Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

new feature: S3 Operator Add support for request payer option #5694

Open
1 task
lau-jay opened this issue Mar 4, 2025 · 1 comment
Open
1 task

new feature: S3 Operator Add support for request payer option #5694

lau-jay opened this issue Mar 4, 2025 · 1 comment
Labels
enhancement New feature or request good first issue Good for newcomers services/s3

Comments

@lau-jay
Copy link

lau-jay commented Mar 4, 2025

Feature Description

When accessing S3 buckets that require requester pays, users need to include x-amz-request-payer header in their requests. Currently OpenDAL's S3 service doesn't seem to support this option.

Problem and Solution

Add a new configuration option (e.g. request_payer) for S3 builder

Propagate the payer information by adding x-amz-request-payer: requester header when:

The request_payer option is enabled

Performing any S3 API calls

Additional Context

No response

Are you willing to contribute to the development of this feature?

  • Yes, I am willing to contribute to the development of this feature.
@lau-jay lau-jay added the enhancement New feature or request label Mar 4, 2025
@Xuanwo
Copy link
Member

Xuanwo commented Mar 4, 2025

We can add a config called default_request_payer for s3 like we do for default_storage_class.


Maybe request_payer is enough since we don't have other ways to set request_payer.

@Xuanwo Xuanwo added good first issue Good for newcomers services/s3 labels Mar 4, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request good first issue Good for newcomers services/s3
Projects
None yet
Development

No branches or pull requests

2 participants