You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "Daniel Carl Jones (Jira)" <ji...@apache.org> on 2022/02/07 10:39:00 UTC

[jira] [Commented] (HADOOP-14661) S3A to support Requester Pays Buckets

    [ https://issues.apache.org/jira/browse/HADOOP-14661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17488019#comment-17488019 ] 

Daniel Carl Jones commented on HADOOP-14661:
--------------------------------------------

I'd like to pick this ticket up if that's OK.

 

It looks fairly straight forward, though I have some questions about pre-existing requester pays flags in the code base that aren't yet hooked up.

There's a flag in [S3ClientCreationParameters|https://github.com/apache/hadoop/blob/trunk/hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/S3ClientFactory.java#L103-L106] (added March 2021) and another in [RequestFactoryImpl|https://github.com/apache/hadoop/blob/trunk/hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/impl/RequestFactoryImpl.java#L109-L114] (added May 2021, as part of auditor changes). Is there a preference which one should be hooked up?

> S3A to support Requester Pays Buckets
> -------------------------------------
>
>                 Key: HADOOP-14661
>                 URL: https://issues.apache.org/jira/browse/HADOOP-14661
>             Project: Hadoop Common
>          Issue Type: Sub-task
>          Components: common, util
>    Affects Versions: 3.0.0-alpha3
>            Reporter: Mandus Momberg
>            Assignee: Mandus Momberg
>            Priority: Minor
>         Attachments: HADOOP-14661.patch
>
>   Original Estimate: 2h
>  Remaining Estimate: 2h
>
> Amazon S3 has the ability to charge the requester for the cost of accessing S3. This is called Requester Pays Buckets. 
> In order to access these buckets, each request needs to be signed with a specific header. 
> http://docs.aws.amazon.com/AmazonS3/latest/dev/RequesterPaysBuckets.html



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org