You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "Steve Loughran (Jira)" <ji...@apache.org> on 2022/11/29 15:27:00 UTC

[jira] [Updated] (HADOOP-18281) Tune S3A storage class support

     [ https://issues.apache.org/jira/browse/HADOOP-18281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Steve Loughran updated HADOOP-18281:
------------------------------------
    Target Version/s:   (was: 3.3.5)

> Tune S3A storage class support
> ------------------------------
>
>                 Key: HADOOP-18281
>                 URL: https://issues.apache.org/jira/browse/HADOOP-18281
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: fs/s3
>    Affects Versions: 3.3.5
>            Reporter: Steve Loughran
>            Priority: Minor
>
> Followup to HADOOP-12020, with work/review from rebasing HADOOP-17833 atop it.
> * Can we merge ITestS3AHugeFilesStorageClass into one of the existing test cases? just because it is slow...ideally we want as few of those as possible, even if by testing multiple things at the same we break the rules of testing.
> * move setting the storage class into
> setOptionalMultipartUploadRequestParameters and setOptionalPutRequestParameters
> * both newPutObjectRequest() calls to set storage class
> * docs to list the valid option strings. I had to delve into the AWS SDK to work them out
> Once HADOOP-17833 is in, make this a new option something which can be explicitly used in createFile().
> I've updated PutObjectOptions to pass a value around, and made sure it gets down to to the request factory. that leaves
> * setting the storage class from the options {{CreateFileBuilder}}
> * testing!
> * doc update



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org