You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Prakash Gopalsamy (JIRA)" <ji...@apache.org> on 2019/04/16 12:50:00 UTC

[jira] [Created] (HADOOP-16259) ENHANCE HADOOP DISTCP TO OVERRIDE DEFAULT S3 STORAGE CLASS

Prakash Gopalsamy created HADOOP-16259:
------------------------------------------

             Summary: ENHANCE HADOOP DISTCP TO OVERRIDE DEFAULT S3 STORAGE CLASS
                 Key: HADOOP-16259
                 URL: https://issues.apache.org/jira/browse/HADOOP-16259
             Project: Hadoop Common
          Issue Type: New Feature
          Components: hadoop-aws
    Affects Versions: 2.8.4
            Reporter: Prakash Gopalsamy
         Attachments: ENHANCE_HADOOP_DISTCP_FOR_CUSTOM_S3_STORAGE_CLASS.docx

Hadoop distcp implementation doesn’t have properties to override Storage class while transferring data to Amazon S3 storage. Hadoop distcp doesn’t set any storage class while transferring data to Amazon S3 storage. Due to this all the objects moved from cluster to S3 using Hadoop Distcp are been stored in the default storage class “STANDARD”. By providing a new feature to override the default S3 storage class through configuration properties will be helpful to upload objects in other storage classes. I have come up with a design to implement this feature in a design document and uploaded the same in the JIRA. Kindly review and let me know for your suggestions.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-dev-help@hadoop.apache.org