You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Prakash Gopalsamy (JIRA)" <ji...@apache.org> on 2019/04/16 12:50:00 UTC
[jira] [Created] (HADOOP-16259) ENHANCE HADOOP DISTCP TO OVERRIDE
DEFAULT S3 STORAGE CLASS
Prakash Gopalsamy created HADOOP-16259:
------------------------------------------
Summary: ENHANCE HADOOP DISTCP TO OVERRIDE DEFAULT S3 STORAGE CLASS
Key: HADOOP-16259
URL: https://issues.apache.org/jira/browse/HADOOP-16259
Project: Hadoop Common
Issue Type: New Feature
Components: hadoop-aws
Affects Versions: 2.8.4
Reporter: Prakash Gopalsamy
Attachments: ENHANCE_HADOOP_DISTCP_FOR_CUSTOM_S3_STORAGE_CLASS.docx
Hadoop distcp implementation doesn’t have properties to override Storage class while transferring data to Amazon S3 storage. Hadoop distcp doesn’t set any storage class while transferring data to Amazon S3 storage. Due to this all the objects moved from cluster to S3 using Hadoop Distcp are been stored in the default storage class “STANDARD”. By providing a new feature to override the default S3 storage class through configuration properties will be helpful to upload objects in other storage classes. I have come up with a design to implement this feature in a design document and uploaded the same in the JIRA. Kindly review and let me know for your suggestions.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-dev-help@hadoop.apache.org