[jira] [Commented] (HADOOP-12756) Incorporate Aliyun OSS file system implementation

["Yi Liu (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HADOOP-12756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15255929#comment-15255929 ] 

Yi Liu commented on HADOOP-12756:
---------------------------------

Thanks for mingfei and Lei for the work. 

Hi [~stevel@apache.org] and [~cnauroth], regarding testability, they have talked with me offline, Aliyun created an account for the test and they retained the account for Hadoop, they wanted to pass the username/password through "-D" in mvn command. So the basic functionalities could be verified by unit tests.  Does this make sense to you?

Mingfei and Lei:
About the ali-oss client, does it rely on a different version of httpclient? Could we use the version which hadoop is using?

I will post my detailed comments later.



> Incorporate Aliyun OSS file system implementation
> -------------------------------------------------
>
>                 Key: HADOOP-12756
>                 URL: https://issues.apache.org/jira/browse/HADOOP-12756
>             Project: Hadoop Common
>          Issue Type: New Feature
>          Components: fs
>            Reporter: shimingfei
>            Assignee: shimingfei
>         Attachments: 0001-OSS-filesystem-integration-with-Hadoop.patch, HCFS User manual.md, OSS integration.pdf, OSS integration.pdf
>
>
> Aliyun OSS is widely used among China’s cloud users, but currently it is not easy to access data laid on OSS storage from user’s Hadoop/Spark application, because of no original support for OSS in Hadoop.
> This work aims to integrate Aliyun OSS with Hadoop. By simple configuration, Spark/Hadoop applications can read/write data from OSS without any code change. Narrowing the gap between user’s APP and data storage, like what have been done for S3 in Hadoop 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)