You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "Brahma Reddy Battula (Jira)" <ji...@apache.org> on 2020/07/07 18:38:00 UTC
[jira] [Commented] (HADOOP-16492) Support HuaweiCloud Object
Storage as a Hadoop Backend File System
[ https://issues.apache.org/jira/browse/HADOOP-16492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17152970#comment-17152970 ]
Brahma Reddy Battula commented on HADOOP-16492:
-----------------------------------------------
[~zhongjun] thanks for uploading the design doc..
At first glance
* Looks the docuement states diff between s3a and obs but I didn't any feature difference and perfomance difference. are you planing update on that..?
* looks it's more approiarte to move under "hadoop-cloud-storage-project" instead of the tools.?
* All tests against the live store should have the prefix ITest, not Test, and set up so that they run in the mvn verify stage. And all which can run in parallel do so, for performance. Look at hadoop-azure and hadoop-aws for examples here.
* Please share acount details, so that we can execute the some testcase.
[~junping_du] could look into this, as you recently worked on tencentcloud cos.
> Support HuaweiCloud Object Storage as a Hadoop Backend File System
> ------------------------------------------------------------------
>
> Key: HADOOP-16492
> URL: https://issues.apache.org/jira/browse/HADOOP-16492
> Project: Hadoop Common
> Issue Type: New Feature
> Components: fs
> Affects Versions: 3.4.0
> Reporter: zhongjun
> Priority: Major
> Attachments: Difference Between OBSA and S3A.pdf, HADOOP-16492.001.patch, HADOOP-16492.002.patch, HADOOP-16492.003.patch, HADOOP-16492.004.patch, HADOOP-16492.005.patch, HADOOP-16492.006.patch, HADOOP-16492.007.patch, HADOOP-16492.008.patch, HADOOP-16492.009.patch, HADOOP-16492.010.patch, HADOOP-16492.011.patch, OBSA HuaweiCloud OBS Adapter for Hadoop Support.pdf
>
>
> Added support for HuaweiCloud OBS ([https://www.huaweicloud.com/en-us/product/obs.html]) to Hadoop file system, just like what we do before for S3, ADLS, OSS, etc. With simple configuration, Hadoop applications can read/write data from OBS without any code change.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org