You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "Junping Du (JIRA)" <ji...@apache.org> on 2018/07/19 04:15:00 UTC
[jira] [Comment Edited] (HADOOP-15616) Incorporate Tencent Cloud
COS File System Implementation
[ https://issues.apache.org/jira/browse/HADOOP-15616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16548780#comment-16548780 ]
Junping Du edited comment on HADOOP-15616 at 7/19/18 4:14 AM:
--------------------------------------------------------------
Thank you, Steve! Yes. My colleague and myself will help to maintain this. The initial plan is we will share design and code in next few days for community review. The code has been running in production environment for a while but we are very open for comments and review from community. For test part, if necessary, we can setup some test account for community reviewer. :)
bq. as its a new module, can you put it under hadoop-cloud-storage-project
I noticed most previous work like s3, adl, oss, etc. are all put under hadoop-tools. Do we have plan to move them all to under hadoop-cloud-storage-project?
bq. Anything you can point us to about the store in terms of: consistency, rename performance, atomicity, etc, as in "how close does this come to a filesystem"
That's very key to hadoop behavior over a cloud storage. We will discuss this in our design doc and we can start discussion from that.
bq. not got any time to review this, going to have to find others to do anything...i'll try to keep an eye on the process though.
Understand. Thanks for heads up for our effort here.
was (Author: djp):
Thank you, Steve! Yes. My colleague and myself will help to maintain this. The initial plan is we will share design
and code in next few days for community review. The code has been running in production environment for a while but we are very open for comments and review from community. For test part, if necessary, we can setup some test account for community reviewer. :)
bq. as its a new module, can you put it under hadoop-cloud-storage-project
I noticed most previous work like s3, adl, oss, etc. are all put under hadoop-tools. Do we have plan to move them all to under hadoop-cloud-storage-project?
bq. Anything you can point us to about the store in terms of: consistency, rename performance, atomicity, etc, as in "how close does this come to a filesystem"
That's very key to hadoop behavior over a cloud storage. We will discuss this in our design doc and we can start discussion from that.
bq. not got any time to review this, going to have to find others to do anything...i'll try to keep an eye on the process though.
Understand. Thanks for heads up for our effort here.
> Incorporate Tencent Cloud COS File System Implementation
> --------------------------------------------------------
>
> Key: HADOOP-15616
> URL: https://issues.apache.org/jira/browse/HADOOP-15616
> Project: Hadoop Common
> Issue Type: New Feature
> Components: fs/cos
> Reporter: Junping Du
> Priority: Major
>
> Tencent cloud is top 2 cloud vendors in China market and the object store COS is widely used among China’s cloud users but now it is hard for hadoop user to access data laid on COS storage as no native support for COS in Hadoop.
> This work aims to integrate Tencent cloud COS with Hadoop, just like what we do before for S3, ADL, OSS, etc. With simple configuration, Hadoop applications can read/write data from COS without any code change.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org