You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "wujinhu (JIRA)" <ji...@apache.org> on 2019/03/12 01:44:00 UTC
[jira] [Comment Edited] (HADOOP-15038) Abstract MetadataStore in
S3Guard into a common module.
[ https://issues.apache.org/jira/browse/HADOOP-15038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16790120#comment-16790120 ]
wujinhu edited comment on HADOOP-15038 at 3/12/19 1:43 AM:
-----------------------------------------------------------
Yes，[~stevel@apache.org] I am writing and testing ms for OSS connector, we will continue this process when HADOOP-15619 is ready.
was (Author: wujinhu):
Yes，[~stevel@apache.org] I am writing and testing ms for OSS connector, we will continue this process until HADOOP-15619 is ready.
> Abstract MetadataStore in S3Guard into a common module.
> -------------------------------------------------------
>
> Key: HADOOP-15038
> URL: https://issues.apache.org/jira/browse/HADOOP-15038
> Project: Hadoop Common
> Issue Type: New Feature
> Components: fs
> Affects Versions: 3.2.0, 2.9.2, 3.0.3, 3.1.2
> Reporter: Genmao Yu
> Assignee: wujinhu
> Priority: Major
> Attachments: HADOOP-15038.001.patch
>
>
> Open this JIRA to discuss if we should move {{MetadataStore}} in {{S3Guard}} into a common module.
> Based on this work, other filesystem or object store can implement their own metastore for optimization (known issues like consistency problem and metadata operation performance). [~stevel@apache.org] and other guys have done many base and great works in {{S3Guard}}. It is very helpful to start work. I did some perf test in HADOOP-14098, and started related work for Aliyun OSS. Indeed there are still works to do for {{S3Guard}}, like metadata cache inconsistent with S3 and so on. It also will be a problem for other object store. However, we can do these works in parallel.
> [~stevel@apache.org] [~fabbri] [~drankye] Any suggestion is appreciated.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org