You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "wujinhu (JIRA)" <ji...@apache.org> on 2019/02/27 07:49:00 UTC
[jira] [Comment Edited] (HADOOP-15038) Abstract MetadataStore in
S3Guard into a common module.
[ https://issues.apache.org/jira/browse/HADOOP-15038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16779007#comment-16779007 ]
wujinhu edited comment on HADOOP-15038 at 2/27/19 7:48 AM:
-----------------------------------------------------------
Hi [~stevel@apache.org]
[~uncleGen] assigned this task to me, I will do the abstraction work. It seems has been pending for a long time, do you have some suggestions to me? Thanks.
was (Author: wujinhu):
Hi [~stevel@apache.org]
[~uncleGen] assigned this task to me, I will do the abstraction work, do you have some suggestions to me? Thanks.
> Abstract MetadataStore in S3Guard into a common module.
> -------------------------------------------------------
>
> Key: HADOOP-15038
> URL: https://issues.apache.org/jira/browse/HADOOP-15038
> Project: Hadoop Common
> Issue Type: New Feature
> Components: fs
> Affects Versions: 3.0.0-beta1
> Reporter: Genmao Yu
> Assignee: wujinhu
> Priority: Major
>
> Open this JIRA to discuss if we should move {{MetadataStore}} in {{S3Guard}} into a common module.
> Based on this work, other filesystem or object store can implement their own metastore for optimization (known issues like consistency problem and metadata operation performance). [~stevel@apache.org] and other guys have done many base and great works in {{S3Guard}}. It is very helpful to start work. I did some perf test in HADOOP-14098, and started related work for Aliyun OSS. Indeed there are still works to do for {{S3Guard}}, like metadata cache inconsistent with S3 and so on. It also will be a problem for other object store. However, we can do these works in parallel.
> [~stevel@apache.org] [~fabbri] [~drankye] Any suggestion is appreciated.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org