You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "Sean Mackrory (JIRA)" <ji...@apache.org> on 2017/04/08 00:39:41 UTC
[jira] [Assigned] (HADOOP-13760) S3Guard: add delete tracking
[ https://issues.apache.org/jira/browse/HADOOP-13760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Sean Mackrory reassigned HADOOP-13760:
--------------------------------------
Assignee: Sean Mackrory
I'm starting on this. I'm adding some tests to ITestS3GuardListConsistency and support for inconsistent deletes to InconcistentS3AClient. Looks like a few comments were left in places where we need to add logic for deletes and I imagine there will be quite a few others in subtle places...
> S3Guard: add delete tracking
> ----------------------------
>
> Key: HADOOP-13760
> URL: https://issues.apache.org/jira/browse/HADOOP-13760
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: fs/s3
> Reporter: Aaron Fabbri
> Assignee: Sean Mackrory
>
> Following the S3AFileSystem integration patch in HADOOP-13651, we need to add delete tracking.
> Current behavior on delete is to remove the metadata from the MetadataStore. To make deletes consistent, we need to add a {{isDeleted}} flag to {{PathMetadata}} and check it when returning results from functions like {{getFileStatus()}} and {{listStatus()}}. In HADOOP-13651, I added TODO comments in most of the places these new conditions are needed. The work does not look too bad.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org