[jira] [Created] (HADOOP-13914) s3guard: improve S3AFileStatus#isEmptyDirectory handling

["Aaron Fabbri (JIRA)" <ji...@apache.org>]

Aaron Fabbri created HADOOP-13914:
-------------------------------------

             Summary: s3guard: improve S3AFileStatus#isEmptyDirectory handling
                 Key: HADOOP-13914
                 URL: https://issues.apache.org/jira/browse/HADOOP-13914
             Project: Hadoop Common
          Issue Type: Sub-task
    Affects Versions: HADOOP-13345
            Reporter: Aaron Fabbri


As discussed in HADOOP-13449, proper support for the isEmptyDirectory() flag stored in S3AFileStatus is missing from DynamoDBMetadataStore.

The approach taken by LocalMetadataStore is not suitable for the DynamoDB implementation, and also sacrifices good code separation to minimize S3AFileSystem changes pre-merge to trunk.

I will attach a design doc that attempts to clearly explain the problem and preferred solution.  I suggest we do this work after merging the HADOOP-13345 branch to trunk, but am open to suggestions.

I can also attach a patch of a integration test that exercises the missing case and demonstrates a failure with DynamoDBMetadataStore.






--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org