You are viewing a plain text version of this content. The canonical link for it is here.

Posted to common-dev@hadoop.apache.org by "Mark J Greene (JIRA)" <ji...@apache.org> on 2014/04/13 16:17:15 UTC

[jira] [Created] (HADOOP-10494) Ensure Jets3tFileSystemStore respects URI path for block files

Mark J Greene created HADOOP-10494:
--------------------------------------

             Summary: Ensure Jets3tFileSystemStore respects URI path for block files
                 Key: HADOOP-10494
                 URL: https://issues.apache.org/jira/browse/HADOOP-10494
             Project: Hadoop Common
          Issue Type: Improvement
          Components: fs
            Reporter: Mark J Greene
            Priority: Trivial


The Jets3tFileSystemStore will currently store all block files in the root of an S3 bucket. If you specify a path in your OutputFormat, those paths are created, and some of the supporting meta files are stored there, but all block files will reside in the root of the bucket.

We tracked this down to this method here, which does not use the provided URI from the the job: https://github.com/apache/hadoop-common/blob/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/s3/Jets3tFileSystemStore.java#L381





--
This message was sent by Atlassian JIRA
(v6.2#6252)