You are viewing a plain text version of this content. The canonical link for it is here.

Posted to common-dev@hadoop.apache.org by "Steve Loughran (JIRA)" <ji...@apache.org> on 2015/09/03 16:19:45 UTC

[jira] [Created] (HADOOP-12376) S3NInputStream.close() downloads the remaining bytes of the object from S3

Steve Loughran created HADOOP-12376:
---------------------------------------

             Summary: S3NInputStream.close() downloads the remaining bytes of the object from S3
                 Key: HADOOP-12376
                 URL: https://issues.apache.org/jira/browse/HADOOP-12376
             Project: Hadoop Common
          Issue Type: Bug
          Components: fs/s3
    Affects Versions: 2.7.1, 2.6.0
            Reporter: Steve Loughran


This is the same as HADOOP-11570, possibly the swift code has the same problem.

Apparently (as raised on ASF lists), when you close an s3n input stream, it
reads through the remainder of the file. This kills performance on partial reads of large files.





--
This message was sent by Atlassian JIRA
(v6.3.4#6332)