You are viewing a plain text version of this content. The canonical link for it is here.

Posted to common-issues@hadoop.apache.org by "Steve Loughran (JIRA)" <ji...@apache.org> on 2016/06/20 13:30:05 UTC

[jira] [Created] (HADOOP-13293) add a special 0 byte input stream for empty blobs

Steve Loughran created HADOOP-13293:
---------------------------------------

             Summary: add a special 0 byte input stream for empty blobs
                 Key: HADOOP-13293
                 URL: https://issues.apache.org/jira/browse/HADOOP-13293
             Project: Hadoop Common
          Issue Type: Sub-task
          Components: fs/s3
    Affects Versions: 2.8.0
            Reporter: Steve Loughran
            Priority: Minor


S3a (and the other object stores) have a lot of IO going on, even for 0 byte files. They don't need to: that's a special case which can be handled locally. A special ZeroByteInputStream class could handle this for all the object stores.

This isn't much of an optimization: code shouldn't normally need to go through 0 byte files, but we see evidence it does sometimes happen.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org