You are viewing a plain text version of this content. The canonical link for it is here.

Posted to hdfs-issues@hadoop.apache.org by "Kai Zheng (JIRA)" <ji...@apache.org> on 2015/08/17 15:57:46 UTC

[jira] [Created] (HDFS-8907) Configurable striping read buffer threhold

Kai Zheng created HDFS-8907:
-------------------------------

             Summary: Configurable striping read buffer threhold
                 Key: HDFS-8907
                 URL: https://issues.apache.org/jira/browse/HDFS-8907
             Project: Hadoop HDFS
          Issue Type: Sub-task
            Reporter: Kai Zheng
            Assignee: Kai Zheng


In striping input stream, positional read merges all the possible strips together, while stateful read reads a strip a time. The former is efficient but may incur too large chunk buffers for a client to afford, the latter is simple good but can be improved for better throughput. This would consolidate the both and use a configurable (new or existing) buffer threshold to control how it goes. Fixed chunk buffers for the read will be allocated accordingly and reused time and time. The aligned strips to read a time may be computed against the threshold. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)