You are viewing a plain text version of this content. The canonical link for it is here.

Posted to hdfs-dev@hadoop.apache.org by "David Mollitor (Jira)" <ji...@apache.org> on 2019/09/24 13:35:00 UTC

[jira] [Created] (HDFS-14872) Read HDFS Blocks in Random Order

David Mollitor created HDFS-14872:
-------------------------------------

             Summary: Read HDFS Blocks in Random Order
                 Key: HDFS-14872
                 URL: https://issues.apache.org/jira/browse/HDFS-14872
             Project: Hadoop HDFS
          Issue Type: New Feature
          Components: hdfs-client
    Affects Versions: 3.2.1, 2.8.5
            Reporter: David Mollitor


When the HDFS client is downloading (copying) an entire file, allow the client to download the blocks in random order.  If a lot of clients are reading the same file, in parallel, they will all download the first block, the second block, and so on, stampeding down the line.

It would be interesting to spread the load across across all the available DataNodes.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org