[jira] [Created] (HDFS-11634) Optimize BlockIterator when interating starts in the middle.

["Konstantin Shvachko (JIRA)" <ji...@apache.org>]

Konstantin Shvachko created HDFS-11634:
------------------------------------------

             Summary: Optimize BlockIterator when interating starts in the middle.
                 Key: HDFS-11634
                 URL: https://issues.apache.org/jira/browse/HDFS-11634
             Project: Hadoop HDFS
          Issue Type: Improvement
    Affects Versions: 2.6.5
            Reporter: Konstantin Shvachko
            Assignee: Konstantin Shvachko


{{BlockManager.getBlocksWithLocations()}} needs to iterate blocks from a randomly selected {{startBlock}} index. It creates an iterator which points to the first block and then skips all blocks until {{startBlock}}. It is inefficient when DN has multiple storages. Instead of skipping blocks one by one we can skip entire storages. Should be more efficient on average.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org