You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-issues@hadoop.apache.org by "Andrew Wang (JIRA)" <ji...@apache.org> on 2017/04/21 21:17:04 UTC

[jira] [Commented] (HDFS-11514) DFSTopologyNodeImpl#chooseRandom optimizations

    [ https://issues.apache.org/jira/browse/HDFS-11514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15979393#comment-15979393 ] 

Andrew Wang commented on HDFS-11514:
------------------------------------

Looks like the commit msg JIRA # was typo'd as HDFS-11419.

> DFSTopologyNodeImpl#chooseRandom optimizations
> ----------------------------------------------
>
>                 Key: HDFS-11514
>                 URL: https://issues.apache.org/jira/browse/HDFS-11514
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>          Components: namenode
>            Reporter: Chen Liang
>            Assignee: Chen Liang
>             Fix For: 3.0.0-alpha3
>
>         Attachments: HDFS-11514.001.patch, HDFS-11514.002.patch, HDFS-11514.003.patch
>
>
> Based on the offline discussion, one potential improvement to the {{chooseRandomWithStorageType}} added in HDFS-11482 is that, currently given a node, the method iterates all its children to sum up the number of candidate datanodes. Since datanode status change is much less frequent than block placement request. It is more efficient to get rid of this iteration check, by probably maintaining another disk type counter map. This JIRA tracks (but not limited) this optimization.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org