[jira] [Resolved] (HDFS-4989) Balancer needs to consider storage type in balancing

["Arpit Agarwal (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/HDFS-4989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Arpit Agarwal resolved HDFS-4989.
---------------------------------
    Resolution: Duplicate

Resolving a duplicate of HDFS-6685 since that one is fixed.

I am sorry about that [~djp]. Some of the HDFS-2832 follow-up tasks that were pushed out were fixed as part of HDFS-6584.

> Balancer needs to consider storage type in balancing
> ----------------------------------------------------
>
>                 Key: HDFS-4989
>                 URL: https://issues.apache.org/jira/browse/HDFS-4989
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>          Components: balancer & mover, datanode, namenode
>            Reporter: Suresh Srinivas
>            Assignee: Junping Du
>
> Balancer needs to balance with in a storage tier. A couple of works:
> - add an option of storageType in balancer CLI to balance data on a specific storage type.
> - add storageType to BalancingPolicy 
> - need new API (getDatanodeReport(StorageType) peer with getDatanodeReport() before) in ClientProtocol to get storage related info from NN so that balancer can choose storages as <source, target> balancing pair.
> - update chooseDatanodes() algorithm to choose storages on the same DN first in setting up <under-utilization, over-load> pairs.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)