You are viewing a plain text version of this content. The canonical link for it is here.

Posted to hdfs-dev@hadoop.apache.org by "Tsz Wo Nicholas Sze (JIRA)" <ji...@apache.org> on 2015/07/28 01:04:05 UTC

[jira] [Created] (HDFS-8824) Do not use small blocks for balancing the cluster

Tsz Wo Nicholas Sze created HDFS-8824:
-----------------------------------------

             Summary: Do not use small blocks for balancing the cluster
                 Key: HDFS-8824
                 URL: https://issues.apache.org/jira/browse/HDFS-8824
             Project: Hadoop HDFS
          Issue Type: Improvement
          Components: balancer & mover
            Reporter: Tsz Wo Nicholas Sze
            Assignee: Tsz Wo Nicholas Sze


Balancer gets datanode block lists from NN and then move the blocks in order to balance the cluster.  It should not use the blocks with small size since moving the small blocks generates a lot of overhead and the small blocks do not help balancing the cluster much.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)