[jira] [Created] (HDFS-8874) Add DN metrics for balancer and other block movement scenarios

["Ming Ma (JIRA)" <ji...@apache.org>]

Ming Ma created HDFS-8874:
-----------------------------

             Summary: Add DN metrics for balancer and other block movement scenarios
                 Key: HDFS-8874
                 URL: https://issues.apache.org/jira/browse/HDFS-8874
             Project: Hadoop HDFS
          Issue Type: Improvement
            Reporter: Ming Ma
            Assignee: Chris Trezzo


For balancer, mover and migrator (HDFS-8789), we want to know how close it is to the DN's throttling thresholds. Although DN has existing metrics such as {{BytesWritten}}, {{BytesRead}}, {{CopyBlockOpNumOps}} and {{ReplaceBlockOpNumOps}}, there is no metrics to indicate the number of bytes moved.

We can add {{ReplaceBlockBytesWritten}} and {{CopyBlockBytesRead}} to account for the bytes moved in ReplaceBlock and CopyBlock operations. In addition, we can also add throttling metrics for {{DataTransferThrottler}} and {{BlockBalanceThrottler}}.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)