You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-issues@hadoop.apache.org by "Chris Trezzo (JIRA)" <ji...@apache.org> on 2017/03/29 21:48:41 UTC
[jira] [Updated] (HDFS-8874) Add DN metrics for balancer and other
block movement scenarios
[ https://issues.apache.org/jira/browse/HDFS-8874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Chris Trezzo updated HDFS-8874:
-------------------------------
Attachment: HDFS-8874-trunk.005.patch
Rebased and attached v5 for trunk.
> Add DN metrics for balancer and other block movement scenarios
> --------------------------------------------------------------
>
> Key: HDFS-8874
> URL: https://issues.apache.org/jira/browse/HDFS-8874
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Reporter: Ming Ma
> Assignee: Chris Trezzo
> Attachments: HDFS-8874-trunk.005.patch, HDFS-8874-trunk-v1.patch, HDFS-8874-trunk-v2.patch, HDFS-8874-trunk-v3.patch, HDFS-8874-trunk-v4.patch
>
>
> For balancer, mover and migrator (HDFS-8789), we want to know how close it is to the DN's throttling thresholds. Although DN has existing metrics such as {{BytesWritten}}, {{BytesRead}}, {{CopyBlockOpNumOps}} and {{ReplaceBlockOpNumOps}}, there is no metrics to indicate the number of bytes moved.
> We can add {{ReplaceBlockBytesWritten}} and {{CopyBlockBytesRead}} to account for the bytes moved in ReplaceBlock and CopyBlock operations. In addition, we can also add throttling metrics for {{DataTransferThrottler}} and {{BlockBalanceThrottler}}.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org