You are viewing a plain text version of this content. The canonical link for it is here.

Posted to hdfs-issues@hadoop.apache.org by "Fengnan Li (Jira)" <ji...@apache.org> on 2020/12/29 22:57:00 UTC

[jira] [Created] (HDFS-15754) Create packet metrics for DataNode

Fengnan Li created HDFS-15754:
---------------------------------

             Summary: Create packet metrics for DataNode
                 Key: HDFS-15754
                 URL: https://issues.apache.org/jira/browse/HDFS-15754
             Project: Hadoop HDFS
          Issue Type: Improvement
          Components: datanode
            Reporter: Fengnan Li
            Assignee: Fengnan Li


In BlockReceiver, right now when there is slowness in writeToMirror, writeToDisk and writeToOsCache, it is dumped in the debug log. In practice we have found these are quite useful signal to detect issues in DataNode, so it will be great these metrics can be exposed by JMX.
Also we introduced totalPacket received to use a percentage as a signal to detect the potentially underperforming datanode since datanodes across one HDFS cluster may received different numbers of packets totally.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org