You are viewing a plain text version of this content. The canonical link for it is here.

Posted to hdfs-dev@hadoop.apache.org by "ZanderXu (Jira)" <ji...@apache.org> on 2022/07/21 14:21:00 UTC

[jira] [Created] (HDFS-16678) RBF supports disable getNodeUsage() in RBFMetrics

ZanderXu created HDFS-16678:
-------------------------------

             Summary: RBF supports disable getNodeUsage() in RBFMetrics
                 Key: HDFS-16678
                 URL: https://issues.apache.org/jira/browse/HDFS-16678
             Project: Hadoop HDFS
          Issue Type: Improvement
            Reporter: ZanderXu
            Assignee: ZanderXu


In our prod environment, we try to collect RBF metrics every 15s through jmx_exporter. And we found that collection task often failed. 

After tracing and found that the collection task is blocked at getNodeUsage() in RBFMetrics, because it will collection all datanode's usage from downstream nameservices.  This is a very expensive and almost useless operation. Because in most scenarios, each NameSerivce contains almost the same DNs. We can get the data usage's from any one nameservices, not from RBF.

So I feel that RBF should supports disable getNodeUsage() in RBFMetrics.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org