You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "Ming Ma (JIRA)" <ji...@apache.org> on 2012/08/16 02:58:37 UTC
[jira] [Updated] (HADOOP-8706) Provide rate metrics based on
counter value
[ https://issues.apache.org/jira/browse/HADOOP-8706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ming Ma updated HADOOP-8706:
----------------------------
Attachment: HADOOP-8706.patch
Here is the patch. It defines a new metrics type MutableCounterLongRate.
For most usage cases of MutableCounterLong in HDFS, it seems more useful to express in terms of ops / sec. We can change it to use the new metrics type MutableCounterLongRate.
Alternatively, we can have MutableCounterLong push out two values to the metrics sink, one is the current counter value, another one is ops / sec.
> Provide rate metrics based on counter value
> -------------------------------------------
>
> Key: HADOOP-8706
> URL: https://issues.apache.org/jira/browse/HADOOP-8706
> Project: Hadoop Common
> Issue Type: Improvement
> Components: metrics
> Reporter: Ming Ma
> Attachments: HADOOP-8706.patch
>
>
> In production clusters, it is more useful to have ops / sec instead of increasing counter value. Take NameNodeMetrics.getBlockLocations as an example, its current type is MutableCounterLong and thus the value is increasing all the time. Quite often "num of getBlockLocations" per second is more interesting for analysis. Further I found most of the MutableCounterLong in NamenodeMetrics and DataNodeMetrics are more useful if they are expressed in terms of ops / sec.
> I looked at all the metrics objects provided in metrics 2.0, couldn't find such type.
> FYI, hbase has its own MetricsRate object based on metrics 1.0 for this purpose.
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira