You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Robert Chansler (JIRA)" <ji...@apache.org> on 2009/03/03 20:00:57 UTC

[jira] Updated: (HADOOP-3422) Ganglia counter metrics are all reported with the metric name "value", so the counter values can not be seen

     [ https://issues.apache.org/jira/browse/HADOOP-3422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Robert Chansler updated HADOOP-3422:
------------------------------------

    Release Note: Changed names of ganglia metrics to avoid conflicts and to better identify source function.  (was: Produce ganglia metrics with names of the form:
jvm.metrics.*
mapred.job.Job Counters .*
mapred.job.Map-Reduce Framework.*
mapred.job.Map-Reduce Framework.*
mapred.job.Map-Reduce Framework.*
mapred.jobtracker.*
mapred.shuffleInput.*
mapred.tasktracker.*

instead of just using the last token name, or in the case of Per Job Counters, the string value, for all counters.

The net result of this change is that the metrics names make it clear which part of hadoop is reporting, and the counter values each have their own RRD file instead of all the counters being aggregated under the name "value")
    Hadoop Flags: [Incompatible change, Reviewed]  (was: [Reviewed])

Edit release note for publication.

jvm.metrics.*
mapred.job.Job Counters .*
mapred.job.Map-Reduce Framework.*
mapred.job.Map-Reduce Framework.*
mapred.job.Map-Reduce Framework.*
mapred.jobtracker.*
mapred.shuffleInput.*
mapred.tasktracker.*

instead of just using the last token name, or in the case of Per Job Counters, the string value, for all counters.

The net result of this change is that the metrics names make it clear which part of hadoop is reporting, and the counter values each have their own RRD file instead of all the counters being aggregated under the name "value"

> Ganglia counter metrics are all reported with the metric name "value", so the counter values can not be seen
> ------------------------------------------------------------------------------------------------------------
>
>                 Key: HADOOP-3422
>                 URL: https://issues.apache.org/jira/browse/HADOOP-3422
>             Project: Hadoop Core
>          Issue Type: Bug
>          Components: metrics
>    Affects Versions: 0.17.2, 0.18.0, 0.18.1, 0.18.2
>            Reporter: Jason
>            Assignee: stack
>             Fix For: 0.20.0
>
>         Attachments: diff-20080520-1025.txt, ganglia-patch-3422-and-4137.patch, ganglia-patch-3422-and-4137.patch, ganglia-patch-3422-qand-4137-1.patch, ganglia-patch-3422-updated-v2.patch, ganglia-patch-3422-updated.patch
>
>   Original Estimate: 1h
>  Remaining Estimate: 1h
>
> The JobInProgress class reports all metrics with the name "value". The FileMetrics class puts all of the tags into the name when reporting the individual values, but the Ganglia Context does not put the tags into the name..
> This patch modifies the context to build names for the counter metrics out of the tag values. This enables the user to see the indivdual counter values with the ganglia web tool, on a per job basis

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.