You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Jason Lowe (JIRA)" <ji...@apache.org> on 2012/06/05 00:13:22 UTC
[jira] [Created] (MAPREDUCE-4312) Add metrics to RM for NM
heartbeats
Jason Lowe created MAPREDUCE-4312:
-------------------------------------
Summary: Add metrics to RM for NM heartbeats
Key: MAPREDUCE-4312
URL: https://issues.apache.org/jira/browse/MAPREDUCE-4312
Project: Hadoop Map/Reduce
Issue Type: Improvement
Components: mrv2, resourcemanager
Affects Versions: 2.0.0-alpha
Reporter: Jason Lowe
Priority: Minor
It would be nice to have a metric in the ResourceManager to track the number of NodeManager heartbeats processed. The JobTracker in 1.0 has a tasktracker heartbeat metric, and it would be nice if the RM had the equivalent metric.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-4312) Add metrics to RM for NM
heartbeats
Posted by "Jason Lowe (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jason Lowe updated MAPREDUCE-4312:
----------------------------------
Attachment: MAPREDUCE-4312.patch
Patch to add node heartbeat metric to ClusterMetrics.
> Add metrics to RM for NM heartbeats
> -----------------------------------
>
> Key: MAPREDUCE-4312
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4312
> Project: Hadoop Map/Reduce
> Issue Type: Improvement
> Components: mrv2, resourcemanager
> Affects Versions: 2.0.0-alpha
> Reporter: Jason Lowe
> Priority: Minor
> Attachments: MAPREDUCE-4312.patch
>
>
> It would be nice to have a metric in the ResourceManager to track the number of NodeManager heartbeats processed. The JobTracker in 1.0 has a tasktracker heartbeat metric, and it would be nice if the RM had the equivalent metric.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-4312) Add metrics to RM for NM
heartbeats
Posted by "Jason Lowe (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jason Lowe updated MAPREDUCE-4312:
----------------------------------
Resolution: Not A Problem
Status: Resolved (was: Patch Available)
Closing since these metrics are available in the detailed RPC metrics under NodeHeartbeatNumOps and NodeHeartbeatAvgTime.
Missed this originally because the RPC detailed metrics for node heartbeats aren't showing up for me on 0.23. I'll investigate the cause and file a separate JIRA if necessary.
> Add metrics to RM for NM heartbeats
> -----------------------------------
>
> Key: MAPREDUCE-4312
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4312
> Project: Hadoop Map/Reduce
> Issue Type: Improvement
> Components: mrv2, resourcemanager
> Affects Versions: 2.0.0-alpha
> Reporter: Jason Lowe
> Assignee: Jason Lowe
> Priority: Minor
> Attachments: MAPREDUCE-4312.patch
>
>
> It would be nice to have a metric in the ResourceManager to track the number of NodeManager heartbeats processed. The JobTracker in 1.0 has a tasktracker heartbeat metric, and it would be nice if the RM had the equivalent metric.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-4312) Add metrics to RM for NM
heartbeats
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13289518#comment-13289518 ]
Hadoop QA commented on MAPREDUCE-4312:
--------------------------------------
+1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12530973/MAPREDUCE-4312.patch
against trunk revision .
+1 @author. The patch does not contain any @author tags.
+1 tests included. The patch appears to include 1 new or modified test files.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
+1 javadoc. The javadoc tool did not generate any warning messages.
+1 eclipse:eclipse. The patch built with eclipse:eclipse.
+1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.
+1 release audit. The applied patch does not increase the total number of release audit warnings.
+1 core tests. The patch passed unit tests in hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager.
+1 contrib tests. The patch passed contrib unit tests.
Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2438//testReport/
Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2438//console
This message is automatically generated.
> Add metrics to RM for NM heartbeats
> -----------------------------------
>
> Key: MAPREDUCE-4312
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4312
> Project: Hadoop Map/Reduce
> Issue Type: Improvement
> Components: mrv2, resourcemanager
> Affects Versions: 2.0.0-alpha
> Reporter: Jason Lowe
> Assignee: Jason Lowe
> Priority: Minor
> Attachments: MAPREDUCE-4312.patch
>
>
> It would be nice to have a metric in the ResourceManager to track the number of NodeManager heartbeats processed. The JobTracker in 1.0 has a tasktracker heartbeat metric, and it would be nice if the RM had the equivalent metric.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Assigned] (MAPREDUCE-4312) Add metrics to RM for NM
heartbeats
Posted by "Jason Lowe (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jason Lowe reassigned MAPREDUCE-4312:
-------------------------------------
Assignee: Jason Lowe
> Add metrics to RM for NM heartbeats
> -----------------------------------
>
> Key: MAPREDUCE-4312
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4312
> Project: Hadoop Map/Reduce
> Issue Type: Improvement
> Components: mrv2, resourcemanager
> Affects Versions: 2.0.0-alpha
> Reporter: Jason Lowe
> Assignee: Jason Lowe
> Priority: Minor
> Attachments: MAPREDUCE-4312.patch
>
>
> It would be nice to have a metric in the ResourceManager to track the number of NodeManager heartbeats processed. The JobTracker in 1.0 has a tasktracker heartbeat metric, and it would be nice if the RM had the equivalent metric.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-4312) Add metrics to RM for NM
heartbeats
Posted by "Jason Lowe (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jason Lowe updated MAPREDUCE-4312:
----------------------------------
Target Version/s: 0.23.3, 2.0.1-alpha
Status: Patch Available (was: Open)
> Add metrics to RM for NM heartbeats
> -----------------------------------
>
> Key: MAPREDUCE-4312
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4312
> Project: Hadoop Map/Reduce
> Issue Type: Improvement
> Components: mrv2, resourcemanager
> Affects Versions: 2.0.0-alpha
> Reporter: Jason Lowe
> Priority: Minor
> Attachments: MAPREDUCE-4312.patch
>
>
> It would be nice to have a metric in the ResourceManager to track the number of NodeManager heartbeats processed. The JobTracker in 1.0 has a tasktracker heartbeat metric, and it would be nice if the RM had the equivalent metric.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira