You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Devaraj Das (JIRA)" <ji...@apache.org> on 2007/06/03 08:28:15 UTC
[jira] Created: (HADOOP-1457) Counters for monitoring task
assignments
Counters for monitoring task assignments
----------------------------------------
Key: HADOOP-1457
URL: https://issues.apache.org/jira/browse/HADOOP-1457
Project: Hadoop
Issue Type: Improvement
Components: mapred
Affects Versions: 0.12.3
Reporter: Devaraj Das
Assignee: Devaraj Das
Priority: Minor
Fix For: 0.14.0
For performance reasons, it would be nice to monitor the task assignments to nodes. This is especially true for maps where we want to maximize data-locality-based assignments. Counters could be introduced for that.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-1457) Counters for monitoring task
assignments
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12505460 ]
Hadoop QA commented on HADOOP-1457:
-----------------------------------
Integrated in Hadoop-Nightly #123 (See [http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Nightly/123/])
> Counters for monitoring task assignments
> ----------------------------------------
>
> Key: HADOOP-1457
> URL: https://issues.apache.org/jira/browse/HADOOP-1457
> Project: Hadoop
> Issue Type: Improvement
> Components: mapred
> Affects Versions: 0.12.3
> Reporter: Devaraj Das
> Assignee: Arun C Murthy
> Priority: Minor
> Fix For: 0.14.0
>
> Attachments: HADOOP-1457_1_20070604.patch
>
>
> For performance reasons, it would be nice to monitor the task assignments to nodes. This is especially true for maps where we want to maximize data-locality-based assignments. Counters could be introduced for that.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-1457) Counters for monitoring task
assignments
Posted by "Arun C Murthy (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Arun C Murthy updated HADOOP-1457:
----------------------------------
Attachment: HADOOP-1457_1_20070604.patch
Simple patch which adds job-counters for total launched maps/reduces and 'data-local' maps, these help for e.g. to check percentage of 'data-local' maps as against 'total launched maps' via simon etc.
> Counters for monitoring task assignments
> ----------------------------------------
>
> Key: HADOOP-1457
> URL: https://issues.apache.org/jira/browse/HADOOP-1457
> Project: Hadoop
> Issue Type: Improvement
> Components: mapred
> Affects Versions: 0.12.3
> Reporter: Devaraj Das
> Assignee: Devaraj Das
> Priority: Minor
> Fix For: 0.14.0
>
> Attachments: HADOOP-1457_1_20070604.patch
>
>
> For performance reasons, it would be nice to monitor the task assignments to nodes. This is especially true for maps where we want to maximize data-locality-based assignments. Counters could be introduced for that.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-1457) Counters for monitoring task
assignments
Posted by "Arun C Murthy (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Arun C Murthy updated HADOOP-1457:
----------------------------------
Status: Patch Available (was: Open)
Thanks for the review Devaraj; the whitespaces changes are deliberate and make the code easier to read... should have brought it to attention first-time around of course! :)
> Counters for monitoring task assignments
> ----------------------------------------
>
> Key: HADOOP-1457
> URL: https://issues.apache.org/jira/browse/HADOOP-1457
> Project: Hadoop
> Issue Type: Improvement
> Components: mapred
> Affects Versions: 0.12.3
> Reporter: Devaraj Das
> Assignee: Arun C Murthy
> Priority: Minor
> Fix For: 0.14.0
>
> Attachments: HADOOP-1457_1_20070604.patch
>
>
> For performance reasons, it would be nice to monitor the task assignments to nodes. This is especially true for maps where we want to maximize data-locality-based assignments. Counters could be introduced for that.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-1457) Counters for monitoring task
assignments
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12503514 ]
Hadoop QA commented on HADOOP-1457:
-----------------------------------
+1
http://issues.apache.org/jira/secure/attachment/12358842/HADOOP-1457_1_20070604.patch applied and successfully tested against trunk revision r546192.
Test results: http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch/261/testReport/
Console output: http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch/261/console
> Counters for monitoring task assignments
> ----------------------------------------
>
> Key: HADOOP-1457
> URL: https://issues.apache.org/jira/browse/HADOOP-1457
> Project: Hadoop
> Issue Type: Improvement
> Components: mapred
> Affects Versions: 0.12.3
> Reporter: Devaraj Das
> Assignee: Arun C Murthy
> Priority: Minor
> Fix For: 0.14.0
>
> Attachments: HADOOP-1457_1_20070604.patch
>
>
> For performance reasons, it would be nice to monitor the task assignments to nodes. This is especially true for maps where we want to maximize data-locality-based assignments. Counters could be introduced for that.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Assigned: (HADOOP-1457) Counters for monitoring task
assignments
Posted by "Devaraj Das (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Devaraj Das reassigned HADOOP-1457:
-----------------------------------
Assignee: Arun C Murthy (was: Devaraj Das)
> Counters for monitoring task assignments
> ----------------------------------------
>
> Key: HADOOP-1457
> URL: https://issues.apache.org/jira/browse/HADOOP-1457
> Project: Hadoop
> Issue Type: Improvement
> Components: mapred
> Affects Versions: 0.12.3
> Reporter: Devaraj Das
> Assignee: Arun C Murthy
> Priority: Minor
> Fix For: 0.14.0
>
> Attachments: HADOOP-1457_1_20070604.patch
>
>
> For performance reasons, it would be nice to monitor the task assignments to nodes. This is especially true for maps where we want to maximize data-locality-based assignments. Counters could be introduced for that.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-1457) Counters for monitoring task
assignments
Posted by "Tom White (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Tom White updated HADOOP-1457:
------------------------------
Resolution: Fixed
Status: Resolved (was: Patch Available)
I've just committed this. Thanks Arun!
> Counters for monitoring task assignments
> ----------------------------------------
>
> Key: HADOOP-1457
> URL: https://issues.apache.org/jira/browse/HADOOP-1457
> Project: Hadoop
> Issue Type: Improvement
> Components: mapred
> Affects Versions: 0.12.3
> Reporter: Devaraj Das
> Assignee: Arun C Murthy
> Priority: Minor
> Fix For: 0.14.0
>
> Attachments: HADOOP-1457_1_20070604.patch
>
>
> For performance reasons, it would be nice to monitor the task assignments to nodes. This is especially true for maps where we want to maximize data-locality-based assignments. Counters could be introduced for that.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-1457) Counters for monitoring task
assignments
Posted by "Devaraj Das (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12502269 ]
Devaraj Das commented on HADOOP-1457:
-------------------------------------
Looks good except some white space changes which can be removed.
> Counters for monitoring task assignments
> ----------------------------------------
>
> Key: HADOOP-1457
> URL: https://issues.apache.org/jira/browse/HADOOP-1457
> Project: Hadoop
> Issue Type: Improvement
> Components: mapred
> Affects Versions: 0.12.3
> Reporter: Devaraj Das
> Assignee: Arun C Murthy
> Priority: Minor
> Fix For: 0.14.0
>
> Attachments: HADOOP-1457_1_20070604.patch
>
>
> For performance reasons, it would be nice to monitor the task assignments to nodes. This is especially true for maps where we want to maximize data-locality-based assignments. Counters could be introduced for that.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.