You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Owen O'Malley (JIRA)" <ji...@apache.org> on 2006/03/23 09:14:13 UTC
[jira] Created: (HADOOP-98) The JobTracker's count of the number of
running maps and reduces is wrong
The JobTracker's count of the number of running maps and reduces is wrong
-------------------------------------------------------------------------
Key: HADOOP-98
URL: http://issues.apache.org/jira/browse/HADOOP-98
Project: Hadoop
Type: Bug
Components: mapred
Versions: 0.1
Reporter: Owen O'Malley
Assigned to: Owen O'Malley
Fix For: 0.1
When a heatbeat comes in from a task tracker, the job tracker just adds the number of currently running maps and reduces. The jobs from the previous heartbear are never subtracted. This causes the scheduling to misjudge the "loading" levels of the task trackers.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see:
http://www.atlassian.com/software/jira
[jira] Updated: (HADOOP-98) The JobTracker's count of the number of
running maps and reduces is wrong
Posted by "Owen O'Malley (JIRA)" <ji...@apache.org>.
[ http://issues.apache.org/jira/browse/HADOOP-98?page=all ]
Owen O'Malley updated HADOOP-98:
--------------------------------
Attachment: task-counter.patch
This patch consolidate all of the places where status was put in to or out of the taskTrackers status map, so that
the counts of maps and reduces are maintained consistently.
I also added the cluster status to the webapp so that you can get a quick view of how busy the cluster is.
> The JobTracker's count of the number of running maps and reduces is wrong
> -------------------------------------------------------------------------
>
> Key: HADOOP-98
> URL: http://issues.apache.org/jira/browse/HADOOP-98
> Project: Hadoop
> Type: Bug
> Components: mapred
> Versions: 0.1
> Reporter: Owen O'Malley
> Assignee: Owen O'Malley
> Fix For: 0.1
> Attachments: task-counter.patch
>
> When a heatbeat comes in from a task tracker, the job tracker just adds the number of currently running maps and reduces. The jobs from the previous heartbear are never subtracted. This causes the scheduling to misjudge the "loading" levels of the task trackers.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see:
http://www.atlassian.com/software/jira
[jira] Resolved: (HADOOP-98) The JobTracker's count of the number
of running maps and reduces is wrong
Posted by "Doug Cutting (JIRA)" <ji...@apache.org>.
[ http://issues.apache.org/jira/browse/HADOOP-98?page=all ]
Doug Cutting resolved HADOOP-98:
--------------------------------
Resolution: Fixed
This looks great. I just committed it. Thanks, Owen.
> The JobTracker's count of the number of running maps and reduces is wrong
> -------------------------------------------------------------------------
>
> Key: HADOOP-98
> URL: http://issues.apache.org/jira/browse/HADOOP-98
> Project: Hadoop
> Type: Bug
> Components: mapred
> Versions: 0.1
> Reporter: Owen O'Malley
> Assignee: Owen O'Malley
> Fix For: 0.1
> Attachments: task-counter.patch
>
> When a heatbeat comes in from a task tracker, the job tracker just adds the number of currently running maps and reduces. The jobs from the previous heartbear are never subtracted. This causes the scheduling to misjudge the "loading" levels of the task trackers.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see:
http://www.atlassian.com/software/jira