You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Allen Wittenauer (JIRA)" <ji...@apache.org> on 2010/06/09 00:36:11 UTC
[jira] Created: (MAPREDUCE-1847) capacity scheduler job tasks
summaries are wrong if nodes fail
capacity scheduler job tasks summaries are wrong if nodes fail
--------------------------------------------------------------
Key: MAPREDUCE-1847
URL: https://issues.apache.org/jira/browse/MAPREDUCE-1847
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: contrib/capacity-sched
Reporter: Allen Wittenauer
Priority: Minor
The Job Scheduling Information the web UI is needs to be re-computed in case nodes fail. Otherwise it will report tasks are running that are not.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1847) capacity scheduler job tasks
summaries are wrong if nodes fail
Posted by "Allen Wittenauer (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12876845#action_12876845 ]
Allen Wittenauer commented on MAPREDUCE-1847:
---------------------------------------------
This is on jobtracker.jsp, not jobdetails.jsp.
> capacity scheduler job tasks summaries are wrong if nodes fail
> --------------------------------------------------------------
>
> Key: MAPREDUCE-1847
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1847
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: contrib/capacity-sched
> Reporter: Allen Wittenauer
> Priority: Minor
>
> The Job Scheduling Information the web UI is needs to be re-computed in case nodes fail. Otherwise it will report tasks are running that are not.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1847) capacity scheduler job tasks
summaries are wrong if nodes fail
Posted by "Arun C Murthy (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12876846#action_12876846 ]
Arun C Murthy commented on MAPREDUCE-1847:
------------------------------------------
Looks like a familiar bug... I assume this was on the job 'row'?
> capacity scheduler job tasks summaries are wrong if nodes fail
> --------------------------------------------------------------
>
> Key: MAPREDUCE-1847
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1847
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: contrib/capacity-sched
> Reporter: Allen Wittenauer
> Priority: Minor
>
> The Job Scheduling Information the web UI is needs to be re-computed in case nodes fail. Otherwise it will report tasks are running that are not.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1847) capacity scheduler job tasks
summaries are wrong if nodes fail
Posted by "Allen Wittenauer (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12876842#action_12876842 ]
Allen Wittenauer commented on MAPREDUCE-1847:
---------------------------------------------
While doing some work on the grid, I killed 4 task trackers. For one particular task, the summary information still believed that tasks were running on those nodes:
6 running reduce tasks using 6 reduce slots.
This was clearly impossible, as there were only 2 pending reduce tasks that still had to be recomputed. The map task summary information was correct.
> capacity scheduler job tasks summaries are wrong if nodes fail
> --------------------------------------------------------------
>
> Key: MAPREDUCE-1847
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1847
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: contrib/capacity-sched
> Reporter: Allen Wittenauer
> Priority: Minor
>
> The Job Scheduling Information the web UI is needs to be re-computed in case nodes fail. Otherwise it will report tasks are running that are not.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1847) capacity scheduler job tasks
summaries are wrong if nodes fail
Posted by "Allen Wittenauer (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12876850#action_12876850 ]
Allen Wittenauer commented on MAPREDUCE-1847:
---------------------------------------------
Yes.
The total cluster summary was correct.
> capacity scheduler job tasks summaries are wrong if nodes fail
> --------------------------------------------------------------
>
> Key: MAPREDUCE-1847
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1847
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: contrib/capacity-sched
> Reporter: Allen Wittenauer
> Priority: Minor
>
> The Job Scheduling Information the web UI is needs to be re-computed in case nodes fail. Otherwise it will report tasks are running that are not.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.