You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Amar Kamat (JIRA)" <ji...@apache.org> on 2009/11/10 11:00:27 UTC
[jira] Commented: (MAPREDUCE-1199) TaskInProgress should also
consider blacklisted node while (re)scheduling failed tasks
[ https://issues.apache.org/jira/browse/MAPREDUCE-1199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12775360#action_12775360 ]
Amar Kamat commented on MAPREDUCE-1199:
---------------------------------------
Consider an example where the cluster has 3 tasktrackers (t1,t2 and t3) and a tip tip1 runs on t1 and fails. Now the tip1 is rescheduled on t2 and fails again. Now if tracker t1 is blacklisted, then t1 will be removed from the active tracker list. Now if tracker t2 asks for a task, tip1 will be scheduled on it as the total count of active tracker = 2 (t2, t3) and total-tip-failures = 2 (t1, t2) is same.
> TaskInProgress should also consider blacklisted node while (re)scheduling failed tasks
> --------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-1199
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1199
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: jobtracker
> Affects Versions: 0.22.0
> Reporter: Amar Kamat
>
> While rescheduling failed tasks, only the failure count is used. It should also consider the blacklisted trackers information too.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.