You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Allen Wittenauer (JIRA)" <ji...@apache.org> on 2014/07/17 20:59:06 UTC
[jira] [Commented] (MAPREDUCE-618) Need to be able to re-run
specific map tasks (when -reducer NONE)
[ https://issues.apache.org/jira/browse/MAPREDUCE-618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14065373#comment-14065373 ]
Allen Wittenauer commented on MAPREDUCE-618:
--------------------------------------------
I'm tempted to close this because retry logic is way better now. However... isn't this essentially the same request as the various (real) preemption jiras?
> Need to be able to re-run specific map tasks (when -reducer NONE)
> -----------------------------------------------------------------
>
> Key: MAPREDUCE-618
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-618
> Project: Hadoop Map/Reduce
> Issue Type: Improvement
> Reporter: arkady borkovsky
>
> Sometimes, a few map tasks fail and -reducer NONE.
> It should be possible to rerun the failed map tasks .
> There are several failure modes:
> * a task is hanging, so the job is killed
> * from the infrastructure perspective, the task has completed successfully , but it failed to produces correct result
> * failed in the proper Hadoop sense
> It is often too expensive to rerun the whole job. And for larger jobs, chances are each run will have a few failed tasks.
--
This message was sent by Atlassian JIRA
(v6.2#6252)