You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Allen Wittenauer (JIRA)" <ji...@apache.org> on 2014/07/18 00:12:06 UTC
[jira] [Resolved] (MAPREDUCE-152) getMapOutput() keeps failing too
many times before the tasktracker fails
[ https://issues.apache.org/jira/browse/MAPREDUCE-152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Allen Wittenauer resolved MAPREDUCE-152.
----------------------------------------
Resolution: Incomplete
At this point, lots of have changed have happened. So closing this as stale.
> getMapOutput() keeps failing too many times before the tasktracker fails
> ------------------------------------------------------------------------
>
> Key: MAPREDUCE-152
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-152
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Reporter: Yiping Han
>
> We are running a big job on our cluster. There are about 400 reducers. Around 361 reducers finished successfully while the last batch of 39 reducers all failed roughly around the same time. After examining the log files, the following error info was found 858 times for a single tasktracker:
> 2008-04-21 02:42:45,368 WARN org.apache.hadoop.mapred.TaskTracker: getMapOutput(task_200804101742_0001_m_032077_2,396) failed :
> 2008-04-21 02:42:49,468 WARN org.apache.hadoop.mapred.TaskTracker: getMapOutput(task_200804101742_0001_m_032077_2,396) failed :
> 2008-04-21 02:43:03,717 WARN org.apache.hadoop.mapred.TaskTracker: getMapOutput(task_200804101742_0001_m_032077_2,396) failed :
> Shouldn't the task tracker failed early without trying so many times?
--
This message was sent by Atlassian JIRA
(v6.2#6252)