You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Krishna Ramachandran (JIRA)" <ji...@apache.org> on 2010/08/11 21:08:16 UTC
[jira] Commented: (MAPREDUCE-152) getMapOutput() keeps failing too
many times before the tasktracker fails
[ https://issues.apache.org/jira/browse/MAPREDUCE-152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12897395#action_12897395 ]
Krishna Ramachandran commented on MAPREDUCE-152:
------------------------------------------------
It has been more than 2 years. Is this still an issue?
> getMapOutput() keeps failing too many times before the tasktracker fails
> ------------------------------------------------------------------------
>
> Key: MAPREDUCE-152
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-152
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Reporter: Yiping Han
> Priority: Critical
>
> We are running a big job on our cluster. There are about 400 reducers. Around 361 reducers finished successfully while the last batch of 39 reducers all failed roughly around the same time. After examining the log files, the following error info was found 858 times for a single tasktracker:
> 2008-04-21 02:42:45,368 WARN org.apache.hadoop.mapred.TaskTracker: getMapOutput(task_200804101742_0001_m_032077_2,396) failed :
> 2008-04-21 02:42:49,468 WARN org.apache.hadoop.mapred.TaskTracker: getMapOutput(task_200804101742_0001_m_032077_2,396) failed :
> 2008-04-21 02:43:03,717 WARN org.apache.hadoop.mapred.TaskTracker: getMapOutput(task_200804101742_0001_m_032077_2,396) failed :
> Shouldn't the task tracker failed early without trying so many times?
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.