You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Amareshwari Sriramadasu (JIRA)" <ji...@apache.org> on 2009/06/19 07:57:07 UTC
[jira] Created: (HADOOP-6088) Task stuck in cleanup with
OutOfMemoryErrors
Task stuck in cleanup with OutOfMemoryErrors
--------------------------------------------
Key: HADOOP-6088
URL: https://issues.apache.org/jira/browse/HADOOP-6088
Project: Hadoop Core
Issue Type: Bug
Components: mapred
Reporter: Amareshwari Sriramadasu
Fix For: 0.21.0
Obesrved a task with OutOfMemory error, stuck in cleanup.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-6088) Task stuck in cleanup with
OutOfMemoryErrors
Posted by "Amareshwari Sriramadasu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-6088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12721667#action_12721667 ]
Amareshwari Sriramadasu commented on HADOOP-6088:
-------------------------------------------------
Task logs show :
2009-06-12 21:37:11,574 WARN org.apache.hadoop.mapred.TaskTracker: Error running child
java.io.IOException: Task: attempt_200905250540_16139_r_000176_0 - The reduce copier failed
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:382)
at org.apache.hadoop.mapred.Child.main(Child.java:170)
Caused by: java.lang.OutOfMemoryError: Java heap space
at org.apache.hadoop.mapred.IFile$Reader.readNextBlock(IFile.java:342)
at org.apache.hadoop.mapred.IFile$Reader.next(IFile.java:404)
at org.apache.hadoop.mapred.Merger$Segment.next(Merger.java:184)
at org.apache.hadoop.mapred.Merger$MergeQueue.merge(Merger.java:376)
at org.apache.hadoop.mapred.Merger$MergeQueue.merge(Merger.java:338)
at org.apache.hadoop.mapred.Merger.merge(Merger.java:60)
at org.apache.hadoop.mapred.ReduceTask$ReduceCopier$LocalFSMerger.run(ReduceTask.java:2460)
2009-06-12 21:37:11,597 INFO org.apache.hadoop.mapred.ReduceTask: Read 43883500 bytes from map-output for attempt_200905250540_16139_m_001504_0
2009-06-12 21:37:11,696 INFO org.apache.hadoop.mapred.TaskRunner: Runnning cleanup for the task
Similar to FSError, for any error Task should inform TT and get killed forcefully. Currently, Child catches Throwable and does cleanup, shutting log Manager etc. We should catch only Exception here. And Errors should be informed to TT.
Thoughts?
> Task stuck in cleanup with OutOfMemoryErrors
> --------------------------------------------
>
> Key: HADOOP-6088
> URL: https://issues.apache.org/jira/browse/HADOOP-6088
> Project: Hadoop Core
> Issue Type: Bug
> Components: mapred
> Reporter: Amareshwari Sriramadasu
> Fix For: 0.21.0
>
>
> Obesrved a task with OutOfMemory error, stuck in cleanup.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.