You are viewing a plain text version of this content. The canonical link for it is here.

Posted to mapreduce-user@hadoop.apache.org by Subroto <ss...@datameer.com> on 2012/07/04 11:01:16 UTC

Map Task Hanging for long time for commit

I am using 0.20.2 hadoop and I find many of my Tasks are getting timed out. The task Time out is set to 10 minutes(default) :

Caused by: java.lang.RuntimeException: tasktracker: Task attempt_201206280317_0052_m_000000_0 failed to report status for 950 seconds. Killing!

the tasks are waiting at the point:
Thread[main,5,main]
	at java.lang.Thread.sleep(Native Method)
	at org.apache.hadoop.mapred.Task.commit(Task.java:954)
	at org.apache.hadoop.mapred.Task.done(Task.java:845)
	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:327)
	at org.apache.hadoop.mapred.Child$4.run(Child.java:270)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:396)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1157)
	at org.apache.hadoop.mapred.Child.main(Child.java:264)


The last line from syslog is:
2012-07-03 01:12:53,729 INFO org.apache.hadoop.mapred.Task: Task:attempt_201206280317_0052_m_000000_3 is done. And is in the process of commiting

Is there any problem with my Hadoop Installation or there is a problem with Hadoop?

Cheers,
Subroto Sanyal