You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by John Conwell <jo...@iamjohn.me> on 2011/07/29 19:34:56 UTC

Lost task tracker and Could not obtain block errors

I'm running into a wall with one of my map reduce jobs (actually its a 7
jobs, chained together).  I get to the 5th MR job, which takes as input the
output from the 3rd MR job, and right off the bat I start getting "Lost task
tracker" and "Could not obtain block..." errors.  Eventually I get enough of
these errors that hadoop just kills my tasks, and fails the job all
together.

I'm running a 5 node hadoop cluster on EC2.  The input to the 5th MR job is
~400mb in size (10 part-* files, each ~40mb in size), so its not really that
big.  And I seem to get this no matter how big a hdfs cluster I create (5 -
15 nodes).

I'm not really sure how to proceed in trouble shooting the issue.  Any help
would be greatly appreciated.

-- 

Thanks,
John C