You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by Ahmed Said Nagy <ah...@hotmail.com> on 2011/04/15 13:09:55 UTC

Jobs stay pending for ever

Dear All,I have been getting an unexpected behavior from my 8 node hadoop cluster. The jobs I try to run they keep pending for ever. When I checked the job tracker logs I found an error that I dont understand very well what to do to resolve it. Kindly find below the error. I checked the folder and it exists and it has characteristics  hadoop:users  I reinstalled hadoop but still the problem is the same. The space on the machine looks fine it is 25 percent free. Please help and adviceRegardsAhmed Nagy


2011-04-14 18:28:28,248 INFO org.mortbay.log: Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog2011-04-14 18:28:28,413 INFO org.apache.hadoop.http.HttpServer: Added global filtersafety (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)2011-04-14 18:28:28,529 INFO org.apache.hadoop.security.Groups: Group mapping impl=org.apache.hadoop.security.ShellBasedUnixGroupsMapping; cacheTimeout=3000002011-04-14 18:28:28,568 INFO org.apache.hadoop.http.HttpServer: Port returned by webServer.getConnectors()[0].getLocalPort() before open() is -1. Opening the listener $2011-04-14 18:28:28,580 INFO org.apache.hadoop.http.HttpServer: listener.getLocalPort() returned 50060 webServer.getConnectors()[0].getLocalPort() returned 500602011-04-14 18:28:28,580 INFO org.apache.hadoop.http.HttpServer: Jetty bound to port 500602011-04-14 18:28:28,581 INFO org.mortbay.log: jetty-6.1.142011-04-14 18:31:10,869 INFO org.mortbay.log: Started SelectChannelCon
 nector@0.0.0.0:500602011-04-14 18:31:10,904 INFO org.apache.hadoop.mapred.TaskTracker: Starting tasktracker with owner as hadoop and supergroup as supergroup2011-04-14 18:31:10,918 ERROR org.apache.hadoop.mapred.TaskTracker:Can not start task tracker because java.lang.RuntimeException:Cannot find root /data/users/hadoop/hadoophdfsdir/for execution of task deletion of toBeDeleted/2011-04-01_01-55-41.803_0on /data/users/hadoop/hadoophdfsdir/ with original name /data/users/hadoop/hadoophdfsdir/toBeDeleted/2011-04-01_01-55-41.803_0        at org.apache.hadoop.util.AsyncDiskService.execute(AsyncDiskService.java:99)        at org.apache.hadoop.mapreduce.util.MRAsyncDiskService.execute(MRAsyncDiskService.java:125)        at org.apache.hadoop.mapreduce.util.MRAsyncDiskService.<init>(MRAsyncDiskService.java:108)        at org.apache.hadoop.mapreduce.util.MRAsyncDiskService.<init>(MRAsyncDiskService.java:118)        at org.apache.hadoop.mapred.TaskTracker.initialize(TaskTracker.java:6
 18)        at org.apache.hadoop.mapred.TaskTracker.<init>(TaskTracker.java:1299)        at org.apache.hadoop.mapred.TaskTracker.main(TaskTracker.java:3461)
2011-04-14 18:31:10,920 INFO org.apache.hadoop.mapred.TaskTracker: SHUTDOWN_MSG:/************************************************************SHUTDOWN_MSG: Shutting down TaskTracker at n01/192.168.0.1************************************************************/