You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hadoop.apache.org by Björn-Elmar Macek <ma...@cs.uni-kassel.de> on 2012/08/08 16:04:12 UTC

Logs cannot be created

Hi,

after having successfully tested my Hadoop program with small sets of 
data, i began applying Hadoop to the original data set (~63gig).
Somehow the logs cannot be written. My log looks like this:

12/08/07 17:23:02 WARN mapred.JobClient: Use GenericOptionsParser for 
parsing the arguments. Applications should implement Tool for the same.
12/08/07 17:23:02 INFO util.NativeCodeLoader: Loaded the native-hadoop 
library
12/08/07 17:23:02 WARN snappy.LoadSnappy: Snappy native library not loaded
12/08/07 17:23:02 INFO mapred.FileInputFormat: Total input paths to 
process : 1
12/08/07 17:23:03 INFO mapred.JobClient: Running job: job_201208071709_0001
12/08/07 17:23:04 INFO mapred.JobClient:  map 0% reduce 0%
12/08/07 17:33:13 INFO mapred.JobClient: Task Id : 
attempt_201208071709_0001_m_000951_0, Status : FAILED
Task attempt_201208071709_0001_m_000951_0 failed to report status for 
602 seconds. Killing!
12/08/07 17:43:16 INFO mapred.JobClient: Task Id : 
attempt_201208071709_0001_r_000002_0, Status : FAILED
Task attempt_201208071709_0001_r_000002_0 failed to report status for 
600 seconds. Killing!
12/08/07 17:52:08 INFO mapred.JobClient: Task Id : 
attempt_201208071709_0001_m_000002_0, Status : FAILED
java.lang.Throwable: Child Error
     at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:271)
Caused by: java.io.IOException: Creation of 
/tmp/hadoop-bmacek/mapred/local/userlogs/job_201208071709_0001/attempt_201208071709_0001_m_000002_0 
failed.
     at 
org.apache.hadoop.mapred.TaskLog.createTaskAttemptLogDir(TaskLog.java:102)
     at 
org.apache.hadoop.mapred.DefaultTaskController.createLogDir(DefaultTaskController.java:71)
     at 
org.apache.hadoop.mapred.TaskRunner.prepareLogFiles(TaskRunner.java:316)
     at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:228)

12/08/07 17:52:08 WARN mapred.JobClient: Error reading task 
outputhttp://its-cs231.its.uni-kassel.de:50060/tasklog?plaintext=true&attemptid=attempt_201208071709_0001_m_000002_0&filter=stdout
12/08/07 17:52:08 WARN mapred.JobClient: Error reading task 
outputhttp://its-cs231.its.uni-kassel.de:50060/tasklog?plaintext=true&attemptid=attempt_201208071709_0001_m_000002_0&filter=stderr
12/08/07 17:52:08 INFO mapred.JobClient: Task Id : 
attempt_201208071709_0001_m_000004_0, Status : FAILED
java.lang.Throwable: Child Error
     at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:271)
Caused by: java.io.IOException: Creation of 
/tmp/hadoop-bmacek/mapred/local/userlogs/job_201208071709_0001/attempt_201208071709_0001_m_000004_0 
failed.
     at 
org.apache.hadoop.mapred.TaskLog.createTaskAttemptLogDir(TaskLog.java:102)
     at 
org.apache.hadoop.mapred.DefaultTaskController.createLogDir(DefaultTaskController.java:71)
     at 
org.apache.hadoop.mapred.TaskRunner.prepareLogFiles(TaskRunner.java:316)
     at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:228)


And this repeats kind of endlessly.

I have informed myself about this error message and i found several 
posts saying, that space restrictions might be the root of the problem, 
but since i clean all working directories *before* running Hadoop i 
doubt this is the reason.

I also looked up some of the slaves' logs (they are about 12MB big) and 
they contain similar errors but others as well.

Can anybody tell me please, what's going wrong here?

Thanks in advance and best regards,
Björn

Re: Logs cannot be created

Posted by Harit Himanshu <ha...@gmail.com>.
make sure you have enough permissions on  /tmp/hadoop-bmacek/
also check you have enough space to write to disk
On Aug 8, 2012, at 7:04 AM, Björn-Elmar Macek wrote:

>  /tmp/hadoop-bmacek/

Re: Logs cannot be created

Posted by Harit Himanshu <ha...@gmail.com>.
make sure you have enough permissions on  /tmp/hadoop-bmacek/
also check you have enough space to write to disk
On Aug 8, 2012, at 7:04 AM, Björn-Elmar Macek wrote:

>  /tmp/hadoop-bmacek/

Re: Logs cannot be created

Posted by Harit Himanshu <ha...@gmail.com>.
make sure you have enough permissions on  /tmp/hadoop-bmacek/
also check you have enough space to write to disk
On Aug 8, 2012, at 7:04 AM, Björn-Elmar Macek wrote:

>  /tmp/hadoop-bmacek/

Re: Logs cannot be created

Posted by Harit Himanshu <ha...@gmail.com>.
make sure you have enough permissions on  /tmp/hadoop-bmacek/
also check you have enough space to write to disk
On Aug 8, 2012, at 7:04 AM, Björn-Elmar Macek wrote:

>  /tmp/hadoop-bmacek/