You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@nutch.apache.org by Shekhar Sharma <sh...@gmail.com> on 2013/11/06 08:03:14 UTC
Re: Error while running apache Nutch on CDH4
No. I am not creating it manually, it will be created as part of mapreduce job.
Do i need to run the job with some specific user?
Regards,
Som Shekhar Sharma
+91-8197243810
On Tue, Oct 22, 2013 at 12:02 AM, Talat UYARER <ta...@agmlab.com> wrote:
> Hi Shekhar,
> This is not seems like a nutch error. I dont use CDH before but i think this
> problem because of permissions. Do you create
> /usr/lib/hadoop-0.20-mapreduce/logs/userlogs/job_201310210546_0030 with
> manual ?
>
> Regards
> Talat
>
> 21-10-2013 17:04 tarihinde, Shekhar Sharma yazdı:
>>
>> Hi All,
>>
>> I have recently installed 4 node CDH cluster and trying to run a
>> simple Nutch job with some seed urls, but i am getting the following
>> error consistently even if i am running as root user
>>
>> Error initializing attempt_201310210546_0030_m_000001_0:
>> java.io.IOException: Could not create job user log directory:
>> file:/usr/lib/hadoop-0.20-mapreduce/logs/userlogs/job_201310210546_0030
>> at
>> org.apache.hadoop.mapred.JobLocalizer.initializeJobLogDir(JobLocalizer.java:242)
>> at
>> org.apache.hadoop.mapred.DefaultTaskController.initializeJob(DefaultTaskController.java:225)
>> at org.apache.hadoop.mapred.TaskTracker$4.run(TaskTracker.java:1470)
>> at java.security.AccessController.doPrivileged(Native Method)
>> at javax.security.auth.Subject.doAs(Subject.java:396)
>> at
>> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1408)
>> at
>> org.apache.hadoop.mapred.TaskTracker.initializeJob(TaskTracker.java:1445)
>> at
>> org.apache.hadoop.mapred.TaskTracker.localizeJob(TaskTracker.java:1360)
>> at
>> org.apache.hadoop.mapred.TaskTracker.startNewTask(TaskTracker.java:2786)
>> at
>> org.apache.hadoop.mapred.TaskTracker$TaskLauncher.run(TaskTracker.java:2750)
>>
>> 13/10/21 12:29:14 WARN mapred.JobClient: Error reading task
>>
>> outputhttp://inbelw012004a.symphonyteleca.com:50060/tasklog?plaintext=true&attemptid=attempt_201310210546_0030_m_000001_0&filter=stdout
>> 13/10/21 12:29:14 WARN mapred.JobClient: Error reading task
>>
>> outputhttp://inbelw012004a.symphonyteleca.com:50060/tasklog?plaintext=true&attemptid=attempt_201310210546_0030_m_000001_0&filter=stderr
>> 13/10/21 12:29:14 INFO mapred.JobClient: Task Id :
>> attempt_201310210546_0030_m_000001_1, Status : FAILED
>> Error initializing attempt_201310210546_0030_m_000001_1:
>> java.io.IOException: Could not create job user log directory:
>> file:/usr/lib/hadoop-0.20-mapreduce/logs/userlogs/job_201310210546_0030
>> at
>> org.apache.hadoop.mapred.JobLocalizer.initializeJobLogDir(JobLocalizer.java:242)
>> at
>> org.apache.hadoop.mapred.DefaultTaskController.initializeJob(DefaultTaskController.java:225)
>>
>> Could you please throw some light on how to solve this error?
>>
>>
>> Regards,
>> Som Shekhar Sharma
>> +91-8197243810
>
>