You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by binish <bi...@cognizant.com> on 2009/10/05 11:43:29 UTC
hadoop-tasktracker error
Hi,
I tried to run one job in a hadoop grid.
Following error occurs while running the job
09/10/05 14:23:20 WARN mapred.JobClient: Error reading task
outputhttp://pc021209.xyz.com:50061/tasklog?plaintext=true&taskid=attempt_200910051111_0006_m_000031_0&filter=stdout
09/10/05 14:23:20 WARN mapred.JobClient: Error reading task
outputhttp://pc021209.xyz.com:50061/tasklog?plaintext=true&taskid=attempt_200910051111_0006_m_000031_0&filter=stderr
09/10/05 14:23:23 INFO mapred.JobClient: Task Id :
attempt_200910051111_0006_m_000031_1, Status : FAILED
java.io.IOException: Task process exit with nonzero status of 1.
at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:425)
09/10/05 14:23:23 WARN mapred.JobClient: Error reading task
outputhttp://pc021209.xyz.com:50061/tasklog?plaintext=true&taskid=attempt_200910051111_0006_m_000031_1&filter=stdout
09/10/05 14:23:23 WARN mapred.JobClient: Error reading task
outputhttp://pc021209.xyz.com:50061/tasklog?plaintext=true&taskid=attempt_200910051111_0006_m_000031_1&filter=stderr
09/10/05 14:23:26 INFO mapred.JobClient: Task Id :
attempt_200910051111_0006_m_000031_2, Status : FAILED
java.io.IOException: Task process exit with nonzero status of 1.
at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:425)
09/10/05 14:23:26 WARN mapred.JobClient: Error reading task
outputhttp://pc021209.xyz.com:50061/tasklog?plaintext=true&taskid=attempt_200910051111_0006_m_000031_2&filter=stdout
09/10/05 14:23:26 WARN mapred.JobClient: Error reading task
outputhttp://pc021209.xyz.com:50061/tasklog?plaintext=true&taskid=attempt_200910051111_0006_m_000031_2&filter=stderr
java.io.IOException: Job failed!
at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:1232)
at org.apache.hadoop.examples.Grep.run(Grep.java:69)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
at org.apache.hadoop.examples.Grep.main(Grep.java:93)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.ProgramDriver
$ProgramDescription.invoke(ProgramDriver.java:68)
at org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:141)
at org.apache.hadoop.examples.ExampleDriver.main(ExampleDriver.java:61)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.RunJar.main(RunJar.java:165)
at org.apache.hadoop.mapred.JobShell.run(JobShell.java:54)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
at org.apache.hadoop.mapred.JobShell.main(JobShell.java:68)
===================== Tasktracker log =====================
2009-10-05 14:40:17,380 INFO org.apache.hadoop.mapred.TaskTracker:
Received KillTaskAction for task: attempt_200910051111_0007_m_000032_3
2009-10-05 14:40:17,400 INFO org.apache.hadoop.mapred.JvmManager: In
JvmRunner constructed JVM ID: jvm_200910051111_0007_m_1560777712
2009-10-05 14:40:17,401 INFO org.apache.hadoop.mapred.JvmManager: JVM
Runner jvm_200910051111_0007_m_1560777712 spawned.
2009-10-05 14:40:17,537 INFO org.apache.hadoop.mapred.JvmManager: JVM :
jvm_200910051111_0007_m_1560777712 exited. Number of tasks it ran: 0
2009-10-05 14:40:17,538 WARN org.apache.hadoop.mapred.TaskRunner:
attempt_200910051111_0007_m_000031_0 Child Error
java.io.IOException: Task process exit with nonzero status of 1.
at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:425)
2009-10-05 14:40:20,539 INFO org.apache.hadoop.mapred.TaskRunner:
attempt_200910051111_0007_m_000031_0 done; removing files.
2009-10-05 14:40:20,540 INFO org.apache.hadoop.mapred.TaskTracker:
addFreeSlot : current free slots : 1
2009-10-05 14:40:20,543 INFO org.apache.hadoop.mapred.TaskTracker:
LaunchTaskAction (registerTask): attempt_200910051111_0007_m_000031_1
task's state:UNASSIGNED
2009-10-05 14:40:20,543 INFO org.apache.hadoop.mapred.TaskTracker:
Trying to launch : attempt_200910051111_0007_m_000031_1
2009-10-05 14:40:20,544 INFO org.apache.hadoop.mapred.TaskTracker: In
TaskLauncher, current free slots : 1 and trying to launch
attempt_200910051111_0007_m_000031_1
2009-10-05 14:40:20,574 INFO org.apache.hadoop.mapred.JvmManager: In
JvmRunner constructed JVM ID: jvm_200910051111_0007_m_1681281662
2009-10-05 14:40:20,574 INFO org.apache.hadoop.mapred.JvmManager: JVM
Runner jvm_200910051111_0007_m_1681281662 spawned.
2009-10-05 14:40:20,716 INFO org.apache.hadoop.mapred.JvmManager: JVM :
jvm_200910051111_0007_m_1681281662 exited. Number of tasks it ran: 0
2009-10-05 14:40:20,716 WARN org.apache.hadoop.mapred.TaskRunner:
attempt_200910051111_0007_m_000031_1 Child Error
java.io.IOException: Task process exit with nonzero status of 1.
at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:425)
2009-10-05 14:40:23,718 INFO org.apache.hadoop.mapred.TaskRunner:
attempt_200910051111_0007_m_000031_1 done; removing files.
2009-10-05 14:40:23,718 INFO org.apache.hadoop.mapred.TaskTracker:
addFreeSlot : current free slots : 1
2009-10-05 14:40:23,723 INFO org.apache.hadoop.mapred.TaskTracker:
LaunchTaskAction (registerTask): attempt_200910051111_0007_m_000031_2
task's state:UNASSIGNED
2009-10-05 14:40:23,723 INFO org.apache.hadoop.mapred.TaskTracker:
Trying to launch : attempt_200910051111_0007_m_000031_2
2009-10-05 14:40:23,723 INFO org.apache.hadoop.mapred.TaskTracker: In
TaskLauncher, current free slots : 1 and trying to launch
attempt_200910051111_0007_m_000031_2
2009-10-05 14:40:23,745 INFO org.apache.hadoop.mapred.JvmManager: In
JvmRunner constructed JVM ID: jvm_200910051111_0007_m_-943819336
2009-10-05 14:40:23,746 INFO org.apache.hadoop.mapred.JvmManager: JVM
Runner jvm_200910051111_0007_m_-943819336 spawned.
2009-10-05 14:40:23,887 INFO org.apache.hadoop.mapred.JvmManager: JVM :
jvm_200910051111_0007_m_-943819336 exited. Number of tasks it ran: 0
2009-10-05 14:40:23,887 WARN org.apache.hadoop.mapred.TaskRunner:
attempt_200910051111_0007_m_000031_2 Child Error
java.io.IOException: Task process exit with nonzero status of 1.
at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:425)
=================== Job Tracker ===================================
009-10-05 14:40:17,376 INFO org.apache.hadoop.mapred.TaskInProgress:
TaskInProgress task_200910051111_0007_m_000032 has failed 4 times.
2009-10-05 14:40:17,377 INFO org.apache.hadoop.mapred.JobInProgress:
TaskTracker at 'tracker_pc021209.xyz.com' turned 'flaky'
2009-10-05 14:40:17,377 INFO org.apache.hadoop.mapred.JobInProgress:
Aborting job job_200910051111_0007
2009-10-05 14:40:17,377 INFO org.apache.hadoop.mapred.JobInProgress:
Killing job 'job_200910051111_0007'
2009-10-05 14:40:17,377 INFO org.apache.hadoop.mapred.JobTracker: Adding
task 'attempt_200910051111_0007_m_000031_0' to tip
task_200910051111_0007_m_000031, for tracker
'tracker_pc021209.xyz.com:localhost.localdomain/127.0.0.1:54240'
2009-10-05 14:40:17,377 INFO org.apache.hadoop.mapred.JobTracker:
Removed completed task 'attempt_200910051111_0007_m_000032_3' from
'tracker_pc021209.xyz.com:localhost.localdomain/127.0.0.1:54240'
2009-10-05 14:40:20,541 INFO org.apache.hadoop.mapred.TaskInProgress:
Error from attempt_200910051111_0007_m_000031_0: java.io.IOException:
Task process exit with nonzero status of 1.
at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:425)
2009-10-05 14:40:20,542 INFO org.apache.hadoop.mapred.JobTracker: Adding
task 'attempt_200910051111_0007_m_000031_1' to tip
task_200910051111_0007_m_000031, for tracker
'tracker_pc021209.xyz.com:localhost.localdomain/127.0.0.1:54240'
2009-10-05 14:40:20,542 INFO org.apache.hadoop.mapred.JobTracker:
Removed completed task 'attempt_200910051111_0007_m_000031_0' from
'tracker_pc021209.xyz.com:localhost.localdomain/127.0.0.1:54240'
2009-10-05 14:40:23,720 INFO org.apache.hadoop.mapred.TaskInProgress:
Error from attempt_200910051111_0007_m_000031_1: java.io.IOException:
Task process exit with nonzero status of 1.
at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:425)
2009-10-05 14:40:23,720 INFO org.apache.hadoop.mapred.JobTracker: Adding
task 'attempt_200910051111_0007_m_000031_2' to tip
task_200910051111_0007_m_000031, for tracker
'tracker_pc021209.xyz.com:localhost.localdomain/127.0.0.1:54240'
2009-10-05 14:40:23,721 INFO org.apache.hadoop.mapred.JobTracker:
Removed completed task 'attempt_200910051111_0007_m_000031_1' from
'tracker_pc021209.xyz.com:localhost.localdomain/127.0.0.1:54240'
2009-10-05 14:40:26,903 INFO org.apache.hadoop.mapred.TaskInProgress:
Error from attempt_200910051111_0007_m_000031_2: java.io.IOException:
Task process exit with nonzero status of 1.
at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:425)
2009-10-05 14:40:26,904 INFO org.apache.hadoop.mapred.JobTracker: Adding
task 'attempt_200910051111_0007_m_000031_3' to tip
task_200910051111_0007_m_000031, for tracker
'tracker_pc021209.xyz.com:localhost.localdomain/127.0.0.1:54240'
2009-10-05 14:40:26,904 INFO org.apache.hadoop.mapred.JobTracker:
Removed completed task 'attempt_200910051111_0007_m_000031_2' from
'tracker_pc021209.xyz.com:localhost.localdomain/127.0.0.1:54240'
2009-10-05 14:40:30,072 INFO org.apache.hadoop.mapred.TaskInProgress:
Error from attempt_200910051111_0007_m_000031_3: java.io.IOException:
Task process exit with nonzero status of 1.
at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:425)
2009-10-05 14:40:30,072 INFO org.apache.hadoop.mapred.TaskInProgress:
TaskInProgress task_200910051111_0007_m_000031 has failed 4 times.
2009-10-05 14:40:30,072 INFO org.apache.hadoop.mapred.JobInProgress:
Aborting job job_200910051111_0007
--
Thanks & Regards,
Binish Abraham,
This e-mail and any files transmitted with it are for the sole use of the intended recipient(s) and may contain confidential and privileged information.
If you are not the intended recipient, please contact the sender by reply e-mail and destroy all copies of the original message.
Any unauthorized review, use, disclosure, dissemination, forwarding, printing or copying of this email or any action taken in reliance on this e-mail is strictly prohibited and may be unlawful.