You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Karam Singh (JIRA)" <ji...@apache.org> on 2009/09/15 09:07:58 UTC
[jira] Commented: (MAPREDUCE-981) TaskTracker does not cleans up
job directory when LinuxTraskController is used.
[ https://issues.apache.org/jira/browse/MAPREDUCE-981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12755395#action_12755395 ]
Karam Singh commented on MAPREDUCE-981:
---------------------------------------
2009-09-15 06:50:41,794 WARN org.apache.hadoop.mapred.LinuxTaskController: Exit code from INITIALIZE_JOB is : 15
2009-09-15 06:50:41,796 WARN org.apache.hadoop.mapred.LinuxTaskController: Exception thrown by INITIALIZE_JOB : org.apache.hadoop.util.Shell$ExitCodeException:
at org.apache.hadoop.util.Shell.runCommand(Shell.java:243)
at org.apache.hadoop.util.Shell.run(Shell.java:170)
at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:363)
at org.apache.hadoop.mapred.LinuxTaskController.runCommand(LinuxTaskController.java:169)
at org.apache.hadoop.mapred.LinuxTaskController.initializeJob(LinuxTaskController.java:381)
at org.apache.hadoop.mapred.TaskTracker.localizeJob(TaskTracker.java:855)
at org.apache.hadoop.mapred.TaskTracker.startNewTask(TaskTracker.java:1828)
at org.apache.hadoop.mapred.TaskTracker.access$1200(TaskTracker.java:102)
at org.apache.hadoop.mapred.TaskTracker$TaskLauncher.run(TaskTracker.java:1793)
2009-09-15 06:50:41,796 INFO org.apache.hadoop.mapred.LinuxTaskController: Output from LinuxTaskController's INITIALIZE_JOB follows:
2009-09-15 06:50:41,796 INFO org.apache.hadoop.mapred.LinuxTaskController: main : command provided 1
2009-09-15 06:50:41,796 INFO org.apache.hadoop.mapred.LinuxTaskController: main : user is username
2009-09-15 06:50:41,796 INFO org.apache.hadoop.mapred.LinuxTaskController: Invalid file path. <job.xml> not user/group owned by the tasktracker.
2009-09-15 06:50:41,796 INFO org.apache.hadoop.mapred.LinuxTaskController: Failed to secure the job_dir <job-dir>
2009-09-15 06:50:41,796 WARN org.apache.hadoop.mapred.TaskTracker: Error initializing attempt_200909150645_0002_r_000008_1:
java.io.IOException: org.apache.hadoop.util.Shell$ExitCodeException:
at org.apache.hadoop.mapred.LinuxTaskController.runCommand(LinuxTaskController.java:178)
at org.apache.hadoop.mapred.LinuxTaskController.initializeJob(LinuxTaskController.java:381)
at org.apache.hadoop.mapred.TaskTracker.localizeJob(TaskTracker.java:855)
at org.apache.hadoop.mapred.TaskTracker.startNewTask(TaskTracker.java:1828)
at org.apache.hadoop.mapred.TaskTracker.access$1200(TaskTracker.java:102)
at org.apache.hadoop.mapred.TaskTracker$TaskLauncher.run(TaskTracker.java:1793)
Caused by: org.apache.hadoop.util.Shell$ExitCodeException:
at org.apache.hadoop.util.Shell.runCommand(Shell.java:243)
at org.apache.hadoop.util.Shell.run(Shell.java:170)
at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:363)
at org.apache.hadoop.mapred.LinuxTaskController.runCommand(LinuxTaskController.java:169)
... 5 more
2009-09-15 06:50:41,797 INFO org.apache.hadoop.mapred.TaskTracker: addFreeSlot : current free slots : 2
2009-09-15 06:50:42,288 WARN org.mortbay.log: /tasklog: java.io.IOException: Closed
2009-09-15 06:50:42,291 WARN org.mortbay.log: /tasklog: java.io.IOException: Closed
2009-09-15 06:50:45,307 WARN org.mortbay.log: /tasklog: java.io.IOException: Closed
2009-09-15 06:50:45,309 WARN org.mortbay.log: /tasklog: java.io.IOException: Closed
2009-09-15 06:50:56,665 INFO org.apache.hadoop.mapred.TaskTracker: Received 'KillJobAction' for job: job_200909150645_0002
2009-09-15 06:50:56,665 INFO org.apache.hadoop.mapred.IndexCache: Map ID attempt_200909150645_0002_m_000016_1 not found in cache
2009-09-15 06:50:56,665 WARN org.apache.hadoop.mapred.TaskTracker: java.lang.NullPointerException
at org.apache.hadoop.mapred.TaskTracker.purgeJob(TaskTracker.java:1508)
at org.apache.hadoop.mapred.TaskTracker.access$100(TaskTracker.java:102)
at org.apache.hadoop.mapred.TaskTracker$1.run(TaskTracker.java:349)
at java.lang.Thread.run(Thread.java:619)
> TaskTracker does not cleans up job directory when LinuxTraskController is used.
> -------------------------------------------------------------------------------
>
> Key: MAPREDUCE-981
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-981
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Reporter: Karam Singh
>
> TaskTracker does not cleans up job directory when LinuxTraskController is used with wrong permissions and setup task of job fails
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.