You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Sanjay Dahiya (JIRA)" <ji...@apache.org> on 2006/09/20 20:54:23 UTC
[jira] Updated: (HADOOP-546) Task tracker doesnt generate job.xml
in jobcache for some tasks ( possibly for only rescheduled tasks)
[ http://issues.apache.org/jira/browse/HADOOP-546?page=all ]
Sanjay Dahiya updated HADOOP-546:
---------------------------------
Summary: Task tracker doesnt generate job.xml in jobcache for some tasks ( possibly for only rescheduled tasks) (was: Jobtracker doesnt generate job.xml in jobcache for some tasks ( possibly for only rescheduled tasks))
Description:
For many of the rescheduled tasks task tracker doesn't generate job.xml causing the task to fail. The exception appears in Job tracker logs and not in task tracker's logs.
possibly related to Hadoop-543
2006-09-19 01:10:37,064 INFO org.apache.hadoop.mapred.TaskInProgress: Error from task_0001_m_022869_3: java.io.FileNotFoundException: .../hadoop/mapred/local/taskTracker/jobcache/job_0001/task_0001_m_022869_3/job.xml (No such file or directory)
at java.io.FileOutputStream.open(Native Method)
at java.io.FileOutputStream.<init>(FileOutputStream.java:179)
at java.io.FileOutputStream.<init>(FileOutputStream.java:131)
at org.apache.hadoop.fs.LocalFileSystem$LocalFSFileOutputStream.<init>(LocalFileSystem.java:133)
at org.apache.hadoop.fs.LocalFileSystem.createRaw(LocalFileSystem.java:172)
at org.apache.hadoop.fs.LocalFileSystem.createRaw(LocalFileSystem.java:180)
at org.apache.hadoop.fs.FSDataOutputStream$Summer.<init>(FSDataOutputStream.java:56)
at org.apache.hadoop.fs.FSDataOutputStream$Summer.<init>(FSDataOutputStream.java:45)
at org.apache.hadoop.fs.FSDataOutputStream.<init>(FSDataOutputStream.java:146)
at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:270)
at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:177)
at org.apache.hadoop.mapred.TaskTracker$TaskInProgress.localizeTask(TaskTracker.java:810)
at org.apache.hadoop.mapred.TaskTracker$TaskInProgress.launchTask(TaskTracker.java:858)
at org.apache.hadoop.mapred.TaskTracker.launchTaskForJob(TaskTracker.java:282)
at org.apache.hadoop.mapred.TaskTracker.localizeJob(TaskTracker.java:275)
at org.apache.hadoop.mapred.TaskTracker.startNewTask(TaskTracker.java:669)
at org.apache.hadoop.mapred.TaskTracker.offerService(TaskTracker.java:486)
at org.apache.hadoop.mapred.TaskTracker.run(TaskTracker.java:689)
at org.apache.hadoop.mapred.TaskTracker.main(TaskTracker.java:1290)
was:
For many of the rescheduled tasks job tracker doesn't generate job.xml the task fails on job tracker itself and is rescheduled for another node and fails again as the file is still not generated, causing the job to fail.
possibly related to Hadoop-543
2006-09-19 01:10:37,064 INFO org.apache.hadoop.mapred.TaskInProgress: Error from task_0001_m_022869_3: java.io.FileNotFoundException: .../hadoop/mapred/local/taskTracker/jobcache/job_0001/task_0001_m_022869_3/job.xml (No such file or directory)
at java.io.FileOutputStream.open(Native Method)
at java.io.FileOutputStream.<init>(FileOutputStream.java:179)
at java.io.FileOutputStream.<init>(FileOutputStream.java:131)
at org.apache.hadoop.fs.LocalFileSystem$LocalFSFileOutputStream.<init>(LocalFileSystem.java:133)
at org.apache.hadoop.fs.LocalFileSystem.createRaw(LocalFileSystem.java:172)
at org.apache.hadoop.fs.LocalFileSystem.createRaw(LocalFileSystem.java:180)
at org.apache.hadoop.fs.FSDataOutputStream$Summer.<init>(FSDataOutputStream.java:56)
at org.apache.hadoop.fs.FSDataOutputStream$Summer.<init>(FSDataOutputStream.java:45)
at org.apache.hadoop.fs.FSDataOutputStream.<init>(FSDataOutputStream.java:146)
at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:270)
at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:177)
at org.apache.hadoop.mapred.TaskTracker$TaskInProgress.localizeTask(TaskTracker.java:810)
at org.apache.hadoop.mapred.TaskTracker$TaskInProgress.launchTask(TaskTracker.java:858)
at org.apache.hadoop.mapred.TaskTracker.launchTaskForJob(TaskTracker.java:282)
at org.apache.hadoop.mapred.TaskTracker.localizeJob(TaskTracker.java:275)
at org.apache.hadoop.mapred.TaskTracker.startNewTask(TaskTracker.java:669)
at org.apache.hadoop.mapred.TaskTracker.offerService(TaskTracker.java:486)
at org.apache.hadoop.mapred.TaskTracker.run(TaskTracker.java:689)
at org.apache.hadoop.mapred.TaskTracker.main(TaskTracker.java:1290)
> Task tracker doesnt generate job.xml in jobcache for some tasks ( possibly for only rescheduled tasks)
> ------------------------------------------------------------------------------------------------------
>
> Key: HADOOP-546
> URL: http://issues.apache.org/jira/browse/HADOOP-546
> Project: Hadoop
> Issue Type: Bug
> Components: mapred
> Affects Versions: 0.6.2
> Reporter: Sanjay Dahiya
> Priority: Critical
>
> For many of the rescheduled tasks task tracker doesn't generate job.xml causing the task to fail. The exception appears in Job tracker logs and not in task tracker's logs.
> possibly related to Hadoop-543
> 2006-09-19 01:10:37,064 INFO org.apache.hadoop.mapred.TaskInProgress: Error from task_0001_m_022869_3: java.io.FileNotFoundException: .../hadoop/mapred/local/taskTracker/jobcache/job_0001/task_0001_m_022869_3/job.xml (No such file or directory)
> at java.io.FileOutputStream.open(Native Method)
> at java.io.FileOutputStream.<init>(FileOutputStream.java:179)
> at java.io.FileOutputStream.<init>(FileOutputStream.java:131)
> at org.apache.hadoop.fs.LocalFileSystem$LocalFSFileOutputStream.<init>(LocalFileSystem.java:133)
> at org.apache.hadoop.fs.LocalFileSystem.createRaw(LocalFileSystem.java:172)
> at org.apache.hadoop.fs.LocalFileSystem.createRaw(LocalFileSystem.java:180)
> at org.apache.hadoop.fs.FSDataOutputStream$Summer.<init>(FSDataOutputStream.java:56)
> at org.apache.hadoop.fs.FSDataOutputStream$Summer.<init>(FSDataOutputStream.java:45)
> at org.apache.hadoop.fs.FSDataOutputStream.<init>(FSDataOutputStream.java:146)
> at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:270)
> at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:177)
> at org.apache.hadoop.mapred.TaskTracker$TaskInProgress.localizeTask(TaskTracker.java:810)
> at org.apache.hadoop.mapred.TaskTracker$TaskInProgress.launchTask(TaskTracker.java:858)
> at org.apache.hadoop.mapred.TaskTracker.launchTaskForJob(TaskTracker.java:282)
> at org.apache.hadoop.mapred.TaskTracker.localizeJob(TaskTracker.java:275)
> at org.apache.hadoop.mapred.TaskTracker.startNewTask(TaskTracker.java:669)
> at org.apache.hadoop.mapred.TaskTracker.offerService(TaskTracker.java:486)
> at org.apache.hadoop.mapred.TaskTracker.run(TaskTracker.java:689)
> at org.apache.hadoop.mapred.TaskTracker.main(TaskTracker.java:1290)
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira