You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Nigel Daley (JIRA)" <ji...@apache.org> on 2006/11/10 03:00:37 UTC
[jira] Created: (HADOOP-705) IOException: job.xml already exists
IOException: job.xml already exists
-----------------------------------
Key: HADOOP-705
URL: http://issues.apache.org/jira/browse/HADOOP-705
Project: Hadoop
Issue Type: Bug
Components: mapred
Affects Versions: 0.8.0
Reporter: Nigel Daley
Assigned To: Mahadev konar
I'm seeing this exception in the JobTracker log. It's caused the same map to fail enough that the job aborted.
2006-11-09 17:28:37,594 INFO org.apache.hadoop.mapred.TaskInProgress: Error from task_0004_m_000588_2: Error
initializing task_0004_m_000588_2:
java.io.IOException: Target /foobar/tmp/mapred/local/taskTracker/jobcache/job_0004/job.xml already exists
at org.apache.hadoop.fs.FileUtil.checkDest(FileUtil.java:215)
at org.apache.hadoop.fs.FileUtil.copy(FileUtil.java:61)
at org.apache.hadoop.dfs.DistributedFileSystem.copyToLocalFile(DistributedFileSystem.java:192)
at org.apache.hadoop.mapred.TaskTracker.localizeJob(TaskTracker.java:279)
at org.apache.hadoop.mapred.TaskTracker.startNewTask(TaskTracker.java:691)
at org.apache.hadoop.mapred.TaskTracker.checkForNewTasks(TaskTracker.java:533)
at org.apache.hadoop.mapred.TaskTracker.offerService(TaskTracker.java:448)
at org.apache.hadoop.mapred.TaskTracker.run(TaskTracker.java:720)
at org.apache.hadoop.mapred.TaskTracker.main(TaskTracker.java:1374)
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Updated: (HADOOP-705) IOException: job.xml already exists
Posted by "Doug Cutting (JIRA)" <ji...@apache.org>.
[ http://issues.apache.org/jira/browse/HADOOP-705?page=all ]
Doug Cutting updated HADOOP-705:
--------------------------------
Status: Open (was: Patch Available)
Wouldn't it be better to remove the job's entire directory at the outset? That would cover failures in both job.xml, job.jar and whatever else ends up there.
Also, this patch uses tabs to indent, rather than spaces, with non-standard tab stops. And there's a typo in the comment.
> IOException: job.xml already exists
> -----------------------------------
>
> Key: HADOOP-705
> URL: http://issues.apache.org/jira/browse/HADOOP-705
> Project: Hadoop
> Issue Type: Bug
> Components: mapred
> Affects Versions: 0.8.0
> Reporter: Nigel Daley
> Assigned To: Mahadev konar
> Attachments: jobxml.patch
>
>
> I'm seeing this exception in the JobTracker log. It's caused the same map to fail enough that the job aborted.
> 2006-11-09 17:28:37,594 INFO org.apache.hadoop.mapred.TaskInProgress: Error from task_0004_m_000588_2: Error
> initializing task_0004_m_000588_2:
> java.io.IOException: Target /foobar/tmp/mapred/local/taskTracker/jobcache/job_0004/job.xml already exists
> at org.apache.hadoop.fs.FileUtil.checkDest(FileUtil.java:215)
> at org.apache.hadoop.fs.FileUtil.copy(FileUtil.java:61)
> at org.apache.hadoop.dfs.DistributedFileSystem.copyToLocalFile(DistributedFileSystem.java:192)
> at org.apache.hadoop.mapred.TaskTracker.localizeJob(TaskTracker.java:279)
> at org.apache.hadoop.mapred.TaskTracker.startNewTask(TaskTracker.java:691)
> at org.apache.hadoop.mapred.TaskTracker.checkForNewTasks(TaskTracker.java:533)
> at org.apache.hadoop.mapred.TaskTracker.offerService(TaskTracker.java:448)
> at org.apache.hadoop.mapred.TaskTracker.run(TaskTracker.java:720)
> at org.apache.hadoop.mapred.TaskTracker.main(TaskTracker.java:1374)
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Updated: (HADOOP-705) IOException: job.xml already exists
Posted by "Mahadev konar (JIRA)" <ji...@apache.org>.
[ http://issues.apache.org/jira/browse/HADOOP-705?page=all ]
Mahadev konar updated HADOOP-705:
---------------------------------
Attachment: jobxml.patch
this patch fixes the problem. The problem arose on a half execution of localizejob. this might happen when the namenode is very busy. The job.xml is copied but the job.jar isnt. So the job is not fully localized. The new task on the machine tries to localize the job but fails with the error mentioned. This patch deletes any presexisting job.xml if the job has not been fully localized and tries localizing the job again.
> IOException: job.xml already exists
> -----------------------------------
>
> Key: HADOOP-705
> URL: http://issues.apache.org/jira/browse/HADOOP-705
> Project: Hadoop
> Issue Type: Bug
> Components: mapred
> Affects Versions: 0.8.0
> Reporter: Nigel Daley
> Assigned To: Mahadev konar
> Attachments: jobxml.patch
>
>
> I'm seeing this exception in the JobTracker log. It's caused the same map to fail enough that the job aborted.
> 2006-11-09 17:28:37,594 INFO org.apache.hadoop.mapred.TaskInProgress: Error from task_0004_m_000588_2: Error
> initializing task_0004_m_000588_2:
> java.io.IOException: Target /foobar/tmp/mapred/local/taskTracker/jobcache/job_0004/job.xml already exists
> at org.apache.hadoop.fs.FileUtil.checkDest(FileUtil.java:215)
> at org.apache.hadoop.fs.FileUtil.copy(FileUtil.java:61)
> at org.apache.hadoop.dfs.DistributedFileSystem.copyToLocalFile(DistributedFileSystem.java:192)
> at org.apache.hadoop.mapred.TaskTracker.localizeJob(TaskTracker.java:279)
> at org.apache.hadoop.mapred.TaskTracker.startNewTask(TaskTracker.java:691)
> at org.apache.hadoop.mapred.TaskTracker.checkForNewTasks(TaskTracker.java:533)
> at org.apache.hadoop.mapred.TaskTracker.offerService(TaskTracker.java:448)
> at org.apache.hadoop.mapred.TaskTracker.run(TaskTracker.java:720)
> at org.apache.hadoop.mapred.TaskTracker.main(TaskTracker.java:1374)
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Updated: (HADOOP-705) IOException: job.xml already exists
Posted by "Mahadev konar (JIRA)" <ji...@apache.org>.
[ http://issues.apache.org/jira/browse/HADOOP-705?page=all ]
Mahadev konar updated HADOOP-705:
---------------------------------
Status: Patch Available (was: Open)
> IOException: job.xml already exists
> -----------------------------------
>
> Key: HADOOP-705
> URL: http://issues.apache.org/jira/browse/HADOOP-705
> Project: Hadoop
> Issue Type: Bug
> Components: mapred
> Affects Versions: 0.8.0
> Reporter: Nigel Daley
> Assigned To: Mahadev konar
> Attachments: jobxml.patch
>
>
> I'm seeing this exception in the JobTracker log. It's caused the same map to fail enough that the job aborted.
> 2006-11-09 17:28:37,594 INFO org.apache.hadoop.mapred.TaskInProgress: Error from task_0004_m_000588_2: Error
> initializing task_0004_m_000588_2:
> java.io.IOException: Target /foobar/tmp/mapred/local/taskTracker/jobcache/job_0004/job.xml already exists
> at org.apache.hadoop.fs.FileUtil.checkDest(FileUtil.java:215)
> at org.apache.hadoop.fs.FileUtil.copy(FileUtil.java:61)
> at org.apache.hadoop.dfs.DistributedFileSystem.copyToLocalFile(DistributedFileSystem.java:192)
> at org.apache.hadoop.mapred.TaskTracker.localizeJob(TaskTracker.java:279)
> at org.apache.hadoop.mapred.TaskTracker.startNewTask(TaskTracker.java:691)
> at org.apache.hadoop.mapred.TaskTracker.checkForNewTasks(TaskTracker.java:533)
> at org.apache.hadoop.mapred.TaskTracker.offerService(TaskTracker.java:448)
> at org.apache.hadoop.mapred.TaskTracker.run(TaskTracker.java:720)
> at org.apache.hadoop.mapred.TaskTracker.main(TaskTracker.java:1374)
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Updated: (HADOOP-705) IOException: job.xml already exists
Posted by "Mahadev konar (JIRA)" <ji...@apache.org>.
[ http://issues.apache.org/jira/browse/HADOOP-705?page=all ]
Mahadev konar updated HADOOP-705:
---------------------------------
Attachment: (was: jobxml.patch)
> IOException: job.xml already exists
> -----------------------------------
>
> Key: HADOOP-705
> URL: http://issues.apache.org/jira/browse/HADOOP-705
> Project: Hadoop
> Issue Type: Bug
> Components: mapred
> Affects Versions: 0.8.0
> Reporter: Nigel Daley
> Assigned To: Mahadev konar
>
> I'm seeing this exception in the JobTracker log. It's caused the same map to fail enough that the job aborted.
> 2006-11-09 17:28:37,594 INFO org.apache.hadoop.mapred.TaskInProgress: Error from task_0004_m_000588_2: Error
> initializing task_0004_m_000588_2:
> java.io.IOException: Target /foobar/tmp/mapred/local/taskTracker/jobcache/job_0004/job.xml already exists
> at org.apache.hadoop.fs.FileUtil.checkDest(FileUtil.java:215)
> at org.apache.hadoop.fs.FileUtil.copy(FileUtil.java:61)
> at org.apache.hadoop.dfs.DistributedFileSystem.copyToLocalFile(DistributedFileSystem.java:192)
> at org.apache.hadoop.mapred.TaskTracker.localizeJob(TaskTracker.java:279)
> at org.apache.hadoop.mapred.TaskTracker.startNewTask(TaskTracker.java:691)
> at org.apache.hadoop.mapred.TaskTracker.checkForNewTasks(TaskTracker.java:533)
> at org.apache.hadoop.mapred.TaskTracker.offerService(TaskTracker.java:448)
> at org.apache.hadoop.mapred.TaskTracker.run(TaskTracker.java:720)
> at org.apache.hadoop.mapred.TaskTracker.main(TaskTracker.java:1374)
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (HADOOP-705) IOException: job.xml already exists
Posted by "Nigel Daley (JIRA)" <ji...@apache.org>.
[ http://issues.apache.org/jira/browse/HADOOP-705?page=comments#action_12448824 ]
Nigel Daley commented on HADOOP-705:
------------------------------------
+1
This patch fixes the issue. In addition, "ant clean compile test tar" is successfull when this patch is applied against revision 473426.
> IOException: job.xml already exists
> -----------------------------------
>
> Key: HADOOP-705
> URL: http://issues.apache.org/jira/browse/HADOOP-705
> Project: Hadoop
> Issue Type: Bug
> Components: mapred
> Affects Versions: 0.8.0
> Reporter: Nigel Daley
> Assigned To: Mahadev konar
> Attachments: jobxml.patch
>
>
> I'm seeing this exception in the JobTracker log. It's caused the same map to fail enough that the job aborted.
> 2006-11-09 17:28:37,594 INFO org.apache.hadoop.mapred.TaskInProgress: Error from task_0004_m_000588_2: Error
> initializing task_0004_m_000588_2:
> java.io.IOException: Target /foobar/tmp/mapred/local/taskTracker/jobcache/job_0004/job.xml already exists
> at org.apache.hadoop.fs.FileUtil.checkDest(FileUtil.java:215)
> at org.apache.hadoop.fs.FileUtil.copy(FileUtil.java:61)
> at org.apache.hadoop.dfs.DistributedFileSystem.copyToLocalFile(DistributedFileSystem.java:192)
> at org.apache.hadoop.mapred.TaskTracker.localizeJob(TaskTracker.java:279)
> at org.apache.hadoop.mapred.TaskTracker.startNewTask(TaskTracker.java:691)
> at org.apache.hadoop.mapred.TaskTracker.checkForNewTasks(TaskTracker.java:533)
> at org.apache.hadoop.mapred.TaskTracker.offerService(TaskTracker.java:448)
> at org.apache.hadoop.mapred.TaskTracker.run(TaskTracker.java:720)
> at org.apache.hadoop.mapred.TaskTracker.main(TaskTracker.java:1374)
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Updated: (HADOOP-705) IOException: job.xml already exists
Posted by "Mahadev konar (JIRA)" <ji...@apache.org>.
[ http://issues.apache.org/jira/browse/HADOOP-705?page=all ]
Mahadev konar updated HADOOP-705:
---------------------------------
Attachment: jobxml.patch
made the changes. The whole job dir is deleted before we retry again. fixed the typo. sorry abt the tabs... just cleaned up my eclipse settings.
> IOException: job.xml already exists
> -----------------------------------
>
> Key: HADOOP-705
> URL: http://issues.apache.org/jira/browse/HADOOP-705
> Project: Hadoop
> Issue Type: Bug
> Components: mapred
> Affects Versions: 0.8.0
> Reporter: Nigel Daley
> Assigned To: Mahadev konar
> Attachments: jobxml.patch
>
>
> I'm seeing this exception in the JobTracker log. It's caused the same map to fail enough that the job aborted.
> 2006-11-09 17:28:37,594 INFO org.apache.hadoop.mapred.TaskInProgress: Error from task_0004_m_000588_2: Error
> initializing task_0004_m_000588_2:
> java.io.IOException: Target /foobar/tmp/mapred/local/taskTracker/jobcache/job_0004/job.xml already exists
> at org.apache.hadoop.fs.FileUtil.checkDest(FileUtil.java:215)
> at org.apache.hadoop.fs.FileUtil.copy(FileUtil.java:61)
> at org.apache.hadoop.dfs.DistributedFileSystem.copyToLocalFile(DistributedFileSystem.java:192)
> at org.apache.hadoop.mapred.TaskTracker.localizeJob(TaskTracker.java:279)
> at org.apache.hadoop.mapred.TaskTracker.startNewTask(TaskTracker.java:691)
> at org.apache.hadoop.mapred.TaskTracker.checkForNewTasks(TaskTracker.java:533)
> at org.apache.hadoop.mapred.TaskTracker.offerService(TaskTracker.java:448)
> at org.apache.hadoop.mapred.TaskTracker.run(TaskTracker.java:720)
> at org.apache.hadoop.mapred.TaskTracker.main(TaskTracker.java:1374)
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Updated: (HADOOP-705) IOException: job.xml already exists
Posted by "Doug Cutting (JIRA)" <ji...@apache.org>.
[ http://issues.apache.org/jira/browse/HADOOP-705?page=all ]
Doug Cutting updated HADOOP-705:
--------------------------------
Status: Resolved (was: Patch Available)
Fix Version/s: 0.9.0
Resolution: Fixed
I just committed this. Thanks, Mahadev!
> IOException: job.xml already exists
> -----------------------------------
>
> Key: HADOOP-705
> URL: http://issues.apache.org/jira/browse/HADOOP-705
> Project: Hadoop
> Issue Type: Bug
> Components: mapred
> Affects Versions: 0.8.0
> Reporter: Nigel Daley
> Assigned To: Mahadev konar
> Fix For: 0.9.0
>
> Attachments: jobxml.patch
>
>
> I'm seeing this exception in the JobTracker log. It's caused the same map to fail enough that the job aborted.
> 2006-11-09 17:28:37,594 INFO org.apache.hadoop.mapred.TaskInProgress: Error from task_0004_m_000588_2: Error
> initializing task_0004_m_000588_2:
> java.io.IOException: Target /foobar/tmp/mapred/local/taskTracker/jobcache/job_0004/job.xml already exists
> at org.apache.hadoop.fs.FileUtil.checkDest(FileUtil.java:215)
> at org.apache.hadoop.fs.FileUtil.copy(FileUtil.java:61)
> at org.apache.hadoop.dfs.DistributedFileSystem.copyToLocalFile(DistributedFileSystem.java:192)
> at org.apache.hadoop.mapred.TaskTracker.localizeJob(TaskTracker.java:279)
> at org.apache.hadoop.mapred.TaskTracker.startNewTask(TaskTracker.java:691)
> at org.apache.hadoop.mapred.TaskTracker.checkForNewTasks(TaskTracker.java:533)
> at org.apache.hadoop.mapred.TaskTracker.offerService(TaskTracker.java:448)
> at org.apache.hadoop.mapred.TaskTracker.run(TaskTracker.java:720)
> at org.apache.hadoop.mapred.TaskTracker.main(TaskTracker.java:1374)
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Updated: (HADOOP-705) IOException: job.xml already exists
Posted by "Mahadev konar (JIRA)" <ji...@apache.org>.
[ http://issues.apache.org/jira/browse/HADOOP-705?page=all ]
Mahadev konar updated HADOOP-705:
---------------------------------
Status: Patch Available (was: Open)
> IOException: job.xml already exists
> -----------------------------------
>
> Key: HADOOP-705
> URL: http://issues.apache.org/jira/browse/HADOOP-705
> Project: Hadoop
> Issue Type: Bug
> Components: mapred
> Affects Versions: 0.8.0
> Reporter: Nigel Daley
> Assigned To: Mahadev konar
> Attachments: jobxml.patch
>
>
> I'm seeing this exception in the JobTracker log. It's caused the same map to fail enough that the job aborted.
> 2006-11-09 17:28:37,594 INFO org.apache.hadoop.mapred.TaskInProgress: Error from task_0004_m_000588_2: Error
> initializing task_0004_m_000588_2:
> java.io.IOException: Target /foobar/tmp/mapred/local/taskTracker/jobcache/job_0004/job.xml already exists
> at org.apache.hadoop.fs.FileUtil.checkDest(FileUtil.java:215)
> at org.apache.hadoop.fs.FileUtil.copy(FileUtil.java:61)
> at org.apache.hadoop.dfs.DistributedFileSystem.copyToLocalFile(DistributedFileSystem.java:192)
> at org.apache.hadoop.mapred.TaskTracker.localizeJob(TaskTracker.java:279)
> at org.apache.hadoop.mapred.TaskTracker.startNewTask(TaskTracker.java:691)
> at org.apache.hadoop.mapred.TaskTracker.checkForNewTasks(TaskTracker.java:533)
> at org.apache.hadoop.mapred.TaskTracker.offerService(TaskTracker.java:448)
> at org.apache.hadoop.mapred.TaskTracker.run(TaskTracker.java:720)
> at org.apache.hadoop.mapred.TaskTracker.main(TaskTracker.java:1374)
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira