[jira] Updated: (HADOOP-705) IOException: job.xml already exists

["Mahadev konar (JIRA)" <ji...@apache.org>]

     [ http://issues.apache.org/jira/browse/HADOOP-705?page=all ]

Mahadev konar updated HADOOP-705:
---------------------------------

    Attachment: jobxml.patch

this patch fixes the problem. The problem arose on a half execution of localizejob. this might happen when the namenode is very busy. The job.xml is copied but the job.jar isnt. So the job is not fully localized. The new task on the machine tries to localize the job but fails with the error mentioned. This patch deletes any presexisting job.xml if the job has not been fully localized and tries localizing the job again.

> IOException: job.xml already exists
> -----------------------------------
>
>                 Key: HADOOP-705
>                 URL: http://issues.apache.org/jira/browse/HADOOP-705
>             Project: Hadoop
>          Issue Type: Bug
>          Components: mapred
>    Affects Versions: 0.8.0
>            Reporter: Nigel Daley
>         Assigned To: Mahadev konar
>         Attachments: jobxml.patch
>
>
> I'm seeing this exception in the JobTracker log.  It's caused the same map to fail enough that the job aborted.
> 2006-11-09 17:28:37,594 INFO org.apache.hadoop.mapred.TaskInProgress: Error from task_0004_m_000588_2: Error 
> initializing task_0004_m_000588_2:
> java.io.IOException: Target /foobar/tmp/mapred/local/taskTracker/jobcache/job_0004/job.xml already exists
>         at org.apache.hadoop.fs.FileUtil.checkDest(FileUtil.java:215)
>         at org.apache.hadoop.fs.FileUtil.copy(FileUtil.java:61)
>         at org.apache.hadoop.dfs.DistributedFileSystem.copyToLocalFile(DistributedFileSystem.java:192)
>         at org.apache.hadoop.mapred.TaskTracker.localizeJob(TaskTracker.java:279)
>         at org.apache.hadoop.mapred.TaskTracker.startNewTask(TaskTracker.java:691)
>         at org.apache.hadoop.mapred.TaskTracker.checkForNewTasks(TaskTracker.java:533)
>         at org.apache.hadoop.mapred.TaskTracker.offerService(TaskTracker.java:448)
>         at org.apache.hadoop.mapred.TaskTracker.run(TaskTracker.java:720)
>         at org.apache.hadoop.mapred.TaskTracker.main(TaskTracker.java:1374)

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira