You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Owen O'Malley (JIRA)" <ji...@apache.org> on 2009/03/20 16:38:50 UTC
[jira] Resolved: (HADOOP-1057) IOException: job.xml already exists
[ https://issues.apache.org/jira/browse/HADOOP-1057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Owen O'Malley resolved HADOOP-1057.
-----------------------------------
Resolution: Cannot Reproduce
I think we fixed this when various race conditions in the job tracker and task were fixed. I haven't seen it in years.
> IOException: job.xml already exists
> -----------------------------------
>
> Key: HADOOP-1057
> URL: https://issues.apache.org/jira/browse/HADOOP-1057
> Project: Hadoop Core
> Issue Type: Bug
> Components: mapred
> Affects Versions: 0.11.2
> Reporter: Nigel Daley
>
> Running TestMiniMRLocalFS on Linux, I saw this exception during the 2nd job that it runs:
> [junit] 2007-02-28 21:09:50,076 INFO mapred.JobInProgress (JobInProgress.java:findNewTask(573)) - Choosing normal task tip_0002_r_000000
> [junit] 2007-02-28 21:09:50,079 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(709)) - Adding task 'task_0002_r_000000_0' to tip tip_0002_r_000000, for tracker 'tracker_foo.com:60042'
> [junit] 2007-02-28 21:09:50,080 INFO mapred.TaskTracker (TaskTracker.java:startNewTask(849)) - LaunchTaskAction: task_0002_r_000000_0
> [junit] 2007-02-28 21:09:50,089 WARN mapred.TaskTracker (TaskTracker.java:startNewTask(866)) - Error initializing task_0002_r_000000_0:
> [junit] java.io.IOException: Target /foo/trunk/build/test/mapred/local/60044_0/taskTracker/jobcache/job_0002/job.xml already exists
> [junit] at org.apache.hadoop.fs.FileUtil.checkDest(FileUtil.java:226)
> [junit] at org.apache.hadoop.fs.FileUtil.copy(FileUtil.java:70)
> [junit] at org.apache.hadoop.fs.LocalFileSystem.copyToLocalFile(LocalFileSystem.java:55)
> [junit] at org.apache.hadoop.fs.FileSystem.copyToLocalFile(FileSystem.java:766)
> [junit] at org.apache.hadoop.mapred.TaskTracker.localizeJob(TaskTracker.java:351)
> [junit] at org.apache.hadoop.mapred.TaskTracker.startNewTask(TaskTracker.java:862)
> [junit] at org.apache.hadoop.mapred.TaskTracker.offerService(TaskTracker.java:530)
> [junit] at org.apache.hadoop.mapred.TaskTracker.run(TaskTracker.java:898)
> [junit] at org.apache.hadoop.mapred.MiniMRCluster$TaskTrackerRunner.run(MiniMRCluster.java:130)
> [junit] at java.lang.Thread.run(Thread.java:595)
> [junit] 2007-02-28 21:09:51,115 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(1056)) - task_0002_m_000000_0 1.0% file:/foo/trunk/build/test/data/wc/input/part-0:0+47
> [junit] 2007-02-28 21:09:51,117 INFO mapred.TaskTracker (TaskTracker.java:reportDone(1106)) - Task task_0002_m_000000_0 is done.
> [junit] 2007-02-28 21:09:51,203 INFO mapred.JobInProgress (JobInProgress.java:completedTask(616)) - Task 'task_0002_m_000000_0' has completed tip_0002_m_000000 successfully.
> [junit] 2007-02-28 21:09:51,203 INFO mapred.TaskInProgress (TaskInProgress.java:completedTask(411)) - Task 'task_0002_m_000000_0' has completed.
> [junit] 2007-02-28 21:09:51,847 INFO mapred.TaskInProgress (TaskInProgress.java:updateStatus(328)) - Error from task_0002_r_000000_0: Error initializing task_0002_r_000000_0:
> [junit] java.io.IOException: Target /foo/trunk/build/test/mapred/local/60044_0/taskTracker/jobcache/job_0002/job.xml already exists
> [junit] at org.apache.hadoop.fs.FileUtil.checkDest(FileUtil.java:226)
> [junit] at org.apache.hadoop.fs.FileUtil.copy(FileUtil.java:70)
> [junit] at org.apache.hadoop.fs.LocalFileSystem.copyToLocalFile(LocalFileSystem.java:55)
> [junit] at org.apache.hadoop.fs.FileSystem.copyToLocalFile(FileSystem.java:766)
> [junit] at org.apache.hadoop.mapred.TaskTracker.localizeJob(TaskTracker.java:351)
> [junit] at org.apache.hadoop.mapred.TaskTracker.startNewTask(TaskTracker.java:862)
> [junit] at org.apache.hadoop.mapred.TaskTracker.offerService(TaskTracker.java:530)
> [junit] at org.apache.hadoop.mapred.TaskTracker.run(TaskTracker.java:898)
> [junit] at org.apache.hadoop.mapred.MiniMRCluster$TaskTrackerRunner.run(MiniMRCluster.java:130)
> [junit] at java.lang.Thread.run(Thread.java:595)
> [junit] 2007-02-28 21:09:51,848 INFO mapred.TaskInProgress (TaskInProgress.java:failedSubTask(380)) - Task 'task_0002_r_000000_0' has been lost.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.