You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Nigel Daley (JIRA)" <ji...@apache.org> on 2007/01/18 21:21:30 UTC

[jira] Created: (HADOOP-906) unit test failures: job.xml already exists

unit test failures: job.xml already exists
------------------------------------------

                 Key: HADOOP-906
                 URL: https://issues.apache.org/jira/browse/HADOOP-906
             Project: Hadoop
          Issue Type: Bug
          Components: mapred
    Affects Versions: 0.10.1
            Reporter: Nigel Daley
         Assigned To: Mahadev konar


In my last 30 test runs on REL4 and Windows, I've seen this exception 6 times on Windows and 2 times on REL4 in the TestMiniMRDFSCaching or TestMiniMRClasspath logs:

    [junit] java.io.IOException: Target C:/trunk/build/test/mapred/local/50064_1/taskTracker/jobcache/job_0001/job.xml already exists
    [junit] 	at org.apache.hadoop.fs.FileUtil.checkDest(FileUtil.java:245)
    [junit] 	at org.apache.hadoop.fs.FileUtil.copy(FileUtil.java:80)
    [junit] 	at org.apache.hadoop.fs.LocalFileSystem.copyToLocalFile(LocalFileSystem.java:349)
    [junit] 	at org.apache.hadoop.fs.FileSystem.copyToLocalFile(FileSystem.java:842)
    [junit] 	at org.apache.hadoop.mapred.TaskTracker.localizeJob(TaskTracker.java:330)
    [junit] 	at org.apache.hadoop.mapred.TaskTracker.startNewTask(TaskTracker.java:823)
    [junit] 	at org.apache.hadoop.mapred.TaskTracker.offerService(TaskTracker.java:510)
    [junit] 	at org.apache.hadoop.mapred.TaskTracker.run(TaskTracker.java:852)
    [junit] 	at org.apache.hadoop.mapred.MiniMRCluster$TaskTrackerRunner.run(MiniMRCluster.java:141)
    [junit] 	at java.lang.Thread.run(Thread.java:595)

In additon to the above exception, TestMiniMRClasspath also logged this exception further down in its log:

    [junit] 2007-01-05 12:23:24,027 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(531)) - Job job_0001 has completed successfully.
    [junit] 2007-01-05 12:23:24,058 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(638)) - Received 'KillJobAction' for job: job_0001
    [junit] 2007-01-05 12:23:24,058 INFO  mapred.TaskTracker (TaskTracker.java:cleanup(1167)) - Error cleaning up task runner: java.lang.NullPointerException
    [junit] 	at org.apache.hadoop.mapred.TaskTracker$TaskInProgress.cleanup(TaskTracker.java:1161)
    [junit] 	at org.apache.hadoop.mapred.TaskTracker$TaskInProgress.jobHasFinished(TaskTracker.java:1079)
    [junit] 	at org.apache.hadoop.mapred.TaskTracker.purgeJob(TaskTracker.java:650)
    [junit] 	at org.apache.hadoop.mapred.TaskTracker.access$100(TaskTracker.java:51)
    [junit] 	at org.apache.hadoop.mapred.TaskTracker$1.run(TaskTracker.java:151)
    [junit] 	at java.lang.Thread.run(Thread.java:595)

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: https://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] Resolved: (HADOOP-906) unit test failures: job.xml already exists

Posted by "Nigel Daley (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Nigel Daley resolved HADOOP-906.
--------------------------------

       Resolution: Cannot Reproduce
    Fix Version/s: 0.11.0

After the patch for HADOOP-912 has been applied, I can no longer reproduce these exception.

> unit test failures: job.xml already exists
> ------------------------------------------
>
>                 Key: HADOOP-906
>                 URL: https://issues.apache.org/jira/browse/HADOOP-906
>             Project: Hadoop
>          Issue Type: Bug
>          Components: mapred
>    Affects Versions: 0.10.1
>            Reporter: Nigel Daley
>         Assigned To: Mahadev konar
>             Fix For: 0.11.0
>
>
> In my last 30 test runs on REL4 and Windows, I've seen this exception 6 times on Windows and 2 times on REL4 in the TestMiniMRDFSCaching or TestMiniMRClasspath logs:
>     [junit] java.io.IOException: Target C:/trunk/build/test/mapred/local/50064_1/taskTracker/jobcache/job_0001/job.xml already exists
>     [junit] 	at org.apache.hadoop.fs.FileUtil.checkDest(FileUtil.java:245)
>     [junit] 	at org.apache.hadoop.fs.FileUtil.copy(FileUtil.java:80)
>     [junit] 	at org.apache.hadoop.fs.LocalFileSystem.copyToLocalFile(LocalFileSystem.java:349)
>     [junit] 	at org.apache.hadoop.fs.FileSystem.copyToLocalFile(FileSystem.java:842)
>     [junit] 	at org.apache.hadoop.mapred.TaskTracker.localizeJob(TaskTracker.java:330)
>     [junit] 	at org.apache.hadoop.mapred.TaskTracker.startNewTask(TaskTracker.java:823)
>     [junit] 	at org.apache.hadoop.mapred.TaskTracker.offerService(TaskTracker.java:510)
>     [junit] 	at org.apache.hadoop.mapred.TaskTracker.run(TaskTracker.java:852)
>     [junit] 	at org.apache.hadoop.mapred.MiniMRCluster$TaskTrackerRunner.run(MiniMRCluster.java:141)
>     [junit] 	at java.lang.Thread.run(Thread.java:595)
> In additon to the above exception, TestMiniMRClasspath also logged this exception further down in its log:
>     [junit] 2007-01-05 12:23:24,027 INFO  mapred.JobInProgress (JobInProgress.java:completedTask(531)) - Job job_0001 has completed successfully.
>     [junit] 2007-01-05 12:23:24,058 INFO  mapred.TaskTracker (TaskTracker.java:purgeJob(638)) - Received 'KillJobAction' for job: job_0001
>     [junit] 2007-01-05 12:23:24,058 INFO  mapred.TaskTracker (TaskTracker.java:cleanup(1167)) - Error cleaning up task runner: java.lang.NullPointerException
>     [junit] 	at org.apache.hadoop.mapred.TaskTracker$TaskInProgress.cleanup(TaskTracker.java:1161)
>     [junit] 	at org.apache.hadoop.mapred.TaskTracker$TaskInProgress.jobHasFinished(TaskTracker.java:1079)
>     [junit] 	at org.apache.hadoop.mapred.TaskTracker.purgeJob(TaskTracker.java:650)
>     [junit] 	at org.apache.hadoop.mapred.TaskTracker.access$100(TaskTracker.java:51)
>     [junit] 	at org.apache.hadoop.mapred.TaskTracker$1.run(TaskTracker.java:151)
>     [junit] 	at java.lang.Thread.run(Thread.java:595)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.