You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Mukund Madhugiri (JIRA)" <ji...@apache.org> on 2008/03/25 00:19:28 UTC
[jira] Created: (HADOOP-3084) distcp fails for files with zero
length
distcp fails for files with zero length
---------------------------------------
Key: HADOOP-3084
URL: https://issues.apache.org/jira/browse/HADOOP-3084
Project: Hadoop Core
Issue Type: Bug
Components: util
Affects Versions: 0.16.1, 0.16.0, 0.16.2
Reporter: Mukund Madhugiri
Assignee: Robert Chansler
Priority: Critical
Fix For: 0.16.2
distcp fails for files with zero length. This is a regression from 0.15.3
distcp hftp://<namenode:port>/dir1/file1 file2
08/03/24 23:09:45 INFO util.CopyFiles: srcPaths=[hftp://<namenode:port>/dir1/file1]
08/03/24 23:09:45 INFO util.CopyFiles: destPath=file2
08/03/24 23:09:45 INFO util.CopyFiles: srcCount=1
08/03/24 23:09:46 INFO mapred.JobClient: Running job: job_200803242306_0001
08/03/24 23:09:47 INFO mapred.JobClient: map 0% reduce 0%
08/03/24 23:10:01 INFO mapred.JobClient: Task Id : task_200803242306_0001_m_000000_0, Status : FAILED
java.io.IOException: Copied: 0 Skipped: 0 Failed: 1
at org.apache.hadoop.util.CopyFiles$FSCopyFilesMapper.close(CopyFiles.java:448)
at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:53)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:208)
at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2084)
08/03/24 23:10:18 INFO mapred.JobClient: Task Id : task_200803242306_0001_m_000000_1, Status : FAILED
java.io.IOException: Copied: 0 Skipped: 0 Failed: 1
at org.apache.hadoop.util.CopyFiles$FSCopyFilesMapper.close(CopyFiles.java:448)
at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:53)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:208)
at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2084)
08/03/24 23:10:33 INFO mapred.JobClient: Task Id : task_200803242306_0001_m_000000_2, Status : FAILED
java.io.IOException: Copied: 0 Skipped: 0 Failed: 1
at org.apache.hadoop.util.CopyFiles$FSCopyFilesMapper.close(CopyFiles.java:448)
at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:53)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:208)
at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2084)
^@08/03/24 23:10:48 INFO mapred.JobClient: map 100% reduce 100%
With failures, global counters are inaccurate; consider running with -i
Copy failed: java.io.IOException: Job failed!
at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:894)
at org.apache.hadoop.util.CopyFiles.copy(CopyFiles.java:526)
at org.apache.hadoop.util.CopyFiles.run(CopyFiles.java:596)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
at org.apache.hadoop.util.CopyFiles.main(CopyFiles.java:612)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-3084) distcp fails for files with zero
length
Posted by "Tsz Wo (Nicholas), SZE (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12581721#action_12581721 ]
Tsz Wo (Nicholas), SZE commented on HADOOP-3084:
------------------------------------------------
Is file2 an absolute path? If I remember correctly, distcp cannot handle relative paths.
> distcp fails for files with zero length
> ---------------------------------------
>
> Key: HADOOP-3084
> URL: https://issues.apache.org/jira/browse/HADOOP-3084
> Project: Hadoop Core
> Issue Type: Bug
> Components: util
> Affects Versions: 0.16.0, 0.16.1, 0.16.2
> Reporter: Mukund Madhugiri
> Assignee: Robert Chansler
> Priority: Blocker
> Fix For: 0.16.2
>
>
> distcp fails for files with zero length. This is a regression from 0.15.3
> distcp hftp://<namenode:port>/dir1/file1 file2
> 08/03/24 23:09:45 INFO util.CopyFiles: srcPaths=[hftp://<namenode:port>/dir1/file1]
> 08/03/24 23:09:45 INFO util.CopyFiles: destPath=file2
> 08/03/24 23:09:45 INFO util.CopyFiles: srcCount=1
> 08/03/24 23:09:46 INFO mapred.JobClient: Running job: job_200803242306_0001
> 08/03/24 23:09:47 INFO mapred.JobClient: map 0% reduce 0%
> 08/03/24 23:10:01 INFO mapred.JobClient: Task Id : task_200803242306_0001_m_000000_0, Status : FAILED
> java.io.IOException: Copied: 0 Skipped: 0 Failed: 1
> at org.apache.hadoop.util.CopyFiles$FSCopyFilesMapper.close(CopyFiles.java:448)
> at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:53)
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:208)
> at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2084)
> 08/03/24 23:10:18 INFO mapred.JobClient: Task Id : task_200803242306_0001_m_000000_1, Status : FAILED
> java.io.IOException: Copied: 0 Skipped: 0 Failed: 1
> at org.apache.hadoop.util.CopyFiles$FSCopyFilesMapper.close(CopyFiles.java:448)
> at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:53)
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:208)
> at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2084)
> 08/03/24 23:10:33 INFO mapred.JobClient: Task Id : task_200803242306_0001_m_000000_2, Status : FAILED
> java.io.IOException: Copied: 0 Skipped: 0 Failed: 1
> at org.apache.hadoop.util.CopyFiles$FSCopyFilesMapper.close(CopyFiles.java:448)
> at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:53)
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:208)
> at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2084)
> ^@08/03/24 23:10:48 INFO mapred.JobClient: map 100% reduce 100%
> With failures, global counters are inaccurate; consider running with -i
> Copy failed: java.io.IOException: Job failed!
> at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:894)
> at org.apache.hadoop.util.CopyFiles.copy(CopyFiles.java:526)
> at org.apache.hadoop.util.CopyFiles.run(CopyFiles.java:596)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
> at org.apache.hadoop.util.CopyFiles.main(CopyFiles.java:612)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Assigned: (HADOOP-3084) distcp fails for files with zero
length
Posted by "Robert Chansler (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Robert Chansler reassigned HADOOP-3084:
---------------------------------------
Assignee: Chris Douglas (was: Robert Chansler)
> distcp fails for files with zero length
> ---------------------------------------
>
> Key: HADOOP-3084
> URL: https://issues.apache.org/jira/browse/HADOOP-3084
> Project: Hadoop Core
> Issue Type: Bug
> Components: util
> Affects Versions: 0.16.0, 0.16.1, 0.16.2
> Reporter: Mukund Madhugiri
> Assignee: Chris Douglas
> Priority: Blocker
> Fix For: 0.16.2
>
>
> distcp fails for files with zero length. This is a regression from 0.15.3
> distcp hftp://<namenode:port>/dir1/file1 file2
> 08/03/24 23:09:45 INFO util.CopyFiles: srcPaths=[hftp://<namenode:port>/dir1/file1]
> 08/03/24 23:09:45 INFO util.CopyFiles: destPath=file2
> 08/03/24 23:09:45 INFO util.CopyFiles: srcCount=1
> 08/03/24 23:09:46 INFO mapred.JobClient: Running job: job_200803242306_0001
> 08/03/24 23:09:47 INFO mapred.JobClient: map 0% reduce 0%
> 08/03/24 23:10:01 INFO mapred.JobClient: Task Id : task_200803242306_0001_m_000000_0, Status : FAILED
> java.io.IOException: Copied: 0 Skipped: 0 Failed: 1
> at org.apache.hadoop.util.CopyFiles$FSCopyFilesMapper.close(CopyFiles.java:448)
> at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:53)
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:208)
> at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2084)
> 08/03/24 23:10:18 INFO mapred.JobClient: Task Id : task_200803242306_0001_m_000000_1, Status : FAILED
> java.io.IOException: Copied: 0 Skipped: 0 Failed: 1
> at org.apache.hadoop.util.CopyFiles$FSCopyFilesMapper.close(CopyFiles.java:448)
> at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:53)
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:208)
> at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2084)
> 08/03/24 23:10:33 INFO mapred.JobClient: Task Id : task_200803242306_0001_m_000000_2, Status : FAILED
> java.io.IOException: Copied: 0 Skipped: 0 Failed: 1
> at org.apache.hadoop.util.CopyFiles$FSCopyFilesMapper.close(CopyFiles.java:448)
> at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:53)
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:208)
> at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2084)
> ^@08/03/24 23:10:48 INFO mapred.JobClient: map 100% reduce 100%
> With failures, global counters are inaccurate; consider running with -i
> Copy failed: java.io.IOException: Job failed!
> at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:894)
> at org.apache.hadoop.util.CopyFiles.copy(CopyFiles.java:526)
> at org.apache.hadoop.util.CopyFiles.run(CopyFiles.java:596)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
> at org.apache.hadoop.util.CopyFiles.main(CopyFiles.java:612)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3084) distcp fails for files with zero
length
Posted by "Chris Douglas (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Chris Douglas updated HADOOP-3084:
----------------------------------
Attachment: 3084-0.patch
> distcp fails for files with zero length
> ---------------------------------------
>
> Key: HADOOP-3084
> URL: https://issues.apache.org/jira/browse/HADOOP-3084
> Project: Hadoop Core
> Issue Type: Bug
> Components: util
> Affects Versions: 0.16.0, 0.16.1, 0.16.2
> Reporter: Mukund Madhugiri
> Assignee: Chris Douglas
> Priority: Blocker
> Fix For: 0.16.2
>
> Attachments: 3084-0.patch
>
>
> distcp fails for files with zero length. This is a regression from 0.15.3
> distcp hftp://<namenode:port>/dir1/file1 file2
> 08/03/24 23:09:45 INFO util.CopyFiles: srcPaths=[hftp://<namenode:port>/dir1/file1]
> 08/03/24 23:09:45 INFO util.CopyFiles: destPath=file2
> 08/03/24 23:09:45 INFO util.CopyFiles: srcCount=1
> 08/03/24 23:09:46 INFO mapred.JobClient: Running job: job_200803242306_0001
> 08/03/24 23:09:47 INFO mapred.JobClient: map 0% reduce 0%
> 08/03/24 23:10:01 INFO mapred.JobClient: Task Id : task_200803242306_0001_m_000000_0, Status : FAILED
> java.io.IOException: Copied: 0 Skipped: 0 Failed: 1
> at org.apache.hadoop.util.CopyFiles$FSCopyFilesMapper.close(CopyFiles.java:448)
> at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:53)
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:208)
> at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2084)
> 08/03/24 23:10:18 INFO mapred.JobClient: Task Id : task_200803242306_0001_m_000000_1, Status : FAILED
> java.io.IOException: Copied: 0 Skipped: 0 Failed: 1
> at org.apache.hadoop.util.CopyFiles$FSCopyFilesMapper.close(CopyFiles.java:448)
> at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:53)
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:208)
> at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2084)
> 08/03/24 23:10:33 INFO mapred.JobClient: Task Id : task_200803242306_0001_m_000000_2, Status : FAILED
> java.io.IOException: Copied: 0 Skipped: 0 Failed: 1
> at org.apache.hadoop.util.CopyFiles$FSCopyFilesMapper.close(CopyFiles.java:448)
> at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:53)
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:208)
> at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2084)
> ^@08/03/24 23:10:48 INFO mapred.JobClient: map 100% reduce 100%
> With failures, global counters are inaccurate; consider running with -i
> Copy failed: java.io.IOException: Job failed!
> at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:894)
> at org.apache.hadoop.util.CopyFiles.copy(CopyFiles.java:526)
> at org.apache.hadoop.util.CopyFiles.run(CopyFiles.java:596)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
> at org.apache.hadoop.util.CopyFiles.main(CopyFiles.java:612)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3084) distcp fails for files with zero
length
Posted by "Chris Douglas (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Chris Douglas updated HADOOP-3084:
----------------------------------
Status: Patch Available (was: Open)
This lets FileDataServlet share code with the browseDirectory service and redirects to a random datanode using ReplicationChooser now that zero-length blocks are not returned for zero-length files.
> distcp fails for files with zero length
> ---------------------------------------
>
> Key: HADOOP-3084
> URL: https://issues.apache.org/jira/browse/HADOOP-3084
> Project: Hadoop Core
> Issue Type: Bug
> Components: util
> Affects Versions: 0.16.1, 0.16.0, 0.16.2
> Reporter: Mukund Madhugiri
> Assignee: Chris Douglas
> Priority: Blocker
> Fix For: 0.16.2
>
> Attachments: 3084-0.patch
>
>
> distcp fails for files with zero length. This is a regression from 0.15.3
> distcp hftp://<namenode:port>/dir1/file1 file2
> 08/03/24 23:09:45 INFO util.CopyFiles: srcPaths=[hftp://<namenode:port>/dir1/file1]
> 08/03/24 23:09:45 INFO util.CopyFiles: destPath=file2
> 08/03/24 23:09:45 INFO util.CopyFiles: srcCount=1
> 08/03/24 23:09:46 INFO mapred.JobClient: Running job: job_200803242306_0001
> 08/03/24 23:09:47 INFO mapred.JobClient: map 0% reduce 0%
> 08/03/24 23:10:01 INFO mapred.JobClient: Task Id : task_200803242306_0001_m_000000_0, Status : FAILED
> java.io.IOException: Copied: 0 Skipped: 0 Failed: 1
> at org.apache.hadoop.util.CopyFiles$FSCopyFilesMapper.close(CopyFiles.java:448)
> at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:53)
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:208)
> at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2084)
> 08/03/24 23:10:18 INFO mapred.JobClient: Task Id : task_200803242306_0001_m_000000_1, Status : FAILED
> java.io.IOException: Copied: 0 Skipped: 0 Failed: 1
> at org.apache.hadoop.util.CopyFiles$FSCopyFilesMapper.close(CopyFiles.java:448)
> at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:53)
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:208)
> at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2084)
> 08/03/24 23:10:33 INFO mapred.JobClient: Task Id : task_200803242306_0001_m_000000_2, Status : FAILED
> java.io.IOException: Copied: 0 Skipped: 0 Failed: 1
> at org.apache.hadoop.util.CopyFiles$FSCopyFilesMapper.close(CopyFiles.java:448)
> at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:53)
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:208)
> at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2084)
> ^@08/03/24 23:10:48 INFO mapred.JobClient: map 100% reduce 100%
> With failures, global counters are inaccurate; consider running with -i
> Copy failed: java.io.IOException: Job failed!
> at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:894)
> at org.apache.hadoop.util.CopyFiles.copy(CopyFiles.java:526)
> at org.apache.hadoop.util.CopyFiles.run(CopyFiles.java:596)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
> at org.apache.hadoop.util.CopyFiles.main(CopyFiles.java:612)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3084) distcp fails for files with zero
length
Posted by "Chris Douglas (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Chris Douglas updated HADOOP-3084:
----------------------------------
Resolution: Fixed
Status: Resolved (was: Patch Available)
I committed this.
> distcp fails for files with zero length
> ---------------------------------------
>
> Key: HADOOP-3084
> URL: https://issues.apache.org/jira/browse/HADOOP-3084
> Project: Hadoop Core
> Issue Type: Bug
> Components: util
> Affects Versions: 0.16.0, 0.16.1, 0.16.2
> Reporter: Mukund Madhugiri
> Assignee: Chris Douglas
> Priority: Blocker
> Fix For: 0.16.2
>
> Attachments: 3084-0.patch, 3084v16-0.patch
>
>
> distcp fails for files with zero length. This is a regression from 0.15.3
> distcp hftp://<namenode:port>/dir1/file1 file2
> 08/03/24 23:09:45 INFO util.CopyFiles: srcPaths=[hftp://<namenode:port>/dir1/file1]
> 08/03/24 23:09:45 INFO util.CopyFiles: destPath=file2
> 08/03/24 23:09:45 INFO util.CopyFiles: srcCount=1
> 08/03/24 23:09:46 INFO mapred.JobClient: Running job: job_200803242306_0001
> 08/03/24 23:09:47 INFO mapred.JobClient: map 0% reduce 0%
> 08/03/24 23:10:01 INFO mapred.JobClient: Task Id : task_200803242306_0001_m_000000_0, Status : FAILED
> java.io.IOException: Copied: 0 Skipped: 0 Failed: 1
> at org.apache.hadoop.util.CopyFiles$FSCopyFilesMapper.close(CopyFiles.java:448)
> at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:53)
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:208)
> at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2084)
> 08/03/24 23:10:18 INFO mapred.JobClient: Task Id : task_200803242306_0001_m_000000_1, Status : FAILED
> java.io.IOException: Copied: 0 Skipped: 0 Failed: 1
> at org.apache.hadoop.util.CopyFiles$FSCopyFilesMapper.close(CopyFiles.java:448)
> at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:53)
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:208)
> at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2084)
> 08/03/24 23:10:33 INFO mapred.JobClient: Task Id : task_200803242306_0001_m_000000_2, Status : FAILED
> java.io.IOException: Copied: 0 Skipped: 0 Failed: 1
> at org.apache.hadoop.util.CopyFiles$FSCopyFilesMapper.close(CopyFiles.java:448)
> at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:53)
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:208)
> at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2084)
> ^@08/03/24 23:10:48 INFO mapred.JobClient: map 100% reduce 100%
> With failures, global counters are inaccurate; consider running with -i
> Copy failed: java.io.IOException: Job failed!
> at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:894)
> at org.apache.hadoop.util.CopyFiles.copy(CopyFiles.java:526)
> at org.apache.hadoop.util.CopyFiles.run(CopyFiles.java:596)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
> at org.apache.hadoop.util.CopyFiles.main(CopyFiles.java:612)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-3084) distcp fails for files with zero
length
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12582998#action_12582998 ]
Hudson commented on HADOOP-3084:
--------------------------------
Integrated in Hadoop-trunk #444 (See [http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/444/])
> distcp fails for files with zero length
> ---------------------------------------
>
> Key: HADOOP-3084
> URL: https://issues.apache.org/jira/browse/HADOOP-3084
> Project: Hadoop Core
> Issue Type: Bug
> Components: util
> Affects Versions: 0.16.0, 0.16.1, 0.16.2
> Reporter: Mukund Madhugiri
> Assignee: Chris Douglas
> Priority: Blocker
> Fix For: 0.16.2
>
> Attachments: 3084-0.patch, 3084v16-0.patch
>
>
> distcp fails for files with zero length. This is a regression from 0.15.3
> distcp hftp://<namenode:port>/dir1/file1 file2
> 08/03/24 23:09:45 INFO util.CopyFiles: srcPaths=[hftp://<namenode:port>/dir1/file1]
> 08/03/24 23:09:45 INFO util.CopyFiles: destPath=file2
> 08/03/24 23:09:45 INFO util.CopyFiles: srcCount=1
> 08/03/24 23:09:46 INFO mapred.JobClient: Running job: job_200803242306_0001
> 08/03/24 23:09:47 INFO mapred.JobClient: map 0% reduce 0%
> 08/03/24 23:10:01 INFO mapred.JobClient: Task Id : task_200803242306_0001_m_000000_0, Status : FAILED
> java.io.IOException: Copied: 0 Skipped: 0 Failed: 1
> at org.apache.hadoop.util.CopyFiles$FSCopyFilesMapper.close(CopyFiles.java:448)
> at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:53)
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:208)
> at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2084)
> 08/03/24 23:10:18 INFO mapred.JobClient: Task Id : task_200803242306_0001_m_000000_1, Status : FAILED
> java.io.IOException: Copied: 0 Skipped: 0 Failed: 1
> at org.apache.hadoop.util.CopyFiles$FSCopyFilesMapper.close(CopyFiles.java:448)
> at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:53)
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:208)
> at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2084)
> 08/03/24 23:10:33 INFO mapred.JobClient: Task Id : task_200803242306_0001_m_000000_2, Status : FAILED
> java.io.IOException: Copied: 0 Skipped: 0 Failed: 1
> at org.apache.hadoop.util.CopyFiles$FSCopyFilesMapper.close(CopyFiles.java:448)
> at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:53)
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:208)
> at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2084)
> ^@08/03/24 23:10:48 INFO mapred.JobClient: map 100% reduce 100%
> With failures, global counters are inaccurate; consider running with -i
> Copy failed: java.io.IOException: Job failed!
> at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:894)
> at org.apache.hadoop.util.CopyFiles.copy(CopyFiles.java:526)
> at org.apache.hadoop.util.CopyFiles.run(CopyFiles.java:596)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
> at org.apache.hadoop.util.CopyFiles.main(CopyFiles.java:612)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-3084) distcp fails for files with zero
length
Posted by "Tsz Wo (Nicholas), SZE (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12582468#action_12582468 ]
Tsz Wo (Nicholas), SZE commented on HADOOP-3084:
------------------------------------------------
+1 for the patch
> distcp fails for files with zero length
> ---------------------------------------
>
> Key: HADOOP-3084
> URL: https://issues.apache.org/jira/browse/HADOOP-3084
> Project: Hadoop Core
> Issue Type: Bug
> Components: util
> Affects Versions: 0.16.0, 0.16.1, 0.16.2
> Reporter: Mukund Madhugiri
> Assignee: Chris Douglas
> Priority: Blocker
> Fix For: 0.16.2
>
> Attachments: 3084-0.patch
>
>
> distcp fails for files with zero length. This is a regression from 0.15.3
> distcp hftp://<namenode:port>/dir1/file1 file2
> 08/03/24 23:09:45 INFO util.CopyFiles: srcPaths=[hftp://<namenode:port>/dir1/file1]
> 08/03/24 23:09:45 INFO util.CopyFiles: destPath=file2
> 08/03/24 23:09:45 INFO util.CopyFiles: srcCount=1
> 08/03/24 23:09:46 INFO mapred.JobClient: Running job: job_200803242306_0001
> 08/03/24 23:09:47 INFO mapred.JobClient: map 0% reduce 0%
> 08/03/24 23:10:01 INFO mapred.JobClient: Task Id : task_200803242306_0001_m_000000_0, Status : FAILED
> java.io.IOException: Copied: 0 Skipped: 0 Failed: 1
> at org.apache.hadoop.util.CopyFiles$FSCopyFilesMapper.close(CopyFiles.java:448)
> at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:53)
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:208)
> at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2084)
> 08/03/24 23:10:18 INFO mapred.JobClient: Task Id : task_200803242306_0001_m_000000_1, Status : FAILED
> java.io.IOException: Copied: 0 Skipped: 0 Failed: 1
> at org.apache.hadoop.util.CopyFiles$FSCopyFilesMapper.close(CopyFiles.java:448)
> at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:53)
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:208)
> at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2084)
> 08/03/24 23:10:33 INFO mapred.JobClient: Task Id : task_200803242306_0001_m_000000_2, Status : FAILED
> java.io.IOException: Copied: 0 Skipped: 0 Failed: 1
> at org.apache.hadoop.util.CopyFiles$FSCopyFilesMapper.close(CopyFiles.java:448)
> at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:53)
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:208)
> at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2084)
> ^@08/03/24 23:10:48 INFO mapred.JobClient: map 100% reduce 100%
> With failures, global counters are inaccurate; consider running with -i
> Copy failed: java.io.IOException: Job failed!
> at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:894)
> at org.apache.hadoop.util.CopyFiles.copy(CopyFiles.java:526)
> at org.apache.hadoop.util.CopyFiles.run(CopyFiles.java:596)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
> at org.apache.hadoop.util.CopyFiles.main(CopyFiles.java:612)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-3084) distcp fails for files with zero
length
Posted by "Tsz Wo (Nicholas), SZE (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12582437#action_12582437 ]
Tsz Wo (Nicholas), SZE commented on HADOOP-3084:
------------------------------------------------
Since the class FSNamesystem is package private, we can remove getDatanodeByIndex(int index)and randomDataNode() directly without deprecating them.
> distcp fails for files with zero length
> ---------------------------------------
>
> Key: HADOOP-3084
> URL: https://issues.apache.org/jira/browse/HADOOP-3084
> Project: Hadoop Core
> Issue Type: Bug
> Components: util
> Affects Versions: 0.16.0, 0.16.1, 0.16.2
> Reporter: Mukund Madhugiri
> Assignee: Chris Douglas
> Priority: Blocker
> Fix For: 0.16.2
>
> Attachments: 3084-0.patch
>
>
> distcp fails for files with zero length. This is a regression from 0.15.3
> distcp hftp://<namenode:port>/dir1/file1 file2
> 08/03/24 23:09:45 INFO util.CopyFiles: srcPaths=[hftp://<namenode:port>/dir1/file1]
> 08/03/24 23:09:45 INFO util.CopyFiles: destPath=file2
> 08/03/24 23:09:45 INFO util.CopyFiles: srcCount=1
> 08/03/24 23:09:46 INFO mapred.JobClient: Running job: job_200803242306_0001
> 08/03/24 23:09:47 INFO mapred.JobClient: map 0% reduce 0%
> 08/03/24 23:10:01 INFO mapred.JobClient: Task Id : task_200803242306_0001_m_000000_0, Status : FAILED
> java.io.IOException: Copied: 0 Skipped: 0 Failed: 1
> at org.apache.hadoop.util.CopyFiles$FSCopyFilesMapper.close(CopyFiles.java:448)
> at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:53)
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:208)
> at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2084)
> 08/03/24 23:10:18 INFO mapred.JobClient: Task Id : task_200803242306_0001_m_000000_1, Status : FAILED
> java.io.IOException: Copied: 0 Skipped: 0 Failed: 1
> at org.apache.hadoop.util.CopyFiles$FSCopyFilesMapper.close(CopyFiles.java:448)
> at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:53)
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:208)
> at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2084)
> 08/03/24 23:10:33 INFO mapred.JobClient: Task Id : task_200803242306_0001_m_000000_2, Status : FAILED
> java.io.IOException: Copied: 0 Skipped: 0 Failed: 1
> at org.apache.hadoop.util.CopyFiles$FSCopyFilesMapper.close(CopyFiles.java:448)
> at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:53)
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:208)
> at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2084)
> ^@08/03/24 23:10:48 INFO mapred.JobClient: map 100% reduce 100%
> With failures, global counters are inaccurate; consider running with -i
> Copy failed: java.io.IOException: Job failed!
> at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:894)
> at org.apache.hadoop.util.CopyFiles.copy(CopyFiles.java:526)
> at org.apache.hadoop.util.CopyFiles.run(CopyFiles.java:596)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
> at org.apache.hadoop.util.CopyFiles.main(CopyFiles.java:612)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-3084) distcp fails for files with zero
length
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12582500#action_12582500 ]
Hadoop QA commented on HADOOP-3084:
-----------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12378664/3084-0.patch
against trunk revision 619744.
@author +1. The patch does not contain any @author tags.
tests included -1. The patch doesn't appear to include any new or modified tests.
Please justify why no tests are needed for this patch.
javadoc +1. The javadoc tool did not generate any warning messages.
javac -1. The applied patch generated 567 javac compiler warnings (more than the trunk's current 566 warnings).
release audit +1. The applied patch does not generate any new release audit warnings.
findbugs +1. The patch does not introduce any new Findbugs warnings.
core tests +1. The patch passed core unit tests.
contrib tests +1. The patch passed contrib unit tests.
Test results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2070/testReport/
Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2070/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Checkstyle results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2070/artifact/trunk/build/test/checkstyle-errors.html
Console output: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2070/console
This message is automatically generated.
> distcp fails for files with zero length
> ---------------------------------------
>
> Key: HADOOP-3084
> URL: https://issues.apache.org/jira/browse/HADOOP-3084
> Project: Hadoop Core
> Issue Type: Bug
> Components: util
> Affects Versions: 0.16.0, 0.16.1, 0.16.2
> Reporter: Mukund Madhugiri
> Assignee: Chris Douglas
> Priority: Blocker
> Fix For: 0.16.2
>
> Attachments: 3084-0.patch
>
>
> distcp fails for files with zero length. This is a regression from 0.15.3
> distcp hftp://<namenode:port>/dir1/file1 file2
> 08/03/24 23:09:45 INFO util.CopyFiles: srcPaths=[hftp://<namenode:port>/dir1/file1]
> 08/03/24 23:09:45 INFO util.CopyFiles: destPath=file2
> 08/03/24 23:09:45 INFO util.CopyFiles: srcCount=1
> 08/03/24 23:09:46 INFO mapred.JobClient: Running job: job_200803242306_0001
> 08/03/24 23:09:47 INFO mapred.JobClient: map 0% reduce 0%
> 08/03/24 23:10:01 INFO mapred.JobClient: Task Id : task_200803242306_0001_m_000000_0, Status : FAILED
> java.io.IOException: Copied: 0 Skipped: 0 Failed: 1
> at org.apache.hadoop.util.CopyFiles$FSCopyFilesMapper.close(CopyFiles.java:448)
> at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:53)
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:208)
> at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2084)
> 08/03/24 23:10:18 INFO mapred.JobClient: Task Id : task_200803242306_0001_m_000000_1, Status : FAILED
> java.io.IOException: Copied: 0 Skipped: 0 Failed: 1
> at org.apache.hadoop.util.CopyFiles$FSCopyFilesMapper.close(CopyFiles.java:448)
> at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:53)
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:208)
> at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2084)
> 08/03/24 23:10:33 INFO mapred.JobClient: Task Id : task_200803242306_0001_m_000000_2, Status : FAILED
> java.io.IOException: Copied: 0 Skipped: 0 Failed: 1
> at org.apache.hadoop.util.CopyFiles$FSCopyFilesMapper.close(CopyFiles.java:448)
> at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:53)
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:208)
> at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2084)
> ^@08/03/24 23:10:48 INFO mapred.JobClient: map 100% reduce 100%
> With failures, global counters are inaccurate; consider running with -i
> Copy failed: java.io.IOException: Job failed!
> at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:894)
> at org.apache.hadoop.util.CopyFiles.copy(CopyFiles.java:526)
> at org.apache.hadoop.util.CopyFiles.run(CopyFiles.java:596)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
> at org.apache.hadoop.util.CopyFiles.main(CopyFiles.java:612)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3084) distcp fails for files with zero
length
Posted by "Chris Douglas (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Chris Douglas updated HADOOP-3084:
----------------------------------
Attachment: 3084v16-0.patch
Since HADOOP-2239 was committed to trunk, we need a slightly different fix for 0.16.
> distcp fails for files with zero length
> ---------------------------------------
>
> Key: HADOOP-3084
> URL: https://issues.apache.org/jira/browse/HADOOP-3084
> Project: Hadoop Core
> Issue Type: Bug
> Components: util
> Affects Versions: 0.16.0, 0.16.1, 0.16.2
> Reporter: Mukund Madhugiri
> Assignee: Chris Douglas
> Priority: Blocker
> Fix For: 0.16.2
>
> Attachments: 3084-0.patch, 3084v16-0.patch
>
>
> distcp fails for files with zero length. This is a regression from 0.15.3
> distcp hftp://<namenode:port>/dir1/file1 file2
> 08/03/24 23:09:45 INFO util.CopyFiles: srcPaths=[hftp://<namenode:port>/dir1/file1]
> 08/03/24 23:09:45 INFO util.CopyFiles: destPath=file2
> 08/03/24 23:09:45 INFO util.CopyFiles: srcCount=1
> 08/03/24 23:09:46 INFO mapred.JobClient: Running job: job_200803242306_0001
> 08/03/24 23:09:47 INFO mapred.JobClient: map 0% reduce 0%
> 08/03/24 23:10:01 INFO mapred.JobClient: Task Id : task_200803242306_0001_m_000000_0, Status : FAILED
> java.io.IOException: Copied: 0 Skipped: 0 Failed: 1
> at org.apache.hadoop.util.CopyFiles$FSCopyFilesMapper.close(CopyFiles.java:448)
> at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:53)
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:208)
> at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2084)
> 08/03/24 23:10:18 INFO mapred.JobClient: Task Id : task_200803242306_0001_m_000000_1, Status : FAILED
> java.io.IOException: Copied: 0 Skipped: 0 Failed: 1
> at org.apache.hadoop.util.CopyFiles$FSCopyFilesMapper.close(CopyFiles.java:448)
> at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:53)
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:208)
> at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2084)
> 08/03/24 23:10:33 INFO mapred.JobClient: Task Id : task_200803242306_0001_m_000000_2, Status : FAILED
> java.io.IOException: Copied: 0 Skipped: 0 Failed: 1
> at org.apache.hadoop.util.CopyFiles$FSCopyFilesMapper.close(CopyFiles.java:448)
> at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:53)
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:208)
> at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2084)
> ^@08/03/24 23:10:48 INFO mapred.JobClient: map 100% reduce 100%
> With failures, global counters are inaccurate; consider running with -i
> Copy failed: java.io.IOException: Job failed!
> at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:894)
> at org.apache.hadoop.util.CopyFiles.copy(CopyFiles.java:526)
> at org.apache.hadoop.util.CopyFiles.run(CopyFiles.java:596)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
> at org.apache.hadoop.util.CopyFiles.main(CopyFiles.java:612)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3084) distcp fails for files with zero
length
Posted by "Mukund Madhugiri (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Mukund Madhugiri updated HADOOP-3084:
-------------------------------------
Priority: Blocker (was: Critical)
> distcp fails for files with zero length
> ---------------------------------------
>
> Key: HADOOP-3084
> URL: https://issues.apache.org/jira/browse/HADOOP-3084
> Project: Hadoop Core
> Issue Type: Bug
> Components: util
> Affects Versions: 0.16.0, 0.16.1, 0.16.2
> Reporter: Mukund Madhugiri
> Assignee: Robert Chansler
> Priority: Blocker
> Fix For: 0.16.2
>
>
> distcp fails for files with zero length. This is a regression from 0.15.3
> distcp hftp://<namenode:port>/dir1/file1 file2
> 08/03/24 23:09:45 INFO util.CopyFiles: srcPaths=[hftp://<namenode:port>/dir1/file1]
> 08/03/24 23:09:45 INFO util.CopyFiles: destPath=file2
> 08/03/24 23:09:45 INFO util.CopyFiles: srcCount=1
> 08/03/24 23:09:46 INFO mapred.JobClient: Running job: job_200803242306_0001
> 08/03/24 23:09:47 INFO mapred.JobClient: map 0% reduce 0%
> 08/03/24 23:10:01 INFO mapred.JobClient: Task Id : task_200803242306_0001_m_000000_0, Status : FAILED
> java.io.IOException: Copied: 0 Skipped: 0 Failed: 1
> at org.apache.hadoop.util.CopyFiles$FSCopyFilesMapper.close(CopyFiles.java:448)
> at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:53)
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:208)
> at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2084)
> 08/03/24 23:10:18 INFO mapred.JobClient: Task Id : task_200803242306_0001_m_000000_1, Status : FAILED
> java.io.IOException: Copied: 0 Skipped: 0 Failed: 1
> at org.apache.hadoop.util.CopyFiles$FSCopyFilesMapper.close(CopyFiles.java:448)
> at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:53)
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:208)
> at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2084)
> 08/03/24 23:10:33 INFO mapred.JobClient: Task Id : task_200803242306_0001_m_000000_2, Status : FAILED
> java.io.IOException: Copied: 0 Skipped: 0 Failed: 1
> at org.apache.hadoop.util.CopyFiles$FSCopyFilesMapper.close(CopyFiles.java:448)
> at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:53)
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:208)
> at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2084)
> ^@08/03/24 23:10:48 INFO mapred.JobClient: map 100% reduce 100%
> With failures, global counters are inaccurate; consider running with -i
> Copy failed: java.io.IOException: Job failed!
> at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:894)
> at org.apache.hadoop.util.CopyFiles.copy(CopyFiles.java:526)
> at org.apache.hadoop.util.CopyFiles.run(CopyFiles.java:596)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
> at org.apache.hadoop.util.CopyFiles.main(CopyFiles.java:612)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.