You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Vinod K V (JIRA)" <ji...@apache.org> on 2010/06/11 13:02:16 UTC
[jira] Created: (MAPREDUCE-1858) TestCopyFiles fails consistently
on trunk
TestCopyFiles fails consistently on trunk
-----------------------------------------
Key: MAPREDUCE-1858
URL: https://issues.apache.org/jira/browse/MAPREDUCE-1858
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: distcp
Affects Versions: 0.22.0
Reporter: Vinod K V
All the tests in TestCopyFiles fail. For e.g.
{code}
Testcase: testCopyFromLocalToLocal took 10.051 sec
Caused an ERROR
File /home/vinodkv/Workspace/eclipse-workspace/apache-svn-mapreduce/trunk/build/test/data/destdat/one/one/9208695393420117603 does not exist.
java.io.FileNotFoundException: File /home/vinodkv/Workspace/eclipse-workspace/apache-svn-mapreduce/trunk/build/test/data/destdat/one/one/9208695393420117603 does not exist.
at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:420)
at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:290)
at org.apache.hadoop.tools.TestCopyFiles.checkFiles(TestCopyFiles.java:169)
at org.apache.hadoop.tools.TestCopyFiles.checkFiles(TestCopyFiles.java:159)
at org.apache.hadoop.tools.TestCopyFiles.testCopyFromLocalToLocal(TestCopyFiles.java:271)
{code}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1858) TestCopyFiles fails consistently
on trunk
Posted by "Vinod K V (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12877780#action_12877780 ]
Vinod K V commented on MAPREDUCE-1858:
--------------------------------------
I see more logs.
{code}
Copy failed: java.lang.NullPointerException
at org.apache.hadoop.fs.FileStatus.readFields(FileStatus.java:280)
at org.apache.hadoop.tools.DistCp$FilePair.readFields(DistCp.java:245)
at org.apache.hadoop.io.SequenceFile$Reader.getCurrentValue(SequenceFile.java:1816)
at org.apache.hadoop.io.SequenceFile$Reader.next(SequenceFile.java:1944)
at org.apache.hadoop.tools.DistCp$CopyInputFormat.getSplits(DistCp.java:294)
at org.apache.hadoop.mapreduce.JobSubmitter.writeOldSplits(JobSubmitter.java:428)
at org.apache.hadoop.mapreduce.JobSubmitter.writeSplits(JobSubmitter.java:420)
at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:338)
at org.apache.hadoop.mapreduce.Job$2.run(Job.java:1033)
at org.apache.hadoop.mapreduce.Job$2.run(Job.java:1030)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:416)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:793)
at org.apache.hadoop.mapreduce.Job.submit(Job.java:1030)
at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:536)
at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:781)
at org.apache.hadoop.tools.DistCp.copy(DistCp.java:795)
at org.apache.hadoop.tools.DistCp.run(DistCp.java:1032)
{code}
Seems like a change in common project affected this. HADOOP-6796?
> TestCopyFiles fails consistently on trunk
> -----------------------------------------
>
> Key: MAPREDUCE-1858
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1858
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: distcp
> Affects Versions: 0.22.0
> Reporter: Vinod K V
>
> All the tests in TestCopyFiles fail. For e.g.
> {code}
> Testcase: testCopyFromLocalToLocal took 10.051 sec
> Caused an ERROR
> File /home/vinodkv/Workspace/eclipse-workspace/apache-svn-mapreduce/trunk/build/test/data/destdat/one/one/9208695393420117603 does not exist.
> java.io.FileNotFoundException: File /home/vinodkv/Workspace/eclipse-workspace/apache-svn-mapreduce/trunk/build/test/data/destdat/one/one/9208695393420117603 does not exist.
> at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:420)
> at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:290)
> at org.apache.hadoop.tools.TestCopyFiles.checkFiles(TestCopyFiles.java:169)
> at org.apache.hadoop.tools.TestCopyFiles.checkFiles(TestCopyFiles.java:159)
> at org.apache.hadoop.tools.TestCopyFiles.testCopyFromLocalToLocal(TestCopyFiles.java:271)
> {code}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Resolved: (MAPREDUCE-1858) TestCopyFiles fails consistently
on trunk
Posted by "Eli Collins (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Eli Collins resolved MAPREDUCE-1858.
------------------------------------
Resolution: Fixed
Reverted the patch for HADOOP-6796 and confirmed TestCopyFiles now passes.
> TestCopyFiles fails consistently on trunk
> -----------------------------------------
>
> Key: MAPREDUCE-1858
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1858
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: distcp
> Affects Versions: 0.22.0
> Reporter: Vinod K V
>
> All the tests in TestCopyFiles fail. For e.g.
> {code}
> Testcase: testCopyFromLocalToLocal took 10.051 sec
> Caused an ERROR
> File /home/vinodkv/Workspace/eclipse-workspace/apache-svn-mapreduce/trunk/build/test/data/destdat/one/one/9208695393420117603 does not exist.
> java.io.FileNotFoundException: File /home/vinodkv/Workspace/eclipse-workspace/apache-svn-mapreduce/trunk/build/test/data/destdat/one/one/9208695393420117603 does not exist.
> at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:420)
> at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:290)
> at org.apache.hadoop.tools.TestCopyFiles.checkFiles(TestCopyFiles.java:169)
> at org.apache.hadoop.tools.TestCopyFiles.checkFiles(TestCopyFiles.java:159)
> at org.apache.hadoop.tools.TestCopyFiles.testCopyFromLocalToLocal(TestCopyFiles.java:271)
> {code}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.