You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@tez.apache.org by "Hitesh Shah (JIRA)" <ji...@apache.org> on 2014/11/01 21:44:33 UTC
[jira] [Commented] (TEZ-1690) TestMultiMRInput tests fail because
of user collisions
[ https://issues.apache.org/jira/browse/TEZ-1690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14193457#comment-14193457 ]
Hitesh Shah commented on TEZ-1690:
----------------------------------
[~vasanthkumar] Thanks for the patch. A minor comment that will help this test run on all platforms without any issues. Similar to TestTezJobs and some other tests, it might be better to leverage the target/<test class> as the test dir. This will help prevent collisions across multiple tests in the same module and also ensure that it works on Windows for example where a /tmp dir is not guaranteed to exist.
Furthermore, each test case in the file could create its own subdir under the above test root dir if needed.
> TestMultiMRInput tests fail because of user collisions
> ------------------------------------------------------
>
> Key: TEZ-1690
> URL: https://issues.apache.org/jira/browse/TEZ-1690
> Project: Apache Tez
> Issue Type: Bug
> Affects Versions: 0.5.2
> Reporter: Gopal V
> Labels: newbie
> Attachments: TEZ-1690.1.patch
>
>
> If two users run "mvn test" on a machine, the paths in TestMultiMRInput collide & tests fail.
> {code}
> testSingleSplit(org.apache.tez.mapreduce.input.TestMultiMRInput) Time elapsed: 0.037 sec <<< ERROR!
> java.io.FileNotFoundException: /tmp/TestMultiMRInput/testSingleSplit/file1 (Permission denied)
> at java.io.FileOutputStream.open(Native Method)
> at java.io.FileOutputStream.<init>(FileOutputStream.java:212)
> at org.apache.hadoop.fs.RawLocalFileSystem$LocalFSFileOutputStream.<init>(RawLocalFileSystem.java:206)
> at org.apache.hadoop.fs.RawLocalFileSystem$LocalFSFileOutputStream.<init>(RawLocalFileSystem.java:202)
> at org.apache.hadoop.fs.RawLocalFileSystem.create(RawLocalFileSystem.java:265) at org.apache.hadoop.fs.RawLocalFileSystem.create(RawLocalFileSystem.java:252)
> at org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSOutputSummer.<init>(ChecksumFileSystem.java:384) at org.apache.hadoop.fs.ChecksumFileSystem.create(ChecksumFileSystem.java:443)
> at org.apache.hadoop.fs.ChecksumFileSystem.create(ChecksumFileSystem.java:424)
> at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:906)
> at org.apache.hadoop.io.SequenceFile$Writer.<init>(SequenceFile.java:1071)
> at org.apache.hadoop.io.SequenceFile$RecordCompressWriter.<init>(SequenceFile.java:1371)
> at org.apache.hadoop.io.SequenceFile.createWriter(SequenceFile.java:272)
> at org.apache.hadoop.io.SequenceFile.createWriter(SequenceFile.java:294)
> at org.apache.tez.mapreduce.input.TestMultiMRInput.createInputData(TestMultiMRInput.java:277)
> at org.apache.tez.mapreduce.input.TestMultiMRInput.testSingleSplit(TestMultiMRInput.java:106)
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)