You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Hudson (JIRA)" <ji...@apache.org> on 2012/08/01 00:42:36 UTC

[jira] [Commented] (MAPREDUCE-4234) SortValidator.java is incompatible with multi-user or parallel use (due to a /tmp file with static name)

    [ https://issues.apache.org/jira/browse/MAPREDUCE-4234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13426189#comment-13426189 ] 

Hudson commented on MAPREDUCE-4234:
-----------------------------------

Integrated in Hadoop-Mapreduce-trunk-Commit #2562 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/2562/])
    MAPREDUCE-4234. SortValidator.java is incompatible with multi-user or parallel use (due to a /tmp file with static name) (Robert Evans via jeagles) (Revision 1367789)

     Result = FAILURE
jeagles : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1367789
Files : 
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/SortValidator.java
* /hadoop/common/trunk/hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/mapred/SortValidator.java

                
> SortValidator.java is incompatible with multi-user or parallel use (due to a /tmp file with static name)
> --------------------------------------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-4234
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4234
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: examples
>    Affects Versions: 0.23.3, trunk
>            Reporter: Randy Clayton
>            Assignee: Robert Joseph Evans
>            Priority: Minor
>         Attachments: MAPREDUCE-4234.patch, MR-4234.txt, MR-4234.txt
>
>
> The SortValidator.java file checkRecords method creates a file in the /tmp/sortvalidator directory using a static filename. This can result in failures due to name collisions when the hadoop-mapreduce-client-jobclient-*-tests jar is used by more than one task or one user simultaneously. We use this jar when testing compression codecs and after we started running tests in parallel (four at a time to reduce overall test time) we started experiencing random test failures due to name collisions. Creating a random or unique per thread filename may resolve this issue. We have developed a change to introduce per use unique file names. 

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira