You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Arpit Gupta (JIRA)" <ji...@apache.org> on 2012/09/21 20:07:07 UTC

[jira] [Created] (MAPREDUCE-4673) make TestRawHistoryFile and TestJobHistoryServer more robust

Arpit Gupta created MAPREDUCE-4673:
--------------------------------------

             Summary: make TestRawHistoryFile and TestJobHistoryServer more robust
                 Key: MAPREDUCE-4673
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4673
             Project: Hadoop Map/Reduce
          Issue Type: Bug
          Components: test
    Affects Versions: 1.1.0, 1.2.0
            Reporter: Arpit Gupta
            Assignee: Arpit Gupta


these unit tests fail if 2 different users run them on the same host as they are using /tmp/input path

following is the info from the test log

{code}
testcase classname="org.apache.hadoop.mapred.TestJobHistoryServer" name="testHistoryServerStandalone" time="4.572">
    <failure message="/tmp/.input.crc (Permission denied)" type="junit.framework.AssertionFailedError">junit.framework.AssertionFailedError: /tmp/.input.crc (Permission denied)
        at org.apache.hadoop.mapred.TestJobHistoryServer.testHistoryServerStandalone(TestJobHistoryServer.java:113)
</failure>
{code}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (MAPREDUCE-4673) make TestRawHistoryFile and TestJobHistoryServer more robust

Posted by "Arpit Gupta (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-4673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Arpit Gupta updated MAPREDUCE-4673:
-----------------------------------

    Attachment: MAPREDUCE-4673.branch-1.patch

updated the patch with 80 char limit for the line.
                
> make TestRawHistoryFile and TestJobHistoryServer more robust
> ------------------------------------------------------------
>
>                 Key: MAPREDUCE-4673
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4673
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: test
>    Affects Versions: 1.1.0, 1.2.0
>            Reporter: Arpit Gupta
>            Assignee: Arpit Gupta
>         Attachments: MAPREDUCE-4673.branch-1.patch, MAPREDUCE-4673.branch-1.patch
>
>
> these unit tests fail if 2 different users run them on the same host as they are using /tmp/input path
> following is the info from the test log
> {code}
> testcase classname="org.apache.hadoop.mapred.TestJobHistoryServer" name="testHistoryServerStandalone" time="4.572">
>     <failure message="/tmp/.input.crc (Permission denied)" type="junit.framework.AssertionFailedError">junit.framework.AssertionFailedError: /tmp/.input.crc (Permission denied)
>         at org.apache.hadoop.mapred.TestJobHistoryServer.testHistoryServerStandalone(TestJobHistoryServer.java:113)
> </failure>
> {code}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (MAPREDUCE-4673) make TestRawHistoryFile and TestJobHistoryServer more robust

Posted by "Arpit Gupta (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-4673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Arpit Gupta updated MAPREDUCE-4673:
-----------------------------------

    Attachment: MAPREDUCE-4673.branch-1.patch

attached a patch for branch-1. Also removed unused imports.
                
> make TestRawHistoryFile and TestJobHistoryServer more robust
> ------------------------------------------------------------
>
>                 Key: MAPREDUCE-4673
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4673
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: test
>    Affects Versions: 1.1.0, 1.2.0
>            Reporter: Arpit Gupta
>            Assignee: Arpit Gupta
>         Attachments: MAPREDUCE-4673.branch-1.patch
>
>
> these unit tests fail if 2 different users run them on the same host as they are using /tmp/input path
> following is the info from the test log
> {code}
> testcase classname="org.apache.hadoop.mapred.TestJobHistoryServer" name="testHistoryServerStandalone" time="4.572">
>     <failure message="/tmp/.input.crc (Permission denied)" type="junit.framework.AssertionFailedError">junit.framework.AssertionFailedError: /tmp/.input.crc (Permission denied)
>         at org.apache.hadoop.mapred.TestJobHistoryServer.testHistoryServerStandalone(TestJobHistoryServer.java:113)
> </failure>
> {code}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (MAPREDUCE-4673) make TestRawHistoryFile and TestJobHistoryServer more robust

Posted by "Arpit Gupta (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-4673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13460673#comment-13460673 ] 

Arpit Gupta commented on MAPREDUCE-4673:
----------------------------------------

ran the tests for both the classes and tests passed.
                
> make TestRawHistoryFile and TestJobHistoryServer more robust
> ------------------------------------------------------------
>
>                 Key: MAPREDUCE-4673
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4673
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: test
>    Affects Versions: 1.1.0, 1.2.0
>            Reporter: Arpit Gupta
>            Assignee: Arpit Gupta
>         Attachments: MAPREDUCE-4673.branch-1.patch
>
>
> these unit tests fail if 2 different users run them on the same host as they are using /tmp/input path
> following is the info from the test log
> {code}
> testcase classname="org.apache.hadoop.mapred.TestJobHistoryServer" name="testHistoryServerStandalone" time="4.572">
>     <failure message="/tmp/.input.crc (Permission denied)" type="junit.framework.AssertionFailedError">junit.framework.AssertionFailedError: /tmp/.input.crc (Permission denied)
>         at org.apache.hadoop.mapred.TestJobHistoryServer.testHistoryServerStandalone(TestJobHistoryServer.java:113)
> </failure>
> {code}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (MAPREDUCE-4673) make TestRawHistoryFile and TestJobHistoryServer more robust

Posted by "Arpit Gupta (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-4673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13461909#comment-13461909 ] 

Arpit Gupta commented on MAPREDUCE-4673:
----------------------------------------

Here is the test-patch output

{code}
 [exec] BUILD SUCCESSFUL
     [exec] Total time: 7 minutes 1 second
     [exec] 
     [exec] 
     [exec] 
     [exec] 
     [exec] -1 overall.  
     [exec] 
     [exec]     +1 @author.  The patch does not contain any @author tags.
     [exec] 
     [exec]     +1 tests included.  The patch appears to include 8 new or modified tests.
     [exec] 
     [exec]     +1 javadoc.  The javadoc tool did not generate any warning messages.
     [exec] 
     [exec]     +1 javac.  The applied patch does not increase the total number of javac compiler warnings.
     [exec] 
     [exec]     -1 findbugs.  The patch appears to introduce 8 new Findbugs (version 1.3.9) warnings.
     [exec] 
     [exec] 
     [exec] 
     [exec] 
     [exec] ======================================================================
     [exec] ======================================================================
     [exec]     Finished build.
     [exec] ======================================================================
     [exec] ======================================================================
{code}

findbugs warnings are not related to the files that have been updated in this patch.
                
> make TestRawHistoryFile and TestJobHistoryServer more robust
> ------------------------------------------------------------
>
>                 Key: MAPREDUCE-4673
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4673
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: test
>    Affects Versions: 1.1.0, 1.2.0
>            Reporter: Arpit Gupta
>            Assignee: Arpit Gupta
>         Attachments: MAPREDUCE-4673.branch-1.patch, MAPREDUCE-4673.branch-1.patch
>
>
> these unit tests fail if 2 different users run them on the same host as they are using /tmp/input path
> following is the info from the test log
> {code}
> testcase classname="org.apache.hadoop.mapred.TestJobHistoryServer" name="testHistoryServerStandalone" time="4.572">
>     <failure message="/tmp/.input.crc (Permission denied)" type="junit.framework.AssertionFailedError">junit.framework.AssertionFailedError: /tmp/.input.crc (Permission denied)
>         at org.apache.hadoop.mapred.TestJobHistoryServer.testHistoryServerStandalone(TestJobHistoryServer.java:113)
> </failure>
> {code}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (MAPREDUCE-4673) make TestRawHistoryFile and TestJobHistoryServer more robust

Posted by "Vinod Kumar Vavilapalli (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-4673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13461480#comment-13461480 ] 

Vinod Kumar Vavilapalli commented on MAPREDUCE-4673:
----------------------------------------------------

Arpit, the patch looks good. One minor nit: wrap around the newly added lines to be under 80chars.

Once you do that, can you also quickly run test-patch and post the results? Will commit it once that's done. Tx.
                
> make TestRawHistoryFile and TestJobHistoryServer more robust
> ------------------------------------------------------------
>
>                 Key: MAPREDUCE-4673
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4673
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: test
>    Affects Versions: 1.1.0, 1.2.0
>            Reporter: Arpit Gupta
>            Assignee: Arpit Gupta
>         Attachments: MAPREDUCE-4673.branch-1.patch
>
>
> these unit tests fail if 2 different users run them on the same host as they are using /tmp/input path
> following is the info from the test log
> {code}
> testcase classname="org.apache.hadoop.mapred.TestJobHistoryServer" name="testHistoryServerStandalone" time="4.572">
>     <failure message="/tmp/.input.crc (Permission denied)" type="junit.framework.AssertionFailedError">junit.framework.AssertionFailedError: /tmp/.input.crc (Permission denied)
>         at org.apache.hadoop.mapred.TestJobHistoryServer.testHistoryServerStandalone(TestJobHistoryServer.java:113)
> </failure>
> {code}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Resolved] (MAPREDUCE-4673) make TestRawHistoryFile and TestJobHistoryServer more robust

Posted by "Vinod Kumar Vavilapalli (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-4673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Vinod Kumar Vavilapalli resolved MAPREDUCE-4673.
------------------------------------------------

       Resolution: Fixed
    Fix Version/s: 1.1.0
     Release Note: Fixed TestRawHistoryFile and TestJobHistoryServer to not write to /tmp.
     Hadoop Flags: Reviewed

I just committed this to branch-1 and branch-1.1. Thanks Arpit!
                
> make TestRawHistoryFile and TestJobHistoryServer more robust
> ------------------------------------------------------------
>
>                 Key: MAPREDUCE-4673
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4673
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: test
>    Affects Versions: 1.1.0, 1.2.0
>            Reporter: Arpit Gupta
>            Assignee: Arpit Gupta
>             Fix For: 1.1.0
>
>         Attachments: MAPREDUCE-4673.branch-1.patch, MAPREDUCE-4673.branch-1.patch
>
>
> these unit tests fail if 2 different users run them on the same host as they are using /tmp/input path
> following is the info from the test log
> {code}
> testcase classname="org.apache.hadoop.mapred.TestJobHistoryServer" name="testHistoryServerStandalone" time="4.572">
>     <failure message="/tmp/.input.crc (Permission denied)" type="junit.framework.AssertionFailedError">junit.framework.AssertionFailedError: /tmp/.input.crc (Permission denied)
>         at org.apache.hadoop.mapred.TestJobHistoryServer.testHistoryServerStandalone(TestJobHistoryServer.java:113)
> </failure>
> {code}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (MAPREDUCE-4673) make TestRawHistoryFile and TestJobHistoryServer more robust

Posted by "Arpit Gupta (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-4673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13460794#comment-13460794 ] 

Arpit Gupta commented on MAPREDUCE-4673:
----------------------------------------

Could not find these test classes in trunk. so looks like it only impacts branch-1
                
> make TestRawHistoryFile and TestJobHistoryServer more robust
> ------------------------------------------------------------
>
>                 Key: MAPREDUCE-4673
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4673
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: test
>    Affects Versions: 1.1.0, 1.2.0
>            Reporter: Arpit Gupta
>            Assignee: Arpit Gupta
>         Attachments: MAPREDUCE-4673.branch-1.patch
>
>
> these unit tests fail if 2 different users run them on the same host as they are using /tmp/input path
> following is the info from the test log
> {code}
> testcase classname="org.apache.hadoop.mapred.TestJobHistoryServer" name="testHistoryServerStandalone" time="4.572">
>     <failure message="/tmp/.input.crc (Permission denied)" type="junit.framework.AssertionFailedError">junit.framework.AssertionFailedError: /tmp/.input.crc (Permission denied)
>         at org.apache.hadoop.mapred.TestJobHistoryServer.testHistoryServerStandalone(TestJobHistoryServer.java:113)
> </failure>
> {code}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira