You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Eli Collins (Created) (JIRA)" <ji...@apache.org> on 2012/01/23 18:38:40 UTC

[jira] [Created] (MAPREDUCE-3709) TestDistributedShell is failing

TestDistributedShell is failing
-------------------------------

                 Key: MAPREDUCE-3709
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3709
             Project: Hadoop Map/Reduce
          Issue Type: Bug
          Components: mrv1, test
    Affects Versions: 0.23.1
            Reporter: Eli Collins
            Priority: Blocker


TestDistributedShell#testDSShell is failing the assert on line 90 on branch-23.


--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (MAPREDUCE-3709) TestDistributedShell is failing

Posted by "Mahadev konar (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-3709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Mahadev konar updated MAPREDUCE-3709:
-------------------------------------

    Component/s:     (was: mrv1)
                 mrv2
    
> TestDistributedShell is failing
> -------------------------------
>
>                 Key: MAPREDUCE-3709
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3709
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2, test
>    Affects Versions: 0.23.1
>            Reporter: Eli Collins
>            Priority: Blocker
>
> TestDistributedShell#testDSShell is failing the assert on line 90 on branch-23.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (MAPREDUCE-3709) TestDistributedShell is failing

Posted by "Hitesh Shah (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-3709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Hitesh Shah updated MAPREDUCE-3709:
-----------------------------------

    Priority: Major  (was: Blocker)
    
> TestDistributedShell is failing
> -------------------------------
>
>                 Key: MAPREDUCE-3709
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3709
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2, test
>    Affects Versions: 0.23.1
>            Reporter: Eli Collins
>            Assignee: Hitesh Shah
>         Attachments: MR-3709.1.patch
>
>
> TestDistributedShell#testDSShell is failing the assert on line 90 on branch-23.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (MAPREDUCE-3709) TestDistributedShell is failing

Posted by "Hitesh Shah (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-3709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Hitesh Shah updated MAPREDUCE-3709:
-----------------------------------

    Status: Patch Available  (was: Open)
    
> TestDistributedShell is failing
> -------------------------------
>
>                 Key: MAPREDUCE-3709
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3709
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2, test
>    Affects Versions: 0.23.1
>            Reporter: Eli Collins
>            Assignee: Hitesh Shah
>         Attachments: MR-3709.1.patch
>
>
> TestDistributedShell#testDSShell is failing the assert on line 90 on branch-23.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-3709) TestDistributedShell is failing

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-3709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13201994#comment-13201994 ] 

Hudson commented on MAPREDUCE-3709:
-----------------------------------

Integrated in Hadoop-Common-trunk-Commit #1680 (See [https://builds.apache.org/job/Hadoop-Common-trunk-Commit/1680/])
    MAPREDUCE-3709. TestDistributedShell is failing. (Hitesh Shah via mahadev)

mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1241325
Files : 
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell/pom.xml
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell/src/main/java/org/apache/hadoop/yarn/applications/distributedshell/Client.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell/src/test/java/org/apache/hadoop/yarn/applications/distributedshell/TestDistributedShell.java

                
> TestDistributedShell is failing
> -------------------------------
>
>                 Key: MAPREDUCE-3709
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3709
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2, test
>    Affects Versions: 0.23.1
>            Reporter: Eli Collins
>            Assignee: Hitesh Shah
>             Fix For: 0.23.1
>
>         Attachments: MR-3709.1.patch, MR-3709.2.patch
>
>
> TestDistributedShell#testDSShell is failing the assert on line 90 on branch-23.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-3709) TestDistributedShell is failing

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-3709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13202381#comment-13202381 ] 

Hudson commented on MAPREDUCE-3709:
-----------------------------------

Integrated in Hadoop-Mapreduce-trunk #982 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk/982/])
    MAPREDUCE-3709. TestDistributedShell is failing. (Hitesh Shah via mahadev)

mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1241325
Files : 
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell/pom.xml
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell/src/main/java/org/apache/hadoop/yarn/applications/distributedshell/Client.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell/src/test/java/org/apache/hadoop/yarn/applications/distributedshell/TestDistributedShell.java

                
> TestDistributedShell is failing
> -------------------------------
>
>                 Key: MAPREDUCE-3709
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3709
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2, test
>    Affects Versions: 0.23.1
>            Reporter: Eli Collins
>            Assignee: Hitesh Shah
>             Fix For: 0.23.1
>
>         Attachments: MR-3709.1.patch, MR-3709.2.patch
>
>
> TestDistributedShell#testDSShell is failing the assert on line 90 on branch-23.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-3709) TestDistributedShell is failing

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-3709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13202040#comment-13202040 ] 

Hudson commented on MAPREDUCE-3709:
-----------------------------------

Integrated in Hadoop-Mapreduce-0.23-Commit #514 (See [https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Commit/514/])
    MAPREDUCE-3709. TestDistributedShell is failing. (Hitesh Shah via mahadev) - Merging r1241325 from trunk.

mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1241327
Files : 
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell/pom.xml
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell/src/main/java/org/apache/hadoop/yarn/applications/distributedshell/Client.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell/src/test/java/org/apache/hadoop/yarn/applications/distributedshell/TestDistributedShell.java

                
> TestDistributedShell is failing
> -------------------------------
>
>                 Key: MAPREDUCE-3709
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3709
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2, test
>    Affects Versions: 0.23.1
>            Reporter: Eli Collins
>            Assignee: Hitesh Shah
>             Fix For: 0.23.1
>
>         Attachments: MR-3709.1.patch, MR-3709.2.patch
>
>
> TestDistributedShell#testDSShell is failing the assert on line 90 on branch-23.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (MAPREDUCE-3709) TestDistributedShell is failing

Posted by "Hitesh Shah (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-3709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Hitesh Shah updated MAPREDUCE-3709:
-----------------------------------

    Status: Patch Available  (was: Open)
    
> TestDistributedShell is failing
> -------------------------------
>
>                 Key: MAPREDUCE-3709
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3709
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2, test
>    Affects Versions: 0.23.1
>            Reporter: Eli Collins
>            Assignee: Hitesh Shah
>         Attachments: MR-3709.1.patch, MR-3709.2.patch
>
>
> TestDistributedShell#testDSShell is failing the assert on line 90 on branch-23.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-3709) TestDistributedShell is failing

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-3709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13201993#comment-13201993 ] 

Hudson commented on MAPREDUCE-3709:
-----------------------------------

Integrated in Hadoop-Hdfs-trunk-Commit #1753 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/1753/])
    MAPREDUCE-3709. TestDistributedShell is failing. (Hitesh Shah via mahadev)

mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1241325
Files : 
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell/pom.xml
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell/src/main/java/org/apache/hadoop/yarn/applications/distributedshell/Client.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell/src/test/java/org/apache/hadoop/yarn/applications/distributedshell/TestDistributedShell.java

                
> TestDistributedShell is failing
> -------------------------------
>
>                 Key: MAPREDUCE-3709
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3709
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2, test
>    Affects Versions: 0.23.1
>            Reporter: Eli Collins
>            Assignee: Hitesh Shah
>             Fix For: 0.23.1
>
>         Attachments: MR-3709.1.patch, MR-3709.2.patch
>
>
> TestDistributedShell#testDSShell is failing the assert on line 90 on branch-23.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (MAPREDUCE-3709) TestDistributedShell is failing

Posted by "Mahadev konar (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-3709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Mahadev konar updated MAPREDUCE-3709:
-------------------------------------

      Resolution: Fixed
    Hadoop Flags: Reviewed
          Status: Resolved  (was: Patch Available)

I just committed this. Thanks Hitesh!
                
> TestDistributedShell is failing
> -------------------------------
>
>                 Key: MAPREDUCE-3709
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3709
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2, test
>    Affects Versions: 0.23.1
>            Reporter: Eli Collins
>            Assignee: Hitesh Shah
>         Attachments: MR-3709.1.patch, MR-3709.2.patch
>
>
> TestDistributedShell#testDSShell is failing the assert on line 90 on branch-23.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-3709) TestDistributedShell is failing

Posted by "Hadoop QA (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-3709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13201817#comment-13201817 ] 

Hadoop QA commented on MAPREDUCE-3709:
--------------------------------------

+1 overall.  Here are the results of testing the latest attachment 
  http://issues.apache.org/jira/secure/attachment/12513512/MR-3709.2.patch
  against trunk revision .

    +1 @author.  The patch does not contain any @author tags.

    +1 tests included.  The patch appears to include 3 new or modified tests.

    +1 javadoc.  The javadoc tool did not generate any warning messages.

    +1 javac.  The applied patch does not increase the total number of javac compiler warnings.

    +1 eclipse:eclipse.  The patch built with eclipse:eclipse.

    +1 findbugs.  The patch does not introduce any new Findbugs (version 1.3.9) warnings.

    +1 release audit.  The applied patch does not increase the total number of release audit warnings.

    +1 core tests.  The patch passed unit tests in .

    +1 contrib tests.  The patch passed contrib unit tests.

Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1800//testReport/
Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1800//console

This message is automatically generated.
                
> TestDistributedShell is failing
> -------------------------------
>
>                 Key: MAPREDUCE-3709
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3709
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2, test
>    Affects Versions: 0.23.1
>            Reporter: Eli Collins
>            Assignee: Hitesh Shah
>         Attachments: MR-3709.1.patch, MR-3709.2.patch
>
>
> TestDistributedShell#testDSShell is failing the assert on line 90 on branch-23.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-3709) TestDistributedShell is failing

Posted by "Eli Collins (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-3709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13193472#comment-13193472 ] 

Eli Collins commented on MAPREDUCE-3709:
----------------------------------------

Diff'ing TestDistributedShell-output.txt from a successful run (on another host) and my machine does indicate the failure is due to the container getting killed due to running beyond its VM limits.

The test however still fails when making the following change to the pom.xml in hadoop-yarn-applications-distributedshell.

{noformat}
hadoop-trunk1 $ svn diff
Index: hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell/pom.xml
===================================================================
--- hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell/pom.xml	(revision 1235995)
+++ hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell/pom.xml	(working copy)
@@ -104,6 +104,7 @@
         <configuration>
           <environmentVariables>
             <JAVA_HOME>${java.home}</JAVA_HOME>
+            <MALLOC_ARENA_MAX>4</MALLOC_ARENA_MAX>
           </environmentVariables>
        </configuration>
       </plugin>
{noformat}
                
> TestDistributedShell is failing
> -------------------------------
>
>                 Key: MAPREDUCE-3709
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3709
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2, test
>    Affects Versions: 0.23.1
>            Reporter: Eli Collins
>            Priority: Blocker
>
> TestDistributedShell#testDSShell is failing the assert on line 90 on branch-23.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (MAPREDUCE-3709) TestDistributedShell is failing

Posted by "Mahadev konar (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-3709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Mahadev konar updated MAPREDUCE-3709:
-------------------------------------

    Fix Version/s: 0.23.1
    
> TestDistributedShell is failing
> -------------------------------
>
>                 Key: MAPREDUCE-3709
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3709
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2, test
>    Affects Versions: 0.23.1
>            Reporter: Eli Collins
>            Assignee: Hitesh Shah
>             Fix For: 0.23.1
>
>         Attachments: MR-3709.1.patch, MR-3709.2.patch
>
>
> TestDistributedShell#testDSShell is failing the assert on line 90 on branch-23.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-3709) TestDistributedShell is failing

Posted by "Mahadev konar (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-3709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13201957#comment-13201957 ] 

Mahadev konar commented on MAPREDUCE-3709:
------------------------------------------

+1 for the patch. Looks good to me.
                
> TestDistributedShell is failing
> -------------------------------
>
>                 Key: MAPREDUCE-3709
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3709
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2, test
>    Affects Versions: 0.23.1
>            Reporter: Eli Collins
>            Assignee: Hitesh Shah
>         Attachments: MR-3709.1.patch, MR-3709.2.patch
>
>
> TestDistributedShell#testDSShell is failing the assert on line 90 on branch-23.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (MAPREDUCE-3709) TestDistributedShell is failing

Posted by "Hitesh Shah (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-3709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Hitesh Shah updated MAPREDUCE-3709:
-----------------------------------

    Attachment: MR-3709.1.patch

@Eli, given that MAPREDUCE-3765 is now in, the latest patch should be able to use smaller sized containers which hopefully should solve the problem. Could you please try the patch and let me know if it fixes the issue in your env. 

I am also downgrading this to a non-blocker as it is not reproducible in most environments. Please let me know if you see any issues with doing this.
                
> TestDistributedShell is failing
> -------------------------------
>
>                 Key: MAPREDUCE-3709
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3709
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2, test
>    Affects Versions: 0.23.1
>            Reporter: Eli Collins
>            Assignee: Hitesh Shah
>            Priority: Blocker
>         Attachments: MR-3709.1.patch
>
>
> TestDistributedShell#testDSShell is failing the assert on line 90 on branch-23.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-3709) TestDistributedShell is failing

Posted by "Eli Collins (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-3709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13201816#comment-13201816 ] 

Eli Collins commented on MAPREDUCE-3709:
----------------------------------------

Oddly the test no longer fails on my system w/o this patch. Something else must have changed in the meantime.
                
> TestDistributedShell is failing
> -------------------------------
>
>                 Key: MAPREDUCE-3709
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3709
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2, test
>    Affects Versions: 0.23.1
>            Reporter: Eli Collins
>            Assignee: Hitesh Shah
>         Attachments: MR-3709.1.patch, MR-3709.2.patch
>
>
> TestDistributedShell#testDSShell is failing the assert on line 90 on branch-23.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-3709) TestDistributedShell is failing

Posted by "Eli Collins (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-3709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13191600#comment-13191600 ] 

Eli Collins commented on MAPREDUCE-3709:
----------------------------------------

I think this is environmental, noticed a container getting killed in the log.

"Container [pid=14954,containerID=container_1327360294062_0001_01_000001] is running beyond virtual memory limits. Current usage: 78.4mb of 2.0gb physical memory used; 4.3gb of 4.2gb virtual memory used. Killing container"

Perhaps a change like HADOOP-7154 needs to be made in yarn. 
                
> TestDistributedShell is failing
> -------------------------------
>
>                 Key: MAPREDUCE-3709
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3709
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2, test
>    Affects Versions: 0.23.1
>            Reporter: Eli Collins
>            Priority: Blocker
>
> TestDistributedShell#testDSShell is failing the assert on line 90 on branch-23.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (MAPREDUCE-3709) TestDistributedShell is failing

Posted by "Hitesh Shah (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-3709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Hitesh Shah updated MAPREDUCE-3709:
-----------------------------------

    Status: Open  (was: Patch Available)
    
> TestDistributedShell is failing
> -------------------------------
>
>                 Key: MAPREDUCE-3709
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3709
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2, test
>    Affects Versions: 0.23.1
>            Reporter: Eli Collins
>            Assignee: Hitesh Shah
>         Attachments: MR-3709.1.patch
>
>
> TestDistributedShell#testDSShell is failing the assert on line 90 on branch-23.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (MAPREDUCE-3709) TestDistributedShell is failing

Posted by "Hitesh Shah (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-3709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Hitesh Shah updated MAPREDUCE-3709:
-----------------------------------

    Attachment: MR-3709.2.patch

Real fix this time. 
                
> TestDistributedShell is failing
> -------------------------------
>
>                 Key: MAPREDUCE-3709
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3709
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2, test
>    Affects Versions: 0.23.1
>            Reporter: Eli Collins
>            Assignee: Hitesh Shah
>         Attachments: MR-3709.1.patch, MR-3709.2.patch
>
>
> TestDistributedShell#testDSShell is failing the assert on line 90 on branch-23.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-3709) TestDistributedShell is failing

Posted by "Eli Collins (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-3709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13191332#comment-13191332 ] 

Eli Collins commented on MAPREDUCE-3709:
----------------------------------------

Yes, I have JAVA_HOME set.
                
> TestDistributedShell is failing
> -------------------------------
>
>                 Key: MAPREDUCE-3709
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3709
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv1, test
>    Affects Versions: 0.23.1
>            Reporter: Eli Collins
>            Priority: Blocker
>
> TestDistributedShell#testDSShell is failing the assert on line 90 on branch-23.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-3709) TestDistributedShell is failing

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-3709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13201999#comment-13201999 ] 

Hudson commented on MAPREDUCE-3709:
-----------------------------------

Integrated in Hadoop-Hdfs-0.23-Commit #497 (See [https://builds.apache.org/job/Hadoop-Hdfs-0.23-Commit/497/])
    MAPREDUCE-3709. TestDistributedShell is failing. (Hitesh Shah via mahadev) - Merging r1241325 from trunk.

mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1241327
Files : 
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell/pom.xml
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell/src/main/java/org/apache/hadoop/yarn/applications/distributedshell/Client.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell/src/test/java/org/apache/hadoop/yarn/applications/distributedshell/TestDistributedShell.java

                
> TestDistributedShell is failing
> -------------------------------
>
>                 Key: MAPREDUCE-3709
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3709
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2, test
>    Affects Versions: 0.23.1
>            Reporter: Eli Collins
>            Assignee: Hitesh Shah
>             Fix For: 0.23.1
>
>         Attachments: MR-3709.1.patch, MR-3709.2.patch
>
>
> TestDistributedShell#testDSShell is failing the assert on line 90 on branch-23.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-3709) TestDistributedShell is failing

Posted by "Hitesh Shah (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-3709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13193202#comment-13193202 ] 

Hitesh Shah commented on MAPREDUCE-3709:
----------------------------------------

@Eli, I don't have a rhel6 host to try and reproduce this and a rhel5 host does not show this issue. 

Yarn already has fixes in place for malloc arena when running a proper cluster ( yarn-config.sh sets it if not set and yarn sets malloc_arena_max ( if present in the node manager's env ) into the application's env unless its overridden by the user's config. [ Refer to ContainerLaunch#sanitiveEnv, YarnConfiguration.NM_ADMIN_USER_ENV and YarnConfiguration.DEFAULT_NM_ADMIN_USER_ENV).

One option to try and fix the test in your case would be change the pom file to have this:

{quote}
@@ -104,6 +104,7 @@
         <configuration>
           <environmentVariables>
             <JAVA_HOME>${java.home}</JAVA_HOME>
+            <MALLOC_ARENA_MAX>4</MALLOC_ARENA_MAX>
           </environmentVariables>
        </configuration>
       </plugin>
{quote}

Could you try the above change and see if it resolves the test failure in your env? The above change will result in launch_container.sh setting the malloc arena max value to 4. 

                
> TestDistributedShell is failing
> -------------------------------
>
>                 Key: MAPREDUCE-3709
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3709
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2, test
>    Affects Versions: 0.23.1
>            Reporter: Eli Collins
>            Priority: Blocker
>
> TestDistributedShell#testDSShell is failing the assert on line 90 on branch-23.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Assigned] (MAPREDUCE-3709) TestDistributedShell is failing

Posted by "Hitesh Shah (Assigned) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-3709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Hitesh Shah reassigned MAPREDUCE-3709:
--------------------------------------

    Assignee: Hitesh Shah
    
> TestDistributedShell is failing
> -------------------------------
>
>                 Key: MAPREDUCE-3709
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3709
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2, test
>    Affects Versions: 0.23.1
>            Reporter: Eli Collins
>            Assignee: Hitesh Shah
>            Priority: Blocker
>
> TestDistributedShell#testDSShell is failing the assert on line 90 on branch-23.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-3709) TestDistributedShell is failing

Posted by "Hadoop QA (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-3709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13201541#comment-13201541 ] 

Hadoop QA commented on MAPREDUCE-3709:
--------------------------------------

+1 overall.  Here are the results of testing the latest attachment 
  http://issues.apache.org/jira/secure/attachment/12513463/MR-3709.1.patch
  against trunk revision .

    +1 @author.  The patch does not contain any @author tags.

    +1 tests included.  The patch appears to include 3 new or modified tests.

    +1 javadoc.  The javadoc tool did not generate any warning messages.

    +1 javac.  The applied patch does not increase the total number of javac compiler warnings.

    +1 eclipse:eclipse.  The patch built with eclipse:eclipse.

    +1 findbugs.  The patch does not introduce any new Findbugs (version 1.3.9) warnings.

    +1 release audit.  The applied patch does not increase the total number of release audit warnings.

    +1 core tests.  The patch passed unit tests in .

    +1 contrib tests.  The patch passed contrib unit tests.

Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1790//testReport/
Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1790//console

This message is automatically generated.
                
> TestDistributedShell is failing
> -------------------------------
>
>                 Key: MAPREDUCE-3709
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3709
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2, test
>    Affects Versions: 0.23.1
>            Reporter: Eli Collins
>            Assignee: Hitesh Shah
>         Attachments: MR-3709.1.patch
>
>
> TestDistributedShell#testDSShell is failing the assert on line 90 on branch-23.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-3709) TestDistributedShell is failing

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-3709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13202001#comment-13202001 ] 

Hudson commented on MAPREDUCE-3709:
-----------------------------------

Integrated in Hadoop-Common-0.23-Commit #507 (See [https://builds.apache.org/job/Hadoop-Common-0.23-Commit/507/])
    MAPREDUCE-3709. TestDistributedShell is failing. (Hitesh Shah via mahadev) - Merging r1241325 from trunk.

mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1241327
Files : 
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell/pom.xml
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell/src/main/java/org/apache/hadoop/yarn/applications/distributedshell/Client.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell/src/test/java/org/apache/hadoop/yarn/applications/distributedshell/TestDistributedShell.java

                
> TestDistributedShell is failing
> -------------------------------
>
>                 Key: MAPREDUCE-3709
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3709
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2, test
>    Affects Versions: 0.23.1
>            Reporter: Eli Collins
>            Assignee: Hitesh Shah
>             Fix For: 0.23.1
>
>         Attachments: MR-3709.1.patch, MR-3709.2.patch
>
>
> TestDistributedShell#testDSShell is failing the assert on line 90 on branch-23.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-3709) TestDistributedShell is failing

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-3709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13202300#comment-13202300 ] 

Hudson commented on MAPREDUCE-3709:
-----------------------------------

Integrated in Hadoop-Hdfs-trunk #949 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk/949/])
    MAPREDUCE-3709. TestDistributedShell is failing. (Hitesh Shah via mahadev)

mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1241325
Files : 
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell/pom.xml
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell/src/main/java/org/apache/hadoop/yarn/applications/distributedshell/Client.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell/src/test/java/org/apache/hadoop/yarn/applications/distributedshell/TestDistributedShell.java

                
> TestDistributedShell is failing
> -------------------------------
>
>                 Key: MAPREDUCE-3709
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3709
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2, test
>    Affects Versions: 0.23.1
>            Reporter: Eli Collins
>            Assignee: Hitesh Shah
>             Fix For: 0.23.1
>
>         Attachments: MR-3709.1.patch, MR-3709.2.patch
>
>
> TestDistributedShell#testDSShell is failing the assert on line 90 on branch-23.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-3709) TestDistributedShell is failing

Posted by "Hitesh Shah (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-3709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13191298#comment-13191298 ] 

Hitesh Shah commented on MAPREDUCE-3709:
----------------------------------------

@Eli, could you check if JAVA_HOME is set in the environment when running this test and if not, re-try after setting it in the env? 
                
> TestDistributedShell is failing
> -------------------------------
>
>                 Key: MAPREDUCE-3709
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3709
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv1, test
>    Affects Versions: 0.23.1
>            Reporter: Eli Collins
>            Priority: Blocker
>
> TestDistributedShell#testDSShell is failing the assert on line 90 on branch-23.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-3709) TestDistributedShell is failing

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-3709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13202346#comment-13202346 ] 

Hudson commented on MAPREDUCE-3709:
-----------------------------------

Integrated in Hadoop-Mapreduce-0.23-Build #184 (See [https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Build/184/])
    MAPREDUCE-3709. TestDistributedShell is failing. (Hitesh Shah via mahadev) - Merging r1241325 from trunk.

mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1241327
Files : 
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell/pom.xml
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell/src/main/java/org/apache/hadoop/yarn/applications/distributedshell/Client.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell/src/test/java/org/apache/hadoop/yarn/applications/distributedshell/TestDistributedShell.java

                
> TestDistributedShell is failing
> -------------------------------
>
>                 Key: MAPREDUCE-3709
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3709
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2, test
>    Affects Versions: 0.23.1
>            Reporter: Eli Collins
>            Assignee: Hitesh Shah
>             Fix For: 0.23.1
>
>         Attachments: MR-3709.1.patch, MR-3709.2.patch
>
>
> TestDistributedShell#testDSShell is failing the assert on line 90 on branch-23.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-3709) TestDistributedShell is failing

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-3709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13202319#comment-13202319 ] 

Hudson commented on MAPREDUCE-3709:
-----------------------------------

Integrated in Hadoop-Hdfs-0.23-Build #162 (See [https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/162/])
    MAPREDUCE-3709. TestDistributedShell is failing. (Hitesh Shah via mahadev) - Merging r1241325 from trunk.

mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1241327
Files : 
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell/pom.xml
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell/src/main/java/org/apache/hadoop/yarn/applications/distributedshell/Client.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell/src/test/java/org/apache/hadoop/yarn/applications/distributedshell/TestDistributedShell.java

                
> TestDistributedShell is failing
> -------------------------------
>
>                 Key: MAPREDUCE-3709
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3709
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2, test
>    Affects Versions: 0.23.1
>            Reporter: Eli Collins
>            Assignee: Hitesh Shah
>             Fix For: 0.23.1
>
>         Attachments: MR-3709.1.patch, MR-3709.2.patch
>
>
> TestDistributedShell#testDSShell is failing the assert on line 90 on branch-23.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-3709) TestDistributedShell is failing

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-3709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13202015#comment-13202015 ] 

Hudson commented on MAPREDUCE-3709:
-----------------------------------

Integrated in Hadoop-Mapreduce-trunk-Commit #1692 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/1692/])
    MAPREDUCE-3709. TestDistributedShell is failing. (Hitesh Shah via mahadev)

mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1241325
Files : 
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell/pom.xml
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell/src/main/java/org/apache/hadoop/yarn/applications/distributedshell/Client.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell/src/test/java/org/apache/hadoop/yarn/applications/distributedshell/TestDistributedShell.java

                
> TestDistributedShell is failing
> -------------------------------
>
>                 Key: MAPREDUCE-3709
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3709
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2, test
>    Affects Versions: 0.23.1
>            Reporter: Eli Collins
>            Assignee: Hitesh Shah
>             Fix For: 0.23.1
>
>         Attachments: MR-3709.1.patch, MR-3709.2.patch
>
>
> TestDistributedShell#testDSShell is failing the assert on line 90 on branch-23.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-3709) TestDistributedShell is failing

Posted by "Hitesh Shah (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-3709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13201839#comment-13201839 ] 

Hitesh Shah commented on MAPREDUCE-3709:
----------------------------------------

@Eli, from what I figured out, the test failure was likely due to what the default jvm heap size configured on the system and what the allocated container size is. If the default heap allocated is larged than the allocated container, the memory check would kick in and fail the test. In the latest patch, I tweaked the distributed shell code itself to set the appropriate heap size and make sure that it is within the required bounds. 
                
> TestDistributedShell is failing
> -------------------------------
>
>                 Key: MAPREDUCE-3709
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3709
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2, test
>    Affects Versions: 0.23.1
>            Reporter: Eli Collins
>            Assignee: Hitesh Shah
>         Attachments: MR-3709.1.patch, MR-3709.2.patch
>
>
> TestDistributedShell#testDSShell is failing the assert on line 90 on branch-23.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira