You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Alejandro Abdelnur (Created) (JIRA)" <ji...@apache.org> on 2011/11/16 21:21:55 UTC

[jira] [Created] (MAPREDUCE-3415) improve MiniMRYarnCluster & DistributedShell JAR resolution

improve MiniMRYarnCluster & DistributedShell JAR resolution 
------------------------------------------------------------

                 Key: MAPREDUCE-3415
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3415
             Project: Hadoop Map/Reduce
          Issue Type: Improvement
          Components: mrv2
    Affects Versions: 0.24.0, 0.23.1
            Reporter: Alejandro Abdelnur
            Assignee: Alejandro Abdelnur
             Fix For: 0.24.0, 0.23.1


Current JAR resolution assumes the following:

# The class used for JAR lookup is effectively in a JAR
# A System property is set for testing with the location of the JAR

The problem with #1 is that in some cases (when using the class in the same Maven module where the class is, the class is not in a JAR but in a directory 'target/test-classes').

The problem with #2 is the JAR does not exists at the time of running the test (packaging comes after test and we are not doing integration testing yet thus won't work)

In addition, this is required for streaming testcases, to have the JAR with streaming classes for testing.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (MAPREDUCE-3415) improve MiniMRYarnCluster & DistributedShell JAR resolution

Posted by "Alejandro Abdelnur (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-3415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Alejandro Abdelnur updated MAPREDUCE-3415:
------------------------------------------

    Fix Version/s:     (was: 0.24.0)
    
> improve MiniMRYarnCluster & DistributedShell JAR resolution 
> ------------------------------------------------------------
>
>                 Key: MAPREDUCE-3415
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3415
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: mrv2
>    Affects Versions: 0.23.1, 0.24.0
>            Reporter: Alejandro Abdelnur
>            Assignee: Alejandro Abdelnur
>             Fix For: 0.23.1
>
>         Attachments: MAPREDUCE-3415.patch, MAPREDUCE-3415.patch, MAPREDUCE-3415.patch, MAPREDUCE-3415.patch
>
>
> Current JAR resolution assumes the following:
> # The class used for JAR lookup is effectively in a JAR
> # A System property is set for testing with the location of the JAR
> The problem with #1 is that in some cases (when using the class in the same Maven module where the class is, the class is not in a JAR but in a directory 'target/test-classes').
> The problem with #2 is the JAR does not exists at the time of running the test (packaging comes after test and we are not doing integration testing yet thus won't work)
> In addition, this is required for streaming testcases, to have the JAR with streaming classes for testing.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (MAPREDUCE-3415) improve MiniMRYarnCluster & DistributedShell JAR resolution

Posted by "Alejandro Abdelnur (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-3415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Alejandro Abdelnur updated MAPREDUCE-3415:
------------------------------------------

    Status: Open  (was: Patch Available)

patch does not apply to current trunk, have to rebase
                
> improve MiniMRYarnCluster & DistributedShell JAR resolution 
> ------------------------------------------------------------
>
>                 Key: MAPREDUCE-3415
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3415
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: mrv2
>    Affects Versions: 0.24.0, 0.23.1
>            Reporter: Alejandro Abdelnur
>            Assignee: Alejandro Abdelnur
>             Fix For: 0.24.0, 0.23.1
>
>         Attachments: MAPREDUCE-3415.patch
>
>
> Current JAR resolution assumes the following:
> # The class used for JAR lookup is effectively in a JAR
> # A System property is set for testing with the location of the JAR
> The problem with #1 is that in some cases (when using the class in the same Maven module where the class is, the class is not in a JAR but in a directory 'target/test-classes').
> The problem with #2 is the JAR does not exists at the time of running the test (packaging comes after test and we are not doing integration testing yet thus won't work)
> In addition, this is required for streaming testcases, to have the JAR with streaming classes for testing.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-3415) improve MiniMRYarnCluster & DistributedShell JAR resolution

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-3415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13203263#comment-13203263 ] 

Hudson commented on MAPREDUCE-3415:
-----------------------------------

Integrated in Hadoop-Mapreduce-0.23-Commit #523 (See [https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Commit/523/])
    MAPREDUCE-3415. Moving to 0.23.1 section.

acmurthy : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1241756
Files : 
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt

                
> improve MiniMRYarnCluster & DistributedShell JAR resolution 
> ------------------------------------------------------------
>
>                 Key: MAPREDUCE-3415
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3415
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: mrv2
>    Affects Versions: 0.23.1, 0.24.0
>            Reporter: Alejandro Abdelnur
>            Assignee: Alejandro Abdelnur
>             Fix For: 0.23.1
>
>         Attachments: MAPREDUCE-3415.patch, MAPREDUCE-3415.patch, MAPREDUCE-3415.patch, MAPREDUCE-3415.patch
>
>
> Current JAR resolution assumes the following:
> # The class used for JAR lookup is effectively in a JAR
> # A System property is set for testing with the location of the JAR
> The problem with #1 is that in some cases (when using the class in the same Maven module where the class is, the class is not in a JAR but in a directory 'target/test-classes').
> The problem with #2 is the JAR does not exists at the time of running the test (packaging comes after test and we are not doing integration testing yet thus won't work)
> In addition, this is required for streaming testcases, to have the JAR with streaming classes for testing.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-3415) improve MiniMRYarnCluster & DistributedShell JAR resolution

Posted by "Ahmed Radwan (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-3415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13152000#comment-13152000 ] 

Ahmed Radwan commented on MAPREDUCE-3415:
-----------------------------------------

Thanks Tucu! I have tested the patch and it works great. +1
I have a comment regrading clean up of created jar files. 
The files are now created in the temporary system directory, and the reliance will be on the default system clean up (e.g. on reboot). I think this may cause problems on test dedicated machines that will then require periodic cleanup of the tmp dir. After few minutes of testing I have a dozen of jar files sitting in my tmp dir. I think it may be better to create these jars in a maven predefined directory, that can be cleaned up through maven at the end. What do you think?


                
> improve MiniMRYarnCluster & DistributedShell JAR resolution 
> ------------------------------------------------------------
>
>                 Key: MAPREDUCE-3415
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3415
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: mrv2
>    Affects Versions: 0.24.0, 0.23.1
>            Reporter: Alejandro Abdelnur
>            Assignee: Alejandro Abdelnur
>             Fix For: 0.24.0, 0.23.1
>
>         Attachments: MAPREDUCE-3415.patch, MAPREDUCE-3415.patch, MAPREDUCE-3415.patch
>
>
> Current JAR resolution assumes the following:
> # The class used for JAR lookup is effectively in a JAR
> # A System property is set for testing with the location of the JAR
> The problem with #1 is that in some cases (when using the class in the same Maven module where the class is, the class is not in a JAR but in a directory 'target/test-classes').
> The problem with #2 is the JAR does not exists at the time of running the test (packaging comes after test and we are not doing integration testing yet thus won't work)
> In addition, this is required for streaming testcases, to have the JAR with streaming classes for testing.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (MAPREDUCE-3415) improve MiniMRYarnCluster & DistributedShell JAR resolution

Posted by "Alejandro Abdelnur (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-3415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Alejandro Abdelnur updated MAPREDUCE-3415:
------------------------------------------

    Attachment: MAPREDUCE-3415.patch
    
> improve MiniMRYarnCluster & DistributedShell JAR resolution 
> ------------------------------------------------------------
>
>                 Key: MAPREDUCE-3415
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3415
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: mrv2
>    Affects Versions: 0.24.0, 0.23.1
>            Reporter: Alejandro Abdelnur
>            Assignee: Alejandro Abdelnur
>             Fix For: 0.24.0, 0.23.1
>
>         Attachments: MAPREDUCE-3415.patch
>
>
> Current JAR resolution assumes the following:
> # The class used for JAR lookup is effectively in a JAR
> # A System property is set for testing with the location of the JAR
> The problem with #1 is that in some cases (when using the class in the same Maven module where the class is, the class is not in a JAR but in a directory 'target/test-classes').
> The problem with #2 is the JAR does not exists at the time of running the test (packaging comes after test and we are not doing integration testing yet thus won't work)
> In addition, this is required for streaming testcases, to have the JAR with streaming classes for testing.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (MAPREDUCE-3415) improve MiniMRYarnCluster & DistributedShell JAR resolution

Posted by "Alejandro Abdelnur (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-3415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Alejandro Abdelnur updated MAPREDUCE-3415:
------------------------------------------

    Status: Patch Available  (was: Open)
    
> improve MiniMRYarnCluster & DistributedShell JAR resolution 
> ------------------------------------------------------------
>
>                 Key: MAPREDUCE-3415
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3415
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: mrv2
>    Affects Versions: 0.24.0, 0.23.1
>            Reporter: Alejandro Abdelnur
>            Assignee: Alejandro Abdelnur
>             Fix For: 0.24.0, 0.23.1
>
>         Attachments: MAPREDUCE-3415.patch, MAPREDUCE-3415.patch
>
>
> Current JAR resolution assumes the following:
> # The class used for JAR lookup is effectively in a JAR
> # A System property is set for testing with the location of the JAR
> The problem with #1 is that in some cases (when using the class in the same Maven module where the class is, the class is not in a JAR but in a directory 'target/test-classes').
> The problem with #2 is the JAR does not exists at the time of running the test (packaging comes after test and we are not doing integration testing yet thus won't work)
> In addition, this is required for streaming testcases, to have the JAR with streaming classes for testing.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (MAPREDUCE-3415) improve MiniMRYarnCluster & DistributedShell JAR resolution

Posted by "Alejandro Abdelnur (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-3415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Alejandro Abdelnur updated MAPREDUCE-3415:
------------------------------------------

    Attachment: MAPREDUCE-3415.patch

as per Ahmed suggestion, not using temp dir anymore, instead using a dir within 'target', thus no need to do an explicit clean up.

Had to tweak the MiniMRClusterFactory to use JarFinder as it was not working when running test cases from root level because in that case there is no JAR for for the caller class. Also, this enables running the testcases from within IDEs (for the very same reason)
                
> improve MiniMRYarnCluster & DistributedShell JAR resolution 
> ------------------------------------------------------------
>
>                 Key: MAPREDUCE-3415
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3415
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: mrv2
>    Affects Versions: 0.24.0, 0.23.1
>            Reporter: Alejandro Abdelnur
>            Assignee: Alejandro Abdelnur
>             Fix For: 0.24.0, 0.23.1
>
>         Attachments: MAPREDUCE-3415.patch, MAPREDUCE-3415.patch, MAPREDUCE-3415.patch, MAPREDUCE-3415.patch
>
>
> Current JAR resolution assumes the following:
> # The class used for JAR lookup is effectively in a JAR
> # A System property is set for testing with the location of the JAR
> The problem with #1 is that in some cases (when using the class in the same Maven module where the class is, the class is not in a JAR but in a directory 'target/test-classes').
> The problem with #2 is the JAR does not exists at the time of running the test (packaging comes after test and we are not doing integration testing yet thus won't work)
> In addition, this is required for streaming testcases, to have the JAR with streaming classes for testing.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-3415) improve MiniMRYarnCluster & DistributedShell JAR resolution

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-3415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13152861#comment-13152861 ] 

Hudson commented on MAPREDUCE-3415:
-----------------------------------

Integrated in Hadoop-Mapreduce-trunk #901 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk/901/])
    MAPREDUCE-3415. improve MiniMRYarnCluster & DistributedShell JAR resolution (tucu)

tucu : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1203411
Files : 
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/util/JarFinder.java
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/util/TestJarFinder.java
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/pom.xml
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/MiniMRClientClusterFactory.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/v2/MiniMRYarnCluster.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell/pom.xml
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell/src/test/java/org/apache/hadoop/yarn/applications/distributedshell/TestDistributedShell.java

                
> improve MiniMRYarnCluster & DistributedShell JAR resolution 
> ------------------------------------------------------------
>
>                 Key: MAPREDUCE-3415
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3415
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: mrv2
>    Affects Versions: 0.24.0, 0.23.1
>            Reporter: Alejandro Abdelnur
>            Assignee: Alejandro Abdelnur
>             Fix For: 0.24.0, 0.23.1
>
>         Attachments: MAPREDUCE-3415.patch, MAPREDUCE-3415.patch, MAPREDUCE-3415.patch, MAPREDUCE-3415.patch
>
>
> Current JAR resolution assumes the following:
> # The class used for JAR lookup is effectively in a JAR
> # A System property is set for testing with the location of the JAR
> The problem with #1 is that in some cases (when using the class in the same Maven module where the class is, the class is not in a JAR but in a directory 'target/test-classes').
> The problem with #2 is the JAR does not exists at the time of running the test (packaging comes after test and we are not doing integration testing yet thus won't work)
> In addition, this is required for streaming testcases, to have the JAR with streaming classes for testing.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-3415) improve MiniMRYarnCluster & DistributedShell JAR resolution

Posted by "Alejandro Abdelnur (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-3415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13152414#comment-13152414 ] 

Alejandro Abdelnur commented on MAPREDUCE-3415:
-----------------------------------------------

@Tom, Jenkins failure is because testcases are run at MR level and they are picking up a prev version of common JAR from M2 repo, not using the changes in the this patch. after the commit things would go back to normal
                
> improve MiniMRYarnCluster & DistributedShell JAR resolution 
> ------------------------------------------------------------
>
>                 Key: MAPREDUCE-3415
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3415
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: mrv2
>    Affects Versions: 0.24.0, 0.23.1
>            Reporter: Alejandro Abdelnur
>            Assignee: Alejandro Abdelnur
>             Fix For: 0.24.0, 0.23.1
>
>         Attachments: MAPREDUCE-3415.patch, MAPREDUCE-3415.patch, MAPREDUCE-3415.patch, MAPREDUCE-3415.patch
>
>
> Current JAR resolution assumes the following:
> # The class used for JAR lookup is effectively in a JAR
> # A System property is set for testing with the location of the JAR
> The problem with #1 is that in some cases (when using the class in the same Maven module where the class is, the class is not in a JAR but in a directory 'target/test-classes').
> The problem with #2 is the JAR does not exists at the time of running the test (packaging comes after test and we are not doing integration testing yet thus won't work)
> In addition, this is required for streaming testcases, to have the JAR with streaming classes for testing.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-3415) improve MiniMRYarnCluster & DistributedShell JAR resolution

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-3415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13203589#comment-13203589 ] 

Hudson commented on MAPREDUCE-3415:
-----------------------------------

Integrated in Hadoop-Mapreduce-trunk #983 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk/983/])
    MAPREDUCE-3415. Moving to 0.23.1 section.

acmurthy : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1241752
Files : 
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt

                
> improve MiniMRYarnCluster & DistributedShell JAR resolution 
> ------------------------------------------------------------
>
>                 Key: MAPREDUCE-3415
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3415
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: mrv2
>    Affects Versions: 0.23.1, 0.24.0
>            Reporter: Alejandro Abdelnur
>            Assignee: Alejandro Abdelnur
>             Fix For: 0.23.1
>
>         Attachments: MAPREDUCE-3415.patch, MAPREDUCE-3415.patch, MAPREDUCE-3415.patch, MAPREDUCE-3415.patch
>
>
> Current JAR resolution assumes the following:
> # The class used for JAR lookup is effectively in a JAR
> # A System property is set for testing with the location of the JAR
> The problem with #1 is that in some cases (when using the class in the same Maven module where the class is, the class is not in a JAR but in a directory 'target/test-classes').
> The problem with #2 is the JAR does not exists at the time of running the test (packaging comes after test and we are not doing integration testing yet thus won't work)
> In addition, this is required for streaming testcases, to have the JAR with streaming classes for testing.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-3415) improve MiniMRYarnCluster & DistributedShell JAR resolution

Posted by "Tom White (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-3415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13152283#comment-13152283 ] 

Tom White commented on MAPREDUCE-3415:
--------------------------------------

+1 (pending investigating the jenkins warnings)
                
> improve MiniMRYarnCluster & DistributedShell JAR resolution 
> ------------------------------------------------------------
>
>                 Key: MAPREDUCE-3415
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3415
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: mrv2
>    Affects Versions: 0.24.0, 0.23.1
>            Reporter: Alejandro Abdelnur
>            Assignee: Alejandro Abdelnur
>             Fix For: 0.24.0, 0.23.1
>
>         Attachments: MAPREDUCE-3415.patch, MAPREDUCE-3415.patch, MAPREDUCE-3415.patch, MAPREDUCE-3415.patch
>
>
> Current JAR resolution assumes the following:
> # The class used for JAR lookup is effectively in a JAR
> # A System property is set for testing with the location of the JAR
> The problem with #1 is that in some cases (when using the class in the same Maven module where the class is, the class is not in a JAR but in a directory 'target/test-classes').
> The problem with #2 is the JAR does not exists at the time of running the test (packaging comes after test and we are not doing integration testing yet thus won't work)
> In addition, this is required for streaming testcases, to have the JAR with streaming classes for testing.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-3415) improve MiniMRYarnCluster & DistributedShell JAR resolution

Posted by "Hadoop QA (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-3415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13151755#comment-13151755 ] 

Hadoop QA commented on MAPREDUCE-3415:
--------------------------------------

-1 overall.  Here are the results of testing the latest attachment 
  http://issues.apache.org/jira/secure/attachment/12504012/MAPREDUCE-3415.patch
  against trunk revision .

    +1 @author.  The patch does not contain any @author tags.

    +1 tests included.  The patch appears to include 10 new or modified tests.

    +1 javadoc.  The javadoc tool did not generate any warning messages.

    -1 javac.  The patch appears to cause tar ant target to fail.

    -1 findbugs.  The patch appears to cause Findbugs (version 1.3.9) to fail.

    +1 release audit.  The applied patch does not increase the total number of release audit warnings.

    -1 core tests.  The patch failed the unit tests build

    +1 contrib tests.  The patch passed contrib unit tests.

Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1315//testReport/
Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1315//console

This message is automatically generated.
                
> improve MiniMRYarnCluster & DistributedShell JAR resolution 
> ------------------------------------------------------------
>
>                 Key: MAPREDUCE-3415
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3415
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: mrv2
>    Affects Versions: 0.24.0, 0.23.1
>            Reporter: Alejandro Abdelnur
>            Assignee: Alejandro Abdelnur
>             Fix For: 0.24.0, 0.23.1
>
>         Attachments: MAPREDUCE-3415.patch, MAPREDUCE-3415.patch, MAPREDUCE-3415.patch
>
>
> Current JAR resolution assumes the following:
> # The class used for JAR lookup is effectively in a JAR
> # A System property is set for testing with the location of the JAR
> The problem with #1 is that in some cases (when using the class in the same Maven module where the class is, the class is not in a JAR but in a directory 'target/test-classes').
> The problem with #2 is the JAR does not exists at the time of running the test (packaging comes after test and we are not doing integration testing yet thus won't work)
> In addition, this is required for streaming testcases, to have the JAR with streaming classes for testing.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-3415) improve MiniMRYarnCluster & DistributedShell JAR resolution

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-3415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13203247#comment-13203247 ] 

Hudson commented on MAPREDUCE-3415:
-----------------------------------

Integrated in Hadoop-Common-0.23-Commit #519 (See [https://builds.apache.org/job/Hadoop-Common-0.23-Commit/519/])
    MAPREDUCE-3415. Moving to 0.23.1 section.

acmurthy : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1241756
Files : 
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt

                
> improve MiniMRYarnCluster & DistributedShell JAR resolution 
> ------------------------------------------------------------
>
>                 Key: MAPREDUCE-3415
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3415
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: mrv2
>    Affects Versions: 0.23.1, 0.24.0
>            Reporter: Alejandro Abdelnur
>            Assignee: Alejandro Abdelnur
>             Fix For: 0.23.1
>
>         Attachments: MAPREDUCE-3415.patch, MAPREDUCE-3415.patch, MAPREDUCE-3415.patch, MAPREDUCE-3415.patch
>
>
> Current JAR resolution assumes the following:
> # The class used for JAR lookup is effectively in a JAR
> # A System property is set for testing with the location of the JAR
> The problem with #1 is that in some cases (when using the class in the same Maven module where the class is, the class is not in a JAR but in a directory 'target/test-classes').
> The problem with #2 is the JAR does not exists at the time of running the test (packaging comes after test and we are not doing integration testing yet thus won't work)
> In addition, this is required for streaming testcases, to have the JAR with streaming classes for testing.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (MAPREDUCE-3415) improve MiniMRYarnCluster & DistributedShell JAR resolution

Posted by "Alejandro Abdelnur (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-3415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Alejandro Abdelnur updated MAPREDUCE-3415:
------------------------------------------

    Attachment: MAPREDUCE-3415.patch

now rebased to trunk and on top of MAPREDUCE-3169
                
> improve MiniMRYarnCluster & DistributedShell JAR resolution 
> ------------------------------------------------------------
>
>                 Key: MAPREDUCE-3415
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3415
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: mrv2
>    Affects Versions: 0.24.0, 0.23.1
>            Reporter: Alejandro Abdelnur
>            Assignee: Alejandro Abdelnur
>             Fix For: 0.24.0, 0.23.1
>
>         Attachments: MAPREDUCE-3415.patch, MAPREDUCE-3415.patch
>
>
> Current JAR resolution assumes the following:
> # The class used for JAR lookup is effectively in a JAR
> # A System property is set for testing with the location of the JAR
> The problem with #1 is that in some cases (when using the class in the same Maven module where the class is, the class is not in a JAR but in a directory 'target/test-classes').
> The problem with #2 is the JAR does not exists at the time of running the test (packaging comes after test and we are not doing integration testing yet thus won't work)
> In addition, this is required for streaming testcases, to have the JAR with streaming classes for testing.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-3415) improve MiniMRYarnCluster & DistributedShell JAR resolution

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-3415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13203262#comment-13203262 ] 

Hudson commented on MAPREDUCE-3415:
-----------------------------------

Integrated in Hadoop-Mapreduce-trunk-Commit #1702 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/1702/])
    MAPREDUCE-3415. Moving to 0.23.1 section.

acmurthy : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1241752
Files : 
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt

                
> improve MiniMRYarnCluster & DistributedShell JAR resolution 
> ------------------------------------------------------------
>
>                 Key: MAPREDUCE-3415
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3415
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: mrv2
>    Affects Versions: 0.23.1, 0.24.0
>            Reporter: Alejandro Abdelnur
>            Assignee: Alejandro Abdelnur
>             Fix For: 0.23.1
>
>         Attachments: MAPREDUCE-3415.patch, MAPREDUCE-3415.patch, MAPREDUCE-3415.patch, MAPREDUCE-3415.patch
>
>
> Current JAR resolution assumes the following:
> # The class used for JAR lookup is effectively in a JAR
> # A System property is set for testing with the location of the JAR
> The problem with #1 is that in some cases (when using the class in the same Maven module where the class is, the class is not in a JAR but in a directory 'target/test-classes').
> The problem with #2 is the JAR does not exists at the time of running the test (packaging comes after test and we are not doing integration testing yet thus won't work)
> In addition, this is required for streaming testcases, to have the JAR with streaming classes for testing.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-3415) improve MiniMRYarnCluster & DistributedShell JAR resolution

Posted by "Hadoop QA (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-3415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13151527#comment-13151527 ] 

Hadoop QA commented on MAPREDUCE-3415:
--------------------------------------

-1 overall.  Here are the results of testing the latest attachment 
  http://issues.apache.org/jira/secure/attachment/12503949/MAPREDUCE-3415.patch
  against trunk revision .

    +1 @author.  The patch does not contain any @author tags.

    +1 tests included.  The patch appears to include 8 new or modified tests.

    +1 javadoc.  The javadoc tool did not generate any warning messages.

    -1 javac.  The patch appears to cause tar ant target to fail.

    -1 findbugs.  The patch appears to cause Findbugs (version 1.3.9) to fail.

    +1 release audit.  The applied patch does not increase the total number of release audit warnings.

    -1 core tests.  The patch failed the unit tests build

    +1 contrib tests.  The patch passed contrib unit tests.

Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1313//testReport/
Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1313//console

This message is automatically generated.
                
> improve MiniMRYarnCluster & DistributedShell JAR resolution 
> ------------------------------------------------------------
>
>                 Key: MAPREDUCE-3415
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3415
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: mrv2
>    Affects Versions: 0.24.0, 0.23.1
>            Reporter: Alejandro Abdelnur
>            Assignee: Alejandro Abdelnur
>             Fix For: 0.24.0, 0.23.1
>
>         Attachments: MAPREDUCE-3415.patch, MAPREDUCE-3415.patch
>
>
> Current JAR resolution assumes the following:
> # The class used for JAR lookup is effectively in a JAR
> # A System property is set for testing with the location of the JAR
> The problem with #1 is that in some cases (when using the class in the same Maven module where the class is, the class is not in a JAR but in a directory 'target/test-classes').
> The problem with #2 is the JAR does not exists at the time of running the test (packaging comes after test and we are not doing integration testing yet thus won't work)
> In addition, this is required for streaming testcases, to have the JAR with streaming classes for testing.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-3415) improve MiniMRYarnCluster & DistributedShell JAR resolution

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-3415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13152463#comment-13152463 ] 

Hudson commented on MAPREDUCE-3415:
-----------------------------------

Integrated in Hadoop-Mapreduce-trunk-Commit #1304 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/1304/])
    MAPREDUCE-3415. improve MiniMRYarnCluster & DistributedShell JAR resolution (tucu)

tucu : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1203411
Files : 
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/util/JarFinder.java
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/util/TestJarFinder.java
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/pom.xml
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/MiniMRClientClusterFactory.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/v2/MiniMRYarnCluster.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell/pom.xml
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell/src/test/java/org/apache/hadoop/yarn/applications/distributedshell/TestDistributedShell.java

                
> improve MiniMRYarnCluster & DistributedShell JAR resolution 
> ------------------------------------------------------------
>
>                 Key: MAPREDUCE-3415
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3415
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: mrv2
>    Affects Versions: 0.24.0, 0.23.1
>            Reporter: Alejandro Abdelnur
>            Assignee: Alejandro Abdelnur
>             Fix For: 0.24.0, 0.23.1
>
>         Attachments: MAPREDUCE-3415.patch, MAPREDUCE-3415.patch, MAPREDUCE-3415.patch, MAPREDUCE-3415.patch
>
>
> Current JAR resolution assumes the following:
> # The class used for JAR lookup is effectively in a JAR
> # A System property is set for testing with the location of the JAR
> The problem with #1 is that in some cases (when using the class in the same Maven module where the class is, the class is not in a JAR but in a directory 'target/test-classes').
> The problem with #2 is the JAR does not exists at the time of running the test (packaging comes after test and we are not doing integration testing yet thus won't work)
> In addition, this is required for streaming testcases, to have the JAR with streaming classes for testing.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-3415) improve MiniMRYarnCluster & DistributedShell JAR resolution

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-3415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13203244#comment-13203244 ] 

Hudson commented on MAPREDUCE-3415:
-----------------------------------

Integrated in Hadoop-Hdfs-0.23-Commit #508 (See [https://builds.apache.org/job/Hadoop-Hdfs-0.23-Commit/508/])
    MAPREDUCE-3415. Moving to 0.23.1 section.

acmurthy : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1241756
Files : 
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt

                
> improve MiniMRYarnCluster & DistributedShell JAR resolution 
> ------------------------------------------------------------
>
>                 Key: MAPREDUCE-3415
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3415
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: mrv2
>    Affects Versions: 0.23.1, 0.24.0
>            Reporter: Alejandro Abdelnur
>            Assignee: Alejandro Abdelnur
>             Fix For: 0.23.1
>
>         Attachments: MAPREDUCE-3415.patch, MAPREDUCE-3415.patch, MAPREDUCE-3415.patch, MAPREDUCE-3415.patch
>
>
> Current JAR resolution assumes the following:
> # The class used for JAR lookup is effectively in a JAR
> # A System property is set for testing with the location of the JAR
> The problem with #1 is that in some cases (when using the class in the same Maven module where the class is, the class is not in a JAR but in a directory 'target/test-classes').
> The problem with #2 is the JAR does not exists at the time of running the test (packaging comes after test and we are not doing integration testing yet thus won't work)
> In addition, this is required for streaming testcases, to have the JAR with streaming classes for testing.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-3415) improve MiniMRYarnCluster & DistributedShell JAR resolution

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-3415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13203242#comment-13203242 ] 

Hudson commented on MAPREDUCE-3415:
-----------------------------------

Integrated in Hadoop-Hdfs-trunk-Commit #1766 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/1766/])
    MAPREDUCE-3415. Moving to 0.23.1 section.

acmurthy : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1241752
Files : 
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt

                
> improve MiniMRYarnCluster & DistributedShell JAR resolution 
> ------------------------------------------------------------
>
>                 Key: MAPREDUCE-3415
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3415
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: mrv2
>    Affects Versions: 0.23.1, 0.24.0
>            Reporter: Alejandro Abdelnur
>            Assignee: Alejandro Abdelnur
>             Fix For: 0.23.1
>
>         Attachments: MAPREDUCE-3415.patch, MAPREDUCE-3415.patch, MAPREDUCE-3415.patch, MAPREDUCE-3415.patch
>
>
> Current JAR resolution assumes the following:
> # The class used for JAR lookup is effectively in a JAR
> # A System property is set for testing with the location of the JAR
> The problem with #1 is that in some cases (when using the class in the same Maven module where the class is, the class is not in a JAR but in a directory 'target/test-classes').
> The problem with #2 is the JAR does not exists at the time of running the test (packaging comes after test and we are not doing integration testing yet thus won't work)
> In addition, this is required for streaming testcases, to have the JAR with streaming classes for testing.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-3415) improve MiniMRYarnCluster & DistributedShell JAR resolution

Posted by "Alejandro Abdelnur (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-3415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13151482#comment-13151482 ] 

Alejandro Abdelnur commented on MAPREDUCE-3415:
-----------------------------------------------

One solution is to have a 'JarFinder' class that looks for the classpath element of the class, if the classpath element is a JAR return its path. And, if the classpath element is a directory, create a JAR file on the fly (in a temp dir) with all the contents of the classpath element directory and return the path to that file.
                
> improve MiniMRYarnCluster & DistributedShell JAR resolution 
> ------------------------------------------------------------
>
>                 Key: MAPREDUCE-3415
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3415
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: mrv2
>    Affects Versions: 0.24.0, 0.23.1
>            Reporter: Alejandro Abdelnur
>            Assignee: Alejandro Abdelnur
>             Fix For: 0.24.0, 0.23.1
>
>
> Current JAR resolution assumes the following:
> # The class used for JAR lookup is effectively in a JAR
> # A System property is set for testing with the location of the JAR
> The problem with #1 is that in some cases (when using the class in the same Maven module where the class is, the class is not in a JAR but in a directory 'target/test-classes').
> The problem with #2 is the JAR does not exists at the time of running the test (packaging comes after test and we are not doing integration testing yet thus won't work)
> In addition, this is required for streaming testcases, to have the JAR with streaming classes for testing.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-3415) improve MiniMRYarnCluster & DistributedShell JAR resolution

Posted by "Hadoop QA (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-3415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13152239#comment-13152239 ] 

Hadoop QA commented on MAPREDUCE-3415:
--------------------------------------

-1 overall.  Here are the results of testing the latest attachment 
  http://issues.apache.org/jira/secure/attachment/12504097/MAPREDUCE-3415.patch
  against trunk revision .

    +1 @author.  The patch does not contain any @author tags.

    +1 tests included.  The patch appears to include 14 new or modified tests.

    -1 patch.  The patch command could not apply the patch.

Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1318//console

This message is automatically generated.
                
> improve MiniMRYarnCluster & DistributedShell JAR resolution 
> ------------------------------------------------------------
>
>                 Key: MAPREDUCE-3415
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3415
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: mrv2
>    Affects Versions: 0.24.0, 0.23.1
>            Reporter: Alejandro Abdelnur
>            Assignee: Alejandro Abdelnur
>             Fix For: 0.24.0, 0.23.1
>
>         Attachments: MAPREDUCE-3415.patch, MAPREDUCE-3415.patch, MAPREDUCE-3415.patch, MAPREDUCE-3415.patch
>
>
> Current JAR resolution assumes the following:
> # The class used for JAR lookup is effectively in a JAR
> # A System property is set for testing with the location of the JAR
> The problem with #1 is that in some cases (when using the class in the same Maven module where the class is, the class is not in a JAR but in a directory 'target/test-classes').
> The problem with #2 is the JAR does not exists at the time of running the test (packaging comes after test and we are not doing integration testing yet thus won't work)
> In addition, this is required for streaming testcases, to have the JAR with streaming classes for testing.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-3415) improve MiniMRYarnCluster & DistributedShell JAR resolution

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-3415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13203541#comment-13203541 ] 

Hudson commented on MAPREDUCE-3415:
-----------------------------------

Integrated in Hadoop-Hdfs-0.23-Build #163 (See [https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/163/])
    MAPREDUCE-3415. Moving to 0.23.1 section.

acmurthy : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1241756
Files : 
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt

                
> improve MiniMRYarnCluster & DistributedShell JAR resolution 
> ------------------------------------------------------------
>
>                 Key: MAPREDUCE-3415
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3415
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: mrv2
>    Affects Versions: 0.23.1, 0.24.0
>            Reporter: Alejandro Abdelnur
>            Assignee: Alejandro Abdelnur
>             Fix For: 0.23.1
>
>         Attachments: MAPREDUCE-3415.patch, MAPREDUCE-3415.patch, MAPREDUCE-3415.patch, MAPREDUCE-3415.patch
>
>
> Current JAR resolution assumes the following:
> # The class used for JAR lookup is effectively in a JAR
> # A System property is set for testing with the location of the JAR
> The problem with #1 is that in some cases (when using the class in the same Maven module where the class is, the class is not in a JAR but in a directory 'target/test-classes').
> The problem with #2 is the JAR does not exists at the time of running the test (packaging comes after test and we are not doing integration testing yet thus won't work)
> In addition, this is required for streaming testcases, to have the JAR with streaming classes for testing.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (MAPREDUCE-3415) improve MiniMRYarnCluster & DistributedShell JAR resolution

Posted by "Alejandro Abdelnur (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-3415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Alejandro Abdelnur updated MAPREDUCE-3415:
------------------------------------------

    Attachment: MAPREDUCE-3415.patch

integrating Tom's comments
                
> improve MiniMRYarnCluster & DistributedShell JAR resolution 
> ------------------------------------------------------------
>
>                 Key: MAPREDUCE-3415
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3415
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: mrv2
>    Affects Versions: 0.24.0, 0.23.1
>            Reporter: Alejandro Abdelnur
>            Assignee: Alejandro Abdelnur
>             Fix For: 0.24.0, 0.23.1
>
>         Attachments: MAPREDUCE-3415.patch, MAPREDUCE-3415.patch, MAPREDUCE-3415.patch
>
>
> Current JAR resolution assumes the following:
> # The class used for JAR lookup is effectively in a JAR
> # A System property is set for testing with the location of the JAR
> The problem with #1 is that in some cases (when using the class in the same Maven module where the class is, the class is not in a JAR but in a directory 'target/test-classes').
> The problem with #2 is the JAR does not exists at the time of running the test (packaging comes after test and we are not doing integration testing yet thus won't work)
> In addition, this is required for streaming testcases, to have the JAR with streaming classes for testing.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-3415) improve MiniMRYarnCluster & DistributedShell JAR resolution

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-3415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13152845#comment-13152845 ] 

Hudson commented on MAPREDUCE-3415:
-----------------------------------

Integrated in Hadoop-Mapreduce-0.23-Build #97 (See [https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Build/97/])
    Merge -r 1203410:1203411 from trunk to branch. FIXES: MAPREDUCE-3415

tucu : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1203415
Files : 
* /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/util/JarFinder.java
* /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/util/TestJarFinder.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/pom.xml
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/MiniMRClientClusterFactory.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/v2/MiniMRYarnCluster.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell/pom.xml
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell/src/test/java/org/apache/hadoop/yarn/applications/distributedshell/TestDistributedShell.java

                
> improve MiniMRYarnCluster & DistributedShell JAR resolution 
> ------------------------------------------------------------
>
>                 Key: MAPREDUCE-3415
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3415
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: mrv2
>    Affects Versions: 0.24.0, 0.23.1
>            Reporter: Alejandro Abdelnur
>            Assignee: Alejandro Abdelnur
>             Fix For: 0.24.0, 0.23.1
>
>         Attachments: MAPREDUCE-3415.patch, MAPREDUCE-3415.patch, MAPREDUCE-3415.patch, MAPREDUCE-3415.patch
>
>
> Current JAR resolution assumes the following:
> # The class used for JAR lookup is effectively in a JAR
> # A System property is set for testing with the location of the JAR
> The problem with #1 is that in some cases (when using the class in the same Maven module where the class is, the class is not in a JAR but in a directory 'target/test-classes').
> The problem with #2 is the JAR does not exists at the time of running the test (packaging comes after test and we are not doing integration testing yet thus won't work)
> In addition, this is required for streaming testcases, to have the JAR with streaming classes for testing.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-3415) improve MiniMRYarnCluster & DistributedShell JAR resolution

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-3415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13152819#comment-13152819 ] 

Hudson commented on MAPREDUCE-3415:
-----------------------------------

Integrated in Hadoop-Hdfs-0.23-Build #80 (See [https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/80/])
    Merge -r 1203410:1203411 from trunk to branch. FIXES: MAPREDUCE-3415

tucu : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1203415
Files : 
* /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/util/JarFinder.java
* /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/util/TestJarFinder.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/pom.xml
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/MiniMRClientClusterFactory.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/v2/MiniMRYarnCluster.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell/pom.xml
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell/src/test/java/org/apache/hadoop/yarn/applications/distributedshell/TestDistributedShell.java

                
> improve MiniMRYarnCluster & DistributedShell JAR resolution 
> ------------------------------------------------------------
>
>                 Key: MAPREDUCE-3415
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3415
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: mrv2
>    Affects Versions: 0.24.0, 0.23.1
>            Reporter: Alejandro Abdelnur
>            Assignee: Alejandro Abdelnur
>             Fix For: 0.24.0, 0.23.1
>
>         Attachments: MAPREDUCE-3415.patch, MAPREDUCE-3415.patch, MAPREDUCE-3415.patch, MAPREDUCE-3415.patch
>
>
> Current JAR resolution assumes the following:
> # The class used for JAR lookup is effectively in a JAR
> # A System property is set for testing with the location of the JAR
> The problem with #1 is that in some cases (when using the class in the same Maven module where the class is, the class is not in a JAR but in a directory 'target/test-classes').
> The problem with #2 is the JAR does not exists at the time of running the test (packaging comes after test and we are not doing integration testing yet thus won't work)
> In addition, this is required for streaming testcases, to have the JAR with streaming classes for testing.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-3415) improve MiniMRYarnCluster & DistributedShell JAR resolution

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-3415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13203519#comment-13203519 ] 

Hudson commented on MAPREDUCE-3415:
-----------------------------------

Integrated in Hadoop-Hdfs-trunk #950 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk/950/])
    MAPREDUCE-3415. Moving to 0.23.1 section.

acmurthy : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1241752
Files : 
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt

                
> improve MiniMRYarnCluster & DistributedShell JAR resolution 
> ------------------------------------------------------------
>
>                 Key: MAPREDUCE-3415
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3415
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: mrv2
>    Affects Versions: 0.23.1, 0.24.0
>            Reporter: Alejandro Abdelnur
>            Assignee: Alejandro Abdelnur
>             Fix For: 0.23.1
>
>         Attachments: MAPREDUCE-3415.patch, MAPREDUCE-3415.patch, MAPREDUCE-3415.patch, MAPREDUCE-3415.patch
>
>
> Current JAR resolution assumes the following:
> # The class used for JAR lookup is effectively in a JAR
> # A System property is set for testing with the location of the JAR
> The problem with #1 is that in some cases (when using the class in the same Maven module where the class is, the class is not in a JAR but in a directory 'target/test-classes').
> The problem with #2 is the JAR does not exists at the time of running the test (packaging comes after test and we are not doing integration testing yet thus won't work)
> In addition, this is required for streaming testcases, to have the JAR with streaming classes for testing.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-3415) improve MiniMRYarnCluster & DistributedShell JAR resolution

Posted by "Hadoop QA (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-3415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13151504#comment-13151504 ] 

Hadoop QA commented on MAPREDUCE-3415:
--------------------------------------

-1 overall.  Here are the results of testing the latest attachment 
  http://issues.apache.org/jira/secure/attachment/12503947/MAPREDUCE-3415.patch
  against trunk revision .

    +1 @author.  The patch does not contain any @author tags.

    +1 tests included.  The patch appears to include 8 new or modified tests.

    -1 patch.  The patch command could not apply the patch.

Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1312//console

This message is automatically generated.
                
> improve MiniMRYarnCluster & DistributedShell JAR resolution 
> ------------------------------------------------------------
>
>                 Key: MAPREDUCE-3415
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3415
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: mrv2
>    Affects Versions: 0.24.0, 0.23.1
>            Reporter: Alejandro Abdelnur
>            Assignee: Alejandro Abdelnur
>             Fix For: 0.24.0, 0.23.1
>
>         Attachments: MAPREDUCE-3415.patch
>
>
> Current JAR resolution assumes the following:
> # The class used for JAR lookup is effectively in a JAR
> # A System property is set for testing with the location of the JAR
> The problem with #1 is that in some cases (when using the class in the same Maven module where the class is, the class is not in a JAR but in a directory 'target/test-classes').
> The problem with #2 is the JAR does not exists at the time of running the test (packaging comes after test and we are not doing integration testing yet thus won't work)
> In addition, this is required for streaming testcases, to have the JAR with streaming classes for testing.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-3415) improve MiniMRYarnCluster & DistributedShell JAR resolution

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-3415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13152446#comment-13152446 ] 

Hudson commented on MAPREDUCE-3415:
-----------------------------------

Integrated in Hadoop-Hdfs-0.23-Commit #177 (See [https://builds.apache.org/job/Hadoop-Hdfs-0.23-Commit/177/])
    Merge -r 1203410:1203411 from trunk to branch. FIXES: MAPREDUCE-3415

tucu : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1203415
Files : 
* /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/util/JarFinder.java
* /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/util/TestJarFinder.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/pom.xml
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/MiniMRClientClusterFactory.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/v2/MiniMRYarnCluster.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell/pom.xml
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell/src/test/java/org/apache/hadoop/yarn/applications/distributedshell/TestDistributedShell.java

                
> improve MiniMRYarnCluster & DistributedShell JAR resolution 
> ------------------------------------------------------------
>
>                 Key: MAPREDUCE-3415
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3415
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: mrv2
>    Affects Versions: 0.24.0, 0.23.1
>            Reporter: Alejandro Abdelnur
>            Assignee: Alejandro Abdelnur
>             Fix For: 0.24.0, 0.23.1
>
>         Attachments: MAPREDUCE-3415.patch, MAPREDUCE-3415.patch, MAPREDUCE-3415.patch, MAPREDUCE-3415.patch
>
>
> Current JAR resolution assumes the following:
> # The class used for JAR lookup is effectively in a JAR
> # A System property is set for testing with the location of the JAR
> The problem with #1 is that in some cases (when using the class in the same Maven module where the class is, the class is not in a JAR but in a directory 'target/test-classes').
> The problem with #2 is the JAR does not exists at the time of running the test (packaging comes after test and we are not doing integration testing yet thus won't work)
> In addition, this is required for streaming testcases, to have the JAR with streaming classes for testing.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (MAPREDUCE-3415) improve MiniMRYarnCluster & DistributedShell JAR resolution

Posted by "Alejandro Abdelnur (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-3415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Alejandro Abdelnur updated MAPREDUCE-3415:
------------------------------------------

      Resolution: Fixed
    Hadoop Flags: Reviewed
          Status: Resolved  (was: Patch Available)

Committed to trunk and 0.23
                
> improve MiniMRYarnCluster & DistributedShell JAR resolution 
> ------------------------------------------------------------
>
>                 Key: MAPREDUCE-3415
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3415
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: mrv2
>    Affects Versions: 0.24.0, 0.23.1
>            Reporter: Alejandro Abdelnur
>            Assignee: Alejandro Abdelnur
>             Fix For: 0.24.0, 0.23.1
>
>         Attachments: MAPREDUCE-3415.patch, MAPREDUCE-3415.patch, MAPREDUCE-3415.patch, MAPREDUCE-3415.patch
>
>
> Current JAR resolution assumes the following:
> # The class used for JAR lookup is effectively in a JAR
> # A System property is set for testing with the location of the JAR
> The problem with #1 is that in some cases (when using the class in the same Maven module where the class is, the class is not in a JAR but in a directory 'target/test-classes').
> The problem with #2 is the JAR does not exists at the time of running the test (packaging comes after test and we are not doing integration testing yet thus won't work)
> In addition, this is required for streaming testcases, to have the JAR with streaming classes for testing.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-3415) improve MiniMRYarnCluster & DistributedShell JAR resolution

Posted by "Ahmed Radwan (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-3415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13152313#comment-13152313 ] 

Ahmed Radwan commented on MAPREDUCE-3415:
-----------------------------------------

+1, thanks Tucu!
                
> improve MiniMRYarnCluster & DistributedShell JAR resolution 
> ------------------------------------------------------------
>
>                 Key: MAPREDUCE-3415
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3415
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: mrv2
>    Affects Versions: 0.24.0, 0.23.1
>            Reporter: Alejandro Abdelnur
>            Assignee: Alejandro Abdelnur
>             Fix For: 0.24.0, 0.23.1
>
>         Attachments: MAPREDUCE-3415.patch, MAPREDUCE-3415.patch, MAPREDUCE-3415.patch, MAPREDUCE-3415.patch
>
>
> Current JAR resolution assumes the following:
> # The class used for JAR lookup is effectively in a JAR
> # A System property is set for testing with the location of the JAR
> The problem with #1 is that in some cases (when using the class in the same Maven module where the class is, the class is not in a JAR but in a directory 'target/test-classes').
> The problem with #2 is the JAR does not exists at the time of running the test (packaging comes after test and we are not doing integration testing yet thus won't work)
> In addition, this is required for streaming testcases, to have the JAR with streaming classes for testing.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-3415) improve MiniMRYarnCluster & DistributedShell JAR resolution

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-3415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13203246#comment-13203246 ] 

Hudson commented on MAPREDUCE-3415:
-----------------------------------

Integrated in Hadoop-Common-trunk-Commit #1691 (See [https://builds.apache.org/job/Hadoop-Common-trunk-Commit/1691/])
    MAPREDUCE-3415. Moving to 0.23.1 section.

acmurthy : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1241752
Files : 
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt

                
> improve MiniMRYarnCluster & DistributedShell JAR resolution 
> ------------------------------------------------------------
>
>                 Key: MAPREDUCE-3415
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3415
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: mrv2
>    Affects Versions: 0.23.1, 0.24.0
>            Reporter: Alejandro Abdelnur
>            Assignee: Alejandro Abdelnur
>             Fix For: 0.23.1
>
>         Attachments: MAPREDUCE-3415.patch, MAPREDUCE-3415.patch, MAPREDUCE-3415.patch, MAPREDUCE-3415.patch
>
>
> Current JAR resolution assumes the following:
> # The class used for JAR lookup is effectively in a JAR
> # A System property is set for testing with the location of the JAR
> The problem with #1 is that in some cases (when using the class in the same Maven module where the class is, the class is not in a JAR but in a directory 'target/test-classes').
> The problem with #2 is the JAR does not exists at the time of running the test (packaging comes after test and we are not doing integration testing yet thus won't work)
> In addition, this is required for streaming testcases, to have the JAR with streaming classes for testing.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-3415) improve MiniMRYarnCluster & DistributedShell JAR resolution

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-3415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13152478#comment-13152478 ] 

Hudson commented on MAPREDUCE-3415:
-----------------------------------

Integrated in Hadoop-Mapreduce-0.23-Commit #190 (See [https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Commit/190/])
    Merge -r 1203410:1203411 from trunk to branch. FIXES: MAPREDUCE-3415

tucu : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1203415
Files : 
* /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/util/JarFinder.java
* /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/util/TestJarFinder.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/pom.xml
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/MiniMRClientClusterFactory.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/v2/MiniMRYarnCluster.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell/pom.xml
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell/src/test/java/org/apache/hadoop/yarn/applications/distributedshell/TestDistributedShell.java

                
> improve MiniMRYarnCluster & DistributedShell JAR resolution 
> ------------------------------------------------------------
>
>                 Key: MAPREDUCE-3415
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3415
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: mrv2
>    Affects Versions: 0.24.0, 0.23.1
>            Reporter: Alejandro Abdelnur
>            Assignee: Alejandro Abdelnur
>             Fix For: 0.24.0, 0.23.1
>
>         Attachments: MAPREDUCE-3415.patch, MAPREDUCE-3415.patch, MAPREDUCE-3415.patch, MAPREDUCE-3415.patch
>
>
> Current JAR resolution assumes the following:
> # The class used for JAR lookup is effectively in a JAR
> # A System property is set for testing with the location of the JAR
> The problem with #1 is that in some cases (when using the class in the same Maven module where the class is, the class is not in a JAR but in a directory 'target/test-classes').
> The problem with #2 is the JAR does not exists at the time of running the test (packaging comes after test and we are not doing integration testing yet thus won't work)
> In addition, this is required for streaming testcases, to have the JAR with streaming classes for testing.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-3415) improve MiniMRYarnCluster & DistributedShell JAR resolution

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-3415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13152430#comment-13152430 ] 

Hudson commented on MAPREDUCE-3415:
-----------------------------------

Integrated in Hadoop-Common-trunk-Commit #1280 (See [https://builds.apache.org/job/Hadoop-Common-trunk-Commit/1280/])
    MAPREDUCE-3415. improve MiniMRYarnCluster & DistributedShell JAR resolution (tucu)

tucu : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1203411
Files : 
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/util/JarFinder.java
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/util/TestJarFinder.java
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/pom.xml
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/MiniMRClientClusterFactory.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/v2/MiniMRYarnCluster.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell/pom.xml
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell/src/test/java/org/apache/hadoop/yarn/applications/distributedshell/TestDistributedShell.java

                
> improve MiniMRYarnCluster & DistributedShell JAR resolution 
> ------------------------------------------------------------
>
>                 Key: MAPREDUCE-3415
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3415
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: mrv2
>    Affects Versions: 0.24.0, 0.23.1
>            Reporter: Alejandro Abdelnur
>            Assignee: Alejandro Abdelnur
>             Fix For: 0.24.0, 0.23.1
>
>         Attachments: MAPREDUCE-3415.patch, MAPREDUCE-3415.patch, MAPREDUCE-3415.patch, MAPREDUCE-3415.patch
>
>
> Current JAR resolution assumes the following:
> # The class used for JAR lookup is effectively in a JAR
> # A System property is set for testing with the location of the JAR
> The problem with #1 is that in some cases (when using the class in the same Maven module where the class is, the class is not in a JAR but in a directory 'target/test-classes').
> The problem with #2 is the JAR does not exists at the time of running the test (packaging comes after test and we are not doing integration testing yet thus won't work)
> In addition, this is required for streaming testcases, to have the JAR with streaming classes for testing.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-3415) improve MiniMRYarnCluster & DistributedShell JAR resolution

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-3415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13152830#comment-13152830 ] 

Hudson commented on MAPREDUCE-3415:
-----------------------------------

Integrated in Hadoop-Hdfs-trunk #867 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk/867/])
    MAPREDUCE-3415. improve MiniMRYarnCluster & DistributedShell JAR resolution (tucu)

tucu : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1203411
Files : 
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/util/JarFinder.java
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/util/TestJarFinder.java
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/pom.xml
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/MiniMRClientClusterFactory.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/v2/MiniMRYarnCluster.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell/pom.xml
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell/src/test/java/org/apache/hadoop/yarn/applications/distributedshell/TestDistributedShell.java

                
> improve MiniMRYarnCluster & DistributedShell JAR resolution 
> ------------------------------------------------------------
>
>                 Key: MAPREDUCE-3415
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3415
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: mrv2
>    Affects Versions: 0.24.0, 0.23.1
>            Reporter: Alejandro Abdelnur
>            Assignee: Alejandro Abdelnur
>             Fix For: 0.24.0, 0.23.1
>
>         Attachments: MAPREDUCE-3415.patch, MAPREDUCE-3415.patch, MAPREDUCE-3415.patch, MAPREDUCE-3415.patch
>
>
> Current JAR resolution assumes the following:
> # The class used for JAR lookup is effectively in a JAR
> # A System property is set for testing with the location of the JAR
> The problem with #1 is that in some cases (when using the class in the same Maven module where the class is, the class is not in a JAR but in a directory 'target/test-classes').
> The problem with #2 is the JAR does not exists at the time of running the test (packaging comes after test and we are not doing integration testing yet thus won't work)
> In addition, this is required for streaming testcases, to have the JAR with streaming classes for testing.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-3415) improve MiniMRYarnCluster & DistributedShell JAR resolution

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-3415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13152447#comment-13152447 ] 

Hudson commented on MAPREDUCE-3415:
-----------------------------------

Integrated in Hadoop-Common-0.23-Commit #178 (See [https://builds.apache.org/job/Hadoop-Common-0.23-Commit/178/])
    Merge -r 1203410:1203411 from trunk to branch. FIXES: MAPREDUCE-3415

tucu : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1203415
Files : 
* /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/util/JarFinder.java
* /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/util/TestJarFinder.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/pom.xml
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/MiniMRClientClusterFactory.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/v2/MiniMRYarnCluster.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell/pom.xml
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell/src/test/java/org/apache/hadoop/yarn/applications/distributedshell/TestDistributedShell.java

                
> improve MiniMRYarnCluster & DistributedShell JAR resolution 
> ------------------------------------------------------------
>
>                 Key: MAPREDUCE-3415
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3415
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: mrv2
>    Affects Versions: 0.24.0, 0.23.1
>            Reporter: Alejandro Abdelnur
>            Assignee: Alejandro Abdelnur
>             Fix For: 0.24.0, 0.23.1
>
>         Attachments: MAPREDUCE-3415.patch, MAPREDUCE-3415.patch, MAPREDUCE-3415.patch, MAPREDUCE-3415.patch
>
>
> Current JAR resolution assumes the following:
> # The class used for JAR lookup is effectively in a JAR
> # A System property is set for testing with the location of the JAR
> The problem with #1 is that in some cases (when using the class in the same Maven module where the class is, the class is not in a JAR but in a directory 'target/test-classes').
> The problem with #2 is the JAR does not exists at the time of running the test (packaging comes after test and we are not doing integration testing yet thus won't work)
> In addition, this is required for streaming testcases, to have the JAR with streaming classes for testing.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-3415) improve MiniMRYarnCluster & DistributedShell JAR resolution

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-3415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13203565#comment-13203565 ] 

Hudson commented on MAPREDUCE-3415:
-----------------------------------

Integrated in Hadoop-Mapreduce-0.23-Build #185 (See [https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Build/185/])
    MAPREDUCE-3415. Moving to 0.23.1 section.

acmurthy : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1241756
Files : 
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt

                
> improve MiniMRYarnCluster & DistributedShell JAR resolution 
> ------------------------------------------------------------
>
>                 Key: MAPREDUCE-3415
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3415
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: mrv2
>    Affects Versions: 0.23.1, 0.24.0
>            Reporter: Alejandro Abdelnur
>            Assignee: Alejandro Abdelnur
>             Fix For: 0.23.1
>
>         Attachments: MAPREDUCE-3415.patch, MAPREDUCE-3415.patch, MAPREDUCE-3415.patch, MAPREDUCE-3415.patch
>
>
> Current JAR resolution assumes the following:
> # The class used for JAR lookup is effectively in a JAR
> # A System property is set for testing with the location of the JAR
> The problem with #1 is that in some cases (when using the class in the same Maven module where the class is, the class is not in a JAR but in a directory 'target/test-classes').
> The problem with #2 is the JAR does not exists at the time of running the test (packaging comes after test and we are not doing integration testing yet thus won't work)
> In addition, this is required for streaming testcases, to have the JAR with streaming classes for testing.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-3415) improve MiniMRYarnCluster & DistributedShell JAR resolution

Posted by "Tom White (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-3415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13151659#comment-13151659 ] 

Tom White commented on MAPREDUCE-3415:
--------------------------------------

This is an improvement for test code. Is it only used by test code? If so it should go in the test tree, otherwise it should be marked Private Unstable.

* Use Guava's Preconditions.checkNotNull rather than notNull.
* Nit: There are some spurious changes at the end of the patch.
                
> improve MiniMRYarnCluster & DistributedShell JAR resolution 
> ------------------------------------------------------------
>
>                 Key: MAPREDUCE-3415
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3415
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: mrv2
>    Affects Versions: 0.24.0, 0.23.1
>            Reporter: Alejandro Abdelnur
>            Assignee: Alejandro Abdelnur
>             Fix For: 0.24.0, 0.23.1
>
>         Attachments: MAPREDUCE-3415.patch, MAPREDUCE-3415.patch
>
>
> Current JAR resolution assumes the following:
> # The class used for JAR lookup is effectively in a JAR
> # A System property is set for testing with the location of the JAR
> The problem with #1 is that in some cases (when using the class in the same Maven module where the class is, the class is not in a JAR but in a directory 'target/test-classes').
> The problem with #2 is the JAR does not exists at the time of running the test (packaging comes after test and we are not doing integration testing yet thus won't work)
> In addition, this is required for streaming testcases, to have the JAR with streaming classes for testing.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (MAPREDUCE-3415) improve MiniMRYarnCluster & DistributedShell JAR resolution

Posted by "Alejandro Abdelnur (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-3415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Alejandro Abdelnur updated MAPREDUCE-3415:
------------------------------------------

    Status: Patch Available  (was: Open)
    
> improve MiniMRYarnCluster & DistributedShell JAR resolution 
> ------------------------------------------------------------
>
>                 Key: MAPREDUCE-3415
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3415
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: mrv2
>    Affects Versions: 0.24.0, 0.23.1
>            Reporter: Alejandro Abdelnur
>            Assignee: Alejandro Abdelnur
>             Fix For: 0.24.0, 0.23.1
>
>         Attachments: MAPREDUCE-3415.patch
>
>
> Current JAR resolution assumes the following:
> # The class used for JAR lookup is effectively in a JAR
> # A System property is set for testing with the location of the JAR
> The problem with #1 is that in some cases (when using the class in the same Maven module where the class is, the class is not in a JAR but in a directory 'target/test-classes').
> The problem with #2 is the JAR does not exists at the time of running the test (packaging comes after test and we are not doing integration testing yet thus won't work)
> In addition, this is required for streaming testcases, to have the JAR with streaming classes for testing.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-3415) improve MiniMRYarnCluster & DistributedShell JAR resolution

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-3415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13152428#comment-13152428 ] 

Hudson commented on MAPREDUCE-3415:
-----------------------------------

Integrated in Hadoop-Hdfs-trunk-Commit #1354 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/1354/])
    MAPREDUCE-3415. improve MiniMRYarnCluster & DistributedShell JAR resolution (tucu)

tucu : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1203411
Files : 
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/util/JarFinder.java
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/util/TestJarFinder.java
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/pom.xml
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/MiniMRClientClusterFactory.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/v2/MiniMRYarnCluster.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell/pom.xml
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell/src/test/java/org/apache/hadoop/yarn/applications/distributedshell/TestDistributedShell.java

                
> improve MiniMRYarnCluster & DistributedShell JAR resolution 
> ------------------------------------------------------------
>
>                 Key: MAPREDUCE-3415
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3415
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: mrv2
>    Affects Versions: 0.24.0, 0.23.1
>            Reporter: Alejandro Abdelnur
>            Assignee: Alejandro Abdelnur
>             Fix For: 0.24.0, 0.23.1
>
>         Attachments: MAPREDUCE-3415.patch, MAPREDUCE-3415.patch, MAPREDUCE-3415.patch, MAPREDUCE-3415.patch
>
>
> Current JAR resolution assumes the following:
> # The class used for JAR lookup is effectively in a JAR
> # A System property is set for testing with the location of the JAR
> The problem with #1 is that in some cases (when using the class in the same Maven module where the class is, the class is not in a JAR but in a directory 'target/test-classes').
> The problem with #2 is the JAR does not exists at the time of running the test (packaging comes after test and we are not doing integration testing yet thus won't work)
> In addition, this is required for streaming testcases, to have the JAR with streaming classes for testing.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira