You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "Vinod Kumar Vavilapalli (JIRA)" <ji...@apache.org> on 2011/09/12 15:45:09 UTC

[jira] [Created] (HADOOP-7624) Set things up for a top level hadoop-tools module

Set things up for a top level hadoop-tools module
-------------------------------------------------

                 Key: HADOOP-7624
                 URL: https://issues.apache.org/jira/browse/HADOOP-7624
             Project: Hadoop Common
          Issue Type: Bug
          Components: build
            Reporter: Vinod Kumar Vavilapalli


See this thread: http://markmail.org/thread/cxtz3i6lvztfgfxn

We need to get things up and running for a top level hadoop-tools module. DistCpV2 will be the first resident of this new home. Things we need:
 - The module itself and a top level pom with appropriate dependencies
 - Integration with the patch builds for the new module
 - Integration with the post-commit and nightly builds for the new module.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-7624) Set things up for a top level hadoop-tools module

Posted by "Allen Wittenauer (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-7624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13103080#comment-13103080 ] 

Allen Wittenauer commented on HADOOP-7624:
------------------------------------------

No, there was not consensus.  I even said in the mailing list that I would oppose this without some rules to prevent this turning into contrib v2.0.

I honestly think that the only way to prevent this from turning into a complete mess is to essentially make it a full-fledged sub-project.

> Set things up for a top level hadoop-tools module
> -------------------------------------------------
>
>                 Key: HADOOP-7624
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7624
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: build
>            Reporter: Vinod Kumar Vavilapalli
>
> See this thread: http://markmail.org/thread/cxtz3i6lvztfgfxn
> We need to get things up and running for a top level hadoop-tools module. DistCpV2 will be the first resident of this new home. Things we need:
>  - The module itself and a top level pom with appropriate dependencies
>  - Integration with the patch builds for the new module
>  - Integration with the post-commit and nightly builds for the new module.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-7624) Set things up for a top level hadoop-tools module

Posted by "Doug Cutting (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-7624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13103143#comment-13103143 ] 

Doug Cutting commented on HADOOP-7624:
--------------------------------------

Allen, if you're not vetoing the addition of DistCpV2 (MAPREDUCE-2765) into Hadoop, but you don't feel it should go into a directory named 'tools', what directory should it go in?

> Set things up for a top level hadoop-tools module
> -------------------------------------------------
>
>                 Key: HADOOP-7624
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7624
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: build
>            Reporter: Vinod Kumar Vavilapalli
>
> See this thread: http://markmail.org/thread/cxtz3i6lvztfgfxn
> We need to get things up and running for a top level hadoop-tools module. DistCpV2 will be the first resident of this new home. Things we need:
>  - The module itself and a top level pom with appropriate dependencies
>  - Integration with the patch builds for the new module
>  - Integration with the post-commit and nightly builds for the new module.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HADOOP-7624) Set things up for a top level hadoop-tools module

Posted by "Alejandro Abdelnur (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-7624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Alejandro Abdelnur updated HADOOP-7624:
---------------------------------------

    Attachment: HADOOP-7624.patch

In case there is consensus for the trunk/hadoop-tools module.

> Set things up for a top level hadoop-tools module
> -------------------------------------------------
>
>                 Key: HADOOP-7624
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7624
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: build
>            Reporter: Vinod Kumar Vavilapalli
>         Attachments: HADOOP-7624.patch
>
>
> See this thread: http://markmail.org/thread/cxtz3i6lvztfgfxn
> We need to get things up and running for a top level hadoop-tools module. DistCpV2 will be the first resident of this new home. Things we need:
>  - The module itself and a top level pom with appropriate dependencies
>  - Integration with the patch builds for the new module
>  - Integration with the post-commit and nightly builds for the new module.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-7624) Set things up for a top level hadoop-tools module

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-7624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13138837#comment-13138837 ] 

Hudson commented on HADOOP-7624:
--------------------------------

Integrated in Hadoop-Mapreduce-0.23-Commit #103 (See [https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Commit/103/])
    Merge -r 1179911:1179912 from trunk to branch. FIXES: HADOOP-7624

tucu : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1190581
Files : 
* /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-tools
* /hadoop/common/branches/branch-0.23/hadoop-tools/pom.xml
* /hadoop/common/branches/branch-0.23/pom.xml

                
> Set things up for a top level hadoop-tools module
> -------------------------------------------------
>
>                 Key: HADOOP-7624
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7624
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: build
>            Reporter: Vinod Kumar Vavilapalli
>            Assignee: Alejandro Abdelnur
>         Attachments: HADOOP-7624.patch
>
>
> See this thread: http://markmail.org/thread/cxtz3i6lvztfgfxn
> We need to get things up and running for a top level hadoop-tools module. DistCpV2 will be the first resident of this new home. Things we need:
>  - The module itself and a top level pom with appropriate dependencies
>  - Integration with the patch builds for the new module
>  - Integration with the post-commit and nightly builds for the new module.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-7624) Set things up for a top level hadoop-tools module

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-7624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13122462#comment-13122462 ] 

Hudson commented on HADOOP-7624:
--------------------------------

Integrated in Hadoop-Common-trunk-Commit #1028 (See [https://builds.apache.org/job/Hadoop-Common-trunk-Commit/1028/])
    HADOOP-7624. Set things up for a top level hadoop-tools module. (tucu)

tucu : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1179912
Files : 
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
* /hadoop/common/trunk/hadoop-tools
* /hadoop/common/trunk/hadoop-tools/pom.xml
* /hadoop/common/trunk/pom.xml

                
> Set things up for a top level hadoop-tools module
> -------------------------------------------------
>
>                 Key: HADOOP-7624
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7624
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: build
>            Reporter: Vinod Kumar Vavilapalli
>            Assignee: Alejandro Abdelnur
>         Attachments: HADOOP-7624.patch
>
>
> See this thread: http://markmail.org/thread/cxtz3i6lvztfgfxn
> We need to get things up and running for a top level hadoop-tools module. DistCpV2 will be the first resident of this new home. Things we need:
>  - The module itself and a top level pom with appropriate dependencies
>  - Integration with the patch builds for the new module
>  - Integration with the post-commit and nightly builds for the new module.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-7624) Set things up for a top level hadoop-tools module

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-7624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13139221#comment-13139221 ] 

Hudson commented on HADOOP-7624:
--------------------------------

Integrated in Hadoop-Hdfs-0.23-Build #54 (See [https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/54/])
    Merge -r 1179911:1179912 from trunk to branch. FIXES: HADOOP-7624

tucu : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1190581
Files : 
* /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-tools
* /hadoop/common/branches/branch-0.23/hadoop-tools/pom.xml
* /hadoop/common/branches/branch-0.23/pom.xml

                
> Set things up for a top level hadoop-tools module
> -------------------------------------------------
>
>                 Key: HADOOP-7624
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7624
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: build
>            Reporter: Vinod Kumar Vavilapalli
>            Assignee: Alejandro Abdelnur
>         Attachments: HADOOP-7624.patch
>
>
> See this thread: http://markmail.org/thread/cxtz3i6lvztfgfxn
> We need to get things up and running for a top level hadoop-tools module. DistCpV2 will be the first resident of this new home. Things we need:
>  - The module itself and a top level pom with appropriate dependencies
>  - Integration with the patch builds for the new module
>  - Integration with the post-commit and nightly builds for the new module.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-7624) Set things up for a top level hadoop-tools module

Posted by "Vinod Kumar Vavilapalli (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-7624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13107419#comment-13107419 ] 

Vinod Kumar Vavilapalli commented on HADOOP-7624:
-------------------------------------------------

Thanks Allen. I do agree that we as a community should be prudent enough to not let the history repeat itself.

Tucu, we also need to fix test-patch so that Jenkins can accept patches to the tools module. I originally included that too as part of this ticket. Do you wish to take that up also? Basically, test-patch.sh needs some tinkering to recognize hadoop-tools-project along-side common/mapreduce/hdfs. It also needs changes to compile and run tests in hadoop-tools_projects on patch submission.

> Set things up for a top level hadoop-tools module
> -------------------------------------------------
>
>                 Key: HADOOP-7624
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7624
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: build
>            Reporter: Vinod Kumar Vavilapalli
>            Assignee: Alejandro Abdelnur
>         Attachments: HADOOP-7624.patch
>
>
> See this thread: http://markmail.org/thread/cxtz3i6lvztfgfxn
> We need to get things up and running for a top level hadoop-tools module. DistCpV2 will be the first resident of this new home. Things we need:
>  - The module itself and a top level pom with appropriate dependencies
>  - Integration with the patch builds for the new module
>  - Integration with the post-commit and nightly builds for the new module.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HADOOP-7624) Set things up for a top level hadoop-tools module

Posted by "Eli Collins (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-7624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Eli Collins updated HADOOP-7624:
--------------------------------

    Affects Version/s: 0.23.0
        Fix Version/s: 0.23.0
    
> Set things up for a top level hadoop-tools module
> -------------------------------------------------
>
>                 Key: HADOOP-7624
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7624
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: build
>    Affects Versions: 0.23.0
>            Reporter: Vinod Kumar Vavilapalli
>            Assignee: Alejandro Abdelnur
>             Fix For: 0.23.0
>
>         Attachments: HADOOP-7624.patch
>
>
> See this thread: http://markmail.org/thread/cxtz3i6lvztfgfxn
> We need to get things up and running for a top level hadoop-tools module. DistCpV2 will be the first resident of this new home. Things we need:
>  - The module itself and a top level pom with appropriate dependencies
>  - Integration with the patch builds for the new module
>  - Integration with the post-commit and nightly builds for the new module.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-7624) Set things up for a top level hadoop-tools module

Posted by "Alejandro Abdelnur (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-7624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13122465#comment-13122465 ] 

Alejandro Abdelnur commented on HADOOP-7624:
--------------------------------------------

committed to trunk, in a few days it will be committed to 0.23 in a combo with other maven related patches.
                
> Set things up for a top level hadoop-tools module
> -------------------------------------------------
>
>                 Key: HADOOP-7624
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7624
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: build
>            Reporter: Vinod Kumar Vavilapalli
>            Assignee: Alejandro Abdelnur
>         Attachments: HADOOP-7624.patch
>
>
> See this thread: http://markmail.org/thread/cxtz3i6lvztfgfxn
> We need to get things up and running for a top level hadoop-tools module. DistCpV2 will be the first resident of this new home. Things we need:
>  - The module itself and a top level pom with appropriate dependencies
>  - Integration with the patch builds for the new module
>  - Integration with the post-commit and nightly builds for the new module.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-7624) Set things up for a top level hadoop-tools module

Posted by "Allen Wittenauer (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-7624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13103834#comment-13103834 ] 

Allen Wittenauer commented on HADOOP-7624:
------------------------------------------

I see a handful of choices:

a) rename contrib to tools and quit lying to ourselves that putting random stuff in a different directory makes them special

b) integrate these components directly into the mapreduce jar

c) make a new Hadoop sub project to hold these random things

d) just keep these components in contrib

e) make tools separate from contrib, but actually put some rules and process around what goes in there so that we don't end up with the same mess we had before

I basically don't want to see a repeat of history. If we don't do this now, in a year or three we're going to be back to "we need to prune contrib^H^H^H^H^H^H^Htools of all this abandoned source".

If these things are important, just integrate them directly into the mainline jars and be done with it.

> Set things up for a top level hadoop-tools module
> -------------------------------------------------
>
>                 Key: HADOOP-7624
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7624
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: build
>            Reporter: Vinod Kumar Vavilapalli
>            Assignee: Alejandro Abdelnur
>         Attachments: HADOOP-7624.patch
>
>
> See this thread: http://markmail.org/thread/cxtz3i6lvztfgfxn
> We need to get things up and running for a top level hadoop-tools module. DistCpV2 will be the first resident of this new home. Things we need:
>  - The module itself and a top level pom with appropriate dependencies
>  - Integration with the patch builds for the new module
>  - Integration with the post-commit and nightly builds for the new module.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HADOOP-7624) Set things up for a top level hadoop-tools module

Posted by "Alejandro Abdelnur (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-7624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Alejandro Abdelnur updated HADOOP-7624:
---------------------------------------

      Resolution: Fixed
    Hadoop Flags: Reviewed
          Status: Resolved  (was: Patch Available)
    
> Set things up for a top level hadoop-tools module
> -------------------------------------------------
>
>                 Key: HADOOP-7624
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7624
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: build
>            Reporter: Vinod Kumar Vavilapalli
>            Assignee: Alejandro Abdelnur
>         Attachments: HADOOP-7624.patch
>
>
> See this thread: http://markmail.org/thread/cxtz3i6lvztfgfxn
> We need to get things up and running for a top level hadoop-tools module. DistCpV2 will be the first resident of this new home. Things we need:
>  - The module itself and a top level pom with appropriate dependencies
>  - Integration with the patch builds for the new module
>  - Integration with the post-commit and nightly builds for the new module.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-7624) Set things up for a top level hadoop-tools module

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-7624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13122463#comment-13122463 ] 

Hudson commented on HADOOP-7624:
--------------------------------

Integrated in Hadoop-Hdfs-trunk-Commit #1106 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/1106/])
    HADOOP-7624. Set things up for a top level hadoop-tools module. (tucu)

tucu : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1179912
Files : 
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
* /hadoop/common/trunk/hadoop-tools
* /hadoop/common/trunk/hadoop-tools/pom.xml
* /hadoop/common/trunk/pom.xml

                
> Set things up for a top level hadoop-tools module
> -------------------------------------------------
>
>                 Key: HADOOP-7624
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7624
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: build
>            Reporter: Vinod Kumar Vavilapalli
>            Assignee: Alejandro Abdelnur
>         Attachments: HADOOP-7624.patch
>
>
> See this thread: http://markmail.org/thread/cxtz3i6lvztfgfxn
> We need to get things up and running for a top level hadoop-tools module. DistCpV2 will be the first resident of this new home. Things we need:
>  - The module itself and a top level pom with appropriate dependencies
>  - Integration with the patch builds for the new module
>  - Integration with the post-commit and nightly builds for the new module.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-7624) Set things up for a top level hadoop-tools module

Posted by "Alejandro Abdelnur (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-7624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13102942#comment-13102942 ] 

Alejandro Abdelnur commented on HADOOP-7624:
--------------------------------------------

@Allen, if you read properly my previous comment, I'm not saying 'we are going to create this anyway', I'm using a conditional tense 'we could move'. This means that the action of moving forward is conditional and subject to the opinion of the Hadoop developers community. Given that no objection has been raised against distcpV2 being part of Hadoop, we *could* move forward with it, while the general rules are being defined for adding other components. Cheers.


> Set things up for a top level hadoop-tools module
> -------------------------------------------------
>
>                 Key: HADOOP-7624
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7624
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: build
>            Reporter: Vinod Kumar Vavilapalli
>
> See this thread: http://markmail.org/thread/cxtz3i6lvztfgfxn
> We need to get things up and running for a top level hadoop-tools module. DistCpV2 will be the first resident of this new home. Things we need:
>  - The module itself and a top level pom with appropriate dependencies
>  - Integration with the patch builds for the new module
>  - Integration with the post-commit and nightly builds for the new module.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-7624) Set things up for a top level hadoop-tools module

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-7624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13122724#comment-13122724 ] 

Hudson commented on HADOOP-7624:
--------------------------------

Integrated in Hadoop-Hdfs-trunk #823 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk/823/])
    HADOOP-7624. Set things up for a top level hadoop-tools module. (tucu)

tucu : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1179912
Files : 
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
* /hadoop/common/trunk/hadoop-tools
* /hadoop/common/trunk/hadoop-tools/pom.xml
* /hadoop/common/trunk/pom.xml

                
> Set things up for a top level hadoop-tools module
> -------------------------------------------------
>
>                 Key: HADOOP-7624
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7624
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: build
>            Reporter: Vinod Kumar Vavilapalli
>            Assignee: Alejandro Abdelnur
>         Attachments: HADOOP-7624.patch
>
>
> See this thread: http://markmail.org/thread/cxtz3i6lvztfgfxn
> We need to get things up and running for a top level hadoop-tools module. DistCpV2 will be the first resident of this new home. Things we need:
>  - The module itself and a top level pom with appropriate dependencies
>  - Integration with the patch builds for the new module
>  - Integration with the post-commit and nightly builds for the new module.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-7624) Set things up for a top level hadoop-tools module

Posted by "Alejandro Abdelnur (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-7624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13103022#comment-13103022 ] 

Alejandro Abdelnur commented on HADOOP-7624:
--------------------------------------------

typo, I've meant 'What would be the rules you propose?'

> Set things up for a top level hadoop-tools module
> -------------------------------------------------
>
>                 Key: HADOOP-7624
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7624
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: build
>            Reporter: Vinod Kumar Vavilapalli
>
> See this thread: http://markmail.org/thread/cxtz3i6lvztfgfxn
> We need to get things up and running for a top level hadoop-tools module. DistCpV2 will be the first resident of this new home. Things we need:
>  - The module itself and a top level pom with appropriate dependencies
>  - Integration with the patch builds for the new module
>  - Integration with the post-commit and nightly builds for the new module.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-7624) Set things up for a top level hadoop-tools module

Posted by "Mahadev konar (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-7624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13122470#comment-13122470 ] 

Mahadev konar commented on HADOOP-7624:
---------------------------------------

nice! good to get it stabilized on trunk before merging to 0.23.
                
> Set things up for a top level hadoop-tools module
> -------------------------------------------------
>
>                 Key: HADOOP-7624
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7624
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: build
>            Reporter: Vinod Kumar Vavilapalli
>            Assignee: Alejandro Abdelnur
>         Attachments: HADOOP-7624.patch
>
>
> See this thread: http://markmail.org/thread/cxtz3i6lvztfgfxn
> We need to get things up and running for a top level hadoop-tools module. DistCpV2 will be the first resident of this new home. Things we need:
>  - The module itself and a top level pom with appropriate dependencies
>  - Integration with the patch builds for the new module
>  - Integration with the post-commit and nightly builds for the new module.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-7624) Set things up for a top level hadoop-tools module

Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-7624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13103179#comment-13103179 ] 

Hadoop QA commented on HADOOP-7624:
-----------------------------------

-1 overall.  Here are the results of testing the latest attachment 
  http://issues.apache.org/jira/secure/attachment/12494147/HADOOP-7624.patch
  against trunk revision .

    +1 @author.  The patch does not contain any @author tags.

    -1 tests included.  The patch doesn't appear to include any new or modified tests.
                        Please justify why no new tests are needed for this patch.
                        Also please list what manual steps were performed to verify this patch.

    -1 patch.  The patch command could not apply the patch.

Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/167//console

This message is automatically generated.

> Set things up for a top level hadoop-tools module
> -------------------------------------------------
>
>                 Key: HADOOP-7624
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7624
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: build
>            Reporter: Vinod Kumar Vavilapalli
>            Assignee: Alejandro Abdelnur
>         Attachments: HADOOP-7624.patch
>
>
> See this thread: http://markmail.org/thread/cxtz3i6lvztfgfxn
> We need to get things up and running for a top level hadoop-tools module. DistCpV2 will be the first resident of this new home. Things we need:
>  - The module itself and a top level pom with appropriate dependencies
>  - Integration with the patch builds for the new module
>  - Integration with the post-commit and nightly builds for the new module.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-7624) Set things up for a top level hadoop-tools module

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-7624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13139295#comment-13139295 ] 

Hudson commented on HADOOP-7624:
--------------------------------

Integrated in Hadoop-Mapreduce-0.23-Build #72 (See [https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Build/72/])
    Merge -r 1179911:1179912 from trunk to branch. FIXES: HADOOP-7624

tucu : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1190581
Files : 
* /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-tools
* /hadoop/common/branches/branch-0.23/hadoop-tools/pom.xml
* /hadoop/common/branches/branch-0.23/pom.xml

                
> Set things up for a top level hadoop-tools module
> -------------------------------------------------
>
>                 Key: HADOOP-7624
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7624
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: build
>            Reporter: Vinod Kumar Vavilapalli
>            Assignee: Alejandro Abdelnur
>         Attachments: HADOOP-7624.patch
>
>
> See this thread: http://markmail.org/thread/cxtz3i6lvztfgfxn
> We need to get things up and running for a top level hadoop-tools module. DistCpV2 will be the first resident of this new home. Things we need:
>  - The module itself and a top level pom with appropriate dependencies
>  - Integration with the patch builds for the new module
>  - Integration with the post-commit and nightly builds for the new module.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-7624) Set things up for a top level hadoop-tools module

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-7624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13122473#comment-13122473 ] 

Hudson commented on HADOOP-7624:
--------------------------------

Integrated in Hadoop-Mapreduce-trunk-Commit #1046 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/1046/])
    HADOOP-7624. Set things up for a top level hadoop-tools module. (tucu)

tucu : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1179912
Files : 
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
* /hadoop/common/trunk/hadoop-tools
* /hadoop/common/trunk/hadoop-tools/pom.xml
* /hadoop/common/trunk/pom.xml

                
> Set things up for a top level hadoop-tools module
> -------------------------------------------------
>
>                 Key: HADOOP-7624
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7624
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: build
>            Reporter: Vinod Kumar Vavilapalli
>            Assignee: Alejandro Abdelnur
>         Attachments: HADOOP-7624.patch
>
>
> See this thread: http://markmail.org/thread/cxtz3i6lvztfgfxn
> We need to get things up and running for a top level hadoop-tools module. DistCpV2 will be the first resident of this new home. Things we need:
>  - The module itself and a top level pom with appropriate dependencies
>  - Integration with the patch builds for the new module
>  - Integration with the post-commit and nightly builds for the new module.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-7624) Set things up for a top level hadoop-tools module

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-7624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13138770#comment-13138770 ] 

Hudson commented on HADOOP-7624:
--------------------------------

Integrated in Hadoop-Common-0.23-Commit #99 (See [https://builds.apache.org/job/Hadoop-Common-0.23-Commit/99/])
    Merge -r 1179911:1179912 from trunk to branch. FIXES: HADOOP-7624

tucu : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1190581
Files : 
* /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-tools
* /hadoop/common/branches/branch-0.23/hadoop-tools/pom.xml
* /hadoop/common/branches/branch-0.23/pom.xml

                
> Set things up for a top level hadoop-tools module
> -------------------------------------------------
>
>                 Key: HADOOP-7624
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7624
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: build
>            Reporter: Vinod Kumar Vavilapalli
>            Assignee: Alejandro Abdelnur
>         Attachments: HADOOP-7624.patch
>
>
> See this thread: http://markmail.org/thread/cxtz3i6lvztfgfxn
> We need to get things up and running for a top level hadoop-tools module. DistCpV2 will be the first resident of this new home. Things we need:
>  - The module itself and a top level pom with appropriate dependencies
>  - Integration with the patch builds for the new module
>  - Integration with the post-commit and nightly builds for the new module.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HADOOP-7624) Set things up for a top level hadoop-tools module

Posted by "Alejandro Abdelnur (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-7624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Alejandro Abdelnur updated HADOOP-7624:
---------------------------------------

    Issue Type: Improvement  (was: Bug)
    
> Set things up for a top level hadoop-tools module
> -------------------------------------------------
>
>                 Key: HADOOP-7624
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7624
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: build
>            Reporter: Vinod Kumar Vavilapalli
>            Assignee: Alejandro Abdelnur
>         Attachments: HADOOP-7624.patch
>
>
> See this thread: http://markmail.org/thread/cxtz3i6lvztfgfxn
> We need to get things up and running for a top level hadoop-tools module. DistCpV2 will be the first resident of this new home. Things we need:
>  - The module itself and a top level pom with appropriate dependencies
>  - Integration with the patch builds for the new module
>  - Integration with the post-commit and nightly builds for the new module.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-7624) Set things up for a top level hadoop-tools module

Posted by "Allen Wittenauer (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-7624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13107297#comment-13107297 ] 

Allen Wittenauer commented on HADOOP-7624:
------------------------------------------

I'm removing my -1.  Commit away.

> Set things up for a top level hadoop-tools module
> -------------------------------------------------
>
>                 Key: HADOOP-7624
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7624
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: build
>            Reporter: Vinod Kumar Vavilapalli
>            Assignee: Alejandro Abdelnur
>         Attachments: HADOOP-7624.patch
>
>
> See this thread: http://markmail.org/thread/cxtz3i6lvztfgfxn
> We need to get things up and running for a top level hadoop-tools module. DistCpV2 will be the first resident of this new home. Things we need:
>  - The module itself and a top level pom with appropriate dependencies
>  - Integration with the patch builds for the new module
>  - Integration with the post-commit and nightly builds for the new module.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-7624) Set things up for a top level hadoop-tools module

Posted by "Allen Wittenauer (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-7624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13102921#comment-13102921 ] 

Allen Wittenauer commented on HADOOP-7624:
------------------------------------------

It is not acceptable to say "we're going to create this anyway and deal with the consequences later".

> Set things up for a top level hadoop-tools module
> -------------------------------------------------
>
>                 Key: HADOOP-7624
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7624
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: build
>            Reporter: Vinod Kumar Vavilapalli
>
> See this thread: http://markmail.org/thread/cxtz3i6lvztfgfxn
> We need to get things up and running for a top level hadoop-tools module. DistCpV2 will be the first resident of this new home. Things we need:
>  - The module itself and a top level pom with appropriate dependencies
>  - Integration with the patch builds for the new module
>  - Integration with the post-commit and nightly builds for the new module.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-7624) Set things up for a top level hadoop-tools module

Posted by "Allen Wittenauer (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-7624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13102963#comment-13102963 ] 

Allen Wittenauer commented on HADOOP-7624:
------------------------------------------

This JIRA was set up under the pretense of creating the hadoop-tools space.  Even the summary statement says: "Set things up for a top level hadoop-tools module".  It seems logical to me that this is the space where this discussion needs to happen.  

> Set things up for a top level hadoop-tools module
> -------------------------------------------------
>
>                 Key: HADOOP-7624
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7624
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: build
>            Reporter: Vinod Kumar Vavilapalli
>
> See this thread: http://markmail.org/thread/cxtz3i6lvztfgfxn
> We need to get things up and running for a top level hadoop-tools module. DistCpV2 will be the first resident of this new home. Things we need:
>  - The module itself and a top level pom with appropriate dependencies
>  - Integration with the patch builds for the new module
>  - Integration with the post-commit and nightly builds for the new module.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-7624) Set things up for a top level hadoop-tools module

Posted by "Aaron T. Myers (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-7624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13122378#comment-13122378 ] 

Aaron T. Myers commented on HADOOP-7624:
----------------------------------------

+1, the patch looks good to me.

bq. Work on test-patch.sh still pending, should we do a different JIRA?

That seems fine to me. Please file one and link it to this JIRA.
                
> Set things up for a top level hadoop-tools module
> -------------------------------------------------
>
>                 Key: HADOOP-7624
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7624
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: build
>            Reporter: Vinod Kumar Vavilapalli
>            Assignee: Alejandro Abdelnur
>         Attachments: HADOOP-7624.patch
>
>
> See this thread: http://markmail.org/thread/cxtz3i6lvztfgfxn
> We need to get things up and running for a top level hadoop-tools module. DistCpV2 will be the first resident of this new home. Things we need:
>  - The module itself and a top level pom with appropriate dependencies
>  - Integration with the patch builds for the new module
>  - Integration with the post-commit and nightly builds for the new module.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-7624) Set things up for a top level hadoop-tools module

Posted by "Alejandro Abdelnur (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-7624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13122219#comment-13122219 ] 

Alejandro Abdelnur commented on HADOOP-7624:
--------------------------------------------

patch still applies cleanly.

work on test-patch.sh still pending, should we do a different JIRA?
                
> Set things up for a top level hadoop-tools module
> -------------------------------------------------
>
>                 Key: HADOOP-7624
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7624
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: build
>            Reporter: Vinod Kumar Vavilapalli
>            Assignee: Alejandro Abdelnur
>         Attachments: HADOOP-7624.patch
>
>
> See this thread: http://markmail.org/thread/cxtz3i6lvztfgfxn
> We need to get things up and running for a top level hadoop-tools module. DistCpV2 will be the first resident of this new home. Things we need:
>  - The module itself and a top level pom with appropriate dependencies
>  - Integration with the patch builds for the new module
>  - Integration with the post-commit and nightly builds for the new module.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HADOOP-7624) Set things up for a top level hadoop-tools module

Posted by "Alejandro Abdelnur (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-7624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Alejandro Abdelnur updated HADOOP-7624:
---------------------------------------

    Assignee: Alejandro Abdelnur
      Status: Patch Available  (was: Open)

> Set things up for a top level hadoop-tools module
> -------------------------------------------------
>
>                 Key: HADOOP-7624
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7624
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: build
>            Reporter: Vinod Kumar Vavilapalli
>            Assignee: Alejandro Abdelnur
>         Attachments: HADOOP-7624.patch
>
>
> See this thread: http://markmail.org/thread/cxtz3i6lvztfgfxn
> We need to get things up and running for a top level hadoop-tools module. DistCpV2 will be the first resident of this new home. Things we need:
>  - The module itself and a top level pom with appropriate dependencies
>  - Integration with the patch builds for the new module
>  - Integration with the post-commit and nightly builds for the new module.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-7624) Set things up for a top level hadoop-tools module

Posted by "Alejandro Abdelnur (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-7624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13103009#comment-13103009 ] 

Alejandro Abdelnur commented on HADOOP-7624:
--------------------------------------------

The JIRA was setup after consensus in the alias for trunk/hadoop-tools module. You are proposing defining the rules for acceptance of components, fair enough. What would to be the rules you propose?

> Set things up for a top level hadoop-tools module
> -------------------------------------------------
>
>                 Key: HADOOP-7624
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7624
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: build
>            Reporter: Vinod Kumar Vavilapalli
>
> See this thread: http://markmail.org/thread/cxtz3i6lvztfgfxn
> We need to get things up and running for a top level hadoop-tools module. DistCpV2 will be the first resident of this new home. Things we need:
>  - The module itself and a top level pom with appropriate dependencies
>  - Integration with the patch builds for the new module
>  - Integration with the post-commit and nightly builds for the new module.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-7624) Set things up for a top level hadoop-tools module

Posted by "Doug Cutting (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-7624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13103930#comment-13103930 ] 

Doug Cutting commented on HADOOP-7624:
--------------------------------------

Allen, are all of these choices equally acceptable to you?  If not, what is your preferred choice?

Some questions about each of these choices:

a. Are you proposing that things that are currently in various contrib directories move to the hadoop-tools module created by this proposal?  If so, those sound like good follow-on issues to file.

b. Where specifically in the current tree would you prefer we place the new distcp code (MAPREDUCE-2765)? In hadoop-mapreduce-project/src/tools, beside the old distcp?

c. Will you propose and drive a new subproject?  Would the release cycle be separate from Hadoop?

d. Distcp is not currently in contrib.  Would you prefer that the new version be committed in hadoop-mapreduce-project/src/contrib?

e. I think that's what's proposed here.  The 'rules and process' are not currently formalized.  Rather it was agreed that we should be more cautious than before about accepting things and that we be more aggressive about booting things when they're abandoned and/or stop passing tests.  If you'd like to formalize this and build consensus around some rules and process that'd be great.  Should we block the commit of MAPREDUCE-2765 on that?


> Set things up for a top level hadoop-tools module
> -------------------------------------------------
>
>                 Key: HADOOP-7624
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7624
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: build
>            Reporter: Vinod Kumar Vavilapalli
>            Assignee: Alejandro Abdelnur
>         Attachments: HADOOP-7624.patch
>
>
> See this thread: http://markmail.org/thread/cxtz3i6lvztfgfxn
> We need to get things up and running for a top level hadoop-tools module. DistCpV2 will be the first resident of this new home. Things we need:
>  - The module itself and a top level pom with appropriate dependencies
>  - Integration with the patch builds for the new module
>  - Integration with the post-commit and nightly builds for the new module.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-7624) Set things up for a top level hadoop-tools module

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-7624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13122781#comment-13122781 ] 

Hudson commented on HADOOP-7624:
--------------------------------

Integrated in Hadoop-Mapreduce-trunk #853 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk/853/])
    HADOOP-7624. Set things up for a top level hadoop-tools module. (tucu)

tucu : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1179912
Files : 
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
* /hadoop/common/trunk/hadoop-tools
* /hadoop/common/trunk/hadoop-tools/pom.xml
* /hadoop/common/trunk/pom.xml

                
> Set things up for a top level hadoop-tools module
> -------------------------------------------------
>
>                 Key: HADOOP-7624
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7624
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: build
>            Reporter: Vinod Kumar Vavilapalli
>            Assignee: Alejandro Abdelnur
>         Attachments: HADOOP-7624.patch
>
>
> See this thread: http://markmail.org/thread/cxtz3i6lvztfgfxn
> We need to get things up and running for a top level hadoop-tools module. DistCpV2 will be the first resident of this new home. Things we need:
>  - The module itself and a top level pom with appropriate dependencies
>  - Integration with the patch builds for the new module
>  - Integration with the post-commit and nightly builds for the new module.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-7624) Set things up for a top level hadoop-tools module

Posted by "Allen Wittenauer (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-7624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13102835#comment-13102835 ] 

Allen Wittenauer commented on HADOOP-7624:
------------------------------------------

We need a rule set of what goes into tools so that we don't create contrib v2.  Until that, I'm very much -1 on this.

> Set things up for a top level hadoop-tools module
> -------------------------------------------------
>
>                 Key: HADOOP-7624
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7624
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: build
>            Reporter: Vinod Kumar Vavilapalli
>
> See this thread: http://markmail.org/thread/cxtz3i6lvztfgfxn
> We need to get things up and running for a top level hadoop-tools module. DistCpV2 will be the first resident of this new home. Things we need:
>  - The module itself and a top level pom with appropriate dependencies
>  - Integration with the patch builds for the new module
>  - Integration with the post-commit and nightly builds for the new module.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-7624) Set things up for a top level hadoop-tools module

Posted by "Alejandro Abdelnur (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-7624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13102847#comment-13102847 ] 

Alejandro Abdelnur commented on HADOOP-7624:
--------------------------------------------

Allen, 

I fully agree we need to have clear rules to decide what goes in in here to avoid a contrib v2 situation.

I have not seen any objection to have distcpV2 (and streaming) in hadoop-tools.

Thus there is no contention here. Because of this I think we could move forward with hadoop-tools for distcpV2 (and streaming) and open a JIRA to define the acceptance process for components under hadoop-tools. Given that you seem to have a vested interest in this, would you please follow up with the corresponding JIRA.

Thanks.


> Set things up for a top level hadoop-tools module
> -------------------------------------------------
>
>                 Key: HADOOP-7624
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7624
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: build
>            Reporter: Vinod Kumar Vavilapalli
>
> See this thread: http://markmail.org/thread/cxtz3i6lvztfgfxn
> We need to get things up and running for a top level hadoop-tools module. DistCpV2 will be the first resident of this new home. Things we need:
>  - The module itself and a top level pom with appropriate dependencies
>  - Integration with the patch builds for the new module
>  - Integration with the post-commit and nightly builds for the new module.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-7624) Set things up for a top level hadoop-tools module

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-7624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13138777#comment-13138777 ] 

Hudson commented on HADOOP-7624:
--------------------------------

Integrated in Hadoop-Hdfs-0.23-Commit #99 (See [https://builds.apache.org/job/Hadoop-Hdfs-0.23-Commit/99/])
    Merge -r 1179911:1179912 from trunk to branch. FIXES: HADOOP-7624

tucu : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1190581
Files : 
* /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-tools
* /hadoop/common/branches/branch-0.23/hadoop-tools/pom.xml
* /hadoop/common/branches/branch-0.23/pom.xml

                
> Set things up for a top level hadoop-tools module
> -------------------------------------------------
>
>                 Key: HADOOP-7624
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7624
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: build
>            Reporter: Vinod Kumar Vavilapalli
>            Assignee: Alejandro Abdelnur
>         Attachments: HADOOP-7624.patch
>
>
> See this thread: http://markmail.org/thread/cxtz3i6lvztfgfxn
> We need to get things up and running for a top level hadoop-tools module. DistCpV2 will be the first resident of this new home. Things we need:
>  - The module itself and a top level pom with appropriate dependencies
>  - Integration with the patch builds for the new module
>  - Integration with the post-commit and nightly builds for the new module.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira