You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Eric Yang (Created) (JIRA)" <ji...@apache.org> on 2011/11/07 18:20:51 UTC
[jira] [Created] (MAPREDUCE-3367) Consolidate MRv2 maven modules
Consolidate MRv2 maven modules
------------------------------
Key: MAPREDUCE-3367
URL: https://issues.apache.org/jira/browse/MAPREDUCE-3367
Project: Hadoop Map/Reduce
Issue Type: Improvement
Components: build, mrv2
Affects Versions: 0.23.0
Environment: Java, Maven
Reporter: Eric Yang
Assignee: Eric Yang
Maven modules for MRv2 has been splitter into many small pieces, like this:
{noformat}
[INFO] hadoop-yarn ....................................... SUCCESS [0.312s]
[INFO] hadoop-yarn-api ................................... SUCCESS [24.184s]
[INFO] hadoop-yarn-common ................................ SUCCESS [18.243s]
[INFO] hadoop-yarn-server ................................ SUCCESS [0.094s]
[INFO] hadoop-yarn-server-common ......................... SUCCESS [5.394s]
[INFO] hadoop-yarn-server-nodemanager .................... SUCCESS [7.056s]
[INFO] hadoop-yarn-server-web-proxy ...................... SUCCESS [2.295s]
[INFO] hadoop-yarn-server-resourcemanager ................ SUCCESS [10.217s]
[INFO] hadoop-yarn-server-tests .......................... SUCCESS [0.395s]
[INFO] hadoop-yarn-applications .......................... SUCCESS [0.069s]
[INFO] hadoop-yarn-applications-distributedshell ......... SUCCESS [2.534s]
[INFO] hadoop-yarn-site .................................. SUCCESS [0.144s]
[INFO] hadoop-mapreduce-client ........................... SUCCESS [0.073s]
[INFO] hadoop-mapreduce-client-core ...................... SUCCESS [13.727s]
[INFO] hadoop-mapreduce-client-common .................... SUCCESS [13.045s]
[INFO] hadoop-mapreduce-client-shuffle ................... SUCCESS [1.909s]
[INFO] hadoop-mapreduce-client-app ....................... SUCCESS [6.676s]
[INFO] hadoop-mapreduce-client-hs ........................ SUCCESS [3.317s]
[INFO] hadoop-mapreduce-client-jobclient ................. SUCCESS [2.575s]
[INFO] hadoop-mapreduce .................................. SUCCESS [4.952s]
{noformat}
The excessive use of directory structure is slowing down development and compile time. For example, hadoop-yarn-server-tests and hadoop-yarn-site should not be stand alone modules. There are better ways to organize the source code. The proposal is to rearrange the code to:
{noformat}
Apache Hadoop Mapreduce Project
- Apache Hadoop Mapreduce Client
- Apache Hadoop YARN
{noformat}
This is a nice to have for 0.23, but optional.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (MAPREDUCE-3367) Consolidate MRv2 maven modules
Posted by "Eric Yang (Resolved) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Eric Yang resolved MAPREDUCE-3367.
----------------------------------
Resolution: Duplicate
This is a duplicate issue of MAPREDUCE-2600.
> Consolidate MRv2 maven modules
> ------------------------------
>
> Key: MAPREDUCE-3367
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3367
> Project: Hadoop Map/Reduce
> Issue Type: Improvement
> Components: build, mrv2
> Affects Versions: 0.23.0
> Environment: Java, Maven
> Reporter: Eric Yang
> Assignee: Eric Yang
>
> Maven modules for MRv2 has been splitter into many small pieces, like this:
> {noformat}
> [INFO] hadoop-yarn ....................................... SUCCESS [0.312s]
> [INFO] hadoop-yarn-api ................................... SUCCESS [24.184s]
> [INFO] hadoop-yarn-common ................................ SUCCESS [18.243s]
> [INFO] hadoop-yarn-server ................................ SUCCESS [0.094s]
> [INFO] hadoop-yarn-server-common ......................... SUCCESS [5.394s]
> [INFO] hadoop-yarn-server-nodemanager .................... SUCCESS [7.056s]
> [INFO] hadoop-yarn-server-web-proxy ...................... SUCCESS [2.295s]
> [INFO] hadoop-yarn-server-resourcemanager ................ SUCCESS [10.217s]
> [INFO] hadoop-yarn-server-tests .......................... SUCCESS [0.395s]
> [INFO] hadoop-yarn-applications .......................... SUCCESS [0.069s]
> [INFO] hadoop-yarn-applications-distributedshell ......... SUCCESS [2.534s]
> [INFO] hadoop-yarn-site .................................. SUCCESS [0.144s]
> [INFO] hadoop-mapreduce-client ........................... SUCCESS [0.073s]
> [INFO] hadoop-mapreduce-client-core ...................... SUCCESS [13.727s]
> [INFO] hadoop-mapreduce-client-common .................... SUCCESS [13.045s]
> [INFO] hadoop-mapreduce-client-shuffle ................... SUCCESS [1.909s]
> [INFO] hadoop-mapreduce-client-app ....................... SUCCESS [6.676s]
> [INFO] hadoop-mapreduce-client-hs ........................ SUCCESS [3.317s]
> [INFO] hadoop-mapreduce-client-jobclient ................. SUCCESS [2.575s]
> [INFO] hadoop-mapreduce .................................. SUCCESS [4.952s]
> {noformat}
> The excessive use of directory structure is slowing down development and compile time. For example, hadoop-yarn-server-tests and hadoop-yarn-site should not be stand alone modules. There are better ways to organize the source code. The proposal is to rearrange the code to:
> {noformat}
> Apache Hadoop Mapreduce Project
> - Apache Hadoop Mapreduce Client
> - Apache Hadoop YARN
> {noformat}
> This is a nice to have for 0.23, but optional.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3367) Consolidate MRv2 maven modules
Posted by "Robert Joseph Evans (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13145634#comment-13145634 ]
Robert Joseph Evans commented on MAPREDUCE-3367:
------------------------------------------------
You might want to look at MAPREDUCE-2600. There was a lot of discussion on this already.
> Consolidate MRv2 maven modules
> ------------------------------
>
> Key: MAPREDUCE-3367
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3367
> Project: Hadoop Map/Reduce
> Issue Type: Improvement
> Components: build, mrv2
> Affects Versions: 0.23.0
> Environment: Java, Maven
> Reporter: Eric Yang
> Assignee: Eric Yang
>
> Maven modules for MRv2 has been splitter into many small pieces, like this:
> {noformat}
> [INFO] hadoop-yarn ....................................... SUCCESS [0.312s]
> [INFO] hadoop-yarn-api ................................... SUCCESS [24.184s]
> [INFO] hadoop-yarn-common ................................ SUCCESS [18.243s]
> [INFO] hadoop-yarn-server ................................ SUCCESS [0.094s]
> [INFO] hadoop-yarn-server-common ......................... SUCCESS [5.394s]
> [INFO] hadoop-yarn-server-nodemanager .................... SUCCESS [7.056s]
> [INFO] hadoop-yarn-server-web-proxy ...................... SUCCESS [2.295s]
> [INFO] hadoop-yarn-server-resourcemanager ................ SUCCESS [10.217s]
> [INFO] hadoop-yarn-server-tests .......................... SUCCESS [0.395s]
> [INFO] hadoop-yarn-applications .......................... SUCCESS [0.069s]
> [INFO] hadoop-yarn-applications-distributedshell ......... SUCCESS [2.534s]
> [INFO] hadoop-yarn-site .................................. SUCCESS [0.144s]
> [INFO] hadoop-mapreduce-client ........................... SUCCESS [0.073s]
> [INFO] hadoop-mapreduce-client-core ...................... SUCCESS [13.727s]
> [INFO] hadoop-mapreduce-client-common .................... SUCCESS [13.045s]
> [INFO] hadoop-mapreduce-client-shuffle ................... SUCCESS [1.909s]
> [INFO] hadoop-mapreduce-client-app ....................... SUCCESS [6.676s]
> [INFO] hadoop-mapreduce-client-hs ........................ SUCCESS [3.317s]
> [INFO] hadoop-mapreduce-client-jobclient ................. SUCCESS [2.575s]
> [INFO] hadoop-mapreduce .................................. SUCCESS [4.952s]
> {noformat}
> The excessive use of directory structure is slowing down development and compile time. For example, hadoop-yarn-server-tests and hadoop-yarn-site should not be stand alone modules. There are better ways to organize the source code. The proposal is to rearrange the code to:
> {noformat}
> Apache Hadoop Mapreduce Project
> - Apache Hadoop Mapreduce Client
> - Apache Hadoop YARN
> {noformat}
> This is a nice to have for 0.23, but optional.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira