You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Eric Yang (Created) (JIRA)" <ji...@apache.org> on 2011/11/07 18:00:53 UTC
[jira] [Created] (MAPREDUCE-3366) Mapreduce component should use
consistent directory structure layout as HDFS/common
Mapreduce component should use consistent directory structure layout as HDFS/common
-----------------------------------------------------------------------------------
Key: MAPREDUCE-3366
URL: https://issues.apache.org/jira/browse/MAPREDUCE-3366
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: mrv2
Affects Versions: 0.23.0
Environment: Java, Maven
Reporter: Eric Yang
Assignee: Eric Yang
Directory structure for MRv2 layout looks like:
{noformat}
hadoop-mapreduce-0.23.0-SNAPSHOT/bin
/conf
/lib
/modules
{noformat}
The directory structure layout should be updated to reflect changes implemented in HADOOP-6255.
{noformat}
hadoop-mapreduce-0.23.0-SNAPSHOT/bin
/etc/hadoop
/lib
/libexec
/sbin
/share/hadoop
/share/hadoop/lib
{noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3366) Mapreduce component should use
consistent directory structure layout as HDFS/common
Posted by "Hadoop QA (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13168030#comment-13168030 ]
Hadoop QA commented on MAPREDUCE-3366:
--------------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12507108/MAPREDUCE-3366-4-trunk.patch
against trunk revision .
+1 @author. The patch does not contain any @author tags.
+1 tests included. The patch appears to include 1 new or modified tests.
-1 patch. The patch command could not apply the patch.
Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1428//console
This message is automatically generated.
> Mapreduce component should use consistent directory structure layout as HDFS/common
> -----------------------------------------------------------------------------------
>
> Key: MAPREDUCE-3366
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3366
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Environment: Java, Maven
> Reporter: Eric Yang
> Assignee: Eric Yang
> Labels: bigtop
> Attachments: MAPREDUCE-3366-1-trunk.patch, MAPREDUCE-3366-2-trunk.patch, MAPREDUCE-3366-3-trunk.patch, MAPREDUCE-3366-4-trunk.patch, MAPREDUCE-3366.patch, svn-rename-MAPREDUCE-3366-3.sh
>
>
> Directory structure for MRv2 layout looks like:
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /conf
> /lib
> /modules
> {noformat}
> The directory structure layout should be updated to reflect changes implemented in HADOOP-6255.
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /etc/hadoop
> /lib
> /libexec
> /sbin
> /share/hadoop
> /share/hadoop/lib
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3366) Mapreduce component should use
consistent directory structure layout as HDFS/common
Posted by "Hadoop QA (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13164998#comment-13164998 ]
Hadoop QA commented on MAPREDUCE-3366:
--------------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12506411/MAPREDUCE-3366-3-trunk.patch
against trunk revision .
+1 @author. The patch does not contain any @author tags.
+1 tests included. The patch appears to include 1 new or modified tests.
-1 patch. The patch command could not apply the patch.
Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1410//console
This message is automatically generated.
> Mapreduce component should use consistent directory structure layout as HDFS/common
> -----------------------------------------------------------------------------------
>
> Key: MAPREDUCE-3366
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3366
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Environment: Java, Maven
> Reporter: Eric Yang
> Assignee: Eric Yang
> Attachments: MAPREDUCE-3366-1-trunk.patch, MAPREDUCE-3366-2-trunk.patch, MAPREDUCE-3366-3-trunk.patch, MAPREDUCE-3366.patch, svn-rename-MAPREDUCE-3366-3.sh
>
>
> Directory structure for MRv2 layout looks like:
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /conf
> /lib
> /modules
> {noformat}
> The directory structure layout should be updated to reflect changes implemented in HADOOP-6255.
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /etc/hadoop
> /lib
> /libexec
> /sbin
> /share/hadoop
> /share/hadoop/lib
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3366) Mapreduce component should use
consistent directory structure layout as HDFS/common
Posted by "Eric Yang (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Eric Yang updated MAPREDUCE-3366:
---------------------------------
Attachment: MAPREDUCE-3366.patch
Map YARN directory structure to the same layout as HDFS/common.
> Mapreduce component should use consistent directory structure layout as HDFS/common
> -----------------------------------------------------------------------------------
>
> Key: MAPREDUCE-3366
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3366
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Environment: Java, Maven
> Reporter: Eric Yang
> Assignee: Eric Yang
> Attachments: MAPREDUCE-3366.patch
>
>
> Directory structure for MRv2 layout looks like:
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /conf
> /lib
> /modules
> {noformat}
> The directory structure layout should be updated to reflect changes implemented in HADOOP-6255.
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /etc/hadoop
> /lib
> /libexec
> /sbin
> /share/hadoop
> /share/hadoop/lib
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3366) Mapreduce component should use
consistent directory structure layout as HDFS/common
Posted by "Mahadev konar (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13163216#comment-13163216 ]
Mahadev konar commented on MAPREDUCE-3366:
------------------------------------------
@Eric,
Thanks will try it out to see if everything is working - secure/unsecure.
> Mapreduce component should use consistent directory structure layout as HDFS/common
> -----------------------------------------------------------------------------------
>
> Key: MAPREDUCE-3366
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3366
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Environment: Java, Maven
> Reporter: Eric Yang
> Assignee: Eric Yang
> Attachments: MAPREDUCE-3366-1-trunk.patch, MAPREDUCE-3366-2-trunk.patch, MAPREDUCE-3366.patch
>
>
> Directory structure for MRv2 layout looks like:
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /conf
> /lib
> /modules
> {noformat}
> The directory structure layout should be updated to reflect changes implemented in HADOOP-6255.
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /etc/hadoop
> /lib
> /libexec
> /sbin
> /share/hadoop
> /share/hadoop/lib
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3366) Mapreduce component should use
consistent directory structure layout as HDFS/common
Posted by "Mahadev konar (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13170012#comment-13170012 ]
Mahadev konar commented on MAPREDUCE-3366:
------------------------------------------
@Eric,
The symlink would still be needed if you were running bin/hadoop jar ... No? I dont think you can get away without creating the symlinks in that case.
> Mapreduce component should use consistent directory structure layout as HDFS/common
> -----------------------------------------------------------------------------------
>
> Key: MAPREDUCE-3366
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3366
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Environment: Java, Maven
> Reporter: Eric Yang
> Assignee: Eric Yang
> Labels: bigtop
> Attachments: MAPREDUCE-3366-1-trunk.patch, MAPREDUCE-3366-2-trunk.patch, MAPREDUCE-3366-3-trunk.patch, MAPREDUCE-3366-4-trunk.patch, MAPREDUCE-3366.patch, svn-rename-MAPREDUCE-3366-3.sh
>
>
> Directory structure for MRv2 layout looks like:
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /conf
> /lib
> /modules
> {noformat}
> The directory structure layout should be updated to reflect changes implemented in HADOOP-6255.
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /etc/hadoop
> /lib
> /libexec
> /sbin
> /share/hadoop
> /share/hadoop/lib
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3366) Mapreduce component should use
consistent directory structure layout as HDFS/common
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13170850#comment-13170850 ]
Hudson commented on MAPREDUCE-3366:
-----------------------------------
Integrated in Hadoop-Hdfs-trunk-Commit #1515 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/1515/])
MAPREDUCE-3366. Mapreduce component should use consistent directory structure layout as HDFS/common (Eric Yang via mahadev)
mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1215065
Files :
* /hadoop/common/trunk/hadoop-assemblies/src/main/resources/assemblies/hadoop-mapreduce-dist.xml
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/bin/hadoop-config.sh
* /hadoop/common/trunk/hadoop-dist/pom.xml
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/INSTALL
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/slaves.sh
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/start-all.sh
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/start-yarn.sh
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/stop-all.sh
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/stop-yarn.sh
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/yarn
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/yarn-config.sh
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/yarn-daemon.sh
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/yarn-daemons.sh
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/conf/yarn-env.sh
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/ApplicationConstants.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-site/src/site/apt/SingleCluster.apt.vm
* /hadoop/common/trunk/hadoop-mapreduce-project/pom.xml
> Mapreduce component should use consistent directory structure layout as HDFS/common
> -----------------------------------------------------------------------------------
>
> Key: MAPREDUCE-3366
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3366
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Environment: Java, Maven
> Reporter: Eric Yang
> Assignee: Eric Yang
> Labels: bigtop
> Attachments: MAPREDUCE-3366-1-trunk.patch, MAPREDUCE-3366-2-trunk.patch, MAPREDUCE-3366-3-trunk.patch, MAPREDUCE-3366-4-trunk.patch, MAPREDUCE-3366.patch, svn-rename-MAPREDUCE-3366-3.sh
>
>
> Directory structure for MRv2 layout looks like:
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /conf
> /lib
> /modules
> {noformat}
> The directory structure layout should be updated to reflect changes implemented in HADOOP-6255.
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /etc/hadoop
> /lib
> /libexec
> /sbin
> /share/hadoop
> /share/hadoop/lib
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3366) Mapreduce component should use
consistent directory structure layout as HDFS/common
Posted by "Eric Yang (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Eric Yang updated MAPREDUCE-3366:
---------------------------------
Status: Patch Available (was: Open)
> Mapreduce component should use consistent directory structure layout as HDFS/common
> -----------------------------------------------------------------------------------
>
> Key: MAPREDUCE-3366
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3366
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Environment: Java, Maven
> Reporter: Eric Yang
> Assignee: Eric Yang
> Attachments: MAPREDUCE-3366.patch
>
>
> Directory structure for MRv2 layout looks like:
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /conf
> /lib
> /modules
> {noformat}
> The directory structure layout should be updated to reflect changes implemented in HADOOP-6255.
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /etc/hadoop
> /lib
> /libexec
> /sbin
> /share/hadoop
> /share/hadoop/lib
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3366) Mapreduce component should use
consistent directory structure layout as HDFS/common
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13173659#comment-13173659 ]
Hudson commented on MAPREDUCE-3366:
-----------------------------------
Integrated in Hadoop-Common-0.23-Commit #313 (See [https://builds.apache.org/job/Hadoop-Common-0.23-Commit/313/])
MAPREDUCE-3588. Fixed bin/yarn which was broken by MAPREDUCE-3366 so that yarn daemons can start. Contributed by Arun C Murthy.
svn merge -c 1221533 --ignore-ancestry ../../trunk/
vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1221534
Files :
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/yarn
> Mapreduce component should use consistent directory structure layout as HDFS/common
> -----------------------------------------------------------------------------------
>
> Key: MAPREDUCE-3366
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3366
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Environment: Java, Maven
> Reporter: Eric Yang
> Assignee: Eric Yang
> Labels: bigtop
> Attachments: MAPREDUCE-3366-1-trunk.patch, MAPREDUCE-3366-2-trunk.patch, MAPREDUCE-3366-3-trunk.patch, MAPREDUCE-3366-4-trunk.patch, MAPREDUCE-3366.patch, svn-rename-MAPREDUCE-3366-3.sh
>
>
> Directory structure for MRv2 layout looks like:
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /conf
> /lib
> /modules
> {noformat}
> The directory structure layout should be updated to reflect changes implemented in HADOOP-6255.
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /etc/hadoop
> /lib
> /libexec
> /sbin
> /share/hadoop
> /share/hadoop/lib
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3366) Mapreduce component should use
consistent directory structure layout as HDFS/common
Posted by "Eric Payne (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13170386#comment-13170386 ]
Eric Payne commented on MAPREDUCE-3366:
---------------------------------------
@Mahadev,
Are the build procedures changing as a result of this JIRA?
> Mapreduce component should use consistent directory structure layout as HDFS/common
> -----------------------------------------------------------------------------------
>
> Key: MAPREDUCE-3366
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3366
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Environment: Java, Maven
> Reporter: Eric Yang
> Assignee: Eric Yang
> Labels: bigtop
> Attachments: MAPREDUCE-3366-1-trunk.patch, MAPREDUCE-3366-2-trunk.patch, MAPREDUCE-3366-3-trunk.patch, MAPREDUCE-3366-4-trunk.patch, MAPREDUCE-3366.patch, svn-rename-MAPREDUCE-3366-3.sh
>
>
> Directory structure for MRv2 layout looks like:
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /conf
> /lib
> /modules
> {noformat}
> The directory structure layout should be updated to reflect changes implemented in HADOOP-6255.
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /etc/hadoop
> /lib
> /libexec
> /sbin
> /share/hadoop
> /share/hadoop/lib
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3366) Mapreduce component should use
consistent directory structure layout as HDFS/common
Posted by "Mahadev konar (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13170006#comment-13170006 ]
Mahadev konar commented on MAPREDUCE-3366:
------------------------------------------
Thanks Eric. The patch looks good. Running through some final testing to see all if the builds are all fine. Will commit this tomm morning.
> Mapreduce component should use consistent directory structure layout as HDFS/common
> -----------------------------------------------------------------------------------
>
> Key: MAPREDUCE-3366
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3366
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Environment: Java, Maven
> Reporter: Eric Yang
> Assignee: Eric Yang
> Labels: bigtop
> Attachments: MAPREDUCE-3366-1-trunk.patch, MAPREDUCE-3366-2-trunk.patch, MAPREDUCE-3366-3-trunk.patch, MAPREDUCE-3366-4-trunk.patch, MAPREDUCE-3366.patch, svn-rename-MAPREDUCE-3366-3.sh
>
>
> Directory structure for MRv2 layout looks like:
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /conf
> /lib
> /modules
> {noformat}
> The directory structure layout should be updated to reflect changes implemented in HADOOP-6255.
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /etc/hadoop
> /lib
> /libexec
> /sbin
> /share/hadoop
> /share/hadoop/lib
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3366) Mapreduce component should use
consistent directory structure layout as HDFS/common
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13173670#comment-13173670 ]
Hudson commented on MAPREDUCE-3366:
-----------------------------------
Integrated in Hadoop-Mapreduce-0.23-Build #134 (See [https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Build/134/])
MAPREDUCE-3588. Fixed bin/yarn which was broken by MAPREDUCE-3366 so that yarn daemons can start. Contributed by Arun C Murthy.
svn merge -c 1221533 --ignore-ancestry ../../trunk/
vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1221534
Files :
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/yarn
> Mapreduce component should use consistent directory structure layout as HDFS/common
> -----------------------------------------------------------------------------------
>
> Key: MAPREDUCE-3366
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3366
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Environment: Java, Maven
> Reporter: Eric Yang
> Assignee: Eric Yang
> Labels: bigtop
> Attachments: MAPREDUCE-3366-1-trunk.patch, MAPREDUCE-3366-2-trunk.patch, MAPREDUCE-3366-3-trunk.patch, MAPREDUCE-3366-4-trunk.patch, MAPREDUCE-3366.patch, svn-rename-MAPREDUCE-3366-3.sh
>
>
> Directory structure for MRv2 layout looks like:
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /conf
> /lib
> /modules
> {noformat}
> The directory structure layout should be updated to reflect changes implemented in HADOOP-6255.
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /etc/hadoop
> /lib
> /libexec
> /sbin
> /share/hadoop
> /share/hadoop/lib
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3366) Mapreduce component should use
consistent directory structure layout as HDFS/common
Posted by "Hadoop QA (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13163204#comment-13163204 ]
Hadoop QA commented on MAPREDUCE-3366:
--------------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12506196/MAPREDUCE-3366-2-trunk.patch
against trunk revision .
+1 @author. The patch does not contain any @author tags.
+1 tests included. The patch appears to include 1 new or modified tests.
-1 patch. The patch command could not apply the patch.
Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1397//console
This message is automatically generated.
> Mapreduce component should use consistent directory structure layout as HDFS/common
> -----------------------------------------------------------------------------------
>
> Key: MAPREDUCE-3366
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3366
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Environment: Java, Maven
> Reporter: Eric Yang
> Assignee: Eric Yang
> Attachments: MAPREDUCE-3366-1-trunk.patch, MAPREDUCE-3366-2-trunk.patch, MAPREDUCE-3366.patch
>
>
> Directory structure for MRv2 layout looks like:
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /conf
> /lib
> /modules
> {noformat}
> The directory structure layout should be updated to reflect changes implemented in HADOOP-6255.
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /etc/hadoop
> /lib
> /libexec
> /sbin
> /share/hadoop
> /share/hadoop/lib
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3366) Mapreduce component should use
consistent directory structure layout as HDFS/common
Posted by "Mahadev konar (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13170005#comment-13170005 ]
Mahadev konar commented on MAPREDUCE-3366:
------------------------------------------
Thanks Eric. The patch looks good. Running through some final testing to see all if the builds are all fine. Will commit this tomm morning.
> Mapreduce component should use consistent directory structure layout as HDFS/common
> -----------------------------------------------------------------------------------
>
> Key: MAPREDUCE-3366
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3366
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Environment: Java, Maven
> Reporter: Eric Yang
> Assignee: Eric Yang
> Labels: bigtop
> Attachments: MAPREDUCE-3366-1-trunk.patch, MAPREDUCE-3366-2-trunk.patch, MAPREDUCE-3366-3-trunk.patch, MAPREDUCE-3366-4-trunk.patch, MAPREDUCE-3366.patch, svn-rename-MAPREDUCE-3366-3.sh
>
>
> Directory structure for MRv2 layout looks like:
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /conf
> /lib
> /modules
> {noformat}
> The directory structure layout should be updated to reflect changes implemented in HADOOP-6255.
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /etc/hadoop
> /lib
> /libexec
> /sbin
> /share/hadoop
> /share/hadoop/lib
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3366) Mapreduce component should use
consistent directory structure layout as HDFS/common
Posted by "Mahadev konar (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Mahadev konar updated MAPREDUCE-3366:
-------------------------------------
Resolution: Fixed
Hadoop Flags: Reviewed
Status: Resolved (was: Patch Available)
I just committed this. Thanks Eric.
> Mapreduce component should use consistent directory structure layout as HDFS/common
> -----------------------------------------------------------------------------------
>
> Key: MAPREDUCE-3366
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3366
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Environment: Java, Maven
> Reporter: Eric Yang
> Assignee: Eric Yang
> Labels: bigtop
> Attachments: MAPREDUCE-3366-1-trunk.patch, MAPREDUCE-3366-2-trunk.patch, MAPREDUCE-3366-3-trunk.patch, MAPREDUCE-3366-4-trunk.patch, MAPREDUCE-3366.patch, svn-rename-MAPREDUCE-3366-3.sh
>
>
> Directory structure for MRv2 layout looks like:
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /conf
> /lib
> /modules
> {noformat}
> The directory structure layout should be updated to reflect changes implemented in HADOOP-6255.
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /etc/hadoop
> /lib
> /libexec
> /sbin
> /share/hadoop
> /share/hadoop/lib
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3366) Mapreduce component should use
consistent directory structure layout as HDFS/common
Posted by "Mahadev konar (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13163218#comment-13163218 ]
Mahadev konar commented on MAPREDUCE-3366:
------------------------------------------
@Eric,
The patch scripts has some issues working on cross project patches. Youll probably have to run the test-patch script manually.
> Mapreduce component should use consistent directory structure layout as HDFS/common
> -----------------------------------------------------------------------------------
>
> Key: MAPREDUCE-3366
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3366
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Environment: Java, Maven
> Reporter: Eric Yang
> Assignee: Eric Yang
> Attachments: MAPREDUCE-3366-1-trunk.patch, MAPREDUCE-3366-2-trunk.patch, MAPREDUCE-3366.patch
>
>
> Directory structure for MRv2 layout looks like:
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /conf
> /lib
> /modules
> {noformat}
> The directory structure layout should be updated to reflect changes implemented in HADOOP-6255.
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /etc/hadoop
> /lib
> /libexec
> /sbin
> /share/hadoop
> /share/hadoop/lib
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3366) Mapreduce component should use
consistent directory structure layout as HDFS/common
Posted by "Eric Yang (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13170011#comment-13170011 ]
Eric Yang commented on MAPREDUCE-3366:
--------------------------------------
In the new layout, there is no need to create symlink for yarn jar files in common directory. I think the symlink section is no longer necessary with the new layout. Therefore, I removed that section. Could you be more specific about the flaws? Thanks
> Mapreduce component should use consistent directory structure layout as HDFS/common
> -----------------------------------------------------------------------------------
>
> Key: MAPREDUCE-3366
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3366
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Environment: Java, Maven
> Reporter: Eric Yang
> Assignee: Eric Yang
> Labels: bigtop
> Attachments: MAPREDUCE-3366-1-trunk.patch, MAPREDUCE-3366-2-trunk.patch, MAPREDUCE-3366-3-trunk.patch, MAPREDUCE-3366-4-trunk.patch, MAPREDUCE-3366.patch, svn-rename-MAPREDUCE-3366-3.sh
>
>
> Directory structure for MRv2 layout looks like:
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /conf
> /lib
> /modules
> {noformat}
> The directory structure layout should be updated to reflect changes implemented in HADOOP-6255.
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /etc/hadoop
> /lib
> /libexec
> /sbin
> /share/hadoop
> /share/hadoop/lib
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3366) Mapreduce component should use
consistent directory structure layout as HDFS/common
Posted by "Eric Yang (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Eric Yang updated MAPREDUCE-3366:
---------------------------------
Status: Patch Available (was: Open)
> Mapreduce component should use consistent directory structure layout as HDFS/common
> -----------------------------------------------------------------------------------
>
> Key: MAPREDUCE-3366
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3366
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Environment: Java, Maven
> Reporter: Eric Yang
> Assignee: Eric Yang
> Attachments: MAPREDUCE-3366-1-trunk.patch, MAPREDUCE-3366.patch
>
>
> Directory structure for MRv2 layout looks like:
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /conf
> /lib
> /modules
> {noformat}
> The directory structure layout should be updated to reflect changes implemented in HADOOP-6255.
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /etc/hadoop
> /lib
> /libexec
> /sbin
> /share/hadoop
> /share/hadoop/lib
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3366) Mapreduce component should use
consistent directory structure layout as HDFS/common
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13170870#comment-13170870 ]
Hudson commented on MAPREDUCE-3366:
-----------------------------------
Integrated in Hadoop-Mapreduce-trunk-Commit #1467 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/1467/])
MAPREDUCE-3366. Mapreduce component should use consistent directory structure layout as HDFS/common (Eric Yang via mahadev)
mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1215065
Files :
* /hadoop/common/trunk/hadoop-assemblies/src/main/resources/assemblies/hadoop-mapreduce-dist.xml
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/bin/hadoop-config.sh
* /hadoop/common/trunk/hadoop-dist/pom.xml
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/INSTALL
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/slaves.sh
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/start-all.sh
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/start-yarn.sh
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/stop-all.sh
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/stop-yarn.sh
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/yarn
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/yarn-config.sh
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/yarn-daemon.sh
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/yarn-daemons.sh
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/conf/yarn-env.sh
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/ApplicationConstants.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-site/src/site/apt/SingleCluster.apt.vm
* /hadoop/common/trunk/hadoop-mapreduce-project/pom.xml
> Mapreduce component should use consistent directory structure layout as HDFS/common
> -----------------------------------------------------------------------------------
>
> Key: MAPREDUCE-3366
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3366
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Environment: Java, Maven
> Reporter: Eric Yang
> Assignee: Eric Yang
> Labels: bigtop
> Attachments: MAPREDUCE-3366-1-trunk.patch, MAPREDUCE-3366-2-trunk.patch, MAPREDUCE-3366-3-trunk.patch, MAPREDUCE-3366-4-trunk.patch, MAPREDUCE-3366.patch, svn-rename-MAPREDUCE-3366-3.sh
>
>
> Directory structure for MRv2 layout looks like:
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /conf
> /lib
> /modules
> {noformat}
> The directory structure layout should be updated to reflect changes implemented in HADOOP-6255.
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /etc/hadoop
> /lib
> /libexec
> /sbin
> /share/hadoop
> /share/hadoop/lib
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3366) Mapreduce component should use
consistent directory structure layout as HDFS/common
Posted by "Bruno Mahé (Commented JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13163142#comment-13163142 ]
Bruno Mahé commented on MAPREDUCE-3366:
---------------------------------------
Here are some issues with that patch:
* In hadoop-mapreduce-project/hadoop-yarn/bin/yarn-config.sh :
Instead of using the hardcoded value "$bin/../", it would be eaiser to reuse what has been done in MAPREDUCE-3373.
For instance:
+DEFAULT_LIBEXEC_DIR="$bin"/../libexec
+HADOOP_LIBEXEC_DIR=${HADOOP_LIBEXEC_DIR:-$DEFAULT_LIBEXEC_DIR}
+if [ -e "${HADOOP_LIBEXEC_DIR}/hadoop-config.sh" ]; then
+ . "${HADOOP_LIBEXEC_DIR}/hadoop-config.sh"
* Wouldn't it be less confusing to display the message "hadoop-config.sh not found" instead of "Hadoop common not found." if hadoop-config.sh is not found?
* Why changing these lines:
-YARN_CONF_DIR="${YARN_CONF_DIR:-$YARN_HOME/conf}"
+YARN_CONF_DIR="${HADOOP_CONF_DIR:-$YARN_HOME/conf}
I would like to be able to specify a different YARN_CONF_DIR than HADOOP_CONF_DIR whole not being in YARN_HOME/conf. This change reduces the choices
> Mapreduce component should use consistent directory structure layout as HDFS/common
> -----------------------------------------------------------------------------------
>
> Key: MAPREDUCE-3366
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3366
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Environment: Java, Maven
> Reporter: Eric Yang
> Assignee: Eric Yang
> Attachments: MAPREDUCE-3366-1-trunk.patch, MAPREDUCE-3366.patch
>
>
> Directory structure for MRv2 layout looks like:
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /conf
> /lib
> /modules
> {noformat}
> The directory structure layout should be updated to reflect changes implemented in HADOOP-6255.
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /etc/hadoop
> /lib
> /libexec
> /sbin
> /share/hadoop
> /share/hadoop/lib
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3366) Mapreduce component should use
consistent directory structure layout as HDFS/common
Posted by "Mahadev konar (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13163146#comment-13163146 ]
Mahadev konar commented on MAPREDUCE-3366:
------------------------------------------
Great to see this Eric. Does this subsume MAPREDUCE-3177?
> Mapreduce component should use consistent directory structure layout as HDFS/common
> -----------------------------------------------------------------------------------
>
> Key: MAPREDUCE-3366
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3366
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Environment: Java, Maven
> Reporter: Eric Yang
> Assignee: Eric Yang
> Attachments: MAPREDUCE-3366-1-trunk.patch, MAPREDUCE-3366.patch
>
>
> Directory structure for MRv2 layout looks like:
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /conf
> /lib
> /modules
> {noformat}
> The directory structure layout should be updated to reflect changes implemented in HADOOP-6255.
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /etc/hadoop
> /lib
> /libexec
> /sbin
> /share/hadoop
> /share/hadoop/lib
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3366) Mapreduce component should use
consistent directory structure layout as HDFS/common
Posted by "Eric Yang (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13163270#comment-13163270 ]
Eric Yang commented on MAPREDUCE-3366:
--------------------------------------
Summary Output from test-patch:
{noformat}
There appear to be 0 release audit warnings before the patch and 0 release audit warnings after applying the patch.
======================================================================
======================================================================
Checking the integrity of system test framework code.
======================================================================
======================================================================
/bin/kill -9 12670
kill: 12670: No such process
NOP
+1 overall.
+1 @author. The patch does not contain any @author tags.
+1 tests included. The patch appears to include 1 new or modified tests.
+1 javadoc. The javadoc tool did not generate any warning messages.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
+1 findbugs. The patch does not introduce any new Findbugs (version ) warnings.
+1 release audit. The applied patch does not increase the total number of release audit warnings.
======================================================================
======================================================================
Finished build.
======================================================================
======================================================================
{noformat}
> Mapreduce component should use consistent directory structure layout as HDFS/common
> -----------------------------------------------------------------------------------
>
> Key: MAPREDUCE-3366
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3366
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Environment: Java, Maven
> Reporter: Eric Yang
> Assignee: Eric Yang
> Attachments: MAPREDUCE-3366-1-trunk.patch, MAPREDUCE-3366-2-trunk.patch, MAPREDUCE-3366.patch
>
>
> Directory structure for MRv2 layout looks like:
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /conf
> /lib
> /modules
> {noformat}
> The directory structure layout should be updated to reflect changes implemented in HADOOP-6255.
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /etc/hadoop
> /lib
> /libexec
> /sbin
> /share/hadoop
> /share/hadoop/lib
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3366) Mapreduce component should use
consistent directory structure layout as HDFS/common
Posted by "Alejandro Abdelnur (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13163917#comment-13163917 ]
Alejandro Abdelnur commented on MAPREDUCE-3366:
-----------------------------------------------
the patch applies and builds a distro, but the distro fails to start any of the MR services
{code}
tucu@ubuntu:~/src/apache/hadoop/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT$ sbin/yarn-daemon.sh start resourcemanager
sbin/yarn-daemon.sh: line 44: /home/tucu/src/apache/hadoop/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT/sbin/yarn-config.sh: No such file or directory
starting resourcemanager, logging to /home/tucu/src/apache/hadoop/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT/logs/yarn-tucu-resourcemanager-ubuntu.out
/home/tucu/src/apache/hadoop/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT/bin/yarn: line 49: /home/tucu/src/apache/hadoop/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT/bin/yarn-config.sh: No such file or directory
/usr/lib/jvm/java-6-sun/bin/java -Dproc_--config -Xmx1000m -Dhadoop.log.dir=/home/tucu/src/apache/hadoop/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT/logs -Dyarn.log.dir=/home/tucu/src/apache/hadoop/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT/logs -Dhadoop.log.file=yarn-tucu-resourcemanager-ubuntu.log -Dyarn.log.file=yarn-tucu-resourcemanager-ubuntu.log -Dyarn.home.dir=/home/tucu/src/apache/hadoop/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT -Dhadoop.root.logger=INFO,DRFA -Dyarn.root.logger=INFO,DRFA -classpath /home/tucu/src/apache/hadoop/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT/conf/:~/home/tucu/src/apache/hadoop/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT/conf/::/usr/lib/jvm/java-6-sun/lib/tools.jar --config ~/home/tucu/src/apache/hadoop/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT/conf/ resourcemanager
Unrecognized option: --config
Could not create the Java virtual machine.
{code}
It seems the yarn-config.sh is being looked in bin/ instead of libexec/
> Mapreduce component should use consistent directory structure layout as HDFS/common
> -----------------------------------------------------------------------------------
>
> Key: MAPREDUCE-3366
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3366
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Environment: Java, Maven
> Reporter: Eric Yang
> Assignee: Eric Yang
> Attachments: MAPREDUCE-3366-1-trunk.patch, MAPREDUCE-3366-2-trunk.patch, MAPREDUCE-3366.patch
>
>
> Directory structure for MRv2 layout looks like:
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /conf
> /lib
> /modules
> {noformat}
> The directory structure layout should be updated to reflect changes implemented in HADOOP-6255.
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /etc/hadoop
> /lib
> /libexec
> /sbin
> /share/hadoop
> /share/hadoop/lib
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3366) Mapreduce component should use
consistent directory structure layout as HDFS/common
Posted by "Eric Yang (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13163195#comment-13163195 ]
Eric Yang commented on MAPREDUCE-3366:
--------------------------------------
Bruno, you are right. Thanks for catching this. I will updated it to reflect changes in MAPREDUCE-3373.
bq. Why changing these lines:
bq. -YARN_CONF_DIR="${YARN_CONF_DIR:-$YARN_HOME/conf}"
bq. +YARN_CONF_DIR="${HADOOP_CONF_DIR:-$YARN_HOME/conf}
This was done as part of merging back Hadoop into a project. There are many configuration files which have interconnected parts. i.e. log4j, hadoop-metric2.properties. It seems safer to consolidate config files back to
HADOOP_CONF_DIR, and reduce redundancies or conflicts. For consistency, HDFS use HADOOP_CONF_DIR rather than
HDFS_CONF_DIR. Yarn should follow the same pattern in my opinion.
Mahadev, yes, this subsume MAPREDUCE-3177.
> Mapreduce component should use consistent directory structure layout as HDFS/common
> -----------------------------------------------------------------------------------
>
> Key: MAPREDUCE-3366
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3366
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Environment: Java, Maven
> Reporter: Eric Yang
> Assignee: Eric Yang
> Attachments: MAPREDUCE-3366-1-trunk.patch, MAPREDUCE-3366.patch
>
>
> Directory structure for MRv2 layout looks like:
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /conf
> /lib
> /modules
> {noformat}
> The directory structure layout should be updated to reflect changes implemented in HADOOP-6255.
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /etc/hadoop
> /lib
> /libexec
> /sbin
> /share/hadoop
> /share/hadoop/lib
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3366) Mapreduce component should use
consistent directory structure layout as HDFS/common
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13173744#comment-13173744 ]
Hudson commented on MAPREDUCE-3366:
-----------------------------------
Integrated in Hadoop-Mapreduce-0.23-Commit #324 (See [https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Commit/324/])
MAPREDUCE-3588. Fixed bin/yarn which was broken by MAPREDUCE-3366 so that yarn daemons can start. Contributed by Arun C Murthy.
svn merge -c 1221533 --ignore-ancestry ../../trunk/
vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1221534
Files :
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/yarn
> Mapreduce component should use consistent directory structure layout as HDFS/common
> -----------------------------------------------------------------------------------
>
> Key: MAPREDUCE-3366
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3366
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Environment: Java, Maven
> Reporter: Eric Yang
> Assignee: Eric Yang
> Labels: bigtop
> Attachments: MAPREDUCE-3366-1-trunk.patch, MAPREDUCE-3366-2-trunk.patch, MAPREDUCE-3366-3-trunk.patch, MAPREDUCE-3366-4-trunk.patch, MAPREDUCE-3366.patch, svn-rename-MAPREDUCE-3366-3.sh
>
>
> Directory structure for MRv2 layout looks like:
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /conf
> /lib
> /modules
> {noformat}
> The directory structure layout should be updated to reflect changes implemented in HADOOP-6255.
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /etc/hadoop
> /lib
> /libexec
> /sbin
> /share/hadoop
> /share/hadoop/lib
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3366) Mapreduce component should use
consistent directory structure layout as HDFS/common
Posted by "Eric Yang (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Eric Yang updated MAPREDUCE-3366:
---------------------------------
Status: Open (was: Patch Available)
Patch build didn't work for some other reasons, cancel patch and retest.
> Mapreduce component should use consistent directory structure layout as HDFS/common
> -----------------------------------------------------------------------------------
>
> Key: MAPREDUCE-3366
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3366
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Environment: Java, Maven
> Reporter: Eric Yang
> Assignee: Eric Yang
> Attachments: MAPREDUCE-3366.patch
>
>
> Directory structure for MRv2 layout looks like:
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /conf
> /lib
> /modules
> {noformat}
> The directory structure layout should be updated to reflect changes implemented in HADOOP-6255.
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /etc/hadoop
> /lib
> /libexec
> /sbin
> /share/hadoop
> /share/hadoop/lib
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3366) Mapreduce component should use
consistent directory structure layout as HDFS/common
Posted by "Tom White (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13165415#comment-13165415 ]
Tom White commented on MAPREDUCE-3366:
--------------------------------------
Does this subsume MAPREDUCE-3416?
> Mapreduce component should use consistent directory structure layout as HDFS/common
> -----------------------------------------------------------------------------------
>
> Key: MAPREDUCE-3366
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3366
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Environment: Java, Maven
> Reporter: Eric Yang
> Assignee: Eric Yang
> Attachments: MAPREDUCE-3366-1-trunk.patch, MAPREDUCE-3366-2-trunk.patch, MAPREDUCE-3366-3-trunk.patch, MAPREDUCE-3366.patch, svn-rename-MAPREDUCE-3366-3.sh
>
>
> Directory structure for MRv2 layout looks like:
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /conf
> /lib
> /modules
> {noformat}
> The directory structure layout should be updated to reflect changes implemented in HADOOP-6255.
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /etc/hadoop
> /lib
> /libexec
> /sbin
> /share/hadoop
> /share/hadoop/lib
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3366) Mapreduce component should use
consistent directory structure layout as HDFS/common
Posted by "Hitesh Shah (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Hitesh Shah updated MAPREDUCE-3366:
-----------------------------------
Status: Open (was: Patch Available)
> Mapreduce component should use consistent directory structure layout as HDFS/common
> -----------------------------------------------------------------------------------
>
> Key: MAPREDUCE-3366
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3366
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Environment: Java, Maven
> Reporter: Eric Yang
> Assignee: Eric Yang
> Attachments: MAPREDUCE-3366.patch
>
>
> Directory structure for MRv2 layout looks like:
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /conf
> /lib
> /modules
> {noformat}
> The directory structure layout should be updated to reflect changes implemented in HADOOP-6255.
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /etc/hadoop
> /lib
> /libexec
> /sbin
> /share/hadoop
> /share/hadoop/lib
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3366) Mapreduce component should use
consistent directory structure layout as HDFS/common
Posted by "Eric Yang (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Eric Yang updated MAPREDUCE-3366:
---------------------------------
Status: Patch Available (was: Open)
> Mapreduce component should use consistent directory structure layout as HDFS/common
> -----------------------------------------------------------------------------------
>
> Key: MAPREDUCE-3366
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3366
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Environment: Java, Maven
> Reporter: Eric Yang
> Assignee: Eric Yang
> Attachments: MAPREDUCE-3366-1-trunk.patch, MAPREDUCE-3366-2-trunk.patch, MAPREDUCE-3366-3-trunk.patch, MAPREDUCE-3366.patch, svn-rename-MAPREDUCE-3366-3.sh
>
>
> Directory structure for MRv2 layout looks like:
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /conf
> /lib
> /modules
> {noformat}
> The directory structure layout should be updated to reflect changes implemented in HADOOP-6255.
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /etc/hadoop
> /lib
> /libexec
> /sbin
> /share/hadoop
> /share/hadoop/lib
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3366) Mapreduce component should use
consistent directory structure layout as HDFS/common
Posted by "Mahadev konar (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13166450#comment-13166450 ]
Mahadev konar commented on MAPREDUCE-3366:
------------------------------------------
@Eric,
Could you please incorporate the documentation changes from MAPREDUCE-3416 as well?
> Mapreduce component should use consistent directory structure layout as HDFS/common
> -----------------------------------------------------------------------------------
>
> Key: MAPREDUCE-3366
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3366
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Environment: Java, Maven
> Reporter: Eric Yang
> Assignee: Eric Yang
> Labels: bigtop
> Attachments: MAPREDUCE-3366-1-trunk.patch, MAPREDUCE-3366-2-trunk.patch, MAPREDUCE-3366-3-trunk.patch, MAPREDUCE-3366.patch, svn-rename-MAPREDUCE-3366-3.sh
>
>
> Directory structure for MRv2 layout looks like:
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /conf
> /lib
> /modules
> {noformat}
> The directory structure layout should be updated to reflect changes implemented in HADOOP-6255.
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /etc/hadoop
> /lib
> /libexec
> /sbin
> /share/hadoop
> /share/hadoop/lib
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3366) Mapreduce component should use
consistent directory structure layout as HDFS/common
Posted by "Mahadev konar (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13167303#comment-13167303 ]
Mahadev konar commented on MAPREDUCE-3366:
------------------------------------------
@Eric, I tried setting up a secure cluster as I used to earlier, looks like YARN_HOME needs to be set now, which is fine. Earlier it used to work without it - I think YARN_HOME used to default to MAPRED_HOME. But I think we need to make sure our documentation is correct. Could you please update the documentation (single node/multi node setup) to be in sync with the latest binary layout and environment setup?
> Mapreduce component should use consistent directory structure layout as HDFS/common
> -----------------------------------------------------------------------------------
>
> Key: MAPREDUCE-3366
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3366
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Environment: Java, Maven
> Reporter: Eric Yang
> Assignee: Eric Yang
> Labels: bigtop
> Attachments: MAPREDUCE-3366-1-trunk.patch, MAPREDUCE-3366-2-trunk.patch, MAPREDUCE-3366-3-trunk.patch, MAPREDUCE-3366.patch, svn-rename-MAPREDUCE-3366-3.sh
>
>
> Directory structure for MRv2 layout looks like:
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /conf
> /lib
> /modules
> {noformat}
> The directory structure layout should be updated to reflect changes implemented in HADOOP-6255.
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /etc/hadoop
> /lib
> /libexec
> /sbin
> /share/hadoop
> /share/hadoop/lib
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3366) Mapreduce component should use
consistent directory structure layout as HDFS/common
Posted by "Mahadev konar (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13170839#comment-13170839 ]
Mahadev konar commented on MAPREDUCE-3366:
------------------------------------------
+1 the patch is good as it is. Committing it now.
> Mapreduce component should use consistent directory structure layout as HDFS/common
> -----------------------------------------------------------------------------------
>
> Key: MAPREDUCE-3366
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3366
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Environment: Java, Maven
> Reporter: Eric Yang
> Assignee: Eric Yang
> Labels: bigtop
> Attachments: MAPREDUCE-3366-1-trunk.patch, MAPREDUCE-3366-2-trunk.patch, MAPREDUCE-3366-3-trunk.patch, MAPREDUCE-3366-4-trunk.patch, MAPREDUCE-3366.patch, svn-rename-MAPREDUCE-3366-3.sh
>
>
> Directory structure for MRv2 layout looks like:
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /conf
> /lib
> /modules
> {noformat}
> The directory structure layout should be updated to reflect changes implemented in HADOOP-6255.
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /etc/hadoop
> /lib
> /libexec
> /sbin
> /share/hadoop
> /share/hadoop/lib
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3366) Mapreduce component should use
consistent directory structure layout as HDFS/common
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13173663#comment-13173663 ]
Hudson commented on MAPREDUCE-3366:
-----------------------------------
Integrated in Hadoop-Hdfs-trunk-Commit #1533 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/1533/])
MAPREDUCE-3588. Fixed bin/yarn which was broken by MAPREDUCE-3366 so that yarn daemons can start. Contributed by Arun C Murthy.
vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1221533
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/yarn
> Mapreduce component should use consistent directory structure layout as HDFS/common
> -----------------------------------------------------------------------------------
>
> Key: MAPREDUCE-3366
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3366
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Environment: Java, Maven
> Reporter: Eric Yang
> Assignee: Eric Yang
> Labels: bigtop
> Attachments: MAPREDUCE-3366-1-trunk.patch, MAPREDUCE-3366-2-trunk.patch, MAPREDUCE-3366-3-trunk.patch, MAPREDUCE-3366-4-trunk.patch, MAPREDUCE-3366.patch, svn-rename-MAPREDUCE-3366-3.sh
>
>
> Directory structure for MRv2 layout looks like:
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /conf
> /lib
> /modules
> {noformat}
> The directory structure layout should be updated to reflect changes implemented in HADOOP-6255.
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /etc/hadoop
> /lib
> /libexec
> /sbin
> /share/hadoop
> /share/hadoop/lib
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3366) Mapreduce component should use
consistent directory structure layout as HDFS/common
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13170946#comment-13170946 ]
Hudson commented on MAPREDUCE-3366:
-----------------------------------
Integrated in Hadoop-Hdfs-0.23-Build #109 (See [https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/109/])
MAPREDUCE-3366. Mapreduce component should use consistent directory structure layout as HDFS/common (Eric Yang via mahadev) - Merging r1215065 from trunk
mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1215066
Files :
* /hadoop/common/branches/branch-0.23/hadoop-assemblies/src/main/resources/assemblies/hadoop-mapreduce-dist.xml
* /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/main/bin/hadoop-config.sh
* /hadoop/common/branches/branch-0.23/hadoop-dist/pom.xml
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/INSTALL
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/slaves.sh
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/start-all.sh
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/start-yarn.sh
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/stop-all.sh
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/stop-yarn.sh
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/yarn
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/yarn-config.sh
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/yarn-daemon.sh
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/yarn-daemons.sh
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/conf/yarn-env.sh
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/ApplicationConstants.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-site/src/site/apt/SingleCluster.apt.vm
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/pom.xml
> Mapreduce component should use consistent directory structure layout as HDFS/common
> -----------------------------------------------------------------------------------
>
> Key: MAPREDUCE-3366
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3366
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Environment: Java, Maven
> Reporter: Eric Yang
> Assignee: Eric Yang
> Labels: bigtop
> Attachments: MAPREDUCE-3366-1-trunk.patch, MAPREDUCE-3366-2-trunk.patch, MAPREDUCE-3366-3-trunk.patch, MAPREDUCE-3366-4-trunk.patch, MAPREDUCE-3366.patch, svn-rename-MAPREDUCE-3366-3.sh
>
>
> Directory structure for MRv2 layout looks like:
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /conf
> /lib
> /modules
> {noformat}
> The directory structure layout should be updated to reflect changes implemented in HADOOP-6255.
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /etc/hadoop
> /lib
> /libexec
> /sbin
> /share/hadoop
> /share/hadoop/lib
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3366) Mapreduce component should use
consistent directory structure layout as HDFS/common
Posted by "Mahadev konar (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13170017#comment-13170017 ]
Mahadev konar commented on MAPREDUCE-3366:
------------------------------------------
Looks like I might be wrong on this. Let me run a cluster without doing any symlinks on the gateways. @Eric you might be right that we dont need any symlinks at all.
> Mapreduce component should use consistent directory structure layout as HDFS/common
> -----------------------------------------------------------------------------------
>
> Key: MAPREDUCE-3366
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3366
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Environment: Java, Maven
> Reporter: Eric Yang
> Assignee: Eric Yang
> Labels: bigtop
> Attachments: MAPREDUCE-3366-1-trunk.patch, MAPREDUCE-3366-2-trunk.patch, MAPREDUCE-3366-3-trunk.patch, MAPREDUCE-3366-4-trunk.patch, MAPREDUCE-3366.patch, svn-rename-MAPREDUCE-3366-3.sh
>
>
> Directory structure for MRv2 layout looks like:
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /conf
> /lib
> /modules
> {noformat}
> The directory structure layout should be updated to reflect changes implemented in HADOOP-6255.
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /etc/hadoop
> /lib
> /libexec
> /sbin
> /share/hadoop
> /share/hadoop/lib
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3366) Mapreduce component should use
consistent directory structure layout as HDFS/common
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13173655#comment-13173655 ]
Hudson commented on MAPREDUCE-3366:
-----------------------------------
Integrated in Hadoop-Common-trunk-Commit #1460 (See [https://builds.apache.org/job/Hadoop-Common-trunk-Commit/1460/])
MAPREDUCE-3588. Fixed bin/yarn which was broken by MAPREDUCE-3366 so that yarn daemons can start. Contributed by Arun C Murthy.
vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1221533
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/yarn
> Mapreduce component should use consistent directory structure layout as HDFS/common
> -----------------------------------------------------------------------------------
>
> Key: MAPREDUCE-3366
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3366
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Environment: Java, Maven
> Reporter: Eric Yang
> Assignee: Eric Yang
> Labels: bigtop
> Attachments: MAPREDUCE-3366-1-trunk.patch, MAPREDUCE-3366-2-trunk.patch, MAPREDUCE-3366-3-trunk.patch, MAPREDUCE-3366-4-trunk.patch, MAPREDUCE-3366.patch, svn-rename-MAPREDUCE-3366-3.sh
>
>
> Directory structure for MRv2 layout looks like:
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /conf
> /lib
> /modules
> {noformat}
> The directory structure layout should be updated to reflect changes implemented in HADOOP-6255.
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /etc/hadoop
> /lib
> /libexec
> /sbin
> /share/hadoop
> /share/hadoop/lib
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3366) Mapreduce component should use
consistent directory structure layout as HDFS/common
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13170855#comment-13170855 ]
Hudson commented on MAPREDUCE-3366:
-----------------------------------
Integrated in Hadoop-Common-0.23-Commit #298 (See [https://builds.apache.org/job/Hadoop-Common-0.23-Commit/298/])
MAPREDUCE-3366. Mapreduce component should use consistent directory structure layout as HDFS/common (Eric Yang via mahadev) - Merging r1215065 from trunk
mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1215066
Files :
* /hadoop/common/branches/branch-0.23/hadoop-assemblies/src/main/resources/assemblies/hadoop-mapreduce-dist.xml
* /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/main/bin/hadoop-config.sh
* /hadoop/common/branches/branch-0.23/hadoop-dist/pom.xml
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/INSTALL
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/slaves.sh
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/start-all.sh
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/start-yarn.sh
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/stop-all.sh
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/stop-yarn.sh
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/yarn
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/yarn-config.sh
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/yarn-daemon.sh
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/yarn-daemons.sh
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/conf/yarn-env.sh
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/ApplicationConstants.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-site/src/site/apt/SingleCluster.apt.vm
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/pom.xml
> Mapreduce component should use consistent directory structure layout as HDFS/common
> -----------------------------------------------------------------------------------
>
> Key: MAPREDUCE-3366
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3366
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Environment: Java, Maven
> Reporter: Eric Yang
> Assignee: Eric Yang
> Labels: bigtop
> Attachments: MAPREDUCE-3366-1-trunk.patch, MAPREDUCE-3366-2-trunk.patch, MAPREDUCE-3366-3-trunk.patch, MAPREDUCE-3366-4-trunk.patch, MAPREDUCE-3366.patch, svn-rename-MAPREDUCE-3366-3.sh
>
>
> Directory structure for MRv2 layout looks like:
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /conf
> /lib
> /modules
> {noformat}
> The directory structure layout should be updated to reflect changes implemented in HADOOP-6255.
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /etc/hadoop
> /lib
> /libexec
> /sbin
> /share/hadoop
> /share/hadoop/lib
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3366) Mapreduce component should use
consistent directory structure layout as HDFS/common
Posted by "Eric Yang (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13163215#comment-13163215 ]
Eric Yang commented on MAPREDUCE-3366:
--------------------------------------
I generated the patch from trunk directory. It doesn't seem to apply. What is the expected prefix for the patch build?
> Mapreduce component should use consistent directory structure layout as HDFS/common
> -----------------------------------------------------------------------------------
>
> Key: MAPREDUCE-3366
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3366
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Environment: Java, Maven
> Reporter: Eric Yang
> Assignee: Eric Yang
> Attachments: MAPREDUCE-3366-1-trunk.patch, MAPREDUCE-3366-2-trunk.patch, MAPREDUCE-3366.patch
>
>
> Directory structure for MRv2 layout looks like:
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /conf
> /lib
> /modules
> {noformat}
> The directory structure layout should be updated to reflect changes implemented in HADOOP-6255.
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /etc/hadoop
> /lib
> /libexec
> /sbin
> /share/hadoop
> /share/hadoop/lib
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3366) Mapreduce component should use
consistent directory structure layout as HDFS/common
Posted by "Alejandro Abdelnur (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13166460#comment-13166460 ]
Alejandro Abdelnur commented on MAPREDUCE-3366:
-----------------------------------------------
Tried the patch, layout seems OK, after setting all necessary ENV variables as well as minimal *-site.xml files I was able to start all services and run an example MR job.
+1 (after comments from Eric are addressed)
> Mapreduce component should use consistent directory structure layout as HDFS/common
> -----------------------------------------------------------------------------------
>
> Key: MAPREDUCE-3366
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3366
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Environment: Java, Maven
> Reporter: Eric Yang
> Assignee: Eric Yang
> Labels: bigtop
> Attachments: MAPREDUCE-3366-1-trunk.patch, MAPREDUCE-3366-2-trunk.patch, MAPREDUCE-3366-3-trunk.patch, MAPREDUCE-3366.patch, svn-rename-MAPREDUCE-3366-3.sh
>
>
> Directory structure for MRv2 layout looks like:
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /conf
> /lib
> /modules
> {noformat}
> The directory structure layout should be updated to reflect changes implemented in HADOOP-6255.
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /etc/hadoop
> /lib
> /libexec
> /sbin
> /share/hadoop
> /share/hadoop/lib
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3366) Mapreduce component should use
consistent directory structure layout as HDFS/common
Posted by "Eric Yang (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Eric Yang updated MAPREDUCE-3366:
---------------------------------
Attachment: MAPREDUCE-3366-4-trunk.patch
Include updated documentation.
> Mapreduce component should use consistent directory structure layout as HDFS/common
> -----------------------------------------------------------------------------------
>
> Key: MAPREDUCE-3366
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3366
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Environment: Java, Maven
> Reporter: Eric Yang
> Assignee: Eric Yang
> Labels: bigtop
> Attachments: MAPREDUCE-3366-1-trunk.patch, MAPREDUCE-3366-2-trunk.patch, MAPREDUCE-3366-3-trunk.patch, MAPREDUCE-3366-4-trunk.patch, MAPREDUCE-3366.patch, svn-rename-MAPREDUCE-3366-3.sh
>
>
> Directory structure for MRv2 layout looks like:
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /conf
> /lib
> /modules
> {noformat}
> The directory structure layout should be updated to reflect changes implemented in HADOOP-6255.
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /etc/hadoop
> /lib
> /libexec
> /sbin
> /share/hadoop
> /share/hadoop/lib
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3366) Mapreduce component should use
consistent directory structure layout as HDFS/common
Posted by "Eric Yang (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Eric Yang updated MAPREDUCE-3366:
---------------------------------
Status: Patch Available (was: Open)
> Mapreduce component should use consistent directory structure layout as HDFS/common
> -----------------------------------------------------------------------------------
>
> Key: MAPREDUCE-3366
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3366
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Environment: Java, Maven
> Reporter: Eric Yang
> Assignee: Eric Yang
> Attachments: MAPREDUCE-3366.patch
>
>
> Directory structure for MRv2 layout looks like:
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /conf
> /lib
> /modules
> {noformat}
> The directory structure layout should be updated to reflect changes implemented in HADOOP-6255.
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /etc/hadoop
> /lib
> /libexec
> /sbin
> /share/hadoop
> /share/hadoop/lib
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3366) Mapreduce component should use
consistent directory structure layout as HDFS/common
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13174101#comment-13174101 ]
Hudson commented on MAPREDUCE-3366:
-----------------------------------
Integrated in Hadoop-Mapreduce-trunk #934 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk/934/])
MAPREDUCE-3588. Fixed bin/yarn which was broken by MAPREDUCE-3366 so that yarn daemons can start. Contributed by Arun C Murthy.
vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1221533
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/yarn
> Mapreduce component should use consistent directory structure layout as HDFS/common
> -----------------------------------------------------------------------------------
>
> Key: MAPREDUCE-3366
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3366
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Environment: Java, Maven
> Reporter: Eric Yang
> Assignee: Eric Yang
> Labels: bigtop
> Attachments: MAPREDUCE-3366-1-trunk.patch, MAPREDUCE-3366-2-trunk.patch, MAPREDUCE-3366-3-trunk.patch, MAPREDUCE-3366-4-trunk.patch, MAPREDUCE-3366.patch, svn-rename-MAPREDUCE-3366-3.sh
>
>
> Directory structure for MRv2 layout looks like:
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /conf
> /lib
> /modules
> {noformat}
> The directory structure layout should be updated to reflect changes implemented in HADOOP-6255.
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /etc/hadoop
> /lib
> /libexec
> /sbin
> /share/hadoop
> /share/hadoop/lib
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3366) Mapreduce component should use
consistent directory structure layout as HDFS/common
Posted by "Hadoop QA (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13147189#comment-13147189 ]
Hadoop QA commented on MAPREDUCE-3366:
--------------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12503105/MAPREDUCE-3366.patch
against trunk revision .
+1 @author. The patch does not contain any @author tags.
+1 tests included. The patch appears to include 1 new or modified tests.
-1 patch. The patch command could not apply the patch.
Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1284//console
This message is automatically generated.
> Mapreduce component should use consistent directory structure layout as HDFS/common
> -----------------------------------------------------------------------------------
>
> Key: MAPREDUCE-3366
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3366
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Environment: Java, Maven
> Reporter: Eric Yang
> Assignee: Eric Yang
> Attachments: MAPREDUCE-3366.patch
>
>
> Directory structure for MRv2 layout looks like:
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /conf
> /lib
> /modules
> {noformat}
> The directory structure layout should be updated to reflect changes implemented in HADOOP-6255.
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /etc/hadoop
> /lib
> /libexec
> /sbin
> /share/hadoop
> /share/hadoop/lib
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3366) Mapreduce component should use
consistent directory structure layout as HDFS/common
Posted by "Eric Yang (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Eric Yang updated MAPREDUCE-3366:
---------------------------------
Attachment: MAPREDUCE-3366-3-trunk.patch
svn-rename-MAPREDUCE-3366-3.sh
- Revised patch to use proper libexec path.
- Renamed start-all.sh/stop-all.sh to start-yarn.sh/stop-yarn.sh.
Apply instruction:
{noformat}
svn-rename-MAPREDUCE-3366-3.sh
patch -p0 < MAPREDUCE-3366-3-trunk.patch
{noformat}
> Mapreduce component should use consistent directory structure layout as HDFS/common
> -----------------------------------------------------------------------------------
>
> Key: MAPREDUCE-3366
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3366
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Environment: Java, Maven
> Reporter: Eric Yang
> Assignee: Eric Yang
> Attachments: MAPREDUCE-3366-1-trunk.patch, MAPREDUCE-3366-2-trunk.patch, MAPREDUCE-3366-3-trunk.patch, MAPREDUCE-3366.patch, svn-rename-MAPREDUCE-3366-3.sh
>
>
> Directory structure for MRv2 layout looks like:
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /conf
> /lib
> /modules
> {noformat}
> The directory structure layout should be updated to reflect changes implemented in HADOOP-6255.
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /etc/hadoop
> /lib
> /libexec
> /sbin
> /share/hadoop
> /share/hadoop/lib
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3366) Mapreduce component should use
consistent directory structure layout as HDFS/common
Posted by "Eric Yang (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Eric Yang updated MAPREDUCE-3366:
---------------------------------
Attachment: MAPREDUCE-3366-1-trunk.patch
Updated patch for trunk with ApplicationConstants.java fixed.
> Mapreduce component should use consistent directory structure layout as HDFS/common
> -----------------------------------------------------------------------------------
>
> Key: MAPREDUCE-3366
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3366
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Environment: Java, Maven
> Reporter: Eric Yang
> Assignee: Eric Yang
> Attachments: MAPREDUCE-3366-1-trunk.patch, MAPREDUCE-3366.patch
>
>
> Directory structure for MRv2 layout looks like:
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /conf
> /lib
> /modules
> {noformat}
> The directory structure layout should be updated to reflect changes implemented in HADOOP-6255.
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /etc/hadoop
> /lib
> /libexec
> /sbin
> /share/hadoop
> /share/hadoop/lib
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3366) Mapreduce component should use
consistent directory structure layout as HDFS/common
Posted by "Eric Yang (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13167402#comment-13167402 ]
Eric Yang commented on MAPREDUCE-3366:
--------------------------------------
Mahadev, yes I will update the document for completeness. Thanks for the pointer.
> Mapreduce component should use consistent directory structure layout as HDFS/common
> -----------------------------------------------------------------------------------
>
> Key: MAPREDUCE-3366
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3366
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Environment: Java, Maven
> Reporter: Eric Yang
> Assignee: Eric Yang
> Labels: bigtop
> Attachments: MAPREDUCE-3366-1-trunk.patch, MAPREDUCE-3366-2-trunk.patch, MAPREDUCE-3366-3-trunk.patch, MAPREDUCE-3366.patch, svn-rename-MAPREDUCE-3366-3.sh
>
>
> Directory structure for MRv2 layout looks like:
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /conf
> /lib
> /modules
> {noformat}
> The directory structure layout should be updated to reflect changes implemented in HADOOP-6255.
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /etc/hadoop
> /lib
> /libexec
> /sbin
> /share/hadoop
> /share/hadoop/lib
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3366) Mapreduce component should use
consistent directory structure layout as HDFS/common
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13171019#comment-13171019 ]
Hudson commented on MAPREDUCE-3366:
-----------------------------------
Integrated in Hadoop-Hdfs-trunk #896 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk/896/])
MAPREDUCE-3366. Mapreduce component should use consistent directory structure layout as HDFS/common (Eric Yang via mahadev)
mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1215065
Files :
* /hadoop/common/trunk/hadoop-assemblies/src/main/resources/assemblies/hadoop-mapreduce-dist.xml
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/bin/hadoop-config.sh
* /hadoop/common/trunk/hadoop-dist/pom.xml
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/INSTALL
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/slaves.sh
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/start-all.sh
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/start-yarn.sh
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/stop-all.sh
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/stop-yarn.sh
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/yarn
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/yarn-config.sh
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/yarn-daemon.sh
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/yarn-daemons.sh
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/conf/yarn-env.sh
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/ApplicationConstants.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-site/src/site/apt/SingleCluster.apt.vm
* /hadoop/common/trunk/hadoop-mapreduce-project/pom.xml
> Mapreduce component should use consistent directory structure layout as HDFS/common
> -----------------------------------------------------------------------------------
>
> Key: MAPREDUCE-3366
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3366
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Environment: Java, Maven
> Reporter: Eric Yang
> Assignee: Eric Yang
> Labels: bigtop
> Attachments: MAPREDUCE-3366-1-trunk.patch, MAPREDUCE-3366-2-trunk.patch, MAPREDUCE-3366-3-trunk.patch, MAPREDUCE-3366-4-trunk.patch, MAPREDUCE-3366.patch, svn-rename-MAPREDUCE-3366-3.sh
>
>
> Directory structure for MRv2 layout looks like:
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /conf
> /lib
> /modules
> {noformat}
> The directory structure layout should be updated to reflect changes implemented in HADOOP-6255.
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /etc/hadoop
> /lib
> /libexec
> /sbin
> /share/hadoop
> /share/hadoop/lib
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3366) Mapreduce component should use
consistent directory structure layout as HDFS/common
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13173676#comment-13173676 ]
Hudson commented on MAPREDUCE-3366:
-----------------------------------
Integrated in Hadoop-Hdfs-0.23-Commit #302 (See [https://builds.apache.org/job/Hadoop-Hdfs-0.23-Commit/302/])
MAPREDUCE-3588. Fixed bin/yarn which was broken by MAPREDUCE-3366 so that yarn daemons can start. Contributed by Arun C Murthy.
svn merge -c 1221533 --ignore-ancestry ../../trunk/
vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1221534
Files :
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/yarn
> Mapreduce component should use consistent directory structure layout as HDFS/common
> -----------------------------------------------------------------------------------
>
> Key: MAPREDUCE-3366
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3366
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Environment: Java, Maven
> Reporter: Eric Yang
> Assignee: Eric Yang
> Labels: bigtop
> Attachments: MAPREDUCE-3366-1-trunk.patch, MAPREDUCE-3366-2-trunk.patch, MAPREDUCE-3366-3-trunk.patch, MAPREDUCE-3366-4-trunk.patch, MAPREDUCE-3366.patch, svn-rename-MAPREDUCE-3366-3.sh
>
>
> Directory structure for MRv2 layout looks like:
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /conf
> /lib
> /modules
> {noformat}
> The directory structure layout should be updated to reflect changes implemented in HADOOP-6255.
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /etc/hadoop
> /lib
> /libexec
> /sbin
> /share/hadoop
> /share/hadoop/lib
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3366) Mapreduce component should use
consistent directory structure layout as HDFS/common
Posted by "Hadoop QA (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13163161#comment-13163161 ]
Hadoop QA commented on MAPREDUCE-3366:
--------------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12506181/MAPREDUCE-3366-1-trunk.patch
against trunk revision .
+1 @author. The patch does not contain any @author tags.
+1 tests included. The patch appears to include 1 new or modified tests.
-1 patch. The patch command could not apply the patch.
Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1394//console
This message is automatically generated.
> Mapreduce component should use consistent directory structure layout as HDFS/common
> -----------------------------------------------------------------------------------
>
> Key: MAPREDUCE-3366
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3366
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Environment: Java, Maven
> Reporter: Eric Yang
> Assignee: Eric Yang
> Attachments: MAPREDUCE-3366-1-trunk.patch, MAPREDUCE-3366.patch
>
>
> Directory structure for MRv2 layout looks like:
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /conf
> /lib
> /modules
> {noformat}
> The directory structure layout should be updated to reflect changes implemented in HADOOP-6255.
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /etc/hadoop
> /lib
> /libexec
> /sbin
> /share/hadoop
> /share/hadoop/lib
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3366) Mapreduce component should use
consistent directory structure layout as HDFS/common
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13171030#comment-13171030 ]
Hudson commented on MAPREDUCE-3366:
-----------------------------------
Integrated in Hadoop-Mapreduce-trunk #929 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk/929/])
MAPREDUCE-3366. Mapreduce component should use consistent directory structure layout as HDFS/common (Eric Yang via mahadev)
mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1215065
Files :
* /hadoop/common/trunk/hadoop-assemblies/src/main/resources/assemblies/hadoop-mapreduce-dist.xml
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/bin/hadoop-config.sh
* /hadoop/common/trunk/hadoop-dist/pom.xml
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/INSTALL
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/slaves.sh
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/start-all.sh
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/start-yarn.sh
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/stop-all.sh
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/stop-yarn.sh
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/yarn
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/yarn-config.sh
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/yarn-daemon.sh
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/yarn-daemons.sh
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/conf/yarn-env.sh
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/ApplicationConstants.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-site/src/site/apt/SingleCluster.apt.vm
* /hadoop/common/trunk/hadoop-mapreduce-project/pom.xml
> Mapreduce component should use consistent directory structure layout as HDFS/common
> -----------------------------------------------------------------------------------
>
> Key: MAPREDUCE-3366
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3366
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Environment: Java, Maven
> Reporter: Eric Yang
> Assignee: Eric Yang
> Labels: bigtop
> Attachments: MAPREDUCE-3366-1-trunk.patch, MAPREDUCE-3366-2-trunk.patch, MAPREDUCE-3366-3-trunk.patch, MAPREDUCE-3366-4-trunk.patch, MAPREDUCE-3366.patch, svn-rename-MAPREDUCE-3366-3.sh
>
>
> Directory structure for MRv2 layout looks like:
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /conf
> /lib
> /modules
> {noformat}
> The directory structure layout should be updated to reflect changes implemented in HADOOP-6255.
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /etc/hadoop
> /lib
> /libexec
> /sbin
> /share/hadoop
> /share/hadoop/lib
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3366) Mapreduce component should use
consistent directory structure layout as HDFS/common
Posted by "Mahadev konar (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13170007#comment-13170007 ]
Mahadev konar commented on MAPREDUCE-3366:
------------------------------------------
Yikes.. looks like the documentation update is incorrect (related to symlink creation). Ill update that before committing.
> Mapreduce component should use consistent directory structure layout as HDFS/common
> -----------------------------------------------------------------------------------
>
> Key: MAPREDUCE-3366
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3366
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Environment: Java, Maven
> Reporter: Eric Yang
> Assignee: Eric Yang
> Labels: bigtop
> Attachments: MAPREDUCE-3366-1-trunk.patch, MAPREDUCE-3366-2-trunk.patch, MAPREDUCE-3366-3-trunk.patch, MAPREDUCE-3366-4-trunk.patch, MAPREDUCE-3366.patch, svn-rename-MAPREDUCE-3366-3.sh
>
>
> Directory structure for MRv2 layout looks like:
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /conf
> /lib
> /modules
> {noformat}
> The directory structure layout should be updated to reflect changes implemented in HADOOP-6255.
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /etc/hadoop
> /lib
> /libexec
> /sbin
> /share/hadoop
> /share/hadoop/lib
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3366) Mapreduce component should use
consistent directory structure layout as HDFS/common
Posted by "Mahadev konar (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13170426#comment-13170426 ]
Mahadev konar commented on MAPREDUCE-3366:
------------------------------------------
@Eric P,
The build procedure will still stay the same. Its just the structure of the tarball and the script locations will change.
> Mapreduce component should use consistent directory structure layout as HDFS/common
> -----------------------------------------------------------------------------------
>
> Key: MAPREDUCE-3366
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3366
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Environment: Java, Maven
> Reporter: Eric Yang
> Assignee: Eric Yang
> Labels: bigtop
> Attachments: MAPREDUCE-3366-1-trunk.patch, MAPREDUCE-3366-2-trunk.patch, MAPREDUCE-3366-3-trunk.patch, MAPREDUCE-3366-4-trunk.patch, MAPREDUCE-3366.patch, svn-rename-MAPREDUCE-3366-3.sh
>
>
> Directory structure for MRv2 layout looks like:
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /conf
> /lib
> /modules
> {noformat}
> The directory structure layout should be updated to reflect changes implemented in HADOOP-6255.
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /etc/hadoop
> /lib
> /libexec
> /sbin
> /share/hadoop
> /share/hadoop/lib
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3366) Mapreduce component should use
consistent directory structure layout as HDFS/common
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13170854#comment-13170854 ]
Hudson commented on MAPREDUCE-3366:
-----------------------------------
Integrated in Hadoop-Common-trunk-Commit #1442 (See [https://builds.apache.org/job/Hadoop-Common-trunk-Commit/1442/])
MAPREDUCE-3366. Mapreduce component should use consistent directory structure layout as HDFS/common (Eric Yang via mahadev)
mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1215065
Files :
* /hadoop/common/trunk/hadoop-assemblies/src/main/resources/assemblies/hadoop-mapreduce-dist.xml
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/bin/hadoop-config.sh
* /hadoop/common/trunk/hadoop-dist/pom.xml
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/INSTALL
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/slaves.sh
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/start-all.sh
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/start-yarn.sh
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/stop-all.sh
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/stop-yarn.sh
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/yarn
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/yarn-config.sh
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/yarn-daemon.sh
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/yarn-daemons.sh
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/conf/yarn-env.sh
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/ApplicationConstants.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-site/src/site/apt/SingleCluster.apt.vm
* /hadoop/common/trunk/hadoop-mapreduce-project/pom.xml
> Mapreduce component should use consistent directory structure layout as HDFS/common
> -----------------------------------------------------------------------------------
>
> Key: MAPREDUCE-3366
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3366
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Environment: Java, Maven
> Reporter: Eric Yang
> Assignee: Eric Yang
> Labels: bigtop
> Attachments: MAPREDUCE-3366-1-trunk.patch, MAPREDUCE-3366-2-trunk.patch, MAPREDUCE-3366-3-trunk.patch, MAPREDUCE-3366-4-trunk.patch, MAPREDUCE-3366.patch, svn-rename-MAPREDUCE-3366-3.sh
>
>
> Directory structure for MRv2 layout looks like:
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /conf
> /lib
> /modules
> {noformat}
> The directory structure layout should be updated to reflect changes implemented in HADOOP-6255.
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /etc/hadoop
> /lib
> /libexec
> /sbin
> /share/hadoop
> /share/hadoop/lib
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3366) Mapreduce component should use
consistent directory structure layout as HDFS/common
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13174055#comment-13174055 ]
Hudson commented on MAPREDUCE-3366:
-----------------------------------
Integrated in Hadoop-Hdfs-trunk #901 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk/901/])
MAPREDUCE-3588. Fixed bin/yarn which was broken by MAPREDUCE-3366 so that yarn daemons can start. Contributed by Arun C Murthy.
vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1221533
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/yarn
> Mapreduce component should use consistent directory structure layout as HDFS/common
> -----------------------------------------------------------------------------------
>
> Key: MAPREDUCE-3366
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3366
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Environment: Java, Maven
> Reporter: Eric Yang
> Assignee: Eric Yang
> Labels: bigtop
> Attachments: MAPREDUCE-3366-1-trunk.patch, MAPREDUCE-3366-2-trunk.patch, MAPREDUCE-3366-3-trunk.patch, MAPREDUCE-3366-4-trunk.patch, MAPREDUCE-3366.patch, svn-rename-MAPREDUCE-3366-3.sh
>
>
> Directory structure for MRv2 layout looks like:
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /conf
> /lib
> /modules
> {noformat}
> The directory structure layout should be updated to reflect changes implemented in HADOOP-6255.
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /etc/hadoop
> /lib
> /libexec
> /sbin
> /share/hadoop
> /share/hadoop/lib
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3366) Mapreduce component should use
consistent directory structure layout as HDFS/common
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13174066#comment-13174066 ]
Hudson commented on MAPREDUCE-3366:
-----------------------------------
Integrated in Hadoop-Hdfs-0.23-Build #114 (See [https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/114/])
MAPREDUCE-3588. Fixed bin/yarn which was broken by MAPREDUCE-3366 so that yarn daemons can start. Contributed by Arun C Murthy.
svn merge -c 1221533 --ignore-ancestry ../../trunk/
vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1221534
Files :
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/yarn
> Mapreduce component should use consistent directory structure layout as HDFS/common
> -----------------------------------------------------------------------------------
>
> Key: MAPREDUCE-3366
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3366
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Environment: Java, Maven
> Reporter: Eric Yang
> Assignee: Eric Yang
> Labels: bigtop
> Attachments: MAPREDUCE-3366-1-trunk.patch, MAPREDUCE-3366-2-trunk.patch, MAPREDUCE-3366-3-trunk.patch, MAPREDUCE-3366-4-trunk.patch, MAPREDUCE-3366.patch, svn-rename-MAPREDUCE-3366-3.sh
>
>
> Directory structure for MRv2 layout looks like:
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /conf
> /lib
> /modules
> {noformat}
> The directory structure layout should be updated to reflect changes implemented in HADOOP-6255.
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /etc/hadoop
> /lib
> /libexec
> /sbin
> /share/hadoop
> /share/hadoop/lib
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3366) Mapreduce component should use
consistent directory structure layout as HDFS/common
Posted by "Eric Yang (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13163136#comment-13163136 ]
Eric Yang commented on MAPREDUCE-3366:
--------------------------------------
The same trunk patch can apply cleanly to 0.23 branch for now.
> Mapreduce component should use consistent directory structure layout as HDFS/common
> -----------------------------------------------------------------------------------
>
> Key: MAPREDUCE-3366
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3366
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Environment: Java, Maven
> Reporter: Eric Yang
> Assignee: Eric Yang
> Attachments: MAPREDUCE-3366-1-trunk.patch, MAPREDUCE-3366.patch
>
>
> Directory structure for MRv2 layout looks like:
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /conf
> /lib
> /modules
> {noformat}
> The directory structure layout should be updated to reflect changes implemented in HADOOP-6255.
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /etc/hadoop
> /lib
> /libexec
> /sbin
> /share/hadoop
> /share/hadoop/lib
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3366) Mapreduce component should use
consistent directory structure layout as HDFS/common
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13170858#comment-13170858 ]
Hudson commented on MAPREDUCE-3366:
-----------------------------------
Integrated in Hadoop-Hdfs-0.23-Commit #287 (See [https://builds.apache.org/job/Hadoop-Hdfs-0.23-Commit/287/])
MAPREDUCE-3366. Mapreduce component should use consistent directory structure layout as HDFS/common (Eric Yang via mahadev) - Merging r1215065 from trunk
mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1215066
Files :
* /hadoop/common/branches/branch-0.23/hadoop-assemblies/src/main/resources/assemblies/hadoop-mapreduce-dist.xml
* /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/main/bin/hadoop-config.sh
* /hadoop/common/branches/branch-0.23/hadoop-dist/pom.xml
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/INSTALL
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/slaves.sh
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/start-all.sh
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/start-yarn.sh
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/stop-all.sh
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/stop-yarn.sh
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/yarn
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/yarn-config.sh
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/yarn-daemon.sh
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/yarn-daemons.sh
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/conf/yarn-env.sh
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/ApplicationConstants.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-site/src/site/apt/SingleCluster.apt.vm
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/pom.xml
> Mapreduce component should use consistent directory structure layout as HDFS/common
> -----------------------------------------------------------------------------------
>
> Key: MAPREDUCE-3366
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3366
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Environment: Java, Maven
> Reporter: Eric Yang
> Assignee: Eric Yang
> Labels: bigtop
> Attachments: MAPREDUCE-3366-1-trunk.patch, MAPREDUCE-3366-2-trunk.patch, MAPREDUCE-3366-3-trunk.patch, MAPREDUCE-3366-4-trunk.patch, MAPREDUCE-3366.patch, svn-rename-MAPREDUCE-3366-3.sh
>
>
> Directory structure for MRv2 layout looks like:
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /conf
> /lib
> /modules
> {noformat}
> The directory structure layout should be updated to reflect changes implemented in HADOOP-6255.
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /etc/hadoop
> /lib
> /libexec
> /sbin
> /share/hadoop
> /share/hadoop/lib
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3366) Mapreduce component should use
consistent directory structure layout as HDFS/common
Posted by "Eric Yang (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13169958#comment-13169958 ]
Eric Yang commented on MAPREDUCE-3366:
--------------------------------------
Patch build doesn't handle svn rename script, this is the reason pre-commit build fails on the patch test. The latest patch should be right and updated document.
Apply procedure:
{noformat}
svn-rename-MAPREDUCE-3366-3.sh
patch -p0 < MAPREDUCE-3366-4-trunk.patch
{noformat}
> Mapreduce component should use consistent directory structure layout as HDFS/common
> -----------------------------------------------------------------------------------
>
> Key: MAPREDUCE-3366
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3366
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Environment: Java, Maven
> Reporter: Eric Yang
> Assignee: Eric Yang
> Labels: bigtop
> Attachments: MAPREDUCE-3366-1-trunk.patch, MAPREDUCE-3366-2-trunk.patch, MAPREDUCE-3366-3-trunk.patch, MAPREDUCE-3366-4-trunk.patch, MAPREDUCE-3366.patch, svn-rename-MAPREDUCE-3366-3.sh
>
>
> Directory structure for MRv2 layout looks like:
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /conf
> /lib
> /modules
> {noformat}
> The directory structure layout should be updated to reflect changes implemented in HADOOP-6255.
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /etc/hadoop
> /lib
> /libexec
> /sbin
> /share/hadoop
> /share/hadoop/lib
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Issue Comment Edited] (MAPREDUCE-3366) Mapreduce component
should use consistent directory structure layout as HDFS/common
Posted by "Mahadev konar (Issue Comment Edited) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13170012#comment-13170012 ]
Mahadev konar edited comment on MAPREDUCE-3366 at 12/15/11 8:01 AM:
--------------------------------------------------------------------
@Eric,
The symlink would still be needed if you were running bin/hadoop jar ... No? I dont think you can get away without creating the symlinks in that case. Though it would only be needed on the gateway node and not on the cluster nodes.
was (Author: mahadev):
@Eric,
The symlink would still be needed if you were running bin/hadoop jar ... No? I dont think you can get away without creating the symlinks in that case.
> Mapreduce component should use consistent directory structure layout as HDFS/common
> -----------------------------------------------------------------------------------
>
> Key: MAPREDUCE-3366
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3366
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Environment: Java, Maven
> Reporter: Eric Yang
> Assignee: Eric Yang
> Labels: bigtop
> Attachments: MAPREDUCE-3366-1-trunk.patch, MAPREDUCE-3366-2-trunk.patch, MAPREDUCE-3366-3-trunk.patch, MAPREDUCE-3366-4-trunk.patch, MAPREDUCE-3366.patch, svn-rename-MAPREDUCE-3366-3.sh
>
>
> Directory structure for MRv2 layout looks like:
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /conf
> /lib
> /modules
> {noformat}
> The directory structure layout should be updated to reflect changes implemented in HADOOP-6255.
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /etc/hadoop
> /lib
> /libexec
> /sbin
> /share/hadoop
> /share/hadoop/lib
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3366) Mapreduce component should use
consistent directory structure layout as HDFS/common
Posted by "Bruno Mahé (Commented JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13163205#comment-13163205 ]
Bruno Mahé commented on MAPREDUCE-3366:
---------------------------------------
Great! Thanks a lot!
Regarding merging all configurations in HADOOP_CONF_DIR, this definitely makes sense.
> Mapreduce component should use consistent directory structure layout as HDFS/common
> -----------------------------------------------------------------------------------
>
> Key: MAPREDUCE-3366
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3366
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Environment: Java, Maven
> Reporter: Eric Yang
> Assignee: Eric Yang
> Attachments: MAPREDUCE-3366-1-trunk.patch, MAPREDUCE-3366-2-trunk.patch, MAPREDUCE-3366.patch
>
>
> Directory structure for MRv2 layout looks like:
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /conf
> /lib
> /modules
> {noformat}
> The directory structure layout should be updated to reflect changes implemented in HADOOP-6255.
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /etc/hadoop
> /lib
> /libexec
> /sbin
> /share/hadoop
> /share/hadoop/lib
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3366) Mapreduce component should use
consistent directory structure layout as HDFS/common
Posted by "Eric Yang (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13166406#comment-13166406 ]
Eric Yang commented on MAPREDUCE-3366:
--------------------------------------
bq. Does this subsume MAPREDUCE-3416?
Yes.
> Mapreduce component should use consistent directory structure layout as HDFS/common
> -----------------------------------------------------------------------------------
>
> Key: MAPREDUCE-3366
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3366
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Environment: Java, Maven
> Reporter: Eric Yang
> Assignee: Eric Yang
> Labels: bigtop
> Attachments: MAPREDUCE-3366-1-trunk.patch, MAPREDUCE-3366-2-trunk.patch, MAPREDUCE-3366-3-trunk.patch, MAPREDUCE-3366.patch, svn-rename-MAPREDUCE-3366-3.sh
>
>
> Directory structure for MRv2 layout looks like:
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /conf
> /lib
> /modules
> {noformat}
> The directory structure layout should be updated to reflect changes implemented in HADOOP-6255.
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /etc/hadoop
> /lib
> /libexec
> /sbin
> /share/hadoop
> /share/hadoop/lib
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3366) Mapreduce component should use
consistent directory structure layout as HDFS/common
Posted by "Eric Yang (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Eric Yang updated MAPREDUCE-3366:
---------------------------------
Attachment: MAPREDUCE-3366-2-trunk.patch
Updated LIBEXEC to match what was done in MAPREDUCE-3373.
> Mapreduce component should use consistent directory structure layout as HDFS/common
> -----------------------------------------------------------------------------------
>
> Key: MAPREDUCE-3366
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3366
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Environment: Java, Maven
> Reporter: Eric Yang
> Assignee: Eric Yang
> Attachments: MAPREDUCE-3366-1-trunk.patch, MAPREDUCE-3366-2-trunk.patch, MAPREDUCE-3366.patch
>
>
> Directory structure for MRv2 layout looks like:
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /conf
> /lib
> /modules
> {noformat}
> The directory structure layout should be updated to reflect changes implemented in HADOOP-6255.
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /etc/hadoop
> /lib
> /libexec
> /sbin
> /share/hadoop
> /share/hadoop/lib
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3366) Mapreduce component should use
consistent directory structure layout as HDFS/common
Posted by "Mahadev konar (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13166491#comment-13166491 ]
Mahadev konar commented on MAPREDUCE-3366:
------------------------------------------
I am trying to get it tested on secure cluster, will update on how that goes.
> Mapreduce component should use consistent directory structure layout as HDFS/common
> -----------------------------------------------------------------------------------
>
> Key: MAPREDUCE-3366
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3366
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Environment: Java, Maven
> Reporter: Eric Yang
> Assignee: Eric Yang
> Labels: bigtop
> Attachments: MAPREDUCE-3366-1-trunk.patch, MAPREDUCE-3366-2-trunk.patch, MAPREDUCE-3366-3-trunk.patch, MAPREDUCE-3366.patch, svn-rename-MAPREDUCE-3366-3.sh
>
>
> Directory structure for MRv2 layout looks like:
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /conf
> /lib
> /modules
> {noformat}
> The directory structure layout should be updated to reflect changes implemented in HADOOP-6255.
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /etc/hadoop
> /lib
> /libexec
> /sbin
> /share/hadoop
> /share/hadoop/lib
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3366) Mapreduce component should use
consistent directory structure layout as HDFS/common
Posted by "Mahadev konar (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Mahadev konar updated MAPREDUCE-3366:
-------------------------------------
Status: Open (was: Patch Available)
@Eric,
I am getting the same erros as Alejandro:
{noformat}
sbin/yarn-daemon.sh: line 44: /X/workspace/install/hadoop-mapreduce/sbin/yarn-config.sh: No such file or directory
starting resourcemanager, logging to /X/workspace/install/hadoop-mapreduce/logs/yarn-mahadev-resourcemanager.out
/X/install/hadoop-mapreduce/bin/yarn: line 49: /X/workspace/install/hadoop-mapreduce/bin/yarn-config.sh: No such file or directory
/System/Library/Frameworks/JavaVM.framework/Home/bin/java -Dproc_--config -Xmx1000m -Dhadoop.log.dir=/X/workspace/install/hadoop-mapreduce/logs -Dyarn.log.dir=/X/workspace/install/hadoop-mapreduce/logs -Dhadoop.log.file=yarn-mahadev-resourcemanager.log -Dyarn.log.file=yarn.log -Dyarn.home.dir=/X/workspace/install/hadoop-mapreduce -Dhadoop.root.logger=INFO,DRFA -Dyarn.root.logger=INFO,DRFA -classpath /X/workspace/install/conf:/X/workspace/install/conf::/System/Library/Frameworks/JavaVM.framework/Home/lib/tools.jar --config /X/workspace/install/conf resourcemanager
{noformat}
> Mapreduce component should use consistent directory structure layout as HDFS/common
> -----------------------------------------------------------------------------------
>
> Key: MAPREDUCE-3366
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3366
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Environment: Java, Maven
> Reporter: Eric Yang
> Assignee: Eric Yang
> Attachments: MAPREDUCE-3366-1-trunk.patch, MAPREDUCE-3366-2-trunk.patch, MAPREDUCE-3366.patch
>
>
> Directory structure for MRv2 layout looks like:
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /conf
> /lib
> /modules
> {noformat}
> The directory structure layout should be updated to reflect changes implemented in HADOOP-6255.
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /etc/hadoop
> /lib
> /libexec
> /sbin
> /share/hadoop
> /share/hadoop/lib
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3366) Mapreduce component should use
consistent directory structure layout as HDFS/common
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13173674#comment-13173674 ]
Hudson commented on MAPREDUCE-3366:
-----------------------------------
Integrated in Hadoop-Mapreduce-trunk-Commit #1482 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/1482/])
MAPREDUCE-3588. Fixed bin/yarn which was broken by MAPREDUCE-3366 so that yarn daemons can start. Contributed by Arun C Murthy.
vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1221533
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/bin/yarn
> Mapreduce component should use consistent directory structure layout as HDFS/common
> -----------------------------------------------------------------------------------
>
> Key: MAPREDUCE-3366
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3366
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Environment: Java, Maven
> Reporter: Eric Yang
> Assignee: Eric Yang
> Labels: bigtop
> Attachments: MAPREDUCE-3366-1-trunk.patch, MAPREDUCE-3366-2-trunk.patch, MAPREDUCE-3366-3-trunk.patch, MAPREDUCE-3366-4-trunk.patch, MAPREDUCE-3366.patch, svn-rename-MAPREDUCE-3366-3.sh
>
>
> Directory structure for MRv2 layout looks like:
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /conf
> /lib
> /modules
> {noformat}
> The directory structure layout should be updated to reflect changes implemented in HADOOP-6255.
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /etc/hadoop
> /lib
> /libexec
> /sbin
> /share/hadoop
> /share/hadoop/lib
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3366) Mapreduce component should use
consistent directory structure layout as HDFS/common
Posted by "Eli Collins (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Eli Collins updated MAPREDUCE-3366:
-----------------------------------
Fix Version/s: 0.23.1
> Mapreduce component should use consistent directory structure layout as HDFS/common
> -----------------------------------------------------------------------------------
>
> Key: MAPREDUCE-3366
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3366
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Environment: Java, Maven
> Reporter: Eric Yang
> Assignee: Eric Yang
> Labels: bigtop
> Fix For: 0.23.1
>
> Attachments: MAPREDUCE-3366-1-trunk.patch, MAPREDUCE-3366-2-trunk.patch, MAPREDUCE-3366-3-trunk.patch, MAPREDUCE-3366-4-trunk.patch, MAPREDUCE-3366.patch, svn-rename-MAPREDUCE-3366-3.sh
>
>
> Directory structure for MRv2 layout looks like:
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /conf
> /lib
> /modules
> {noformat}
> The directory structure layout should be updated to reflect changes implemented in HADOOP-6255.
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /etc/hadoop
> /lib
> /libexec
> /sbin
> /share/hadoop
> /share/hadoop/lib
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3366) Mapreduce component should use
consistent directory structure layout as HDFS/common
Posted by "Hitesh Shah (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13152200#comment-13152200 ]
Hitesh Shah commented on MAPREDUCE-3366:
----------------------------------------
For MR jobs to work properly with the above change, APPLICATION_CLASSPATH in ApplicationConstants.java will also likely need to be changed.
> Mapreduce component should use consistent directory structure layout as HDFS/common
> -----------------------------------------------------------------------------------
>
> Key: MAPREDUCE-3366
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3366
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Environment: Java, Maven
> Reporter: Eric Yang
> Assignee: Eric Yang
> Attachments: MAPREDUCE-3366.patch
>
>
> Directory structure for MRv2 layout looks like:
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /conf
> /lib
> /modules
> {noformat}
> The directory structure layout should be updated to reflect changes implemented in HADOOP-6255.
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /etc/hadoop
> /lib
> /libexec
> /sbin
> /share/hadoop
> /share/hadoop/lib
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3366) Mapreduce component should use
consistent directory structure layout as HDFS/common
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13170877#comment-13170877 ]
Hudson commented on MAPREDUCE-3366:
-----------------------------------
Integrated in Hadoop-Mapreduce-0.23-Commit #310 (See [https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Commit/310/])
MAPREDUCE-3366. Mapreduce component should use consistent directory structure layout as HDFS/common (Eric Yang via mahadev) - Merging r1215065 from trunk
mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1215066
Files :
* /hadoop/common/branches/branch-0.23/hadoop-assemblies/src/main/resources/assemblies/hadoop-mapreduce-dist.xml
* /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/main/bin/hadoop-config.sh
* /hadoop/common/branches/branch-0.23/hadoop-dist/pom.xml
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/INSTALL
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/slaves.sh
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/start-all.sh
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/start-yarn.sh
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/stop-all.sh
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/stop-yarn.sh
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/yarn
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/yarn-config.sh
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/yarn-daemon.sh
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/yarn-daemons.sh
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/conf/yarn-env.sh
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/ApplicationConstants.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-site/src/site/apt/SingleCluster.apt.vm
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/pom.xml
> Mapreduce component should use consistent directory structure layout as HDFS/common
> -----------------------------------------------------------------------------------
>
> Key: MAPREDUCE-3366
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3366
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Environment: Java, Maven
> Reporter: Eric Yang
> Assignee: Eric Yang
> Labels: bigtop
> Attachments: MAPREDUCE-3366-1-trunk.patch, MAPREDUCE-3366-2-trunk.patch, MAPREDUCE-3366-3-trunk.patch, MAPREDUCE-3366-4-trunk.patch, MAPREDUCE-3366.patch, svn-rename-MAPREDUCE-3366-3.sh
>
>
> Directory structure for MRv2 layout looks like:
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /conf
> /lib
> /modules
> {noformat}
> The directory structure layout should be updated to reflect changes implemented in HADOOP-6255.
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /etc/hadoop
> /lib
> /libexec
> /sbin
> /share/hadoop
> /share/hadoop/lib
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3366) Mapreduce component should use
consistent directory structure layout as HDFS/common
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13170962#comment-13170962 ]
Hudson commented on MAPREDUCE-3366:
-----------------------------------
Integrated in Hadoop-Mapreduce-0.23-Build #129 (See [https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Build/129/])
MAPREDUCE-3366. Mapreduce component should use consistent directory structure layout as HDFS/common (Eric Yang via mahadev) - Merging r1215065 from trunk
mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1215066
Files :
* /hadoop/common/branches/branch-0.23/hadoop-assemblies/src/main/resources/assemblies/hadoop-mapreduce-dist.xml
* /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/main/bin/hadoop-config.sh
* /hadoop/common/branches/branch-0.23/hadoop-dist/pom.xml
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/INSTALL
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/slaves.sh
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/start-all.sh
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/start-yarn.sh
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/stop-all.sh
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/stop-yarn.sh
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/yarn
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/yarn-config.sh
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/yarn-daemon.sh
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/bin/yarn-daemons.sh
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/conf/yarn-env.sh
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/ApplicationConstants.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-site/src/site/apt/SingleCluster.apt.vm
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/pom.xml
> Mapreduce component should use consistent directory structure layout as HDFS/common
> -----------------------------------------------------------------------------------
>
> Key: MAPREDUCE-3366
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3366
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Environment: Java, Maven
> Reporter: Eric Yang
> Assignee: Eric Yang
> Labels: bigtop
> Attachments: MAPREDUCE-3366-1-trunk.patch, MAPREDUCE-3366-2-trunk.patch, MAPREDUCE-3366-3-trunk.patch, MAPREDUCE-3366-4-trunk.patch, MAPREDUCE-3366.patch, svn-rename-MAPREDUCE-3366-3.sh
>
>
> Directory structure for MRv2 layout looks like:
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /conf
> /lib
> /modules
> {noformat}
> The directory structure layout should be updated to reflect changes implemented in HADOOP-6255.
> {noformat}
> hadoop-mapreduce-0.23.0-SNAPSHOT/bin
> /etc/hadoop
> /lib
> /libexec
> /sbin
> /share/hadoop
> /share/hadoop/lib
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira