You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-commits@hadoop.apache.org by xg...@apache.org on 2016/12/27 19:52:12 UTC
[04/14] hadoop git commit: MAPREDUCE-6704. Update the documents to
run MapReduce application. Contributed by Bibin A Chundatt.
MAPREDUCE-6704. Update the documents to run MapReduce application. Contributed by Bibin A Chundatt.
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/22befbd5
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/22befbd5
Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/22befbd5
Branch: refs/heads/YARN-5734
Commit: 22befbd585f65934e1d9ae5782a8f961192c0750
Parents: 38e66d4
Author: Akira Ajisaka <aa...@apache.org>
Authored: Fri Dec 23 04:48:04 2016 +0900
Committer: Akira Ajisaka <aa...@apache.org>
Committed: Fri Dec 23 04:48:04 2016 +0900
----------------------------------------------------------------------
.../hadoop-common/src/site/markdown/ClusterSetup.md | 1 +
.../hadoop-common/src/site/markdown/SingleCluster.md.vm | 12 ++++--------
2 files changed, 5 insertions(+), 8 deletions(-)
----------------------------------------------------------------------
http://git-wip-us.apache.org/repos/asf/hadoop/blob/22befbd5/hadoop-common-project/hadoop-common/src/site/markdown/ClusterSetup.md
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/ClusterSetup.md b/hadoop-common-project/hadoop-common/src/site/markdown/ClusterSetup.md
index 56b43e6..e2ccbf0 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/ClusterSetup.md
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/ClusterSetup.md
@@ -156,6 +156,7 @@ This section deals with important parameters to be specified in the given config
| `yarn.nodemanager.remote-app-log-dir` | */logs* | HDFS directory where the application logs are moved on application completion. Need to set appropriate permissions. Only applicable if log-aggregation is enabled. |
| `yarn.nodemanager.remote-app-log-dir-suffix` | *logs* | Suffix appended to the remote log dir. Logs will be aggregated to ${yarn.nodemanager.remote-app-log-dir}/${user}/${thisParam} Only applicable if log-aggregation is enabled. |
| `yarn.nodemanager.aux-services` | mapreduce\_shuffle | Shuffle service that needs to be set for Map Reduce applications. |
+| `yarn.nodemanager.env-whitelist` | Environment properties to be inherited by containers from NodeManagers | For mapreduce application in addition to the default values HADOOP\_MAPRED_HOME should to be added. Property value should JAVA\_HOME,HADOOP\_COMMON\_HOME,HADOOP\_HDFS\_HOME,HADOOP\_CONF\_DIR,CLASSPATH\_PREPEND\_DISTCACHE,HADOOP\_YARN\_HOME,HADOOP\_MAPRED\_HOME |
* Configurations for History Server (Needs to be moved elsewhere):
http://git-wip-us.apache.org/repos/asf/hadoop/blob/22befbd5/hadoop-common-project/hadoop-common/src/site/markdown/SingleCluster.md.vm
----------------------------------------------------------------------
diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/SingleCluster.md.vm b/hadoop-common-project/hadoop-common/src/site/markdown/SingleCluster.md.vm
index 4825e00..fb4df9a 100644
--- a/hadoop-common-project/hadoop-common/src/site/markdown/SingleCluster.md.vm
+++ b/hadoop-common-project/hadoop-common/src/site/markdown/SingleCluster.md.vm
@@ -190,14 +190,6 @@ The following instructions assume that 1. ~ 4. steps of [the above instructions]
<name>mapreduce.framework.name</name>
<value>yarn</value>
</property>
- <property>
- <name>mapreduce.admin.user.env</name>
- <value>HADOOP_MAPRED_HOME=$HADOOP_COMMON_HOME</value>
- </property>
- <property>
- <name>yarn.app.mapreduce.am.env</name>
- <value>HADOOP_MAPRED_HOME=$HADOOP_COMMON_HOME</value>
- </property>
</configuration>
`etc/hadoop/yarn-site.xml`:
@@ -207,6 +199,10 @@ The following instructions assume that 1. ~ 4. steps of [the above instructions]
<name>yarn.nodemanager.aux-services</name>
<value>mapreduce_shuffle</value>
</property>
+ <property>
+ <name>yarn.nodemanager.env-whitelist</name>
+ <value>JAVA_HOME,HADOOP_COMMON_HOME,HADOOP_HDFS_HOME,HADOOP_CONF_DIR,CLASSPATH_PREPEND_DISTCACHE,HADOOP_YARN_HOME,HADOOP_MAPRED_HOME</value>
+ </property>
</configuration>
2. Start ResourceManager daemon and NodeManager daemon:
---------------------------------------------------------------------
To unsubscribe, e-mail: common-commits-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-commits-help@hadoop.apache.org