You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-commits@hadoop.apache.org by ac...@apache.org on 2011/10/31 18:33:29 UTC
svn commit: r1195579 - in /hadoop/common/trunk/hadoop-mapreduce-project:
CHANGES.txt hadoop-yarn/hadoop-yarn-site/src/site/apt/ClusterSetup.apt.vm
Author: acmurthy
Date: Mon Oct 31 17:33:29 2011
New Revision: 1195579
URL: http://svn.apache.org/viewvc?rev=1195579&view=rev
Log:
MAPREDUCE-3275. Added documentation for AM WebApp Proxy. Contributed by Robert Evans.
Modified:
hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-site/src/site/apt/ClusterSetup.apt.vm
Modified: hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
URL: http://svn.apache.org/viewvc/hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt?rev=1195579&r1=1195578&r2=1195579&view=diff
==============================================================================
--- hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt (original)
+++ hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt Mon Oct 31 17:33:29 2011
@@ -452,6 +452,9 @@ Release 0.23.0 - Unreleased
MAPREDUCE-3146. Added a MR specific command line to dump logs for a
given TaskAttemptID. (Siddharth Seth via vinodkv)
+ MAPREDUCE-3275. Added documentation for AM WebApp Proxy. (Robert Evans via
+ acmurthy)
+
OPTIMIZATIONS
MAPREDUCE-2026. Make JobTracker.getJobCounters() and
Modified: hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-site/src/site/apt/ClusterSetup.apt.vm
URL: http://svn.apache.org/viewvc/hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-site/src/site/apt/ClusterSetup.apt.vm?rev=1195579&r1=1195578&r2=1195579&view=diff
==============================================================================
--- hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-site/src/site/apt/ClusterSetup.apt.vm (original)
+++ hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-site/src/site/apt/ClusterSetup.apt.vm Mon Oct 31 17:33:29 2011
@@ -101,6 +101,8 @@ Hadoop MapReduce Next Generation - Clust
*--------------------------------------+--------------------------------------+
| NodeManager | YARN_NODEMANAGER_OPTS |
*--------------------------------------+--------------------------------------+
+| WebAppProxy | YARN_PROXYSERVER_OPTS |
+*--------------------------------------+--------------------------------------+
For example, To configure Namenode to use parallelGC, the following
statement should be added in hadoop-env.sh :
@@ -450,9 +452,16 @@ Hadoop MapReduce Next Generation - Clust
Run a script to start NodeManagers on all slaves:
----
- $ $YARN_HOME/bin/hdfs start nodemanager --config $HADOOP_CONF_DIR
+ $ $YARN_HOME/bin/yarn start nodemanager --config $HADOOP_CONF_DIR
----
+ Start a standalone WebAppProxy server. If multiple servers
+ are used with load balancing it should be run on each of them:
+
+----
+ $ $YARN_HOME/bin/yarn start proxyserver --config $HADOOP_CONF_DIR
+----
+
Start the MapReduce JobHistory Server with the following command, run on the
designated server:
@@ -485,9 +494,17 @@ Hadoop MapReduce Next Generation - Clust
Run a script to stop NodeManagers on all slaves:
----
- $ $YARN_HOME/bin/hdfs stop nodemanager --config $HADOOP_CONF_DIR
+ $ $YARN_HOME/bin/yarn stop nodemanager --config $HADOOP_CONF_DIR
----
+ Stop the WebAppProxy server. If multiple servers are used with load
+ balancing it should be run on each of them:
+
+----
+ $ $YARN_HOME/bin/yarn stop proxyserver --config $HADOOP_CONF_DIR
+----
+
+
Stop the MapReduce JobHistory Server with the following command, run on the
designated server:
@@ -502,7 +519,7 @@ Hadoop MapReduce Next Generation - Clust
to run Hadoop in <<secure mode>> with strong, Kerberos-based
authentication.
- * <<<User Acccounts for Hadoop Daemons>>>
+ * <<<User Accounts for Hadoop Daemons>>>
Ensure that HDFS and YARN daemons run as different Unix users, for e.g.
<<<hdfs>>> and <<<yarn>>>. Also, ensure that the MapReduce JobHistory
@@ -751,6 +768,31 @@ KVNO Timestamp Principal
* <<<conf/yarn-site.xml>>>
+ * WebAppProxy
+
+ The <<<WebAppProxy>>> provides a proxy between the web applications
+ exported by an application and an end user. If security is enabled
+ it will warn users before accessing a potentially unsafe web application.
+ Authentication and authorization using the proxy is handled just like
+ any other privileged web application.
+
+*-------------------------+-------------------------+------------------------+
+|| Parameter || Value || Notes |
+*-------------------------+-------------------------+------------------------+
+| <<<yarn.web-proxy.address>>> | | |
+| | <<<WebAppProxy>>> host:port for proxy to AM web apps. | |
+| | | <host:port> if this is the same as <<<yarn.resourcemanager.webapp.address>>>|
+| | | or it is not defined then the <<<ResourceManager>>> will run the proxy|
+| | | otherwise a standalone proxy server will need to be launched.|
+*-------------------------+-------------------------+------------------------+
+| <<<yarn.web-proxy.keytab>>> | | |
+| | </etc/security/keytab/web-app.service.keytab> | |
+| | | Kerberos keytab file for the WebAppProxy. |
+*-------------------------+-------------------------+------------------------+
+| <<<yarn.web-proxy.principal>>> | wap/_HOST@REALM.TLD | |
+| | | Kerberos principal name for the WebAppProxy. |
+*-------------------------+-------------------------+------------------------+
+
* LinuxContainerExecutor
A <<<ContainerExecutor>>> used by YARN framework which define how any
@@ -968,7 +1010,15 @@ KVNO Timestamp Principal
Run a script to start NodeManagers on all slaves as <yarn>:
----
-[yarn]$ $YARN_HOME/bin/hdfs start nodemanager --config $HADOOP_CONF_DIR
+[yarn]$ $YARN_HOME/bin/yarn start nodemanager --config $HADOOP_CONF_DIR
+----
+
+ Start a standalone WebAppProxy server. Run on the WebAppProxy
+ server as <yarn>. If multiple servers are used with load balancing
+ it should be run on each of them:
+
+----
+[yarn]$ $YARN_HOME/bin/yarn start proxyserver --config $HADOOP_CONF_DIR
----
Start the MapReduce JobHistory Server with the following command, run on the
@@ -1003,12 +1053,20 @@ KVNO Timestamp Principal
Run a script to stop NodeManagers on all slaves as <yarn>:
----
-[yarn]$ $YARN_HOME/bin/hdfs stop nodemanager --config $HADOOP_CONF_DIR
+[yarn]$ $YARN_HOME/bin/yarn stop nodemanager --config $HADOOP_CONF_DIR
----
+ Stop the WebAppProxy server. Run on the WebAppProxy server as
+ <yarn>. If multiple servers are used with load balancing it
+ should be run on each of them:
+
+----
+[yarn]$ $YARN_HOME/bin/yarn stop proxyserver --config $HADOOP_CONF_DIR
+----
+
Stop the MapReduce JobHistory Server with the following command, run on the
designated server as <mapred>:
-
+
----
[mapred]$ $YARN_HOME/bin/yarn stop historyserver --config $HADOOP_CONF_DIR
----