You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-commits@hadoop.apache.org by ma...@apache.org on 2011/11/15 03:05:25 UTC
svn commit: r1202002 - in /hadoop/common/trunk/hadoop-mapreduce-project:
CHANGES.txt hadoop-yarn/hadoop-yarn-site/src/site/apt/SingleCluster.apt.vm
Author: mahadev
Date: Tue Nov 15 02:05:25 2011
New Revision: 1202002
URL: http://svn.apache.org/viewvc?rev=1202002&view=rev
Log:
MAPREDUCE-3331. Improvement to single node cluster setup documentation for 0.23 (Anupam Seth via mahadev)
Modified:
hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-site/src/site/apt/SingleCluster.apt.vm
Modified: hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
URL: http://svn.apache.org/viewvc/hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt?rev=1202002&r1=1202001&r2=1202002&view=diff
==============================================================================
--- hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt (original)
+++ hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt Tue Nov 15 02:05:25 2011
@@ -88,6 +88,9 @@ Release 0.23.1 - Unreleased
MAPREDUCE-3243. Invalid tracking URL for streaming jobs (Jonathan Eagles
via mahadev)
+ MAPREDUCE-3331. Improvement to single node cluster setup documentation for
+ 0.23 (Anupam Seth via mahadev)
+
OPTIMIZATIONS
BUG FIXES
Modified: hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-site/src/site/apt/SingleCluster.apt.vm
URL: http://svn.apache.org/viewvc/hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-site/src/site/apt/SingleCluster.apt.vm?rev=1202002&r1=1202001&r2=1202002&view=diff
==============================================================================
--- hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-site/src/site/apt/SingleCluster.apt.vm (original)
+++ hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-site/src/site/apt/SingleCluster.apt.vm Tue Nov 15 02:05:25 2011
@@ -41,7 +41,7 @@ $ mvn clean install assembly:assembly -P
* Setting up the environment.
Assuming you have installed hadoop-common/hadoop-hdfs and exported
- <<$HADOOP_COMMON_HOME>>/<<$HADOOP_COMMON_HOME>>, untar hadoop mapreduce
+ <<$HADOOP_COMMON_HOME>>/<<$HADOOP_HDFS_HOME>>, untar hadoop mapreduce
tarball and set environment variable <<$HADOOP_MAPRED_HOME>> to the
untarred directory. Set <<$YARN_HOME>> the same as <<$HADOOP_MAPRED_HOME>>.
@@ -79,15 +79,15 @@ $ mvn clean install assembly:assembly -P
Add the following configs to your <<<yarn-site.xml>>>
+---+
- <property>
+ <property>
<name>yarn.resourcemanager.resource-tracker.address</name>
<value>host:port</value>
<description>host is the hostname of the resource manager and
port is the port on which the NodeManagers contact the Resource Manager.
</description>
- </property>
+ </property>
- <property>
+ <property>
<name>yarn.resourcemanager.scheduler.address</name>
<value>host:port</value>
<description>host is the hostname of the resourcemanager and port is the port
@@ -145,6 +145,32 @@ Add the following configs to your <<<yar
</property>
+---+
+** Setting up <<<capacity-scheduler.xml>>>
+
+ Make sure you populate the root queues in <<<capacity-scheduler.xml>>>.
+
++---+
+ <property>
+ <name>yarn.scheduler.capacity.root.queues</name>
+ <value>unfunded,default</value>
+ </property>
+
+ <property>
+ <name>yarn.scheduler.capacity.root.capacity</name>
+ <value>100</value>
+ </property>
+
+ <property>
+ <name>yarn.scheduler.capacity.root.unfunded.capacity</name>
+ <value>50</value>
+ </property>
+
+ <property>
+ <name>yarn.scheduler.capacity.root.default.capacity</name>
+ <value>50</value>
+ </property>
++---+
+
* Create Symlinks.
You will have to create the following symlinks: