You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-commits@hadoop.apache.org by el...@apache.org on 2011/05/18 20:47:33 UTC

svn commit: r1124374 - in /hadoop/mapreduce/trunk: CHANGES.txt src/docs/src/documentation/content/xdocs/fair_scheduler.xml

Author: eli
Date: Wed May 18 18:47:33 2011
New Revision: 1124374

URL: http://svn.apache.org/viewvc?rev=1124374&view=rev
Log:
MAPREDUCE-2505. Explain how to use ACLs in the fair scheduler. Contributed by Matei Zaharia.

Modified:
    hadoop/mapreduce/trunk/CHANGES.txt
    hadoop/mapreduce/trunk/src/docs/src/documentation/content/xdocs/fair_scheduler.xml

Modified: hadoop/mapreduce/trunk/CHANGES.txt
URL: http://svn.apache.org/viewvc/hadoop/mapreduce/trunk/CHANGES.txt?rev=1124374&r1=1124373&r2=1124374&view=diff
==============================================================================
--- hadoop/mapreduce/trunk/CHANGES.txt (original)
+++ hadoop/mapreduce/trunk/CHANGES.txt Wed May 18 18:47:33 2011
@@ -395,6 +395,9 @@ Release 0.22.0 - Unreleased
     MAPREDUCE-2103. task-controller shouldn't require o-r permissions.
     (todd via eli)
 
+    MAPREDUCE-2505. Explain how to use ACLs in the fair scheduler.
+    (matei via eli)
+
   OPTIMIZATIONS
 
     MAPREDUCE-1354. Enhancements to JobTracker for better performance and

Modified: hadoop/mapreduce/trunk/src/docs/src/documentation/content/xdocs/fair_scheduler.xml
URL: http://svn.apache.org/viewvc/hadoop/mapreduce/trunk/src/docs/src/documentation/content/xdocs/fair_scheduler.xml?rev=1124374&r1=1124373&r2=1124374&view=diff
==============================================================================
--- hadoop/mapreduce/trunk/src/docs/src/documentation/content/xdocs/fair_scheduler.xml (original)
+++ hadoop/mapreduce/trunk/src/docs/src/documentation/content/xdocs/fair_scheduler.xml Wed May 18 18:47:33 2011
@@ -185,9 +185,9 @@
             Specify which jobconf property is used to determine the pool that a
             job belongs in. String, default: <em>mapreduce.job.user.name</em>
             (i.e. one pool for each user). 
-            Another useful value is <em>group.name</em> to create a
-            pool per Unix group.
-            mapred.fairscheduler. poolnameproperty is used only for jobs in which 
+            Another useful value is <em>mapreduce.job.queuename</em> to use MapReduce's "queue"
+            system for access control lists (see below).
+            mapred.fairscheduler.poolnameproperty is used only for jobs in which 
             mapred.fairscheduler.pool is not explicitly set.
           </td>
           </tr>
@@ -441,6 +441,29 @@
         number of jobs.
         </p>
       </section>
+      <section>
+        <title>Access Control Lists (ACLs)</title>
+        <p>
+          The fair scheduler can be used in tandem with the "queue" based access
+          control system in MapReduce to restrict which pools each user can access.
+          To do this, first enable ACLs and set up some queues as described in the
+          <a href="mapred_tutorial.html#Job+Authorization">MapReduce usage guide</a>,
+          then set the fair scheduler to use one pool per queue by adding
+          the following property in <em>HADOOP_CONF_DIR/mapred-site.xml</em>:
+        </p>
+<source>
+&lt;property&gt;
+  &lt;name&gt;mapred.fairscheduler.poolnameproperty&lt;/name&gt;
+  &lt;value&gt;mapreduce.job.queuename&lt;/value&gt;
+&lt;/property&gt;
+</source>
+        <p>
+          You can then set the minimum share, weight, and internal scheduling mode
+          for each pool as described earlier.
+          In addition, make sure that users submit jobs to the right queue by setting
+          the <em>mapreduce.job.queuename</em> property in their jobs.
+        </p>
+      </section>
     </section>
     <section>
     <title> Administration</title>