You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-commits@hadoop.apache.org by om...@apache.org on 2008/10/20 19:12:39 UTC
svn commit: r706341 [1/4] - in /hadoop/core/branches/branch-0.19: ./ docs/
src/docs/src/documentation/content/xdocs/
Author: omalley
Date: Mon Oct 20 10:12:38 2008
New Revision: 706341
URL: http://svn.apache.org/viewvc?rev=706341&view=rev
Log:
HADOOP-4321. Include documentation for the capacity scheduler. (Hemanth
Yamijala via omalley)
Merge -r 706337:706338 from trunk to branch 0.19.
Added:
hadoop/core/branches/branch-0.19/docs/capacity_scheduler.html
hadoop/core/branches/branch-0.19/docs/capacity_scheduler.pdf
hadoop/core/branches/branch-0.19/src/docs/src/documentation/content/xdocs/capacity_scheduler.xml
- copied unchanged from r706338, hadoop/core/trunk/src/docs/src/documentation/content/xdocs/capacity_scheduler.xml
Modified:
hadoop/core/branches/branch-0.19/CHANGES.txt
hadoop/core/branches/branch-0.19/docs/SLG_user_guide.html
hadoop/core/branches/branch-0.19/docs/changes.html
hadoop/core/branches/branch-0.19/docs/cluster_setup.html
hadoop/core/branches/branch-0.19/docs/cluster_setup.pdf
hadoop/core/branches/branch-0.19/docs/commands_manual.html
hadoop/core/branches/branch-0.19/docs/distcp.html
hadoop/core/branches/branch-0.19/docs/hadoop_archives.html
hadoop/core/branches/branch-0.19/docs/hdfs_design.html
hadoop/core/branches/branch-0.19/docs/hdfs_permissions_guide.html
hadoop/core/branches/branch-0.19/docs/hdfs_quota_admin_guide.html
hadoop/core/branches/branch-0.19/docs/hdfs_shell.html
hadoop/core/branches/branch-0.19/docs/hdfs_user_guide.html
hadoop/core/branches/branch-0.19/docs/hod.html
hadoop/core/branches/branch-0.19/docs/hod_admin_guide.html
hadoop/core/branches/branch-0.19/docs/hod_config_guide.html
hadoop/core/branches/branch-0.19/docs/hod_user_guide.html
hadoop/core/branches/branch-0.19/docs/index.html
hadoop/core/branches/branch-0.19/docs/linkmap.html
hadoop/core/branches/branch-0.19/docs/linkmap.pdf
hadoop/core/branches/branch-0.19/docs/mapred_tutorial.html
hadoop/core/branches/branch-0.19/docs/mapred_tutorial.pdf
hadoop/core/branches/branch-0.19/docs/native_libraries.html
hadoop/core/branches/branch-0.19/docs/quickstart.html
hadoop/core/branches/branch-0.19/docs/streaming.html
hadoop/core/branches/branch-0.19/src/docs/src/documentation/content/xdocs/cluster_setup.xml
hadoop/core/branches/branch-0.19/src/docs/src/documentation/content/xdocs/mapred_tutorial.xml
hadoop/core/branches/branch-0.19/src/docs/src/documentation/content/xdocs/site.xml
Modified: hadoop/core/branches/branch-0.19/CHANGES.txt
URL: http://svn.apache.org/viewvc/hadoop/core/branches/branch-0.19/CHANGES.txt?rev=706341&r1=706340&r2=706341&view=diff
==============================================================================
--- hadoop/core/branches/branch-0.19/CHANGES.txt (original)
+++ hadoop/core/branches/branch-0.19/CHANGES.txt Mon Oct 20 10:12:38 2008
@@ -442,6 +442,9 @@
HADOOP-4150. Include librecordio in hadoop releases. (Giridharan Kesavan
via acmurthy)
+ HADOOP-4321. Include documentation for the capacity scheduler. (Hemanth
+ Yamijala via omalley)
+
OPTIMIZATIONS
HADOOP-3556. Removed lock contention in MD5Hash by changing the
Modified: hadoop/core/branches/branch-0.19/docs/SLG_user_guide.html
URL: http://svn.apache.org/viewvc/hadoop/core/branches/branch-0.19/docs/SLG_user_guide.html?rev=706341&r1=706340&r2=706341&view=diff
==============================================================================
--- hadoop/core/branches/branch-0.19/docs/SLG_user_guide.html (original)
+++ hadoop/core/branches/branch-0.19/docs/SLG_user_guide.html Mon Oct 20 10:12:38 2008
@@ -153,6 +153,9 @@
<a href="hod.html">Hadoop On Demand</a>
</div>
<div class="menuitem">
+<a href="capacity_scheduler.html">Capacity Scheduler</a>
+</div>
+<div class="menuitem">
<a href="api/index.html">API Docs</a>
</div>
<div class="menuitem">
Added: hadoop/core/branches/branch-0.19/docs/capacity_scheduler.html
URL: http://svn.apache.org/viewvc/hadoop/core/branches/branch-0.19/docs/capacity_scheduler.html?rev=706341&view=auto
==============================================================================
--- hadoop/core/branches/branch-0.19/docs/capacity_scheduler.html (added)
+++ hadoop/core/branches/branch-0.19/docs/capacity_scheduler.html Mon Oct 20 10:12:38 2008
@@ -0,0 +1,519 @@
+<!DOCTYPE html PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN" "http://www.w3.org/TR/html4/loose.dtd">
+<html>
+<head>
+<META http-equiv="Content-Type" content="text/html; charset=UTF-8">
+<meta content="Apache Forrest" name="Generator">
+<meta name="Forrest-version" content="0.8">
+<meta name="Forrest-skin-name" content="pelt">
+<title>Capacity Scheduler</title>
+<link type="text/css" href="skin/basic.css" rel="stylesheet">
+<link media="screen" type="text/css" href="skin/screen.css" rel="stylesheet">
+<link media="print" type="text/css" href="skin/print.css" rel="stylesheet">
+<link type="text/css" href="skin/profile.css" rel="stylesheet">
+<script src="skin/getBlank.js" language="javascript" type="text/javascript"></script><script src="skin/getMenu.js" language="javascript" type="text/javascript"></script><script src="skin/fontsize.js" language="javascript" type="text/javascript"></script>
+<link rel="shortcut icon" href="images/favicon.ico">
+</head>
+<body onload="init()">
+<script type="text/javascript">ndeSetTextSize();</script>
+<div id="top">
+<!--+
+ |breadtrail
+ +-->
+<div class="breadtrail">
+<a href="http://www.apache.org/">Apache</a> > <a href="http://hadoop.apache.org/">Hadoop</a> > <a href="http://hadoop.apache.org/core/">Core</a><script src="skin/breadcrumbs.js" language="JavaScript" type="text/javascript"></script>
+</div>
+<!--+
+ |header
+ +-->
+<div class="header">
+<!--+
+ |start group logo
+ +-->
+<div class="grouplogo">
+<a href="http://hadoop.apache.org/"><img class="logoImage" alt="Hadoop" src="images/hadoop-logo.jpg" title="Apache Hadoop"></a>
+</div>
+<!--+
+ |end group logo
+ +-->
+<!--+
+ |start Project Logo
+ +-->
+<div class="projectlogo">
+<a href="http://hadoop.apache.org/core/"><img class="logoImage" alt="Hadoop" src="images/core-logo.gif" title="Scalable Computing Platform"></a>
+</div>
+<!--+
+ |end Project Logo
+ +-->
+<!--+
+ |start Search
+ +-->
+<div class="searchbox">
+<form action="http://www.google.com/search" method="get" class="roundtopsmall">
+<input value="hadoop.apache.org" name="sitesearch" type="hidden"><input onFocus="getBlank (this, 'Search the site with google');" size="25" name="q" id="query" type="text" value="Search the site with google">
+ <input name="Search" value="Search" type="submit">
+</form>
+</div>
+<!--+
+ |end search
+ +-->
+<!--+
+ |start Tabs
+ +-->
+<ul id="tabs">
+<li>
+<a class="unselected" href="http://hadoop.apache.org/core/">Project</a>
+</li>
+<li>
+<a class="unselected" href="http://wiki.apache.org/hadoop">Wiki</a>
+</li>
+<li class="current">
+<a class="selected" href="index.html">Hadoop 0.19 Documentation</a>
+</li>
+</ul>
+<!--+
+ |end Tabs
+ +-->
+</div>
+</div>
+<div id="main">
+<div id="publishedStrip">
+<!--+
+ |start Subtabs
+ +-->
+<div id="level2tabs"></div>
+<!--+
+ |end Endtabs
+ +-->
+<script type="text/javascript"><!--
+document.write("Last Published: " + document.lastModified);
+// --></script>
+</div>
+<!--+
+ |breadtrail
+ +-->
+<div class="breadtrail">
+
+
+ </div>
+<!--+
+ |start Menu, mainarea
+ +-->
+<!--+
+ |start Menu
+ +-->
+<div id="menu">
+<div onclick="SwitchMenu('menu_selected_1.1', 'skin/')" id="menu_selected_1.1Title" class="menutitle" style="background-image: url('skin/images/chapter_open.gif');">Documentation</div>
+<div id="menu_selected_1.1" class="selectedmenuitemgroup" style="display: block;">
+<div class="menuitem">
+<a href="index.html">Overview</a>
+</div>
+<div class="menuitem">
+<a href="quickstart.html">Quickstart</a>
+</div>
+<div class="menuitem">
+<a href="cluster_setup.html">Cluster Setup</a>
+</div>
+<div class="menuitem">
+<a href="hdfs_design.html">HDFS Architecture</a>
+</div>
+<div class="menuitem">
+<a href="hdfs_user_guide.html">HDFS User Guide</a>
+</div>
+<div class="menuitem">
+<a href="hdfs_permissions_guide.html">HDFS Permissions Guide</a>
+</div>
+<div class="menuitem">
+<a href="hdfs_quota_admin_guide.html">HDFS Quotas Administrator Guide</a>
+</div>
+<div class="menuitem">
+<a href="commands_manual.html">Commands Manual</a>
+</div>
+<div class="menuitem">
+<a href="hdfs_shell.html">FS Shell Guide</a>
+</div>
+<div class="menuitem">
+<a href="SLG_user_guide.html">Synthetic Load Generator User Guide</a>
+</div>
+<div class="menuitem">
+<a href="distcp.html">DistCp Guide</a>
+</div>
+<div class="menuitem">
+<a href="mapred_tutorial.html">Map-Reduce Tutorial</a>
+</div>
+<div class="menuitem">
+<a href="native_libraries.html">Native Hadoop Libraries</a>
+</div>
+<div class="menuitem">
+<a href="streaming.html">Streaming</a>
+</div>
+<div class="menuitem">
+<a href="hadoop_archives.html">Hadoop Archives</a>
+</div>
+<div class="menuitem">
+<a href="hod.html">Hadoop On Demand</a>
+</div>
+<div class="menupage">
+<div class="menupagetitle">Capacity Scheduler</div>
+</div>
+<div class="menuitem">
+<a href="api/index.html">API Docs</a>
+</div>
+<div class="menuitem">
+<a href="jdiff/changes.html">API Changes</a>
+</div>
+<div class="menuitem">
+<a href="http://wiki.apache.org/hadoop/">Wiki</a>
+</div>
+<div class="menuitem">
+<a href="http://wiki.apache.org/hadoop/FAQ">FAQ</a>
+</div>
+<div class="menuitem">
+<a href="http://hadoop.apache.org/core/mailing_lists.html">Mailing Lists</a>
+</div>
+<div class="menuitem">
+<a href="releasenotes.html">Release Notes</a>
+</div>
+<div class="menuitem">
+<a href="changes.html">All Changes</a>
+</div>
+</div>
+<div id="credit"></div>
+<div id="roundbottom">
+<img style="display: none" class="corner" height="15" width="15" alt="" src="skin/images/rc-b-l-15-1body-2menu-3menu.png"></div>
+<!--+
+ |alternative credits
+ +-->
+<div id="credit2"></div>
+</div>
+<!--+
+ |end Menu
+ +-->
+<!--+
+ |start content
+ +-->
+<div id="content">
+<div title="Portable Document Format" class="pdflink">
+<a class="dida" href="capacity_scheduler.pdf"><img alt="PDF -icon" src="skin/images/pdfdoc.gif" class="skin"><br>
+ PDF</a>
+</div>
+<h1>Capacity Scheduler</h1>
+<div id="minitoc-area">
+<ul class="minitoc">
+<li>
+<a href="#Purpose">Purpose</a>
+</li>
+<li>
+<a href="#Features">Features</a>
+</li>
+<li>
+<a href="#Picking+a+task+to+run">Picking a task to run</a>
+</li>
+<li>
+<a href="#Reclaiming+capacity">Reclaiming capacity</a>
+</li>
+<li>
+<a href="#Installation">Installation</a>
+</li>
+<li>
+<a href="#Configuration">Configuration</a>
+<ul class="minitoc">
+<li>
+<a href="#Using+the+capacity+scheduler">Using the capacity scheduler</a>
+</li>
+<li>
+<a href="#Setting+up+queues">Setting up queues</a>
+</li>
+<li>
+<a href="#Configuring+properties+for+queues">Configuring properties for queues</a>
+</li>
+<li>
+<a href="#Reviewing+the+configuration+of+the+capacity+scheduler">Reviewing the configuration of the capacity scheduler</a>
+</li>
+</ul>
+</li>
+</ul>
+</div>
+
+
+<a name="N1000D"></a><a name="Purpose"></a>
+<h2 class="h3">Purpose</h2>
+<div class="section">
+<p>This document describes the Capacity Scheduler, a pluggable Map/Reduce scheduler for Hadoop which provides a way to share large clusters.</p>
+</div>
+
+
+<a name="N10017"></a><a name="Features"></a>
+<h2 class="h3">Features</h2>
+<div class="section">
+<p>The Capacity Scheduler supports the following features:</p>
+<ul>
+
+<li>
+ Support for multiple queues, where a job is submitted to a queue.
+ </li>
+
+<li>
+ Queues are guaranteed a fraction of the capacity of the grid (their
+ 'guaranteed capacity') in the sense that a certain capacity of
+ resources will be at their disposal. All jobs submitted to the a
+ queue will have access to the capacity guaranteed to the queue.
+ </li>
+
+<li>
+ Free resources can be allocated to any queue beyond its guaranteed
+ capacity. These excess allocated resources can be reclaimed and made
+ available to another queue in order to meet its capacity guarantee.
+ </li>
+
+<li>
+ The scheduler guarantees that excess resources taken from a queue
+ will be restored to it within N minutes of its need for them.
+ </li>
+
+<li>
+ Queues optionally support job priorities (disabled by default).
+ </li>
+
+<li>
+ Within a queue, jobs with higher priority will have access to the
+ queue's resources before jobs with lower priority. However, once a
+ job is running, it will not be preempted for a higher priority job.
+ </li>
+
+<li>
+ In order to prevent one or more users from monopolizing its
+ resources, each queue enforces a limit on the percentage of
+ resources allocated to a user at any given time, if there is
+ competition for them.
+ </li>
+
+<li>
+ Support for memory-intensive jobs, wherein a job can optionally
+ specify higher memory-requirements than the default, and the tasks
+ of the job will only be run on TaskTrackers that have enough memory
+ to spare.
+ </li>
+
+</ul>
+</div>
+
+
+<a name="N1003C"></a><a name="Picking+a+task+to+run"></a>
+<h2 class="h3">Picking a task to run</h2>
+<div class="section">
+<p>Note that many of these steps can be, and will be, enhanced over time
+ to provide better algorithms.</p>
+<p>Whenever a TaskTracker is free, the Capacity Scheduler first picks a
+ queue that needs to reclaim any resources the earliest (this is a queue
+ whose resources were temporarily being used by some other queue and now
+ needs access to those resources). If no such queue is found, it then picks
+ a queue which has most free space (whose ratio of # of running slots to
+ guaranteed capacity is the lowest).</p>
+<p>Once a queue is selected, the scheduler picks a job in the queue. Jobs
+ are sorted based on when they're submitted and their priorities (if the
+ queue supports priorities). Jobs are considered in order, and a job is
+ selected if its user is within the user-quota for the queue, i.e., the
+ user is not already using queue resources above his/her limit. The
+ scheduler also makes sure that there is enough free memory in the
+ TaskTracker to tun the job's task, in case the job has special memory
+ requirements.</p>
+<p>Once a job is selected, the scheduler picks a task to run. This logic
+ to pick a task remains unchanged from earlier versions.</p>
+</div>
+
+
+<a name="N1004F"></a><a name="Reclaiming+capacity"></a>
+<h2 class="h3">Reclaiming capacity</h2>
+<div class="section">
+<p>Periodically, the scheduler determines:</p>
+<ul>
+
+<li>
+ if a queue needs to reclaim capacity. This happens when a queue has
+ at least one task pending and part of its guaranteed capacity is
+ being used by some other queue. If this happens, the scheduler notes
+ the amount of resources it needs to reclaim for this queue within a
+ specified period of time (the reclaim time).
+ </li>
+
+<li>
+ if a queue has not received all the resources it needed to reclaim,
+ and its reclaim time is about to expire. In this case, the scheduler
+ needs to kill tasks from queues running over capacity. This it does
+ by killing the tasks that started the latest.
+ </li>
+
+</ul>
+</div>
+
+
+<a name="N10062"></a><a name="Installation"></a>
+<h2 class="h3">Installation</h2>
+<div class="section">
+<p>The capacity scheduler is available as a JAR file in the Hadoop
+ tarball under the <em>contrib/capacity-scheduler</em> directory. The name of
+ the JAR file would be on the lines of hadoop-*-capacity-scheduler.jar.</p>
+<p>You can also build the scheduler from source by executing
+ <em>ant package</em>, in which case it would be available under
+ <em>build/contrib/capacity-scheduler</em>.</p>
+<p>To run the capacity scheduler in your Hadoop installation, you need
+ to put it on the <em>CLASSPATH</em>. The easiest way is to copy the
+ <span class="codefrag">hadoop-*-capacity-scheduler.jar</span> from
+ to <span class="codefrag">HADOOP_HOME/lib</span>. Alternatively, you can modify
+ <em>HADOOP_CLASSPATH</em> to include this jar, in
+ <span class="codefrag">conf/hadoop-env.sh</span>.</p>
+</div>
+
+
+<a name="N1008A"></a><a name="Configuration"></a>
+<h2 class="h3">Configuration</h2>
+<div class="section">
+<a name="N10090"></a><a name="Using+the+capacity+scheduler"></a>
+<h3 class="h4">Using the capacity scheduler</h3>
+<p>
+ To make the Hadoop framework use the capacity scheduler, set up
+ the following property in the site configuration:</p>
+<table class="ForrestTable" cellspacing="1" cellpadding="4">
+
+<tr>
+
+<td colspan="1" rowspan="1">Property</td>
+ <td colspan="1" rowspan="1">Value</td>
+
+</tr>
+
+<tr>
+
+<td colspan="1" rowspan="1">mapred.jobtracker.taskScheduler</td>
+ <td colspan="1" rowspan="1">org.apache.hadoop.mapred.CapacityTaskScheduler</td>
+
+</tr>
+
+</table>
+<a name="N100B7"></a><a name="Setting+up+queues"></a>
+<h3 class="h4">Setting up queues</h3>
+<p>
+ You can define multiple queues to which users can submit jobs with
+ the capacity scheduler. To define multiple queues, you should edit
+ the site configuration for Hadoop and modify the
+ <em>mapred.queue.names</em> property.
+ </p>
+<p>
+ You can also configure ACLs for controlling which users or groups
+ have access to the queues.
+ </p>
+<p>
+ For more details, refer to
+ <a href="cluster_setup.html#Configuring+the+Hadoop+Daemons">Cluster
+ Setup</a> documentation.
+ </p>
+<a name="N100CE"></a><a name="Configuring+properties+for+queues"></a>
+<h3 class="h4">Configuring properties for queues</h3>
+<p>The capacity scheduler can be configured with several properties
+ for each queue that control the behavior of the scheduler. This
+ configuration is in the <em>conf/capacity-scheduler.xml</em>. By
+ default, the configuration is set up for one queue, named
+ <em>default</em>.</p>
+<p>To specify a property for a queue that is defined in the site
+ configuration, you should use the property name as
+ <em>mapred.capacity-scheduler.queue.<queue-name>.<property-name></em>.
+ </p>
+<p>For example, to define the property <em>guaranteed-capacity</em>
+ for queue named <em>research</em>, you should specify the property
+ name as
+ <em>mapred.capacity-scheduler.queue.research.guaranteed-capacity</em>.
+ </p>
+<p>The properties defined for queues and their descriptions are
+ listed in the table below:</p>
+<table class="ForrestTable" cellspacing="1" cellpadding="4">
+
+<tr>
+<th colspan="1" rowspan="1">Name</th><th colspan="1" rowspan="1">Description</th>
+</tr>
+
+<tr>
+<td colspan="1" rowspan="1">mapred.capacity-scheduler.queue.<queue-name>.guaranteed-capacity</td>
+ <td colspan="1" rowspan="1">Percentage of the number of slots in the cluster that are
+ guaranteed to be available for jobs in this queue.
+ The sum of guaranteed capacities for all queues should be less
+ than or equal 100.</td>
+
+</tr>
+
+<tr>
+<td colspan="1" rowspan="1">mapred.capacity-scheduler.queue.<queue-name>.reclaim-time-limit</td>
+ <td colspan="1" rowspan="1">The amount of time, in seconds, before which resources
+ distributed to other queues will be reclaimed.</td>
+
+</tr>
+
+<tr>
+<td colspan="1" rowspan="1">mapred.capacity-scheduler.queue.<queue-name>.supports-priority</td>
+ <td colspan="1" rowspan="1">If true, priorities of jobs will be taken into account in scheduling
+ decisions.</td>
+
+</tr>
+
+<tr>
+<td colspan="1" rowspan="1">mapred.capacity-scheduler.queue.<queue-name>.minimum-user-limit-percent</td>
+ <td colspan="1" rowspan="1">Each queue enforces a limit on the percentage of resources
+ allocated to a user at any given time, if there is competition
+ for them. This user limit can vary between a minimum and maximum
+ value. The former depends on the number of users who have submitted
+ jobs, and the latter is set to this property value. For example,
+ suppose the value of this property is 25. If two users have
+ submitted jobs to a queue, no single user can use more than 50%
+ of the queue resources. If a third user submits a job, no single
+ user can use more than 33% of the queue resources. With 4 or more
+ users, no user can use more than 25% of the queue's resources. A
+ value of 100 implies no user limits are imposed.</td>
+
+</tr>
+
+</table>
+<a name="N10130"></a><a name="Reviewing+the+configuration+of+the+capacity+scheduler"></a>
+<h3 class="h4">Reviewing the configuration of the capacity scheduler</h3>
+<p>
+ Once the installation and configuration is completed, you can review
+ it after starting the Map/Reduce cluster from the admin UI.
+ </p>
+<ul>
+
+<li>Start the Map/Reduce cluster as usual.</li>
+
+<li>Open the JobTracker web UI.</li>
+
+<li>The queues you have configured should be listed under the <em>Scheduling
+ Information</em> section of the page.</li>
+
+<li>The properties for the queues should be visible in the <em>Scheduling
+ Information</em> column against each queue.</li>
+
+</ul>
+</div>
+
+</div>
+<!--+
+ |end content
+ +-->
+<div class="clearboth"> </div>
+</div>
+<div id="footer">
+<!--+
+ |start bottomstrip
+ +-->
+<div class="lastmodified">
+<script type="text/javascript"><!--
+document.write("Last Published: " + document.lastModified);
+// --></script>
+</div>
+<div class="copyright">
+ Copyright ©
+ 2008 <a href="http://www.apache.org/licenses/">The Apache Software Foundation.</a>
+</div>
+<!--+
+ |end bottomstrip
+ +-->
+</div>
+</body>
+</html>
Added: hadoop/core/branches/branch-0.19/docs/capacity_scheduler.pdf
URL: http://svn.apache.org/viewvc/hadoop/core/branches/branch-0.19/docs/capacity_scheduler.pdf?rev=706341&view=auto
==============================================================================
--- hadoop/core/branches/branch-0.19/docs/capacity_scheduler.pdf (added)
+++ hadoop/core/branches/branch-0.19/docs/capacity_scheduler.pdf Mon Oct 20 10:12:38 2008
@@ -0,0 +1,490 @@
+%PDF-1.3
+%ª«¬
+4 0 obj
+<< /Type /Info
+/Producer (FOP 0.20.5) >>
+endobj
+5 0 obj
+<< /Length 747 /Filter [ /ASCII85Decode /FlateDecode ]
+ >>
+stream
+Gb!$E9lldX&;KZO$6>[)<Co^_N_QCBBhrG::JD?6$_%G',"+3^pQbN:BKa?u,SV?%Q'[c.=0'kXa54k=%g[jp`0lD)=6^rJn1[-(K0a&13(;3W+c%5VO3LBs-Y]_iYJ:AUK_j<F/j5)?>6oKXIY.?q%N,7/KUg"i!JB%fI@N:m<<s7kR@cB;B#eUc.T*3XMT5]do6;)a'9HWnK0C?"]u_AQh<V6<D(FqPdHbua_K?qpc5?2u_nh'YA,AG8!si&LG.b:.;6:PWJ&/7lYoe,DoHJ+q+<!NCASfEa2GYFcnmF7)YsXd5%usZCZ#%VXfBHX`JOUW6""%:f`V$qYBp%J;1L8GnE3I%td[hE%GP<r&/j4R^@E[;`pQr0_8Pp`_Y?'<4^SsfO;q$Z/3LWPW?cI9%DlPS9&$9*-gRNT80AC2^]hh=uo#9S@.SkH5B)^\W=a$j@30idh9OmOr\!>!)0Q-bV&ss&QP2L/qmj2rNG=&9s#]4G!:T\<^\.&!oTXa/4?s^9:$\6l/[WLdc$fLf@M*DZIQ;oN4apn8.QW<UiPgSe"GUi:-r-fJVoo$_oA\R2KrU7[G/mchnK6^lbeW7E6\M94?LY3c)Z'p0&]r/"Jm93#=!Z:-\m8cW:0H^P?]PlZ7Bjo,Z)hK4>.!%FOXKU*/1D"8/VNe#dAUZTggV_k]L93lU$EY';pq?2he%>=Vb1''.SXF?FQMXEOke'q1f'(\&**Y6d5)VS2ke@-,r+Gj~>
+endstream
+endobj
+6 0 obj
+<< /Type /Page
+/Parent 1 0 R
+/MediaBox [ 0 0 612 792 ]
+/Resources 3 0 R
+/Contents 5 0 R
+/Annots 7 0 R
+>>
+endobj
+7 0 obj
+[
+8 0 R
+10 0 R
+12 0 R
+14 0 R
+16 0 R
+18 0 R
+20 0 R
+22 0 R
+24 0 R
+26 0 R
+]
+endobj
+8 0 obj
+<< /Type /Annot
+/Subtype /Link
+/Rect [ 102.0 559.666 148.664 547.666 ]
+/C [ 0 0 0 ]
+/Border [ 0 0 0 ]
+/A 9 0 R
+/H /I
+>>
+endobj
+10 0 obj
+<< /Type /Annot
+/Subtype /Link
+/Rect [ 102.0 541.466 150.656 529.466 ]
+/C [ 0 0 0 ]
+/Border [ 0 0 0 ]
+/A 11 0 R
+/H /I
+>>
+endobj
+12 0 obj
+<< /Type /Annot
+/Subtype /Link
+/Rect [ 102.0 523.266 208.664 511.266 ]
+/C [ 0 0 0 ]
+/Border [ 0 0 0 ]
+/A 13 0 R
+/H /I
+>>
+endobj
+14 0 obj
+<< /Type /Annot
+/Subtype /Link
+/Rect [ 102.0 505.066 208.316 493.066 ]
+/C [ 0 0 0 ]
+/Border [ 0 0 0 ]
+/A 15 0 R
+/H /I
+>>
+endobj
+16 0 obj
+<< /Type /Annot
+/Subtype /Link
+/Rect [ 102.0 486.866 164.0 474.866 ]
+/C [ 0 0 0 ]
+/Border [ 0 0 0 ]
+/A 17 0 R
+/H /I
+>>
+endobj
+18 0 obj
+<< /Type /Annot
+/Subtype /Link
+/Rect [ 102.0 468.666 177.332 456.666 ]
+/C [ 0 0 0 ]
+/Border [ 0 0 0 ]
+/A 19 0 R
+/H /I
+>>
+endobj
+20 0 obj
+<< /Type /Annot
+/Subtype /Link
+/Rect [ 108.0 450.466 261.8 438.466 ]
+/C [ 0 0 0 ]
+/Border [ 0 0 0 ]
+/A 21 0 R
+/H /I
+>>
+endobj
+22 0 obj
+<< /Type /Annot
+/Subtype /Link
+/Rect [ 108.0 432.266 208.832 420.266 ]
+/C [ 0 0 0 ]
+/Border [ 0 0 0 ]
+/A 23 0 R
+/H /I
+>>
+endobj
+24 0 obj
+<< /Type /Annot
+/Subtype /Link
+/Rect [ 108.0 414.066 286.472 402.066 ]
+/C [ 0 0 0 ]
+/Border [ 0 0 0 ]
+/A 25 0 R
+/H /I
+>>
+endobj
+26 0 obj
+<< /Type /Annot
+/Subtype /Link
+/Rect [ 108.0 395.866 383.444 383.866 ]
+/C [ 0 0 0 ]
+/Border [ 0 0 0 ]
+/A 27 0 R
+/H /I
+>>
+endobj
+28 0 obj
+<< /Length 2172 /Filter [ /ASCII85Decode /FlateDecode ]
+ >>
+stream
+Gat=-8WVUa'YaHG#j<EL...@J7Cc>)l\nU>^=G5U:nVZ'o[]2<m%DRj>LH>q,e^8?lX41$L@>>b$TgetQTM6s'dnlb@-/[fcW=&dtU4ehqbXnp:sX=A>4DkqgY#Fm6i?8p]7[Rr/A:$?9'bRI#u+39oB<ZTk3=g:D6$bg+dN!0Nr-O>Cd8<b\<8@",/%9aNIhao:YGE`P@>*Ca;;`F5uUS%XnncL2D(P>[&1WN)TL1)d(3Ckt$k6a;kEU;hO?S/Ig)T(=>/JliIq3"eohm6pI[RMN,Soipq,RZCeoLI"EK-3>uGR;@`ZLL=D@JP56CuuYbU@'PR>3oYSHeQs:*r?,[-:M812d`Nf%ZRVueP&TH2EM55^#iX#5nL[-D(:&LnYCai#>"',N+^TQ5oN>"YXlQ-O?t_ZW#]2JN*O#7'^MY9_9d7a_]Kc%at&ZPe+Kmcmq/7V63^/;'4fZr?LDLU;>`?sNOT?G,f-s[7gG'uHVn0&mo`YieI&pMe:b`\f;o&i-P[!aGPE(q\^$!pb&`ga0)2'9OL[1$!,TaeT.0hVGK'5.eRl+hp%W\"&S9nf2oWgVi^@u$K$q!&/4a9U,g]^\m"+"U>ID);cb)R,(adRMrf::dGl!ZpBDBn?;'>g-2jQbp><iR"<.rd?@:1?<=^r36#cmS;Y,dA2_1bl`3!?cods5+=iPrF&4+)HNWO1maN+ZI?\-UmQ2M[2'`D0Tc2,l4V6*u#sBk)$YKDd'@U.BR+i:ZJ7YM6aS>hFFp8[Dtp<3P_XggYnb6AArD0<t;>>rB5O>#]1g*'C47CcakrPq:i]DG-k>*RZ0c'QU!e??9eF67Wl
h9JV"=j1tR[PTXWiFQ8gU"A4s"]?B]VjMl4S3-!r8D_i'O*T^T0V5681WoktgBMgp%I^](*s3*)#O^=T>K,"P30sbDXLPe"8_1CUrKEb<D#...@XXml_>+(ushVL<\,c4G:a4\Fe7aQ)&c4,]rE8%C49"]YS9h@\h&EC!;Ar?h)5NUfg#?qkV3E?<-5mLc2p'D!1LLLJ-5c;giYe'-rtb-.u.g&.e53nYC.6dFDoZoUl<0*%4??f?^d;%cdl"Rp7`S$D:/=VTI:70!2g-XTeaK\@BNG,]2pcL!>hDALOG/#5kgC`5Qq(H3!*4-&]Z7&)Rb#Z>ibZ5i$aT^l`@f,f"8FRb[/bJgR8WgM^<M:e`!A9B:b<Sgtt2heT5kMlR&%,nh<);@ALr:+`fX?T7CLA'aGDQa$ENGCp4qfG%M0K;h#McmTJ@eAFh/@4$XB_lc>2hsuf!I<Mfj(^[#O(ITsJAe(MJ!1Y@<2Z\Z7BW9NDNrAEoH`Qsi_tR1FS1f`DW"7_$[/7,H%j>Y66d^LnDU:`h.#o^$hlJCU.mQV@I^LiS-Lk;l:=U>28Z>F%J:qparV45M#\6afBDl5;RuS4DHD9EiEaZhrif8)T*4(!-OYLr!*U<OoLVc^scgS;k_dLq,**U_kC-Wa"(hOG)/*_PBXb)oeHIM^lXmOP+diHqA>*'=Jk"](Zm6ff^,&f/mL/oMCS^\
0U5KJm(_??=)DOr2+`h=lI%R7QG2=./W)NS%NF+\_YU#hM+rV<cS4;VV'P=KMVNj!mQX7F_t!>=/]N]Ga5ZQP6:oP:'`r#h3A:)3j1Ig!RAB)rb(+T`.glp).%qe?jj?D^c`R-D,*#MASC.kg"5<;1Cq@>Ntf6lHj^4/Uusip_,Her]+7NilZa]DhjIJ`@d~>
+endstream
+endobj
+29 0 obj
+<< /Type /Page
+/Parent 1 0 R
+/MediaBox [ 0 0 612 792 ]
+/Resources 3 0 R
+/Contents 28 0 R
+>>
+endobj
+30 0 obj
+<< /Length 2162 /Filter [ /ASCII85Decode /FlateDecode ]
+ >>
+stream
+Gat=-D,]IQ&H88.O`0>B+Dgkeh`,p`HIEAr83_2gVk_m:XM_<%Cm3&Wn(Nfl.ZjdS(`;UAqss+AZb+N'`U)&_p,$jRC\[j>Q8lgNLLCI<rLj&f_KB>IcP<'*B7J,h/nUHBK=OY6PJq;!oVW](ETb6]J<J:LkDRU_n$?lVb7F1Pg<2KlEk_E:n``O!/iTM=GW+AeAYpIZC:^L2O@h?]f@.Eg1U5@<9G^JVD`)*+,umm5j?7l5e*Sf/M&p,s_>h^q?Okl`'&nsiVR!9l`YEYb+NL=1&'lh&ZK^7bEesoA,ALQS<5T#h/[//jc';GQ<]%?8/RW_A/tQ8"+ELR]SUqV;,R>d\7[Rj[kQoY"6F35ZC_/X]i[ijCF.uoDK<0;L>F"1V@8$ETT#a?KR:Fd$J/gu9?XPDM2!8"Gi9+6?bNWcZ*]mp;cWuSkUZZcXe%Wq,UB-9;`(9Aq[d+n:6uhk[L2WkSaB2ra@.iPHZ1JX?d3'g*eoh`_ncr]%"-UsS)H0[X]+>WB6'@=S6mu\-h(,'(<nL\Xr2CEgDg9sb`$d^)-Pj9F;e4."lL!BdOWc;+OZq>c/KJM:gf7QnM2+eRjBAAAA"BVYBEERK.#l=dKYbT5D40Of>[qq[.Ch`YaAa=eYKpJ(!]Y+Orpk+eGQ"3Yk^#@`6s_k:nWC"^H!2mM4C$#XX&pj?h-T;b;[S%Kr%NM495['_93]iHkXmQJN4@n5qO'lW;=*-Oh2F9tJ[rGml,@;eXNaN@gL/D%5\]`Yr3:BM@iZ&tHh/qnUVIqT>fh7l>>f29p)$eFU?/JVG_u<Nf!OgFBI/QSXl-9MQa5\-.B6t?*ebHnL-5lO:SstCehAVOY]O(o>dmD3ZJddHV\CperK:qgTgPNK96@+u)s!/u[!pGuK[B]uRnpt24mouo@@W-C.dR9.NpMFZM*%=&38;N_[,>NZQ3'5GShrNr'el`dZnZhH^iZgTqJ\J]H.TNXQ,(eGqD'sUeHd.
c#9AgL_n2iDnaDaCp)uTV<Rq(:3cD'6Xe)mC#`Rp*=W<Q__@l;r`"WS7"P#E/C=Qn6;(jFu^hN@+FYK/iNS+mB]n5[4CT+Td=#Y<8Vc)k1r?sKrJZ$kIH:.$$LV[ZI;PO_h30b?]2gf&E=.'rH/X'9[-DSk(9t?"pJKOaP=Z8UB4L6"Z(pHX(C6/*u\EhMXVa(V.a=fdcN!e.-mR7.M#kXsk6^bo3l02MFM)S0Fg;n`enV00A0XGC=$FVK>BppE[03;LX8dKg]3dfhh9Zd\I6nPh3D9Ik[mTFnT6]:D^6JTt4fKC0"QC"B$(W]f278XEU\Q"o[6-Z58bh9F9W+9)dZgHQr:tj(#^c`EjZN40M;jXZ\GbF`BJ0^m7Gn9_iNu,j(ODdf1(C&2SPNlM\`VG2!P.(9?>>a%Qa,kC(M$u4XY%dm+Vesma[5A]1b+V\2>L%2g#Nm2^R\.Y'ht'C#*6>?8GhZK!3JI_+HQ?*(5]p<EN+,T$hGAe#Wj$eF@AZgEWiP@DEV[@!_M_YcP66*M9VJ_DQq-&r/@k7.8j]G"O;i?M&VsQ8[6o881\\EeG?poel0i())FbBa>lStiIt)[M\2cD_"^RmZon,0*JJCLj]L?Y)AST9"V6\gCSOebcmXujBIGLDpW8iPT""&RXd?%]&SXEM_>T/e[o_%f7=$PU!hYheBqtm;767bp[\JH;/8'#!OYe??a0@*nXH?WD]gVAi^g7;[pn@.^+-B$cE$j#-C[.jeK*E1j`\4Mp!d:V*j-CbGTU'(+p6QRNUAlq/la6I];"2'".Faf3'S:o6V$*T@^e:kYG4?OXY+C0V;Z#8+VH&2Se77fVe9;,/Z^s`K7d-DSAG5au!W7FCps/bVJj%8C=R-4U:7Xd%[kkWd_%s.o+R(th)bcBPMei+(?.g70?<\!_WXL5d.4Q.5OU7*;>C+G4DPq39QeSqUSKIsUb)=gZ!gCK*%qQ5eiU;?!Or0Z>-d<YKJbTW
>cjFBnt6EcNH;$:_lV":p>;]NDfEsAD0LdY_Y*C>B2Ju^VXY#/ik_euqbH.U@_8=bMEmOFn0mYJfg99_;K&MV5@RLLd$9D?PS%@jT>3q'rtF\<E"i.3sq;.qH.e\6qM(K]NS^:or7B$1n"o3&r+d6gOQZ!fg</pc>2]&kkOY`+bP\GlOO.!j#~>
+endstream
+endobj
+31 0 obj
+<< /Type /Page
+/Parent 1 0 R
+/MediaBox [ 0 0 612 792 ]
+/Resources 3 0 R
+/Contents 30 0 R
+>>
+endobj
+32 0 obj
+<< /Length 2657 /Filter [ /ASCII85Decode /FlateDecode ]
+ >>
+stream
+GatU6gMZ(1&q0LUk]$YtF*+*n5nG1!`7\E!_<ao...@0e.>_$)-rIJD$u@la,-,sgl;Wo:a8Nn/qhM?cNcfoV?QWaHfN&Odn=BF#kFGCs')@)YE9m#_c\IR>'<"Y')/11gIJE6A[#oN@if:ro'%uab-B0?3n-.6QUN@2/dU4a[fa,0L>21[s3HUIt1e*@lXSMAH=AFLbrqp0541=+_A&YPgh]n_.m8N=8mlhIhcAUu\46qCIrZ=0hT&Xb-BKTc?Uoh9&]re70o.Y<kGYUB:jU[[,g]Yb:q/q6ED1jWa>[PUT$_4Wad[!p[%M'F(Sk&-D_ND.:i$\*qlqeG`pk9N[@c`s&a"'C)#qonbB+%Uqrd*>]<VWYNemATH$6Fk$<a5pR)5'@"m$)'A;><:4:IXrf2h:Y].C:'jVX3+L/Z%,AToP#RJ@OZ%CZi,/p[0i@.WN)m&*gh-r3bZE0.15][f"c*P_L2[3hXG\Y5.Pi.HVPmnKW;D449XKB6CEIaDUt7`6[G_qf,deQ,jV&[]^WO=o\<Z.ZRT;XcaL^KVGb9Un[.p&>Meg79!rklH8WHdMZ_tc6YlPVJeSQT_taJn$DCcIG[86`OM2bXA2OhR%Nks1n.-8i>lI<ZaeKgX$h[R3G1cFpfe\frKuE&VDLAkoBSZ.MT0&@rOu'Z%L!TumInV\V>"pb7?7PP&r2%P6E]U7)0(]M\f>H9.C1`W#cF:9Ik)o)!U6W*P!mKfq<5`F01Aq)k]^,%N:aF9Od?^nhF"D`\KrQ0AJmC<BPb<,_C'.tRc1B@Gf<(&6a,E\?Ka<?$m@K1s8(8lE5@#)[:h+d5.+W6'$lU+:D+&FdLWGrla*Aq27^5!G?`TAR^J2J>ul9r^hO*X5VEs8X*:qh?ihkkL0t4V?K,k+R]756/DKZ/CG'M%grOA7eV$`OYtk+sC3,OhEB=VHiqRN6m2k9\7hs'JA?'_`Hn(^(8=p)=JNW9
ihkLXIY@2iO,8/"Y,/9C"3g$TN",1a58igUOr0\?Pfmj*93."jtE8Ij7Pl@NgUE5["DT<Y%+#p(,^`'QN'ORVmdQQ>l76(Q[^u8B`ge>(`@V?9EPT.6Gm>Zi2SX4N57=V2V$sWVU&&`@]084T>n^Ro6lOpCbL:YI!'Y^3TB#W%gNdQP-)pR9nD-1P8b,-YZAg)eTd`?+t$p7i9&iZQ]1a>ptgOYTI`be)2o:o?7fdOjI-[*^7L,[+MFt'>WYZfFbXDMC=A1j0/0+(;+!AiSOj#FF+ElNl0kdNs]Xf-OZ6f?.2jbNQMY#4d8q4Z7ja0U%'O9"i<dq*X6(Bcm4C*f>Ka\q=5EFR/!PF?E1rOd#7_Zc']K1OUDWEI&T($DK#:Y=.D%4?CEYemooXA?.!H2oO2lP7(nXD!uIdL6IB`qI3.@0dd%LNEBaZA+K%b.7n(^EF#^Ebb?%YS;^1#%XKUiY^UL\h8%4_V*EnQ>KP8*DqKp[4n0t!(BcCQ-*S[nqJph%,@6t!kQ0)FB#M4U/g(rHhh"6*q)VmmZY5ZnJlcRh9Lb%)L]d!7?&80*cUdPc%ZP,6(Rr%/Y@Y6;[6!;Jn?VlD%;ifs1Jm&H.:o?a#;RDF&q)MCqr?ngMB41?U4&)0XaVf4@&2p5'SGn!;4<T^*f8>M6&^YN033*p\jsf$:%\9966?-adgb<Yo?/c#4riAlSPja/djUh]'SK:_PG%dK,a^l>kK%'%Fe1d3&[\S9?VGHS,90OITDCU#Ic`WaOA[AYY;@&m"^a(%;Qrk;u"/6!1MXp)nM&-:/_iZ#JG2@P-"\25dKaEM54X%q++L%3U!X5HF$>#JHt2mDO<[FAF0!L4l1!XVe3;04&BoHm`4OB%@$QcTl#?,ahSs.?f-WtYt<Fs;<K9\S;%dJY;JZs*8;gh"Js)rN]JFjWdSr^CLS\>p0,a[,cR]mT?FnW'3^#Lq8HDMNPN$n;o+M$'BuY4.GlGG]h+fkVbN
7*e%o6COp&27$iWat<N'D0[=i"'<o9n`WWFU+Ri/0cE1/nSmr9891JB7_lID,CNn9I-1sT55N/?!F"T;jS%WsYJ7N(]&0qFsj!iPKqG[sfD^g[4;5Upq"eg@_"a*Qnd?:]!jH".HkblrcB^ZUdA**b'Kbu*JY.Hj/p:Q(]?YcRFY/#mWV(EtAA)h^q)/k>dX!E/a&_#aO-6tNT:OT$85=Ae)e;n*,Rbr?m>dQ3E[qm,Pr^Z!,Mfu&h?RIZ*6E'h2"#qb&2hpiIMb#:9LQd*'[->PGo<n4?5</kSoL3ILj]%XQ@Ji$$?0..5LCY`o$S5e93>,T!prKOBh]3Me,1E!P+g?"-=.on-T[Wo\sM6;_1%.>k7blFaDW4TW,.FLfq6S4a'0:>gd9srM3lJkU,i^J:o^c?-XB[BLd7lFMqOE!tpTO6W#rUu,;?1H.`IC8*i4jsi*[se\#`>\L.a"5J\-+^^96\c29;lr@+e)_@pNL+Fsa[j#LKEI&E``<@.JE*Z]AWQ&o;]%ErQ<igInP<%^;Sl%LfE@Ogqdo);#gHr'5ckR^]Z=mZ1^]N!:YcVbdn#VSpHQ24OW.1??cfZ&(Z1)uCnQ+eRcU`,\6P02rp0DU5B:U&RQ/^meGa_b5Q71DWu(/Bp&oJclJ=kaVd]"3FdH8?o&<efBDqstboYp~>
+endstream
+endobj
+33 0 obj
+<< /Type /Page
+/Parent 1 0 R
+/MediaBox [ 0 0 612 792 ]
+/Resources 3 0 R
+/Contents 32 0 R
+/Annots 34 0 R
+>>
+endobj
+34 0 obj
+[
+35 0 R
+]
+endobj
+35 0 obj
+<< /Type /Annot
+/Subtype /Link
+/Rect [ 212.64 508.247 277.644 496.247 ]
+/C [ 0 0 0 ]
+/Border [ 0 0 0 ]
+/A << /URI (cluster_setup.html#Configuring+the+Hadoop+Daemons)
+/S /URI >>
+/H /I
+>>
+endobj
+36 0 obj
+<< /Length 1418 /Filter [ /ASCII85Decode /FlateDecode ]
+ >>
+stream
+Gau0DgQ(#H&:O:SkbZ?)fPl*JFa6Z4]%@!OgT6;s,^l=sg/]_\$74BY^Fs`73OC)>!d#5:9R2@TkKIm)oS:EPkJcfBN-H<5q...@ZOB>c(FMeo-!1,XOj5u;/GSY_<mJh+lU6kqm\d6rd>7sSABXec[dYmr*Htt/f4??NM!Ph(#kPt5L#$Tg<_M(1Y`S_k+?mWZmu<M+\'.6mX9B%dQFYhHLGMa)=rVO'R$\oqULUlZJJ4\^)$EPSec%sjP[XZp"'#p>C8J;g8>43rR/7OmQ0`'ejs>lMlj@=[F2V8G.a!7/68$aTE)@1oc.2-)%d,97?]C`KPG?g2jMm#lMXc:_,fn&XK#DA!Gf6OO8`#"lL>'-g@mmj)D]QjR1B9j!Kp',@+>T>L1[8_V:>2(['k%Pa&1gZQlGV.aNI7@6FLI).X<5FZc9MJfAO'oNhG?NGYApr!W6RipKgQ`m\XBO.gj`%>9fV<L,">n[i#@^X0gMid`")Kbo/!DY-]E,2!"G0.<W\[SVR2!`B"L[7E\:\3g%sGW5=C^?;30=-*9WWNOBLp"h"F0hkDiKY@u^WW#J/%/$6:(jFal4'Yl=k_6,9;.HN9d^+EVTV?H"IP]1[Ac,=e$[UbA3nc#Ch5VNB]hc,tB<gU`af#>#BZnYt,<\4=e0[lM;[6fMtdld7.ld*Pf$sgL+7hH)[@>4dX*N?2eHMB%8WSEue[#YF-qE^j5Fh2:oW71_Ol6#bZa6Z5DP-clkrKA_ab#OWG"+T1Pq%6(^*$4u;6TP5Gb1#/<%<RP0&0cj#:[>J6OV=,1U8gYJSP\NFXt)@+Z@4KANselm+76C9eNiE8;g5g)R;/tsH8kp1JSLnEo*@=4d.9,c*'*Ne<Kp:ONNeLeOu8L\oieDD656[[D2fS8q/!Bn9ZYIPl9rP\?Rb),L\(9P*"<tZ!Ur`TErsQ
[A-<0-;`,c2NgMRimmCnR_IH3'ZBtXi8M(`^,l^2YHb$dbcaJVB&"W7K#BU?0VlOU`6t.4k"?4jW8H3G*RLG.A^ckDl)VR*g$F7+NqD8`.E3kq*fT0:u07?9.;Z=4?>Mrre?'0]W@,G$@\ZmuV@O&&\KgcCRG6N[h?roBT)&g=*#%ju4[@7N^V3pVt.U?X]M7Yblk+WXs^'jhY,N;3-"Z17t92sL'`CU@Te-`H4$">.5g2,B*,2&P9@O"@U#l/*6$dFMuB\ZDY&Y)$nLuQc$H3\KY!ArT5bqqCJ+WnuNls<B?//_YJp/)M69E&h7b#s`,^rKZZBl680K=bmqUI?/AYEb(WEdUjJX%kTXE!cA53<;8Q`fV9%(Wc?*3#o]3FhN!fKt/s#[gOSMBsJ.(JF2'`=YWX4e2uDl(ubGr$]Q$$~>
+endstream
+endobj
+37 0 obj
+<< /Type /Page
+/Parent 1 0 R
+/MediaBox [ 0 0 612 792 ]
+/Resources 3 0 R
+/Contents 36 0 R
+>>
+endobj
+39 0 obj
+<<
+ /Title (\376\377\0\61\0\40\0\120\0\165\0\162\0\160\0\157\0\163\0\145)
+ /Parent 38 0 R
+ /Next 40 0 R
+ /A 9 0 R
+>> endobj
+40 0 obj
+<<
+ /Title (\376\377\0\62\0\40\0\106\0\145\0\141\0\164\0\165\0\162\0\145\0\163)
+ /Parent 38 0 R
+ /Prev 39 0 R
+ /Next 41 0 R
+ /A 11 0 R
+>> endobj
+41 0 obj
+<<
+ /Title (\376\377\0\63\0\40\0\120\0\151\0\143\0\153\0\151\0\156\0\147\0\40\0\141\0\40\0\164\0\141\0\163\0\153\0\40\0\164\0\157\0\40\0\162\0\165\0\156)
+ /Parent 38 0 R
+ /Prev 40 0 R
+ /Next 42 0 R
+ /A 13 0 R
+>> endobj
+42 0 obj
+<<
+ /Title (\376\377\0\64\0\40\0\122\0\145\0\143\0\154\0\141\0\151\0\155\0\151\0\156\0\147\0\40\0\143\0\141\0\160\0\141\0\143\0\151\0\164\0\171)
+ /Parent 38 0 R
+ /Prev 41 0 R
+ /Next 43 0 R
+ /A 15 0 R
+>> endobj
+43 0 obj
+<<
+ /Title (\376\377\0\65\0\40\0\111\0\156\0\163\0\164\0\141\0\154\0\154\0\141\0\164\0\151\0\157\0\156)
+ /Parent 38 0 R
+ /Prev 42 0 R
+ /Next 44 0 R
+ /A 17 0 R
+>> endobj
+44 0 obj
+<<
+ /Title (\376\377\0\66\0\40\0\103\0\157\0\156\0\146\0\151\0\147\0\165\0\162\0\141\0\164\0\151\0\157\0\156)
+ /Parent 38 0 R
+ /First 45 0 R
+ /Last 48 0 R
+ /Prev 43 0 R
+ /Count -4
+ /A 19 0 R
+>> endobj
+45 0 obj
+<<
+ /Title (\376\377\0\66\0\56\0\61\0\40\0\125\0\163\0\151\0\156\0\147\0\40\0\164\0\150\0\145\0\40\0\143\0\141\0\160\0\141\0\143\0\151\0\164\0\171\0\40\0\163\0\143\0\150\0\145\0\144\0\165\0\154\0\145\0\162)
+ /Parent 44 0 R
+ /Next 46 0 R
+ /A 21 0 R
+>> endobj
+46 0 obj
+<<
+ /Title (\376\377\0\66\0\56\0\62\0\40\0\123\0\145\0\164\0\164\0\151\0\156\0\147\0\40\0\165\0\160\0\40\0\161\0\165\0\145\0\165\0\145\0\163)
+ /Parent 44 0 R
+ /Prev 45 0 R
+ /Next 47 0 R
+ /A 23 0 R
+>> endobj
+47 0 obj
+<<
+ /Title (\376\377\0\66\0\56\0\63\0\40\0\103\0\157\0\156\0\146\0\151\0\147\0\165\0\162\0\151\0\156\0\147\0\40\0\160\0\162\0\157\0\160\0\145\0\162\0\164\0\151\0\145\0\163\0\40\0\146\0\157\0\162\0\40\0\161\0\165\0\145\0\165\0\145\0\163)
+ /Parent 44 0 R
+ /Prev 46 0 R
+ /Next 48 0 R
+ /A 25 0 R
+>> endobj
+48 0 obj
+<<
+ /Title (\376\377\0\66\0\56\0\64\0\40\0\122\0\145\0\166\0\151\0\145\0\167\0\151\0\156\0\147\0\40\0\164\0\150\0\145\0\40\0\143\0\157\0\156\0\146\0\151\0\147\0\165\0\162\0\141\0\164\0\151\0\157\0\156\0\40\0\157\0\146\0\40\0\164\0\150\0\145\0\40\0\143\0\141\0\160\0\141\0\143\0\151\0\164\0\171\0\40\0\163\0\143\0\150\0\145\0\144\0\165\0\154\0\145\0\162)
+ /Parent 44 0 R
+ /Prev 47 0 R
+ /A 27 0 R
+>> endobj
+49 0 obj
+<< /Type /Font
+/Subtype /Type1
+/Name /F3
+/BaseFont /Helvetica-Bold
+/Encoding /WinAnsiEncoding >>
+endobj
+50 0 obj
+<< /Type /Font
+/Subtype /Type1
+/Name /F5
+/BaseFont /Times-Roman
+/Encoding /WinAnsiEncoding >>
+endobj
+51 0 obj
+<< /Type /Font
+/Subtype /Type1
+/Name /F6
+/BaseFont /Times-Italic
+/Encoding /WinAnsiEncoding >>
+endobj
+52 0 obj
+<< /Type /Font
+/Subtype /Type1
+/Name /F1
+/BaseFont /Helvetica
+/Encoding /WinAnsiEncoding >>
+endobj
+53 0 obj
+<< /Type /Font
+/Subtype /Type1
+/Name /F9
+/BaseFont /Courier
+/Encoding /WinAnsiEncoding >>
+endobj
+54 0 obj
+<< /Type /Font
+/Subtype /Type1
+/Name /F2
+/BaseFont /Helvetica-Oblique
+/Encoding /WinAnsiEncoding >>
+endobj
+55 0 obj
+<< /Type /Font
+/Subtype /Type1
+/Name /F7
+/BaseFont /Times-Bold
+/Encoding /WinAnsiEncoding >>
+endobj
+1 0 obj
+<< /Type /Pages
+/Count 5
+/Kids [6 0 R 29 0 R 31 0 R 33 0 R 37 0 R ] >>
+endobj
+2 0 obj
+<< /Type /Catalog
+/Pages 1 0 R
+ /Outlines 38 0 R
+ /PageMode /UseOutlines
+ >>
+endobj
+3 0 obj
+<<
+/Font << /F3 49 0 R /F5 50 0 R /F1 52 0 R /F6 51 0 R /F9 53 0 R /F2 54 0 R /F7 55 0 R >>
+/ProcSet [ /PDF /ImageC /Text ] >>
+endobj
+9 0 obj
+<<
+/S /GoTo
+/D [29 0 R /XYZ 85.0 659.0 null]
+>>
+endobj
+11 0 obj
+<<
+/S /GoTo
+/D [29 0 R /XYZ 85.0 593.466 null]
+>>
+endobj
+13 0 obj
+<<
+/S /GoTo
+/D [29 0 R /XYZ 85.0 284.332 null]
+>>
+endobj
+15 0 obj
+<<
+/S /GoTo
+/D [31 0 R /XYZ 85.0 550.6 null]
+>>
+endobj
+17 0 obj
+<<
+/S /GoTo
+/D [31 0 R /XYZ 85.0 399.866 null]
+>>
+endobj
+19 0 obj
+<<
+/S /GoTo
+/D [31 0 R /XYZ 85.0 225.932 null]
+>>
+endobj
+21 0 obj
+<<
+/S /GoTo
+/D [31 0 R /XYZ 85.0 194.798 null]
+>>
+endobj
+23 0 obj
+<<
+/S /GoTo
+/D [33 0 R /XYZ 85.0 618.5 null]
+>>
+endobj
+25 0 obj
+<<
+/S /GoTo
+/D [33 0 R /XYZ 85.0 485.247 null]
+>>
+endobj
+27 0 obj
+<<
+/S /GoTo
+/D [37 0 R /XYZ 85.0 503.75 null]
+>>
+endobj
+38 0 obj
+<<
+ /First 39 0 R
+ /Last 44 0 R
+>> endobj
+xref
+0 56
+0000000000 65535 f
+0000015041 00000 n
+0000015127 00000 n
+0000015219 00000 n
+0000000015 00000 n
+0000000071 00000 n
+0000000909 00000 n
+0000001029 00000 n
+0000001117 00000 n
+0000015364 00000 n
+0000001252 00000 n
+0000015427 00000 n
+0000001389 00000 n
+0000015493 00000 n
+0000001526 00000 n
+0000015559 00000 n
+0000001663 00000 n
+0000015623 00000 n
+0000001798 00000 n
+0000015689 00000 n
+0000001935 00000 n
+0000015755 00000 n
+0000002070 00000 n
+0000015821 00000 n
+0000002207 00000 n
+0000015885 00000 n
+0000002344 00000 n
+0000015951 00000 n
+0000002481 00000 n
+0000004746 00000 n
+0000004854 00000 n
+0000007109 00000 n
+0000007217 00000 n
+0000009967 00000 n
+0000010090 00000 n
+0000010117 00000 n
+0000010319 00000 n
+0000011830 00000 n
+0000016016 00000 n
+0000011938 00000 n
+0000012071 00000 n
+0000012225 00000 n
+0000012453 00000 n
+0000012672 00000 n
+0000012850 00000 n
+0000013060 00000 n
+0000013327 00000 n
+0000013543 00000 n
+0000013854 00000 n
+0000014268 00000 n
+0000014381 00000 n
+0000014491 00000 n
+0000014602 00000 n
+0000014710 00000 n
+0000014816 00000 n
+0000014932 00000 n
+trailer
+<<
+/Size 56
+/Root 2 0 R
+/Info 4 0 R
+>>
+startxref
+16067
+%%EOF
Modified: hadoop/core/branches/branch-0.19/docs/changes.html
URL: http://svn.apache.org/viewvc/hadoop/core/branches/branch-0.19/docs/changes.html?rev=706341&r1=706340&r2=706341&view=diff
==============================================================================
--- hadoop/core/branches/branch-0.19/docs/changes.html (original)
+++ hadoop/core/branches/branch-0.19/docs/changes.html Mon Oct 20 10:12:38 2008
@@ -205,7 +205,7 @@
</ol>
</li>
<li><a href="javascript:toggleList('release_0.19.0_-_unreleased_._improvements_')"> IMPROVEMENTS
-</a> (74)
+</a> (75)
<ol id="release_0.19.0_-_unreleased_._improvements_">
<li><a href="http://issues.apache.org/jira/browse/HADOOP-4205">HADOOP-4205</a>. hive: metastore and ql to use the refactored SerDe library.<br />(zshao)</li>
<li><a href="http://issues.apache.org/jira/browse/HADOOP-4106">HADOOP-4106</a>. libhdfs: add time, permission and user attribute support
@@ -338,6 +338,8 @@
<li><a href="http://issues.apache.org/jira/browse/HADOOP-3790">HADOOP-3790</a>. Add more unit tests for testing HDFS file append.<br />(szetszwo)</li>
<li><a href="http://issues.apache.org/jira/browse/HADOOP-4150">HADOOP-4150</a>. Include librecordio in hadoop releases.<br />(Giridharan Kesavan
via acmurthy)</li>
+ <li><a href="http://issues.apache.org/jira/browse/HADOOP-4321">HADOOP-4321</a>. Include documentation for the capacity scheduler.<br />(Hemanth
+Yamijala via omalley)</li>
</ol>
</li>
<li><a href="javascript:toggleList('release_0.19.0_-_unreleased_._optimizations_')"> OPTIMIZATIONS
@@ -370,7 +372,7 @@
</ol>
</li>
<li><a href="javascript:toggleList('release_0.19.0_-_unreleased_._bug_fixes_')"> BUG FIXES
-</a> (133)
+</a> (139)
<ol id="release_0.19.0_-_unreleased_._bug_fixes_">
<li><a href="http://issues.apache.org/jira/browse/HADOOP-3563">HADOOP-3563</a>. Refactor the distributed upgrade code so that it is
easier to identify datanode and namenode related code.<br />(dhruba)</li>
@@ -618,12 +620,21 @@
Phillips via cdouglas)</li>
<li><a href="http://issues.apache.org/jira/browse/HADOOP-4426">HADOOP-4426</a>. TestCapacityScheduler broke due to the two commits <a href="http://issues.apache.org/jira/browse/HADOOP-4053">HADOOP-4053</a>
and <a href="http://issues.apache.org/jira/browse/HADOOP-4373">HADOOP-4373</a>. This patch fixes that.<br />(Hemanth Yamijala via ddas)</li>
- <li><a href="http://issues.apache.org/jira/browse/HADOOP-4278">HADOOP-4278</a>. Increase debug logging for unit test TestDatanodeDeath.<br />(dhruba)</li>
<li><a href="http://issues.apache.org/jira/browse/HADOOP-4418">HADOOP-4418</a>. Updates documentation in forrest for Mapred, streaming and pipes.<br />(Amareshwari Sriramadasu via ddas)</li>
<li><a href="http://issues.apache.org/jira/browse/HADOOP-3155">HADOOP-3155</a>. Ensure that there is only one thread fetching
TaskCompletionEvents on TaskTracker re-init.<br />(Dhruba Borthakur via
acmurthy)</li>
<li><a href="http://issues.apache.org/jira/browse/HADOOP-4425">HADOOP-4425</a>. Fix EditLogInputStream to overload the bulk read method.<br />(cdouglas)</li>
+ <li><a href="http://issues.apache.org/jira/browse/HADOOP-4427">HADOOP-4427</a>. Adds the new queue/job commands to the manual.<br />(Sreekanth Ramakrishnan via ddas)</li>
+ <li><a href="http://issues.apache.org/jira/browse/HADOOP-4278">HADOOP-4278</a>. Increase debug logging for unit test TestDatanodeDeath.
+Fix the case when primary is dead.<br />(dhruba via szetszwo)</li>
+ <li><a href="http://issues.apache.org/jira/browse/HADOOP-4423">HADOOP-4423</a>. Keep block length when the block recovery is triggered by
+append.<br />(szetszwo)</li>
+ <li><a href="http://issues.apache.org/jira/browse/HADOOP-4449">HADOOP-4449</a>. Fix dfsadmin usage.<br />(Raghu Angadi via cdouglas)</li>
+ <li><a href="http://issues.apache.org/jira/browse/HADOOP-4455">HADOOP-4455</a>. Added TestSerDe so that unit tests can run successfully.<br />(Ashish Thusoo via dhruba)</li>
+ <li><a href="http://issues.apache.org/jira/browse/HADOOP-4399">HADOOP-4399</a>. Make fuse-dfs multi-thread access safe.<br />(Pete Wyckoff via dhruba)</li>
+ <li><a href="http://issues.apache.org/jira/browse/HADOOP-4457">HADOOP-4457</a>. Fixes an input split logging problem introduced by
+<a href="http://issues.apache.org/jira/browse/HADOOP-3245">HADOOP-3245</a>.<br />(Amareshwari Sriramadasu via ddas)</li>
</ol>
</li>
</ul>
@@ -631,7 +642,7 @@
</a></h2>
<ul id="release_0.18.2_-_unreleased_">
<li><a href="javascript:toggleList('release_0.18.2_-_unreleased_._bug_fixes_')"> BUG FIXES
-</a> (7)
+</a> (8)
<ol id="release_0.18.2_-_unreleased_._bug_fixes_">
<li><a href="http://issues.apache.org/jira/browse/HADOOP-4116">HADOOP-4116</a>. Balancer should provide better resource management.<br />(hairong)</li>
<li><a href="http://issues.apache.org/jira/browse/HADOOP-3614">HADOOP-3614</a>. Fix a bug that Datanode may use an old GenerationStamp to get
@@ -644,6 +655,8 @@
<li><a href="http://issues.apache.org/jira/browse/HADOOP-4351">HADOOP-4351</a>. FSNamesystem.getBlockLocationsInternal throws
ArrayIndexOutOfBoundsException.<br />(hairong)</li>
<li><a href="http://issues.apache.org/jira/browse/HADOOP-4292">HADOOP-4292</a>. Do not support append() for LocalFileSystem.<br />(hairong)</li>
+ <li><a href="http://issues.apache.org/jira/browse/HADOOP-4398">HADOOP-4398</a>. No need to truncate access time in INode. Also fixes NPE
+in CreateEditsLog.<br />(Raghu Angadi)</li>
</ol>
</li>
</ul>
Modified: hadoop/core/branches/branch-0.19/docs/cluster_setup.html
URL: http://svn.apache.org/viewvc/hadoop/core/branches/branch-0.19/docs/cluster_setup.html?rev=706341&r1=706340&r2=706341&view=diff
==============================================================================
--- hadoop/core/branches/branch-0.19/docs/cluster_setup.html (original)
+++ hadoop/core/branches/branch-0.19/docs/cluster_setup.html Mon Oct 20 10:12:38 2008
@@ -153,6 +153,9 @@
<a href="hod.html">Hadoop On Demand</a>
</div>
<div class="menuitem">
+<a href="capacity_scheduler.html">Capacity Scheduler</a>
+</div>
+<div class="menuitem">
<a href="api/index.html">API Docs</a>
</div>
<div class="menuitem">
@@ -518,13 +521,84 @@
</td>
</tr>
+
+<tr>
+
+<td colspan="1" rowspan="1">mapred.queue.names</td>
+ <td colspan="1" rowspan="1">Comma separated list of queues to which jobs can be submitted.</td>
+ <td colspan="1" rowspan="1">
+ The Map/Reduce system always supports atleast one queue
+ with the name as <em>default</em>. Hence, this parameter's
+ value should always contain the string <em>default</em>.
+ Some job schedulers supported in Hadoop, like the
+ <a href="capacity_scheduler.html">Capacity
+ Scheduler</a>, support multiple queues. If such a scheduler is
+ being used, the list of configured queue names must be
+ specified here. Once queues are defined, users can submit
+ jobs to a queue using the property name
+ <em>mapred.job.queue.name</em> in the job configuration.
+ There could be a separate
+ configuration file for configuring properties of these
+ queues that is managed by the scheduler.
+ Refer to the documentation of the scheduler for information on
+ the same.
+ </td>
+
+</tr>
+
+<tr>
+
+<td colspan="1" rowspan="1">mapred.acls.enabled</td>
+ <td colspan="1" rowspan="1">Specifies whether ACLs are supported for controlling job
+ submission and administration</td>
+ <td colspan="1" rowspan="1">
+ If <em>true</em>, ACLs would be checked while submitting
+ and administering jobs. ACLs can be specified using the
+ configuration parameters of the form
+ <em>mapred.queue.queue-name.acl-name</em>, defined below.
+ </td>
+
+</tr>
+
+<tr>
+
+<td colspan="1" rowspan="1">mapred.queue.<em>queue-name</em>.acl-submit-job</td>
+ <td colspan="1" rowspan="1">List of users and groups that can submit jobs to the
+ specified <em>queue-name</em>.</td>
+ <td colspan="1" rowspan="1">
+ The list of users and groups are both comma separated
+ list of names. The two lists are separated by a blank.
+ Example: <em>user1,user2 group1,group2</em>.
+ If you wish to define only a list of groups, provide
+ a blank at the beginning of the value.
+ </td>
+
+</tr>
+
+<tr>
+
+<td colspan="1" rowspan="1">mapred.queue.<em>queue-name</em>.acl-administer-job</td>
+ <td colspan="1" rowspan="1">List of users and groups that can change the priority
+ or kill jobs that have been submitted to the
+ specified <em>queue-name</em>.</td>
+ <td colspan="1" rowspan="1">
+ The list of users and groups are both comma separated
+ list of names. The two lists are separated by a blank.
+ Example: <em>user1,user2 group1,group2</em>.
+ If you wish to define only a list of groups, provide
+ a blank at the beginning of the value. Note that an
+ owner of a job can always change the priority or kill
+ his/her own job, irrespective of the ACLs.
+ </td>
+
+</tr>
</table>
<p>Typically all the above parameters are marked as
<a href="api/org/apache/hadoop/conf/Configuration.html#FinalParams">
final</a> to ensure that they cannot be overriden by user-applications.
</p>
-<a name="N1020F"></a><a name="Real-World+Cluster+Configurations"></a>
+<a name="N1027C"></a><a name="Real-World+Cluster+Configurations"></a>
<h5>Real-World Cluster Configurations</h5>
<p>This section lists some non-default configuration parameters which
have been used to run the <em>sort</em> benchmark on very large
@@ -685,7 +759,7 @@
</li>
</ul>
-<a name="N1032D"></a><a name="Slaves"></a>
+<a name="N1039A"></a><a name="Slaves"></a>
<h4>Slaves</h4>
<p>Typically you choose one machine in the cluster to act as the
<span class="codefrag">NameNode</span> and one machine as to act as the
@@ -694,14 +768,14 @@
referred to as <em>slaves</em>.</p>
<p>List all slave hostnames or IP addresses in your
<span class="codefrag">conf/slaves</span> file, one per line.</p>
-<a name="N1034C"></a><a name="Logging"></a>
+<a name="N103B9"></a><a name="Logging"></a>
<h4>Logging</h4>
<p>Hadoop uses the <a href="http://logging.apache.org/log4j/">Apache
log4j</a> via the <a href="http://commons.apache.org/logging/">Apache
Commons Logging</a> framework for logging. Edit the
<span class="codefrag">conf/log4j.properties</span> file to customize the Hadoop
daemons' logging configuration (log-formats and so on).</p>
-<a name="N10360"></a><a name="History+Logging"></a>
+<a name="N103CD"></a><a name="History+Logging"></a>
<h5>History Logging</h5>
<p> The job history files are stored in central location
<span class="codefrag"> hadoop.job.history.location </span> which can be on DFS also,
@@ -734,10 +808,10 @@
typically <span class="codefrag">${HADOOP_HOME}/conf</span>.</p>
</div>
-<a name="N10398"></a><a name="Cluster+Restartability"></a>
+<a name="N10405"></a><a name="Cluster+Restartability"></a>
<h2 class="h3">Cluster Restartability</h2>
<div class="section">
-<a name="N1039E"></a><a name="Map%2FReduce"></a>
+<a name="N1040B"></a><a name="Map%2FReduce"></a>
<h3 class="h4">Map/Reduce</h3>
<p>The job tracker restart can recover running jobs if
<span class="codefrag">mapred.jobtracker.restart.recover</span> is set true and
@@ -748,7 +822,7 @@
</div>
-<a name="N103B3"></a><a name="Hadoop+Rack+Awareness"></a>
+<a name="N10420"></a><a name="Hadoop+Rack+Awareness"></a>
<h2 class="h3">Hadoop Rack Awareness</h2>
<div class="section">
<p>The HDFS and the Map/Reduce components are rack-aware.</p>
@@ -771,7 +845,7 @@
</div>
-<a name="N103D9"></a><a name="Hadoop+Startup"></a>
+<a name="N10446"></a><a name="Hadoop+Startup"></a>
<h2 class="h3">Hadoop Startup</h2>
<div class="section">
<p>To start a Hadoop cluster you will need to start both the HDFS and
@@ -806,7 +880,7 @@
</div>
-<a name="N1041F"></a><a name="Hadoop+Shutdown"></a>
+<a name="N1048C"></a><a name="Hadoop+Shutdown"></a>
<h2 class="h3">Hadoop Shutdown</h2>
<div class="section">
<p>