You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@slider.apache.org by sm...@apache.org on 2014/07/11 08:20:21 UTC
svn commit: r1609635 [2/3] - in /incubator/slider/site/content: ./ design/
design/registry/ design/specification/ developing/ docs/
docs/configuration/ docs/slider_specs/ downloads/ images/ release_notes/
Modified: incubator/slider/site/content/docs/getting_started.html
URL: http://svn.apache.org/viewvc/incubator/slider/site/content/docs/getting_started.html?rev=1609635&r1=1609634&r2=1609635&view=diff
==============================================================================
--- incubator/slider/site/content/docs/getting_started.html (original)
+++ incubator/slider/site/content/docs/getting_started.html Fri Jul 11 06:20:20 2014
@@ -108,7 +108,7 @@
<li id="nav_use_client_config"><a href="/docs/client-configuration.html">Client Configuration</a></li>
<li id="nav_use_exitcodes"><a href="/docs/exitcodes.html">Client Exit Codes</a></li>
<li id="nav_use_security"><a href="/docs/security.html">Security</a></li>
-<li id="nav_use_app_package"><a href="/docs/slider_specs/index.html">App Packaging</a></li>
+<li id="nav_use_app_package"><a href="/docs/slider_specs/index.html">Creating App Packages</a></li>
<li id="nav_use_app_configuration"><a href="/docs/configuration/index.html">App Configuration Model</a></li>
<li id="nav_use_debugging"><a href="/docs/debugging.html">Debugging</a></li>
<li id="nav_use_troubleshooting"><a href="/docs/troubleshooting.html">Troubleshooting</a></li>
@@ -175,7 +175,7 @@ Latest release: <strong>0.30-incubating<
<p>The following provides the steps required for setting up a cluster and deploying a YARN hosted application using Slider.</p>
<ul>
<li>
-<p><a href="#sysreqs">Prerequisites</a></p>
+<p><a href="#sysreqs">System Requirements</a></p>
</li>
<li>
<p><a href="#setup">Setup the Cluster</a></p>
@@ -193,17 +193,11 @@ Latest release: <strong>0.30-incubating<
<p><a href="#deploy">Deploy Slider Resources</a></p>
</li>
<li>
-<p><a href="#downsample">Download Sample Application Packages</a></p>
+<p><a href="#downsample">Create Application Packages</a></p>
</li>
<li>
<p><a href="#installapp">Install, Configure, Start and Verify Sample Application</a></p>
</li>
-<li>
-<p><a href="#appendixa">Appendix A: Storm Sample Application Specifications</a></p>
-</li>
-<li>
-<p><a href="#appendixb">Appendix B: HBase Sample Application Specifications</a></p>
-</li>
</ul>
<h2 id="system-requirements"><a name="sysreqs"></a>System Requirements</h2>
<p>The Slider deployment has the following minimum system requirements:</p>
@@ -217,6 +211,9 @@ Latest release: <strong>0.30-incubating<
<li>
<p>Oracle JDK 1.7 (64-bit)</p>
</li>
+<li>
+<p>Python 2.7</p>
+</li>
</ul>
<h2 id="setup-the-cluster"><a name="setup"></a>Setup the Cluster</h2>
<p>After setting up your Hadoop cluster (using Ambari or other means) with the
@@ -229,7 +226,7 @@ containers on a single host. In <code>ya
</tr>
<tr>
<td>yarn.scheduler.minimum-allocation-mb</td>
- <td>>= 256</td>
+ <td>>= 256 (ensure that YARN can allocate sufficient number of containers)</td>
</tr>
<tr>
<td>yarn.nodemanager.delete.debug-delay-sec</td>
@@ -241,13 +238,14 @@ containers on a single host. In <code>ya
<h2 id="download-slider-packages"><a name="download"></a>Download Slider Packages</h2>
<p>Slider releases are available at
<a href="https://www.apache.org/dyn/closer.cgi/incubator/slider">https://www.apache.org/dyn/closer.cgi/incubator/slider</a>.</p>
+<p><em>Or, you can build it as described below.</em></p>
<h2 id="build-slider"><a name="build"></a>Build Slider</h2>
<ul>
-<li>From the top level directory, execute <code>mvn clean install -DskipTests</code></li>
+<li>From the top level directory, execute <code>mvn clean site:site site:stage package -DskipTests</code></li>
<li>Use the generated compressed tar file in slider-assembly/target directory (e.g. slider-0.30.0-all.tar.gz) for the subsequent steps</li>
</ul>
<h2 id="install-slider"><a name="install"></a>Install Slider</h2>
-<p>Follow the following steps to expand/install Slider:</p>
+<p>Slider is installed on a client machine that can access the hadoop cluster. Follow the following steps to expand/install Slider:</p>
<div class="codehilite"><pre>mkdir <span class="cp">${</span><span class="n">slider</span><span class="o">-</span><span class="n">install</span><span class="o">-</span><span class="nb">dir</span><span class="o">*</span><span class="p">;</span>
<span class="n">cd</span> <span class="err">$</span><span class="p">{</span><span class="n">slider</span><span class="o">-</span><span class="n">install</span><span class="o">-</span><span class="nb">dir</span><span class="cp">}</span>
@@ -258,6 +256,7 @@ containers on a single host. In <code>ya
<em>This assumes that all apps are being run as âyarnâ user. Any other user can be used to run the apps - ensure that file permission is granted as required.</em></p>
<p>Expand the tar file: <code>tar -xvf slider-0.30.0-all.tar.gz</code></p>
<p>Browse to the Slider directory: <code>cd slider-0.30.0/bin</code></p>
+<p><em>Add java to the PATH.</em></p>
<div class="codehilite"><pre> <span class="n">export</span> <span class="n">PATH</span><span class="o">=</span><span class="err">$</span><span class="n">PATH</span><span class="o">:/</span><span class="n">usr</span><span class="o">/</span><span class="n">jdk64</span><span class="o">/</span><span class="n">jdk1</span><span class="mf">.7.0</span><span class="n">_45</span><span class="o">/</span><span class="n">bin</span>
</pre></div>
@@ -297,9 +296,9 @@ containers on a single host. In <code>ya
</pre></div>
-<p>Ensure there are no errors and you can see "Compiled against Hadoop 2.4.0"</p>
+<p>Ensure there are no errors and you can see "Compiled against Hadoop 2.4.0". <strong>This ensures that Slider is installed correctly.</strong></p>
<h2 id="deploy-slider-resources"><a name="deploy"></a>Deploy Slider Resources</h2>
-<p>Ensure that all file folders are accessible to the user creating the application instance. The example assumes "yarn" to be that user.</p>
+<p>Ensure that all file folders are accessible to the user creating the application instance. The example assumes "yarn" to be that user. The HDFS folder "/slider" is a suggestion and the default application packages and associated configurations assume this path while accessing the slider-agent tarball.</p>
<h3 id="create-hdfs-root-folder-for-slider">Create HDFS root folder for Slider</h3>
<p>Perform the following steps to create the Slider root folder with the appropriate permissions:</p>
<div class="codehilite"><pre><span class="n">su</span> <span class="n">hdfs</span>
@@ -319,89 +318,25 @@ containers on a single host. In <code>ya
hdfs dfs -mkdir /slider/agent
-hdfs dfs -mkdir /slider/agent/conf
-
-hdfs dfs -copyFromLocal <span class="cp">${</span><span class="n">slider</span><span class="o">-</span><span class="n">install</span><span class="o">-</span><span class="nb">dir</span><span class="cp">}</span>/slider-0.30.0/agent/slider-agent-0.30.0.tar.gz /slider/agent
-</pre></div>
-
-
-<h3 id="create-and-deploy-slider-agent-configuration">Create and deploy Slider Agent configuration</h3>
-<p>Create an agent config file (agent.ini) based on the sample available at:</p>
-<div class="codehilite"><pre><span class="cp">${</span><span class="n">slider</span><span class="o">-</span><span class="n">install</span><span class="o">-</span><span class="nb">dir</span><span class="cp">}</span>/slider-0.30.0/agent/conf/agent.ini
-</pre></div>
-
-
-<p>The sample agent.ini file can be used as is (see below). Some of the parameters of interest are:</p>
-<h1 id="log_level-info-or-debug-to-control-the-verbosity-of-log"><code>log_level</code> = INFO or DEBUG, to control the verbosity of log</h1>
-<h1 id="app_log_dir-the-relative-location-of-the-application-log-file"><code>app_log_dir</code> = the relative location of the application log file</h1>
-<h1 id="log_dir-the-relative-location-of-the-agent-and-command-log-file"><code>log_dir</code> = the relative location of the agent and command log file</h1>
-<div class="codehilite"><pre><span class="k">[server]</span>
-<span class="na">hostname</span><span class="o">=</span><span class="s">localhost</span>
-<span class="na">port</span><span class="o">=</span><span class="s">8440</span>
-<span class="na">secured_port</span><span class="o">=</span><span class="s">8441</span>
-<span class="na">check_path</span><span class="o">=</span><span class="s">/ws/v1/slider/agents/</span>
-<span class="na">register_path</span><span class="o">=</span><span class="s">/ws/v1/slider/agents/{name}/register</span>
-<span class="na">heartbeat_path</span><span class="o">=</span><span class="s">/ws/v1/slider/agents/{name}/heartbeat</span>
-
-<span class="k">[agent]</span>
-<span class="na">app_pkg_dir</span><span class="o">=</span><span class="s">app/definition</span>
-<span class="na">app_install_dir</span><span class="o">=</span><span class="s">app/install</span>
-<span class="na">app_run_dir</span><span class="o">=</span><span class="s">app/run</span>
-<span class="na">app_task_dir</span><span class="o">=</span><span class="s">app/command-log</span>
-<span class="na">app_log_dir</span><span class="o">=</span><span class="s">app/log</span>
-<span class="na">app_tmp_dir</span><span class="o">=</span><span class="s">app/tmp</span>
-<span class="na">log_dir</span><span class="o">=</span><span class="s">infra/log</span>
-<span class="na">run_dir</span><span class="o">=</span><span class="s">infra/run</span>
-<span class="na">version_file</span><span class="o">=</span><span class="s">infra/version</span>
-<span class="na">log_level</span><span class="o">=</span><span class="s">INFO</span>
-
-<span class="k">[python]</span>
-
-<span class="k">[command]</span>
-<span class="na">max_retries</span><span class="o">=</span><span class="s">2</span>
-<span class="na">sleep_between_retries</span><span class="o">=</span><span class="s">1</span>
-
-<span class="k">[security]</span>
-
-<span class="k">[heartbeat]</span>
-<span class="na">state_interval</span><span class="o">=</span><span class="s">6</span>
-<span class="na">log_lines_count</span><span class="o">=</span><span class="s">300</span>
+hdfs dfs -copyFromLocal <span class="cp">${</span><span class="n">slider</span><span class="o">-</span><span class="n">install</span><span class="o">-</span><span class="nb">dir</span><span class="cp">}</span>/slider-0.30.0/agent/slider-agent.tar.gz /slider/agent
</pre></div>
-<p>Once created, deploy the agent.ini file to HDFS:</p>
-<div class="codehilite"><pre><span class="n">su</span> <span class="n">yarn</span>
-
-<span class="n">hdfs</span> <span class="n">dfs</span> <span class="o">-</span><span class="n">copyFromLocal</span> <span class="n">agent</span><span class="p">.</span><span class="n">ini</span> <span class="o">/</span><span class="n">slider</span><span class="o">/</span><span class="n">agent</span><span class="o">/</span><span class="n">conf</span>
-</pre></div>
-
-
-<h2 id="download-sample-application-packages"><a name="downsample"></a>Download Sample Application Packages</h2>
-<p>There are three sample application packages available for download to use with Slider:</p>
-<table>
- <tr>
- <td>Application</td>
- <td>Version</td>
- <td>URL</td>
- </tr>
- <tr>
- <td>Apache HBase</td>
- <td>0.96.0</td>
- <td>http://public-repo-1.hortonworks.com/slider/hbase_v096.tar</td>
- </tr>
- <tr>
- <td>Apache Storm</td>
- <td>0.9.1</td>
- <td>http://public-repo-1.hortonworks.com/slider/storm_v091.tar</td>
- </tr>
- <tr>
- <td>Apache Accumulo</td>
- <td>1.5.1</td>
- <td>http://public-repo-1.hortonworks.com/slider/accumulo_v151.tar</td>
- </tr>
-</table>
-
-<p>Download the packages and deploy one of these sample applications to YARN via Slider using the steps below.</p>
+<h2 id="create-application-packages"><a name="downsample"></a>Create Application Packages</h2>
+<p>Few pre-created application packages are available at: TBD</p>
+<p>Slider "master" branch has three sample application packages available for use with Slider:</p>
+<ul>
+<li>
+<p>app-packages/hbase: The README.txt file describes how to create a Slider Application Package for HBase. By default it will create a package for HBase 0.98.3 but you can create the same for other versions.</p>
+</li>
+<li>
+<p>app-packages/accumulo: The README.txt file describes how to create a Slider Application Package for Accumulo.</p>
+</li>
+<li>
+<p>app-packages/storm: The README.txt describes how to create the Slider Application package for Storm.</p>
+</li>
+</ul>
+<p>Create one or more Slider application packages and follow the steps below to install them.</p>
<h2 id="install-configure-start-and-verify-sample-application"><a name="installapp"></a>Install, Configure, Start and Verify Sample Application</h2>
<ul>
<li>
@@ -421,18 +356,7 @@ hdfs dfs -copyFromLocal <span class="cp"
</li>
</ul>
<h3 id="load-sample-application-package"><a name="load"></a>Load Sample Application Package</h3>
-<div class="codehilite"><pre><span class="n">hdfs</span> <span class="n">dfs</span> <span class="o">-</span><span class="n">copyFromLocal</span> <span class="o">*</span><span class="n">sample</span><span class="o">-</span><span class="n">application</span><span class="o">-</span><span class="n">package</span><span class="o">/</span><span class="n">slider</span>
-</pre></div>
-
-
-<p>If necessary, create HDFS folders needed by the application. For example, HBase requires the following HDFS-based setup:</p>
-<div class="codehilite"><pre><span class="n">su</span> <span class="n">hdfs</span>
-
-<span class="n">hdfs</span> <span class="n">dfs</span> <span class="o">-</span><span class="n">mkdir</span> <span class="o">/</span><span class="n">apps</span>
-
-<span class="n">hdfs</span> <span class="n">dfs</span> <span class="o">-</span><span class="n">mkdir</span> <span class="o">/</span><span class="n">apps</span><span class="o">/</span><span class="n">hbase</span>
-
-<span class="n">hdfs</span> <span class="n">dfs</span> <span class="o">-</span><span class="n">chown</span> <span class="n">yarn</span><span class="o">:</span><span class="n">hdfs</span> <span class="o">/</span><span class="n">apps</span><span class="o">/</span><span class="n">hbase</span>
+<div class="codehilite"><pre><span class="n">hdfs</span> <span class="n">dfs</span> <span class="o">-</span><span class="n">copyFromLocal</span> <span class="o">*</span><span class="n">sample</span><span class="o">-</span><span class="n">application</span><span class="o">-</span><span class="n">package</span><span class="o">*</span> <span class="o">/</span><span class="n">slider</span>
</pre></div>
@@ -440,43 +364,18 @@ hdfs dfs -copyFromLocal <span class="cp"
<p>Configuring a Slider application consists of two parts: the <a href="#resspec">Resource Specification</a>,
and the *<a href="#appconfig">Application Configuration</a>. Below are guidelines for creating these files.</p>
<p><em>Note: There are sample Resource Specifications (<strong>resources.json</strong>) and Application Configuration
-(<strong>appConfig.json</strong>) files in the </em><a href="#appendixa">Appendix</a><em> and also in the root directory of the
-Sample Applications packages (e.g. /<strong>hbase-v096/resources.json</strong> and /<strong>hbase-v096/appConfig.json</strong>).</em></p>
+(<strong>appConfig.json</strong>) files in the root directory of the
+Sample Applications packages (e.g. /<strong>resources.json</strong> and /<strong>appConfig.json</strong>). The Slider git repo also contains sample appConfig.json and resources.json in the application packages directory (e.g. app-packages/hbase/appConfig.json)</em></p>
<h4 id="resource-specification"><a name="resspec"></a>Resource Specification</h4>
<p>Slider needs to know what components (and how many components) are in an application package to deploy. For example, in HBase, the components are <strong><em>master</em></strong> and <strong><em>worker</em></strong> -- the latter hosting <strong>HBase RegionServers</strong>, and the former hosting the <strong>HBase Master</strong>. </p>
<p>As Slider creates each instance of a component in its own YARN container, it also needs to know what to ask YARN for in terms of <strong>memory</strong> and <strong>CPU</strong> for those containers. </p>
<p>All this information goes into the <strong>Resources Specification</strong> file ("Resource Spec") named <code>resources.json</code>. The Resource Spec tells Slider how many instances of each component in the application (such as an HBase RegionServer) to deploy and the parameters for YARN.</p>
-<p>Sample Resource Spec files are available in the Appendix:</p>
-<ul>
-<li>
-<p><a href="#heading=h.1hj8hn5xne7c">Appendix A: Storm Sample Resource Specification</a></p>
-</li>
-<li>
-<p><a href="#heading=h.l7z5mvhvxmzv">Appendix B: HBase Sample Resource Specification</a></p>
-</li>
-</ul>
<p>Store the Resource Spec file on your local disk (e.g. <code>/tmp/resources.json</code>).</p>
+<p><a href="#appendixb">Appendix B</a> provides some sample resources.json files.</p>
<h4 id="application-configuration"><a name="appconfig"></a>Application Configuration</h4>
<p>Alongside the Resource Spec there is the <strong>Application Configuration</strong> file ("App Config") which includes parameters that are specific to the application, rather than YARN. The App Config is a file that contains all application configuration. This configuration is applied to the default configuration provided by the application definition and then handed off to the associated component agent.</p>
<p>For example, the heap sizes of the JVMs, The App Config defines the configuration details <strong>specific to the application and component</strong> instances. For HBase, this includes any values for the <em>to-be-generated </em>hbase-site.xml file, as well as options for individual components, such as their heap size.</p>
-<p>Sample App Configs are available in the Appendix:</p>
-<ul>
-<li>
-<p><a href="#heading=h.2qai3c6w260l">Appendix A: Storm Sample Application Configuration</a></p>
-</li>
-<li>
-<p><a href="#heading=h.hetv1wn44c5x">Appendix B: HBase Sample Application Configuration</a></p>
-</li>
-</ul>
-<p>Store the appConfig.json file on your local disc and a copy in HDFS:</p>
-<div class="codehilite"><pre><span class="n">su</span> <span class="n">yarn</span>
-
-<span class="n">hdfs</span> <span class="n">dfs</span> <span class="o">-</span><span class="n">mkdir</span> <span class="o">/</span><span class="n">slider</span><span class="o">/</span><span class="n">appconf</span>
-
-<span class="n">hdfs</span> <span class="n">dfs</span> <span class="o">-</span><span class="n">copyFromLocal</span> <span class="n">appConf</span><span class="p">.</span><span class="n">json</span> <span class="o">/</span><span class="n">slider</span><span class="o">/</span><span class="n">appconf</span>
-</pre></div>
-
-
+<p><a href="#appendixc">Appendix C</a> provides a sample appConfig.json file.</p>
<h3 id="start-the-application"><a name="start"></a>Start the Application</h3>
<p>Once the steps above are completed, the application can be started through the <strong>Slider Command Line Interface (CLI)</strong>.</p>
<p>Change directory to the "bin" directory under the slider installation</p>
@@ -485,145 +384,186 @@ Sample Applications packages (e.g. /<str
<p>Execute the following command:</p>
-<div class="codehilite"><pre><span class="p">.</span><span class="o">/</span><span class="n">slider</span> <span class="n">create</span> <span class="n">cl1</span> <span class="o">--</span><span class="n">manager</span> <span class="n">yourResourceManagerHost</span><span class="o">:</span><span class="mi">8050</span> <span class="o">--</span><span class="n">image</span> <span class="n">hdfs</span><span class="o">:</span><span class="c1">//yourNameNodeHost:8020/slider/agent/slider-agent-0.30.0.tar.gz --template appConfig.json --resources resources.json</span>
+<div class="codehilite"><pre><span class="p">.</span><span class="o">/</span><span class="n">slider</span> <span class="n">create</span> <span class="n">cl1</span> <span class="o">--</span><span class="n">image</span> <span class="n">hdfs</span><span class="o">:</span><span class="c1">//yourNameNodeHost:8020/slider/agent/slider-agent.tar.gz --template appConfig.json --resources resources.json</span>
</pre></div>
<h3 id="verify-the-application"><a name="verify"></a>Verify the Application</h3>
<p>The successful launch of the application can be verified via the YARN Resource Manager Web UI. In most instances, this UI is accessible via a web browser at port 8088 of the Resource Manager Host:</p>
-<p><img alt="image alt text" src="images/image_0.png" /></p>
+<p><img alt="image alt text" src="../images/image_1_apps_rm_ui-lrg.png" /></p>
<p>The specific information for the running application is accessible via the "ApplicationMaster" link that can be seen in the far right column of the row associated with the running application (probably the top row):</p>
-<p><img alt="image alt text" src="images/image_1.png" /></p>
+<p><img alt="image alt text" src="../images/image_0_app_master_ui_lrg.png" /></p>
+<h3 id="obtain-client-config"><a name="client-config"></a>Obtain client config</h3>
+<p>An application publishes several useful details that can be used to manage and communicate with the application instance.</p>
+<p><strong>All published data</strong></p>
+<p>All published data are available at the <code>/ws/v1/slider/publisher</code> end point of the AppMaster (e.g. http://c6403.ambari.apache.org:34701/ws/v1/slider/publisher). Its obtainable through <code>slider-client status <app name></code> where field <code>info.am.web.url</code> specifies the base address. The URL is also advertised in the AppMaster tracking UI.</p>
+<p><strong>Client configuration</strong>
+Client configurations are at <code>/ws/v1/slider/publisher/slider\<config name></code> where <em>config name</em> can be </p>
+<ul>
+<li>site config file name without extension, such as <code>hbase-site</code> (e.g. http://c6403.ambari.apache.org:34701/ws/v1/slider/publisher/slider/hbase-site) where the output is json formatted name-value pairs</li>
+<li>or, with extension such as <code>hbase-site.xml</code> (http://c6403.ambari.apache.org:34701/ws/v1/slider/publisher/slider/hbase-site.xml) to get an XML formatted output that can be consumed by the clients</li>
+</ul>
+<p><strong>Log locations</strong></p>
+<p>The log locations for various containers in the application instance are at <code>ws/v1/slider/publisher/slider/logfolders</code></p>
+<div class="codehilite"><pre><span class="p">{</span>
+
+ <span class="s">"description"</span><span class="o">:</span> <span class="s">"LogFolders"</span><span class="p">,</span>
+ <span class="s">"entries"</span><span class="o">:</span> <span class="p">{</span>
+ <span class="s">"c6403.ambari.apache.org-container_1404783501621_0002_01_000002-AGENT_LOG_ROOT"</span><span class="o">:</span> <span class="s">"/hadoop/yarn/log/application_1404783501621_0002/container_1404783501621_0002_01_000002"</span><span class="p">,</span>
+ <span class="s">"c6403.ambari.apache.org-container_1404783501621_0002_01_000003-AGENT_LOG_ROOT"</span><span class="o">:</span> <span class="s">"/hadoop/yarn/log/application_1404783501621_0002/container_1404783501621_0002_01_000003"</span><span class="p">,</span>
+ <span class="s">"c6403.ambari.apache.org-container_1404783501621_0002_01_000003-AGENT_WORK_ROOT"</span><span class="o">:</span> <span class="s">"/hadoop/yarn/local/usercache/yarn/appcache/application_1404783501621_0002/container_1404783501621_0002_01_000003"</span><span class="p">,</span>
+ <span class="s">"c6403.ambari.apache.org-container_1404783501621_0002_01_000002-AGENT_WORK_ROOT"</span><span class="o">:</span> <span class="s">"/hadoop/yarn/local/usercache/yarn/appcache/application_1404783501621_0002/container_1404783501621_0002_01_000002"</span>
+ <span class="p">},</span>
+ <span class="s">"updated"</span><span class="o">:</span> <span class="mi">0</span><span class="p">,</span>
+ <span class="s">"empty"</span><span class="o">:</span> <span class="nb">false</span>
+<span class="p">}</span>
+</pre></div>
+
+
+<p><strong>Quick links</strong></p>
+<p>An application may publish some quick links for the monitoring UI, JMX endpoint, etc. as the listening ports are dynamically allocated and thus need to be published. These information is available at <code>/ws/v1/slider/publisher/slider/quicklinks</code>.</p>
<h3 id="manage-the-application-lifecycle"><a name="manage"></a>Manage the Application Lifecycle</h3>
<p>Once started, applications can be frozen/stopped, thawed/restarted, and destroyed/removed as follows:</p>
<h4 id="frozen">Frozen:</h4>
-<div class="codehilite"><pre><span class="p">.</span><span class="o">/</span><span class="n">slider</span> <span class="n">freeze</span> <span class="n">cl1</span> <span class="o">--</span><span class="n">manager</span> <span class="n">yourResourceManagerHost</span><span class="o">:</span><span class="mi">8050</span> <span class="o">--</span><span class="n">filesystem</span> <span class="n">hdfs</span><span class="o">:</span><span class="c1">//yourNameNodeHost:8020</span>
+<div class="codehilite"><pre><span class="p">.</span><span class="o">/</span><span class="n">slider</span> <span class="n">freeze</span> <span class="n">cl1</span>
</pre></div>
<h4 id="thawed">Thawed:</h4>
-<div class="codehilite"><pre><span class="p">.</span><span class="o">/</span><span class="n">slider</span> <span class="n">thaw</span> <span class="n">cl1</span> <span class="o">--</span><span class="n">manager</span> <span class="n">yourResourceManagerHost</span><span class="o">:</span><span class="mi">8050</span> <span class="o">--</span><span class="n">filesystem</span> <span class="n">hdfs</span><span class="o">:</span><span class="c1">//yourNameNodeHost:8020</span>
+<div class="codehilite"><pre><span class="p">.</span><span class="o">/</span><span class="n">slider</span> <span class="n">thaw</span> <span class="n">cl1</span>
</pre></div>
<h4 id="destroyed">Destroyed:</h4>
-<div class="codehilite"><pre><span class="p">.</span><span class="o">/</span><span class="n">slider</span> <span class="n">destroy</span> <span class="n">cl1</span> <span class="o">--</span><span class="n">manager</span> <span class="n">yourResourceManagerHost</span><span class="o">:</span><span class="mi">8050</span> <span class="o">--</span><span class="n">filesystem</span> <span class="n">hdfs</span><span class="o">:</span><span class="c1">//yourNameNodeHost:8020</span>
+<div class="codehilite"><pre><span class="p">.</span><span class="o">/</span><span class="n">slider</span> <span class="n">destroy</span>
</pre></div>
<h4 id="flexed">Flexed:</h4>
-<div class="codehilite"><pre><span class="p">.</span><span class="o">/</span><span class="n">slider</span> <span class="n">flex</span> <span class="n">cl1</span> <span class="o">--</span><span class="n">component</span> <span class="n">worker</span> <span class="mi">5</span> <span class="o">--</span><span class="n">manager</span> <span class="n">yourResourceManagerHost</span><span class="o">:</span><span class="mi">8050</span> <span class="o">--</span><span class="n">filesystem</span> <span class="n">hdfs</span><span class="o">:</span><span class="c1">//yourNameNodeHost:8020</span>
+<div class="codehilite"><pre><span class="p">.</span><span class="o">/</span><span class="n">slider</span> <span class="n">flex</span> <span class="n">cl1</span> <span class="o">--</span><span class="n">component</span> <span class="n">worker</span> <span class="mi">5</span>
</pre></div>
-<h1 id="appendix-a-apache-storm-sample-application-specifications"><a name="appendixa"></a>Appendix A: Apache Storm Sample Application Specifications</h1>
-<h2 id="storm-resource-specification-sample">Storm Resource Specification Sample</h2>
-<div class="codehilite"><pre><span class="p">{</span>
- <span class="s">"schema"</span> <span class="o">:</span> <span class="s">"http://example.org/specification/v2.0.0"</span><span class="p">,</span>
- <span class="s">"metadata"</span> <span class="o">:</span> <span class="p">{</span>
- <span class="p">},</span>
- <span class="s">"global"</span> <span class="o">:</span> <span class="p">{</span>
- <span class="p">},</span>
- <span class="s">"components"</span> <span class="o">:</span> <span class="p">{</span>
- <span class="s">"slider-appmaster"</span> <span class="o">:</span> <span class="p">{</span>
- <span class="p">},</span>
- <span class="s">"NIMBUS"</span> <span class="o">:</span> <span class="p">{</span>
- <span class="s">"yarn.role.priority"</span> <span class="o">:</span> <span class="s">"1"</span><span class="p">,</span>
- <span class="s">"yarn.component.instances"</span> <span class="o">:</span> <span class="s">"1"</span>
- <span class="p">},</span>
- <span class="s">"STORM_REST_API"</span> <span class="o">:</span> <span class="p">{</span>
- <span class="s">"yarn.role.priority"</span> <span class="o">:</span> <span class="s">"2"</span><span class="p">,</span>
- <span class="s">"yarn.component.instances"</span> <span class="o">:</span> <span class="s">"1"</span>
- <span class="p">},</span>
- <span class="s">"STORM_UI_SERVER"</span> <span class="o">:</span> <span class="p">{</span>
- <span class="s">"yarn.role.priority"</span> <span class="o">:</span> <span class="s">"3"</span><span class="p">,</span>
- <span class="s">"yarn.component.instances"</span> <span class="o">:</span> <span class="s">"1"</span>
- <span class="p">},</span>
- <span class="s">"DRPC_SERVER"</span> <span class="o">:</span> <span class="p">{</span>
- <span class="s">"yarn.role.priority"</span> <span class="o">:</span> <span class="s">"4"</span><span class="p">,</span>
- <span class="s">"yarn.component.instances"</span> <span class="o">:</span> <span class="s">"1"</span>
- <span class="p">},</span>
- <span class="s">"SUPERVISOR"</span> <span class="o">:</span> <span class="p">{</span>
- <span class="s">"yarn.role.priority"</span> <span class="o">:</span> <span class="s">"5"</span><span class="p">,</span>
- <span class="s">"yarn.component.instances"</span> <span class="o">:</span> <span class="s">"1"</span>
- <span class="p">}</span>
- <span class="p">}</span>
-<span class="p">}</span>
+<h1 id="appendix-a-debugging-slider-agent"><a name="appendixa"></a>Appendix A: Debugging Slider-Agent</h1>
+<h2 id="create-and-deploy-slider-agent-configuration">Create and deploy Slider Agent configuration</h2>
+<p>Create an agent config file (agent.ini) based on the sample available at:</p>
+<div class="codehilite"><pre><span class="cp">${</span><span class="n">slider</span><span class="o">-</span><span class="n">install</span><span class="o">-</span><span class="nb">dir</span><span class="cp">}</span>/slider-0.30.0/agent/conf/agent.ini
</pre></div>
-<h2 id="storm-application-configuration-sample">Storm Application Configuration Sample</h2>
-<div class="codehilite"><pre>{
- "schema" : "http://example.org/specification/v2.0.0",
- "metadata" : {
- },
- "global" : {
- "A site property for type XYZ with name AA": "its value",
- "site.XYZ.AA": "Value",
- "site.hbase-site.hbase.regionserver.port": "0",
- "site.core-site.fs.defaultFS": "<span class="cp">${</span><span class="n">NN_URI</span><span class="cp">}</span>",
- "Using a well known keyword": "Such as NN_HOST for name node host",
- "site.hdfs-site.dfs.namenode.http-address": "<span class="cp">${</span><span class="n">NN_HOST</span><span class="cp">}</span>:50070",
- "a global property used by app scripts": "not affiliated with any site-xml",
- "site.global.app_user": "yarn",
- "Another example of available keywords": "Such as AGENT_LOG_ROOT",
- "site.global.app_log_dir": "<span class="cp">${</span><span class="n">AGENT_LOG_ROOT</span><span class="cp">}</span>/app/log",
- "site.global.app_pid_dir": "<span class="cp">${</span><span class="n">AGENT_WORK_ROOT</span><span class="cp">}</span>/app/run",
- }
-}
+<p>The sample agent.ini file can be used as is (see below). Some of the parameters of interest are:</p>
+<p><code>log_level</code> = INFO or DEBUG, to control the verbosity of log</p>
+<p><code>app_log_dir</code> = the relative location of the application log file</p>
+<p><code>log_dir</code> = the relative location of the agent and command log file</p>
+<div class="codehilite"><pre><span class="k">[server]</span>
+<span class="na">hostname</span><span class="o">=</span><span class="s">localhost</span>
+<span class="na">port</span><span class="o">=</span><span class="s">8440</span>
+<span class="na">secured_port</span><span class="o">=</span><span class="s">8441</span>
+<span class="na">check_path</span><span class="o">=</span><span class="s">/ws/v1/slider/agents/</span>
+<span class="na">register_path</span><span class="o">=</span><span class="s">/ws/v1/slider/agents/{name}/register</span>
+<span class="na">heartbeat_path</span><span class="o">=</span><span class="s">/ws/v1/slider/agents/{name}/heartbeat</span>
+
+<span class="k">[agent]</span>
+<span class="na">app_pkg_dir</span><span class="o">=</span><span class="s">app/definition</span>
+<span class="na">app_install_dir</span><span class="o">=</span><span class="s">app/install</span>
+<span class="na">app_run_dir</span><span class="o">=</span><span class="s">app/run</span>
+<span class="na">app_dbg_cmd</span><span class="o">=</span>
+<span class="na">debug_mode_enabled</span><span class="o">=</span><span class="s">true</span>
+
+<span class="na">app_task_dir</span><span class="o">=</span><span class="s">app/command-log</span>
+<span class="na">app_log_dir</span><span class="o">=</span><span class="s">app/log</span>
+<span class="na">app_tmp_dir</span><span class="o">=</span><span class="s">app/tmp</span>
+
+<span class="na">log_dir</span><span class="o">=</span><span class="s">infra/log</span>
+<span class="na">run_dir</span><span class="o">=</span><span class="s">infra/run</span>
+<span class="na">version_file</span><span class="o">=</span><span class="s">infra/version</span>
+
+<span class="na">log_level</span><span class="o">=</span><span class="s">INFO</span>
+
+<span class="k">[python]</span>
+
+<span class="k">[command]</span>
+<span class="na">max_retries</span><span class="o">=</span><span class="s">2</span>
+<span class="na">sleep_between_retries</span><span class="o">=</span><span class="s">1</span>
+
+<span class="k">[security]</span>
+
+<span class="k">[heartbeat]</span>
+<span class="na">state_interval</span><span class="o">=</span><span class="s">6</span>
+<span class="na">log_lines_count</span><span class="o">=</span><span class="s">300</span>
</pre></div>
-<h1 id="appendix-b-apache-hbase-sample-application-specifications"><a name="appendixb"></a>Appendix B: Apache HBase Sample Application Specifications</h1>
-<h2 id="hbase-resource-specification-sample">HBase Resource Specification Sample</h2>
+<p>Once created, deploy the agent.ini file to HDFS (it can be deployed in any location accessible to application instance):</p>
+<div class="codehilite"><pre><span class="n">su</span> <span class="n">yarn</span>
+
+<span class="n">hdfs</span> <span class="n">dfs</span> <span class="o">-</span><span class="n">copyFromLocal</span> <span class="n">agent</span><span class="p">.</span><span class="n">ini</span> <span class="o">/</span><span class="n">slider</span><span class="o">/</span><span class="n">agent</span><span class="o">/</span><span class="n">conf</span>
+</pre></div>
+
+
+<p>Modify the --template json file (appConfig.json) and add the location of the agent.ini file.</p>
+<div class="codehilite"><pre><span class="s">"agent.conf"</span><span class="o">:</span> <span class="s">"/slider/agent/conf/agent.ini"</span>
+</pre></div>
+
+
+<h1 id="appendix-b-resource-template-resourcesjson"><a name="appendixb"></a>Appendix B: Resource template (resources.json)</h1>
+<p>This sample is suitable for HBase application.</p>
<div class="codehilite"><pre><span class="p">{</span>
- <span class="s">"schema"</span> <span class="o">:</span> <span class="s">"http://example.org/specification/v2.0.0"</span><span class="p">,</span>
- <span class="s">"metadata"</span> <span class="o">:</span> <span class="p">{</span>
+ <span class="s">"schema"</span><span class="o">:</span> <span class="s">"http://example.org/specification/v2.0.0"</span><span class="p">,</span>
+ <span class="s">"metadata"</span><span class="o">:</span> <span class="p">{</span>
<span class="p">},</span>
- <span class="s">"global"</span> <span class="o">:</span> <span class="p">{</span>
+ <span class="s">"global"</span><span class="o">:</span> <span class="p">{</span>
<span class="p">},</span>
- <span class="s">"components"</span> <span class="o">:</span> <span class="p">{</span>
- <span class="s">"HBASE_MASTER"</span> <span class="o">:</span> <span class="p">{</span>
- <span class="s">"yarn.role.priority"</span> <span class="o">:</span> <span class="s">"1"</span><span class="p">,</span>
- <span class="s">"yarn.component.instances"</span> <span class="o">:</span> <span class="s">"1"</span>
+ <span class="s">"components"</span><span class="o">:</span> <span class="p">{</span>
+ <span class="s">"HBASE_MASTER"</span><span class="o">:</span> <span class="p">{</span>
+ <span class="s">"yarn.role.priority"</span><span class="o">:</span> <span class="s">"1"</span><span class="p">,</span>
+ <span class="s">"yarn.component.instances"</span><span class="o">:</span> <span class="s">"1"</span><span class="p">,</span>
+ <span class="s">"yarn.memory"</span><span class="o">:</span> <span class="s">"256"</span>
<span class="p">},</span>
- <span class="s">"slider-appmaster"</span> <span class="o">:</span> <span class="p">{</span>
+ <span class="s">"slider-appmaster"</span><span class="o">:</span> <span class="p">{</span>
<span class="p">},</span>
- <span class="s">"HBASE_REGIONSERVER"</span> <span class="o">:</span> <span class="p">{</span>
- <span class="s">"yarn.role.priority"</span> <span class="o">:</span> <span class="s">"2"</span><span class="p">,</span>
- <span class="s">"yarn.component.instances"</span> <span class="o">:</span> <span class="s">"1"</span>
+ <span class="s">"HBASE_REGIONSERVER"</span><span class="o">:</span> <span class="p">{</span>
+ <span class="s">"yarn.role.priority"</span><span class="o">:</span> <span class="s">"2"</span><span class="p">,</span>
+ <span class="s">"yarn.component.instances"</span><span class="o">:</span> <span class="s">"1"</span><span class="p">,</span>
+ <span class="s">"yarn.memory"</span><span class="o">:</span> <span class="s">"256"</span>
<span class="p">}</span>
<span class="p">}</span>
<span class="p">}</span>
</pre></div>
-<h2 id="hbase-application-configuration-sample">HBase Application Configuration Sample</h2>
+<h1 id="appendix-c-config-template-appcofigjson"><a name="appendixc"></a>Appendix C: Config template (appCofig.json)</h1>
+<p>This sample is suitable for HBase application. See <a href="/doc/slider_specs/application_instance_configuration.html">Application Instance Configuration</a> for detailed explanation of how to create an appConfig.json file.</p>
<div class="codehilite"><pre>{
- "schema" : "http://example.org/specification/v2.0.0",
- "metadata" : {
+ "schema": "http://example.org/specification/v2.0.0",
+ "metadata": {
},
- "global" : {
- "agent.conf": "/slider/agent/conf/agent.ini",
- "agent.version": "/slider/agent/version",
- "application.def": "/slider/hbase_v096.tar",
+ "global": {
+ "application.def": "<span class="cp">${</span><span class="n">app</span><span class="o">.</span><span class="n">package</span><span class="o">.</span><span class="n">name</span><span class="cp">}</span>.zip",
+ "create.default.zookeeper.node": "true",
"config_types": "core-site,hdfs-site,hbase-site",
"java_home": "/usr/jdk64/jdk1.7.0_45",
- "package_list": "files/hbase-0.96.1-hadoop2-bin.tar",
+ "package_list": "files/hbase-<span class="cp">${</span><span class="n">hbase</span><span class="o">.</span><span class="n">version</span><span class="cp">}</span>-bin.tar.gz",
"site.global.app_user": "yarn",
"site.global.app_log_dir": "<span class="cp">${</span><span class="n">AGENT_LOG_ROOT</span><span class="cp">}</span>/app/log",
"site.global.app_pid_dir": "<span class="cp">${</span><span class="n">AGENT_WORK_ROOT</span><span class="cp">}</span>/app/run",
- "site.global.app_root": "<span class="cp">${</span><span class="n">AGENT_WORK_ROOT</span><span class="cp">}</span>/app/install/hbase-0.96.1-hadoop2",
+ "site.global.app_root": "<span class="cp">${</span><span class="n">AGENT_WORK_ROOT</span><span class="cp">}</span>/app/install/hbase-<span class="cp">${</span><span class="n">hbase</span><span class="o">.</span><span class="n">version</span><span class="cp">}</span>",
"site.global.app_install_dir": "<span class="cp">${</span><span class="n">AGENT_WORK_ROOT</span><span class="cp">}</span>/app/install",
"site.global.hbase_master_heapsize": "1024m",
"site.global.hbase_regionserver_heapsize": "1024m",
+ "site.global.hbase_instance_name": "instancename",
+ "site.global.hbase_root_password": "secret",
"site.global.user_group": "hadoop",
"site.global.security_enabled": "false",
+ "site.global.monitor_protocol": "http",
+ "site.global.ganglia_server_host": "<span class="cp">${</span><span class="n">NN_HOST</span><span class="cp">}</span>",
+ "site.global.ganglia_server_port": "8667",
+ "site.global.ganglia_server_id": "Application1",
"site.hbase-site.hbase.hstore.flush.retries.number": "120",
"site.hbase-site.hbase.client.keyvalue.maxsize": "10485760",
"site.hbase-site.hbase.hstore.compactionThreshold": "3",
- "site.hbase-site.hbase.rootdir": "<span class="cp">${</span><span class="n">NN_URI</span><span class="cp">}</span>/apps/hbase/data",
- "site.hbase-site.hbase.stagingdir": "<span class="cp">${</span><span class="n">NN_URI</span><span class="cp">}</span>/apps/hbase/staging",
+ "site.hbase-site.hbase.rootdir": "<span class="cp">${</span><span class="n">DEFAULT_DATA_DIR</span><span class="cp">}</span>/data",
+ "site.hbase-site.hbase.stagingdir": "<span class="cp">${</span><span class="n">DEFAULT_DATA_DIR</span><span class="cp">}</span>/staging",
"site.hbase-site.hbase.regionserver.handler.count": "60",
"site.hbase-site.hbase.regionserver.global.memstore.lowerLimit": "0.38",
"site.hbase-site.hbase.hregion.memstore.block.multiplier": "2",
@@ -639,7 +579,7 @@ Sample Applications packages (e.g. /<str
"site.hbase-site.hbase.security.authentication": "simple",
"site.hbase-site.hbase.defaults.for.version.skip": "true",
"site.hbase-site.hbase.zookeeper.quorum": "<span class="cp">${</span><span class="n">ZK_HOST</span><span class="cp">}</span>",
- "site.hbase-site.zookeeper.znode.parent": "/hbase-unsecure",
+ "site.hbase-site.zookeeper.znode.parent": "<span class="cp">${</span><span class="n">DEF_ZK_PATH</span><span class="cp">}</span>",
"site.hbase-site.hbase.hstore.blockingStoreFiles": "10",
"site.hbase-site.hbase.hregion.majorcompaction": "86400000",
"site.hbase-site.hbase.security.authorization": "false",
@@ -648,16 +588,20 @@ Sample Applications packages (e.g. /<str
"site.hbase-site.hbase.client.scanner.caching": "100",
"site.hbase-site.hbase.zookeeper.useMulti": "true",
"site.hbase-site.hbase.regionserver.info.port": "0",
- "site.hbase-site.hbase.master.info.port": "60010",
- "site.hbase-site.hbase.regionserver.port": "0",
- "site.core-site.fs.defaultFS": "<span class="cp">${</span><span class="n">NN_URI</span><span class="cp">}</span>",
- "site.hdfs-site.dfs.namenode.https-address": "<span class="cp">${</span><span class="n">NN_HOST</span><span class="cp">}</span>:50470",
- "site.hdfs-site.dfs.namenode.http-address": "<span class="cp">${</span><span class="n">NN_HOST</span><span class="cp">}</span>:50070"
+ "site.hbase-site.hbase.master.info.port": "<span class="cp">${</span><span class="n">HBASE_MASTER</span><span class="o">.</span><span class="n">ALLOCATED_PORT</span><span class="cp">}</span>",
+ "site.hbase-site.hbase.regionserver.port": "0"
+ },
+ "components": {
+ "HBASE_MASTER": {
+ },
+ "slider-appmaster": {
+ "jvm.heapsize": "256M"
+ },
+ "HBASE_REGIONSERVER": {
+ }
}
+}
</pre></div>
-
-
-<p>}</p>
</div>
<div id="footer">
Modified: incubator/slider/site/content/docs/manpage.html
URL: http://svn.apache.org/viewvc/incubator/slider/site/content/docs/manpage.html?rev=1609635&r1=1609634&r2=1609635&view=diff
==============================================================================
--- incubator/slider/site/content/docs/manpage.html (original)
+++ incubator/slider/site/content/docs/manpage.html Fri Jul 11 06:20:20 2014
@@ -108,7 +108,7 @@
<li id="nav_use_client_config"><a href="/docs/client-configuration.html">Client Configuration</a></li>
<li id="nav_use_exitcodes"><a href="/docs/exitcodes.html">Client Exit Codes</a></li>
<li id="nav_use_security"><a href="/docs/security.html">Security</a></li>
-<li id="nav_use_app_package"><a href="/docs/slider_specs/index.html">App Packaging</a></li>
+<li id="nav_use_app_package"><a href="/docs/slider_specs/index.html">Creating App Packages</a></li>
<li id="nav_use_app_configuration"><a href="/docs/configuration/index.html">App Configuration Model</a></li>
<li id="nav_use_debugging"><a href="/docs/debugging.html">Debugging</a></li>
<li id="nav_use_troubleshooting"><a href="/docs/troubleshooting.html">Troubleshooting</a></li>
@@ -463,11 +463,11 @@ in <a href="exitcodes.html">Exit Codes</
is not found, the command returns the exit code <code>EXIT_NOT_FOUND</code> (77)</li>
</ol>
<p>Operations:</p>
-<h4 id="registry-list-servicetype-servicetype-name-name-verbose"><code>registry --list [--servicetype <servicetype>] [--name <name>] [--verbose]</code></h4>
+<h4 id="slider-registry-list-servicetype-servicetype-name-name-verbose"><code>slider registry --list [--servicetype <servicetype>] [--name <name>] [--verbose]</code></h4>
<p>List all services of the service type and optionally the name. </p>
-<h4 id="registry-listconf-name-name-internal-servicetype-servicetype"><code>registry --listconf [--name <name>] [--internal] [--servicetype <servicetype>]</code></h4>
+<h4 id="slider-registry-listconf-name-name-internal-servicetype-servicetype"><code>slider registry --listconf [--name <name>] [--internal] [--servicetype <servicetype>]</code></h4>
<p>List the configurations exported by of a named application</p>
-<h4 id="registry-getconf-configuration-format-xmljsonproperties-dest-path-internal-get-the-configuration"><code>registry --getconf <configuration> [--format (xml|json|properties)] [--dest <path>] [--internal]</code> get the configuration</h4>
+<h4 id="slider-registry-getconf-configuration-format-xmljsonproperties-dest-path-internal-get-the-configuration"><code>slider registry --getconf <configuration> [--format (xml|json|properties)] [--dest <path>] [--internal]</code> get the configuration</h4>
<p>Get a named configuration in a chosen format. Default: XML</p>
<p><code>--dest <path></code> : the filename or directory to save a configuration to.
<code>--format (xml|json|properties)</code> defines the output format</p>
Modified: incubator/slider/site/content/docs/security.html
URL: http://svn.apache.org/viewvc/incubator/slider/site/content/docs/security.html?rev=1609635&r1=1609634&r2=1609635&view=diff
==============================================================================
--- incubator/slider/site/content/docs/security.html (original)
+++ incubator/slider/site/content/docs/security.html Fri Jul 11 06:20:20 2014
@@ -108,7 +108,7 @@
<li id="nav_use_client_config"><a href="/docs/client-configuration.html">Client Configuration</a></li>
<li id="nav_use_exitcodes"><a href="/docs/exitcodes.html">Client Exit Codes</a></li>
<li id="nav_use_security"><a href="/docs/security.html">Security</a></li>
-<li id="nav_use_app_package"><a href="/docs/slider_specs/index.html">App Packaging</a></li>
+<li id="nav_use_app_package"><a href="/docs/slider_specs/index.html">Creating App Packages</a></li>
<li id="nav_use_app_configuration"><a href="/docs/configuration/index.html">App Configuration Model</a></li>
<li id="nav_use_debugging"><a href="/docs/debugging.html">Debugging</a></li>
<li id="nav_use_troubleshooting"><a href="/docs/troubleshooting.html">Troubleshooting</a></li>
Modified: incubator/slider/site/content/docs/slider_specs/application_configuration.html
URL: http://svn.apache.org/viewvc/incubator/slider/site/content/docs/slider_specs/application_configuration.html?rev=1609635&r1=1609634&r2=1609635&view=diff
==============================================================================
--- incubator/slider/site/content/docs/slider_specs/application_configuration.html (original)
+++ incubator/slider/site/content/docs/slider_specs/application_configuration.html Fri Jul 11 06:20:20 2014
@@ -108,7 +108,7 @@
<li id="nav_use_client_config"><a href="/docs/client-configuration.html">Client Configuration</a></li>
<li id="nav_use_exitcodes"><a href="/docs/exitcodes.html">Client Exit Codes</a></li>
<li id="nav_use_security"><a href="/docs/security.html">Security</a></li>
-<li id="nav_use_app_package"><a href="/docs/slider_specs/index.html">App Packaging</a></li>
+<li id="nav_use_app_package"><a href="/docs/slider_specs/index.html">Creating App Packages</a></li>
<li id="nav_use_app_configuration"><a href="/docs/configuration/index.html">App Configuration Model</a></li>
<li id="nav_use_debugging"><a href="/docs/debugging.html">Debugging</a></li>
<li id="nav_use_troubleshooting"><a href="/docs/troubleshooting.html">Troubleshooting</a></li>
Modified: incubator/slider/site/content/docs/slider_specs/application_definition.html
URL: http://svn.apache.org/viewvc/incubator/slider/site/content/docs/slider_specs/application_definition.html?rev=1609635&r1=1609634&r2=1609635&view=diff
==============================================================================
--- incubator/slider/site/content/docs/slider_specs/application_definition.html (original)
+++ incubator/slider/site/content/docs/slider_specs/application_definition.html Fri Jul 11 06:20:20 2014
@@ -108,7 +108,7 @@
<li id="nav_use_client_config"><a href="/docs/client-configuration.html">Client Configuration</a></li>
<li id="nav_use_exitcodes"><a href="/docs/exitcodes.html">Client Exit Codes</a></li>
<li id="nav_use_security"><a href="/docs/security.html">Security</a></li>
-<li id="nav_use_app_package"><a href="/docs/slider_specs/index.html">App Packaging</a></li>
+<li id="nav_use_app_package"><a href="/docs/slider_specs/index.html">Creating App Packages</a></li>
<li id="nav_use_app_configuration"><a href="/docs/configuration/index.html">App Configuration Model</a></li>
<li id="nav_use_debugging"><a href="/docs/debugging.html">Debugging</a></li>
<li id="nav_use_troubleshooting"><a href="/docs/troubleshooting.html">Troubleshooting</a></li>
Modified: incubator/slider/site/content/docs/slider_specs/application_instance_configuration.html
URL: http://svn.apache.org/viewvc/incubator/slider/site/content/docs/slider_specs/application_instance_configuration.html?rev=1609635&r1=1609634&r2=1609635&view=diff
==============================================================================
--- incubator/slider/site/content/docs/slider_specs/application_instance_configuration.html (original)
+++ incubator/slider/site/content/docs/slider_specs/application_instance_configuration.html Fri Jul 11 06:20:20 2014
@@ -108,7 +108,7 @@
<li id="nav_use_client_config"><a href="/docs/client-configuration.html">Client Configuration</a></li>
<li id="nav_use_exitcodes"><a href="/docs/exitcodes.html">Client Exit Codes</a></li>
<li id="nav_use_security"><a href="/docs/security.html">Security</a></li>
-<li id="nav_use_app_package"><a href="/docs/slider_specs/index.html">App Packaging</a></li>
+<li id="nav_use_app_package"><a href="/docs/slider_specs/index.html">Creating App Packages</a></li>
<li id="nav_use_app_configuration"><a href="/docs/configuration/index.html">App Configuration Model</a></li>
<li id="nav_use_debugging"><a href="/docs/debugging.html">Debugging</a></li>
<li id="nav_use_troubleshooting"><a href="/docs/troubleshooting.html">Troubleshooting</a></li>
@@ -206,6 +206,7 @@ Latest release: <strong>0.30-incubating<
"site.hbase-site.hbase.tmp.dir": "<span class="cp">${</span><span class="n">AGENT_WORK_ROOT</span><span class="cp">}</span>/work/app/tmp",
"site.hbase-site.hbase.master.info.port": "<span class="cp">${</span><span class="n">HBASE_MASTER</span><span class="o">.</span><span class="n">ALLOCATED_PORT</span><span class="cp">}</span>",
"site.hbase-site.hbase.regionserver.port": "0",
+ "site.hbase-site.zookeeper.znode.parent": "<span class="cp">${</span><span class="n">DEF_ZK_PATH</span><span class="cp">}</span>",
"site.core-site.fs.defaultFS": "<span class="cp">${</span><span class="n">NN_URI</span><span class="cp">}</span>",
"site.hdfs-site.dfs.namenode.https-address": "<span class="cp">${</span><span class="n">NN_HOST</span><span class="cp">}</span>:50470",
@@ -216,8 +217,8 @@ Latest release: <strong>0.30-incubating<
<p>appConf.json allows you to pass in arbitrary set of configuration that Slider will forward to the application component instances.</p>
-<p><strong>Variable naming convention</strong>
-In order to understand how the naming convention work, lets look at how the config is passed on to component commands. Slider agent recevies a structured bag of commands as input for all commands, INSTALL, CONFIGURE, START, etc. The command includes a section "configuration" which has config properties arranged into named property bags.</p>
+<h2 id="variable-naming-convention">Variable naming convention</h2>
+<p>In order to understand how the naming convention work, lets look at how the config is passed on to component commands. Slider agent recevies a structured bag of commands as input for all commands, INSTALL, CONFIGURE, START, etc. The command includes a section "configuration" which has config properties arranged into named property bags.</p>
<ul>
<li>Variables of the form <code>site.xx.yy</code> translates to variables by the name <code>yy</code> within the group <code>xx</code> and are typically converted to site config files by the name <code>xx</code> containing variable <code>yy</code>. For example, <code>"site.hbase-site.hbase.regionserver.port":""</code> will be sent to the Slider-Agent as <code>"hbase-site" : { "hbase.regionserver.port": ""}</code> and app definition scripts can access all variables under <code>hbase-site</code> as a single property bag.</li>
<li>Similarly, <code>site.core-site.fs.defaultFS</code> allows you to pass in the default fs. <em>This specific variable is automatically made available by Slider but its shown here as an example.</em></li>
@@ -226,12 +227,14 @@ In order to understand how the naming co
<p><strong>slider variables</strong></p>
<ul>
<li>Any config not of the form <code>site.xx.yy</code> are consumed by Slider itself. Some of the manadatory configuration are:</li>
-<li><code>agent.conf</code>: location of the agent config file (typically, "/slider/agent/conf/agent.ini")</li>
-<li><code>application.def</code>: location of the application definition package (typically, "/slider/hbase_v096.zip")</li>
+<li><code>application.def</code>: location of the application definition package (e.g., "/slider/hbase_v096.zip")</li>
<li><code>config_types</code>: list of config types sent to the containers (e.g. "core-site,hdfs-site,hbase-site")</li>
<li><code>java_home</code>: java home path (e.g. "/usr/jdk64/jdk1.7.0_45")</li>
<li><code>package_list</code>: location of the package relative to the root where AppPackage is installed (e.g. "files/hbase-0.96.1-hadoop2-bin.tar.gz"</li>
</ul>
+<p>OPTIONAL
+ * <code>create.default.zookeeper.node</code>: whether the application needs default ZK node
+ * <code>agent.conf</code>: location of the agent config file (typically, "/slider/agent/conf/agent.ini")</p>
<p><strong>dynamically allocated ports</strong></p>
<p>Apps can ask port to be dynamically assigned by Slider or they can leave it as "0". If there is a need for advertising any listening endpoint then the ports can be marked such.</p>
<p>For example, HBase master info port needs to be advertised so that jmx endpoint can be accessed. This is indicated by using a special value, of the form, ${COMPONENT_NAME.ALLOCATED_PORT}. E.g. "site.hbase-site.hbase.master.info.port": "${HBASE_MASTER.ALLOCATED_PORT}"</p>
@@ -245,6 +248,37 @@ In order to understand how the naming co
<li>"site.global.ganglia_server_id": "HBaseApplicationCluster3"</li>
</ul>
<p>All three variable values are user provided. It is also expected that a gmond server is available on host gangliaserver.my.org listening for metrics at port 8663 and is named "HBaseApplicationCluster3". Its the reponsibility of the ganglia server admin to ensure that the server is unique and is only receving metrics from the application instance.</p>
+<h2 id="available-environment-variable">Available environment variable</h2>
+<table>
+ <tr>
+ <td>Property</td>
+ <td>Description</td>
+ </tr>
+ <tr>
+ <td>AGENT_LOG_ROOT</td>
+ <td>The root folder for the log</td>
+ </tr>
+ <tr>
+ <td>AGENT_WORK_ROOT</td>
+ <td>The root working folder</td>
+ </tr>
+ <tr>
+ <td>NN_URI</td>
+ <td>Name node URI given to Slider</td>
+ </tr>
+ <tr>
+ <td>NN_HOST</td>
+ <td>Name node host</td>
+ </tr>
+ <tr>
+ <td><COMPONENT_NAME>.ALLOCATED_PORT</td>
+ <td>Ask Slider to allocate a port</td>
+ </tr>
+ <tr>
+ <td>DEF_ZK_PATH</td>
+ <td>Default ZK path created by Slider if create.default.zookeeper.node is true</td>
+ </tr>
+</table>
</div>
<div id="footer">
Modified: incubator/slider/site/content/docs/slider_specs/application_needs.html
URL: http://svn.apache.org/viewvc/incubator/slider/site/content/docs/slider_specs/application_needs.html?rev=1609635&r1=1609634&r2=1609635&view=diff
==============================================================================
--- incubator/slider/site/content/docs/slider_specs/application_needs.html (original)
+++ incubator/slider/site/content/docs/slider_specs/application_needs.html Fri Jul 11 06:20:20 2014
@@ -108,7 +108,7 @@
<li id="nav_use_client_config"><a href="/docs/client-configuration.html">Client Configuration</a></li>
<li id="nav_use_exitcodes"><a href="/docs/exitcodes.html">Client Exit Codes</a></li>
<li id="nav_use_security"><a href="/docs/security.html">Security</a></li>
-<li id="nav_use_app_package"><a href="/docs/slider_specs/index.html">App Packaging</a></li>
+<li id="nav_use_app_package"><a href="/docs/slider_specs/index.html">Creating App Packages</a></li>
<li id="nav_use_app_configuration"><a href="/docs/configuration/index.html">App Configuration Model</a></li>
<li id="nav_use_debugging"><a href="/docs/debugging.html">Debugging</a></li>
<li id="nav_use_troubleshooting"><a href="/docs/troubleshooting.html">Troubleshooting</a></li>
Modified: incubator/slider/site/content/docs/slider_specs/application_package.html
URL: http://svn.apache.org/viewvc/incubator/slider/site/content/docs/slider_specs/application_package.html?rev=1609635&r1=1609634&r2=1609635&view=diff
==============================================================================
--- incubator/slider/site/content/docs/slider_specs/application_package.html (original)
+++ incubator/slider/site/content/docs/slider_specs/application_package.html Fri Jul 11 06:20:20 2014
@@ -108,7 +108,7 @@
<li id="nav_use_client_config"><a href="/docs/client-configuration.html">Client Configuration</a></li>
<li id="nav_use_exitcodes"><a href="/docs/exitcodes.html">Client Exit Codes</a></li>
<li id="nav_use_security"><a href="/docs/security.html">Security</a></li>
-<li id="nav_use_app_package"><a href="/docs/slider_specs/index.html">App Packaging</a></li>
+<li id="nav_use_app_package"><a href="/docs/slider_specs/index.html">Creating App Packages</a></li>
<li id="nav_use_app_configuration"><a href="/docs/configuration/index.html">App Configuration Model</a></li>
<li id="nav_use_debugging"><a href="/docs/debugging.html">Debugging</a></li>
<li id="nav_use_troubleshooting"><a href="/docs/troubleshooting.html">Troubleshooting</a></li>
Modified: incubator/slider/site/content/docs/slider_specs/canonical_scenarios.html
URL: http://svn.apache.org/viewvc/incubator/slider/site/content/docs/slider_specs/canonical_scenarios.html?rev=1609635&r1=1609634&r2=1609635&view=diff
==============================================================================
--- incubator/slider/site/content/docs/slider_specs/canonical_scenarios.html (original)
+++ incubator/slider/site/content/docs/slider_specs/canonical_scenarios.html Fri Jul 11 06:20:20 2014
@@ -108,7 +108,7 @@
<li id="nav_use_client_config"><a href="/docs/client-configuration.html">Client Configuration</a></li>
<li id="nav_use_exitcodes"><a href="/docs/exitcodes.html">Client Exit Codes</a></li>
<li id="nav_use_security"><a href="/docs/security.html">Security</a></li>
-<li id="nav_use_app_package"><a href="/docs/slider_specs/index.html">App Packaging</a></li>
+<li id="nav_use_app_package"><a href="/docs/slider_specs/index.html">Creating App Packages</a></li>
<li id="nav_use_app_configuration"><a href="/docs/configuration/index.html">App Configuration Model</a></li>
<li id="nav_use_debugging"><a href="/docs/debugging.html">Debugging</a></li>
<li id="nav_use_troubleshooting"><a href="/docs/troubleshooting.html">Troubleshooting</a></li>
Modified: incubator/slider/site/content/docs/slider_specs/creating_app_definitions.html
URL: http://svn.apache.org/viewvc/incubator/slider/site/content/docs/slider_specs/creating_app_definitions.html?rev=1609635&r1=1609634&r2=1609635&view=diff
==============================================================================
--- incubator/slider/site/content/docs/slider_specs/creating_app_definitions.html (original)
+++ incubator/slider/site/content/docs/slider_specs/creating_app_definitions.html Fri Jul 11 06:20:20 2014
@@ -108,7 +108,7 @@
<li id="nav_use_client_config"><a href="/docs/client-configuration.html">Client Configuration</a></li>
<li id="nav_use_exitcodes"><a href="/docs/exitcodes.html">Client Exit Codes</a></li>
<li id="nav_use_security"><a href="/docs/security.html">Security</a></li>
-<li id="nav_use_app_package"><a href="/docs/slider_specs/index.html">App Packaging</a></li>
+<li id="nav_use_app_package"><a href="/docs/slider_specs/index.html">Creating App Packages</a></li>
<li id="nav_use_app_configuration"><a href="/docs/configuration/index.html">App Configuration Model</a></li>
<li id="nav_use_debugging"><a href="/docs/debugging.html">Debugging</a></li>
<li id="nav_use_troubleshooting"><a href="/docs/troubleshooting.html">Troubleshooting</a></li>
Modified: incubator/slider/site/content/docs/slider_specs/index.html
URL: http://svn.apache.org/viewvc/incubator/slider/site/content/docs/slider_specs/index.html?rev=1609635&r1=1609634&r2=1609635&view=diff
==============================================================================
--- incubator/slider/site/content/docs/slider_specs/index.html (original)
+++ incubator/slider/site/content/docs/slider_specs/index.html Fri Jul 11 06:20:20 2014
@@ -108,7 +108,7 @@
<li id="nav_use_client_config"><a href="/docs/client-configuration.html">Client Configuration</a></li>
<li id="nav_use_exitcodes"><a href="/docs/exitcodes.html">Client Exit Codes</a></li>
<li id="nav_use_security"><a href="/docs/security.html">Security</a></li>
-<li id="nav_use_app_package"><a href="/docs/slider_specs/index.html">App Packaging</a></li>
+<li id="nav_use_app_package"><a href="/docs/slider_specs/index.html">Creating App Packages</a></li>
<li id="nav_use_app_configuration"><a href="/docs/configuration/index.html">App Configuration Model</a></li>
<li id="nav_use_debugging"><a href="/docs/debugging.html">Debugging</a></li>
<li id="nav_use_troubleshooting"><a href="/docs/troubleshooting.html">Troubleshooting</a></li>
@@ -197,10 +197,10 @@ Latest release: <strong>0.30-incubating<
<li><a href="creating_app_definitions.html">Slider AppPackage</a> Overview of how to create an Slider AppPackage.</li>
<li><a href="application_package.html">Specifications for AppPackage</a> Describes the structure of an AppPackage</li>
<li><a href="application_definition.html">Specifications for Application Definition</a> How to write metainfo.xml?</li>
-<li><a href="application_configuration.html">Specifications for Configuration</a> How to create a template config file for an app?</li>
<li><a href="resource_specification.html">Specification of Resources</a> How to write a resource spec for an app?</li>
<li><a href="application_instance_configuration.html">Specifications InstanceConfiguration</a> How to write a template config for an app?</li>
<li><a href="canonical_scenarios.html">Guidelines for Clients and Client Applications</a></li>
+<li><a href="application_configuration.html">Specifications for Configuration</a> Default application configuration?</li>
<li><a href="/developing/index.html">Documentation for "General Developer Guidelines"</a></li>
</ul>
</div>
Modified: incubator/slider/site/content/docs/slider_specs/resource_specification.html
URL: http://svn.apache.org/viewvc/incubator/slider/site/content/docs/slider_specs/resource_specification.html?rev=1609635&r1=1609634&r2=1609635&view=diff
==============================================================================
--- incubator/slider/site/content/docs/slider_specs/resource_specification.html (original)
+++ incubator/slider/site/content/docs/slider_specs/resource_specification.html Fri Jul 11 06:20:20 2014
@@ -108,7 +108,7 @@
<li id="nav_use_client_config"><a href="/docs/client-configuration.html">Client Configuration</a></li>
<li id="nav_use_exitcodes"><a href="/docs/exitcodes.html">Client Exit Codes</a></li>
<li id="nav_use_security"><a href="/docs/security.html">Security</a></li>
-<li id="nav_use_app_package"><a href="/docs/slider_specs/index.html">App Packaging</a></li>
+<li id="nav_use_app_package"><a href="/docs/slider_specs/index.html">Creating App Packages</a></li>
<li id="nav_use_app_configuration"><a href="/docs/configuration/index.html">App Configuration Model</a></li>
<li id="nav_use_debugging"><a href="/docs/debugging.html">Debugging</a></li>
<li id="nav_use_troubleshooting"><a href="/docs/troubleshooting.html">Troubleshooting</a></li>
Modified: incubator/slider/site/content/docs/slider_specs/writing_app_command_scripts.html
URL: http://svn.apache.org/viewvc/incubator/slider/site/content/docs/slider_specs/writing_app_command_scripts.html?rev=1609635&r1=1609634&r2=1609635&view=diff
==============================================================================
--- incubator/slider/site/content/docs/slider_specs/writing_app_command_scripts.html (original)
+++ incubator/slider/site/content/docs/slider_specs/writing_app_command_scripts.html Fri Jul 11 06:20:20 2014
@@ -108,7 +108,7 @@
<li id="nav_use_client_config"><a href="/docs/client-configuration.html">Client Configuration</a></li>
<li id="nav_use_exitcodes"><a href="/docs/exitcodes.html">Client Exit Codes</a></li>
<li id="nav_use_security"><a href="/docs/security.html">Security</a></li>
-<li id="nav_use_app_package"><a href="/docs/slider_specs/index.html">App Packaging</a></li>
+<li id="nav_use_app_package"><a href="/docs/slider_specs/index.html">Creating App Packages</a></li>
<li id="nav_use_app_configuration"><a href="/docs/configuration/index.html">App Configuration Model</a></li>
<li id="nav_use_debugging"><a href="/docs/debugging.html">Debugging</a></li>
<li id="nav_use_troubleshooting"><a href="/docs/troubleshooting.html">Troubleshooting</a></li>
Modified: incubator/slider/site/content/docs/troubleshooting.html
URL: http://svn.apache.org/viewvc/incubator/slider/site/content/docs/troubleshooting.html?rev=1609635&r1=1609634&r2=1609635&view=diff
==============================================================================
--- incubator/slider/site/content/docs/troubleshooting.html (original)
+++ incubator/slider/site/content/docs/troubleshooting.html Fri Jul 11 06:20:20 2014
@@ -108,7 +108,7 @@
<li id="nav_use_client_config"><a href="/docs/client-configuration.html">Client Configuration</a></li>
<li id="nav_use_exitcodes"><a href="/docs/exitcodes.html">Client Exit Codes</a></li>
<li id="nav_use_security"><a href="/docs/security.html">Security</a></li>
-<li id="nav_use_app_package"><a href="/docs/slider_specs/index.html">App Packaging</a></li>
+<li id="nav_use_app_package"><a href="/docs/slider_specs/index.html">Creating App Packages</a></li>
<li id="nav_use_app_configuration"><a href="/docs/configuration/index.html">App Configuration Model</a></li>
<li id="nav_use_debugging"><a href="/docs/debugging.html">Debugging</a></li>
<li id="nav_use_troubleshooting"><a href="/docs/troubleshooting.html">Troubleshooting</a></li>
Modified: incubator/slider/site/content/downloads/index.html
URL: http://svn.apache.org/viewvc/incubator/slider/site/content/downloads/index.html?rev=1609635&r1=1609634&r2=1609635&view=diff
==============================================================================
--- incubator/slider/site/content/downloads/index.html (original)
+++ incubator/slider/site/content/downloads/index.html Fri Jul 11 06:20:20 2014
@@ -108,7 +108,7 @@
<li id="nav_use_client_config"><a href="/docs/client-configuration.html">Client Configuration</a></li>
<li id="nav_use_exitcodes"><a href="/docs/exitcodes.html">Client Exit Codes</a></li>
<li id="nav_use_security"><a href="/docs/security.html">Security</a></li>
-<li id="nav_use_app_package"><a href="/docs/slider_specs/index.html">App Packaging</a></li>
+<li id="nav_use_app_package"><a href="/docs/slider_specs/index.html">Creating App Packages</a></li>
<li id="nav_use_app_configuration"><a href="/docs/configuration/index.html">App Configuration Model</a></li>
<li id="nav_use_debugging"><a href="/docs/debugging.html">Debugging</a></li>
<li id="nav_use_troubleshooting"><a href="/docs/troubleshooting.html">Troubleshooting</a></li>
Added: incubator/slider/site/content/images/image_0_app_master_ui_lrg.png
URL: http://svn.apache.org/viewvc/incubator/slider/site/content/images/image_0_app_master_ui_lrg.png?rev=1609635&view=auto
==============================================================================
Binary file - no diff available.
Propchange: incubator/slider/site/content/images/image_0_app_master_ui_lrg.png
------------------------------------------------------------------------------
svn:mime-type = application/octet-stream
Added: incubator/slider/site/content/images/image_1_apps_rm_ui-lrg.png
URL: http://svn.apache.org/viewvc/incubator/slider/site/content/images/image_1_apps_rm_ui-lrg.png?rev=1609635&view=auto
==============================================================================
Binary file - no diff available.
Propchange: incubator/slider/site/content/images/image_1_apps_rm_ui-lrg.png
------------------------------------------------------------------------------
svn:mime-type = application/octet-stream
Modified: incubator/slider/site/content/index.html
URL: http://svn.apache.org/viewvc/incubator/slider/site/content/index.html?rev=1609635&r1=1609634&r2=1609635&view=diff
==============================================================================
--- incubator/slider/site/content/index.html (original)
+++ incubator/slider/site/content/index.html Fri Jul 11 06:20:20 2014
@@ -108,7 +108,7 @@
<li id="nav_use_client_config"><a href="/docs/client-configuration.html">Client Configuration</a></li>
<li id="nav_use_exitcodes"><a href="/docs/exitcodes.html">Client Exit Codes</a></li>
<li id="nav_use_security"><a href="/docs/security.html">Security</a></li>
-<li id="nav_use_app_package"><a href="/docs/slider_specs/index.html">App Packaging</a></li>
+<li id="nav_use_app_package"><a href="/docs/slider_specs/index.html">Creating App Packages</a></li>
<li id="nav_use_app_configuration"><a href="/docs/configuration/index.html">App Configuration Model</a></li>
<li id="nav_use_debugging"><a href="/docs/debugging.html">Debugging</a></li>
<li id="nav_use_troubleshooting"><a href="/docs/troubleshooting.html">Troubleshooting</a></li>
@@ -227,10 +227,20 @@ code changes and as of this writing, it
</ul>
<h2 id="developing">Developing</h2>
<ul>
-<li><a href="/design/index.html">Architecture</a></li>
-<li><a href="/developing/index.html">Developing</a></li>
+<li><a href="/developing/building.html">Building</a></li>
+<li><a href="/docs/debugging.html">Debugging</a></li>
+<li><a href="/developing/testing.html">Testing</a></li>
+<li><a href="/developing/functional_tests.html">Functional Testing</a></li>
+<li><a href="/developing/manual_testing.html">Manual Testing</a></li>
+<li><a href="/developing/releasing.html">Releasing</a></li>
+</ul>
+<h2 id="design">Design</h2>
+<ul>
+<li><a href="/design/architecture.html">Overview</a></li>
<li><a href="/docs/slider_specs/application_needs.html">Application Needs</a></li>
+<li><a href="/design/specification/index.html">Expected Behavior</a></li>
<li><a href="/design/registry/index.html">Service Registry</a></li>
+<li><a href="/design/rolehistory.html">Role History</a></li>
</ul>
<h2 id="disclaimer">Disclaimer</h2>
<p>Apache Slider (incubating) is an effort undergoing incubation at The
Modified: incubator/slider/site/content/mailing_lists.html
URL: http://svn.apache.org/viewvc/incubator/slider/site/content/mailing_lists.html?rev=1609635&r1=1609634&r2=1609635&view=diff
==============================================================================
--- incubator/slider/site/content/mailing_lists.html (original)
+++ incubator/slider/site/content/mailing_lists.html Fri Jul 11 06:20:20 2014
@@ -108,7 +108,7 @@
<li id="nav_use_client_config"><a href="/docs/client-configuration.html">Client Configuration</a></li>
<li id="nav_use_exitcodes"><a href="/docs/exitcodes.html">Client Exit Codes</a></li>
<li id="nav_use_security"><a href="/docs/security.html">Security</a></li>
-<li id="nav_use_app_package"><a href="/docs/slider_specs/index.html">App Packaging</a></li>
+<li id="nav_use_app_package"><a href="/docs/slider_specs/index.html">Creating App Packages</a></li>
<li id="nav_use_app_configuration"><a href="/docs/configuration/index.html">App Configuration Model</a></li>
<li id="nav_use_debugging"><a href="/docs/debugging.html">Debugging</a></li>
<li id="nav_use_troubleshooting"><a href="/docs/troubleshooting.html">Troubleshooting</a></li>
Modified: incubator/slider/site/content/release_notes/release-0.30.0.html
URL: http://svn.apache.org/viewvc/incubator/slider/site/content/release_notes/release-0.30.0.html?rev=1609635&r1=1609634&r2=1609635&view=diff
==============================================================================
--- incubator/slider/site/content/release_notes/release-0.30.0.html (original)
+++ incubator/slider/site/content/release_notes/release-0.30.0.html Fri Jul 11 06:20:20 2014
@@ -108,7 +108,7 @@
<li id="nav_use_client_config"><a href="/docs/client-configuration.html">Client Configuration</a></li>
<li id="nav_use_exitcodes"><a href="/docs/exitcodes.html">Client Exit Codes</a></li>
<li id="nav_use_security"><a href="/docs/security.html">Security</a></li>
-<li id="nav_use_app_package"><a href="/docs/slider_specs/index.html">App Packaging</a></li>
+<li id="nav_use_app_package"><a href="/docs/slider_specs/index.html">Creating App Packages</a></li>
<li id="nav_use_app_configuration"><a href="/docs/configuration/index.html">App Configuration Model</a></li>
<li id="nav_use_debugging"><a href="/docs/debugging.html">Debugging</a></li>
<li id="nav_use_troubleshooting"><a href="/docs/troubleshooting.html">Troubleshooting</a></li>
Added: incubator/slider/site/content/release_notes/release-0.40.0.html
URL: http://svn.apache.org/viewvc/incubator/slider/site/content/release_notes/release-0.40.0.html?rev=1609635&view=auto
==============================================================================
--- incubator/slider/site/content/release_notes/release-0.40.0.html (added)
+++ incubator/slider/site/content/release_notes/release-0.40.0.html Fri Jul 11 06:20:20 2014
@@ -0,0 +1,217 @@
+<!DOCTYPE html>
+<html lang="en">
+<head>
+<!--
+ Licensed to the Apache Software Foundation (ASF) under one or more
+ contributor license agreements. See the NOTICE file distributed with
+ this work for additional information regarding copyright ownership.
+ The ASF licenses this file to You under the Apache License, Version 2.0
+ (the "License"); you may not use this file except in compliance with
+ the License. You may obtain a copy of the License at
+
+ http://www.apache.org/licenses/LICENSE- 2.0
+
+ Unless required by applicable law or agreed to in writing, software
+ distributed under the License is distributed on an "AS IS" BASIS,
+ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ See the License for the specific language governing permissions and
+ limitations under the License.
+-->
+ <meta charset="utf-8">
+ <meta http-equiv="X-UA-Compatible" content="IE=edge">
+ <meta name="viewport" content="width=device-width, initial-scale=1">
+ <link href="/css/bootstrap.min.css" rel="stylesheet">
+ <link href="/css/bootstrap-theme.min.css" rel="stylesheet">
+ <!-- WARNING: Respond.js doesn't work if you view the page via file:// -->
+ <!--[if lt IE 9]>
+ <script src="https://oss.maxcdn.com/libs/html5shiv/3.7.0/html5shiv.js"></script>
+ <script src="https://oss.maxcdn.com/libs/respond.js/1.4.2/respond.min.js"></script>
+ <![endif]-->
+ <script src="https://ajax.googleapis.com/ajax/libs/jquery/1.11.0/jquery.min.js"></script>
+ <script src="/js/bootstrap.min.js"></script>
+ <link href="/css/slider.css" rel="stylesheet" type="text/css">
+ <link href="//netdna.bootstrapcdn.com/font-awesome/4.0.3/css/font-awesome.css" rel="stylesheet">
+ <title></title>
+
+</head>
+
+<body>
+<nav class="navbar navbar-default navbar-fixed-top" role="navigation">
+<div class="container-fluid">
+ <div class="navbar-header">
+ <button type="button" class="navbar-toggle" data-toggle="collapse" data-target="#navbar-items">
+ <span class="sr-only">Toggle navigation</span>
+ <span class="icon-bar"></span>
+ <span class="icon-bar"></span>
+ <span class="icon-bar"></span>
+ </button>
+ <a class="navbar-brand" href="/index.html">Slider</a>
+ </div>
+ <div class="collapse navbar-collapse" id="navbar-items">
+ <ul class="nav navbar-nav">
+ <li class="dropdown">
+ <a class="dropdown-toggle" data-toggle="dropdown" href="#">
+ Project <span class="caret"></span>
+ </a>
+<ul class="dropdown-menu">
+<li id="nav_index"><a href="/index.html">Home</a></li>
+<li id="nav_downloads"><a href="/downloads">Downloads</a></li>
+<li id="nav_source"><a href="https://git-wip-us.apache.org/repos/asf/incubator-slider.git"><i class="fa fa-external-link"></i> Source</a></li>
+<li><a href="http://www.apache.org/licenses/LICENSE-2.0"><i class="fa fa-external-link"></i> License</a></li>
+<li class="divider"></li>
+<li class="dropdown-header">Community</li>
+<li id="nav_team"><a href="/team.html">Team</a></li>
+<li id="nav_mailinglists"><a href="/mailing_lists.html">Mailing Lists</a></li>
+<li class="divider"></li>
+<li class="dropdown-header">Tools</li>
+<li id="nav_jira"><a href="https://issues.apache.org/jira/browse/SLIDER"><i class="fa fa-external-link"></i> Issues</a></li>
+<li id="nav_builds"><a href="https://builds.apache.org/job/Slider-develop"><i class="fa fa-external-link"></i> Builds</a></li>
+</ul>
+</li>
+
+ <li class="dropdown">
+ <a class="dropdown-toggle" data-toggle="dropdown" href="/design">
+ Design <span class="caret"></span>
+ </a>
+<ul class="dropdown-menu">
+<li id="nav_design_overview"><a href="/design/architecture.html">Overview</a></li>
+<li id="nav_app_needs"><a href="/docs/slider_specs/application_needs.html">Application Needs</a></li>
+<li id="nav_spec"><a href="/design/specification/index.html">Expected Behavior</a></li>
+<li id="nav_registry"><a href="/design/registry/index.html">Service Registry</a></li>
+<li id="nav_role_history"><a href="/design/rolehistory.html">Role History</a></li>
+</ul>
+</li>
+
+
+ <li class="dropdown">
+ <a class="dropdown-toggle" data-toggle="dropdown" href="/developing">
+ Developing <span class="caret"></span>
+ </a>
+<ul class="dropdown-menu">
+<li id="nav_dev_building"><a href="/developing/building.html">Building</a></li>
+<li id="nav_dev_debugging"><a href="/docs/debugging.html">Debugging</a></li>
+<li id="nav_dev_testing"><a href="/developing/testing.html">Testing</a></li>
+<li id="nav_dev_funtesting"><a href="/developing/functional_tests.html">Functional Testing</a></li>
+<li id="nav_dev_manual_testing"><a href="/developing/manual_testing.html">Manual Testing</a></li>
+<li id="nav_releasing"><a href="/developing/releasing.html">Releasing</a></li>
+</ul>
+</li>
+
+ <li class="dropdown">
+ <a class="dropdown-toggle" data-toggle="dropdown" href="#">
+ Using <span class="caret"></span>
+ </a>
+<ul class="dropdown-menu">
+<li id="nav_use_getting_started"><a href="/docs/getting_started.html">Getting Started</a></li>
+<li id="nav_use_manpage"><a href="/docs/manpage.html">Man Page</a></li>
+<li id="nav_use_examples"><a href="/docs/examples.html">Examples</a></li>
+<li id="nav_use_client_config"><a href="/docs/client-configuration.html">Client Configuration</a></li>
+<li id="nav_use_exitcodes"><a href="/docs/exitcodes.html">Client Exit Codes</a></li>
+<li id="nav_use_security"><a href="/docs/security.html">Security</a></li>
+<li id="nav_use_app_package"><a href="/docs/slider_specs/index.html">Creating App Packages</a></li>
+<li id="nav_use_app_configuration"><a href="/docs/configuration/index.html">App Configuration Model</a></li>
+<li id="nav_use_debugging"><a href="/docs/debugging.html">Debugging</a></li>
+<li id="nav_use_troubleshooting"><a href="/docs/troubleshooting.html">Troubleshooting</a></li>
+</ul>
+</li>
+
+ <li class="dropdown">
+ <a class="dropdown-toggle" data-toggle="dropdown" href="#">
+ ASF Links <span class="caret"></span>
+ </a>
+<ul class="dropdown-menu">
+<li><a href="http://www.apache.org"><i class="fa fa-external-link"></i> Apache Software Foundation</a></li>
+<li><a href="http://www.apache.org/foundation/sponsorship.html"><i class="fa fa-external-link"></i> Sponsorship</a></li>
+<li><a href="http://www.apache.org/security/"><i class="fa fa-external-link"></i> Security</a></li>
+<li><a href="http://www.apache.org/foundation/thanks.html"><i class="fa fa-external-link"></i> Thanks</a></li>
+</ul>
+</li>
+</ul>
+
+ </div>
+
+</div>
+</nav>
+
+
+<div class="container-fluid">
+<div class="row">
+ <div class="col-md-2" id="sidebar">
+ <div style="text-align: center">
+ <h1><a href="/index.html">Apache Slider (incubating)</a></h1>
+ <hr>
+Latest release: <strong>0.30-incubating</strong><br>
+ <br>
+ <a id="download-button-sidebar" class="btn btn-success btn-block" href="/downloads/" role="button">Download</a>
+ </div>
+ <hr>
+ <a href="http://incubator.apache.org"><img id="logo" alt="Apache Incubator ™" class="img-responsive" src="http://incubator.apache.org/images/apache-incubator-logo.png"/></a>
+ </div>
+ <div class="col-md-8 col-md-offset-1">
+
+ <div id="content">
+
+ <h1 class="title"></h1>
+
+ <!---
+ Licensed to the Apache Software Foundation (ASF) under one or more
+ contributor license agreements. See the NOTICE file distributed with
+ this work for additional information regarding copyright ownership.
+ The ASF licenses this file to You under the Apache License, Version 2.0
+ (the "License"); you may not use this file except in compliance with
+ the License. You may obtain a copy of the License at
+
+ http://www.apache.org/licenses/LICENSE-2.0
+
+ Unless required by applicable law or agreed to in writing, software
+ distributed under the License is distributed on an "AS IS" BASIS,
+ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ See the License for the specific language governing permissions and
+ limitations under the License.
+-->
+
+<h1 id="apache-slider-release-0400-incubating">Apache Slider Release 0.40.0 (incubating)</h1>
+<p>July 2014</p>
+<p>This release is built against the Apache Hadoop 2.4.0, HBase-0.98.3
+and Accumulo 1.5.1 artifacts. </p>
+<p>Download: <a href=""></a></p>
+<h2 id="key-changes">Key changes</h2>
+<ol>
+<li>Slider AppMaster and Agent communication can now be secured via 2-way SSL.</li>
+<li>Default application isolation through default HDFS working dir and ZK node.</li>
+<li>Applied application configurations can now be downloaded from the registry as JSON as well as XML.</li>
+<li>Updated application definition packages for HBase, Accumulo, and Storm and automated creation of HBase and Accumulo packages. </li>
+<li>slider.py is added to enable Slider usage across linux and Windows platforms.</li>
+<li>agent.ini config file for the slider-agent is now optional.</li>
+</ol>
+<h2 id="other-changes">Other changes</h2>
+<h2 id="known-issues">Known Issues</h2>
+<ol>
+<li>Slider cannot handle if YARN is configured with multiple log directories</li>
+</ol>
+ </div>
+
+ <div id="footer">
+ <a alt="Apache Software Foundation" href="http://www.apache.org">
+ <img id="asf-logo" alt="Apache Software Foundation" src="/images/feather-small.gif" width="100">
+ </a>
+ <div class="copyright">
+ <p>
+ Copyright © 2011-2014 The Apache Software Foundation, Licensed under
+ the <a href="http://www.apache.org/licenses/LICENSE-2.0">Apache License, Version 2.0</a>.
+ Apache Slider, Slider, Apache, the Apache feather logo, and the Apache Incubator
+ project logo are trademarks of the <a href="http://www.apache.org">Apache Software Foundation</a>.<br />
+ Site created with <a href="http://getbootstrap.com/">Bootstrap</a> including icons from <a href="http://glyphicons.com/">GLYPHICONS</a> and <a href="http://fontawesome.io/">Font Awesome</a>.
+ </p>
+ </div>
+ </div>
+ </div>
+
+</div>
+</div>
+
+<script type="text/javascript">
+
+</script>
+</body>
+</html>