You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@slider.apache.org by bu...@apache.org on 2014/11/21 13:28:32 UTC
svn commit: r929972 - in /websites/staging/slider/trunk/content: ./
developing/debugging.html developing/demo.html developing/index.html
docs/debugging.html docs/getting_started.html docs/getting_started_40.html
index.html
Author: buildbot
Date: Fri Nov 21 12:28:31 2014
New Revision: 929972
Log:
Staging update by buildbot for slider
Added:
websites/staging/slider/trunk/content/developing/debugging.html
websites/staging/slider/trunk/content/developing/demo.html
Removed:
websites/staging/slider/trunk/content/docs/debugging.html
websites/staging/slider/trunk/content/docs/getting_started_40.html
Modified:
websites/staging/slider/trunk/content/ (props changed)
websites/staging/slider/trunk/content/developing/index.html
websites/staging/slider/trunk/content/docs/getting_started.html
websites/staging/slider/trunk/content/index.html
Propchange: websites/staging/slider/trunk/content/
------------------------------------------------------------------------------
--- cms:source-revision (original)
+++ cms:source-revision Fri Nov 21 12:28:31 2014
@@ -1 +1 @@
-1640678
+1640906
Added: websites/staging/slider/trunk/content/developing/debugging.html
==============================================================================
--- websites/staging/slider/trunk/content/developing/debugging.html (added)
+++ websites/staging/slider/trunk/content/developing/debugging.html Fri Nov 21 12:28:31 2014
@@ -0,0 +1,263 @@
+<!DOCTYPE html>
+<html lang="en">
+<head>
+<!--
+ Licensed to the Apache Software Foundation (ASF) under one or more
+ contributor license agreements. See the NOTICE file distributed with
+ this work for additional information regarding copyright ownership.
+ The ASF licenses this file to You under the Apache License, Version 2.0
+ (the "License"); you may not use this file except in compliance with
+ the License. You may obtain a copy of the License at
+
+ http://www.apache.org/licenses/LICENSE- 2.0
+
+ Unless required by applicable law or agreed to in writing, software
+ distributed under the License is distributed on an "AS IS" BASIS,
+ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ See the License for the specific language governing permissions and
+ limitations under the License.
+-->
+ <meta charset="utf-8">
+ <meta http-equiv="X-UA-Compatible" content="IE=edge">
+ <meta name="viewport" content="width=device-width, initial-scale=1">
+ <link href="/css/bootstrap.min.css" rel="stylesheet">
+ <link href="/css/bootstrap-theme.min.css" rel="stylesheet">
+ <!-- WARNING: Respond.js doesn't work if you view the page via file:// -->
+ <!--[if lt IE 9]>
+ <script src="https://oss.maxcdn.com/libs/html5shiv/3.7.0/html5shiv.js"></script>
+ <script src="https://oss.maxcdn.com/libs/respond.js/1.4.2/respond.min.js"></script>
+ <![endif]-->
+ <script src="https://ajax.googleapis.com/ajax/libs/jquery/1.11.0/jquery.min.js"></script>
+ <script src="/js/bootstrap.min.js"></script>
+ <link href="/css/slider.css" rel="stylesheet" type="text/css">
+ <link href="//netdna.bootstrapcdn.com/font-awesome/4.0.3/css/font-awesome.css" rel="stylesheet">
+ <title></title>
+
+</head>
+
+<body>
+<nav class="navbar navbar-default navbar-fixed-top" role="navigation">
+<div class="container-fluid">
+ <div class="navbar-header">
+ <button type="button" class="navbar-toggle" data-toggle="collapse" data-target="#navbar-items">
+ <span class="sr-only">Toggle navigation</span>
+ <span class="icon-bar"></span>
+ <span class="icon-bar"></span>
+ <span class="icon-bar"></span>
+ </button>
+ <a class="navbar-brand" href="/index.html">Slider</a>
+ </div>
+ <div class="collapse navbar-collapse" id="navbar-items">
+ <ul class="nav navbar-nav">
+ <li class="dropdown">
+ <a class="dropdown-toggle" data-toggle="dropdown" href="#">
+ Project <span class="caret"></span>
+ </a>
+<ul class="dropdown-menu">
+<li id="nav_index"><a href="/index.html">Home</a></li>
+<li id="nav_downloads"><a href="/downloads">Downloads</a></li>
+<li id="nav_source"><a href="https://git-wip-us.apache.org/repos/asf/incubator-slider.git"><i class="fa fa-external-link"></i> Source</a></li>
+<li><a href="http://www.apache.org/licenses/LICENSE-2.0"><i class="fa fa-external-link"></i> License</a></li>
+<li class="divider"></li>
+<li class="dropdown-header">Community</li>
+<li id="nav_team"><a href="/team.html">Team</a></li>
+<li id="nav_mailinglists"><a href="/mailing_lists.html">Mailing Lists</a></li>
+<li class="divider"></li>
+<li class="dropdown-header">Tools</li>
+<li id="nav_jira"><a href="https://issues.apache.org/jira/browse/SLIDER"><i class="fa fa-external-link"></i> Issues</a></li>
+<li id="nav_builds"><a href="https://builds.apache.org/job/Slider-develop"><i class="fa fa-external-link"></i> Builds</a></li>
+</ul>
+</li>
+
+ <li class="dropdown">
+ <a class="dropdown-toggle" data-toggle="dropdown" href="/design">
+ Design <span class="caret"></span>
+ </a>
+<ul class="dropdown-menu">
+<li id="nav_design_overview"><a href="/design/architecture.html">Overview</a></li>
+<li id="nav_app_needs"><a href="/docs/slider_specs/application_needs.html">Application Needs</a></li>
+<li id="nav_spec"><a href="/design/specification/index.html">Expected Behavior</a></li>
+<li id="nav_registry"><a href="/design/registry/index.html">Service Registry</a></li>
+<li id="nav_ssl_impl"><a href="/design/ssl_implementation.html">SSL Implementation</a></li>
+<li id="nav_role_history"><a href="/design/rolehistory.html">Role History</a></li>
+</ul>
+</li>
+
+
+ <li class="dropdown">
+ <a class="dropdown-toggle" data-toggle="dropdown" href="/developing">
+ Developing <span class="caret"></span>
+ </a>
+<ul class="dropdown-menu">
+<li id="nav_dev_building"><a href="/developing/building.html">Building</a></li>
+<li id="nav_dev_debugging"><a href="/docs/debugging.html">Debugging</a></li>
+<li id="nav_dev_testing"><a href="/developing/testing.html">Testing</a></li>
+<li id="nav_dev_funtesting"><a href="/developing/functional_tests.html">Functional Testing</a></li>
+<li id="nav_dev_manual_testing"><a href="/developing/manual_testing.html">Manual Testing</a></li>
+<li id="nav_releasing"><a href="/developing/releasing.html">Releasing</a></li>
+</ul>
+</li>
+
+ <li class="dropdown">
+ <a class="dropdown-toggle" data-toggle="dropdown" href="#">
+ Using <span class="caret"></span>
+ </a>
+<ul class="dropdown-menu">
+<li id="nav_use_getting_started"><a href="/docs/getting_started.html">Getting Started</a></li>
+<li id="nav_use_manpage"><a href="/docs/manpage.html">Man Page</a></li>
+<li role="presentation" class="divider"></li>
+<li id="nav_use_app_package"><a href="/docs/slider_specs/index.html">Creating App Packages</a></li>
+<li role="presentation" class="divider"></li>
+<li id="nav_use_client_config"><a href="/docs/client-configuration.html">Client Configuration</a></li>
+<li id="nav_use_exitcodes"><a href="/docs/exitcodes.html">Client Exit Codes</a></li>
+<li role="presentation" class="divider"></li>
+<li id="nav_use_debugging"><a href="/docs/debugging.html">Debugging</a></li>
+<li id="nav_use_troubleshooting"><a href="/docs/troubleshooting.html">Troubleshooting</a></li>
+<li role="presentation" class="divider"></li>
+<li id="nav_use_high_availability"><a href="/docs/high_availability.html">High Availability</a></li>
+<li id="nav_use_security"><a href="/docs/security.html">Security</a></li>
+<li id="nav_am_agent_ssl"><a href="/docs/ssl.html">Agent to AM SSL</a></li>
+<li id="nav_use_app_configuration"><a href="/docs/configuration/index.html">App Configuration Model</a></li>
+<li id="nav_use_examples"><a href="/docs/examples.html">Provider Examples</a></li>
+</ul>
+</li>
+
+ <li class="dropdown">
+ <a class="dropdown-toggle" data-toggle="dropdown" href="#">
+ ASF Links <span class="caret"></span>
+ </a>
+<ul class="dropdown-menu">
+<li><a href="http://www.apache.org"><i class="fa fa-external-link"></i> Apache Software Foundation</a></li>
+<li><a href="http://www.apache.org/foundation/sponsorship.html"><i class="fa fa-external-link"></i> Sponsorship</a></li>
+<li><a href="http://www.apache.org/security/"><i class="fa fa-external-link"></i> Security</a></li>
+<li><a href="http://www.apache.org/foundation/thanks.html"><i class="fa fa-external-link"></i> Thanks</a></li>
+</ul>
+</li>
+</ul>
+
+ </div>
+
+</div>
+</nav>
+
+
+<div class="container-fluid">
+<div class="row">
+ <div class="col-md-2" id="sidebar">
+ <div style="text-align: center">
+ <h1><a href="/index.html">Apache Slider (incubating)</a></h1>
+ <hr>
+Latest release: <strong>0.40-incubating</strong><br>
+ <br>
+ <a id="download-button-sidebar" class="btn btn-success btn-block" href="/downloads/" role="button">Download</a>
+ </div>
+ <hr>
+ <a href="http://incubator.apache.org"><img id="logo" alt="Apache Incubator ™" class="img-responsive" src="http://incubator.apache.org/images/apache-incubator-logo.png"/></a>
+ </div>
+ <div class="col-md-8 col-md-offset-1">
+
+ <div id="content">
+
+ <h1 class="title"></h1>
+
+ <!---
+ Licensed to the Apache Software Foundation (ASF) under one or more
+ contributor license agreements. See the NOTICE file distributed with
+ this work for additional information regarding copyright ownership.
+ The ASF licenses this file to You under the Apache License, Version 2.0
+ (the "License"); you may not use this file except in compliance with
+ the License. You may obtain a copy of the License at
+
+ http://www.apache.org/licenses/LICENSE-2.0
+
+ Unless required by applicable law or agreed to in writing, software
+ distributed under the License is distributed on an "AS IS" BASIS,
+ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ See the License for the specific language governing permissions and
+ limitations under the License.
+-->
+
+<h1 id="debugging-apache-slider">Debugging Apache Slider</h1>
+<p>There are a number of options available to you for debugging Slider applications. They include:</p>
+<ul>
+<li>Using Slider logging</li>
+<li>IDE-based remote debugging of the Application Master</li>
+</ul>
+<h2 id="using-slider-logging">Using Slider logging</h2>
+<p>There are a number of options for viewing the generated log files:</p>
+<ol>
+<li>Using a web browser</li>
+<li>Accessing the host machine</li>
+</ol>
+<h3 id="using-a-web-browser">Using a web browser</h3>
+<p>The log files are accessible via the Yarn Resource Manager UI. From the main page (e.g. <code>http://${YARN_RESOURCE_MGR_HOST}:8088</code>),
+click on the link for the application instance of interest, and then click on the <code>logs</code> link.
+This will present you with a page with links to the <code>slider-err.txt</code> file and the <code>slider-out.txt</code> file.
+The former is the file you should select -it is where the applicaton logs go
+Once the log page is presented, click on the link at the top of the page ("Click here for full log") to view the entire file.</p>
+<p>If the file <code>slider-out.txt</code> is empty, then examine <code>slider-err.txt</code> -an empty
+output log usually means that the java process failed to start -this should be
+logged in the error file.</p>
+<h3 id="accessing-the-host-machine">Accessing the host machine</h3>
+<p>If access to other log files is required, there is the option of logging in
+ to the host machine on which the application component is running
+ -provided you have the correct permissions.</p>
+<p>The root directory for all YARN associated files is the value of <code>yarn.nodemanager.log-dirs</code> in <code>yarn-site.xml</code> - e.g. <code>/hadoop/yarn/log</code>.
+Below the root directory you will find an application and container sub-directory (e.g. <code>/application_1398372047522_0009/container_1398372047522_0009_01_000001/</code>).
+Below the container directory you will find any log files associated with the processes running in the given Yarn container.</p>
+<p>Within a container log the following files are useful while debugging the application.</p>
+<p><strong>agent.log</strong> </p>
+<p>E.g. <code>application_1398098639743_0024/container_1398098639743_0024_01_000003/infra/log/agent.log</code>
+This file contains the logs from the Slider-Agent.</p>
+<p><strong>application component log</strong></p>
+<p>E.g. <code>./log/application_1398098639743_0024/container_1398098639743_0024_01_000003/app/log/hbase-yarn-regionserver-c6403.ambari.apache.org.log</code></p>
+<p>The location of the application log is defined by the application. "${AGENT_LOG_ROOT}" is a symbol available to the app developers to use as a root folder for logging.</p>
+<p><strong>agent operations log</strong></p>
+<p>E.g. ./log/application_1398098639743_0024/container_1398098639743_0024_01_000003/app/command-log/</p>
+<p>The command logs produced by the slider-agent are available in the <code>command-log</code> folder relative to <code>${AGENT_LOG_ROOT}/app</code></p>
+<p>Note that the <em>fish</em> shell is convenient for debugging, as <code>cat log/**/slider-out.txt</code> will find the relevant output file
+irrespective of what the path leading to it is.</p>
+<h2 id="ide-based-remote-debugging-of-the-application-master">IDE-based remote debugging of the Application Master</h2>
+<p>For situations in which the logging does not yield enough information to debug an issue,
+the user has the option of specifying JVM command line options for the
+Application Master that enable attaching to the running process with a debugger
+(e.g. the remote debugging facilities in Eclipse or Intellij IDEA).
+In order to specify the JVM options, edit the application configuration file
+(the file specified as the <code>--template</code> argument value on the command line for cluster creation)
+and specify the <code>jvm.opts</code> property for the <code>slider-appmaster</code> component:</p>
+<div class="codehilite"><pre>`"<span class="n">components</span>"<span class="p">:</span> <span class="p">{</span>
+ "<span class="n">slider</span><span class="o">-</span><span class="n">appmaster</span>"<span class="p">:</span> <span class="p">{</span>
+ "<span class="n">jvm</span><span class="p">.</span><span class="n">heapsize</span>"<span class="p">:</span> "256<span class="n">M</span>"<span class="p">,</span>
+ "<span class="n">jvm</span><span class="p">.</span><span class="n">opts</span>"<span class="p">:</span> "<span class="o">-</span><span class="n">agentlib</span><span class="p">:</span><span class="n">jdwp</span><span class="p">=</span><span class="n">transport</span><span class="p">=</span><span class="n">dt_socket</span><span class="p">,</span><span class="n">server</span><span class="p">=</span><span class="n">y</span><span class="p">,</span><span class="n">suspend</span><span class="p">=</span><span class="n">n</span><span class="p">,</span><span class="n">address</span><span class="p">=</span>5005"
+ <span class="p">},</span>
+ <span class="p">...</span>`
+</pre></div>
+
+
+<p>You may specify <code>suspend=y</code> in the line above if you wish to have the application master process wait for the debugger to attach before beginning its processing.</p>
+ </div>
+
+ <div id="footer">
+ <a alt="Apache Software Foundation" href="http://www.apache.org">
+ <img id="asf-logo" alt="Apache Software Foundation" src="/images/feather-small.gif" width="100">
+ </a>
+ <div class="copyright">
+ <p>
+ Copyright © 2011-2014 The Apache Software Foundation, Licensed under
+ the <a href="http://www.apache.org/licenses/LICENSE-2.0">Apache License, Version 2.0</a>.
+ Apache Slider, Slider, Apache, the Apache feather logo, and the Apache Incubator
+ project logo are trademarks of the <a href="http://www.apache.org">Apache Software Foundation</a>.<br />
+ Site created with <a href="http://getbootstrap.com/">Bootstrap</a> including icons from <a href="http://glyphicons.com/">GLYPHICONS</a> and <a href="http://fontawesome.io/">Font Awesome</a>.
+ </p>
+ </div>
+ </div>
+ </div>
+
+</div>
+</div>
+
+<script type="text/javascript">
+
+</script>
+</body>
+</html>
Added: websites/staging/slider/trunk/content/developing/demo.html
==============================================================================
--- websites/staging/slider/trunk/content/developing/demo.html (added)
+++ websites/staging/slider/trunk/content/developing/demo.html Fri Nov 21 12:28:31 2014
@@ -0,0 +1,320 @@
+<!DOCTYPE html>
+<html lang="en">
+<head>
+<!--
+ Licensed to the Apache Software Foundation (ASF) under one or more
+ contributor license agreements. See the NOTICE file distributed with
+ this work for additional information regarding copyright ownership.
+ The ASF licenses this file to You under the Apache License, Version 2.0
+ (the "License"); you may not use this file except in compliance with
+ the License. You may obtain a copy of the License at
+
+ http://www.apache.org/licenses/LICENSE- 2.0
+
+ Unless required by applicable law or agreed to in writing, software
+ distributed under the License is distributed on an "AS IS" BASIS,
+ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ See the License for the specific language governing permissions and
+ limitations under the License.
+-->
+ <meta charset="utf-8">
+ <meta http-equiv="X-UA-Compatible" content="IE=edge">
+ <meta name="viewport" content="width=device-width, initial-scale=1">
+ <link href="/css/bootstrap.min.css" rel="stylesheet">
+ <link href="/css/bootstrap-theme.min.css" rel="stylesheet">
+ <!-- WARNING: Respond.js doesn't work if you view the page via file:// -->
+ <!--[if lt IE 9]>
+ <script src="https://oss.maxcdn.com/libs/html5shiv/3.7.0/html5shiv.js"></script>
+ <script src="https://oss.maxcdn.com/libs/respond.js/1.4.2/respond.min.js"></script>
+ <![endif]-->
+ <script src="https://ajax.googleapis.com/ajax/libs/jquery/1.11.0/jquery.min.js"></script>
+ <script src="/js/bootstrap.min.js"></script>
+ <link href="/css/slider.css" rel="stylesheet" type="text/css">
+ <link href="//netdna.bootstrapcdn.com/font-awesome/4.0.3/css/font-awesome.css" rel="stylesheet">
+ <title></title>
+
+</head>
+
+<body>
+<nav class="navbar navbar-default navbar-fixed-top" role="navigation">
+<div class="container-fluid">
+ <div class="navbar-header">
+ <button type="button" class="navbar-toggle" data-toggle="collapse" data-target="#navbar-items">
+ <span class="sr-only">Toggle navigation</span>
+ <span class="icon-bar"></span>
+ <span class="icon-bar"></span>
+ <span class="icon-bar"></span>
+ </button>
+ <a class="navbar-brand" href="/index.html">Slider</a>
+ </div>
+ <div class="collapse navbar-collapse" id="navbar-items">
+ <ul class="nav navbar-nav">
+ <li class="dropdown">
+ <a class="dropdown-toggle" data-toggle="dropdown" href="#">
+ Project <span class="caret"></span>
+ </a>
+<ul class="dropdown-menu">
+<li id="nav_index"><a href="/index.html">Home</a></li>
+<li id="nav_downloads"><a href="/downloads">Downloads</a></li>
+<li id="nav_source"><a href="https://git-wip-us.apache.org/repos/asf/incubator-slider.git"><i class="fa fa-external-link"></i> Source</a></li>
+<li><a href="http://www.apache.org/licenses/LICENSE-2.0"><i class="fa fa-external-link"></i> License</a></li>
+<li class="divider"></li>
+<li class="dropdown-header">Community</li>
+<li id="nav_team"><a href="/team.html">Team</a></li>
+<li id="nav_mailinglists"><a href="/mailing_lists.html">Mailing Lists</a></li>
+<li class="divider"></li>
+<li class="dropdown-header">Tools</li>
+<li id="nav_jira"><a href="https://issues.apache.org/jira/browse/SLIDER"><i class="fa fa-external-link"></i> Issues</a></li>
+<li id="nav_builds"><a href="https://builds.apache.org/job/Slider-develop"><i class="fa fa-external-link"></i> Builds</a></li>
+</ul>
+</li>
+
+ <li class="dropdown">
+ <a class="dropdown-toggle" data-toggle="dropdown" href="/design">
+ Design <span class="caret"></span>
+ </a>
+<ul class="dropdown-menu">
+<li id="nav_design_overview"><a href="/design/architecture.html">Overview</a></li>
+<li id="nav_app_needs"><a href="/docs/slider_specs/application_needs.html">Application Needs</a></li>
+<li id="nav_spec"><a href="/design/specification/index.html">Expected Behavior</a></li>
+<li id="nav_registry"><a href="/design/registry/index.html">Service Registry</a></li>
+<li id="nav_ssl_impl"><a href="/design/ssl_implementation.html">SSL Implementation</a></li>
+<li id="nav_role_history"><a href="/design/rolehistory.html">Role History</a></li>
+</ul>
+</li>
+
+
+ <li class="dropdown">
+ <a class="dropdown-toggle" data-toggle="dropdown" href="/developing">
+ Developing <span class="caret"></span>
+ </a>
+<ul class="dropdown-menu">
+<li id="nav_dev_building"><a href="/developing/building.html">Building</a></li>
+<li id="nav_dev_debugging"><a href="/docs/debugging.html">Debugging</a></li>
+<li id="nav_dev_testing"><a href="/developing/testing.html">Testing</a></li>
+<li id="nav_dev_funtesting"><a href="/developing/functional_tests.html">Functional Testing</a></li>
+<li id="nav_dev_manual_testing"><a href="/developing/manual_testing.html">Manual Testing</a></li>
+<li id="nav_releasing"><a href="/developing/releasing.html">Releasing</a></li>
+</ul>
+</li>
+
+ <li class="dropdown">
+ <a class="dropdown-toggle" data-toggle="dropdown" href="#">
+ Using <span class="caret"></span>
+ </a>
+<ul class="dropdown-menu">
+<li id="nav_use_getting_started"><a href="/docs/getting_started.html">Getting Started</a></li>
+<li id="nav_use_manpage"><a href="/docs/manpage.html">Man Page</a></li>
+<li role="presentation" class="divider"></li>
+<li id="nav_use_app_package"><a href="/docs/slider_specs/index.html">Creating App Packages</a></li>
+<li role="presentation" class="divider"></li>
+<li id="nav_use_client_config"><a href="/docs/client-configuration.html">Client Configuration</a></li>
+<li id="nav_use_exitcodes"><a href="/docs/exitcodes.html">Client Exit Codes</a></li>
+<li role="presentation" class="divider"></li>
+<li id="nav_use_debugging"><a href="/docs/debugging.html">Debugging</a></li>
+<li id="nav_use_troubleshooting"><a href="/docs/troubleshooting.html">Troubleshooting</a></li>
+<li role="presentation" class="divider"></li>
+<li id="nav_use_high_availability"><a href="/docs/high_availability.html">High Availability</a></li>
+<li id="nav_use_security"><a href="/docs/security.html">Security</a></li>
+<li id="nav_am_agent_ssl"><a href="/docs/ssl.html">Agent to AM SSL</a></li>
+<li id="nav_use_app_configuration"><a href="/docs/configuration/index.html">App Configuration Model</a></li>
+<li id="nav_use_examples"><a href="/docs/examples.html">Provider Examples</a></li>
+</ul>
+</li>
+
+ <li class="dropdown">
+ <a class="dropdown-toggle" data-toggle="dropdown" href="#">
+ ASF Links <span class="caret"></span>
+ </a>
+<ul class="dropdown-menu">
+<li><a href="http://www.apache.org"><i class="fa fa-external-link"></i> Apache Software Foundation</a></li>
+<li><a href="http://www.apache.org/foundation/sponsorship.html"><i class="fa fa-external-link"></i> Sponsorship</a></li>
+<li><a href="http://www.apache.org/security/"><i class="fa fa-external-link"></i> Security</a></li>
+<li><a href="http://www.apache.org/foundation/thanks.html"><i class="fa fa-external-link"></i> Thanks</a></li>
+</ul>
+</li>
+</ul>
+
+ </div>
+
+</div>
+</nav>
+
+
+<div class="container-fluid">
+<div class="row">
+ <div class="col-md-2" id="sidebar">
+ <div style="text-align: center">
+ <h1><a href="/index.html">Apache Slider (incubating)</a></h1>
+ <hr>
+Latest release: <strong>0.40-incubating</strong><br>
+ <br>
+ <a id="download-button-sidebar" class="btn btn-success btn-block" href="/downloads/" role="button">Download</a>
+ </div>
+ <hr>
+ <a href="http://incubator.apache.org"><img id="logo" alt="Apache Incubator ™" class="img-responsive" src="http://incubator.apache.org/images/apache-incubator-logo.png"/></a>
+ </div>
+ <div class="col-md-8 col-md-offset-1">
+
+ <div id="content">
+
+ <h1 class="title"></h1>
+
+ <!---
+ Licensed under the Apache License, Version 2.0 (the "License");
+ you may not use this file except in compliance with the License.
+ You may obtain a copy of the License at
+
+ http://www.apache.org/licenses/LICENSE-2.0
+
+ Unless required by applicable law or agreed to in writing, software
+ distributed under the License is distributed on an "AS IS" BASIS,
+ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ See the License for the specific language governing permissions and
+ limitations under the License. See accompanying LICENSE file.
+-->
+
+<h1 id="simple-slider-demo">Simple Slider Demo</h1>
+<p>These instructions cover how to give a simple demo of slider, showing
+<em> creating an application instance
+</em> starting and stopping an instance
+<em> publishing information in the registry
+</em> flexing an instance
+<em> recovery from component failure
+</em> recovery from AM failure</p>
+<p>It does not cover
+<em> Configuring the application instance via <code>app_conf.json</code>
+</em> Functional use of the deployed application other than viewing its web pages
+* Security</p>
+<h2 id="preparation">Preparation</h2>
+<p>Before starting the demo you need</p>
+<ol>
+<li>A Hadoop 2.6+ cluster, one node or greater</li>
+<li>A local installation of the slider client (unzipped into a directory is sufficient)</li>
+<li>A <code>slider-client.xml</code> file containing the binding information for the Hadoop cluster</li>
+</ol>
+<h3 id="hadoop-cluster-setup">Hadoop cluster setup</h3>
+<p>The cluster must be set up with no checks on memory use, and no minimum size on container allocations. This ensures that all requested VMs will be created, irrespective of how much memory there is available on the VM.</p>
+<div class="codehilite"><pre> <span class="nt"><property></span>
+ <span class="nt"><name></span>yarn.scheduler.minimum-allocation-mb<span class="nt"></name></span>
+ <span class="nt"><value></span>64<span class="nt"></value></span>
+ <span class="nt"></property></span>
+
+ <span class="nt"><property></span>
+ <span class="nt"><name></span>yarn.log-aggregation-enable<span class="nt"></name></span>
+ <span class="nt"><value></span>true<span class="nt"></value></span>
+ <span class="nt"></property></span>
+
+ <span class="nt"><property></span>
+ <span class="nt"><name></span>yarn.nodemanager.pmem-check-enabled<span class="nt"></name></span>
+ <span class="nt"><value></span>false<span class="nt"></value></span>
+ <span class="nt"></property></span>
+
+ <span class="nt"><property></span>
+ <span class="nt"><name></span>yarn.nodemanager.vmem-check-enabled<span class="nt"></name></span>
+ <span class="nt"><value></span>false<span class="nt"></value></span>
+ <span class="nt"></property></span>
+</pre></div>
+
+
+<h3 id="local-environment-and-path-setup">Local environment and path setup</h3>
+<h4 id="bash">Bash</h4>
+<div class="codehilite"><pre> <span class="n">export</span> <span class="n">HADOOP_CONF_DIR</span><span class="p">=</span><span class="o">~/</span><span class="n">clusters</span><span class="o">/</span><span class="n">demo</span><span class="o">/</span><span class="n">hadoop</span><span class="o">-</span><span class="n">conf</span>
+
+ <span class="n">export</span> <span class="n">SLIDER_CONF_DIR</span><span class="p">=</span><span class="o">~/</span><span class="n">clusters</span><span class="o">/</span><span class="n">demo</span><span class="o">/</span><span class="n">slider</span><span class="p">;</span>
+
+ <span class="n">export</span> <span class="n">PATH</span><span class="p">=</span><span class="o">~/</span><span class="n">slider</span><span class="o">/</span><span class="n">slider</span><span class="o">-</span><span class="n">assembly</span><span class="o">/</span><span class="n">target</span><span class="o">/</span><span class="n">slider</span><span class="o">-</span>0<span class="p">.</span>60<span class="p">.</span>0<span class="o">-</span><span class="n">incubating</span><span class="o">-</span><span class="n">all</span><span class="o">/</span><span class="n">slider</span><span class="o">-</span>0<span class="p">.</span>60<span class="p">.</span>0<span class="o">-</span><span class="n">incubating</span><span class="o">/</span><span class="n">bin</span>
+</pre></div>
+
+
+<h4 id="fish">Fish</h4>
+<div class="codehilite"><pre> <span class="n">set</span> <span class="o">-</span><span class="n">gx</span> <span class="n">HADOOP_CONF_DIR</span> <span class="o">~/</span><span class="n">clusters</span><span class="o">/</span><span class="n">demo</span><span class="o">/</span><span class="n">hadoop</span><span class="o">-</span><span class="n">conf</span>
+
+ <span class="n">set</span> <span class="o">-</span><span class="n">gx</span> <span class="n">SLIDER_CONF_DIR</span> <span class="o">~/</span><span class="n">clusters</span><span class="o">/</span><span class="n">demo</span><span class="o">/</span><span class="n">slider</span><span class="p">;</span>
+
+ <span class="n">set</span> <span class="o">-</span><span class="n">gx</span> <span class="n">PATH</span> $<span class="n">PATH</span> <span class="o">~/</span><span class="n">slider</span><span class="o">/</span><span class="n">slider</span><span class="o">-</span><span class="n">assembly</span><span class="o">/</span><span class="n">target</span><span class="o">/</span><span class="n">slider</span><span class="o">-</span>0<span class="p">.</span>60<span class="p">.</span>0<span class="o">-</span><span class="n">incubating</span><span class="o">-</span><span class="n">all</span><span class="o">/</span><span class="n">slider</span><span class="o">-</span>0<span class="p">.</span>60<span class="p">.</span>0<span class="o">-</span><span class="n">incubating</span><span class="o">/</span><span class="n">bin</span>
+</pre></div>
+
+
+<h4 id="tests">Tests</h4>
+<div class="codehilite"><pre><span class="n">slider</span> <span class="n">version</span>
+<span class="n">slider</span> <span class="n">list</span>
+</pre></div>
+
+
+<h3 id="creating-the-hdfs-paths">Creating the HDFS paths</h3>
+<p>HDFS needs to have the user's path created, with the username of the user giving the demo, here <code>demo</code>. This username <em>MUST</em> be that of the local user.</p>
+<div class="codehilite"><pre><span class="n">hdfs</span> <span class="n">dfs</span> <span class="o">-</span><span class="n">chmod</span> 777 <span class="o">/</span>
+<span class="n">hdfs</span> <span class="n">dfs</span> <span class="o">-</span><span class="n">mkdir</span> <span class="o">-</span><span class="n">p</span> <span class="o">/</span><span class="n">user</span><span class="o">/</span><span class="n">demo</span>
+<span class="n">hdfs</span> <span class="n">dfs</span> <span class="o">-</span><span class="n">chown</span> <span class="n">demo</span> <span class="o">/</span><span class="n">user</span><span class="o">/</span><span class="n">demo</span>
+<span class="n">hdfs</span> <span class="n">dfs</span> <span class="o">-</span><span class="n">chmod</span> 777 <span class="o">/</span><span class="n">user</span>
+</pre></div>
+
+
+<p>The YARN user account needs to be present too (in a reformatted VM this may be lost)</p>
+<div class="codehilite"><pre><span class="n">hdfs</span> <span class="n">dfs</span> <span class="o">-</span><span class="n">mkdir</span> <span class="o">-</span><span class="n">p</span> <span class="o">/</span><span class="n">user</span><span class="o">/</span><span class="n">yarn</span>
+<span class="n">hdfs</span> <span class="n">dfs</span> <span class="o">-</span><span class="n">chown</span> <span class="n">yarn</span> <span class="o">/</span><span class="n">user</span><span class="o">/</span><span class="n">yarn</span>
+</pre></div>
+
+
+<h3 id="building-and-installing-the-application">Building and installing the application</h3>
+<p>This demo uses HBase, so must have the slider hbase application package installed in the cluster.</p>
+<ol>
+<li>Download the hbase bin package, such as <code>hbase-0.99.1-bin.tar.gz</code></li>
+<li>rename it <code>hbase-0.99.1.tar.gz</code>, so that the name of the file matches the path to hbase inside it</li>
+<li>Untar it somewhere too (e.g. <code>/Users/demo/hbase-0.99.1</code>)</li>
+<li>
+<p>Build the HBase application package</p>
+<div class="codehilite"><pre><span class="n">mvn</span> <span class="n">clean</span> <span class="n">package</span> <span class="o">-</span><span class="n">Phbase</span><span class="o">-</span><span class="n">app</span><span class="o">-</span><span class="n">package</span> <span class="o">-</span><span class="n">Dpkg</span><span class="p">.</span><span class="n">version</span><span class="p">=</span>0<span class="p">.</span>99<span class="p">.</span>1 <span class="o">\</span>
+ <span class="o">-</span><span class="n">Dpkg</span><span class="p">.</span><span class="n">name</span><span class="p">=</span><span class="n">hbase</span><span class="o">-</span>0<span class="p">.</span>99<span class="p">.</span>1<span class="p">.</span><span class="n">tar</span><span class="p">.</span><span class="n">gz</span> <span class="o">\</span>
+ <span class="o">-</span><span class="n">Dpkg</span><span class="p">.</span><span class="n">src</span><span class="p">=</span><span class="o">/</span><span class="n">Users</span><span class="o">/</span><span class="n">demo</span><span class="o">/</span><span class="n">hbase</span><span class="o">-</span>0<span class="p">.</span>99<span class="p">.</span>1
+</pre></div>
+
+
+</li>
+<li>
+<p>Upload it</p>
+<div class="codehilite"><pre><span class="n">slider</span> <span class="n">install</span><span class="o">-</span><span class="n">package</span> <span class="o">--</span><span class="n">name</span> <span class="n">HBASE</span> <span class="o">--</span><span class="n">package</span> <span class="n">target</span><span class="o">/</span><span class="n">slider</span><span class="o">-</span><span class="n">hbase</span><span class="o">-</span><span class="n">app</span><span class="o">-</span><span class="n">package</span><span class="o">-</span>0<span class="p">.</span>99<span class="p">.</span>1<span class="p">.</span><span class="n">zip</span>
+</pre></div>
+
+
+</li>
+</ol>
+<h3 id="preparing-the-resource-definitions">Preparing the resource definitions</h3>
+<p>Take the template app's <code>resources-default.json</code> and <code>appConf-default.json</code> <em>FROM the target/ subdirectory</em>. They must be the ones with package versions fully expanded.</p>
+<p>In <code>appConfig.json</code></p>
+<ol>
+<li>cut the heap size down to <code>"256m"</code> in all components</li>
+<li>make sure any needed path to the JDK base directory is valid.</li>
+</ol>
+<p>In <code>resources.json</code></p>
+<ol>
+<li>set <code>"yarn.memory": "128"</code> everywhere,</li>
+<li>Turn set the number of instances the THRIFT and REST components to 0.</li>
+</ol>
+ </div>
+
+ <div id="footer">
+ <a alt="Apache Software Foundation" href="http://www.apache.org">
+ <img id="asf-logo" alt="Apache Software Foundation" src="/images/feather-small.gif" width="100">
+ </a>
+ <div class="copyright">
+ <p>
+ Copyright © 2011-2014 The Apache Software Foundation, Licensed under
+ the <a href="http://www.apache.org/licenses/LICENSE-2.0">Apache License, Version 2.0</a>.
+ Apache Slider, Slider, Apache, the Apache feather logo, and the Apache Incubator
+ project logo are trademarks of the <a href="http://www.apache.org">Apache Software Foundation</a>.<br />
+ Site created with <a href="http://getbootstrap.com/">Bootstrap</a> including icons from <a href="http://glyphicons.com/">GLYPHICONS</a> and <a href="http://fontawesome.io/">Font Awesome</a>.
+ </p>
+ </div>
+ </div>
+ </div>
+
+</div>
+</div>
+
+<script type="text/javascript">
+
+</script>
+</body>
+</html>
Modified: websites/staging/slider/trunk/content/developing/index.html
==============================================================================
--- websites/staging/slider/trunk/content/developing/index.html (original)
+++ websites/staging/slider/trunk/content/developing/index.html Fri Nov 21 12:28:31 2014
@@ -183,15 +183,16 @@ strongly encourage people to do so. </p>
<p>Here are documents covering how to go about building, testing and releasing
Slider</p>
<ul>
-<li><a href="/developing/building.html">Building</a></li>
-<li><a href="/docs/debugging.html">Debugging</a></li>
-<li><a href="/developing/testing.html">Testing</a></li>
-<li><a href="/developing/functional_tests.html">Functional Testing</a></li>
-<li><a href="/developing/manual_testing.html">Manual Testing</a></li>
-<li><a href="/developing/releasing.html">Releasing</a></li>
-<li><a href="/developing/releasing.html">Releasing</a></li>
-<li><a href="/developing/style.html">Style Guide</a></li>
-<li><a href="/developing/windows.html">Windows Development and Testing</a></li>
+<li><a href="building.html">Building</a></li>
+<li><a href="debugging.html">Debugging</a></li>
+<li><a href="testing.html">Testing</a></li>
+<li><a href="functional_tests.html">Functional Testing</a></li>
+<li><a href="manual_testing.html">Manual Testing</a></li>
+<li><a href="releasing.html">Releasing</a></li>
+<li><a href="releasing.html">Releasing</a></li>
+<li><a href="style.html">Style Guide</a></li>
+<li><a href="windows.html">Windows Development and Testing</a></li>
+<li><a href="demo.html">Demo Script</a></li>
</ul>
</div>
Modified: websites/staging/slider/trunk/content/docs/getting_started.html
==============================================================================
--- websites/staging/slider/trunk/content/docs/getting_started.html (original)
+++ websites/staging/slider/trunk/content/docs/getting_started.html Fri Nov 21 12:28:31 2014
@@ -179,7 +179,6 @@ Latest release: <strong>0.40-incubating<
<h1 id="apache-slider-getting-started">Apache Slider: Getting Started</h1>
<p>This page is updated to reflect the latest code in "develop".</p>
-<p>For the version applicable to the last release go to <a href="/docs/getting_started_40.html">Slider-40</a>.</p>
<h2 id="introduction">Introduction</h2>
<p>The following provides the steps required for setting up a cluster and deploying a YARN hosted application using Slider.</p>
<ul>
@@ -254,7 +253,7 @@ In <code>yarn-site.xml</code> make the f
<h2 id="wzxhzdk26wzxhzdk27build-slider"><a name="build"></a>Build Slider</h2>
<ul>
<li>From the top level directory, execute <code>mvn clean site:site site:stage package -DskipTests</code></li>
-<li>Use the generated compressed tar file in slider-assembly/target directory (e.g. slider-0.50.0-all.tar.gz or slider-0.50.0-all.zip) for the subsequent steps</li>
+<li>Use the generated compressed tar file in slider-assembly/target directory (e.g. slider-0.60.0-all.tar.gz or slider-0.60.0-all.zip) for the subsequent steps</li>
<li>If you are cloning the Slider git repo, go to <code>master</code> branch for the latest released or <code>develop</code> for the latest under development</li>
</ul>
<h2 id="wzxhzdk28wzxhzdk29install-slider"><a name="install"></a>Install Slider</h2>
@@ -268,9 +267,9 @@ cd <span class="cp">${</span><span class
<p>You can run Slider app as any user. Only requirement is that the user should have a home directory on HDFS. For the reminder of the doc, it is assumed that "yarn" user is being used.</p>
<p>Login as the "yarn" user (assuming this is a host associated with the installed cluster). E.g., <code>su yarn</code>
<em>This assumes that all apps are being run as âyarnâ user</em></p>
-<p>Expand the tar file: <code>tar -xvf slider-0.50.0-incubating-all.tar.gz</code> or <code>unzip slider-0.50.0-incubating-all.zip</code></p>
+<p>Expand the tar file: <code>tar -xvf slider-0.60.0-incubating-all.tar.gz</code> or <code>unzip slider-0.60.0-incubating-all.zip</code></p>
<h2 id="configure-slider">Configure Slider</h2>
-<p>Browse to the Slider directory: <code>cd slider-0.50.0/conf</code></p>
+<p>Browse to the Slider directory: <code>cd slider-0.60.0/conf</code></p>
<p>Edit slider-env.sh and specify correct values.</p>
<div class="codehilite"><pre><span class="n">export</span> <span class="n">JAVA_HOME</span><span class="p">=</span><span class="o">/</span><span class="n">usr</span><span class="o">/</span><span class="n">jdk64</span><span class="o">/</span><span class="n">jdk1</span><span class="p">.</span>7<span class="p">.</span>0<span class="n">_67</span>
<span class="n">export</span> <span class="n">HADOOP_CONF_DIR</span><span class="p">=</span><span class="o">/</span><span class="n">etc</span><span class="o">/</span><span class="n">hadoop</span><span class="o">/</span><span class="n">conf</span>
@@ -278,7 +277,7 @@ cd <span class="cp">${</span><span class
<p>If you are on a node that does not have the hadoop conf folder then you can add the relevant configurations into slider-client.xml.</p>
-<p>For example, if you are targeting a non-secure cluster with no HA for NameNode or ResourceManager, modify Slider configuration file <code>${slider-install-dir}/slider-0.50.0/conf/slider-client.xml</code> to add the following properties:</p>
+<p>For example, if you are targeting a non-secure cluster with no HA for NameNode or ResourceManager, modify Slider configuration file <code>${slider-install-dir}/slider-0.60.0/conf/slider-client.xml</code> to add the following properties:</p>
<div class="codehilite"><pre> <span class="nt"><property></span>
<span class="nt"><name></span>yarn.application.classpath<span class="nt"></name></span>
<span class="nt"><value></span>/etc/hadoop/conf,/usr/lib/hadoop/*,/usr/lib/hadoop/lib/*,/usr/lib/hadoop-hdfs/*,/usr/lib/hadoop-hdfs/lib/*,/usr/lib/hadoop-yarn/*,/usr/lib/hadoop-yarn/lib/*,/usr/lib/hadoop-mapreduce/*,/usr/lib/hadoop-mapreduce/lib/*<span class="nt"></value></span>
@@ -313,9 +312,9 @@ cd <span class="cp">${</span><span class
<p>Execute:</p>
-<div class="codehilite"><pre><span class="cp">${</span><span class="n">slider</span><span class="o">-</span><span class="n">install</span><span class="o">-</span><span class="nb">dir</span><span class="cp">}</span>/slider-0.50.0/bin/slider version
+<div class="codehilite"><pre><span class="cp">${</span><span class="n">slider</span><span class="o">-</span><span class="n">install</span><span class="o">-</span><span class="nb">dir</span><span class="cp">}</span>/slider-0.60.0/bin/slider version
OR
-python %slider-install-dir%/slider-0.50.0/bin/slider.py version
+python %slider-install-dir%/slider-0.60.0/bin/slider.py version
</pre></div>
@@ -336,16 +335,16 @@ python %slider-install-dir%/slider-0.50.
<p>Slider "master" branch has several sample application packages available for use with Slider:</p>
<ul>
<li>
-<p>app-packages/memcached-win or memcached: The README.txt describes how to create the Slider Application package for memcached for linux or windows. <strong>memcached</strong> app packages are a good place to <a href="slider_specs/hello_world_slider_app.html">start</a></p>
+<p><code>app-packages/memcached-win</code> or memcached: The README.txt describes how to create the Slider Application package for memcached for linux or windows. <strong>memcached</strong> app packages are a good place to <a href="slider_specs/hello_world_slider_app.html">start</a></p>
</li>
<li>
-<p>app-packages/hbase or hbase-win: The README.txt file describes how to create a Slider Application Package for HBase. By default it will create a package for HBase 0.98.3 but you can create the same for other versions.</p>
+<p><code>app-packages/hbase</code> or hbase-win: The README.txt file describes how to create a Slider Application Package for HBase. By default it will create a package for HBase 0.98.3 but you can create the same for other versions.</p>
</li>
<li>
-<p>app-packages/accumulo: The README.txt file describes how to create a Slider Application Package for Accumulo.</p>
+<p><code>app-packages/accumulo</code>: The README.txt file describes how to create a Slider Application Package for Accumulo.</p>
</li>
<li>
-<p>app-packages/storm or storm-win: The README.txt describes how to create the Slider Application package for Storm.</p>
+<p><code>app-packages/storm</code> or <code>storm-win</code>: The README.txt describes how to create the Slider Application package for Storm.</p>
</li>
</ul>
<p>Create one or more Slider application packages and follow the steps below to install them.</p>
@@ -400,7 +399,7 @@ This path is also reflected in appConfig
<h3 id="wzxhzdk44wzxhzdk45start-the-application"><a name="start"></a>Start the Application</h3>
<p>Once the steps above are completed, the application can be started through the <strong>Slider Command Line Interface (CLI)</strong>.</p>
<p>Change directory to the "bin" directory under the slider installation</p>
-<div class="codehilite"><pre>cd <span class="cp">${</span><span class="n">slider</span><span class="o">-</span><span class="n">install</span><span class="o">-</span><span class="nb">dir</span><span class="cp">}</span>/slider-0.50.0/bin
+<div class="codehilite"><pre>cd <span class="cp">${</span><span class="n">slider</span><span class="o">-</span><span class="n">install</span><span class="o">-</span><span class="nb">dir</span><span class="cp">}</span>/slider-0.60.0/bin
</pre></div>
@@ -469,7 +468,7 @@ Client configurations are at <code>/ws/v
<h1 id="wzxhzdk52wzxhzdk53appendix-a-debugging-slider-agent"><a name="appendixa"></a>Appendix A: Debugging Slider-Agent</h1>
<h2 id="create-and-deploy-slider-agent-configuration">Create and deploy Slider Agent configuration</h2>
<p>Create an agent config file (agent.ini) based on the sample available at:</p>
-<div class="codehilite"><pre><span class="cp">${</span><span class="n">slider</span><span class="o">-</span><span class="n">install</span><span class="o">-</span><span class="nb">dir</span><span class="cp">}</span>/slider-0.50.0/agent/conf/agent.ini
+<div class="codehilite"><pre><span class="cp">${</span><span class="n">slider</span><span class="o">-</span><span class="n">install</span><span class="o">-</span><span class="nb">dir</span><span class="cp">}</span>/slider-0.60.0/agent/conf/agent.ini
</pre></div>
Modified: websites/staging/slider/trunk/content/index.html
==============================================================================
--- websites/staging/slider/trunk/content/index.html (original)
+++ websites/staging/slider/trunk/content/index.html Fri Nov 21 12:28:31 2014
@@ -231,7 +231,6 @@ code changes and as of this writing, it
<li><a href="/docs/slider_specs/index.html">How to define a new slider-packaged application</a></li>
<li><a href="/docs/configuration/index.html">Application configuration model</a></li>
<li><a href="/docs/high_availability.html">High Availability</a></li>
-<li><a href="/docs/debugging.html">Debugging</a></li>
<li><a href="/docs/troubleshooting.html">Troubleshooting</a></li>
</ul>
<h2 id="developing">Developing</h2>