You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-commits@hadoop.apache.org by ka...@apache.org on 2015/02/03 22:18:23 UTC
hadoop git commit: YARN-1393. SLS: Add how-to-use instructions. (Wei
Yan via kasha)
Repository: hadoop
Updated Branches:
refs/heads/trunk 5bd984691 -> c559df221
YARN-1393. SLS: Add how-to-use instructions. (Wei Yan via kasha)
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/c559df22
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/c559df22
Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/c559df22
Branch: refs/heads/trunk
Commit: c559df2219f4049f2412fba8ad031c434d9e82b6
Parents: 5bd9846
Author: Karthik Kambatla <ka...@apache.org>
Authored: Tue Feb 3 13:20:41 2015 -0800
Committer: Karthik Kambatla <ka...@apache.org>
Committed: Tue Feb 3 13:20:41 2015 -0800
----------------------------------------------------------------------
hadoop-tools/hadoop-sls/README | 24 ++++++++++++++++++--
.../src/site/apt/SchedulerLoadSimulator.apt.vm | 5 ++--
hadoop-yarn-project/CHANGES.txt | 2 ++
3 files changed, 27 insertions(+), 4 deletions(-)
----------------------------------------------------------------------
http://git-wip-us.apache.org/repos/asf/hadoop/blob/c559df22/hadoop-tools/hadoop-sls/README
----------------------------------------------------------------------
diff --git a/hadoop-tools/hadoop-sls/README b/hadoop-tools/hadoop-sls/README
index 86b554e..3d7912e 100644
--- a/hadoop-tools/hadoop-sls/README
+++ b/hadoop-tools/hadoop-sls/README
@@ -8,5 +8,25 @@ SLS runs a regular RM without RPC endpoints and uses a NodeManager and
Application Manager simulators to send and receive events simulating cluster
and application load behavior.
-The size of the cluster and the application load is scripted in a configuration
-file.
+==== Quick Start ====
+
+Let $HADOOP_ROOT represent the Hadoop install directory. If you build Hadoop
+yourself, $HADOOP_ROOT is hadoop-dist/target/hadoop-$VERSION. The simulator
+is located at $HADOOP_ROOT/share/hadoop/tools/sls. The folder sls contains
+four directories: bin (running scripts), html (web portal to view progress),
+sample-conf (some example configurations), and sample-data (an example rumen
+trace).
+
+STEP 1: Copy all configuration files (under sample-conf) to $HADOOP_ROOT/etc/hadoop.
+STEP 2: Go to the $HADOOP_ROOT/share/hadoop/tools/sls directory, and run the simulator
+using the sample rumen trace (under sample-data).
+
+bin/slsrun.sh —-input-rumen=sample-data/2jobs2min-rumen-jh.json —-output-dir=sample-output
+
+The simulator will start to run, and you can track the running progress
+using its web portal (http://$HOST:10001/simulate, where $HOST is the place
+where you run the simulator.). All collected scheduler metrics are stored
+under the output-dir during running. This trace takes about 3 mins to finish.
+
+For more detailed setup, you can check out the document
+(http://issues.apache.org/jira/secure/attachment/12604817/YARN-1021.pdf)
http://git-wip-us.apache.org/repos/asf/hadoop/blob/c559df22/hadoop-tools/hadoop-sls/src/site/apt/SchedulerLoadSimulator.apt.vm
----------------------------------------------------------------------
diff --git a/hadoop-tools/hadoop-sls/src/site/apt/SchedulerLoadSimulator.apt.vm b/hadoop-tools/hadoop-sls/src/site/apt/SchedulerLoadSimulator.apt.vm
index 399a1f5..a8b408c 100644
--- a/hadoop-tools/hadoop-sls/src/site/apt/SchedulerLoadSimulator.apt.vm
+++ b/hadoop-tools/hadoop-sls/src/site/apt/SchedulerLoadSimulator.apt.vm
@@ -225,7 +225,8 @@ Yarn Scheduler Load Simulator (SLS)
input traces. The script to start the simulator is <<<slsrun.sh>>>.
+----+
-$ $HADOOP_ROOT/share/hadoop/tools/sls/bin/slsrun.sh
+$ cd $HADOOP_ROOT/share/hadoop/tools/sls
+$ bin/slsrun.sh
--input-rumen|--input-sls=<TRACE_FILE1,TRACE_FILE2,...>
--output-dir=<SLS_SIMULATION_OUTPUT_DIRECTORY> [--nodes=<SLS_NODES_FILE>]
[--track-jobs=<JOBID1,JOBID2,...>] [--print-simulation]
@@ -258,7 +259,7 @@ $ $HADOOP_ROOT/share/hadoop/tools/sls/bin/slsrun.sh
convert rumen traces to sls traces.
+----+
-$ $HADOOP_ROOT/share/hadoop/tools/sls/bin/rumen2sls.sh
+$ bin/rumen2sls.sh
--rumen-file=<RUMEN_FILE>
--output-dir=<SLS_OUTPUT_DIRECTORY>
[--output-prefix=<SLS_FILE_PREFIX>]
http://git-wip-us.apache.org/repos/asf/hadoop/blob/c559df22/hadoop-yarn-project/CHANGES.txt
----------------------------------------------------------------------
diff --git a/hadoop-yarn-project/CHANGES.txt b/hadoop-yarn-project/CHANGES.txt
index 2d62d0d..8a66893 100644
--- a/hadoop-yarn-project/CHANGES.txt
+++ b/hadoop-yarn-project/CHANGES.txt
@@ -237,6 +237,8 @@ Release 2.7.0 - UNRELEASED
YARN-3075. NodeLabelsManager implementation to retrieve label to node
mapping (Varun Saxena via wangda)
+ YARN-1393. SLS: Add how-to-use instructions. (Wei Yan via kasha)
+
OPTIMIZATIONS
BUG FIXES