You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@zeppelin.apache.org by mo...@apache.org on 2015/08/19 18:09:33 UTC
svn commit: r1696621 -
/incubator/zeppelin/site/docs/install/yarn_install.html
Author: moon
Date: Wed Aug 19 16:09:33 2015
New Revision: 1696621
URL: http://svn.apache.org/r1696621
Log:
https://github.com/apache/incubator-zeppelin/pull/225
Modified:
incubator/zeppelin/site/docs/install/yarn_install.html
Modified: incubator/zeppelin/site/docs/install/yarn_install.html
URL: http://svn.apache.org/viewvc/incubator/zeppelin/site/docs/install/yarn_install.html?rev=1696621&r1=1696620&r2=1696621&view=diff
==============================================================================
--- incubator/zeppelin/site/docs/install/yarn_install.html (original)
+++ incubator/zeppelin/site/docs/install/yarn_install.html Wed Aug 19 16:09:33 2015
@@ -140,6 +140,14 @@
+
+
+
+
+
+
+
+
@@ -189,13 +197,21 @@
+
+ <li><a href="/docs/index.html">Docs</a></li>
+
+
-
- <li><a href="/docs/index.html">Docs</a></li>
-
+
+
+
+
+
+
+
@@ -292,11 +308,10 @@
su - zeppelin
whoami
</code></pre></div>
-<p>Assuming a zeppelin user is created then running whoami command must return
-<code>bash
-zeppelin
-</code>
-Its assumed in the rest of the document that zeppelin user is indeed created and below installation instructions are performed as zeppelin user.</p>
+<p>Assuming a zeppelin user is created then running whoami command must return </p>
+<div class="highlight"><pre><code class="bash language-bash" data-lang="bash">zeppelin
+</code></pre></div>
+<p>Its assumed in the rest of the document that zeppelin user is indeed created and below installation instructions are performed as zeppelin user.</p>
<h3>List of Prerequisites</h3>
@@ -314,26 +329,23 @@ Its assumed in the rest of the document
<h4>Git</h4>
-<p>Intall latest stable version of Git. This document describes installation of version 2.4.8
-<code>bash
-yum install curl-devel expat-devel gettext-devel openssl-devel zlib-devel
+<p>Intall latest stable version of Git. This document describes installation of version 2.4.8</p>
+<div class="highlight"><pre><code class="bash language-bash" data-lang="bash">yum install curl-devel expat-devel gettext-devel openssl-devel zlib-devel
yum install gcc perl-ExtUtils-MakeMaker
yum remove git
-cd /home/zeppelin/prerequisites
+<span class="nb">cd</span> /home/zeppelin/prerequisites
wget https://github.com/git/git/archive/v2.4.8.tar.gz
tar xzf git-2.0.4.tar.gz
-cd git-2.0.4
-make prefix=/home/zeppelin/prerequisites/git all
-make prefix=/home/zeppelin/prerequisites/git install
-echo "export PATH=$PATH:/home/zeppelin/prerequisites/bin" >> /home/zeppelin/.bashrc
-source /home/zeppelin/.bashrc
+<span class="nb">cd </span>git-2.0.4
+make <span class="nv">prefix</span><span class="o">=</span>/home/zeppelin/prerequisites/git all
+make <span class="nv">prefix</span><span class="o">=</span>/home/zeppelin/prerequisites/git install
+<span class="nb">echo</span> <span class="s2">"export PATH=$PATH:/home/zeppelin/prerequisites/bin"</span> >> /home/zeppelin/.bashrc
+<span class="nb">source</span> /home/zeppelin/.bashrc
git --version
-</code>
-Assuming all the packages are successfully installed, running the version option with git command should display
-<code>bash
-git version 2.4.8
-</code></p>
-
+</code></pre></div>
+<p>Assuming all the packages are successfully installed, running the version option with git command should display</p>
+<div class="highlight"><pre><code class="bash language-bash" data-lang="bash">git version 2.4.8
+</code></pre></div>
<h4>Java</h4>
<p>Zeppelin works well with 1.7.x version of Java runtime. Download JDK version 7 and a stable update and follow below instructions to install it.</p>
@@ -344,34 +356,29 @@ tar -xf jdk-7u79-linux-x64.tar.gz
<span class="nb">source</span> /home/zeppelin/.bashrc
<span class="nb">echo</span> <span class="nv">$JAVA_HOME</span>
</code></pre></div>
-<p>Assuming all the packages are successfully installed, echoing JAVA<em>HOME environment variable should display
-```bash
-/home/zeppelin/prerequisites/jdk1.7.0</em>79
-```</p>
-
+<p>Assuming all the packages are successfully installed, echoing JAVA_HOME environment variable should display</p>
+<div class="highlight"><pre><code class="bash language-bash" data-lang="bash">/home/zeppelin/prerequisites/jdk1.7.0_79
+</code></pre></div>
<h4>Apache Maven</h4>
-<p>Download and install a stable version of Maven.
-<code>bash
-cd /home/zeppelin/prerequisites/
+<p>Download and install a stable version of Maven.</p>
+<div class="highlight"><pre><code class="bash language-bash" data-lang="bash"><span class="nb">cd</span> /home/zeppelin/prerequisites/
wget ftp://mirror.reverse.net/pub/apache/maven/maven-3/3.3.3/binaries/apache-maven-3.3.3-bin.tar.gz
tar -xf apache-maven-3.3.3-bin.tar.gz
-cd apache-maven-3.3.3
-export MAVEN_HOME=/home/zeppelin/prerequisites/apache-maven-3.3.3
-echo "export PATH=$PATH:/home/zeppelin/prerequisites/apache-maven-3.3.3/bin" >> /home/zeppelin/.bashrc
-source /home/zeppelin/.bashrc
+<span class="nb">cd </span>apache-maven-3.3.3
+<span class="nb">export </span><span class="nv">MAVEN_HOME</span><span class="o">=</span>/home/zeppelin/prerequisites/apache-maven-3.3.3
+<span class="nb">echo</span> <span class="s2">"export PATH=$PATH:/home/zeppelin/prerequisites/apache-maven-3.3.3/bin"</span> >> /home/zeppelin/.bashrc
+<span class="nb">source</span> /home/zeppelin/.bashrc
mvn -version
-</code>
-Assuming all the packages are successfully installed, running the version option with mvn command should display
-<code>bash
-Apache Maven 3.3.3 (7994120775791599e205a5524ec3e0dfe41d4a06; 2015-04-22T04:57:37-07:00)
+</code></pre></div>
+<p>Assuming all the packages are successfully installed, running the version option with mvn command should display</p>
+<div class="highlight"><pre><code class="bash language-bash" data-lang="bash">Apache Maven 3.3.3 <span class="o">(</span>7994120775791599e205a5524ec3e0dfe41d4a06<span class="p">;</span> 2015-04-22T04:57:37-07:00<span class="o">)</span>
Maven home: /home/zeppelin/prerequisites/apache-maven-3.3.3
Java version: 1.7.0_79, vendor: Oracle Corporation
Java home: /home/zeppelin/prerequisites/jdk1.7.0_79/jre
Default locale: en_US, platform encoding: UTF-8
-OS name: "linux", version: "2.6.32-358.el6.x86_64", arch: "amd64", family: "unix"
-</code></p>
-
+OS name: <span class="s2">"linux"</span>, version: <span class="s2">"2.6.32-358.el6.x86_64"</span>, arch: <span class="s2">"amd64"</span>, family: <span class="s2">"unix"</span>
+</code></pre></div>
<h4>Hadoop client</h4>
<p>Zeppelin can work with multiple versions & distributions of Hadoop. A complete list <a href="https://github.com/apache/incubator-zeppelin#build">is available here.</a> This document assumes Hadoop 2.7.x client libraries including configuration files are installed on Zeppelin node. It also assumes /etc/hadoop/conf contains various Hadoop configuration files. The location of Hadoop configuration files may vary, hence use appropriate location.</p>
@@ -389,12 +396,11 @@ This <span class="nb">command </span>was
<h2>Build</h2>
-<p>Checkout source code from <a href="https://github.com/apache/incubator-zeppelin">https://github.com/apache/incubator-zeppelin</a>
-<code>bash
-cd /home/zeppelin/
+<p>Checkout source code from <a href="https://github.com/apache/incubator-zeppelin">https://github.com/apache/incubator-zeppelin</a></p>
+<div class="highlight"><pre><code class="bash language-bash" data-lang="bash"><span class="nb">cd</span> /home/zeppelin/
git clone https://github.com/apache/incubator-zeppelin.git
-</code>
-Zeppelin package is available at /home/zeppelin/incubator-zeppelin after the checkout completes.</p>
+</code></pre></div>
+<p>Zeppelin package is available at /home/zeppelin/incubator-zeppelin after the checkout completes.</p>
<h3>Cluster mode</h3>
@@ -408,29 +414,26 @@ mvn clean package -Pspark-1.3 -Dspark.ve
<h2>Zeppelin Configuration</h2>
-<p>Zeppelin configurations needs to be modified to connect to YARN cluster. Create a copy of zeppelin environment XML
-<code>bash
-cp /home/zeppelin/incubator-zeppelin/conf/zeppelin-env.sh.template /home/zeppelin/incubator-zeppelin/conf/zeppelin-env.sh
-</code>
-Set the following properties
-<code>bash
-export JAVA_HOME=/home/zeppelin/prerequisites/jdk1.7.0_79
-export HADOOP_CONF_DIR=/etc/hadoop/conf
-export ZEPPELIN_PORT=10008
-export ZEPPELIN_JAVA_OPTS="-Dhdp.version=2.3.1.0-2574"
-</code>
-As /etc/hadoop/conf contains various configurations of YARN cluster, Zeppelin can now submit Spark/Hive jobs on YARN cluster form its web interface. The value of hdp.version is set to 2.3.1.0-2574. This can be obtained by running the following command
-```bash
-hdp-select status hadoop-client | sed 's/hadoop-client - (.*)/\1/'</p>
-
-<h1>It returned 2.3.1.0-2574</h1>
-<div class="highlight"><pre><code class="text language-text" data-lang="text">## Start/Stop
-### Start Zeppelin
+<p>Zeppelin configurations needs to be modified to connect to YARN cluster. Create a copy of zeppelin environment XML</p>
+<div class="highlight"><pre><code class="bash language-bash" data-lang="bash">cp /home/zeppelin/incubator-zeppelin/conf/zeppelin-env.sh.template /home/zeppelin/incubator-zeppelin/conf/zeppelin-env.sh
</code></pre></div>
-<p>cd /home/zeppelin/incubator-zeppelin
+<p>Set the following properties</p>
+<div class="highlight"><pre><code class="bash language-bash" data-lang="bash"><span class="nb">export </span><span class="nv">JAVA_HOME</span><span class="o">=</span>/home/zeppelin/prerequisites/jdk1.7.0_79
+<span class="nb">export </span><span class="nv">HADOOP_CONF_DIR</span><span class="o">=</span>/etc/hadoop/conf
+<span class="nb">export </span><span class="nv">ZEPPELIN_PORT</span><span class="o">=</span>10008
+<span class="nb">export </span><span class="nv">ZEPPELIN_JAVA_OPTS</span><span class="o">=</span><span class="s2">"-Dhdp.version=2.3.1.0-2574"</span>
+</code></pre></div>
+<p>As /etc/hadoop/conf contains various configurations of YARN cluster, Zeppelin can now submit Spark/Hive jobs on YARN cluster form its web interface. The value of hdp.version is set to 2.3.1.0-2574. This can be obtained by running the following command</p>
+<div class="highlight"><pre><code class="bash language-bash" data-lang="bash">hdp-select status hadoop-client <span class="p">|</span> sed <span class="s1">'s/hadoop-client - \(.*\)/\1/'</span>
+<span class="c"># It returned 2.3.1.0-2574</span>
+</code></pre></div>
+<h2>Start/Stop</h2>
+
+<h3>Start Zeppelin</h3>
+<div class="highlight"><pre><code class="text language-text" data-lang="text">cd /home/zeppelin/incubator-zeppelin
bin/zeppelin-daemon.sh start
-```
-After successful start, visit http://[zeppelin-server-host-name]:8080 with your web browser.</p>
+</code></pre></div>
+<p>After successful start, visit http://[zeppelin-server-host-name]:8080 with your web browser.</p>
<h3>Stop Zeppelin</h3>
<div class="highlight"><pre><code class="text language-text" data-lang="text">bin/zeppelin-daemon.sh stop