You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@zeppelin.apache.org by ah...@apache.org on 2016/12/28 01:38:14 UTC
zeppelin git commit: ZEPPELIN-1853. Add README for livy interpreter
Repository: zeppelin
Updated Branches:
refs/heads/master 16ca1d1fb -> 31c31c6b9
ZEPPELIN-1853. Add README for livy interpreter
### What is this PR for?
Add `README` file for developer, besides update the `livy.md` for the recent changes on livy interpreter.
### What type of PR is it?
[Documentation]
### Todos
* [ ] - Task
### What is the Jira issue?
* https://issues.apache.org/jira/browse/ZEPPELIN-1853
### Questions:
* Does the licenses files need update? No
* Is there breaking changes for older versions? No
* Does this needs documentation? No
Author: Jeff Zhang <zj...@apache.org>
Closes #1798 from zjffdu/ZEPPELIN-1853 and squashes the following commits:
940ebae [Jeff Zhang] remove upgrade
7233a4d [Jeff Zhang] address comments
72f40c7 [Jeff Zhang] ZEPPELIN-1853. Add README for livy interpreter
Project: http://git-wip-us.apache.org/repos/asf/zeppelin/repo
Commit: http://git-wip-us.apache.org/repos/asf/zeppelin/commit/31c31c6b
Tree: http://git-wip-us.apache.org/repos/asf/zeppelin/tree/31c31c6b
Diff: http://git-wip-us.apache.org/repos/asf/zeppelin/diff/31c31c6b
Branch: refs/heads/master
Commit: 31c31c6b9d9f35b459256354d69616c5eed7d554
Parents: 16ca1d1
Author: Jeff Zhang <zj...@apache.org>
Authored: Mon Dec 26 17:28:52 2016 +0800
Committer: ahyoungryu <ah...@apache.org>
Committed: Wed Dec 28 10:37:55 2016 +0900
----------------------------------------------------------------------
docs/interpreter/livy.md | 11 ++++-------
livy/README.md | 17 +++++++++++++++++
2 files changed, 21 insertions(+), 7 deletions(-)
----------------------------------------------------------------------
http://git-wip-us.apache.org/repos/asf/zeppelin/blob/31c31c6b/docs/interpreter/livy.md
----------------------------------------------------------------------
diff --git a/docs/interpreter/livy.md b/docs/interpreter/livy.md
index d725304..067a317 100644
--- a/docs/interpreter/livy.md
+++ b/docs/interpreter/livy.md
@@ -40,9 +40,9 @@ Additional requirements for the Livy interpreter are:
## Configuration
We added some common configurations for spark, and you can set any configuration you want.
-This link contains all spark configurations: http://spark.apache.org/docs/latest/configuration.html#available-properties.
+You can find all Spark configurations in [here](http://spark.apache.org/docs/latest/configuration.html#available-properties).
And instead of starting property with `spark.` it should be replaced with `livy.spark.`.
-Example: `spark.master` to `livy.spark.master`
+Example: `spark.driver.memory` to `livy.spark.driver.memory`
<table class="table-configuration">
<tr>
@@ -51,11 +51,6 @@ Example: `spark.master` to `livy.spark.master`
<th>Description</th>
</tr>
<tr>
- <td>livy.spark.master</td>
- <td>local[*]</td>
- <td>Spark master uri. ex) spark://masterhost:7077</td>
- </tr>
- <tr>
<td>zeppelin.livy.url</td>
<td>http://localhost:8998</td>
<td>URL where livy server is running</td>
@@ -127,6 +122,8 @@ Example: `spark.master` to `livy.spark.master`
</tr>
</table>
+**We remove livy.spark.master in zeppelin-0.7. Because we sugguest user to use livy 0.3 in zeppelin-0.7. And livy 0.3 don't allow to specify livy.spark.master, it enfornce yarn-cluster mode.**
+
## Adding External libraries
You can load dynamic library to livy interpreter by set `livy.spark.jars.packages` property to comma-separated list of maven coordinates of jars to include on the driver and executor classpaths. The format for the coordinates should be groupId:artifactId:version.
http://git-wip-us.apache.org/repos/asf/zeppelin/blob/31c31c6b/livy/README.md
----------------------------------------------------------------------
diff --git a/livy/README.md b/livy/README.md
new file mode 100644
index 0000000..e0908a8
--- /dev/null
+++ b/livy/README.md
@@ -0,0 +1,17 @@
+# Overview
+Livy interpreter for Apache Zeppelin
+
+# Prerequisities
+You can follow the instructions at [Livy Quick Start](http://livy.io/quickstart.html) to set up livy.
+
+# Run Integration Tests
+You can add integration test to [LivyInterpreter.java](https://github.com/apache/zeppelin/blob/master/livy/src/test/java/org/apache/zeppelin/livy/LivyInterpreterIT.java)
+Either you can run the integration test on travis where enviroment will be setup or you can run it in local. You need to download livy-0.2 and spark-1.5.2 to local, then use the following
+script to run the integration test.
+
+```bash
+#!/usr/bin/env bash
+export LIVY_HOME=<path_of_livy_0.2.0>
+export SPARK_HOME=<path_of_spark-1.5.2>
+mvn clean verify -pl livy -DfailIfNoTests=false -DskipRat
+```
\ No newline at end of file