You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@zeppelin.apache.org by mo...@apache.org on 2016/12/02 02:01:01 UTC
zeppelin git commit: [ZEPPELIN-1728] Add an example configuring
classpath for hive-site.xml
Repository: zeppelin
Updated Branches:
refs/heads/master 13d77e07f -> c7dede3d3
[ZEPPELIN-1728] Add an example configuring classpath for hive-site.xml
### What is this PR for?
hive-site.xml is required to configure HiveContext in SparkInterpreter.
So it'll be helpful if document provide at least simple example that can help user get some idea.
### What type of PR is it?
Improvement
### Todos
* [x] - Add simple example
### What is the Jira issue?
https://issues.apache.org/jira/browse/ZEPPELIN-1728
### How should this be tested?
### Screenshots (if appropriate)
### Questions:
* Does the licenses files need update? no
* Is there breaking changes for older versions? no
* Does this needs documentation? no
Author: Lee moon soo <mo...@apache.org>
Closes #1708 from Leemoonsoo/ZEPPELIN-1728 and squashes the following commits:
98860ba [Lee moon soo] an example configure hive-site.xml into the classpath
Project: http://git-wip-us.apache.org/repos/asf/zeppelin/repo
Commit: http://git-wip-us.apache.org/repos/asf/zeppelin/commit/c7dede3d
Tree: http://git-wip-us.apache.org/repos/asf/zeppelin/tree/c7dede3d
Diff: http://git-wip-us.apache.org/repos/asf/zeppelin/diff/c7dede3d
Branch: refs/heads/master
Commit: c7dede3d36c116de727d16fbb614ba0f66384fc7
Parents: 13d77e0
Author: Lee moon soo <mo...@apache.org>
Authored: Tue Nov 29 22:29:29 2016 -0800
Committer: Lee moon soo <mo...@apache.org>
Committed: Thu Dec 1 18:00:58 2016 -0800
----------------------------------------------------------------------
docs/interpreter/spark.md | 8 +++++++-
1 file changed, 7 insertions(+), 1 deletion(-)
----------------------------------------------------------------------
http://git-wip-us.apache.org/repos/asf/zeppelin/blob/c7dede3d/docs/interpreter/spark.md
----------------------------------------------------------------------
diff --git a/docs/interpreter/spark.md b/docs/interpreter/spark.md
index 92f8fcd..6d92561 100644
--- a/docs/interpreter/spark.md
+++ b/docs/interpreter/spark.md
@@ -146,11 +146,17 @@ For example,
export SPARK_HOME=/usr/lib/spark
```
-You can optionally export `HADOOP_CONF_DIR` and `SPARK_SUBMIT_OPTIONS`
+You can optionally set more environment variables
```bash
+# set hadoop conf dir
export HADOOP_CONF_DIR=/usr/lib/hadoop
+
+# set options to pass spark-submit command
export SPARK_SUBMIT_OPTIONS="--packages com.databricks:spark-csv_2.10:1.2.0"
+
+# extra classpath. e.g. set classpath for hive-site.xml
+export ZEPPELIN_INTP_CLASSPATH_OVERRIDES=/etc/hive/conf
```
For Windows, ensure you have `winutils.exe` in `%HADOOP_HOME%\bin`. Please see [Problems running Hadoop on Windows](https://wiki.apache.org/hadoop/WindowsProblems) for the details.