You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@zeppelin.apache.org by qinchaofeng <gi...@git.apache.org> on 2017/02/08 08:48:01 UTC
[GitHub] zeppelin pull request #1989: Branch 0.7
GitHub user qinchaofeng opened a pull request:
https://github.com/apache/zeppelin/pull/1989
Branch 0.7
### What is this PR for?
To hide the menu of interpreter setting, credentials and configurations based on permission.
### What type of PR is it?
[Improvement]
### Todos
### What is the Jira issue?
https://issues.apache.org/jira/browse/ZEPPELIN-2073
### How should this be tested?
Has prepared the testcase in UnitTest
### Screenshots (if appropriate)
### Questions:
* Does the licenses files need update?no
* Is there breaking changes for older versions?no
* Does this needs documentation?no
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/apache/zeppelin branch-0.7
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/zeppelin/pull/1989.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #1989
----
commit d91b310cbb985eac1e12ab9528a3be9e8e1b834c
Author: Prabhjyot Singh <pr...@gmail.com>
Date: 2017-01-07T12:37:00Z
[ZEPPELIN-1906] Use multiple InterpreterResult for displaying multiple JDBC queries
### What is this PR for?
Use multiple InterpreterResult for displaying multiple JDBC queries.
IMO since other sql editors allows to execute multiple sql separated with ";" and ours display mechanism being more powerful, hence, it should also allow the same.
### What type of PR is it?
[Improvement]
### What is the Jira issue?
* [ZEPPELIN-1906](https://issues.apache.org/jira/browse/ZEPPELIN-1906)
### How should this be tested?
Try running following in a paragraph (with Postgres setting) and check for output.
```
%jdbc
create table test_temp_table (id int);
select column_name, data_type, character_maximum_length from INFORMATION_SCHEMA.COLUMNS where table_name = 'test_temp_table';
SELECT table_name FROM information_schema.tables WHERE table_schema = 'public';
drop table test_temp_table;
SELECT table_name FROM information_schema.tables WHERE table_schema = 'public';
```
### Screenshots (if appropriate)
### Questions:
* Does the licenses files need update? N/A
* Is there breaking changes for older versions? N/A
* Does this needs documentation? N/A
Author: Prabhjyot Singh <pr...@gmail.com>
Closes #1845 from prabhjyotsingh/ZEPPELIN-1906 and squashes the following commits:
b27352a [Prabhjyot Singh] on error show previous output.
f9fd5c6 [Prabhjyot Singh] allow last query to be without ";"
b3e742e [Prabhjyot Singh] fixing checkstyle-fail-build
ac4663d [Prabhjyot Singh] add block comment
f3da37f [Prabhjyot Singh] replace regex with slightly better logic.
e6727b5 [Prabhjyot Singh] add testcase for spliting sql.
c096e76 [Prabhjyot Singh] remove extra empty lines
e675190 [Prabhjyot Singh] user same connection instead of creating new everytime
f5ab796 [Prabhjyot Singh] Use multiple InterpreterResult for displaying multiple JDBC queries
(cherry picked from commit 8464971c7aab0734f96d0a5a11d842b8e595324a)
Signed-off-by: Prabhjyot Singh <pr...@gmail.com>
commit b8637f5e5fa4aab8859e6bc90fa7886ba9157b24
Author: Alexander Shoshin <al...@epam.com>
Date: 2017-01-11T08:45:31Z
[ZEPPELIN-1787] Add an example of Flink Notebook
### What is this PR for?
This PR will add an example of batch processing with Flink to Zeppelin tutorial notebooks. There are no any Flink notebooks in the tutorial at the moment.
### What type of PR is it?
Improvement
### What is the Jira issue?
[ZEPPELIN-1787](https://issues.apache.org/jira/browse/ZEPPELIN-1787)
### How should this be tested?
You should open `Using Flink for batch processing` notebook from the `Zeppelin Tutorial` folder and run all paragraphs one by one
### Questions:
* Does the licenses files need update? - **no**
* Is there breaking changes for older versions? - **no**
* Does this needs documentation? - **no**
Author: Alexander Shoshin <Al...@epam.com>
Closes #1758 from AlexanderShoshin/ZEPPELIN-1787 and squashes the following commits:
83cbffb [Alexander Shoshin] remove localhost url
5255e17 [Alexander Shoshin] Merge branch 'master' into ZEPPELIN-1787
0b9df56 [Alexander Shoshin] add a link for this notebook to Zeppelin documentation
593c47d [Alexander Shoshin] convert notebook to 0.7.0 format
9013620 [Alexander Shoshin] convert notebook to 0.6.2 format
fe2a39e [Alexander Shoshin] add download instruction, change "wget" to "curl"
f64b60a [Alexander Shoshin] [ZEPPELIN-1787] Add an example of Flink Notebook
(cherry picked from commit 0da08d1d726129f6b684c99b1af8802907475d8a)
Signed-off-by: ahyoungryu <ah...@apache.org>
commit 6a15e7bf30876005b79f7593e02d5a4dc9f691d2
Author: Jeff Zhang <zj...@apache.org>
Date: 2017-01-11T07:22:19Z
ZEPPELIN-1867. Update document for pig interpreter and add one sample note
### What is this PR for?
* Minor update for pig interpreter
* Add one sample pig tutorial note which do the same thing as the spark tutorial note.
### What type of PR is it?
[Improvement | Documentation ]
### Todos
* [ ] - Task
### What is the Jira issue?
* https://issues.apache.org/jira/browse/ZEPPELIN-1867
### How should this be tested?
Tested manually
### Screenshots (if appropriate)
### Questions:
* Does the licenses files need update? No
* Is there breaking changes for older versions? No
* Does this needs documentation? No
Author: Jeff Zhang <zj...@apache.org>
Closes #1830 from zjffdu/ZEPPELIN-1867 and squashes the following commits:
1c0d819 [Jeff Zhang] rename note name
50198a1 [Jeff Zhang] add more description of tutorial note
88385f2 [Jeff Zhang] Add pig tutorial note
25216f8 [Jeff Zhang] ZEPPELIN-1867. Update document for pig interpreter and add one sample note
(cherry picked from commit 3d2d4b6f9804ecc5c157c1b4a3885ee01890884e)
Signed-off-by: ahyoungryu <ah...@apache.org>
commit ffdc5e972e2d5dd36aab099c71a6e852ed0c9260
Author: soralee <so...@nflabs.com>
Date: 2017-01-11T06:26:23Z
[ZEPPELIN-1864] Improvement to show folder and note after searching note
### What is this PR for?
This PR is for improvement to show folder and note after using the filter. And I found some bugs and fixed like this.
the following list is improvement and bug fixed.
1. After using the filter in Zeppelin Home, every note is shown by the form [FolderName/NoteName] like below. It would be nice to show folder icon and note icon as previous status.
2. When using the filter, some functions and icons next to note and folder are disappeared.
3. When using the filter, the `Rename Note` function doesn't work. ( When I was handling this PR, this bug was discovered.)
### What type of PR is it?
[ Bug Fix | Improvement ]
### Todos
* [x] - improve to show folder and note when finishing to use filter.
* [x] - some functions and icons next to note and folder are appeared when using filter.
* [x] - fix `Rename Note` function when using the filter.
### What is the Jira issue?
https://issues.apache.org/jira/browse/ZEPPELIN-1864
### How should this be tested?
- **[Test 1]** Before/After using the filter, check the list structure of your notes. It must be same appearance.
- **[Test 2]** When using the filter, check the notes. Some icons and functions next to note and folder must be appeared.
- **[Test 3]** When using the filter, click `Rename Note`. It must be appeared the path of Note.
### Screenshots (if appropriate)
**Test 1**.
**Test 2**.
**Test 3**.
### Questions:
* Does the licenses files need update? N/A
* Is there breaking changes for older versions? N/A
* Does this needs documentation? N/A
Author: soralee <so...@nflabs.com>
Closes #1834 from soralee/ZEPPELIN-1864 and squashes the following commits:
6fb53aa [soralee] resolve conflict
fd2c243 [soralee] resolve conflict
3e4b8ae [soralee] fix for that filter of navbar and home don't work
61680e5 [soralee] Improvement to show folder and note after searching note
69d6d6d [soralee] Improvement to show folder and note after searching note
(cherry picked from commit d393a5b52d345adc4da807065a25757572202075)
Signed-off-by: ahyoungryu <ah...@apache.org>
commit 0981d34f92de4ee3ec7f59f53c6d4f70b747c9ca
Author: Unknown <so...@gmail.com>
Date: 2017-01-10T14:03:03Z
[MINOR] Small Selenium test fixes
### What is this PR for?
Remove unused imports;
Replace "Thread.sleep" (unstable solution);
Add "deleteTestNotebook()" method -> testWidth.
### What type of PR is it?
[Refactoring]
### Todos
* [ ] - Task
### What is the Jira issue?
* Open an issue on Jira https://issues.apache.org/jira/browse/ZEPPELIN/
* Put link here, and add [ZEPPELIN-*Jira number*] in PR title, eg. [ZEPPELIN-533]
### How should this be tested?
Travis-CI
### Screenshots (if appropriate)
https://travis-ci.org/apache/zeppelin/builds/190644901 -> https://travis-ci.org/apache/zeppelin/jobs/190644918
### Questions:
* Does the licenses files need update? (no)
* Is there breaking changes for older versions? (no)
* Does this needs documentation? (no)
Author: Unknown <So...@gmail.com>
Closes #1882 from bitchelov/automationTestFix and squashes the following commits:
f898c59 [Unknown] [MINOR] Small Selenium test fixes
(cherry picked from commit 434215668e9db51706230420f8ce2c1c268b2457)
Signed-off-by: Jongyoul Lee <jo...@apache.org>
commit ab87537bb2c99857428f712979dd3feb8d971809
Author: Khalid Huseynov <kh...@gmail.com>
Date: 2017-01-11T04:48:26Z
[ZEPPELIN-1730, 1587] add spark impersonation through --proxy-user option
### What is this PR for?
This is to add spark impersonation using --proxy-user option. note that it enables also to use spark impersonation without having logged user as system user with configured ssh.
### What type of PR is it?
Improvement
### Todos
* [x] - add `--proxy-user`
* [x] - try on standalone spark 1.6.2
* [x] - try on yarn-client mode spark 2.0.1
### What is the Jira issue?
Directly solves [ZEPPELIN-1730](https://issues.apache.org/jira/browse/ZEPPELIN-1730) and also solves [ZEPPELIN-1587](https://issues.apache.org/jira/browse/ZEPPELIN-1587) according to discussion in #1566 since using `--proxy-user` in `spark-submit` is preferable method.
### How should this be tested?
1. switch your spark cluster to `per user` and `isolated` mode
2. set up `user impersonation` flag
3. run some job using that spark interpreter
4. spark context should be created with currently logged in user credentials on behalf of system user
### Screenshots (if appropriate)
standalone
yarn-client
<img width="997" alt="screen shot 2017-01-04 at 10 00 13 am" src="https://cloud.githubusercontent.com/assets/1642088/21653117/75410fde-d264-11e6-886f-11d8b5dbd29e.png">
### Questions:
* Does the licenses files need update? no
* Is there breaking changes for older versions? no
* Does this needs documentation? yes
Author: Khalid Huseynov <kh...@gmail.com>
Closes #1840 from khalidhuseynov/feat/spark-proxy-user and squashes the following commits:
e4251de [Khalid Huseynov] update doc with env var
dc61cae [Khalid Huseynov] check for env spark_proxy in interpreter.sh
8b66740 [Khalid Huseynov] add spark_proxy_user to env.sh
892b7e4 [Khalid Huseynov] add note in docs
4c3dba9 [Khalid Huseynov] add --proxy-user option for spark
(cherry picked from commit 5e0aacf8a8f187702452d7cd2ee83b26c56dec90)
Signed-off-by: Jongyoul Lee <jo...@apache.org>
commit 7aa52d828fcfcd23f4a9c1c08279e0db8911fad0
Author: AhyoungRyu <fb...@hanmail.net>
Date: 2017-01-12T06:15:14Z
[MINOR] Rename Pig tutorial note to consider priority
### What is this PR for?
After #1830 merged, Pig tutorial note placed as a first under `Zeppelin Tutorial` folder. I told to zjffdu, I thought the note name should be same with Spark ("Basic Feature (Spark)") in [this comment](https://github.com/apache/zeppelin/pull/1830#discussion_r95522394) (because they have same contents).
<img src="https://cloud.githubusercontent.com/assets/10060731/21879248/a6d9b88a-d8da-11e6-8f43-5ef192e5895c.png" width="300px">
But considering the number of Spark and Pig users, the Spark tutorial note needs to be placed as first I think.
<img src="https://cloud.githubusercontent.com/assets/10060731/21879244/a488e3d0-d8da-11e6-9e0b-c91ca890c611.png" width="300px">
### What type of PR is it?
Rename Pig tutorial note
### What is the Jira issue?
N/A
### Questions:
* Does the licenses files need update? no
* Is there breaking changes for older versions? no
* Does this needs documentation? no
Author: AhyoungRyu <fb...@hanmail.net>
Closes #1889 from AhyoungRyu/rename/pigTutorialNote and squashes the following commits:
f08fd69 [AhyoungRyu] Rename Pig tutorial note to consider priority
(cherry picked from commit b9c667ae1dfcbc6d80d4fc65f64572acee96ede6)
Signed-off-by: ahyoungryu <ah...@apache.org>
commit 94bbd41422ab98d8ee787163598e0aaa49fc2bc6
Author: astroshim <hs...@zepl.com>
Date: 2017-01-11T06:02:00Z
[ZEPPELIN-1229] Clear browser cache with version hashtag.
### What is this PR for?
This PR avoids browser cache.
### What type of PR is it?
Bug Fix
### What is the Jira issue?
https://issues.apache.org/jira/browse/ZEPPELIN-1229
### How should this be tested?
1. Run old version of zeppelin(I was using 0.6.1) and show main page up in your browser.
2. Stop zeppelin.
3. Run this PR of Zeppelin and show page up on the same browser of 1.
4. check main page changed.
- before (Job menu doesn't show)
- after (Job menu show)
### Questions:
* Does the licenses files need update? no
* Is there breaking changes for older versions? no
* Does this needs documentation? no
Author: astroshim <hs...@zepl.com>
Closes #1858 from astroshim/ZEPPELIN-1229 and squashes the following commits:
18defbe [astroshim] modify regx
85e0a05 [astroshim] remove arguments in code
ca09eac [astroshim] change path
13d8056 [astroshim] trying another way
6b554e0 [astroshim] Merge branch 'master' into ZEPPELIN-1229
655dc3d [astroshim] tag all html
c94de90 [astroshim] delete unnecessary codes
9d9f76f [astroshim] fix ZEPPELIN-1229
(cherry picked from commit 02323e283c6cce12bb06bf5327420c2d2da5cbe2)
Signed-off-by: Mina Lee <mi...@apache.org>
commit b0883a80d04918ce3fa79053469ce5cd96e9f63f
Author: Khalid Huseynov <kh...@gmail.com>
Date: 2017-01-11T07:22:35Z
[ZEPPELIN-1936] Fix user impersonation setting propagation
### What is this PR for?
This is to fix bug of creating interpreter with impersonation enabled
### What type of PR is it?
Bug Fix
### Todos
* [x] - fix model
### What is the Jira issue?
[ZEPPELIN-1936](https://issues.apache.org/jira/browse/ZEPPELIN-1936)
### How should this be tested?
create new interpreter with "User Impersonation" enabled
### Screenshots (if appropriate)
before:
after:
### Questions:
* Does the licenses files need update? no
* Is there breaking changes for older versions? no
* Does this needs documentation? no
Author: Khalid Huseynov <kh...@gmail.com>
Closes #1884 from khalidhuseynov/fix/new-interp-impersonation-setting and squashes the following commits:
d5f8393 [Khalid Huseynov] fix model on interpreter-create
(cherry picked from commit 7290200322174fa643625034af2a8c61737dad06)
Signed-off-by: Mina Lee <mi...@apache.org>
commit 55addf1a3194f40ac48eb97dd98bf8b9c3d98b2e
Author: cloverhearts <cl...@gmail.com>
Date: 2017-01-13T02:53:10Z
[HOTFIX : ZEPPELIN-1932] paragraph blur error
### What is this PR for?
When one or more hidden editors are present, clicking on the editor will cause a blur error.
This means that when a paragraph is hidden through ng-if,
Caused by calling the blur method in the absence of an editor object.
### What type of PR is it?
Hot Fix
### What is the Jira issue?
https://issues.apache.org/jira/browse/ZEPPELIN-1932
### How should this be tested?
1. create paragraph and open debug console.
2. enable hide paragraph.
3. page refresh
4. click to anywhere paragraph.
### Questions:
* Does the licenses files need update? no
* Is there breaking changes for older versions? no
* Does this needs documentation? no
Author: cloverhearts <cl...@gmail.com>
Closes #1879 from cloverhearts/hotfix/paragraphOnfocusEvent and squashes the following commits:
7071638 [cloverhearts] fix show title and paragraph context issue
8f4d0bf [cloverhearts] fixed readonly event error
5ecfabb [cloverhearts] check editor object is undeifned.
(cherry picked from commit 2b0e2a41cb7e0d7fc160d5c9193413ffe4d94f68)
Signed-off-by: Mina Lee <mi...@apache.org>
commit 88e2ac2798780a589771bda22029bbd876910189
Author: 1ambda <1a...@gmail.com>
Date: 2017-01-10T22:56:35Z
[ZEPPELIN-1917] Improve python.conda interpreter
### What is this PR for?
Add missing commands to the `python.conda` interpreter
- `conda info`
- `conda list`
- `conda create`
- `conda install`
- `conda uninstall (alias of remove)`
- `conda env *`
#### Implementation Detail
The reason I modified `PythonProcess` is due to NPE
```java
// https://github.com/apache/zeppelin/blob/master/python/src/main/java/org/apache/zeppelin/python/PythonProcess.java#L107-L118
public String sendAndGetResult(String cmd) throws IOException {
writer.println(cmd);
writer.println();
writer.println("\"" + STATEMENT_END + "\"");
StringBuilder output = new StringBuilder();
String line = null;
// NPE when line is null
while (!(line = reader.readLine()).contains(STATEMENT_END)) {
logger.debug("Read line from python shell : " + line);
output.append(line + "\n");
}
return output.toString();
}
```
```
java.lang.NullPointerException
at org.apache.zeppelin.python.PythonProcess.sendAndGetResult(PythonProcess.java:113)
at org.apache.zeppelin.python.PythonInterpreter.sendCommandToPython(PythonInterpreter.java:250)
at org.apache.zeppelin.python.PythonInterpreter.bootStrapInterpreter(PythonInterpreter.java:272)
at org.apache.zeppelin.python.PythonInterpreter.open(PythonInterpreter.java:100)
at org.apache.zeppelin.python.PythonCondaInterpreter.restartPythonProcess(PythonCondaInterpreter.java:139)
at org.apache.zeppelin.python.PythonCondaInterpreter.interpret(PythonCondaInterpreter.java:88)
at org.apache.zeppelin.interpreter.LazyOpenInterpreter.interpret(LazyOpenInterpreter.java:94)
at org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer$InterpretJob.jobRun(RemoteInterpreterServer.java:494)
at org.apache.zeppelin.scheduler.Job.run(Job.java:175)
at org.apache.zeppelin.scheduler.FIFOScheduler$1.run(FIFOScheduler.java:139)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
```
### What type of PR is it?
[Improvement | Refactoring]
### Todos
* [x] - info
* [x] - list
* [x] - create
* [x] - install
* [x] - uninstall (= remove)
* [x] - env *
### What is the Jira issue?
[ZEPPELIN-1917](https://issues.apache.org/jira/browse/ZEPPELIN-1917)
### How should this be tested?
1. Install [miniconda](http://conda.pydata.org/miniconda.html)
2. Make sure that your python interpreter can use `conda` (check the Interpreter Binding page)
3. Remove `test` conda env since we will create in the following section
```sh
$ conda env remove --yes --name test
```
4. Run these commands with `%python.conda`
```
%python.conda info
%python.conda env list
%python.conda create --name test
# you should be able to see `test` in the list
%python.conda env list
%python.conda activate pymysql
%python.conda install pymysql
# you should be able to import
%python
import pymysql.cursors
%python.conda uninstall pymysql
%python.conda deactivate pymysql
# you should be able to see `No module named pymysql.cursor` since we deactivated
%python
import pymysql.cursors
```
### Screenshots (if appropriate)
### Questions:
* Does the licenses files need update? - NO
* Is there breaking changes for older versions? - NO
* Does this needs documentation? - NO
Author: 1ambda <1a...@gmail.com>
Closes #1868 from 1ambda/ZEPPELIN-1917/improve-conda-interpreter and squashes the following commits:
3ba171a [1ambda] fix: Wrap output style
292ed6d [1ambda] refactor: Throw exception in runCommand
2d4aa7d [1ambda] test: Add some tests
49a4a11 [1ambda] feat: Supports other env commands
6eb7e92 [1ambda] fix: NPE in PythonProcess
9c5dd86 [1ambda] refactor: Activate, Deactivate
f955889 [1ambda] fix: minor
935cb89 [1ambda] refactor: Abstract commands
b1c4c9f [1ambda] feat: Add conda remove (uninstall)
e539c42 [1ambda] feat: Add conda install
4f58fa2 [1ambda] feat: Add conda create
7da132d [1ambda] docs: Add missing conda list description
929ca8a [1ambda] feat: Make conda output beautiful
0c6ebb4 [1ambda] feat: Add list conda command
017c76f [1ambda] refactor: Import InterpreterResult.{Code, Type} to short codes
b8a5154 [1ambda] refactor: Simplify exception flow so private funcs don't need care exceptions
64d4bef [1ambda] style: Rename some funcs
afc456d [1ambda] refactor: Add private to member vars
f36fc74 [1ambda] feat: Add info command
2eb9bf5 [1ambda] style: Remove useless newlines
bd2564e [1ambda] refactor: PythonCondaInterpreter.interpret
f0d69bc [1ambda] fix: Use specific command for env list in conda
(cherry picked from commit 034fdc6735e075c89f727bb6bc6fddbc89b639c4)
Signed-off-by: Lee moon soo <mo...@apache.org>
commit 8aea6a52eecc7cd5c75e0ae90d8b907cba2d537f
Author: robbins <ro...@uk.ibm.com>
Date: 2017-01-12T15:15:29Z
[ZEPPELIN-1560] avoid generating minus sign in package name
### What is this PR for?
using Object.hashCode() as part of the REPL wrapper class name can cause a compilation error as hashCode can validly return a negative integer.
We would like this fix backported to 0.6 and later streams.
### What type of PR is it?
Bug Fix
### Todos
* [ ] - Task
### What is the Jira issue?
https://issues.apache.org/jira/browse/ZEPPELIN-1560
### How should this be tested?
regression tests with openJdk + tests with IBM jvm
### Screenshots (if appropriate)
N/A
### Questions:
* Does the licenses files need update? NO
* Is there breaking changes for older versions? NO
* Does this needs documentation? NO
Author: robbins <ro...@uk.ibm.com>
Closes #1894 from robbinspg/ZPPELIN-1560 and squashes the following commits:
eeef3ad [robbins] [ZEPPELIN-1560] avoid generating minus sign in package name
(cherry picked from commit 068c8946211823ac98fc7dbf8061da6e9a2712c3)
Signed-off-by: Lee moon soo <mo...@apache.org>
commit 893c23dd9d48497f3aaeab2fa28917850203369d
Author: cloverhearts <cl...@gmail.com>
Date: 2017-01-14T00:02:55Z
[HOTFIX] Does not working settings menu in zeppelin web graph ui
### What is this PR for?
Does not working settings menu in zeppelin web graph ui
### What type of PR is it?
Bug Fix
### How should this be tested?
1. toggle settings menu in zeppelin graph ui
### Screenshots (if appropriate)
#### Before
#### After
### Questions:
* Does the licenses files need update? no
* Is there breaking changes for older versions? no
* Does this needs documentation? no
Author: cloverhearts <cl...@gmail.com>
Closes #1899 from cloverhearts/ZEEPELIN-SETTING-PROBLEM-WEB-UI and squashes the following commits:
e3453b7 [cloverhearts] invalid render life cycle for setting
(cherry picked from commit 59e15c03d6a405e07dec59fb6e7f0ad87150794f)
Signed-off-by: Lee moon soo <mo...@apache.org>
commit 59d2d107b841f637b8da0b1fcb7f3a8c90c8db7a
Author: 1ambda <1a...@gmail.com>
Date: 2017-01-11T05:38:01Z
[ZEPPELIN-1883] Can't import spark submitted packages in PySpark
### What is this PR for?
Fixed importing packages in pyspack requested by `SPARK_SUBMIT_OPTION`
### What type of PR is it?
[Bug Fix]
### Todos
Nothing
### What is the Jira issue?
[ZEPPELIN-1883](https://issues.apache.org/jira/browse/ZEPPELIN-1883)
### How should this be tested?
0. Download Apache Spark 1.6.2 (since it's the most recent for pyspark-cassandra)
1. Set `SPARK_HOME` and `SPARK_SUBMIT_OPTION` in `conf/zeppelin-env.sh` like
```sh
export SPARK_HOME="~/github/apache-spark/1.6.2-bin-hadoop2.6"
export SPARK_SUBMIT_OPTIONS="--packages com.datastax.spark:spark-cassandra-connector_2.10:1.6.2,TargetHolding:pyspark-cassandra:0.3.5 --exclude-packages org.slf4j:slf4j-api"
```
2. Check before that you can run `spark-submit` or not
```
./bin/spark-submit --packages com.datastax.spark:spark-cassandra-connector_2.10:1.6.2,TargetHolding:pyspark-cassandra:0.3.5 --exclude-packages org.slf4j:slf4j-api --class org.apache.spark.examples.SparkPi lib/spark-examples-1.6.2-hadoop2.6.0.jar
```
3. Test whether submitted packages can be import or not
```
%pyspark
import pyspark_cassandra
```
### Screenshots (if appropriate)
```
import pyspark_cassandra
Traceback (most recent call last):
File "/var/folders/lr/8g9y625n5j39rz6qhkg8s6640000gn/T/zeppelin_pyspark-5266742863961917074.py", line 267, in <module>
raise Exception(traceback.format_exc())
Exception: Traceback (most recent call last):
File "/var/folders/lr/8g9y625n5j39rz6qhkg8s6640000gn/T/zeppelin_pyspark-5266742863961917074.py", line 265, in <module>
exec(code)
File "<stdin>", line 1, in <module>
ImportError: No module named pyspark_cassandra
```
### Questions:
* Does the licenses files need update? - NO
* Is there breaking changes for older versions? - NO
* Does this needs documentation? - NO
Author: 1ambda <1a...@gmail.com>
Closes #1831 from 1ambda/ZEPPELIN-1883/cant-import-submitted-packages-in-pyspark and squashes the following commits:
585d48a [1ambda] Use spark.jars instead of classpath
f76d2c8 [1ambda] fix: Do not extend PYTHONPATH in yarn-client
c735bd5 [1ambda] fix: Import spark submit packages in pyspark
(cherry picked from commit cb8e4187029fdd7b892d84f23efd51acaed65f78)
Signed-off-by: Lee moon soo <mo...@apache.org>
commit 0f98dca046d6c21756d9f30672c867073535df7d
Author: Unknown <so...@gmail.com>
Date: 2016-12-12T14:14:12Z
[MINOR] Remove unused import. Naming convention.
### What is this PR for?
Change method name (Method names should comply with a naming convention). Remove unused imports. Using append makes code simpler to read `sb.append("\nAccessTime = ").append(accessTime);` instead `sb.append("\nAccessTime = " + accessTime);`
### What type of PR is it?
[Refactoring]
### Todos
* [ ] - Task
### What is the Jira issue?
* https://issues.apache.org/jira/browse/ZEPPELIN-1839
### How should this be tested?
HDFSFileInterpreterTest.java (still working)
### Questions:
* Does the licenses files need update? (no)
* Is there breaking changes for older versions? (no)
* Does this needs documentation? (no)
Remove this unused import, naming convention
Author: Unknown <So...@gmail.com>
Closes #1747 from bitchelov/hdfsFileInterpreterSmallChanges and squashes the following commits:
6d27bb8 [Unknown] Minor changes
(cherry picked from commit 69bc353d3c047ad8ad29584ce9e3b6c84d7ace7e)
Signed-off-by: Jongyoul Lee <jo...@apache.org>
commit 054e0846dc558a48653c71d71438fe952775a82b
Author: Jeff Zhang <zj...@apache.org>
Date: 2017-01-13T03:30:13Z
ZEPPELIN-1293. Livy Interpreter: Automatically attach or create to a new session
### What is this PR for?
By default, livy session will expire after one hour. This PR would create session automatically for user if session is expired, and would also display the session expire information in frontend. The expire message would only display at the first time of session recreation, after that the message won't be displayed.
### What type of PR is it?
[Improvement ]
### Todos
* [ ] - Task
### What is the Jira issue?
* https://issues.apache.org/jira/browse/ZEPPELIN-1293
### How should this be tested?
Tested manually.
### Screenshots (if appropriate)
### Questions:
* Does the licenses files need update? No
* Is there breaking changes for older versions? No
* Does this needs documentation? No
Author: Jeff Zhang <zj...@apache.org>
Closes #1861 from zjffdu/ZEPPELIN-1293 and squashes the following commits:
e174593 [Jeff Zhang] minor update on warning message
30c3569 [Jeff Zhang] address comments
88f0d9a [Jeff Zhang] ZEPPELIN-1293. Livy Interpreter: Automatically attach or create to a new session
commit 8dc4721eaec0684ef3df6c25a8668badb4ed2ab5
Author: Lee moon soo <mo...@apache.org>
Date: 2017-01-12T18:58:06Z
[ZEPPELIN-1619] Load js package as a plugin visualization
### What is this PR for?
Current helium plugin application api (experimental) requires create library in java class, and need to create both backend / frontend code in the package. Which is good if your plugin requires both frontend and backend code running.
However, when user just want to make new visualization which completely runs on front-end side in javascript, creating helium application in java project and taking care of backend code can be bit of overhead and barrier for javascript developers.
This PR adds capability to load pure javascript package as a visualization.
### how it works
1. create (copy, download) 'helium package json' file into `ZEPPELIN_HOME/helium` directory.
The json file point visualization js package in npm repository or local file system in `artifact` field.
`type` field in the json file need to be `VISUALIZATION`
Here's an example (zeppelin-examples/zeppelin-example-horizontalbar/zeppelin-example-horizontalbar.json)
```
{
"type" : "VISUALIZATION",
"name" : "zeppelin_horizontalbar",
"description" : "Horizontal Bar chart (example)",
"artifact" : "./zeppelin-examples/zeppelin-example-horizontalbar",
"icon" : "<i class='fa fa-bar-chart rotate90flipX'></i>"
}
```
2. Go to helium GUI menu. (e.g. http://localhost:8080/#/helium).
The menu will list all available packages.
<img width="796" alt="writing_visualization_helium_menu" src="https://cloud.githubusercontent.com/assets/1540981/21749660/0f401c10-d558-11e6-9961-b6d0a9c023d8.png">
3. click 'enable' in any package want to use.
Once a visualization package is enabled, `HeliumVisualizationFactory` will collect all enabled visualizations and create js bundle on the fly.
4. js bundle will be loaded on notebook and additional visualization becomes available
### Programming API to create new plugin visualization.
Simply extends [visualization.js](https://github.com/apache/zeppelin/blob/master/zeppelin-web/src/app/visualization/visualization.js) and overrides some methods, such as
```
/**
* get transformation
*/
getTransformation() {
// override this
};
/**
* Method will be invoked when data or configuration changed
*/
render(tableData) {
// override this
};
/**
* Refresh visualization.
*/
refresh() {
// override this
};
/**
* method will be invoked when visualization need to be destroyed.
* Don't need to destroy this.targetEl.
*/
destroy() {
// override this
};
/**
* return {
* template : angular template string or url (url should end with .html),
* scope : an object to bind to template scope
* }
*/
getSetting() {
// override this
};
```
This is exactly the same api that built-in visualization uses.
an example implementation included `zeppelin-examples/zeppelin-example-horizontalbar/horizontalbar.js`.
Actually [all built-in visualizations](https://github.com/apache/zeppelin/tree/master/zeppelin-web/src/app/visualization/builtins) are example
### Packaging and publishing visualization
Each visualization will need `package.json` file (e.g. `zeppelin-examples/zeppelin-example-horizontalbar/package.json`) to be packaged.
Package can be published in npm repository or package can be deployed to the local filesystem.
`zeppelin-examples/zeppelin-example-horizontalbar/` is an example package that is deployed in the local filesystem
### Development mode
First, locally install and enable your development package by setting `artifact` field to the development directory.
Then run zeppelin-web in visualization development mode with following command
```
cd zeppelin-web
npm run visdev
```
When you have change in your local development package, just reload your notebook. Then Zeppelin will automatically rebuild / reload the package.
Any feedback would be appreciated!
### What type of PR is it?
Feature
### Todos
* [x] - Load plugin visualization js package on runtime
* [x] - Make the feature works in zeppelin Binary package
* [x] - Show loading indicator while 'enable' / 'disable' package
* [x] - Add document
* [x] - Add license of new dependency
* [x] - Development mode
* [x] - Propagate error to front-end
* [x] - Display multiple versions of a package.
### What is the Jira issue?
https://issues.apache.org/jira/browse/ZEPPELIN-1619
### How should this be tested?
Build Zeppelin with `-Pexamples` flag. That'll install example visualization package `horizontalbar`.
You'll able to select `horizontalbar` along with other built-in visualizations
To test npm online package install capability, Place [zeppelin-bubble.json](https://github.com/Leemoonsoo/zeppelin-bubble/blob/master/zeppelin-bubble.json) in hour local registry (`ZEPPELIN_HOME/helium`) and enable it in Helium gui menu.
And then zeppelin will download package from npm repository and load.
### Questions:
* Does the licenses files need update? yes
* Is there breaking changes for older versions? no
* Does this needs documentation? yes
Author: Lee moon soo <mo...@apache.org>
Closes #1842 from Leemoonsoo/ZEPPELIN-1619-rebased and squashes the following commits:
7c49bbb [Lee moon soo] Let Zeppelin continue to bootstrap on offline
816bdec [Lee moon soo] Display license of package when enabling
28fb37d [Lee moon soo] beautifulize helium menu
295768e [Lee moon soo] fix drag and drop visualization reorder
bb304db [Lee moon soo] Sort version in decreasing order
e7f18f1 [Lee moon soo] fix english in docs and labels
c7b187f [Lee moon soo] Merge branch 'master' into ZEPPELIN-1619-rebased
4c87983 [Lee moon soo] Merge remote-tracking branch 'apache-github/master' into ZEPPELIN-1619-rebased
ecd925b [Lee moon soo] Merge remote-tracking branch 'apache-github/master' into ZEPPELIN-1619-rebased
a92cadd [Lee moon soo] Use minifiable syntax
cec534c [Lee moon soo] Reduce log message
f373f1d [Lee moon soo] Ignore removed package
e18d9a4 [Lee moon soo] Ability to customize order of visualization package display
cd74396 [Lee moon soo] Add rest api doc
9de5d6d [Lee moon soo] exclude .npmignore and package.json from zeppelin-web rat check
08abded [Lee moon soo] exclude package.json from rat check
661c26b [Lee moon soo] update screenshot and keep experimental tag only in docs
4515805 [Lee moon soo] Display multiple versions of a package
408c512 [Lee moon soo] Make unittest test bundling with proper vis package on npm registry
fb7a147 [Lee moon soo] display svg icon
47de6d9 [Lee moon soo] Propagate bundle error to the front-end
0fe5e00 [Lee moon soo] visualization development mode
022e8f6 [Lee moon soo] exclude zeppelin-examples/zeppelin-example-horizontalbar/package.json file from rat check
2ef3b69 [Lee moon soo] Add new dependency license
f943d33 [Lee moon soo] Add doc
f494dbd [Lee moon soo] package npm dependency module in binary package
b655fa6 [Lee moon soo] use any version of dependency in example. so zeppelin version bumpup doesn't need to take care of them
2aec52d [Lee moon soo] show loading indicator while enable/disable package
6c380f6 [Lee moon soo] refactor code to fix HeliumTest
e142336 [Lee moon soo] update unittest
7d5e0ae [Lee moon soo] Resolve dependency conflict
c50a524 [Lee moon soo] Add conf/helium.json in .gitignore
1c7b73a [Lee moon soo] add result.css
d2823ad [Lee moon soo] load visualization and tabledata module from source instead npm if accessible
4e1b061 [Lee moon soo] Convert horizontalbar to VISUALIZATION example
a5a935b [Lee moon soo] connect visualization factory with restapi
4b21252 [Lee moon soo] initial implementation of helium menu
0c4da2e [Lee moon soo] pass bundled visualization to result.controller.js
f5ce99e [Lee moon soo] import helium service js
1663582 [Lee moon soo] initial implementation of helium menu
74d52d4 [Lee moon soo] bundle visualization package from npm repository on the fly
(cherry picked from commit 300f7532342d1ea47b85d3b777a8797a3e2248d4)
Signed-off-by: Lee moon soo <mo...@apache.org>
commit 8956d682f591062cd129b93be23b3a10e91dcc83
Author: AhyoungRyu <fb...@hanmail.net>
Date: 2017-01-15T06:14:42Z
[HOTFIX][ZEPPELIN-1970] Use relative path for broken screenshot imgs
### What is this PR for?
Two screenshot imgs in [Writing a new visualization](https://zeppelin.apache.org/docs/0.7.0-SNAPSHOT/development/writingzeppelinvisualization.html) page are broken after deployed. It can be fixed by using relative path like other images. (e.g. [shiroauthentication.md](https://github.com/apache/zeppelin/blob/master/docs/security/shiroauthentication.md#4-login))
### What type of PR is it?
Hot Fix
### What is the Jira issue?
[ZEPPELIN-1970](https://issues.apache.org/jira/browse/ZEPPELIN-1970)
### How should this be tested?
It can't be reproduced using docs dev mode. Needs to be tested with below steps.
```
1) build gh-pages (website) branch
JEKYLL_ENV=production bundle exec jekyll build
cp -r _site/ /tmp/zeppelin_website/
mkdir -p /tmp/zeppelin_website/docs/0.7.0-SNAPSHOT
2) build this patch (docs) and copy it under docs/0.7.0-SNAPSHOT of website
cd docs
bundle exec jekyll build --safe
cp -r _site/ /tmp/zeppelin_website/0.7.0-SNAPSHOT/
3) start httpserver and browse http://localhost:8000/docs/0.7.0-SNAPSHOT/
cd /tmp/zeppelin_website
python -m SimpleHTTPServer
```
### Screenshots (if appropriate)
- before
<img width="809" alt="screen shot 2017-01-15 at 3 10 53 pm" src="https://cloud.githubusercontent.com/assets/10060731/21960655/a73ee658-db35-11e6-8e4d-7702adb1ab19.png">
- after
<img width="751" alt="screen shot 2017-01-15 at 3 10 13 pm" src="https://cloud.githubusercontent.com/assets/10060731/21960650/a23348a2-db35-11e6-80a4-a6bc9b9b188c.png">
### Questions:
* Does the licenses files need update? no
* Is there breaking changes for older versions? no
* Does this needs documentation? no
Author: AhyoungRyu <fb...@hanmail.net>
Closes #1901 from AhyoungRyu/ZEPPELIN-1970 and squashes the following commits:
d64e13f [AhyoungRyu] Use relative path for screenshot imgs
(cherry picked from commit f86bb858b8032408b542f15ccb8794df02224a33)
Signed-off-by: ahyoungryu <ah...@apache.org>
commit 835e9e21f7a94066313af98c44de9b793b1ba54d
Author: Jeff Zhang <zj...@apache.org>
Date: 2017-01-12T07:39:17Z
ZEPPELIN-1933. Set pig job name and allow to set pig property in pig interpreter setting
### What is this PR for?
Two improvements for pig interpreter.
* Set job name via paragraph title if it exists, otherwise use the last line of pig script
* Allow to set any pig property in interpreter setting
### What type of PR is it?
[ Improvement]
### Todos
* [ ] - Task
### What is the Jira issue?
* https://issues.apache.org/jira/browse/ZEPPELIN-1933
### How should this be tested?
Unit tested and manually tested.
### Screenshots (if appropriate)
### Questions:
* Does the licenses files need update? No
* Is there breaking changes for older versions? No
* Does this needs documentation? No
Author: Jeff Zhang <zj...@apache.org>
Closes #1885 from zjffdu/ZEPPELIN-1933 and squashes the following commits:
d2e1cd4 [Jeff Zhang] address comments
9cee380 [Jeff Zhang] ZEPPELIN-1933. Set pig job name and allow to set pig property in pig interpreter setting
(cherry picked from commit 41f9fd921d77f5112107ba76c8794213cf3af929)
Signed-off-by: Felix Cheung <fe...@apache.org>
commit a3d7316190f487ef5a5f041c2eede752b9b38df8
Author: Mina Lee <mi...@apache.org>
Date: 2017-01-13T02:39:42Z
[BUILD] Update release script
### What is this PR for?
* Change hadoop profile from `hadoop-2.4` to `hadoop-2.6`
* Use `SCALA_VERSION` variable instead of hardcoding
* Specify projects to be built for netinst package instead of excluding unnecessary projects.
### What type of PR is it?
Build
### What is the Jira issue?
### How should this be tested?
Outline the steps to test the PR here.
### Screenshots (if appropriate)
### Questions:
* Does the licenses files need update? no
* Is there breaking changes for older versions? no
* Does this needs documentation? no
Author: Mina Lee <mi...@apache.org>
Closes #1890 from minahlee/update/release_script and squashes the following commits:
a97b5fe [Mina Lee] Remove one r interpreter profile as only one will take effect
1479d26 [Mina Lee] Use scala variable instead of hardcoding Specify project to build for net-inst package instead of adding exluding projects everytime zeppelin have new interpreter
da9080a [Mina Lee] Update hadoop profile from 2.4 to 2.6
(cherry picked from commit f8c11d15f4378523922c76a892a755a60e4a187b)
Signed-off-by: Mina Lee <mi...@apache.org>
commit 20c3cbccfd0ac4e58637bd4324774b7e3ab536c9
Author: Khalid Huseynov <kh...@gmail.com>
Date: 2017-01-12T23:12:29Z
[ZEPPELIN-1961] Improve stability of sync when get fails
### What is this PR for?
This is to improve the stability of sync mechanism when `get` from some backend storage fails (e.g. corrupt file, network issues).
### What type of PR is it?
Bug Fix | Hot Fix
### Todos
* [x] - handle exception
### What is the Jira issue?
[ZEPPELIN-1961](https://issues.apache.org/jira/browse/ZEPPELIN-1961)
### How should this be tested?
CI green
### Screenshots (if appropriate)
### Questions:
* Does the licenses files need update? no
* Is there breaking changes for older versions? no
* Does this needs documentation? no
Author: Khalid Huseynov <kh...@gmail.com>
Closes #1895 from khalidhuseynov/fix-stability/sync-fail and squashes the following commits:
aa1e199 [Khalid Huseynov] catch failed get command
(cherry picked from commit e94d5c0fb66ee0954a74450002c5b81b8a7331a7)
Signed-off-by: Mina Lee <mi...@apache.org>
commit 7b123fb8e5b593c6839613f4f851e692529543a8
Author: Jun Kim <i2...@gmail.com>
Date: 2017-01-15T13:22:42Z
[DOCS] Reflect changed default storage to doc
### What is this PR for?
Reflect effects caused by changing the default notebook storage VFSNotebookRepo to GitNotebookRepo.
### What type of PR is it?
[Documentation]
### Questions:
* Does the licenses files need update? NO
* Is there breaking changes for older versions? NO
* Does this needs documentation? NO
Author: Jun Kim <i2...@gmail.com>
Closes #1903 from tae-jun/patch-3 and squashes the following commits:
60448da [Jun Kim] [DOCS] Reflect changed default storage to doc
(cherry picked from commit 982cc0d17e6482844068dbb29ad5a11325a43446)
Signed-off-by: ahyoungryu <ah...@apache.org>
commit 57f03df9e5bd5fbe5e715a78c0f7d809ea31a180
Author: victor.sheng <vi...@qiniu.com>
Date: 2017-01-12T06:54:26Z
[ZEPPELIN-1941] Fix cron job with release resource option dead lock
### What is this PR for?
There is a deadlock in concurrent cron job execution with release resource option.
`Scenario`:
Two notebook run with cron job that release resource after job finished.
In `Notebook.CronJob.execute()` method:
`T1. note.runAll(); // locked paragraphs(lock) and wait to interpreterSettings(lock)`
`T2. notebook.getInterpreterFactory().restart() //locked(interpreterSettings) and wait for paragraphs(lock) during jobAbort.`
This will trigger a deadlock that cause zeppelin hang.
### What type of PR is it?
[Bug Fix ]
### Todos
* [x] - Fix this by avoid acquire lock in job abort method.
### What is the Jira issue?
* https://issues.apache.org/jira/browse/ZEPPELIN-1941
### How should this be tested?
Outline the steps to test the PR here.
### Screenshots (if appropriate)
### Questions:
* Does the licenses files need update?
* Is there breaking changes for older versions?
* Does this needs documentation?
Author: victor.sheng <vi...@qiniu.com>
Closes #1891 from OopsOutOfMemory/fix_dead_lock_cronjob and squashes the following commits:
517fdfa [victor.sheng] fix cron job with release resource option dead lock
(cherry picked from commit 215599cb39420a3564f8fcc7ac64a8da748aa526)
Signed-off-by: Jongyoul Lee <jo...@apache.org>
commit 2a869c80edcaa8ebd2141fe97ddc0d036e66ccc8
Author: Jeff Zhang <zj...@apache.org>
Date: 2017-01-10T06:07:33Z
ZEPPELIN-1770. Restart only the client user's interpreter when restarting interpreter setting
### What is this PR for?
This PR would only restart the trigger user's interpreter rather than all the interpreter. So that restarting won't affect other users.
### What type of PR is it?
[Improvement]
### Todos
* [ ] - Task
### What is the Jira issue?
* https://issues.apache.org/jira/browse/ZEPPELIN-1770
### How should this be tested?
Tested manually.
### Screenshots (if appropriate)
### Questions:
* Does the licenses files need update? No
* Is there breaking changes for older versions? No
* Does this needs documentation? No
Author: Jeff Zhang <zj...@apache.org>
Closes #1846 from zjffdu/ZEPPELIN-1770 and squashes the following commits:
5ee076d [Jeff Zhang] fix scoped mode and add unit test
8cb28a3 [Jeff Zhang] ZEPPELIN-1770. Restart only the client user's interpreter when restarting interpreter setting
(cherry picked from commit ae1cb0527bc223b25761e1370618929e228183f8)
Signed-off-by: Jongyoul Lee <jo...@apache.org>
commit 20ebb6cc1e8246f72e74af36fa286761a79c53f4
Author: Jeff Zhang <zj...@apache.org>
Date: 2017-01-11T02:56:53Z
ZEPPELIN-1918. Fix build with Spark 2.1.0
### What is this PR for?
It's my misunderstanding of `SPARK_VER` in travis. It is only used for downloading spark distribution. We need to specify spark profile explicitly for building with specific version of spark. This PR add new profile for spark 2.1 and fix the build issue with spark 2.1.0 because `SecurityManager` changes its constructor signature in spark 2.1
### What type of PR is it?
[Bug Fix ]
### Todos
* [ ] - Task
### What is the Jira issue?
* https://issues.apache.org/jira/browse/ZEPPELIN-1918
### How should this be tested?
Build with spark 2.1.0 and tested it manually as below screenshot.
### Screenshots (if appropriate)
### Questions:
* Does the licenses files need update? No
* Is there breaking changes for older versions? No
* Does this needs documentation? No
Author: Jeff Zhang <zj...@apache.org>
Closes #1880 from zjffdu/ZEPPELIN-1918 and squashes the following commits:
8f87459 [Jeff Zhang] update release script
34772e0 [Jeff Zhang] update build doc for spark 2.1
5efdb11 [Jeff Zhang] fix unit test and address comments
def502f [Jeff Zhang] ZEPPELIN-1918. Fix build with Spark 2.1.0
(cherry picked from commit 9bc4dce9884ec4011f677560f708286968549374)
Signed-off-by: Felix Cheung <fe...@apache.org>
commit 98f55c099b4baa814ec4cf7d680b8cbd7e667f1f
Author: Lee moon soo <mo...@apache.org>
Date: 2017-01-16T15:40:44Z
[ZEPPELIN-1969] Can not change visualization package version.
### What is this PR for?
Changing visualization package version from helium menu, sometimes fail.
This PR fixes the problem and providing a unittest.
### What type of PR is it?
Bug Fix
### Todos
* [x] - remove package from node_module and let npm download again before bundle the package.
* [x] - add unittest.
### What is the Jira issue?
https://issues.apache.org/jira/browse/ZEPPELIN-1969
### How should this be tested?
Unittest HeliumVisualizationFactoryTest.switchVersion() ensure the fix.
### Questions:
* Does the licenses files need update? no
* Is there breaking changes for older versions? no
* Does this needs documentation? no
Author: Lee moon soo <mo...@apache.org>
Closes #1900 from Leemoonsoo/fix_helium_version_switch and squashes the following commits:
540497f [Lee moon soo] fix style
e9f2811 [Lee moon soo] Make download package everytime bundle to workaround inconsistent behavior of npm install
(cherry picked from commit d61cd99dbb5c63078b3e20e94183355e2c401d5f)
Signed-off-by: Lee moon soo <mo...@apache.org>
commit a2d6a8cf05104443b7a30c84fd4d71838136caaf
Author: Renjith Kamath <re...@gmail.com>
Date: 2017-01-11T17:13:32Z
ZEPPELIN-1935 Add jceks stored password support for jdbc interpreter
### What is this PR for?
Add support for jceks stored password instead of using password in clear text. This security enhancement prevents any user from reading clear passwords from interpreter json using shell/py/spark etc. #1315 is the parent PR which fixed similar a issue in Active Directory (shiro.ini config).
### What type of PR is it?
Improvement
### Todos
### What is the Jira issue?
ZEPPELIN-1935
### How should this be tested?
Create a keystore file using the hadoop credential commandline, for this the hadoop commons should be in the classpath.
`hadoop credential create jdbc.password -provider jceks://file/user/zeppelin/conf/zeppelin.jceks`
Use the jceks file and the key to configure jdbc interpreter. Example interpreter setting:
#### Following are the supported settings for backward compatibility
- Settings with username and jceks
```
default.driver org.postgresql.Driver
default.jceks.credentialKey jdbc.password
default.jceks.file jceks://file/tmp/zeppelin.jceks
default.url jdbc:postgresql://rkamath-local-1:5432/
default.user rk-user
```
- Settings with user name and clear text password
```
default.driver org.postgresql.Driver
default.url jdbc:postgresql://rkamath-local-1:5432/
default.user rk-user
default.password password1
```
### Screenshots (if appropriate)
<img width="1392" alt="screen shot 2017-01-10 at 7 02 12 pm" src="https://cloud.githubusercontent.com/assets/2031306/21808016/5e602982-d767-11e6-88f9-3d15b9a7f0b8.png">
### Questions:
* Does the licenses files need update? no
* Is there breaking changes for older versions? no
* Does this needs documentation? yes
Author: Renjith Kamath <re...@gmail.com>
Closes #1881 from r-kamath/ZEPPELIN-1935 and squashes the following commits:
5cc4db1 [Renjith Kamath] ZEPPELIN-1935 revert wildcard imports
dfabe3a [Renjith Kamath] Merge branch 'master' of https://github.com/apache/zeppelin into ZEPPELIN-1935
e62088a [Renjith Kamath] ZEPPELIN-1935 fix log message
d41d56c [Renjith Kamath] ZEPPELIN-1935 Add jceks stored password support for jdbc interpreter
(cherry picked from commit 04d34547a1453e16ea4cb306cfcfa0d79f22acfe)
Signed-off-by: Prabhjyot Singh <pr...@gmail.com>
commit f7edda1c4633329ed522dea088a12edb00013386
Author: Jeff Zhang <zj...@apache.org>
Date: 2017-01-16T01:01:54Z
ZEPPELIN-1432. Support cancellation of paragraph execution
### What is this PR for?
Livy 0.3 support cancel operation, this PR is to support cancel in livy interpreter. First we would check the livy version, then based on the livy version, we would call the livy rest api to cancel the statement.
### What type of PR is it?
Improvement | Feature ]
### Todos
* [ ] - Task
### What is the Jira issue?
* https://issues.apache.org/jira/browse/ZEPPELIN-1432
### How should this be tested?
Tested manually, because cancel is only avaible in livy 0.3 which is not released yet.
### Screenshots (if appropriate)
### Questions:
* Does the licenses files need update? No
* Is there breaking changes for older versions? No
* Does this needs documentation? No
Author: Jeff Zhang <zj...@apache.org>
Closes #1859 from zjffdu/ZEPPELIN-1432 and squashes the following commits:
83eaf83 [Jeff Zhang] minor update
200ca71 [Jeff Zhang] address comments
1cbeb26 [Jeff Zhang] add zeppelin.livy.pull_status.interval.millis
070fea0 [Jeff Zhang] ZEPPELIN-1432. Support cancellation of paragraph execution
(cherry picked from commit 2fcfaa8c74cad5adf9adcdf76987e4ffbe5983c7)
Signed-off-by: Felix Cheung <fe...@apache.org>
commit 2dc5c8806c76136af5de7cba032f629118e73208
Author: AhyoungRyu <fb...@hanmail.net>
Date: 2017-01-16T13:30:21Z
[Hot Fix] Fix deadlink in writingzeppelinvisualization.md
### What is this PR for?
It should point [HeliumVisualizationFactory.java](https://github.com/apache/zeppelin/blob/master/zeppelin-zengine/src/main/java/org/apache/zeppelin/helium/HeliumVisualizationFactory.java) not [HeliumVisualizationPackage.java](https://github.com/apache/zeppelin/blob/master/zeppelin-zengine/src/main/java/org/apache/zeppelin/helium/HeliumVisualizationPackage.java)
### What type of PR is it?
Documentation | HotFix
### What is the Jira issue?
N/A
### How should this be tested?
click `HeliumVisualizationFactory` link in [this section](https://zeppelin.apache.org/docs/0.7.0-SNAPSHOT/development/writingzeppelinvisualization.html#3-create-and-load-visualization-bundle-on-the-fly) :)
### Questions:
* Does the licenses files need update? no
* Is there breaking changes for older versions? no
* Does this needs documentation? no
Author: AhyoungRyu <fb...@hanmail.net>
Closes #1904 from AhyoungRyu/fix/deadlink and squashes the following commits:
60ac6c9 [AhyoungRyu] Fix deadlink in writingzeppelinvisualization.md
(cherry picked from commit 425abe302374522278e7e76d4c78b71ce5dcdd9d)
Signed-off-by: ahyoungryu <ah...@apache.org>
commit 350cf9c294114cd40ceef00c570d8f53caeea922
Author: Khalid Huseynov <kh...@gmail.com>
Date: 2017-01-13T05:32:02Z
[ZEPPELIN-1963] set cron job executor to current user by default
### What is this PR for?
currently when executing cron job, backend doesn't know who initiated cron job (with subsequent save) unless user puts his name. This PR adds user name by default by keeping compatibility with current workflow.
### What type of PR is it?
Improvement
### Todos
* [x] - add user on front
### What is the Jira issue?
[ZEPPELIN-1963](https://issues.apache.org/jira/browse/ZEPPELIN-1963)
### How should this be tested?
go and set cron job
### Screenshots (if appropriate)
### Questions:
* Does the licenses files need update? no
* Is there breaking changes for older versions? no
* Does this needs documentation? no
Author: Khalid Huseynov <kh...@gmail.com>
Closes #1898 from khalidhuseynov/cron-user and squashes the following commits:
30dc440 [Khalid Huseynov] add logged cron executing user
(cherry picked from commit 8daf32563960b16db739e30c8dcd91d60f854917)
Signed-off-by: Mina Lee <mi...@apache.org>
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] zeppelin issue #1989: [ZEPPELIN-2073]Replace AngularObjectRegistry by Resour...
Posted by 1ambda <gi...@git.apache.org>.
Github user 1ambda commented on the issue:
https://github.com/apache/zeppelin/pull/1989
Hi @qinchaofeng. I think you pushed different branch. Could you check again?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] zeppelin pull request #1989: [ZEPPELIN-2073]Replace AngularObjectRegistry by...
Posted by qinchaofeng <gi...@git.apache.org>.
Github user qinchaofeng closed the pull request at:
https://github.com/apache/zeppelin/pull/1989
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---