You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@zeppelin.apache.org by Serega Sheypak <se...@gmail.com> on 2017/11/15 21:41:15 UTC

How does user user jar conflict resolved in spark interpreter?

Hi zeppelin users!
I have the question about dependencies users are using while running
notebooks using spark interpreter.

Imagine I have configured spark intepreter.

Two users write their spark notebooks.
the first user does

z.load("com:best-it-company:0.1")


the second one user adds to his notebook:

z.load("com:best-it-company:0.2")

Then they start to execute two notebooks concurrently.
What will happen to dependencies?
They have same classes... will spark isolate 0.1 version from 0.2 version
somehow?

Re: How does user user jar conflict resolved in spark interpreter?

Posted by Jeff Zhang <zj...@gmail.com>.
You can try mode isolated per user which would create one jvm for each
user.
Check this link for details.
https://zeppelin.apache.org/docs/0.8.0-SNAPSHOT/usage/interpreter/interpreter_binding_mode.html



Serega Sheypak <se...@gmail.com>于2017年11月16日周四 上午5:42写道:

> Hi zeppelin users!
> I have the question about dependencies users are using while running
> notebooks using spark interpreter.
>
> Imagine I have configured spark intepreter.
>
> Two users write their spark notebooks.
> the first user does
>
> z.load("com:best-it-company:0.1")
>
>
> the second one user adds to his notebook:
>
> z.load("com:best-it-company:0.2")
>
> Then they start to execute two notebooks concurrently.
> What will happen to dependencies?
> They have same classes... will spark isolate 0.1 version from 0.2 version
> somehow?
>