You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@zeppelin.apache.org by Ruslan Dautkhanov <da...@gmail.com> on 2017/04/06 16:49:13 UTC
multiple instances of the same interpreter type
A user managed somehow to launch multiple instances of spark interpreter
under the same Zeppelin server.
See a snippet of `pstree` output:
|-java,6360,wabramov -Dfile.encoding=UTF-8 -Xms1024m -Xmx2048m
-XX:MaxPermSize=512m-Dlog4j.configuration=file:///home/wabramov/
| |-interpreter.sh,4510 /opt/zeppelin/zeppelin-active/bin/interpreter.sh
-d /opt/zeppelin/zeppelin-active/interpreter/spark -p 45986 -l/opt/zeppe
| | `-interpreter.sh,4523
/opt/zeppelin/zeppelin-active/bin/interpreter.sh -d
/opt/zeppelin/zeppelin-active/interpreter/spark -p 45986 -l/opt/zeppe
| | `-java,4524
-cp/etc/hive/conf/:/opt/zeppelin/zeppelin-active/interpreter/spark/*:/opt/zeppelin/zeppelin-active/zeppeli
| |-interpreter.sh,5097 /opt/zeppelin/zeppelin-active/bin/interpreter.sh
-d /opt/zeppelin/zeppelin-active/interpreter/spark -p 39752 -l/opt/zeppe
| | `-interpreter.sh,5110
/opt/zeppelin/zeppelin-active/bin/interpreter.sh -d
/opt/zeppelin/zeppelin-active/interpreter/spark -p 39752 -l/opt/zeppe
| | `-java,5111
-cp/etc/hive/conf/:/opt/zeppelin/zeppelin-active/interpreter/spark/*:/opt/zeppelin/zeppelin-active/zeppeli
I see another user has three (3) instances running of %sh interpreter.
Is this a known issue?
--
Ruslan Dautkhanov
Re: multiple instances of the same interpreter type
Posted by Rick Moritz <ra...@gmail.com>.
Which version of Zeppelin are you running?
There was a bug, where killing Zeppelin wouldn't actually kill the
interpreters, because the kill signal wasn't passed through, but that was
fixed in 0.7.1: https://issues.apache.org/jira/browse/ZEPPELIN-2258
On Fri, Apr 7, 2017 at 5:31 PM, Ruslan Dautkhanov <da...@gmail.com>
wrote:
> We have each user running their own Zeppelin instances,
> so everyone has Spark interpreter group defined as
>
> "option": {
> ..
> "perNote": "shared",
> "perUser": "shared",
> ..
> }
>
> which translates to "interpreter will be instantiated
> Globally in shared
> process."
>
>
>
> --
> Ruslan Dautkhanov
>
> On Thu, Apr 6, 2017 at 6:34 PM, Jeff Zhang <zj...@gmail.com> wrote:
>
>>
>> What mode do you use ?
>>
>>
>>
>> Ruslan Dautkhanov <da...@gmail.com>于2017年4月7日周五 上午12:49写道：
>>
>>> A user managed somehow to launch multiple instances of spark interpreter
>>> under the same Zeppelin server.
>>>
>>> See a snippet of `pstree` output:
>>>
>>> |-java,6360,wabramov -Dfile.encoding=UTF-8 -Xms1024m -Xmx2048m
>>> -XX:MaxPermSize=512m-Dlog4j.configuration=file:///home/wabramov/
>>> | |-interpreter.sh,4510 /opt/zeppelin/zeppelin-active/bin/interpreter.sh
>>> -d /opt/zeppelin/zeppelin-active/interpreter/spark -p 45986 -l/opt/zeppe
>>> | | `-interpreter.sh,4523 /opt/zeppelin/zeppelin-active/bin/interpreter.sh
>>> -d /opt/zeppelin/zeppelin-active/interpreter/spark -p 45986 -l/opt/zeppe
>>> | | `-java,4524 -cp/etc/hive/conf/:/opt/zeppel
>>> in/zeppelin-active/interpreter/spark/*:/opt/zeppelin/
>>> zeppelin-active/zeppeli
>>> | |-interpreter.sh,5097 /opt/zeppelin/zeppelin-active/bin/interpreter.sh
>>> -d /opt/zeppelin/zeppelin-active/interpreter/spark -p 39752 -l/opt/zeppe
>>> | | `-interpreter.sh,5110 /opt/zeppelin/zeppelin-active/bin/interpreter.sh
>>> -d /opt/zeppelin/zeppelin-active/interpreter/spark -p 39752 -l/opt/zeppe
>>> | | `-java,5111 -cp/etc/hive/conf/:/opt/zeppel
>>> in/zeppelin-active/interpreter/spark/*:/opt/zeppelin/
>>> zeppelin-active/zeppeli
>>>
>>>
>>> I see another user has three (3) instances running of %sh interpreter.
>>>
>>> Is this a known issue?
>>>
>>>
>>> --
>>> Ruslan Dautkhanov
>>>
>>
>
Re: multiple instances of the same interpreter type
Posted by Ruslan Dautkhanov <da...@gmail.com>.
We have each user running their own Zeppelin instances,
so everyone has Spark interpreter group defined as
"option": {
..
"perNote": "shared",
"perUser": "shared",
..
}
which translates to "interpreter will be instantiated
Globally in shared
process."
--
Ruslan Dautkhanov
On Thu, Apr 6, 2017 at 6:34 PM, Jeff Zhang <zj...@gmail.com> wrote:
>
> What mode do you use ?
>
>
>
> Ruslan Dautkhanov <da...@gmail.com>于2017年4月7日周五 上午12:49写道：
>
>> A user managed somehow to launch multiple instances of spark interpreter
>> under the same Zeppelin server.
>>
>> See a snippet of `pstree` output:
>>
>> |-java,6360,wabramov -Dfile.encoding=UTF-8 -Xms1024m -Xmx2048m
>> -XX:MaxPermSize=512m-Dlog4j.configuration=file:///home/wabramov/
>> | |-interpreter.sh,4510 /opt/zeppelin/zeppelin-active/bin/interpreter.sh
>> -d /opt/zeppelin/zeppelin-active/interpreter/spark -p 45986 -l/opt/zeppe
>> | | `-interpreter.sh,4523 /opt/zeppelin/zeppelin-active/bin/interpreter.sh
>> -d /opt/zeppelin/zeppelin-active/interpreter/spark -p 45986 -l/opt/zeppe
>> | | `-java,4524 -cp/etc/hive/conf/:/opt/
>> zeppelin/zeppelin-active/interpreter/spark/*:/opt/
>> zeppelin/zeppelin-active/zeppeli
>> | |-interpreter.sh,5097 /opt/zeppelin/zeppelin-active/bin/interpreter.sh
>> -d /opt/zeppelin/zeppelin-active/interpreter/spark -p 39752 -l/opt/zeppe
>> | | `-interpreter.sh,5110 /opt/zeppelin/zeppelin-active/bin/interpreter.sh
>> -d /opt/zeppelin/zeppelin-active/interpreter/spark -p 39752 -l/opt/zeppe
>> | | `-java,5111 -cp/etc/hive/conf/:/opt/
>> zeppelin/zeppelin-active/interpreter/spark/*:/opt/
>> zeppelin/zeppelin-active/zeppeli
>>
>>
>> I see another user has three (3) instances running of %sh interpreter.
>>
>> Is this a known issue?
>>
>>
>> --
>> Ruslan Dautkhanov
>>
>
Re: multiple instances of the same interpreter type
Posted by Jeff Zhang <zj...@gmail.com>.
What mode do you use ?
Ruslan Dautkhanov <da...@gmail.com>于2017年4月7日周五 上午12:49写道：
> A user managed somehow to launch multiple instances of spark interpreter
> under the same Zeppelin server.
>
> See a snippet of `pstree` output:
>
> |-java,6360,wabramov -Dfile.encoding=UTF-8 -Xms1024m -Xmx2048m
> -XX:MaxPermSize=512m-Dlog4j.configuration=file:///home/wabramov/
> | |-interpreter.sh,4510 /opt/zeppelin/zeppelin-active/bin/interpreter.sh
> -d /opt/zeppelin/zeppelin-active/interpreter/spark -p 45986 -l/opt/zeppe
> | | `-interpreter.sh,4523
> /opt/zeppelin/zeppelin-active/bin/interpreter.sh -d
> /opt/zeppelin/zeppelin-active/interpreter/spark -p 45986 -l/opt/zeppe
> | | `-java,4524
> -cp/etc/hive/conf/:/opt/zeppelin/zeppelin-active/interpreter/spark/*:/opt/zeppelin/zeppelin-active/zeppeli
> | |-interpreter.sh,5097 /opt/zeppelin/zeppelin-active/bin/interpreter.sh
> -d /opt/zeppelin/zeppelin-active/interpreter/spark -p 39752 -l/opt/zeppe
> | | `-interpreter.sh,5110
> /opt/zeppelin/zeppelin-active/bin/interpreter.sh -d
> /opt/zeppelin/zeppelin-active/interpreter/spark -p 39752 -l/opt/zeppe
> | | `-java,5111
> -cp/etc/hive/conf/:/opt/zeppelin/zeppelin-active/interpreter/spark/*:/opt/zeppelin/zeppelin-active/zeppeli
>
>
> I see another user has three (3) instances running of %sh interpreter.
>
> Is this a known issue?
>
>
> --
> Ruslan Dautkhanov
>