You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@zeppelin.apache.org by linxi zeng <li...@gmail.com> on 2015/08/20 02:22:15 UTC
Stop RemoteInterpreterServer automatically when no paragraph run in a
Specified time
Hi Moon,
When i use zeppelin to run some spark or sql programs, it will start
a RemoteInterpreterServer after the first time I run the paragraph, and
the RemoteInterpreterServer will never stop unless we stop the process or
the zeppelin server.
The problem is that the RemoteInterpreterServer will hold the resource
of yarn (we run zeppelin paragraph on yarn) even it did't run any paragraph
after a long time, which is a waste of resources.
My suggestion is that, we can stop RemoteInterpreterServer
automatically when no paragraph run in a Specified time (for example
3600s). Is this suggestion OK for you?
Thanks,
linxizeng
Re: Stop RemoteInterpreterServer automatically when no paragraph run
in a Specified time
Posted by moon soo Lee <mo...@apache.org>.
Hi Bae,
Timeout is not available now. You can watch this issue
https://issues.apache.org/jira/browse/ZEPPELIN-242
to keep track of progress.
Thanks,
moon
On Wed, Aug 19, 2015 at 9:41 PM Bae, Jae Hyeon <me...@gmail.com> wrote:
> Hi Moon
>
> How can I configure timeout value?
>
> On Wed, Aug 19, 2015 at 7:04 PM, moon soo Lee <mo...@apache.org> wrote:
>
>> Hi linxizeng,
>>
>> While timeout is configurable and the default value is infinite (does not
>> change default behavior), your suggestion sounds good!
>>
>> Thanks!
>> moon
>>
>>
>>
>> On Wed, Aug 19, 2015 at 5:22 PM linxi zeng <li...@gmail.com>
>> wrote:
>>
>>> Hi Moon,
>>> When i use zeppelin to run some spark or sql programs, it will start
>>> a RemoteInterpreterServer after the first time I run the paragraph, and
>>> the RemoteInterpreterServer will never stop unless we stop the process or
>>> the zeppelin server.
>>> The problem is that the RemoteInterpreterServer will hold the resource
>>> of yarn (we run zeppelin paragraph on yarn) even it did't run any
>>> paragraph
>>> after a long time, which is a waste of resources.
>>> My suggestion is that, we can stop RemoteInterpreterServer
>>> automatically when no paragraph run in a Specified time (for example
>>> 3600s). Is this suggestion OK for you?
>>>
>>> Thanks,
>>> linxizeng
>>>
>>
>
Re: Stop RemoteInterpreterServer automatically when no paragraph run
in a Specified time
Posted by moon soo Lee <mo...@apache.org>.
Hi Bae,
Timeout is not available now. You can watch this issue
https://issues.apache.org/jira/browse/ZEPPELIN-242
to keep track of progress.
Thanks,
moon
On Wed, Aug 19, 2015 at 9:41 PM Bae, Jae Hyeon <me...@gmail.com> wrote:
> Hi Moon
>
> How can I configure timeout value?
>
> On Wed, Aug 19, 2015 at 7:04 PM, moon soo Lee <mo...@apache.org> wrote:
>
>> Hi linxizeng,
>>
>> While timeout is configurable and the default value is infinite (does not
>> change default behavior), your suggestion sounds good!
>>
>> Thanks!
>> moon
>>
>>
>>
>> On Wed, Aug 19, 2015 at 5:22 PM linxi zeng <li...@gmail.com>
>> wrote:
>>
>>> Hi Moon,
>>> When i use zeppelin to run some spark or sql programs, it will start
>>> a RemoteInterpreterServer after the first time I run the paragraph, and
>>> the RemoteInterpreterServer will never stop unless we stop the process or
>>> the zeppelin server.
>>> The problem is that the RemoteInterpreterServer will hold the resource
>>> of yarn (we run zeppelin paragraph on yarn) even it did't run any
>>> paragraph
>>> after a long time, which is a waste of resources.
>>> My suggestion is that, we can stop RemoteInterpreterServer
>>> automatically when no paragraph run in a Specified time (for example
>>> 3600s). Is this suggestion OK for you?
>>>
>>> Thanks,
>>> linxizeng
>>>
>>
>
Re: Stop RemoteInterpreterServer automatically when no paragraph run
in a Specified time
Posted by "Bae, Jae Hyeon" <me...@gmail.com>.
Hi Moon
How can I configure timeout value?
On Wed, Aug 19, 2015 at 7:04 PM, moon soo Lee <mo...@apache.org> wrote:
> Hi linxizeng,
>
> While timeout is configurable and the default value is infinite (does not
> change default behavior), your suggestion sounds good!
>
> Thanks!
> moon
>
>
>
> On Wed, Aug 19, 2015 at 5:22 PM linxi zeng <li...@gmail.com>
> wrote:
>
>> Hi Moon,
>> When i use zeppelin to run some spark or sql programs, it will start
>> a RemoteInterpreterServer after the first time I run the paragraph, and
>> the RemoteInterpreterServer will never stop unless we stop the process or
>> the zeppelin server.
>> The problem is that the RemoteInterpreterServer will hold the resource
>> of yarn (we run zeppelin paragraph on yarn) even it did't run any
>> paragraph
>> after a long time, which is a waste of resources.
>> My suggestion is that, we can stop RemoteInterpreterServer
>> automatically when no paragraph run in a Specified time (for example
>> 3600s). Is this suggestion OK for you?
>>
>> Thanks,
>> linxizeng
>>
>
Re: Stop RemoteInterpreterServer automatically when no paragraph run
in a Specified time
Posted by "Bae, Jae Hyeon" <me...@gmail.com>.
Hi Moon
How can I configure timeout value?
On Wed, Aug 19, 2015 at 7:04 PM, moon soo Lee <mo...@apache.org> wrote:
> Hi linxizeng,
>
> While timeout is configurable and the default value is infinite (does not
> change default behavior), your suggestion sounds good!
>
> Thanks!
> moon
>
>
>
> On Wed, Aug 19, 2015 at 5:22 PM linxi zeng <li...@gmail.com>
> wrote:
>
>> Hi Moon,
>> When i use zeppelin to run some spark or sql programs, it will start
>> a RemoteInterpreterServer after the first time I run the paragraph, and
>> the RemoteInterpreterServer will never stop unless we stop the process or
>> the zeppelin server.
>> The problem is that the RemoteInterpreterServer will hold the resource
>> of yarn (we run zeppelin paragraph on yarn) even it did't run any
>> paragraph
>> after a long time, which is a waste of resources.
>> My suggestion is that, we can stop RemoteInterpreterServer
>> automatically when no paragraph run in a Specified time (for example
>> 3600s). Is this suggestion OK for you?
>>
>> Thanks,
>> linxizeng
>>
>
Re: Stop RemoteInterpreterServer automatically when no paragraph run
in a Specified time
Posted by linxi zeng <li...@gmail.com>.
hi, moon:
thanks for your answer, we are going to use zeppelin for some of
our routine work, and hope that we can do some thing for zeppelin.
we have a jira for this: https://issues.apache.org/jira/browse/ZEPPELIN-242
Thanks!
2015-08-20 10:04 GMT+08:00 moon soo Lee <mo...@apache.org>:
> Hi linxizeng,
>
> While timeout is configurable and the default value is infinite (does not
> change default behavior), your suggestion sounds good!
>
> Thanks!
> moon
>
>
>
> On Wed, Aug 19, 2015 at 5:22 PM linxi zeng <li...@gmail.com>
> wrote:
>
> > Hi Moon,
> > When i use zeppelin to run some spark or sql programs, it will start
> > a RemoteInterpreterServer after the first time I run the paragraph, and
> > the RemoteInterpreterServer will never stop unless we stop the process or
> > the zeppelin server.
> > The problem is that the RemoteInterpreterServer will hold the resource
> > of yarn (we run zeppelin paragraph on yarn) even it did't run any
> paragraph
> > after a long time, which is a waste of resources.
> > My suggestion is that, we can stop RemoteInterpreterServer
> > automatically when no paragraph run in a Specified time (for example
> > 3600s). Is this suggestion OK for you?
> >
> > Thanks,
> > linxizeng
> >
>
Re: Stop RemoteInterpreterServer automatically when no paragraph run
in a Specified time
Posted by linxi zeng <li...@gmail.com>.
hi, moon:
thanks for your answer, we are going to use zeppelin for some of
our routine work, and hope that we can do some thing for zeppelin.
we have a jira for this: https://issues.apache.org/jira/browse/ZEPPELIN-242
Thanks!
2015-08-20 10:04 GMT+08:00 moon soo Lee <mo...@apache.org>:
> Hi linxizeng,
>
> While timeout is configurable and the default value is infinite (does not
> change default behavior), your suggestion sounds good!
>
> Thanks!
> moon
>
>
>
> On Wed, Aug 19, 2015 at 5:22 PM linxi zeng <li...@gmail.com>
> wrote:
>
> > Hi Moon,
> > When i use zeppelin to run some spark or sql programs, it will start
> > a RemoteInterpreterServer after the first time I run the paragraph, and
> > the RemoteInterpreterServer will never stop unless we stop the process or
> > the zeppelin server.
> > The problem is that the RemoteInterpreterServer will hold the resource
> > of yarn (we run zeppelin paragraph on yarn) even it did't run any
> paragraph
> > after a long time, which is a waste of resources.
> > My suggestion is that, we can stop RemoteInterpreterServer
> > automatically when no paragraph run in a Specified time (for example
> > 3600s). Is this suggestion OK for you?
> >
> > Thanks,
> > linxizeng
> >
>
Re: Stop RemoteInterpreterServer automatically when no paragraph run
in a Specified time
Posted by moon soo Lee <mo...@apache.org>.
Hi linxizeng,
While timeout is configurable and the default value is infinite (does not
change default behavior), your suggestion sounds good!
Thanks!
moon
On Wed, Aug 19, 2015 at 5:22 PM linxi zeng <li...@gmail.com> wrote:
> Hi Moon,
> When i use zeppelin to run some spark or sql programs, it will start
> a RemoteInterpreterServer after the first time I run the paragraph, and
> the RemoteInterpreterServer will never stop unless we stop the process or
> the zeppelin server.
> The problem is that the RemoteInterpreterServer will hold the resource
> of yarn (we run zeppelin paragraph on yarn) even it did't run any paragraph
> after a long time, which is a waste of resources.
> My suggestion is that, we can stop RemoteInterpreterServer
> automatically when no paragraph run in a Specified time (for example
> 3600s). Is this suggestion OK for you?
>
> Thanks,
> linxizeng
>
Re: Stop RemoteInterpreterServer automatically when no paragraph run
in a Specified time
Posted by moon soo Lee <mo...@apache.org>.
Hi linxizeng,
While timeout is configurable and the default value is infinite (does not
change default behavior), your suggestion sounds good!
Thanks!
moon
On Wed, Aug 19, 2015 at 5:22 PM linxi zeng <li...@gmail.com> wrote:
> Hi Moon,
> When i use zeppelin to run some spark or sql programs, it will start
> a RemoteInterpreterServer after the first time I run the paragraph, and
> the RemoteInterpreterServer will never stop unless we stop the process or
> the zeppelin server.
> The problem is that the RemoteInterpreterServer will hold the resource
> of yarn (we run zeppelin paragraph on yarn) even it did't run any paragraph
> after a long time, which is a waste of resources.
> My suggestion is that, we can stop RemoteInterpreterServer
> automatically when no paragraph run in a Specified time (for example
> 3600s). Is this suggestion OK for you?
>
> Thanks,
> linxizeng
>