You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@zeppelin.apache.org by Ruslan Dautkhanov <da...@gmail.com> on 2018/02/14 17:54:09 UTC
ipython/grpc issues
I've seen several cases when new ipython interpreter isn't possible to stop
using "Cancel"
button.
Interpreter logs shows following errors.
Then paragraph stops accepting Cancel commands and it shows that status as
"running" when it's actually not.
Python 2.7.13.
Zeppelin from a few days old master snapshot.
$ pip freeze | egrep "ipython|grpc|jupyter"
grpcio==1.9.1
ipython==5.1.0
ipython-genutils==0.2.0
jupyter==1.0.0
jupyter-client==5.2.2
jupyter-console==5.0.0
jupyter-core==4.4.0
[1]
>
> ERROR [2018-02-14 10:39:10,922] ({grpc-default-executor-3}
> IPythonClient.java[onError]:138) - Fail to call IPython grpc
> io.grpc.StatusRuntimeException: RESOURCE_EXHAUSTED:
> io.grpc.netty.NettyClientTransport$3: Frame size 216695976 exceeds maximum:
> 4194304.
> at io.grpc.Status.asRuntimeException(Status.java:543)
> at
> io.grpc.stub.ClientCalls$StreamObserverToCallListenerAdapter.onClose(ClientCalls.java:395)
> at
> io.grpc.internal.ClientCallImpl.closeObserver(ClientCallImpl.java:426)
> at
> io.grpc.internal.ClientCallImpl.access$100(ClientCallImpl.java:76)
> at
> io.grpc.internal.ClientCallImpl$ClientStreamListenerImpl.close(ClientCallImpl.java:512)
> at
> io.grpc.internal.ClientCallImpl$ClientStreamListenerImpl.access$700(ClientCallImpl.java:429)
> at
> io.grpc.internal.ClientCallImpl$ClientStreamListenerImpl$1StreamClosed.runInContext(ClientCallImpl.java:544)
> at io.grpc.internal.ContextRunnable.run(ContextRunnable.java:52)
> at
> io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:117)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
> at java.lang.Thread.run(Thread.java:748)
and
> INFO [2018-02-14 10:39:10,923] ({grpc-default-worker-ELG-1-2}
> AbstractClientStream2.java[inboundDataReceived]:249) - Received data on
> closed stream
> INFO [2018-02-14 10:39:10,924] ({grpc-default-worker-ELG-1-2} AbstractClientStream2.java[inboundDataReceived]:249)
> - Received data on closed stream
> INFO [2018-02-14 10:39:10,925] ({grpc-default-worker-ELG-1-2}
> AbstractClientStream2.java[inboundDataReceived]:249) - Received data on
> closed stream
--
Ruslan Dautkhanov
Re: ipython/grpc issues
Posted by Jeff Zhang <zj...@gmail.com>.
BTW, you need to set zeppelin.ipython.grpc.framesize to a large number
Ruslan Dautkhanov <da...@gmail.com>于2018年2月15日周四 下午1:16写道：
> Thanks a lot for prompt response Jeff. I will give this a try soon.
>
>
>
>
> --
> Ruslan Dautkhanov
>
> On Wed, Feb 14, 2018 at 7:31 PM, Jeff Zhang <zj...@gmail.com> wrote:
>
>>
>> Sorry , miss PR link https://github.com/apache/zeppelin/pull/2802
>>
>>
>> Jeff Zhang <zj...@gmail.com>于2018年2月15日周四 上午10:30写道：
>>
>>>
>>> HI Ruslan,
>>>
>>> Could you help try this PR ?
>>>
>>>
>>> Ruslan Dautkhanov <da...@gmail.com>于2018年2月15日周四 上午1:54写道：
>>>
>>>> I've seen several cases when new ipython interpreter isn't possible to
>>>> stop using "Cancel"
>>>> button.
>>>>
>>>> Interpreter logs shows following errors.
>>>>
>>>> Then paragraph stops accepting Cancel commands and it shows that status
>>>> as "running" when it's actually not.
>>>>
>>>> Python 2.7.13.
>>>> Zeppelin from a few days old master snapshot.
>>>>
>>>> $ pip freeze | egrep "ipython|grpc|jupyter"
>>>> grpcio==1.9.1
>>>> ipython==5.1.0
>>>> ipython-genutils==0.2.0
>>>> jupyter==1.0.0
>>>> jupyter-client==5.2.2
>>>> jupyter-console==5.0.0
>>>> jupyter-core==4.4.0
>>>>
>>>>
>>>>
>>>> [1]
>>>>
>>>>>
>>>>> ERROR [2018-02-14 10:39:10,922] ({grpc-default-executor-3}
>>>>> IPythonClient.java[onError]:138) - Fail to call IPython grpc
>>>>> io.grpc.StatusRuntimeException: RESOURCE_EXHAUSTED:
>>>>> io.grpc.netty.NettyClientTransport$3: Frame size 216695976 exceeds maximum:
>>>>> 4194304.
>>>>> at io.grpc.Status.asRuntimeException(Status.java:543)
>>>>> at
>>>>> io.grpc.stub.ClientCalls$StreamObserverToCallListenerAdapter.onClose(ClientCalls.java:395)
>>>>> at
>>>>> io.grpc.internal.ClientCallImpl.closeObserver(ClientCallImpl.java:426)
>>>>> at
>>>>> io.grpc.internal.ClientCallImpl.access$100(ClientCallImpl.java:76)
>>>>> at
>>>>> io.grpc.internal.ClientCallImpl$ClientStreamListenerImpl.close(ClientCallImpl.java:512)
>>>>> at
>>>>> io.grpc.internal.ClientCallImpl$ClientStreamListenerImpl.access$700(ClientCallImpl.java:429)
>>>>> at
>>>>> io.grpc.internal.ClientCallImpl$ClientStreamListenerImpl$1StreamClosed.runInContext(ClientCallImpl.java:544)
>>>>> at
>>>>> io.grpc.internal.ContextRunnable.run(ContextRunnable.java:52)
>>>>> at
>>>>> io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:117)
>>>>> at
>>>>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
>>>>> at
>>>>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
>>>>> at java.lang.Thread.run(Thread.java:748)
>>>>
>>>>
>>>> and
>>>>
>>>>> INFO [2018-02-14 10:39:10,923] ({grpc-default-worker-ELG-1-2}
>>>>> AbstractClientStream2.java[inboundDataReceived]:249) - Received data
>>>>> on closed stream
>>>>> INFO [2018-02-14 10:39:10,924] ({grpc-default-worker-ELG-1-2} AbstractClientStream2.java[inboundDataReceived]:249)
>>>>> - Received data on closed stream
>>>>> INFO [2018-02-14 10:39:10,925] ({grpc-default-worker-ELG-1-2}
>>>>> AbstractClientStream2.java[inboundDataReceived]:249) - Received data on
>>>>> closed stream
>>>>
>>>>
>>>>
>>>>
>>>>
>>>>
>>>>
>>>> --
>>>> Ruslan Dautkhanov
>>>>
>>>
>
Re: ipython/grpc issues
Posted by Ruslan Dautkhanov <da...@gmail.com>.
Thanks a lot for prompt response Jeff. I will give this a try soon.
--
Ruslan Dautkhanov
On Wed, Feb 14, 2018 at 7:31 PM, Jeff Zhang <zj...@gmail.com> wrote:
>
> Sorry , miss PR link https://github.com/apache/zeppelin/pull/2802
>
>
> Jeff Zhang <zj...@gmail.com>于2018年2月15日周四 上午10:30写道：
>
>>
>> HI Ruslan,
>>
>> Could you help try this PR ?
>>
>>
>> Ruslan Dautkhanov <da...@gmail.com>于2018年2月15日周四 上午1:54写道：
>>
>>> I've seen several cases when new ipython interpreter isn't possible to
>>> stop using "Cancel"
>>> button.
>>>
>>> Interpreter logs shows following errors.
>>>
>>> Then paragraph stops accepting Cancel commands and it shows that status
>>> as "running" when it's actually not.
>>>
>>> Python 2.7.13.
>>> Zeppelin from a few days old master snapshot.
>>>
>>> $ pip freeze | egrep "ipython|grpc|jupyter"
>>> grpcio==1.9.1
>>> ipython==5.1.0
>>> ipython-genutils==0.2.0
>>> jupyter==1.0.0
>>> jupyter-client==5.2.2
>>> jupyter-console==5.0.0
>>> jupyter-core==4.4.0
>>>
>>>
>>>
>>> [1]
>>>
>>>>
>>>> ERROR [2018-02-14 10:39:10,922] ({grpc-default-executor-3}
>>>> IPythonClient.java[onError]:138) - Fail to call IPython grpc
>>>> io.grpc.StatusRuntimeException: RESOURCE_EXHAUSTED: io.grpc.netty.NettyClientTransport$3:
>>>> Frame size 216695976 exceeds maximum: 4194304.
>>>> at io.grpc.Status.asRuntimeException(Status.java:543)
>>>> at io.grpc.stub.ClientCalls$StreamObserverToCallListenerAd
>>>> apter.onClose(ClientCalls.java:395)
>>>> at io.grpc.internal.ClientCallImpl.closeObserver(
>>>> ClientCallImpl.java:426)
>>>> at io.grpc.internal.ClientCallImpl.access$100(
>>>> ClientCallImpl.java:76)
>>>> at io.grpc.internal.ClientCallImpl$ClientStreamListenerImpl.
>>>> close(ClientCallImpl.java:512)
>>>> at io.grpc.internal.ClientCallImpl$ClientStreamListenerImpl.
>>>> access$700(ClientCallImpl.java:429)
>>>> at io.grpc.internal.ClientCallImpl$ClientStreamListenerImpl$
>>>> 1StreamClosed.runInContext(ClientCallImpl.java:544)
>>>> at io.grpc.internal.ContextRunnable.run(
>>>> ContextRunnable.java:52)
>>>> at io.grpc.internal.SerializingExecutor.run(
>>>> SerializingExecutor.java:117)
>>>> at java.util.concurrent.ThreadPoolExecutor.runWorker(
>>>> ThreadPoolExecutor.java:1149)
>>>> at java.util.concurrent.ThreadPoolExecutor$Worker.run(
>>>> ThreadPoolExecutor.java:624)
>>>> at java.lang.Thread.run(Thread.java:748)
>>>
>>>
>>> and
>>>
>>>> INFO [2018-02-14 10:39:10,923] ({grpc-default-worker-ELG-1-2}
>>>> AbstractClientStream2.java[inboundDataReceived]:249) - Received data
>>>> on closed stream
>>>> INFO [2018-02-14 10:39:10,924] ({grpc-default-worker-ELG-1-2}
>>>> AbstractClientStream2.java[inboundDataReceived]:249) - Received data
>>>> on closed stream
>>>> INFO [2018-02-14 10:39:10,925] ({grpc-default-worker-ELG-1-2}
>>>> AbstractClientStream2.java[inboundDataReceived]:249) - Received data
>>>> on closed stream
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>> --
>>> Ruslan Dautkhanov
>>>
>>
Re: ipython/grpc issues
Posted by Jeff Zhang <zj...@gmail.com>.
Sorry , miss PR link https://github.com/apache/zeppelin/pull/2802
Jeff Zhang <zj...@gmail.com>于2018年2月15日周四 上午10:30写道：
>
> HI Ruslan,
>
> Could you help try this PR ?
>
>
> Ruslan Dautkhanov <da...@gmail.com>于2018年2月15日周四 上午1:54写道：
>
>> I've seen several cases when new ipython interpreter isn't possible to
>> stop using "Cancel"
>> button.
>>
>> Interpreter logs shows following errors.
>>
>> Then paragraph stops accepting Cancel commands and it shows that status
>> as "running" when it's actually not.
>>
>> Python 2.7.13.
>> Zeppelin from a few days old master snapshot.
>>
>> $ pip freeze | egrep "ipython|grpc|jupyter"
>> grpcio==1.9.1
>> ipython==5.1.0
>> ipython-genutils==0.2.0
>> jupyter==1.0.0
>> jupyter-client==5.2.2
>> jupyter-console==5.0.0
>> jupyter-core==4.4.0
>>
>>
>>
>> [1]
>>
>>>
>>> ERROR [2018-02-14 10:39:10,922] ({grpc-default-executor-3}
>>> IPythonClient.java[onError]:138) - Fail to call IPython grpc
>>> io.grpc.StatusRuntimeException: RESOURCE_EXHAUSTED:
>>> io.grpc.netty.NettyClientTransport$3: Frame size 216695976 exceeds maximum:
>>> 4194304.
>>> at io.grpc.Status.asRuntimeException(Status.java:543)
>>> at
>>> io.grpc.stub.ClientCalls$StreamObserverToCallListenerAdapter.onClose(ClientCalls.java:395)
>>> at
>>> io.grpc.internal.ClientCallImpl.closeObserver(ClientCallImpl.java:426)
>>> at
>>> io.grpc.internal.ClientCallImpl.access$100(ClientCallImpl.java:76)
>>> at
>>> io.grpc.internal.ClientCallImpl$ClientStreamListenerImpl.close(ClientCallImpl.java:512)
>>> at
>>> io.grpc.internal.ClientCallImpl$ClientStreamListenerImpl.access$700(ClientCallImpl.java:429)
>>> at
>>> io.grpc.internal.ClientCallImpl$ClientStreamListenerImpl$1StreamClosed.runInContext(ClientCallImpl.java:544)
>>> at io.grpc.internal.ContextRunnable.run(ContextRunnable.java:52)
>>> at
>>> io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:117)
>>> at
>>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
>>> at
>>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
>>> at java.lang.Thread.run(Thread.java:748)
>>
>>
>> and
>>
>>> INFO [2018-02-14 10:39:10,923] ({grpc-default-worker-ELG-1-2}
>>> AbstractClientStream2.java[inboundDataReceived]:249) - Received data on
>>> closed stream
>>> INFO [2018-02-14 10:39:10,924] ({grpc-default-worker-ELG-1-2} AbstractClientStream2.java[inboundDataReceived]:249)
>>> - Received data on closed stream
>>> INFO [2018-02-14 10:39:10,925] ({grpc-default-worker-ELG-1-2}
>>> AbstractClientStream2.java[inboundDataReceived]:249) - Received data on
>>> closed stream
>>
>>
>>
>>
>>
>>
>>
>> --
>> Ruslan Dautkhanov
>>
>
Re: ipython/grpc issues
Posted by Jeff Zhang <zj...@gmail.com>.
HI Ruslan,
Could you help try this PR ?
Ruslan Dautkhanov <da...@gmail.com>于2018年2月15日周四 上午1:54写道：
> I've seen several cases when new ipython interpreter isn't possible to
> stop using "Cancel"
> button.
>
> Interpreter logs shows following errors.
>
> Then paragraph stops accepting Cancel commands and it shows that status as
> "running" when it's actually not.
>
> Python 2.7.13.
> Zeppelin from a few days old master snapshot.
>
> $ pip freeze | egrep "ipython|grpc|jupyter"
> grpcio==1.9.1
> ipython==5.1.0
> ipython-genutils==0.2.0
> jupyter==1.0.0
> jupyter-client==5.2.2
> jupyter-console==5.0.0
> jupyter-core==4.4.0
>
>
>
> [1]
>
>>
>> ERROR [2018-02-14 10:39:10,922] ({grpc-default-executor-3}
>> IPythonClient.java[onError]:138) - Fail to call IPython grpc
>> io.grpc.StatusRuntimeException: RESOURCE_EXHAUSTED:
>> io.grpc.netty.NettyClientTransport$3: Frame size 216695976 exceeds maximum:
>> 4194304.
>> at io.grpc.Status.asRuntimeException(Status.java:543)
>> at
>> io.grpc.stub.ClientCalls$StreamObserverToCallListenerAdapter.onClose(ClientCalls.java:395)
>> at
>> io.grpc.internal.ClientCallImpl.closeObserver(ClientCallImpl.java:426)
>> at
>> io.grpc.internal.ClientCallImpl.access$100(ClientCallImpl.java:76)
>> at
>> io.grpc.internal.ClientCallImpl$ClientStreamListenerImpl.close(ClientCallImpl.java:512)
>> at
>> io.grpc.internal.ClientCallImpl$ClientStreamListenerImpl.access$700(ClientCallImpl.java:429)
>> at
>> io.grpc.internal.ClientCallImpl$ClientStreamListenerImpl$1StreamClosed.runInContext(ClientCallImpl.java:544)
>> at io.grpc.internal.ContextRunnable.run(ContextRunnable.java:52)
>> at
>> io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:117)
>> at
>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
>> at
>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
>> at java.lang.Thread.run(Thread.java:748)
>
>
> and
>
>> INFO [2018-02-14 10:39:10,923] ({grpc-default-worker-ELG-1-2}
>> AbstractClientStream2.java[inboundDataReceived]:249) - Received data on
>> closed stream
>> INFO [2018-02-14 10:39:10,924] ({grpc-default-worker-ELG-1-2} AbstractClientStream2.java[inboundDataReceived]:249)
>> - Received data on closed stream
>> INFO [2018-02-14 10:39:10,925] ({grpc-default-worker-ELG-1-2}
>> AbstractClientStream2.java[inboundDataReceived]:249) - Received data on
>> closed stream
>
>
>
>
>
>
>
> --
> Ruslan Dautkhanov
>