You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@zeppelin.apache.org by "Amandeep (Jira)" <ji...@apache.org> on 2019/10/31 18:54:00 UTC
[jira] [Created] (ZEPPELIN-4414) Thrift TransportException occurs
when restarting spark interpreter from ui
Amandeep created ZEPPELIN-4414:
----------------------------------
Summary: Thrift TransportException occurs when restarting spark interpreter from ui
Key: ZEPPELIN-4414
URL: https://issues.apache.org/jira/browse/ZEPPELIN-4414
Project: Zeppelin
Issue Type: Bug
Components: Interpreters
Affects Versions: 0.9.0
Reporter: Amandeep
When i restart spark interpreter from ui it crashes entire zeppelin and causes this exception:
INFO (\{pool-4-thread-1} ManagedInterpreterGroup.java[close]:105) - Kill RemoteInterpreterProcess
INFO [ (\{pool-4-thread-1} RemoteInterpreterManagedProcess.java[stop]:131) - Kill interpreter process
ERROR (\{pool-6-thread-5} TThreadPoolServer.java[run]:315) - Thrift error occurred during processing of message.
org.apache.thrift.transport.TTransportException
at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:132)
at org.apache.thrift.transport.TTransport.readAll(TTransport.java:86)
at org.apache.thrift.protocol.TBinaryProtocol.readAll(TBinaryProtocol.java:425)
at org.apache.thrift.protocol.TBinaryProtocol.readI32(TBinaryProtocol.java:321)
at org.apache.thrift.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:225)
at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:27)
at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:310)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
WARN (\{pool-4-thread-1} RemoteInterpreterManagedProcess.java[stop]:141) - ignore the exception when shutting down
java.lang.RuntimeException: org.apache.thrift.transport.TTransportException
at org.apache.zeppelin.interpreter.remote.RemoteInterpreterProcess.callRemoteFunction(RemoteInterpreterProcess.java:122)
at org.apache.zeppelin.interpreter.remote.RemoteInterpreterManagedProcess.stop(RemoteInterpreterManagedProcess.java:133)
at org.apache.zeppelin.interpreter.ManagedInterpreterGroup.close(ManagedInterpreterGroup.java:106)
at org.apache.zeppelin.interpreter.ManagedInterpreterGroup.close(ManagedInterpreterGroup.java:88)
at org.apache.zeppelin.interpreter.lifecycle.TimeoutLifecycleManager.lambda$new$0(TimeoutLifecycleManager.java:51)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.thrift.transport.TTransportException
at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:132)
at org.apache.thrift.transport.TTransport.readAll(TTransport.java:86)
at org.apache.thrift.protocol.TBinaryProtocol.readAll(TBinaryProtocol.java:425)
at org.apache.thrift.protocol.TBinaryProtocol.readI32(TBinaryProtocol.java:321)
at org.apache.thrift.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:225)
at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:77)
at org.apache.zeppelin.interpreter.thrift.RemoteInterpreterService$Client.recv_shutdown(RemoteInterpreterService.java:347)
at org.apache.zeppelin.interpreter.thrift.RemoteInterpreterService$Client.shutdown(RemoteInterpreterService.java:335)
at org.apache.zeppelin.interpreter.remote.RemoteInterpreterManagedProcess$1.call(RemoteInterpreterManagedProcess.java:136)
at org.apache.zeppelin.interpreter.remote.RemoteInterpreterManagedProcess$1.call(RemoteInterpreterManagedProcess.java:133)
at org.apache.zeppelin.interpreter.remote.RemoteInterpreterProcess.callRemoteFunction(RemoteInterpreterProcess.java:118)
... 11 more
Upgrading thrift to 0.13 might fix this issue since 0.12.0 had a major bug which could be related to Transport Exception we're seeing in Zeppelin. We've upgraded to thrift 0.13 and haven't been able to re-produce the same issue yet. https://issues.apache.org/jira/browse/THRIFT-4858
--
This message was sent by Atlassian Jira
(v8.3.4#803005)