You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@zeppelin.apache.org by Ben Vogan <be...@shopkick.com> on 2018/10/08 16:03:23 UTC
Python interpreter getting hung
Hi there,
We are using Zeppelin in a shared environment and are having persistent
problems with the Python interpreter getting into a state where paragraphs
are PENDING forever. I have looked at the zeppelin-interpreter-python*.log
files and there is virtually nothing in there - just starting/finished
events. Is there any way to see a log of any errors from python scripts?
Any suggestions on how to debug this?
Help is greatly appreciated!
Thanks,
--
*BENJAMIN VOGAN | *Director of Architecture
<http://www.shopkick.com/> <http://www.shopkick.com/>
<http://www.shopkick.com/>
<https://www.facebook.com/shopkick> <https://www.facebook.com/shopkick>
<https://www.instagram.com/shopkick/> <https://www.instagram.com/shopkick/>
<https://www.pinterest.com/shopkick/> <https://www.pinterest.com/shopkick/>
<https://twitter.com/shopkickbiz> <https://twitter.com/shopkickbiz>
<https://www.linkedin.com/company-beta/831240/?pathWildcard=831240>
<https://www.linkedin.com/company-beta/831240/?pathWildcard=831240>
Re: Python interpreter getting hung
Posted by Jeff Zhang <zj...@gmail.com>.
Which version do you use ? Could you enable the debug info via the
following log4j ?
log4j.rootLogger = INFO, dailyfile
log4j.appender.stdout = org.apache.log4j.ConsoleAppender
log4j.appender.stdout.layout = org.apache.log4j.PatternLayout
log4j.appender.stdout.layout.ConversionPattern=%5p [%d] ({%t} %F[%M]:%L) -
%m%n
log4j.appender.dailyfile.DatePattern=.yyyy-MM-dd
log4j.appender.dailyfile.DEBUG = INFO
log4j.appender.dailyfile = org.apache.log4j.DailyRollingFileAppender
log4j.appender.dailyfile.File = ${zeppelin.log.file}
log4j.appender.dailyfile.layout = org.apache.log4j.PatternLayout
log4j.appender.dailyfile.layout.ConversionPattern=%5p [%d] ({%t} %F[%M]:%L)
- %m%n
log4j.logger.org.apache.zeppelin.python=DEBUG
log4j.logger.org.apache.zeppelin.spark=DEBUG
Ben Vogan <be...@shopkick.com>于2018年10月9日周二 上午12:03写道：
> Hi there,
>
> We are using Zeppelin in a shared environment and are having persistent
> problems with the Python interpreter getting into a state where paragraphs
> are PENDING forever. I have looked at the zeppelin-interpreter-python*.log
> files and there is virtually nothing in there - just starting/finished
> events. Is there any way to see a log of any errors from python scripts?
> Any suggestions on how to debug this?
>
> Help is greatly appreciated!
>
> Thanks,
> --
> *BENJAMIN VOGAN | *Director of Architecture
>
> <http://www.shopkick.com/> <http://www.shopkick.com/>
> <http://www.shopkick.com/>
> <https://www.facebook.com/shopkick> <https://www.facebook.com/shopkick>
> <https://www.instagram.com/shopkick/>
> <https://www.instagram.com/shopkick/>
> <https://www.pinterest.com/shopkick/>
> <https://www.pinterest.com/shopkick/> <https://twitter.com/shopkickbiz>
> <https://twitter.com/shopkickbiz>
> <https://www.linkedin.com/company-beta/831240/?pathWildcard=831240>
> <https://www.linkedin.com/company-beta/831240/?pathWildcard=831240>
>
Re: Python interpreter getting hung
Posted by Bicky Ealias <bi...@gmail.com>.
We were facing the same issue.Currently scheduler size is set to 100.I
followed Jeff's suggestion on his excellent blog to clean inactive
interpreter jvms -refer the link
https://medium.com/@zjffdu/zeppelin-0-8-0-new-features-ea53e8810235 every
30 minutes.
0.8.1 version would have a fix to make this value configurable.
On Tue., 9 Oct. 2018, 3:03 am Ben Vogan, <be...@shopkick.com> wrote:
> Hi there,
>
> We are using Zeppelin in a shared environment and are having persistent
> problems with the Python interpreter getting into a state where paragraphs
> are PENDING forever. I have looked at the zeppelin-interpreter-python*.log
> files and there is virtually nothing in there - just starting/finished
> events. Is there any way to see a log of any errors from python scripts?
> Any suggestions on how to debug this?
>
> Help is greatly appreciated!
>
> Thanks,
> --
> *BENJAMIN VOGAN | *Director of Architecture
>
> <http://www.shopkick.com/> <http://www.shopkick.com/>
> <http://www.shopkick.com/>
> <https://www.facebook.com/shopkick> <https://www.facebook.com/shopkick>
> <https://www.instagram.com/shopkick/>
> <https://www.instagram.com/shopkick/>
> <https://www.pinterest.com/shopkick/>
> <https://www.pinterest.com/shopkick/> <https://twitter.com/shopkickbiz>
> <https://twitter.com/shopkickbiz>
> <https://www.linkedin.com/company-beta/831240/?pathWildcard=831240>
> <https://www.linkedin.com/company-beta/831240/?pathWildcard=831240>
>