You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@storm.apache.org by "Alberto J. Sánchez Sanz" <aj...@gmail.com> on 2015/11/02 11:56:30 UTC

Heartbeat timeout with Python spouts

Hi!

I'm running a topology with a Python spout. This topology stops executing
and throw an Exception due to heartbeat timeout problem. This occurs
"randomly" in time. Sometimes the exception is thrown after some hours and
in other cases some days.

I'm using Storm 0.9.5 and this is the trace of the Exception.

Do you know why is this produced and how to solve it?

Thanks!

*******************************


2015-11-01 11:00:14 b.s.s.ShellSpout [ERROR] Halting process: ShellSpout
died.
java.lang.RuntimeException: subprocess heartbeat timeout
at
backtype.storm.spout.ShellSpout$SpoutHeartbeatTimerTask.run(ShellSpout.java:261)
[storm-core-0.9.5.jar:0.9.5]
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
[na:1.7.0_79]
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:304)
[na:1.7.0_79]
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:178)
[na:1.7.0_79]
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
[na:1.7.0_79]
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
[na:1.7.0_79]
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[na:1.7.0_79]
at java.lang.Thread.run(Thread.java:745) [na:1.7.0_79]
2015-11-01 11:00:14 b.s.d.executor [ERROR]
java.lang.RuntimeException: subprocess heartbeat timeout
at
backtype.storm.spout.ShellSpout$SpoutHeartbeatTimerTask.run(ShellSpout.java:261)
[storm-core-0.9.5.jar:0.9.5]
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
[na:1.7.0_79]
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:304)
[na:1.7.0_79]
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:178)
[na:1.7.0_79]
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
[na:1.7.0_79]
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
[na:1.7.0_79]
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[na:1.7.0_79]
at java.lang.Thread.run(Thread.java:745) [na:1.7.0_79]

Re: Heartbeat timeout with Python spouts

Posted by "Alberto J. Sánchez Sanz" <aj...@gmail.com>.
Could this be related?

https://issues.apache.org/jira/browse/STORM-742

On 2 November 2015 at 11:56, Alberto J. Sánchez Sanz <
ajsanchezsanz@gmail.com> wrote:

> Hi!
>
> I'm running a topology with a Python spout. This topology stops executing
> and throw an Exception due to heartbeat timeout problem. This occurs
> "randomly" in time. Sometimes the exception is thrown after some hours and
> in other cases some days.
>
> I'm using Storm 0.9.5 and this is the trace of the Exception.
>
> Do you know why is this produced and how to solve it?
>
> Thanks!
>
> *******************************
>
>
> 2015-11-01 11:00:14 b.s.s.ShellSpout [ERROR] Halting process: ShellSpout
> died.
> java.lang.RuntimeException: subprocess heartbeat timeout
> at
> backtype.storm.spout.ShellSpout$SpoutHeartbeatTimerTask.run(ShellSpout.java:261)
> [storm-core-0.9.5.jar:0.9.5]
> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
> [na:1.7.0_79]
> at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:304)
> [na:1.7.0_79]
> at
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:178)
> [na:1.7.0_79]
> at
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
> [na:1.7.0_79]
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> [na:1.7.0_79]
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> [na:1.7.0_79]
> at java.lang.Thread.run(Thread.java:745) [na:1.7.0_79]
> 2015-11-01 11:00:14 b.s.d.executor [ERROR]
> java.lang.RuntimeException: subprocess heartbeat timeout
> at
> backtype.storm.spout.ShellSpout$SpoutHeartbeatTimerTask.run(ShellSpout.java:261)
> [storm-core-0.9.5.jar:0.9.5]
> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
> [na:1.7.0_79]
> at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:304)
> [na:1.7.0_79]
> at
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:178)
> [na:1.7.0_79]
> at
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
> [na:1.7.0_79]
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> [na:1.7.0_79]
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> [na:1.7.0_79]
> at java.lang.Thread.run(Thread.java:745) [na:1.7.0_79]
>