You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@storm.apache.org by Kushan Maskey <ku...@mmillerassociates.com> on 2014/08/18 22:59:20 UTC

Supervisor keeps crashing

I have two servers in which supervisor is running. Once of the runs fine as
far as I know until now. But the other one keep shuts it down and tries to
restart it again unsuccessfully with the following error message. Can
anyone please help me? Thanks.

2014-08-18 20:56:22 b.s.d.supervisor [INFO] Shutting down and clearing
state for id 3b3df13a-085c-472c-8adb-e67e12703da3. Current supervisor time:
1408395382. State: :disallowed, Heartbeat:
#backtype.storm.daemon.common.WorkerHeartbeat{:time-secs 1408387624,
:storm-id "CEXPStormTopology-17-1408387614", :executors #{[5 5] [9 9] [13
13] [17 17] [-1 -1] [1 1]}, :port 6721}

2014-08-18 20:56:22 b.s.d.supervisor [INFO] Shutting down
2cde2ba9-ea17-4924-bea7-2361dcf4f6a1:3b3df13a-085c-472c-8adb-e67e12703da3

2014-08-18 20:56:22 b.s.event [ERROR] Error when processing event

java.io.IOException: . doesn't exist.

at
org.apache.commons.exec.DefaultExecutor.execute(DefaultExecutor.java:157)
~[commons-exec-1.1.jar:1.1]

at
org.apache.commons.exec.DefaultExecutor.execute(DefaultExecutor.java:147)
~[commons-exec-1.1.jar:1.1]

at backtype.storm.util$exec_command_BANG_.invoke(util.clj:378)
~[storm-core-0.9.2-incubating.jar:0.9.2-incubating]

at backtype.storm.util$ensure_process_killed_BANG_.invoke(util.clj:394)
~[storm-core-0.9.2-incubating.jar:0.9.2-incubating]

at
backtype.storm.daemon.supervisor$shutdown_worker.invoke(supervisor.clj:175)
~[storm-core-0.9.2-incubating.jar:0.9.2-incubating]

at
backtype.storm.daemon.supervisor$sync_processes.invoke(supervisor.clj:240)
~[storm-core-0.9.2-incubating.jar:0.9.2-incubating]

at clojure.lang.AFn.applyToHelper(AFn.java:161) [clojure-1.5.1.jar:na]

at clojure.lang.AFn.applyTo(AFn.java:151) [clojure-1.5.1.jar:na]

at clojure.core$apply.invoke(core.clj:619) ~[clojure-1.5.1.jar:na]

at clojure.core$partial$fn__4190.doInvoke(core.clj:2396)
~[clojure-1.5.1.jar:na]

at clojure.lang.RestFn.invoke(RestFn.java:397) ~[clojure-1.5.1.jar:na]

at backtype.storm.event$event_manager$fn__2378.invoke(event.clj:39)
~[storm-core-0.9.2-incubating.jar:0.9.2-incubating]

at clojure.lang.AFn.run(AFn.java:24) [clojure-1.5.1.jar:na]

at java.lang.Thread.run(Thread.java:744) [na:1.7.0_51]

2014-08-18 20:56:22 b.s.util [INFO] Halting process: ("Error when
processing an event")
--
Kushan Maskey
817.403.7500

Re: Supervisor keeps crashing

Posted by Kushan Maskey <ku...@mmillerassociates.com>.
I have installed the same storm package 0.9.2 on the servers and i have
only removed the netty.3.2.2.jar files from there since it was conflicting
with netty-3.6.3.Final.jar. Besides that I have not made any changes to
other jars.

If you can point me the jar you think is not correct/missing please let me
know. Thanks.

--
Kushan Maskey



On Tue, Aug 19, 2014 at 1:42 AM, Bishnu Patro <Bi...@symantec.com>
wrote:

> From the error message, it seems some of the dependent jar file is missing
> from your storm lib directory.
>
>
>
> *From:* Kushan Maskey [mailto:kushan.maskey@mmillerassociates.com]
> *Sent:* 19 August 2014 02:29
> *To:* user@storm.incubator.apache.org
> *Subject:* Supervisor keeps crashing
>
>
>
>
>
> I have two servers in which supervisor is running. Once of the runs fine
> as far as I know until now. But the other one keep shuts it down and tries
> to restart it again unsuccessfully with the following error message. Can
> anyone please help me? Thanks.
>
>
>
> 2014-08-18 20:56:22 b.s.d.supervisor [INFO] Shutting down and clearing
> state for id 3b3df13a-085c-472c-8adb-e67e12703da3. Current supervisor time:
> 1408395382. State: :disallowed, Heartbeat:
> #backtype.storm.daemon.common.WorkerHeartbeat{:time-secs 1408387624,
> :storm-id "CEXPStormTopology-17-1408387614", :executors #{[5 5] [9 9] [13
> 13] [17 17] [-1 -1] [1 1]}, :port 6721}
>
> 2014-08-18 20:56:22 b.s.d.supervisor [INFO] Shutting down
> 2cde2ba9-ea17-4924-bea7-2361dcf4f6a1:3b3df13a-085c-472c-8adb-e67e12703da3
>
> 2014-08-18 20:56:22 b.s.event [ERROR] Error when processing event
>
> java.io.IOException: . doesn't exist.
>
> at
> org.apache.commons.exec.DefaultExecutor.execute(DefaultExecutor.java:157)
> ~[commons-exec-1.1.jar:1.1]
>
> at
> org.apache.commons.exec.DefaultExecutor.execute(DefaultExecutor.java:147)
> ~[commons-exec-1.1.jar:1.1]
>
> at backtype.storm.util$exec_command_BANG_.invoke(util.clj:378)
> ~[storm-core-0.9.2-incubating.jar:0.9.2-incubating]
>
> at backtype.storm.util$ensure_process_killed_BANG_.invoke(util.clj:394)
> ~[storm-core-0.9.2-incubating.jar:0.9.2-incubating]
>
> at
> backtype.storm.daemon.supervisor$shutdown_worker.invoke(supervisor.clj:175)
> ~[storm-core-0.9.2-incubating.jar:0.9.2-incubating]
>
> at
> backtype.storm.daemon.supervisor$sync_processes.invoke(supervisor.clj:240)
> ~[storm-core-0.9.2-incubating.jar:0.9.2-incubating]
>
> at clojure.lang.AFn.applyToHelper(AFn.java:161) [clojure-1.5.1.jar:na]
>
> at clojure.lang.AFn.applyTo(AFn.java:151) [clojure-1.5.1.jar:na]
>
> at clojure.core$apply.invoke(core.clj:619) ~[clojure-1.5.1.jar:na]
>
> at clojure.core$partial$fn__4190.doInvoke(core.clj:2396)
> ~[clojure-1.5.1.jar:na]
>
> at clojure.lang.RestFn.invoke(RestFn.java:397) ~[clojure-1.5.1.jar:na]
>
> at backtype.storm.event$event_manager$fn__2378.invoke(event.clj:39)
> ~[storm-core-0.9.2-incubating.jar:0.9.2-incubating]
>
> at clojure.lang.AFn.run(AFn.java:24) [clojure-1.5.1.jar:na]
>
> at java.lang.Thread.run(Thread.java:744) [na:1.7.0_51]
>
> 2014-08-18 20:56:22 b.s.util [INFO] Halting process: ("Error when
> processing an event")
>
> --
>
> Kushan Maskey
> 817.403.7500
>

RE: Supervisor keeps crashing

Posted by Bishnu Patro <Bi...@symantec.com>.
From the error message, it seems some of the dependent jar file is missing from your storm lib directory.

From: Kushan Maskey [mailto:kushan.maskey@mmillerassociates.com]
Sent: 19 August 2014 02:29
To: user@storm.incubator.apache.org
Subject: Supervisor keeps crashing


I have two servers in which supervisor is running. Once of the runs fine as far as I know until now. But the other one keep shuts it down and tries to restart it again unsuccessfully with the following error message. Can anyone please help me? Thanks.

2014-08-18 20:56:22 b.s.d.supervisor [INFO] Shutting down and clearing state for id 3b3df13a-085c-472c-8adb-e67e12703da3. Current supervisor time: 1408395382. State: :disallowed, Heartbeat: #backtype.storm.daemon.common.WorkerHeartbeat{:time-secs 1408387624, :storm-id "CEXPStormTopology-17-1408387614", :executors #{[5 5] [9 9] [13 13] [17 17] [-1 -1] [1 1]}, :port 6721}
2014-08-18 20:56:22 b.s.d.supervisor [INFO] Shutting down 2cde2ba9-ea17-4924-bea7-2361dcf4f6a1:3b3df13a-085c-472c-8adb-e67e12703da3
2014-08-18 20:56:22 b.s.event [ERROR] Error when processing event
java.io.IOException: . doesn't exist.
at org.apache.commons.exec.DefaultExecutor.execute(DefaultExecutor.java:157) ~[commons-exec-1.1.jar:1.1]
at org.apache.commons.exec.DefaultExecutor.execute(DefaultExecutor.java:147) ~[commons-exec-1.1.jar:1.1]
at backtype.storm.util$exec_command_BANG_.invoke(util.clj:378) ~[storm-core-0.9.2-incubating.jar:0.9.2-incubating]
at backtype.storm.util$ensure_process_killed_BANG_.invoke(util.clj:394) ~[storm-core-0.9.2-incubating.jar:0.9.2-incubating]
at backtype.storm.daemon.supervisor$shutdown_worker.invoke(supervisor.clj:175) ~[storm-core-0.9.2-incubating.jar:0.9.2-incubating]
at backtype.storm.daemon.supervisor$sync_processes.invoke(supervisor.clj:240) ~[storm-core-0.9.2-incubating.jar:0.9.2-incubating]
at clojure.lang.AFn.applyToHelper(AFn.java:161) [clojure-1.5.1.jar:na]
at clojure.lang.AFn.applyTo(AFn.java:151) [clojure-1.5.1.jar:na]
at clojure.core$apply.invoke(core.clj:619) ~[clojure-1.5.1.jar:na]
at clojure.core$partial$fn__4190.doInvoke(core.clj:2396) ~[clojure-1.5.1.jar:na]
at clojure.lang.RestFn.invoke(RestFn.java:397) ~[clojure-1.5.1.jar:na]
at backtype.storm.event$event_manager$fn__2378.invoke(event.clj:39) ~[storm-core-0.9.2-incubating.jar:0.9.2-incubating]
at clojure.lang.AFn.run(AFn.java:24) [clojure-1.5.1.jar:na]
at java.lang.Thread.run(Thread.java:744) [na:1.7.0_51]
2014-08-18 20:56:22 b.s.util [INFO] Halting process: ("Error when processing an event")
--
Kushan Maskey
817.403.7500