You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@storm.apache.org by Kosala Dissanayake <um...@gmail.com> on 2015/02/02 06:44:52 UTC
Re: storm worker dies with filenotfound exception
Clear your storm local directory and restart the supervisor.
On Fri, Jan 30, 2015 at 6:03 PM, Tousif <to...@gmail.com> wrote:
> one of the worker in storm is terminating with the following error.i'm
> using zookeeper 3.4.6 Here is the log.
>
> o.a.c.f.s.ConnectionStateManager [INFO] State change: CONNECTED 2015-01-30
> 08:25:04 o.a.c.f.s.ConnectionStateManager [WARN] There are no
> ConnectionStateListeners registered. 2015-01-30 08:25:04 b.s.d.worker
> [ERROR] Error on initialization of server mk-worker
> java.io.FileNotFoundException: File
> '/home/apache-storm-0.9.2-incubating/stormtmp/supervisor/stormdist/storm-senseforth-1-1422523443/stormconf.ser'
> does not exist at
> org.apache.commons.io.FileUtils.openInputStream(FileUtils.java:299)
> ~[commons-io-2.4.jar:2.4] at
> org.apache.commons.io.FileUtils.readFileToByteArray(FileUtils.java:1763)
> ~[commons-io-2.4.jar:2.4] at
> backtype.storm.config$read_supervisor_storm_conf.invoke(config.clj:212)
> ~[storm-core-0.9.2-incubating.jar:0.9.2-incubating] at
> backtype.storm.daemon.worker$worker_data.invoke(worker.clj:180)
> ~[storm-core-0.9.2-incubating.jar:0.9.2-incubating] at
> backtype.storm.daemon.worker$fn__5940$exec_fn__1396__auto____5941.invoke(worker.clj:356)
> ~[storm-core-0.9.2-incubating.jar:0.9.2-incubating] at
> clojure.lang.AFn.applyToHelper(AFn.java:185) [clojure-1.5.1.jar:na] at
> clojure.lang.AFn.applyTo(AFn.java:151) [clojure-1.5.1.jar:na] at
> clojure.core$apply.invoke(core.clj:617) ~[clojure-1.5.1.jar:na] at
> backtype.storm.daemon.worker$fn__5940$mk_worker__5996.doInvoke(worker.clj:347)
> [storm-core-0.9.2-incubating.jar:0.9.2-incubating] at
> clojure.lang.RestFn.invoke(RestFn.java:512) [clojure-1.5.1.jar:na] at
> backtype.storm.daemon.worker$_main.invoke(worker.clj:454)
> [storm-core-0.9.2-incubating.jar:0.9.2-incubating] at
> clojure.lang.AFn.applyToHelper(AFn.java:172) [clojure-1.5.1.jar:na] at
> clojure.lang.AFn.applyTo(AFn.java:151) [clojure-1.5.1.jar:na] at
> backtype.storm.daemon.worker.main(Unknown Source)
> [storm-core-0.9.2-incubating.jar:0.9.2-incubating] 2015-01-30 08:25:04
> b.s.util [INFO] Halting process: ("Error on initialization")
>
>
> --
>
>
> Regards
> Tousif Khazi
>
>
Re: storm worker dies with filenotfound exception
Posted by Tousif <to...@gmail.com>.
How can i avoid duplicate event processing when this situation arises. i
assuming all events which where processed by this supervisor node might be
replayed.
On Mon, Feb 2, 2015 at 8:22 PM, Harsha <st...@harsha.io> wrote:
> Tousif,
> You might be running into
> https://issues.apache.org/jira/browse/STORM-130 .
> -Harsha
>
>
> On Mon, Feb 2, 2015, at 12:28 AM, Tousif wrote:
>
> Thank you, Can you tell me why it might happen? i recently tried zk 3.3.3
> with 0.9.2 and found incompatible than moved back again to 3.4.6 . i was
> trying zk 3.3.3 coz 3.4.6 is disconnecting with one of the worker and
> suspending.
>
> On Mon, Feb 2, 2015 at 11:14 AM, Kosala Dissanayake <um...@gmail.com>
> wrote:
>
> Clear your storm local directory and restart the supervisor.
>
> On Fri, Jan 30, 2015 at 6:03 PM, Tousif <to...@gmail.com> wrote:
>
> one of the worker in storm is terminating with the following error.i'm
> using zookeeper 3.4.6 Here is the log.
>
> o.a.c.f.s.ConnectionStateManager [INFO] State change: CONNECTED 2015-01-30
> 08:25:04 o.a.c.f.s.ConnectionStateManager [WARN] There are no
> ConnectionStateListeners registered. 2015-01-30 08:25:04 b.s.d.worker
> [ERROR] Error on initialization of server mk-worker
> java.io.FileNotFoundException: File
> '/home/apache-storm-0.9.2-incubating/stormtmp/supervisor/stormdist/storm-senseforth-1-1422523443/stormconf.ser'
> does not exist at
> org.apache.commons.io.FileUtils.openInputStream(FileUtils.java:299)
> ~[commons-io-2.4.jar:2.4] at
> org.apache.commons.io.FileUtils.readFileToByteArray(FileUtils.java:1763)
> ~[commons-io-2.4.jar:2.4] at
> backtype.storm.config$read_supervisor_storm_conf.invoke(config.clj:212)
> ~[storm-core-0.9.2-incubating.jar:0.9.2-incubating] at
> backtype.storm.daemon.worker$worker_data.invoke(worker.clj:180)
> ~[storm-core-0.9.2-incubating.jar:0.9.2-incubating] at
> backtype.storm.daemon.worker$fn__5940$exec_fn__1396__auto____5941.invoke(worker.clj:356)
> ~[storm-core-0.9.2-incubating.jar:0.9.2-incubating] at
> clojure.lang.AFn.applyToHelper(AFn.java:185) [clojure-1.5.1.jar:na] at
> clojure.lang.AFn.applyTo(AFn.java:151) [clojure-1.5.1.jar:na] at
> clojure.core$apply.invoke(core.clj:617) ~[clojure-1.5.1.jar:na] at
> backtype.storm.daemon.worker$fn__5940$mk_worker__5996.doInvoke(worker.clj:347)
> [storm-core-0.9.2-incubating.jar:0.9.2-incubating] at
> clojure.lang.RestFn.invoke(RestFn.java:512) [clojure-1.5.1.jar:na] at
> backtype.storm.daemon.worker$_main.invoke(worker.clj:454)
> [storm-core-0.9.2-incubating.jar:0.9.2-incubating] at
> clojure.lang.AFn.applyToHelper(AFn.java:172) [clojure-1.5.1.jar:na] at
> clojure.lang.AFn.applyTo(AFn.java:151) [clojure-1.5.1.jar:na] at
> backtype.storm.daemon.worker.main(Unknown Source)
> [storm-core-0.9.2-incubating.jar:0.9.2-incubating] 2015-01-30 08:25:04
> b.s.util [INFO] Halting process: ("Error on initialization")
>
>
>
>
>
> --
>
>
>
> Regards
> Tousif Khazi
>
>
>
>
>
>
>
>
>
> --
>
>
> Regards
> Tousif Khazi
>
>
>
>
--
Regards
Tousif Khazi
Re: storm worker dies with filenotfound exception
Posted by Harsha <st...@harsha.io>.
Tousif, You might be running into
https://issues.apache.org/jira/browse/STORM-130 . -Harsha
On Mon, Feb 2, 2015, at 12:28 AM, Tousif wrote:
> Thank you, Can you tell me why it might happen? i recently tried zk
> 3.3.3 with 0.9.2 and found incompatible than moved back again to 3.4.6
> . i was trying zk 3.3.3 coz 3.4.6 is disconnecting with one of the
> worker and suspending.
>
> On Mon, Feb 2, 2015 at 11:14 AM, Kosala Dissanayake
> <um...@gmail.com> wrote:
>> Clear your storm local directory and restart the supervisor.
>>
>> On Fri, Jan 30, 2015 at 6:03 PM, Tousif
>> <to...@gmail.com> wrote:
>>> one of the worker in storm is terminating with the following
>>> error.i'm using zookeeper 3.4.6 Here is the log.
>>> o.a.c.f.s.ConnectionStateManager [INFO] State change: CONNECTED
2015-01-30 08:25:04 o.a.c.f.s.ConnectionStateManager [WARN] There are no
ConnectionStateListeners registered. 2015-01-30 08:25:04 b.s.d.worker
[ERROR] Error on initialization of server mk-worker
java.io.FileNotFoundException: File
'/home/apache-storm-0.9.2-incubating/stormtmp/supervisor/stormdist/storm-senseforth-1-1422523443/stormconf.ser'
does not exist at
org.apache.commons.io.FileUtils.openInputStream(FileUtils.java:299)
~[commons-io-2.4.jar:2.4] at
org.apache.commons.io.FileUtils.readFileToByteArray(FileUtils.java:1763)
~[commons-io-2.4.jar:2.4] at
backtype.storm.config$read_supervisor_storm_conf.invoke(config.clj:212)
~[storm-core-0.9.2-incubating.jar:0.9.2-incubating] at
backtype.storm.daemon.worker$worker_data.invoke(worker.clj:180)
~[storm-core-0.9.2-incubating.jar:0.9.2-incubating] at
backtype.storm.daemon.worker$fn__5940$exec_fn__1396__auto____5941.invoke(worker.clj:356)
~[storm-core-0.9.2-incubating.jar:0.9.2-incubating] at
clojure.lang.AFn.applyToHelper(AFn.java:185) [clojure-1.5.1.jar:na] at
clojure.lang.AFn.applyTo(AFn.java:151) [clojure-1.5.1.jar:na] at
clojure.core$apply.invoke(core.clj:617) ~[clojure-1.5.1.jar:na] at
backtype.storm.daemon.worker$fn__5940$mk_worker__5996.doInvoke(worker.clj:347)
[storm-core-0.9.2-incubating.jar:0.9.2-incubating] at
clojure.lang.RestFn.invoke(RestFn.java:512) [clojure-1.5.1.jar:na] at
backtype.storm.daemon.worker$_main.invoke(worker.clj:454)
[storm-core-0.9.2-incubating.jar:0.9.2-incubating] at
clojure.lang.AFn.applyToHelper(AFn.java:172) [clojure-1.5.1.jar:na] at
clojure.lang.AFn.applyTo(AFn.java:151) [clojure-1.5.1.jar:na] at
backtype.storm.daemon.worker.main(Unknown Source)
[storm-core-0.9.2-incubating.jar:0.9.2-incubating] 2015-01-30 08:25:04
b.s.util [INFO] Halting process: ("Error on initialization")
>>>
>>>
>>>
>>>
>>>
>>> --
>>>
>>>
>>>
>>> Regards Tousif Khazi
>>>
>>>
>>>
>>
>
>
>
> --
>
>
> Regards Tousif Khazi
>
Re: storm worker dies with filenotfound exception
Posted by Tousif <to...@gmail.com>.
Thank you, Can you tell me why it might happen? i recently tried zk 3.3.3
with 0.9.2 and found incompatible than moved back again to 3.4.6 . i was
trying zk 3.3.3 coz 3.4.6 is disconnecting with one of the worker and
suspending.
On Mon, Feb 2, 2015 at 11:14 AM, Kosala Dissanayake <um...@gmail.com>
wrote:
> Clear your storm local directory and restart the supervisor.
>
> On Fri, Jan 30, 2015 at 6:03 PM, Tousif <to...@gmail.com> wrote:
>
>> one of the worker in storm is terminating with the following error.i'm
>> using zookeeper 3.4.6 Here is the log.
>>
>> o.a.c.f.s.ConnectionStateManager [INFO] State change: CONNECTED
>> 2015-01-30 08:25:04 o.a.c.f.s.ConnectionStateManager [WARN] There are no
>> ConnectionStateListeners registered. 2015-01-30 08:25:04 b.s.d.worker
>> [ERROR] Error on initialization of server mk-worker
>> java.io.FileNotFoundException: File
>> '/home/apache-storm-0.9.2-incubating/stormtmp/supervisor/stormdist/storm-senseforth-1-1422523443/stormconf.ser'
>> does not exist at
>> org.apache.commons.io.FileUtils.openInputStream(FileUtils.java:299)
>> ~[commons-io-2.4.jar:2.4] at
>> org.apache.commons.io.FileUtils.readFileToByteArray(FileUtils.java:1763)
>> ~[commons-io-2.4.jar:2.4] at
>> backtype.storm.config$read_supervisor_storm_conf.invoke(config.clj:212)
>> ~[storm-core-0.9.2-incubating.jar:0.9.2-incubating] at
>> backtype.storm.daemon.worker$worker_data.invoke(worker.clj:180)
>> ~[storm-core-0.9.2-incubating.jar:0.9.2-incubating] at
>> backtype.storm.daemon.worker$fn__5940$exec_fn__1396__auto____5941.invoke(worker.clj:356)
>> ~[storm-core-0.9.2-incubating.jar:0.9.2-incubating] at
>> clojure.lang.AFn.applyToHelper(AFn.java:185) [clojure-1.5.1.jar:na] at
>> clojure.lang.AFn.applyTo(AFn.java:151) [clojure-1.5.1.jar:na] at
>> clojure.core$apply.invoke(core.clj:617) ~[clojure-1.5.1.jar:na] at
>> backtype.storm.daemon.worker$fn__5940$mk_worker__5996.doInvoke(worker.clj:347)
>> [storm-core-0.9.2-incubating.jar:0.9.2-incubating] at
>> clojure.lang.RestFn.invoke(RestFn.java:512) [clojure-1.5.1.jar:na] at
>> backtype.storm.daemon.worker$_main.invoke(worker.clj:454)
>> [storm-core-0.9.2-incubating.jar:0.9.2-incubating] at
>> clojure.lang.AFn.applyToHelper(AFn.java:172) [clojure-1.5.1.jar:na] at
>> clojure.lang.AFn.applyTo(AFn.java:151) [clojure-1.5.1.jar:na] at
>> backtype.storm.daemon.worker.main(Unknown Source)
>> [storm-core-0.9.2-incubating.jar:0.9.2-incubating] 2015-01-30 08:25:04
>> b.s.util [INFO] Halting process: ("Error on initialization")
>>
>>
>> --
>>
>>
>> Regards
>> Tousif Khazi
>>
>>
>
--
Regards
Tousif Khazi