You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@storm.apache.org by "Peter Haggerty (JIRA)" <ji...@apache.org> on 2014/10/07 23:56:35 UTC
[jira] [Updated] (STORM-522) NullPointerException in
storm.kafka.ZkCoordinator
[ https://issues.apache.org/jira/browse/STORM-522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Peter Haggerty updated STORM-522:
---------------------------------
Description:
We've been seeing these about once a week. The nimbus will kill and reassign the topology (on the same hardware) get caught up to "now" in kafka and happily continue running until the next time it encounters an event like this.
{code}
2014-09-30 13:59:40 s.k.ZkCoordinator [INFO] Deleted partition managers: [10.1.2.1:9092:0, 10.1.2.2:9092:1, 10.1.2.3:9092:3]
2014-09-30 13:59:40 b.s.util [ERROR] Async loop died!
java.lang.RuntimeException: java.lang.NullPointerException
at storm.kafka.ZkCoordinator.refresh(ZkCoordinator.java:148) ~[stormjar.jar:na]
at storm.kafka.ZkCoordinator.getMyManagedPartitions(ZkCoordinator.java:77) ~[stormjar.jar:na]
at storm.kafka.KafkaSpout.nextTuple(KafkaSpout.java:94) ~[stormjar.jar:na]
at backtype.storm.daemon.executor$fn__5573$fn__5588$fn__5617.invoke(executor.clj:563) ~[storm-core-0.9.2-incubating.jar:0.9.2-incubating]
at backtype.storm.util$async_loop$fn__457.invoke(util.clj:431) ~[storm-core-0.9.2-incubating.jar:0.9.2-incubating]
at clojure.lang.AFn.run(AFn.java:24) [clojure-1.5.1.jar:na]
at java.lang.Thread.run(Thread.java:745) [na:1.7.0_55]
Caused by: java.lang.NullPointerException: null
at storm.kafka.DynamicPartitionConnections.unregister(DynamicPartitionConnections.java:39) ~[stormjar.jar:na]
at storm.kafka.PartitionManager.close(PartitionManager.java:205) ~[stormjar.jar:na]
at storm.kafka.ZkCoordinator.refresh(ZkCoordinator.java:135) ~[stormjar.jar:na]
... 6 common frames omitted
2014-09-30 13:59:40 b.s.d.executor [ERROR]
java.lang.RuntimeException: java.lang.NullPointerException
at storm.kafka.ZkCoordinator.refresh(ZkCoordinator.java:148) ~[stormjar.jar:na]
at storm.kafka.ZkCoordinator.getMyManagedPartitions(ZkCoordinator.java:77) ~[stormjar.jar:na]
at storm.kafka.KafkaSpout.nextTuple(KafkaSpout.java:94) ~[stormjar.jar:na]
at backtype.storm.daemon.executor$fn__5573$fn__5588$fn__5617.invoke(executor.clj:563) ~[storm-core-0.9.2-incubating.jar:0.9.2-incubating]
at backtype.storm.util$async_loop$fn__457.invoke(util.clj:431) ~[storm-core-0.9.2-incubating.jar:0.9.2-incubating]
at clojure.lang.AFn.run(AFn.java:24) [clojure-1.5.1.jar:na]
at java.lang.Thread.run(Thread.java:745) [na:1.7.0_55]
Caused by: java.lang.NullPointerException: null
at storm.kafka.DynamicPartitionConnections.unregister(DynamicPartitionConnections.java:39) ~[stormjar.jar:na]
at storm.kafka.PartitionManager.close(PartitionManager.java:205) ~[stormjar.jar:na]
at storm.kafka.ZkCoordinator.refresh(ZkCoordinator.java:135) ~[stormjar.jar:na]
... 6 common frames omitted
2014-09-30 13:59:40 b.s.util [INFO] Halting process: ("Worker died")
{code}
was:
{code}
2014-09-30 13:59:40 s.k.ZkCoordinator [INFO] Deleted partition managers: [10.1.2.1:9092:0, 10.1.2.2:9092:1, 10.1.2.3:9092:3]
2014-09-30 13:59:40 b.s.util [ERROR] Async loop died!
java.lang.RuntimeException: java.lang.NullPointerException
at storm.kafka.ZkCoordinator.refresh(ZkCoordinator.java:148) ~[stormjar.jar:na]
at storm.kafka.ZkCoordinator.getMyManagedPartitions(ZkCoordinator.java:77) ~[stormjar.jar:na]
at storm.kafka.KafkaSpout.nextTuple(KafkaSpout.java:94) ~[stormjar.jar:na]
at backtype.storm.daemon.executor$fn__5573$fn__5588$fn__5617.invoke(executor.clj:563) ~[storm-core-0.9.2-incubating.jar:0.9.2-incubating]
at backtype.storm.util$async_loop$fn__457.invoke(util.clj:431) ~[storm-core-0.9.2-incubating.jar:0.9.2-incubating]
at clojure.lang.AFn.run(AFn.java:24) [clojure-1.5.1.jar:na]
at java.lang.Thread.run(Thread.java:745) [na:1.7.0_55]
Caused by: java.lang.NullPointerException: null
at storm.kafka.DynamicPartitionConnections.unregister(DynamicPartitionConnections.java:39) ~[stormjar.jar:na]
at storm.kafka.PartitionManager.close(PartitionManager.java:205) ~[stormjar.jar:na]
at storm.kafka.ZkCoordinator.refresh(ZkCoordinator.java:135) ~[stormjar.jar:na]
... 6 common frames omitted
2014-09-30 13:59:40 b.s.d.executor [ERROR]
java.lang.RuntimeException: java.lang.NullPointerException
at storm.kafka.ZkCoordinator.refresh(ZkCoordinator.java:148) ~[stormjar.jar:na]
at storm.kafka.ZkCoordinator.getMyManagedPartitions(ZkCoordinator.java:77) ~[stormjar.jar:na]
at storm.kafka.KafkaSpout.nextTuple(KafkaSpout.java:94) ~[stormjar.jar:na]
at backtype.storm.daemon.executor$fn__5573$fn__5588$fn__5617.invoke(executor.clj:563) ~[storm-core-0.9.2-incubating.jar:0.9.2-incubating]
at backtype.storm.util$async_loop$fn__457.invoke(util.clj:431) ~[storm-core-0.9.2-incubating.jar:0.9.2-incubating]
at clojure.lang.AFn.run(AFn.java:24) [clojure-1.5.1.jar:na]
at java.lang.Thread.run(Thread.java:745) [na:1.7.0_55]
Caused by: java.lang.NullPointerException: null
at storm.kafka.DynamicPartitionConnections.unregister(DynamicPartitionConnections.java:39) ~[stormjar.jar:na]
at storm.kafka.PartitionManager.close(PartitionManager.java:205) ~[stormjar.jar:na]
at storm.kafka.ZkCoordinator.refresh(ZkCoordinator.java:135) ~[stormjar.jar:na]
... 6 common frames omitted
2014-09-30 13:59:40 b.s.util [INFO] Halting process: ("Worker died")
{code}
> NullPointerException in storm.kafka.ZkCoordinator
> -------------------------------------------------
>
> Key: STORM-522
> URL: https://issues.apache.org/jira/browse/STORM-522
> Project: Apache Storm
> Issue Type: Bug
> Affects Versions: 0.9.2-incubating
> Reporter: Peter Haggerty
>
> We've been seeing these about once a week. The nimbus will kill and reassign the topology (on the same hardware) get caught up to "now" in kafka and happily continue running until the next time it encounters an event like this.
> {code}
> 2014-09-30 13:59:40 s.k.ZkCoordinator [INFO] Deleted partition managers: [10.1.2.1:9092:0, 10.1.2.2:9092:1, 10.1.2.3:9092:3]
> 2014-09-30 13:59:40 b.s.util [ERROR] Async loop died!
> java.lang.RuntimeException: java.lang.NullPointerException
> at storm.kafka.ZkCoordinator.refresh(ZkCoordinator.java:148) ~[stormjar.jar:na]
> at storm.kafka.ZkCoordinator.getMyManagedPartitions(ZkCoordinator.java:77) ~[stormjar.jar:na]
> at storm.kafka.KafkaSpout.nextTuple(KafkaSpout.java:94) ~[stormjar.jar:na]
> at backtype.storm.daemon.executor$fn__5573$fn__5588$fn__5617.invoke(executor.clj:563) ~[storm-core-0.9.2-incubating.jar:0.9.2-incubating]
> at backtype.storm.util$async_loop$fn__457.invoke(util.clj:431) ~[storm-core-0.9.2-incubating.jar:0.9.2-incubating]
> at clojure.lang.AFn.run(AFn.java:24) [clojure-1.5.1.jar:na]
> at java.lang.Thread.run(Thread.java:745) [na:1.7.0_55]
> Caused by: java.lang.NullPointerException: null
> at storm.kafka.DynamicPartitionConnections.unregister(DynamicPartitionConnections.java:39) ~[stormjar.jar:na]
> at storm.kafka.PartitionManager.close(PartitionManager.java:205) ~[stormjar.jar:na]
> at storm.kafka.ZkCoordinator.refresh(ZkCoordinator.java:135) ~[stormjar.jar:na]
> ... 6 common frames omitted
> 2014-09-30 13:59:40 b.s.d.executor [ERROR]
> java.lang.RuntimeException: java.lang.NullPointerException
> at storm.kafka.ZkCoordinator.refresh(ZkCoordinator.java:148) ~[stormjar.jar:na]
> at storm.kafka.ZkCoordinator.getMyManagedPartitions(ZkCoordinator.java:77) ~[stormjar.jar:na]
> at storm.kafka.KafkaSpout.nextTuple(KafkaSpout.java:94) ~[stormjar.jar:na]
> at backtype.storm.daemon.executor$fn__5573$fn__5588$fn__5617.invoke(executor.clj:563) ~[storm-core-0.9.2-incubating.jar:0.9.2-incubating]
> at backtype.storm.util$async_loop$fn__457.invoke(util.clj:431) ~[storm-core-0.9.2-incubating.jar:0.9.2-incubating]
> at clojure.lang.AFn.run(AFn.java:24) [clojure-1.5.1.jar:na]
> at java.lang.Thread.run(Thread.java:745) [na:1.7.0_55]
> Caused by: java.lang.NullPointerException: null
> at storm.kafka.DynamicPartitionConnections.unregister(DynamicPartitionConnections.java:39) ~[stormjar.jar:na]
> at storm.kafka.PartitionManager.close(PartitionManager.java:205) ~[stormjar.jar:na]
> at storm.kafka.ZkCoordinator.refresh(ZkCoordinator.java:135) ~[stormjar.jar:na]
> ... 6 common frames omitted
> 2014-09-30 13:59:40 b.s.util [INFO] Halting process: ("Worker died")
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)