You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@storm.apache.org by Ra...@DellTeam.com on 2015/05/13 05:40:10 UTC
Strom Kafka spout has sporadic issue with figuring out partition
info from ZK on startup
Dell - Internal Use - Confidential
Strom Kafka spout has sporadic issue with figuring out partition info from ZK on startup.
Here is the stack trace. Any clues on how to troubleshoot this error?
Did not find much help on Stackoverflow and Google.
b.s.d.executor [ERROR]
java.lang.RuntimeException: java.lang.RuntimeException: org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode for /brokers/topics/topic1/partitions
at storm.kafka.DynamicBrokersReader.getBrokerInfo(DynamicBrokersReader.java:81) ~[stormjar.jar:na]
at storm.kafka.trident.ZkBrokerReader.<init>(ZkBrokerReader.java:42) ~[stormjar.jar:na]
at storm.kafka.KafkaUtils.makeBrokerReader(KafkaUtils.java:57) ~[stormjar.jar:na]
at storm.kafka.KafkaSpout.open(KafkaSpout.java:87) ~[stormjar.jar:na]
at backtype.storm.daemon.executor$fn_4081$fn_4096.invoke(executor.clj:519) ~[storm-core-0.9.1.2.1.7.1-11.jar:0.9.1.2.1.7.1-11]
at backtype.storm.util$async_loop$fn__444.invoke(util.clj:434) ~[storm-core-0.9.1.2.1.7.1-11.jar:0.9.1.2.1.7.1-11]
at clojure.lang.AFn.run(AFn.java:24) [clojure-1.4.0.jar:na]
at java.lang.Thread.run(Thread.java:744) [na:1.7.0_45]
Caused by: java.lang.RuntimeException: org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode for /brokers/topics/controllerlog_preprod/partitions
at storm.kafka.DynamicBrokersReader.getNumPartitions(DynamicBrokersReader.java:94) ~[stormjar.jar:na]
at storm.kafka.DynamicBrokersReader.getBrokerInfo(DynamicBrokersReader.java:65) ~[stormjar.jar:na]
... 7 common frames omitted
Caused by: org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode for /brokers/topics/topic1/partitions
at org.apache.zookeeper.KeeperException.create(KeeperException.java:111) ~[zookeeper-3.4.5.2.1.7.1-11.jar:3.4.5-11--1]
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51) ~[zookeeper-3.4.5.2.1.7.1-11.jar:3.4.5-11--1]
at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1586) ~[zookeeper-3.4.5.2.1.7.1-11.jar:3.4.5-11--1]
at org.apache.curator.framework.imps.GetChildrenBuilderImpl$3.call(GetChildrenBuilderImpl.java:214) ~[stormjar.jar:na]
at org.apache.curator.framework.imps.GetChildrenBuilderImpl$3.call(GetChildrenBuilderImpl.java:203) ~[stormjar.jar:na]
at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:107) ~[stormjar.jar:na]
at org.apache.curator.framework.imps.GetChildrenBuilderImpl.pathInForeground(GetChildrenBuilderImpl.java:199) ~[stormjar.jar:na]
at org.apache.curator.framework.imps.GetChildrenBuilderImpl.forPath(GetChildrenBuilderImpl.java:191) ~[stormjar.jar:na]
at org.apache.curator.framework.imps.GetChildrenBuilderImpl.forPath(GetChildrenBuilderImpl.java:38) ~[stormjar.jar:na]
at storm.kafka.DynamicBrokersReader.getNumPartitions(DynamicBrokersReader.java:91) ~[stormjar.jar:na]
... 8 common frames omitted
RE: Strom Kafka spout has sporadic issue with figuring out
partition info from ZK on startup
Posted by Ra...@DellTeam.com.
Dell - Internal Use - Confidential
Using the same zk cluster for both storm and kafka.
From: Harsha [mailto:storm@harsha.io]
Sent: Wednesday, May 13, 2015 11:58 AM
To: Kalluri, Rajesh - Dell Team; user@storm.apache.org
Subject: Re: Strom Kafka spout has sporadic issue with figuring out partition info from ZK on startup
Are you using separate zk clusters for storm and kafka. If so which zookeepers did you configure for kafka spout.
--
Harsha
Sent with Airmail
On May 12, 2015 at 8:40:26 PM, rajesh_kalluri@dellteam.com<ma...@dellteam.com> (rajesh_kalluri@dellteam.com<ma...@dellteam.com>) wrote:
Dell - Internal Use - Confidential
Strom Kafka spout has sporadic issue with figuring out partition info from ZK on startup.
Here is the stack trace. Any clues on how to troubleshoot this error?
Did not find much help on Stackoverflow and Google.
b.s.d.executor [ERROR]
java.lang.RuntimeException: java.lang.RuntimeException: org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode for /brokers/topics/topic1/partitions
at storm.kafka.DynamicBrokersReader.getBrokerInfo(DynamicBrokersReader.java:81) ~[stormjar.jar:na]
at storm.kafka.trident.ZkBrokerReader.<init>(ZkBrokerReader.java:42) ~[stormjar.jar:na]
at storm.kafka.KafkaUtils.makeBrokerReader(KafkaUtils.java:57) ~[stormjar.jar:na]
at storm.kafka.KafkaSpout.open(KafkaSpout.java:87) ~[stormjar.jar:na]
at backtype.storm.daemon.executor$fn_4081$fn_4096.invoke(executor.clj:519) ~[storm-core-0.9.1.2.1.7.1-11.jar:0.9.1.2.1.7.1-11]
at backtype.storm.util$async_loop$fn__444.invoke(util.clj:434) ~[storm-core-0.9.1.2.1.7.1-11.jar:0.9.1.2.1.7.1-11]
at clojure.lang.AFn.run(AFn.java:24) [clojure-1.4.0.jar:na]
at java.lang.Thread.run(Thread.java:744) [na:1.7.0_45]
Caused by: java.lang.RuntimeException: org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode for /brokers/topics/controllerlog_preprod/partitions
at storm.kafka.DynamicBrokersReader.getNumPartitions(DynamicBrokersReader.java:94) ~[stormjar.jar:na]
at storm.kafka.DynamicBrokersReader.getBrokerInfo(DynamicBrokersReader.java:65) ~[stormjar.jar:na]
... 7 common frames omitted
Caused by: org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode for /brokers/topics/topic1/partitions
at org.apache.zookeeper.KeeperException.create(KeeperException.java:111) ~[zookeeper-3.4.5.2.1.7.1-11.jar:3.4.5-11--1]
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51) ~[zookeeper-3.4.5.2.1.7.1-11.jar:3.4.5-11--1]
at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1586) ~[zookeeper-3.4.5.2.1.7.1-11.jar:3.4.5-11--1]
at org.apache.curator.framework.imps.GetChildrenBuilderImpl$3.call(GetChildrenBuilderImpl.java:214) ~[stormjar.jar:na]
at org.apache.curator.framework.imps.GetChildrenBuilderImpl$3.call(GetChildrenBuilderImpl.java:203) ~[stormjar.jar:na]
at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:107) ~[stormjar.jar:na]
at org.apache.curator.framework.imps.GetChildrenBuilderImpl.pathInForeground(GetChildrenBuilderImpl.java:199) ~[stormjar.jar:na]
at org.apache.curator.framework.imps.GetChildrenBuilderImpl.forPath(GetChildrenBuilderImpl.java:191) ~[stormjar.jar:na]
at org.apache.curator.framework.imps.GetChildrenBuilderImpl.forPath(GetChildrenBuilderImpl.java:38) ~[stormjar.jar:na]
at storm.kafka.DynamicBrokersReader.getNumPartitions(DynamicBrokersReader.java:91) ~[stormjar.jar:na]
... 8 common frames omitted
Re: Strom Kafka spout has sporadic issue with figuring out
partition info from ZK on startup
Posted by Harsha <st...@harsha.io>.
Are you using separate zk clusters for storm and kafka. If so which zookeepers did you configure for kafka spout.
--
Harsha
Sent with Airmail
On May 12, 2015 at 8:40:26 PM, rajesh_kalluri@dellteam.com (rajesh_kalluri@dellteam.com) wrote:
Dell - Internal Use - Confidential
Strom Kafka spout has sporadic issue with figuring out partition info from ZK on startup.
Here is the stack trace. Any clues on how to troubleshoot this error?
Did not find much help on Stackoverflow and Google.
b.s.d.executor [ERROR]
java.lang.RuntimeException: java.lang.RuntimeException: org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode for /brokers/topics/topic1/partitions
at storm.kafka.DynamicBrokersReader.getBrokerInfo(DynamicBrokersReader.java:81) ~[stormjar.jar:na]
at storm.kafka.trident.ZkBrokerReader.<init>(ZkBrokerReader.java:42) ~[stormjar.jar:na]
at storm.kafka.KafkaUtils.makeBrokerReader(KafkaUtils.java:57) ~[stormjar.jar:na]
at storm.kafka.KafkaSpout.open(KafkaSpout.java:87) ~[stormjar.jar:na]
at backtype.storm.daemon.executor$fn_4081$fn_4096.invoke(executor.clj:519) ~[storm-core-0.9.1.2.1.7.1-11.jar:0.9.1.2.1.7.1-11]
at backtype.storm.util$async_loop$fn__444.invoke(util.clj:434) ~[storm-core-0.9.1.2.1.7.1-11.jar:0.9.1.2.1.7.1-11]
at clojure.lang.AFn.run(AFn.java:24) [clojure-1.4.0.jar:na]
at java.lang.Thread.run(Thread.java:744) [na:1.7.0_45]
Caused by: java.lang.RuntimeException: org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode for /brokers/topics/controllerlog_preprod/partitions
at storm.kafka.DynamicBrokersReader.getNumPartitions(DynamicBrokersReader.java:94) ~[stormjar.jar:na]
at storm.kafka.DynamicBrokersReader.getBrokerInfo(DynamicBrokersReader.java:65) ~[stormjar.jar:na]
... 7 common frames omitted
Caused by: org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode for /brokers/topics/topic1/partitions
at org.apache.zookeeper.KeeperException.create(KeeperException.java:111) ~[zookeeper-3.4.5.2.1.7.1-11.jar:3.4.5-11--1]
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51) ~[zookeeper-3.4.5.2.1.7.1-11.jar:3.4.5-11--1]
at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1586) ~[zookeeper-3.4.5.2.1.7.1-11.jar:3.4.5-11--1]
at org.apache.curator.framework.imps.GetChildrenBuilderImpl$3.call(GetChildrenBuilderImpl.java:214) ~[stormjar.jar:na]
at org.apache.curator.framework.imps.GetChildrenBuilderImpl$3.call(GetChildrenBuilderImpl.java:203) ~[stormjar.jar:na]
at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:107) ~[stormjar.jar:na]
at org.apache.curator.framework.imps.GetChildrenBuilderImpl.pathInForeground(GetChildrenBuilderImpl.java:199) ~[stormjar.jar:na]
at org.apache.curator.framework.imps.GetChildrenBuilderImpl.forPath(GetChildrenBuilderImpl.java:191) ~[stormjar.jar:na]
at org.apache.curator.framework.imps.GetChildrenBuilderImpl.forPath(GetChildrenBuilderImpl.java:38) ~[stormjar.jar:na]
at storm.kafka.DynamicBrokersReader.getNumPartitions(DynamicBrokersReader.java:91) ~[stormjar.jar:na]
... 8 common frames omitted