You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@kafka.apache.org by Filipe Correia <fi...@nmusic.pt> on 2016/03/30 17:03:25 UTC
ConsumerRebalanceFailedException with the kafka-console-consumer (bug?)
Hi there,
I've just installed kafka 0.9.0.1, and I'm getting the following error when
launching the kafka-console-consumer:
$ bin/kafka-console-consumer.sh --zookeeper localhost:2181 --topic
myrandomtesttopic --from-beginning
[2016-03-30 15:46:17,568] ERROR Unknown error when running consumer:
(kafka.tools.ConsoleConsumer$)
*kafka.common.ConsumerRebalanceFailedException:
console-consumer-84710_stg02-1459349168698-425dcf53 can't rebalance after 4
retries*
at
kafka.consumer.ZookeeperConsumerConnector$ZKRebalancerListener.syncedRebalance(ZookeeperConsumerConnector.scala:660)
at
kafka.consumer.ZookeeperConsumerConnector.kafka$consumer$ZookeeperConsumerConnector$$reinitializeConsumer(ZookeeperConsumerConnector.scala:967)
at
kafka.consumer.ZookeeperConsumerConnector$WildcardStreamsHandler.<init>(ZookeeperConsumerConnector.scala:1001)
at
kafka.consumer.ZookeeperConsumerConnector.createMessageStreamsByFilter(ZookeeperConsumerConnector.scala:163)
at kafka.consumer.OldConsumer.<init>(BaseConsumer.scala:75)
at kafka.tools.ConsoleConsumer$.run(ConsoleConsumer.scala:63)
at kafka.tools.ConsoleConsumer$.main(ConsoleConsumer.scala:47)
at kafka.tools.ConsoleConsumer.main(ConsoleConsumer.scala)
On logs/zookeeper.out there's only:
[2016-03-30 15:46:17,902] WARN caught end of stream exception
(org.apache.zookeeper.server.NIOServerCnxn)
EndOfStreamException: Unable to read additional data from client sessionid
0x153c7e67216000e, likely client has closed socket
at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
at
org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
at java.lang.Thread.run(Thread.java:745)
[2016-03-30 15:46:17,903] INFO Closed socket connection for client /
127.0.0.1:8857 which had sessionid 0x153c7e67216000e
(org.apache.zookeeper.server.NIOServerCnxn)
[...]
Any idea what this may be about? :-\
Thanks,
Filipe
Re: ConsumerRebalanceFailedException with the kafka-console-consumer (bug?)
Posted by Cees de Groot <ce...@pagerduty.com>.
Is that a single node, local host only installation?
For starters, I'd advice you to use the --new-consumer option - it will use
what I think is a way less hairy method of doing consumer groups. W.r.t.
Zookeeper, I've found that in test installations, I often end up wiping its
data and restarting, it seems to be pretty volatile now and then (luckily,
that never happens in production ;-)).
On Wed, Mar 30, 2016 at 11:36 AM, Filipe Correia <fi...@nmusic.pt>
wrote:
> I've also asked on stackoverflow, in case you prefer to answer there:
>
> http://stackoverflow.com/questions/36313470/consumerrebalancefailedexception-with-the-kafka-console-consumer
>
> Thanks,
> Filipe
>
> On Wed, Mar 30, 2016 at 4:03 PM, Filipe Correia <fi...@nmusic.pt>
> wrote:
>
> > Hi there,
> >
> > I've just installed kafka 0.9.0.1, and I'm getting the following error
> > when launching the kafka-console-consumer:
> >
> > $ bin/kafka-console-consumer.sh --zookeeper localhost:2181 --topic
> > myrandomtesttopic --from-beginning
> > [2016-03-30 15:46:17,568] ERROR Unknown error when running consumer:
> > (kafka.tools.ConsoleConsumer$)
> > *kafka.common.ConsumerRebalanceFailedException:
> > console-consumer-84710_stg02-1459349168698-425dcf53 can't rebalance
> after 4
> > retries*
> > at
> >
> kafka.consumer.ZookeeperConsumerConnector$ZKRebalancerListener.syncedRebalance(ZookeeperConsumerConnector.scala:660)
> > at
> >
> kafka.consumer.ZookeeperConsumerConnector.kafka$consumer$ZookeeperConsumerConnector$$reinitializeConsumer(ZookeeperConsumerConnector.scala:967)
> > at
> >
> kafka.consumer.ZookeeperConsumerConnector$WildcardStreamsHandler.<init>(ZookeeperConsumerConnector.scala:1001)
> > at
> >
> kafka.consumer.ZookeeperConsumerConnector.createMessageStreamsByFilter(ZookeeperConsumerConnector.scala:163)
> > at kafka.consumer.OldConsumer.<init>(BaseConsumer.scala:75)
> > at kafka.tools.ConsoleConsumer$.run(ConsoleConsumer.scala:63)
> > at kafka.tools.ConsoleConsumer$.main(ConsoleConsumer.scala:47)
> > at kafka.tools.ConsoleConsumer.main(ConsoleConsumer.scala)
> >
> >
> > On logs/zookeeper.out there's only:
> >
> > [2016-03-30 15:46:17,902] WARN caught end of stream exception
> > (org.apache.zookeeper.server.NIOServerCnxn)
> > EndOfStreamException: Unable to read additional data from client
> sessionid
> > 0x153c7e67216000e, likely client has closed socket
> > at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
> > at
> >
> org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
> > at java.lang.Thread.run(Thread.java:745)
> > [2016-03-30 15:46:17,903] INFO Closed socket connection for client /
> > 127.0.0.1:8857 which had sessionid 0x153c7e67216000e
> > (org.apache.zookeeper.server.NIOServerCnxn)
> > [...]
> >
> >
> > Any idea what this may be about? :-\
> >
> > Thanks,
> > Filipe
> >
>
>
>
> --
> FILIPE CORREIA
> Software Engineer | NMUSIC S.A.
> +351 229 026 900 | filipe.correia@nmusic.pt
>
--
Cees de Groot
Principal Software Engineer
PagerDuty, Inc.
Re: ConsumerRebalanceFailedException with the kafka-console-consumer (bug?)
Posted by Filipe Correia <fi...@nmusic.pt>.
I've also asked on stackoverflow, in case you prefer to answer there:
http://stackoverflow.com/questions/36313470/consumerrebalancefailedexception-with-the-kafka-console-consumer
Thanks,
Filipe
On Wed, Mar 30, 2016 at 4:03 PM, Filipe Correia <fi...@nmusic.pt>
wrote:
> Hi there,
>
> I've just installed kafka 0.9.0.1, and I'm getting the following error
> when launching the kafka-console-consumer:
>
> $ bin/kafka-console-consumer.sh --zookeeper localhost:2181 --topic
> myrandomtesttopic --from-beginning
> [2016-03-30 15:46:17,568] ERROR Unknown error when running consumer:
> (kafka.tools.ConsoleConsumer$)
> *kafka.common.ConsumerRebalanceFailedException:
> console-consumer-84710_stg02-1459349168698-425dcf53 can't rebalance after 4
> retries*
> at
> kafka.consumer.ZookeeperConsumerConnector$ZKRebalancerListener.syncedRebalance(ZookeeperConsumerConnector.scala:660)
> at
> kafka.consumer.ZookeeperConsumerConnector.kafka$consumer$ZookeeperConsumerConnector$$reinitializeConsumer(ZookeeperConsumerConnector.scala:967)
> at
> kafka.consumer.ZookeeperConsumerConnector$WildcardStreamsHandler.<init>(ZookeeperConsumerConnector.scala:1001)
> at
> kafka.consumer.ZookeeperConsumerConnector.createMessageStreamsByFilter(ZookeeperConsumerConnector.scala:163)
> at kafka.consumer.OldConsumer.<init>(BaseConsumer.scala:75)
> at kafka.tools.ConsoleConsumer$.run(ConsoleConsumer.scala:63)
> at kafka.tools.ConsoleConsumer$.main(ConsoleConsumer.scala:47)
> at kafka.tools.ConsoleConsumer.main(ConsoleConsumer.scala)
>
>
> On logs/zookeeper.out there's only:
>
> [2016-03-30 15:46:17,902] WARN caught end of stream exception
> (org.apache.zookeeper.server.NIOServerCnxn)
> EndOfStreamException: Unable to read additional data from client sessionid
> 0x153c7e67216000e, likely client has closed socket
> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
> at
> org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
> at java.lang.Thread.run(Thread.java:745)
> [2016-03-30 15:46:17,903] INFO Closed socket connection for client /
> 127.0.0.1:8857 which had sessionid 0x153c7e67216000e
> (org.apache.zookeeper.server.NIOServerCnxn)
> [...]
>
>
> Any idea what this may be about? :-\
>
> Thanks,
> Filipe
>
--
FILIPE CORREIA
Software Engineer | NMUSIC S.A.
+351 229 026 900 | filipe.correia@nmusic.pt