kafka consumer group is rebalancing

[Sunny Gupta <su...@gmail.com>]

Hi,
I am using Kafka .9 and new Java consumer. I am polling inside a loop. I am
getting commitfailedexcption because of group rebalance, when code try to
execute consumer.commitSycn . Please note, I am adding session.timeout.ms
as 30000 and heartbeat.interval.ms as 10000 to consumer and polling happens
for sure with in 30000. Can anyone help me out. Please let me know if any
information is needed.
I am using 3 node kafka cluster.
Thanks,
Sunny

Re: kafka consumer group is rebalancing

[Liquan Pei <li...@gmail.com>]

Hi Sunny,

It would be helpful to know the processing logic after the records are
returned by poll(). How do you make sure that the polling is happening
within session timeout? Did you try to reduce the number of messages
returned by setting max.poll.records to a smaller value?

Thanks,
Liquan

On Mon, May 30, 2016 at 7:30 AM, Sunny Gupta <su...@gmail.com>
wrote:

> Hi,
> I am using Kafka .9 and new Java consumer. I am polling inside a loop. I am
> getting commitfailedexcption because of group rebalance, when code try to
> execute consumer.commitSycn . Please note, I am adding session.timeout.ms
> as 30000 and heartbeat.interval.ms as 10000 to consumer and polling
> happens
> for sure with in 30000. Can anyone help me out. Please let me know if any
> information is needed.
> I am using 3 node kafka cluster.
> Thanks,
> Sunny
>



-- 
Liquan Pei
Software Engineer, Confluent Inc