You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@kafka.apache.org by Saurabh Daftary <sa...@gmail.com> on 2016/03/20 19:31:59 UTC
Consumer 0.9 /Broker 0.9.0.1 - for certain partitions, the commit
offset in kafka alway gets rewinded to a fixed point
I am seeing a very wired issue with my consumer group when running consumer
0.9 with broker 0.9.0.1. On adding or removing consumers, it seems that for
certain partitions the commit offset in kafka alway gets rewinded to a
fixed point.
When I run the below command over time to look at my consumer group:
bin/kafka-consumer-groups.sh --describe --group consumer-gp-1 --new-consumer
--bootstrap-server localhost:9092
I notice that for certain partitions the consumer offsets gets always reset
back to a fixed point. See an example below(Each line represents the result
of running the above command at different times (~1 min apart) for a
particular partition):
consumer-gp-1, topic-1, 54, 6682915, 8264593, 1581678, consumer-5_/
172.18.5.49
consumer-gp-1, topic-1, 54, 6852270, 8265027, 1412757, consumer-5_/
172.18.5.49
consumer-gp-1, topic-1, 54, 6682915, 8265252, 1582337, consumer-5_/
172.18.5.49
consumer-gp-1, topic-1, 54, 6865345, 8265457, 1400112, consumer-5_/
172.18.5.49
consumer-gp-1, 54, 6682915, 8266152, 1583237, consumer-5_/172.18.5.49
In the above case, for partition 54 - the consumer offset will move ahead
but then always come back again to 6682915
Any inputs on how could I go about debugging this?
Re: Consumer 0.9 /Broker 0.9.0.1 - for certain partitions, the commit
offset in kafka alway gets rewinded to a fixed point
Posted by Ismael Juma <is...@juma.me.uk>.
See here for important issues fixed in 0.9.0.1:
http://www.confluent.io/blog/announcing-apache-kafka-0.9.0.1-and-confluent-platform-2.0.1
Upgrading is highly recommended.
Ismael
On Sun, Mar 20, 2016 at 11:20 PM, Saurabh Daftary <saurabh.daftary@gmail.com
> wrote:
> Yes, I do mean 0.9.0.0. I am planning to upgrade to 0.9.0.1 but was
> wondering if this was a known issue in 0.9.0.0
>
> On Sun, Mar 20, 2016 at 11:31 AM, Saurabh Daftary <
> saurabh.daftary@gmail.com
> > wrote:
>
> > I am seeing a very wired issue with my consumer group when running
> > consumer 0.9 with broker 0.9.0.1. On adding or removing consumers, it
> > seems that for certain partitions the commit offset in kafka alway gets
> > rewinded to a fixed point.
> >
> > When I run the below command over time to look at my consumer group:
> >
> > bin/kafka-consumer-groups.sh --describe --group consumer-gp-1
> --new-consumer
> > --bootstrap-server localhost:9092
> >
> > I notice that for certain partitions the consumer offsets gets always
> > reset back to a fixed point. See an example below(Each line represents
> the
> > result of running the above command at different times (~1 min apart)
> for a
> > particular partition):
> >
> > consumer-gp-1, topic-1, 54, 6682915, 8264593, 1581678, consumer-5_/
> > 172.18.5.49
> > consumer-gp-1, topic-1, 54, 6852270, 8265027, 1412757, consumer-5_/
> > 172.18.5.49
> > consumer-gp-1, topic-1, 54, 6682915, 8265252, 1582337, consumer-5_/
> > 172.18.5.49
> > consumer-gp-1, topic-1, 54, 6865345, 8265457, 1400112, consumer-5_/
> > 172.18.5.49
> > consumer-gp-1, 54, 6682915, 8266152, 1583237, consumer-5_/172.18.5.49
> >
> > In the above case, for partition 54 - the consumer offset will move ahead
> > but then always come back again to 6682915
> >
> > Any inputs on how could I go about debugging this?
> >
>
Re: Consumer 0.9 /Broker 0.9.0.1 - for certain partitions, the commit
offset in kafka alway gets rewinded to a fixed point
Posted by Saurabh Daftary <sa...@gmail.com>.
Yes, I do mean 0.9.0.0. I am planning to upgrade to 0.9.0.1 but was
wondering if this was a known issue in 0.9.0.0
On Sun, Mar 20, 2016 at 11:31 AM, Saurabh Daftary <saurabh.daftary@gmail.com
> wrote:
> I am seeing a very wired issue with my consumer group when running
> consumer 0.9 with broker 0.9.0.1. On adding or removing consumers, it
> seems that for certain partitions the commit offset in kafka alway gets
> rewinded to a fixed point.
>
> When I run the below command over time to look at my consumer group:
>
> bin/kafka-consumer-groups.sh --describe --group consumer-gp-1 --new-consumer
> --bootstrap-server localhost:9092
>
> I notice that for certain partitions the consumer offsets gets always
> reset back to a fixed point. See an example below(Each line represents the
> result of running the above command at different times (~1 min apart) for a
> particular partition):
>
> consumer-gp-1, topic-1, 54, 6682915, 8264593, 1581678, consumer-5_/
> 172.18.5.49
> consumer-gp-1, topic-1, 54, 6852270, 8265027, 1412757, consumer-5_/
> 172.18.5.49
> consumer-gp-1, topic-1, 54, 6682915, 8265252, 1582337, consumer-5_/
> 172.18.5.49
> consumer-gp-1, topic-1, 54, 6865345, 8265457, 1400112, consumer-5_/
> 172.18.5.49
> consumer-gp-1, 54, 6682915, 8266152, 1583237, consumer-5_/172.18.5.49
>
> In the above case, for partition 54 - the consumer offset will move ahead
> but then always come back again to 6682915
>
> Any inputs on how could I go about debugging this?
>
Re: Consumer 0.9 /Broker 0.9.0.1 - for certain partitions, the commit
offset in kafka alway gets rewinded to a fixed point
Posted by Ismael Juma <is...@juma.me.uk>.
Hi Saurabh,
When you say Consumer 0.9, do you mean 0.9.0.0? If so, you should really
upgrade to 0.9.0.1 as it contains a number of important fixes.
Ismael
On Sun, Mar 20, 2016 at 6:31 PM, Saurabh Daftary <sa...@gmail.com>
wrote:
> I am seeing a very wired issue with my consumer group when running consumer
> 0.9 with broker 0.9.0.1. On adding or removing consumers, it seems that for
> certain partitions the commit offset in kafka alway gets rewinded to a
> fixed point.
>
> When I run the below command over time to look at my consumer group:
>
> bin/kafka-consumer-groups.sh --describe --group consumer-gp-1
> --new-consumer
> --bootstrap-server localhost:9092
>
> I notice that for certain partitions the consumer offsets gets always reset
> back to a fixed point. See an example below(Each line represents the result
> of running the above command at different times (~1 min apart) for a
> particular partition):
>
> consumer-gp-1, topic-1, 54, 6682915, 8264593, 1581678, consumer-5_/
> 172.18.5.49
> consumer-gp-1, topic-1, 54, 6852270, 8265027, 1412757, consumer-5_/
> 172.18.5.49
> consumer-gp-1, topic-1, 54, 6682915, 8265252, 1582337, consumer-5_/
> 172.18.5.49
> consumer-gp-1, topic-1, 54, 6865345, 8265457, 1400112, consumer-5_/
> 172.18.5.49
> consumer-gp-1, 54, 6682915, 8266152, 1583237, consumer-5_/172.18.5.49
>
> In the above case, for partition 54 - the consumer offset will move ahead
> but then always come back again to 6682915
>
> Any inputs on how could I go about debugging this?
>