You are viewing a plain text version of this content. The canonical link for it is here.

Posted to users@kafka.apache.org by Gourab Chowdhury <go...@gmail.com> on 2016/09/29 13:47:07 UTC

To find the Lag of consumer offset using kafka client library

I can get the *Lag* of offsets with the following command:-

bin/kafka-run-class.sh kafka.admin.ConsumerGroupCommand --zookeeper
localhost:2182 --describe --group DemoConsumer

I am trying to find code that uses kafka library to find the *Lag* of
offsets in consumer?

Also is there any other documentation other than https://github.com/apache/
kafka/tree/trunk/docs? I can't find much documentation of kafka.

Thanks,
Gourab Chowdhury,
Software Engg. JunctionTV Inc.

Re: To find the Lag of consumer offset using kafka client library

Posted by Anish Mashankar <an...@systeminsights.com>.

Yes. kafka.admin helps. You can create an application that resembles the
ConsumerGroupCommand.scala to get consumer offsets for both old and new
consumers.

On Thu, 29 Sep 2016, 8:17 p.m. Gourab Chowdhury, <go...@gmail.com>
wrote:

> Thanks for your suggestion, I had previously read about Yahoo Kafka monitor
> as suggested some where.
>
> What I actually need is function/class in kafka java libaray (if any) that
> helps to find the lag and other details? Can kafka.admin help in this
> matter?
>
> A code snippet equivalent to:-
> bin/kafka-consumer-groups.sh --zookeeper localhost:2182 --describe --group
> DemoConsumer
> bin/kafka-run-class.sh kafka.admin.ConsumerGroupCommand --zookeeper
> localhost:2182 --describe --group DemoConsumer
>
> Thanks
> Gourab
>
> On Thu, Sep 29, 2016 at 7:19 PM, Jan Omar <ja...@wooga.net> wrote:
>
> >
> > Hi Gourab,
> >
> > Check this out:
> >
> > https://github.com/linkedin/Burrow <https://github.com/linkedin/Burrow>
> >
> > Regards
> >
> > Jan
> >
> > > On 29 Sep 2016, at 15:47, Gourab Chowdhury <go...@gmail.com>
> wrote:
> > >
> > > I can get the *Lag* of offsets with the following command:-
> > >
> > > bin/kafka-run-class.sh kafka.admin.ConsumerGroupCommand --zookeeper
> > > localhost:2182 --describe --group DemoConsumer
> > >
> > > I am trying to find code that uses kafka library to find the *Lag* of
> > > offsets in consumer?
> > >
> > > Also is there any other documentation other than
> > https://github.com/apache/
> > > kafka/tree/trunk/docs? I can't find much documentation of kafka.
> > >
> > > Thanks,
> > > Gourab Chowdhury,
> > > Software Engg. JunctionTV Inc.
> >
> >
>

Re: To find the Lag of consumer offset using kafka client library

Posted by Gourab Chowdhury <go...@gmail.com>.

Thanks for your suggestion, I had previously read about Yahoo Kafka monitor
as suggested some where.

What I actually need is function/class in kafka java libaray (if any) that
helps to find the lag and other details? Can kafka.admin help in this
matter?

A code snippet equivalent to:-
bin/kafka-consumer-groups.sh --zookeeper localhost:2182 --describe --group
DemoConsumer
bin/kafka-run-class.sh kafka.admin.ConsumerGroupCommand --zookeeper
localhost:2182 --describe --group DemoConsumer

Thanks
Gourab

On Thu, Sep 29, 2016 at 7:19 PM, Jan Omar <ja...@wooga.net> wrote:

>
> Hi Gourab,
>
> Check this out:
>
> https://github.com/linkedin/Burrow <https://github.com/linkedin/Burrow>
>
> Regards
>
> Jan
>
> > On 29 Sep 2016, at 15:47, Gourab Chowdhury <go...@gmail.com> wrote:
> >
> > I can get the *Lag* of offsets with the following command:-
> >
> > bin/kafka-run-class.sh kafka.admin.ConsumerGroupCommand --zookeeper
> > localhost:2182 --describe --group DemoConsumer
> >
> > I am trying to find code that uses kafka library to find the *Lag* of
> > offsets in consumer?
> >
> > Also is there any other documentation other than
> https://github.com/apache/
> > kafka/tree/trunk/docs? I can't find much documentation of kafka.
> >
> > Thanks,
> > Gourab Chowdhury,
> > Software Engg. JunctionTV Inc.
>
>

Re: To find the Lag of consumer offset using kafka client library

Posted by Jan Omar <ja...@wooga.net>.

Hi Gourab,

Check this out:

https://github.com/linkedin/Burrow <https://github.com/linkedin/Burrow>

Regards

Jan

> On 29 Sep 2016, at 15:47, Gourab Chowdhury <go...@gmail.com> wrote:
> 
> I can get the *Lag* of offsets with the following command:-
> 
> bin/kafka-run-class.sh kafka.admin.ConsumerGroupCommand --zookeeper
> localhost:2182 --describe --group DemoConsumer
> 
> I am trying to find code that uses kafka library to find the *Lag* of
> offsets in consumer?
> 
> Also is there any other documentation other than https://github.com/apache/
> kafka/tree/trunk/docs? I can't find much documentation of kafka.
> 
> Thanks,
> Gourab Chowdhury,
> Software Engg. JunctionTV Inc.