You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@kafka.apache.org by Arunim Chopra <ar...@gmail.com> on 2019/03/01 11:46:59 UTC
Alternative of (kafka-consumer-groups.sh --describe) in java clients
library to get consumer lag
Hi ,
I want to know if there is any alternative of (kafka-consumer-groups.sh
--describe) in java clients library so that I can get consumer lag per
client id.
Regards,
Arunim Chopra
Re: Alternative of (kafka-consumer-groups.sh --describe) in java
clients library to get consumer lag
Posted by Jonathan Santilli <jo...@gmail.com>.
Maybe you can take a look to https://github.com/yahoo/kafka-manager
It allows you to get the info in a Webpage though.
Cheers!
--
Jonathan
On Fri, Mar 1, 2019 at 1:19 PM Arunim Chopra <ar...@gmail.com> wrote:
> Hi Randall,
> There are many monitoring tools which gives the exact information as
> *kafka-consumer-groups.sh
> --describe. *I do not know how they are doing it. I have explored Kafka
> Admin Client as well. There we have a *describeConsumerGroups() *api but it
> does not give us the consumer lag. I am able to get client id committed
> offsets from kafka admin client but I do not know how to get topic log end
> offsets without creating a consumer for each partition. There should be
> direct way to get that.
>
> Regards,
> Arunim Chopra
>
> On Fri, 1 Mar 2019 at 18:43, Randall Svancara <rs...@whitepages.com>
> wrote:
>
> > I see what you mean now. I have not seen anything like this as well.
> > That would be very useful.
> >
> > On 3/1/19, 5:12 AM, "Arunim Chopra" <ar...@gmail.com> wrote:
> >
> > Hi Randall,
> > I think Burrow tracks the consumer lags of group ids and not client
> ids
> > within the group ids. I need the consumer lag of each client id as
> well
> > like *kafka-consumer-groups.sh --describe *gives but I have not found
> > any
> > alternative of this command in java clients library.
> > Regards,
> > Arunim Chopra
> >
> > On Fri, 1 Mar 2019 at 17:50, Randall Svancara <
> > rsvancara@whitepages.com>
> > wrote:
> >
> > > There is a tool called burrow that can do this. It requires a bit
> > more
> > > setup and has a GUI web interface.
> > > https://github.com/linkedin/Burrow
> > >
> > > Get Outlook for Android<https://aka.ms/ghei36>
> > >
> > > ________________________________
> > > From: Arunim Chopra <ar...@gmail.com>
> > > Sent: Friday, March 1, 2019 3:46:59 AM
> > > To: users@kafka.apache.org
> > > Subject: Alternative of (kafka-consumer-groups.sh --describe) in
> java
> > > clients library to get consumer lag
> > >
> > > Hi ,
> > > I want to know if there is any alternative of
> > (kafka-consumer-groups.sh
> > > --describe) in java clients library so that I can get consumer lag
> > per
> > > client id.
> > >
> > > Regards,
> > > Arunim Chopra
> > >
> >
> >
> >
>
--
Santilli Jonathan
Re: Alternative of (kafka-consumer-groups.sh --describe) in java
clients library to get consumer lag
Posted by Arunim Chopra <ar...@gmail.com>.
Hi Randall,
There are many monitoring tools which gives the exact information as
*kafka-consumer-groups.sh
--describe. *I do not know how they are doing it. I have explored Kafka
Admin Client as well. There we have a *describeConsumerGroups() *api but it
does not give us the consumer lag. I am able to get client id committed
offsets from kafka admin client but I do not know how to get topic log end
offsets without creating a consumer for each partition. There should be
direct way to get that.
Regards,
Arunim Chopra
On Fri, 1 Mar 2019 at 18:43, Randall Svancara <rs...@whitepages.com>
wrote:
> I see what you mean now. I have not seen anything like this as well.
> That would be very useful.
>
> On 3/1/19, 5:12 AM, "Arunim Chopra" <ar...@gmail.com> wrote:
>
> Hi Randall,
> I think Burrow tracks the consumer lags of group ids and not client ids
> within the group ids. I need the consumer lag of each client id as well
> like *kafka-consumer-groups.sh --describe *gives but I have not found
> any
> alternative of this command in java clients library.
> Regards,
> Arunim Chopra
>
> On Fri, 1 Mar 2019 at 17:50, Randall Svancara <
> rsvancara@whitepages.com>
> wrote:
>
> > There is a tool called burrow that can do this. It requires a bit
> more
> > setup and has a GUI web interface.
> > https://github.com/linkedin/Burrow
> >
> > Get Outlook for Android<https://aka.ms/ghei36>
> >
> > ________________________________
> > From: Arunim Chopra <ar...@gmail.com>
> > Sent: Friday, March 1, 2019 3:46:59 AM
> > To: users@kafka.apache.org
> > Subject: Alternative of (kafka-consumer-groups.sh --describe) in java
> > clients library to get consumer lag
> >
> > Hi ,
> > I want to know if there is any alternative of
> (kafka-consumer-groups.sh
> > --describe) in java clients library so that I can get consumer lag
> per
> > client id.
> >
> > Regards,
> > Arunim Chopra
> >
>
>
>
Re: Alternative of (kafka-consumer-groups.sh --describe) in java
clients library to get consumer lag
Posted by Randall Svancara <rs...@whitepages.com>.
I see what you mean now. I have not seen anything like this as well. That would be very useful.
On 3/1/19, 5:12 AM, "Arunim Chopra" <ar...@gmail.com> wrote:
Hi Randall,
I think Burrow tracks the consumer lags of group ids and not client ids
within the group ids. I need the consumer lag of each client id as well
like *kafka-consumer-groups.sh --describe *gives but I have not found any
alternative of this command in java clients library.
Regards,
Arunim Chopra
On Fri, 1 Mar 2019 at 17:50, Randall Svancara <rs...@whitepages.com>
wrote:
> There is a tool called burrow that can do this. It requires a bit more
> setup and has a GUI web interface.
> https://github.com/linkedin/Burrow
>
> Get Outlook for Android<https://aka.ms/ghei36>
>
> ________________________________
> From: Arunim Chopra <ar...@gmail.com>
> Sent: Friday, March 1, 2019 3:46:59 AM
> To: users@kafka.apache.org
> Subject: Alternative of (kafka-consumer-groups.sh --describe) in java
> clients library to get consumer lag
>
> Hi ,
> I want to know if there is any alternative of (kafka-consumer-groups.sh
> --describe) in java clients library so that I can get consumer lag per
> client id.
>
> Regards,
> Arunim Chopra
>
Re: Alternative of (kafka-consumer-groups.sh --describe) in java
clients library to get consumer lag
Posted by Arunim Chopra <ar...@gmail.com>.
Hi Randall,
I think Burrow tracks the consumer lags of group ids and not client ids
within the group ids. I need the consumer lag of each client id as well
like *kafka-consumer-groups.sh --describe *gives but I have not found any
alternative of this command in java clients library.
Regards,
Arunim Chopra
On Fri, 1 Mar 2019 at 17:50, Randall Svancara <rs...@whitepages.com>
wrote:
> There is a tool called burrow that can do this. It requires a bit more
> setup and has a GUI web interface.
> https://github.com/linkedin/Burrow
>
> Get Outlook for Android<https://aka.ms/ghei36>
>
> ________________________________
> From: Arunim Chopra <ar...@gmail.com>
> Sent: Friday, March 1, 2019 3:46:59 AM
> To: users@kafka.apache.org
> Subject: Alternative of (kafka-consumer-groups.sh --describe) in java
> clients library to get consumer lag
>
> Hi ,
> I want to know if there is any alternative of (kafka-consumer-groups.sh
> --describe) in java clients library so that I can get consumer lag per
> client id.
>
> Regards,
> Arunim Chopra
>
Re: Alternative of (kafka-consumer-groups.sh --describe) in java
clients library to get consumer lag
Posted by Randall Svancara <rs...@whitepages.com>.
There is a tool called burrow that can do this. It requires a bit more setup and has a GUI web interface.
https://github.com/linkedin/Burrow
Get Outlook for Android<https://aka.ms/ghei36>
________________________________
From: Arunim Chopra <ar...@gmail.com>
Sent: Friday, March 1, 2019 3:46:59 AM
To: users@kafka.apache.org
Subject: Alternative of (kafka-consumer-groups.sh --describe) in java clients library to get consumer lag
Hi ,
I want to know if there is any alternative of (kafka-consumer-groups.sh
--describe) in java clients library so that I can get consumer lag per
client id.
Regards,
Arunim Chopra