You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@kafka.apache.org by "Yu, Libo " <li...@citi.com> on 2013/09/10 16:59:38 UTC
monitoring followers' lag
Hi team,
I wonder if anybody can give detailed instructions on how to monitor
the followers' lag by using JMX. Thanks.
Regards,
Libo
Re: monitoring followers' lag
Posted by Siyuan he <hs...@gmail.com>.
Hi Joel,
Thanks for helping.
I think we found the reason here:
We check out and build kafka before jmx metrics added to
AbstractFetcherManager.
Thanks,
Siyuan
On Wednesday, September 11, 2013, Joel Koshy <jj...@gmail.com> wrote:
> That's weird - it should just work - can you try this:
>
> you would have to start your Kafka broker with a JMX port - should be
> by default, otherwise use JMX_PORT=xxxx <start broker>
>
> ./bin/kafka-run-class.sh kafka.tools.JmxTool --object-name
> '"kafka.server":type="ReplicaFetcherManager",name="Replica-MaxLag"'
> --jmx-url service:jmx:rmi:///jndi/rmi://localhost:9999/jmxrmi
>
"time",""kafka.server":type="ReplicaFetcherManager",name="Replica-MaxLag":Value"
> 1378924115441,0
> 1378924117442,0
>
> On Wed, Sep 11, 2013 at 10:29 AM, Yu, Libo <li...@citi.com> wrote:
>> Hi Joel,
>>
>> I cannot find such a value. My teammate also cannot find it.
>> There is no ReplicaFetcherManager underl kafka.server.
>> There is only a ReplicaManager but there is no MaxLag
>> under it.
>>
>> Regards,
>>
>> Libo
>>
>>
>> -----Original Message-----
>> From: Joel Koshy [mailto:jjkoshy.w@gmail.com]
>> Sent: Tuesday, September 10, 2013 8:48 PM
>> To: users@kafka.apache.org
>> Subject: Re: monitoring followers' lag
>>
>> It should be
"kafka.server":type="ReplicaFetcherManager",name="Replica-MaxLag"
>> - can you confirm and mind updating the wiki if this is the case?
>>
>> Thanks,
>>
>> Joel
>>
>> On Tue, Sep 10, 2013 at 10:38 AM, Yu, Libo <li...@citi.com> wrote:
>>> I have run JConsole. But I cannot find
>>> "kafka.server":name="([-.\w]+)-MaxLag", type="ReplicaFetcherManager"
>>>
>>> I am running 0.8 beta1. It seems ReplicaFetcherManager has not been
>>> added to this version.
>>>
>>> Regards,
>>>
>>> Libo
>>>
>>>
>>> -----Original Message-----
>>> From: Jun Rao [mailto:junrao@gmail.com]
>>> Sent: Tuesday, September 10, 2013 11:01 AM
>>> To: users@kafka.apache.org
>>> Subject: Re: monitoring followers' lag
>>>
>>> Have you looked at the updated docs in
>>> http://kafka.apache.org/documentation.html#monitoring ?
>>>
>>> Thanks,
>>>
>>> Jun
>>>
>>>
>>> On Tue, Sep 10, 2013 at 7:59 AM, Yu, Libo <li...@citi.com> wrote:
>>>
>>>> Hi team,
>>>>
>>>> I wonder if anybody can give detailed instructions on how to monitor
>>>> the followers' lag by using JMX. Thanks.
>>>>
>>>> Regards,
>>>>
>>>> Libo
>>>>
>>>>
>
Re: monitoring followers' lag
Posted by Joel Koshy <jj...@gmail.com>.
That's weird - it should just work - can you try this:
you would have to start your Kafka broker with a JMX port - should be
by default, otherwise use JMX_PORT=xxxx <start broker>
./bin/kafka-run-class.sh kafka.tools.JmxTool --object-name
'"kafka.server":type="ReplicaFetcherManager",name="Replica-MaxLag"'
--jmx-url service:jmx:rmi:///jndi/rmi://localhost:9999/jmxrmi
"time",""kafka.server":type="ReplicaFetcherManager",name="Replica-MaxLag":Value"
1378924115441,0
1378924117442,0
On Wed, Sep 11, 2013 at 10:29 AM, Yu, Libo <li...@citi.com> wrote:
> Hi Joel,
>
> I cannot find such a value. My teammate also cannot find it.
> There is no ReplicaFetcherManager underl kafka.server.
> There is only a ReplicaManager but there is no MaxLag
> under it.
>
> Regards,
>
> Libo
>
>
> -----Original Message-----
> From: Joel Koshy [mailto:jjkoshy.w@gmail.com]
> Sent: Tuesday, September 10, 2013 8:48 PM
> To: users@kafka.apache.org
> Subject: Re: monitoring followers' lag
>
> It should be "kafka.server":type="ReplicaFetcherManager",name="Replica-MaxLag"
> - can you confirm and mind updating the wiki if this is the case?
>
> Thanks,
>
> Joel
>
> On Tue, Sep 10, 2013 at 10:38 AM, Yu, Libo <li...@citi.com> wrote:
>> I have run JConsole. But I cannot find
>> "kafka.server":name="([-.\w]+)-MaxLag", type="ReplicaFetcherManager"
>>
>> I am running 0.8 beta1. It seems ReplicaFetcherManager has not been
>> added to this version.
>>
>> Regards,
>>
>> Libo
>>
>>
>> -----Original Message-----
>> From: Jun Rao [mailto:junrao@gmail.com]
>> Sent: Tuesday, September 10, 2013 11:01 AM
>> To: users@kafka.apache.org
>> Subject: Re: monitoring followers' lag
>>
>> Have you looked at the updated docs in
>> http://kafka.apache.org/documentation.html#monitoring ?
>>
>> Thanks,
>>
>> Jun
>>
>>
>> On Tue, Sep 10, 2013 at 7:59 AM, Yu, Libo <li...@citi.com> wrote:
>>
>>> Hi team,
>>>
>>> I wonder if anybody can give detailed instructions on how to monitor
>>> the followers' lag by using JMX. Thanks.
>>>
>>> Regards,
>>>
>>> Libo
>>>
>>>
RE: monitoring followers' lag
Posted by "Yu, Libo " <li...@citi.com>.
Hi Joel,
I cannot find such a value. My teammate also cannot find it.
There is no ReplicaFetcherManager underl kafka.server.
There is only a ReplicaManager but there is no MaxLag
under it.
Regards,
Libo
-----Original Message-----
From: Joel Koshy [mailto:jjkoshy.w@gmail.com]
Sent: Tuesday, September 10, 2013 8:48 PM
To: users@kafka.apache.org
Subject: Re: monitoring followers' lag
It should be "kafka.server":type="ReplicaFetcherManager",name="Replica-MaxLag"
- can you confirm and mind updating the wiki if this is the case?
Thanks,
Joel
On Tue, Sep 10, 2013 at 10:38 AM, Yu, Libo <li...@citi.com> wrote:
> I have run JConsole. But I cannot find
> "kafka.server":name="([-.\w]+)-MaxLag", type="ReplicaFetcherManager"
>
> I am running 0.8 beta1. It seems ReplicaFetcherManager has not been
> added to this version.
>
> Regards,
>
> Libo
>
>
> -----Original Message-----
> From: Jun Rao [mailto:junrao@gmail.com]
> Sent: Tuesday, September 10, 2013 11:01 AM
> To: users@kafka.apache.org
> Subject: Re: monitoring followers' lag
>
> Have you looked at the updated docs in
> http://kafka.apache.org/documentation.html#monitoring ?
>
> Thanks,
>
> Jun
>
>
> On Tue, Sep 10, 2013 at 7:59 AM, Yu, Libo <li...@citi.com> wrote:
>
>> Hi team,
>>
>> I wonder if anybody can give detailed instructions on how to monitor
>> the followers' lag by using JMX. Thanks.
>>
>> Regards,
>>
>> Libo
>>
>>
Re: monitoring followers' lag
Posted by Joel Koshy <jj...@gmail.com>.
It should be "kafka.server":type="ReplicaFetcherManager",name="Replica-MaxLag"
- can you confirm and mind updating the wiki if this is the case?
Thanks,
Joel
On Tue, Sep 10, 2013 at 10:38 AM, Yu, Libo <li...@citi.com> wrote:
> I have run JConsole. But I cannot find
> "kafka.server":name="([-.\w]+)-MaxLag", type="ReplicaFetcherManager"
>
> I am running 0.8 beta1. It seems ReplicaFetcherManager has not been
> added to this version.
>
> Regards,
>
> Libo
>
>
> -----Original Message-----
> From: Jun Rao [mailto:junrao@gmail.com]
> Sent: Tuesday, September 10, 2013 11:01 AM
> To: users@kafka.apache.org
> Subject: Re: monitoring followers' lag
>
> Have you looked at the updated docs in
> http://kafka.apache.org/documentation.html#monitoring ?
>
> Thanks,
>
> Jun
>
>
> On Tue, Sep 10, 2013 at 7:59 AM, Yu, Libo <li...@citi.com> wrote:
>
>> Hi team,
>>
>> I wonder if anybody can give detailed instructions on how to monitor
>> the followers' lag by using JMX. Thanks.
>>
>> Regards,
>>
>> Libo
>>
>>
RE: monitoring followers' lag
Posted by "Yu, Libo " <li...@citi.com>.
I have run JConsole. But I cannot find
"kafka.server":name="([-.\w]+)-MaxLag", type="ReplicaFetcherManager"
I am running 0.8 beta1. It seems ReplicaFetcherManager has not been
added to this version.
Regards,
Libo
-----Original Message-----
From: Jun Rao [mailto:junrao@gmail.com]
Sent: Tuesday, September 10, 2013 11:01 AM
To: users@kafka.apache.org
Subject: Re: monitoring followers' lag
Have you looked at the updated docs in
http://kafka.apache.org/documentation.html#monitoring ?
Thanks,
Jun
On Tue, Sep 10, 2013 at 7:59 AM, Yu, Libo <li...@citi.com> wrote:
> Hi team,
>
> I wonder if anybody can give detailed instructions on how to monitor
> the followers' lag by using JMX. Thanks.
>
> Regards,
>
> Libo
>
>
RE: monitoring followers' lag
Posted by "Yu, Libo " <li...@citi.com>.
Thanks, Jun. I will try it out.
Regards,
Libo
-----Original Message-----
From: Jun Rao [mailto:junrao@gmail.com]
Sent: Tuesday, September 10, 2013 11:01 AM
To: users@kafka.apache.org
Subject: Re: monitoring followers' lag
Have you looked at the updated docs in
http://kafka.apache.org/documentation.html#monitoring ?
Thanks,
Jun
On Tue, Sep 10, 2013 at 7:59 AM, Yu, Libo <li...@citi.com> wrote:
> Hi team,
>
> I wonder if anybody can give detailed instructions on how to monitor
> the followers' lag by using JMX. Thanks.
>
> Regards,
>
> Libo
>
>
Re: monitoring followers' lag
Posted by Jun Rao <ju...@gmail.com>.
Have you looked at the updated docs in
http://kafka.apache.org/documentation.html#monitoring ?
Thanks,
Jun
On Tue, Sep 10, 2013 at 7:59 AM, Yu, Libo <li...@citi.com> wrote:
> Hi team,
>
> I wonder if anybody can give detailed instructions on how to monitor
> the followers' lag by using JMX. Thanks.
>
> Regards,
>
> Libo
>
>