You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@kafka.apache.org by Vimpy Batra <vi...@yahoo.com> on 2013/09/18 23:20:56 UTC

Using Kafka Metrics

Hi,

I am using Kafka-0.8 and have a module to write metrics to Graphite. I have a multi node cluster and was wondering if I need to enable metrics reporting on all of them. Any advice will be helpful.

Thanks,

Re: Using Kafka Metrics

Posted by Neha Narkhede <ne...@gmail.com>.
Each broker will only report metrics for the partitions that exist on that
broker. In order to get a global view of metrics, you will need to collect
metrics from all brokers.

Thanks,
Neha


On Wed, Sep 18, 2013 at 3:07 PM, Vimpy Batra <vi...@yahoo.com> wrote:

> In case there are multiple brokers, is there an overlap in the metric
> values they report? Let's say a topic is partitioned onto multiple broker
> nodes and we want topic level metrics. Will all the brokers be reporting
> the same value?
> Should we tap into one broker to get all the metrics or do we need to
> capture metrics from all the brokers?
>
> Thanks
>
>
> On Sep 18, 2013, at 2:55 PM, Neha Narkhede <ne...@gmail.com>
> wrote:
>
> > If you start a Kafka broker, it should start reporting metrics
> > automatically. But I'm not sure if I understood your question completely.
> > Can you elaborate on what problem you saw with metrics collection?
> >
> > Thanks,
> > Neha
> >
> >
> > On Wed, Sep 18, 2013 at 2:20 PM, Vimpy Batra <vi...@yahoo.com>
> wrote:
> >
> >> Hi,
> >>
> >> I am using Kafka-0.8 and have a module to write metrics to Graphite. I
> >> have a multi node cluster and was wondering if I need to enable metrics
> >> reporting on all of them. Any advice will be helpful.
> >>
> >> Thanks,
> >>
> >>
>

Re: Using Kafka Metrics

Posted by Vimpy Batra <vi...@yahoo.com>.
In case there are multiple brokers, is there an overlap in the metric values they report? Let's say a topic is partitioned onto multiple broker nodes and we want topic level metrics. Will all the brokers be reporting the same value? 
Should we tap into one broker to get all the metrics or do we need to capture metrics from all the brokers?

Thanks


On Sep 18, 2013, at 2:55 PM, Neha Narkhede <ne...@gmail.com> wrote:

> If you start a Kafka broker, it should start reporting metrics
> automatically. But I'm not sure if I understood your question completely.
> Can you elaborate on what problem you saw with metrics collection?
> 
> Thanks,
> Neha
> 
> 
> On Wed, Sep 18, 2013 at 2:20 PM, Vimpy Batra <vi...@yahoo.com> wrote:
> 
>> Hi,
>> 
>> I am using Kafka-0.8 and have a module to write metrics to Graphite. I
>> have a multi node cluster and was wondering if I need to enable metrics
>> reporting on all of them. Any advice will be helpful.
>> 
>> Thanks,
>> 
>>

Re: Using Kafka Metrics

Posted by Neha Narkhede <ne...@gmail.com>.
If you start a Kafka broker, it should start reporting metrics
automatically. But I'm not sure if I understood your question completely.
Can you elaborate on what problem you saw with metrics collection?

Thanks,
Neha


On Wed, Sep 18, 2013 at 2:20 PM, Vimpy Batra <vi...@yahoo.com> wrote:

> Hi,
>
> I am using Kafka-0.8 and have a module to write metrics to Graphite. I
> have a multi node cluster and was wondering if I need to enable metrics
> reporting on all of them. Any advice will be helpful.
>
> Thanks,
>
>