You are viewing a plain text version of this content. The canonical link for it is here.

Posted to users@kafka.apache.org by Vadim Keylis <vk...@gmail.com> on 2013/08/23 19:27:07 UTC

Kafka Yammer Metrics

Good morning. i have not used yammer metrics until we deploy kafka. Csv
output is great, but sending data to graphite or similar straight from
kafka would be better. We can do our custom implementation that queries jmx
and sends data, but I would be curious how community does it.
is there module that connects yammer metrics to graphite preferably or
ganglia?

Thanks so much,
Vadim

Side note:  I will appreciate if someone can also recommend good site that
has yammer metrics documentation, I google it, but did not find what was
relevant.

Re: Kafka Yammer Metrics

Posted by Jason Rosenberg <jb...@squareup.com>.

Vadim,

We wrap kafka in our own java service container, which as a happy
coincidence, uses yammer metrics also.  The yammer library has a
GraphiteReporter, which you can configure, which will run a background
thread and send all configured yammer metrics to graphite at regular
intervals, e.g. every 10 seconds.

The main site for yammer metrics is here:  http://metrics.codahale.com/

Jason


On Fri, Aug 23, 2013 at 10:44 AM, Vadim Keylis <vk...@gmail.com>wrote:

> Thanks so much. Let me look into this.
>
>
> On Fri, Aug 23, 2013 at 10:38 AM, Neha Narkhede <neha.narkhede@gmail.com
> >wrote:
>
> > Have you taken a look at this - https://github.com/criteo/kafka-ganglia.
> > It
> > is linked off of
> > https://cwiki.apache.org/confluence/display/KAFKA/JMX+Reporters
> >
> > Thanks,
> > Neha
> >
> >
> > On Fri, Aug 23, 2013 at 10:27 AM, Vadim Keylis <vkeylis2009@gmail.com
> > >wrote:
> >
> > > Good morning. i have not used yammer metrics until we deploy kafka. Csv
> > > output is great, but sending data to graphite or similar straight from
> > > kafka would be better. We can do our custom implementation that queries
> > jmx
> > > and sends data, but I would be curious how community does it.
> > > is there module that connects yammer metrics to graphite preferably or
> > > ganglia?
> > >
> > > Thanks so much,
> > > Vadim
> > >
> > > Side note:  I will appreciate if someone can also recommend good site
> > that
> > > has yammer metrics documentation, I google it, but did not find what
> was
> > > relevant.
> > >
> >
>

Re: Kafka Yammer Metrics

Posted by Vadim Keylis <vk...@gmail.com>.

Thanks so much. Let me look into this.


On Fri, Aug 23, 2013 at 10:38 AM, Neha Narkhede <ne...@gmail.com>wrote:

> Have you taken a look at this - https://github.com/criteo/kafka-ganglia.
> It
> is linked off of
> https://cwiki.apache.org/confluence/display/KAFKA/JMX+Reporters
>
> Thanks,
> Neha
>
>
> On Fri, Aug 23, 2013 at 10:27 AM, Vadim Keylis <vkeylis2009@gmail.com
> >wrote:
>
> > Good morning. i have not used yammer metrics until we deploy kafka. Csv
> > output is great, but sending data to graphite or similar straight from
> > kafka would be better. We can do our custom implementation that queries
> jmx
> > and sends data, but I would be curious how community does it.
> > is there module that connects yammer metrics to graphite preferably or
> > ganglia?
> >
> > Thanks so much,
> > Vadim
> >
> > Side note:  I will appreciate if someone can also recommend good site
> that
> > has yammer metrics documentation, I google it, but did not find what was
> > relevant.
> >
>

Re: Kafka Yammer Metrics

Posted by Neha Narkhede <ne...@gmail.com>.

Have you taken a look at this - https://github.com/criteo/kafka-ganglia. It
is linked off of
https://cwiki.apache.org/confluence/display/KAFKA/JMX+Reporters

Thanks,
Neha


On Fri, Aug 23, 2013 at 10:27 AM, Vadim Keylis <vk...@gmail.com>wrote:

> Good morning. i have not used yammer metrics until we deploy kafka. Csv
> output is great, but sending data to graphite or similar straight from
> kafka would be better. We can do our custom implementation that queries jmx
> and sends data, but I would be curious how community does it.
> is there module that connects yammer metrics to graphite preferably or
> ganglia?
>
> Thanks so much,
> Vadim
>
> Side note:  I will appreciate if someone can also recommend good site that
> has yammer metrics documentation, I google it, but did not find what was
> relevant.
>