You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@kafka.apache.org by "Navneet Gupta (Tech - BLR)" <na...@flipkart.com> on 2014/09/09 13:54:40 UTC
GenericJMX plugin file for Kafka 0.8.1
Hi,
We plan to capture various metrics exposed in Kafka via JMX and wanted to
check if anybody has a plugin file which could be reused.
We found one such plugin file here
<https://github.com/deathsyn/chef-kafka/blob/master/templates/default/collectd_kafka-broker.conf.erb>
but
it seems to be targeted for a different kafka version.
--
Thanks & Regards,
Navneet Gupta
Re: GenericJMX plugin file for Kafka 0.8.1
Posted by Joe Stein <jo...@stealth.ly>.
Have you taken a look at
https://cwiki.apache.org/confluence/display/KAFKA/JMX+Reporters or
https://cwiki.apache.org/confluence/display/KAFKA/Ecosystem that might have
more information that you are looking for. If you find something else that
is not on the list if you could update it that would be great.
/*******************************************
Joe Stein
Founder, Principal Consultant
Big Data Open Source Security LLC
http://www.stealth.ly
Twitter: @allthingshadoop <http://www.twitter.com/allthingshadoop>
********************************************/
On Tue, Sep 9, 2014 at 7:54 AM, Navneet Gupta (Tech - BLR) <
navneet.gupta@flipkart.com> wrote:
> Hi,
>
> We plan to capture various metrics exposed in Kafka via JMX and wanted to
> check if anybody has a plugin file which could be reused.
>
> We found one such plugin file here
> <
> https://github.com/deathsyn/chef-kafka/blob/master/templates/default/collectd_kafka-broker.conf.erb
> >
> but
> it seems to be targeted for a different kafka version.
>
> --
> Thanks & Regards,
> Navneet Gupta
>
Re: GenericJMX plugin file for Kafka 0.8.1
Posted by Otis Gospodnetic <ot...@gmail.com>.
Hi,
There's also SPM <http://sematext.com/spm/> which makes use of Kafka JMX
and does graphing, alerting, and anomaly detection on, I believe, all Kafka
metrics for 0.7.x and 0.8.x. You can see a couple Kafka clusters at
https://apps.sematext.com/demo .
Otis
--
Monitoring * Alerting * Anomaly Detection * Centralized Log Management
Solr & Elasticsearch Support * http://sematext.com/
On Tue, Sep 9, 2014 at 7:54 AM, Navneet Gupta (Tech - BLR) <
navneet.gupta@flipkart.com> wrote:
> Hi,
>
> We plan to capture various metrics exposed in Kafka via JMX and wanted to
> check if anybody has a plugin file which could be reused.
>
> We found one such plugin file here
> <
> https://github.com/deathsyn/chef-kafka/blob/master/templates/default/collectd_kafka-broker.conf.erb
> >
> but
> it seems to be targeted for a different kafka version.
>
> --
> Thanks & Regards,
> Navneet Gupta
>
Re: GenericJMX plugin file for Kafka 0.8.1
Posted by Alexis Midon <al...@airbedandbreakfast.com>.
looks like I can't edit the wiki page.
feel free to add https://github.com/airbnb/kafka-statsd-metrics2 to the
page.
thanks
On Tue, Sep 9, 2014 at 8:10 AM, Andrew Otto <ao...@wikimedia.org> wrote:
> We use jmxtrans to pull data out of JMX.
>
>
> https://github.com/wikimedia/puppet-kafka/blob/master/kafka-jmxtrans.json.md
>
>
> On Sep 9, 2014, at 7:54 AM, Navneet Gupta (Tech - BLR) <
> navneet.gupta@flipkart.com> wrote:
>
> > Hi,
> >
> > We plan to capture various metrics exposed in Kafka via JMX and wanted to
> > check if anybody has a plugin file which could be reused.
> >
> > We found one such plugin file here
> > <
> https://github.com/deathsyn/chef-kafka/blob/master/templates/default/collectd_kafka-broker.conf.erb
> >
> > but
> > it seems to be targeted for a different kafka version.
> >
> > --
> > Thanks & Regards,
> > Navneet Gupta
>
>
Re: GenericJMX plugin file for Kafka 0.8.1
Posted by Andrew Otto <ao...@wikimedia.org>.
We use jmxtrans to pull data out of JMX.
https://github.com/wikimedia/puppet-kafka/blob/master/kafka-jmxtrans.json.md
On Sep 9, 2014, at 7:54 AM, Navneet Gupta (Tech - BLR) <na...@flipkart.com> wrote:
> Hi,
>
> We plan to capture various metrics exposed in Kafka via JMX and wanted to
> check if anybody has a plugin file which could be reused.
>
> We found one such plugin file here
> <https://github.com/deathsyn/chef-kafka/blob/master/templates/default/collectd_kafka-broker.conf.erb>
> but
> it seems to be targeted for a different kafka version.
>
> --
> Thanks & Regards,
> Navneet Gupta