[jira] [Comment Edited] (KAFKA-2569) Kafka should write its metrics to a Kafka topic

["UTKARSH BHATNAGAR (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/KAFKA-2569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14906189#comment-14906189 ] 

UTKARSH BHATNAGAR edited comment on KAFKA-2569 at 9/24/15 10:45 AM:
--------------------------------------------------------------------

[~otis] & [~wushujames] - This is the use case which I faced a couple of months ago. So, I implemented JMXTrans KafkaWriter to send JMX Metrics to Kafka. Here is the link:

https://github.com/jmxtrans/jmxtrans/tree/master/jmxtrans-output/jmxtrans-output-kafka

So, just install JMXTrans on Kafka instances and send Kafka metrics to any Kafka(itself or another one). Hope this helps. Please let me know if there are questions.


was (Author: utkarshcmu):
[~otis] & [~wushujames] - This is the use case which I faced a couple of months ago. I implemented JMXTrans KafkaWriter to send JMX Metrics to Kafka. Here is the link:

https://github.com/jmxtrans/jmxtrans/tree/master/jmxtrans-output/jmxtrans-output-kafka

So, just install JMXTrans on Kafka instances and send Kafka metrics to any Kafka(itself or another one). Hope this helps. Please let me know if there are questions.

> Kafka should write its metrics to a Kafka topic
> -----------------------------------------------
>
>                 Key: KAFKA-2569
>                 URL: https://issues.apache.org/jira/browse/KAFKA-2569
>             Project: Kafka
>          Issue Type: New Feature
>            Reporter: James Cheng
>
> Kafka is often used to hold and transport monitoring data.
> In order to monitor Kafka itself, Kafka currently exposes many metrics via JMX, which require using a tool to pull the JMX metrics, and then write them to the monitoring system.
> It would be convenient if Kafka could simply send its metrics to a Kafka topic. This would make most sense if the Kafka topic was in a different Kafka cluster, but could still be useful even if it was sent to a topic in the same Kafka cluster.
> Of course, if sent to the same cluster, it would not be accessible if the cluster itself was down.
> This would allow monitoring of Kafka itself without requiring people to set up their own JMX-to-monitoring-system pipelines.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)