You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@kafka.apache.org by Yifan Ying <na...@gmail.com> on 2017/03/03 00:25:00 UTC

Kafka metrics to Prometheus

Hi Kafka users,

I am trying to expose Kafka client metrics to Prometheus via
*MetricsReporter*. And it looks like Kafka clients don't expose the
*Measurable* objects so that I can only do *KafkaMetric.value()* and use it
as Gauge in Prometheus even if the metric could be a Percentile in Kafka
clients. This would be a problem if these gauge metrics need to be
aggregated in prometheus. So ideally, I hope we can provide customized
*Measurable* objects for Kafka clients to use, and those Measurable objects
will maintain a set of corresponding Prometheus metric objects. For
example, for a customized Counter object, whenever it updates the value, it
also updates the value of a corresponding Prometheus object. In this way,
we will have a full copy of sample data from Kafka metrics in Prometheus
metric object.

I would like to know if anyone has this issue and how this should be
handled. Thanks!

-- 
Yifan