JMXTrans Monitoring for Individual Topics

[Craig Swift <cr...@returnpath.com.INVALID>]

Hello,

I was hoping someone might know this off the top of their head. I haven't
been able to find any documentation on it so I was curious if it was still
available. We're upgrading to Kafka 8.2 from 8.1 (ya, we're a bit behind)
and we used to have the following in jmxtrans that would give us monitoring
on individual topics:

{
     "outputWriters": [
      {
       "@class": "com.googlecode.jmxtrans.model.output.GraphiteWriter",
       "settings": {
        "typeNames": [ "name" ],
        "host": "bla.blabla.net",
        "port": 2013,
        "rootPrefix": "app.infrastructure.kafka.green.green-01"
       }
      }
     ],
     "resultAlias": "topics.topic_name",
     "obj": "kafka.log:type=Log,name=topic_name-*",
     "attr": [ "Value" ]
    }

which would yield metrics on size, log end offset and number of log
segments for that topic. Is a similar option still available in 8.2?

Re: JMXTrans Monitoring for Individual Topics

[Asaf Mesika <as...@gmail.com>]

Something we use which be helpful: We use jmx2graphite
<https://github.com/logzio/jmx2graphite>, so we won't have to manually pick
and choose metrics - we simply send them all. When all hell breaks loose,
you never know in advance which metric you needed to research root cause
analysis.


On Fri, Jul 8, 2016 at 12:28 AM Craig Swift
<cr...@returnpath.com.invalid> wrote:

> Hello,
>
> I was hoping someone might know this off the top of their head. I haven't
> been able to find any documentation on it so I was curious if it was still
> available. We're upgrading to Kafka 8.2 from 8.1 (ya, we're a bit behind)
> and we used to have the following in jmxtrans that would give us monitoring
> on individual topics:
>
> {
>      "outputWriters": [
>       {
>        "@class": "com.googlecode.jmxtrans.model.output.GraphiteWriter",
>        "settings": {
>         "typeNames": [ "name" ],
>         "host": "bla.blabla.net",
>         "port": 2013,
>         "rootPrefix": "app.infrastructure.kafka.green.green-01"
>        }
>       }
>      ],
>      "resultAlias": "topics.topic_name",
>      "obj": "kafka.log:type=Log,name=topic_name-*",
>      "attr": [ "Value" ]
>     }
>
> which would yield metrics on size, log end offset and number of log
> segments for that topic. Is a similar option still available in 8.2?
>