You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@kafka.apache.org by "Mickael Maison (Jira)" <ji...@apache.org> on 2019/11/12 17:52:00 UTC

[jira] [Created] (KAFKA-9175) MirrorMaker 2 emits invalid topic partition metrics

Mickael Maison created KAFKA-9175:
-------------------------------------

             Summary: MirrorMaker 2 emits invalid topic partition metrics
                 Key: KAFKA-9175
                 URL: https://issues.apache.org/jira/browse/KAFKA-9175
             Project: Kafka
          Issue Type: Bug
          Components: KafkaConnect
    Affects Versions: 2.4.0
            Reporter: Mickael Maison
            Assignee: Mickael Maison
         Attachments: image-2019-11-12-17-42-45-773.png

While looking at MirrorMaker 2 metrics with [~ecomar], we noticed the topic partition metrics were invalid. 
!image-2019-11-12-17-42-45-773.png!

The topic spp.hello is not receiving any records but its metrics are constantly updating.

The issue is in MirrorMetrics.PartitionMetrics. In the constructor, Sensors are built using metrics.sensor() with a name that does not include the topic partition. metrics.sensor() does not always create a new Sensor but can return an existing Sensor if one exists for the specified name. So in practice, if a Task is handling many topic partitions, they all share the same Sensors!

This renders the topic partition metrics unusable and really prevents monitoring MirrorMaker 2. 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)