[jira] [Created] (KAFKA-13408) Add a new metric to track invalid task provided offset

["Nicolas Guyomar (Jira)" <ji...@apache.org>]

Nicolas Guyomar created KAFKA-13408:
---------------------------------------

             Summary: Add a new metric to track invalid task provided offset
                 Key: KAFKA-13408
                 URL: https://issues.apache.org/jira/browse/KAFKA-13408
             Project: Kafka
          Issue Type: Improvement
          Components: KafkaConnect
            Reporter: Nicolas Guyomar


Hi team,

Whenever a task provide invalid offset back to the framework, we log a warn message but we do not track yet a dedicated metric for those

In some situations where the Sink connector task implements the precommit method and has a bug in the way it tracks assigned topic/partition this could lead to a task not reporting offset at all thus no offset is being tracked on the consumer group in Kafka and can go undetected if we rely on the existing JMX beans for offset commit

This improvement Jira is to add a dedicated JMX Metric to be able to alert if such invalid offset are provided too often or for too long

 

Thank you



--
This message was sent by Atlassian Jira
(v8.3.4#803005)