[jira] [Commented] (FLINK-16553) Missing KafkaFetcher topic/partition metrics

["Chesnay Schepler (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/FLINK-16553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17150891#comment-17150891 ] 

Chesnay Schepler commented on FLINK-16553:
------------------------------------------

[~app-tarush] ping

> Missing KafkaFetcher topic/partition metrics
> --------------------------------------------
>
>                 Key: FLINK-16553
>                 URL: https://issues.apache.org/jira/browse/FLINK-16553
>             Project: Flink
>          Issue Type: Improvement
>          Components: Connectors / Kafka, Runtime / Metrics
>            Reporter: Fabian Paul
>            Assignee: Tarush Grover
>            Priority: Major
>
> When using the Kafka universal connector, currently not all KafkaFetcher metrics ([link|https://github.com/apache/kafka/blob/trunk/clients/src/main/java/org/apache/kafka/clients/consumer/internals/FetcherMetricsRegistry.java]) which are exposed through the KafkaConsumer are accessible within the Flink metrics system.
> Especially, all metrics which are related to topics and partitions are not available. The KafkaConsumer internally only registers those metrics after it has fetched some records.
> Unfortunately, at the moment Flink only checks the available metrics right after the initialization of the KafkaConsumer when no records are polled, yet.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)