[jira] [Created] (FLINK-24409) Kafka topics with periods in their names generate a constant stream of errors

["Brad Davis (Jira)" <ji...@apache.org>]

Brad Davis created FLINK-24409:
----------------------------------

             Summary: Kafka topics with periods in their names generate a constant stream of errors
                 Key: FLINK-24409
                 URL: https://issues.apache.org/jira/browse/FLINK-24409
             Project: Flink
          Issue Type: Improvement
          Components: Connectors / Kafka
    Affects Versions: 1.14.0
            Reporter: Brad Davis


Attempting to port a job that worked on 1.13.2 over to 1.14.0 I encountered [this|https://gist.github.com/jherico/1f2d1cf441a4a9724ae370c375c90fde] error.  Going into the code I discovered that the reason seems to be [this logic|https://github.com/apache/flink/blob/master/flink-connectors/flink-connector-kafka/src/main/java/org/apache/flink/connector/kafka/source/metrics/KafkaSourceReaderMetrics.java#L297].  But the tags being examined here are generated at least partly by [this code|https://github.com/apache/kafka/blob/trunk/clients/src/main/java/org/apache/kafka/clients/consumer/internals/Fetcher.java#L1937].  The tags always translate periods in the topic name to underscores, but the code in KafkaSourceReaderMetrics uses the untransformed topic name in the filter.  Therefore if the topic name has a period in it the filtering logic will _always_ fail.

 

 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)