You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2021/10/01 06:33:00 UTC
[jira] [Updated] (FLINK-24409) Kafka topics with periods in their
names generate a constant stream of errors
[ https://issues.apache.org/jira/browse/FLINK-24409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
ASF GitHub Bot updated FLINK-24409:
-----------------------------------
Labels: pull-request-available (was: )
> Kafka topics with periods in their names generate a constant stream of errors
> -----------------------------------------------------------------------------
>
> Key: FLINK-24409
> URL: https://issues.apache.org/jira/browse/FLINK-24409
> Project: Flink
> Issue Type: Bug
> Components: Connectors / Kafka
> Affects Versions: 1.14.0
> Reporter: Brad Davis
> Priority: Major
> Labels: pull-request-available
>
> Attempting to port a job that worked on 1.13.2 over to 1.14.0 I encountered [this|https://gist.github.com/jherico/1f2d1cf441a4a9724ae370c375c90fde] error. Going into the code I discovered that the reason seems to be [this logic|https://github.com/apache/flink/blob/master/flink-connectors/flink-connector-kafka/src/main/java/org/apache/flink/connector/kafka/source/metrics/KafkaSourceReaderMetrics.java#L297]. But the tags being examined here are generated at least partly by [this code|https://github.com/apache/kafka/blob/trunk/clients/src/main/java/org/apache/kafka/clients/consumer/internals/Fetcher.java#L1937]. The tags always translate periods in the topic name to underscores, but the code in KafkaSourceReaderMetrics uses the untransformed topic name in the filter. Therefore if the topic name has a period in it the filtering logic will _always_ fail.
> The code that's generating the error is apparently very recent, being merged in this PR [https://github.com/apache/flink/pull/16838]
>
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)