You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@flink.apache.org by GitBox <gi...@apache.org> on 2025/09/19 11:47:21 UTC
[GH] (flink-kubernetes-operator/main): Workflow run "Flink Kubernetes Operator CI" is working again!
The GitHub Actions job "Flink Kubernetes Operator CI" on flink-kubernetes-operator.git/main has succeeded.
Run started by GitHub user mxm (triggered by mxm).
Head commit for run:
003e594c9a52ac67fb64ef67588291fcbc85c99e / Maximilian Michels <mx...@apache.org>
[FLINK-38381] Enumerate Kafka partitions across Kafka clusters (#1030)
When using the DynamicKafkaSink, topics can be spread across multiple
clusters. This used to work fine, but a regression has been added which
considers partitions across different clusters to be identical. This limits the
scale out of the source operator.
Here is an example:
```
"1.Source__Kafka_Source_(testTopic).kafkaCluster.my-cluster-1.KafkaSourceReader.topic.testTopic.partition.0.currentOffset",
"1.Source__Kafka_Source_(testTopic).kafkaCluster.my-cluster-2.KafkaSourceReader.topic.testTopic.partition.0.currentOffset"
```
Those would result be treated as one partition, but there are two partitions from separate kafka clusters.
Report URL: https://github.com/apache/flink-kubernetes-operator/actions/runs/17856988932
With regards,
GitHub Actions via GitBox