You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@flink.apache.org by GitBox <gi...@apache.org> on 2025/09/19 11:47:21 UTC

[GH] (flink-kubernetes-operator/main): Workflow run "Flink Kubernetes Operator CI" is working again!

The GitHub Actions job "Flink Kubernetes Operator CI" on flink-kubernetes-operator.git/main has succeeded.
Run started by GitHub user mxm (triggered by mxm).

Head commit for run:
003e594c9a52ac67fb64ef67588291fcbc85c99e / Maximilian Michels <mx...@apache.org>
[FLINK-38381] Enumerate Kafka partitions across Kafka clusters (#1030)

When using the DynamicKafkaSink, topics can be spread across multiple
clusters. This used to work fine, but a regression has been added which
considers partitions across different clusters to be identical. This limits the
scale out of the source operator.

Here is an example:

```
"1.Source__Kafka_Source_(testTopic).kafkaCluster.my-cluster-1.KafkaSourceReader.topic.testTopic.partition.0.currentOffset",
"1.Source__Kafka_Source_(testTopic).kafkaCluster.my-cluster-2.KafkaSourceReader.topic.testTopic.partition.0.currentOffset"
```

Those would result be treated as one partition, but there are two partitions from separate kafka clusters.

Report URL: https://github.com/apache/flink-kubernetes-operator/actions/runs/17856988932

With regards,
GitHub Actions via GitBox