You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@kafka.apache.org by "Mickael Maison (Jira)" <ji...@apache.org> on 2020/07/31 09:06:00 UTC
[jira] [Created] (KAFKA-10332) MirrorMaker2 fails to detect topic
is remote topic is created first
Mickael Maison created KAFKA-10332:
--------------------------------------
Summary: MirrorMaker2 fails to detect topic is remote topic is created first
Key: KAFKA-10332
URL: https://issues.apache.org/jira/browse/KAFKA-10332
Project: Kafka
Issue Type: Bug
Components: mirrormaker
Affects Versions: 2.6.0
Reporter: Mickael Maison
Assignee: Mickael Maison
Setup:
- 2 clusters: source and target
- Mirroring data from source to target
- create a topic called source.mytopic on the target cluster
- create a topic called mytopic on the source cluster
At this point, MM2 does not start mirroring the topic.
This also happens if you delete and recreate a topic that is being mirrored.
The issue is in [refreshTopicPartitions()|https://github.com/apache/kafka/blob/trunk/connect/mirror/src/main/java/org/apache/kafka/connect/mirror/MirrorSourceConnector.java#L211-L232] which basically does a diff between the 2 clusters.
When creating the topic on the source cluster last, it makes the partition list of both clusters match, hence not triggering a reconfiguration
--
This message was sent by Atlassian Jira
(v8.3.4#803005)