You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@kafka.apache.org by "Mickael Maison (Jira)" <ji...@apache.org> on 2020/07/31 09:06:00 UTC
[jira] [Updated] (KAFKA-10332) MirrorMaker2 fails to detect topic
if remote topic is created first
[ https://issues.apache.org/jira/browse/KAFKA-10332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Mickael Maison updated KAFKA-10332:
-----------------------------------
Summary: MirrorMaker2 fails to detect topic if remote topic is created first (was: MirrorMaker2 fails to detect topic is remote topic is created first)
> MirrorMaker2 fails to detect topic if remote topic is created first
> -------------------------------------------------------------------
>
> Key: KAFKA-10332
> URL: https://issues.apache.org/jira/browse/KAFKA-10332
> Project: Kafka
> Issue Type: Bug
> Components: mirrormaker
> Affects Versions: 2.6.0
> Reporter: Mickael Maison
> Assignee: Mickael Maison
> Priority: Major
>
> Setup:
> - 2 clusters: source and target
> - Mirroring data from source to target
> - create a topic called source.mytopic on the target cluster
> - create a topic called mytopic on the source cluster
> At this point, MM2 does not start mirroring the topic.
> This also happens if you delete and recreate a topic that is being mirrored.
> The issue is in [refreshTopicPartitions()|https://github.com/apache/kafka/blob/trunk/connect/mirror/src/main/java/org/apache/kafka/connect/mirror/MirrorSourceConnector.java#L211-L232] which basically does a diff between the 2 clusters.
> When creating the topic on the source cluster last, it makes the partition list of both clusters match, hence not triggering a reconfiguration
--
This message was sent by Atlassian Jira
(v8.3.4#803005)