You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@kafka.apache.org by "Mickael Maison (Jira)" <ji...@apache.org> on 2020/07/31 09:06:00 UTC

[jira] [Updated] (KAFKA-10332) MirrorMaker2 fails to detect topic if remote topic is created first

     [ https://issues.apache.org/jira/browse/KAFKA-10332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Mickael Maison updated KAFKA-10332:
-----------------------------------
    Summary: MirrorMaker2 fails to detect topic if remote topic is created first  (was: MirrorMaker2 fails to detect topic is remote topic is created first)

> MirrorMaker2 fails to detect topic if remote topic is created first
> -------------------------------------------------------------------
>
>                 Key: KAFKA-10332
>                 URL: https://issues.apache.org/jira/browse/KAFKA-10332
>             Project: Kafka
>          Issue Type: Bug
>          Components: mirrormaker
>    Affects Versions: 2.6.0
>            Reporter: Mickael Maison
>            Assignee: Mickael Maison
>            Priority: Major
>
> Setup:
> - 2 clusters: source and target
> - Mirroring data from source to target
> - create a topic called source.mytopic on the target cluster
> - create a topic called mytopic on the source cluster
> At this point, MM2 does not start mirroring the topic.
> This also happens if you delete and recreate a topic that is being mirrored.
> The issue is in [refreshTopicPartitions()|https://github.com/apache/kafka/blob/trunk/connect/mirror/src/main/java/org/apache/kafka/connect/mirror/MirrorSourceConnector.java#L211-L232] which basically does a diff between the 2 clusters.
> When creating the topic on the source cluster last, it makes the partition list of both clusters match, hence not triggering a reconfiguration



--
This message was sent by Atlassian Jira
(v8.3.4#803005)