[jira] [Commented] (KAFKA-9438) Issue with mm2 active/active replication

["Rens Groothuijsen (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/KAFKA-9438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17076672#comment-17076672 ] 

Rens Groothuijsen commented on KAFKA-9438:
------------------------------------------

[~romanius11] Tried to replicate this issue, though the only scenario in which I managed to do so was one where the MM instance accidentally looped back to the source cluster rather than writing to the target cluster.

> Issue with mm2 active/active replication
> ----------------------------------------
>
>                 Key: KAFKA-9438
>                 URL: https://issues.apache.org/jira/browse/KAFKA-9438
>             Project: Kafka
>          Issue Type: Bug
>          Components: mirrormaker
>    Affects Versions: 2.4.0
>            Reporter: Roman
>            Priority: Minor
>
> Hi,
>  
> i am trying to configure the the active/active with new kafka 2.4.0 and MM2.
> I have 2 kafka clusters of 3 kafkas, one in lets say BO and on in IN.
> In each cluster there are 3 kafkas.
> Topics are replicated properly so in BO i see
> {quote}topics
> in.topics
> {quote}
>  
> in IN i see
> {quote}topics
> bo.topic
> {quote}
>  
> That should be according to documentation.
>  
> But when I stop the replication process on one data center and start it up, the replication replicate the topics with the same prefix twice bo.bo.topics or in.in.topics depending on what connector i restart.
> I have also blacklisted the topics but they are still replicating.
>  
> bo.properties file
> {quote}name = in-bo
>  #topics = .*
>  topics.blacklist = "bo.*"
>  #groups = .*
>  connector.class = org.apache.kafka.connect.mirror.MirrorSourceConnector
>  tasks.max = 10
> source.cluster.alias = in
>  target.cluster.alias = bo
>  source.cluster.bootstrap.servers = IN-kafka1:9092,IN-kafka2:9092,IN-kafka3:9092
>  target.cluster.bootstrap.servers = BO-kafka1:9092,BO-kafka2:9092,bo-kafka39092
> use ByteArrayConverter to ensure that records are not re-encoded
>  key.converter = org.apache.kafka.connect.converters.ByteArrayConverter
>  value.converter = org.apache.kafka.connect.converters.ByteArrayConverter
>  
> {quote}
> in.properties
> {quote}name = bo-in
>  #topics = .*
>  topics.blacklist = "in.*"
>  #groups = .*
>  connector.class = org.apache.kafka.connect.mirror.MirrorSourceConnector
>  tasks.max = 10
> source.cluster.alias = bo
>  target.cluster.alias = in
>  target.cluster.bootstrap.servers = IN-kafka1:9092,IN-kafka2:9092,IN-kafka3:9092
>  source.cluster.bootstrap.servers = BO-kafka1:9092,BO-kafka2:9092,BO-kafka3:9092
> use ByteArrayConverter to ensure that records are not re-encoded
>  key.converter = org.apache.kafka.connect.converters.ByteArrayConverter
>  value.converter = org.apache.kafka.connect.converters.ByteArrayConverter
> {quote}
>  
>  
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)