[jira] [Commented] (KAFKA-10582) Mirror Maker 2 not replicating new topics until restart

["Leonid Ilyevsky (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/KAFKA-10582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17291956#comment-17291956 ] 

Leonid Ilyevsky commented on KAFKA-10582:
-----------------------------------------

I have the same problem, but in my case just restarting the mirror maker does not help.

Here is what I have to do: stop the mirror maker, then delete the *mm2-offset-syncs.<target cluster>.internal* topic on the source cluster, and then start the mirror maker again.

I am using the mirror maker that comes with Confluent 6.1.0, and I run 3 instances on the same hosts as the target cluster.

> Mirror Maker 2 not replicating new topics until restart
> -------------------------------------------------------
>
>                 Key: KAFKA-10582
>                 URL: https://issues.apache.org/jira/browse/KAFKA-10582
>             Project: Kafka
>          Issue Type: Bug
>          Components: mirrormaker
>    Affects Versions: 2.5.1
>         Environment: RHEL 7 Linux.
>            Reporter: Robert Martin
>            Priority: Minor
>
> We are using Mirror Maker 2 from the 2.5.1 release for replication on some clusters.  Replication is working as expected for existing topics.  When we create a new topic, however, Mirror Maker 2 creates the replicated topic as expected but never starts replicating it.  If we restart Mirror Maker 2 within 2-3 minutes the topic starts replicating as expected.  From documentation we haveve seen it appears this should start replicating without a restart based on the settings we have.
> *Example:*
> Create topic "mytesttopic" on source cluster
> MirrorMaker 2 creates "source.mytesttopioc" on target cluster with no issue
> MirrorMaker 2 does not replicate "mytesttopic" -> "source.mytesttopic"
> Restart MirrorMaker 2 and now replication works for "mytesttopic" -> "source.mytesttopic"
> *Example config:*
> name = source->target
> group.id = source-to-target
> clusters = source, target
> source.bootstrap.servers = sourcehosts:9092
> target.bootstrap.servers = targethosts:9092
> source->target.enabled = true
> source->target.topics = .*
> target->source = false
> target->source.topics = .*
> replication.factor=3
> checkpoints.topic.replication.factor=3
> heartbeats.topic.replication.factor=3
> offset-syncs.topic.replication.factor=3
> offset.storage.replication.factor=3
> status.storage.replication.factor=3
> config.storage.replication.factor=3
> tasks.max = 16
> refresh.topics.enabled = true
> sync.topic.configs.enabled = true
> refresh.topics.interval.seconds = 300
> refresh.groups.interval.seconds = 300
> readahead.queue.capacity = 100
> emit.checkpoints.enabled = true
> emit.checkpoints.interval.seconds = 5



--
This message was sent by Atlassian Jira
(v8.3.4#803005)