You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@kafka.apache.org by "Mikhail Grinfeld (Jira)" <ji...@apache.org> on 2020/01/30 06:44:00 UTC

[jira] [Created] (KAFKA-9482) mirror maker 2.0 doesn't replicates (create topic) created automatically by producing messages

Mikhail Grinfeld created KAFKA-9482:
---------------------------------------

             Summary: mirror maker 2.0 doesn't replicates (create topic) created automatically by producing messages
                 Key: KAFKA-9482
                 URL: https://issues.apache.org/jira/browse/KAFKA-9482
             Project: Kafka
          Issue Type: Bug
          Components: mirrormaker
    Affects Versions: 2.4.0
            Reporter: Mikhail Grinfeld


I have 2 kafka (3 brokers each) clusters and MirrorMaker instance.  (built with docker and docker-compose)

Both cluster is defined to create topics automatically (no auto.create.topics.enable in conf and default, at least as it appears in docs, is true).

If topic created on source cluster before MirrorMaker starts, everything works as expected: producig messages to source cluster, causes replication to destination cluster.

If topic doesn't exist on source cluster, when starting to produce messages, it created in source cluster, but not in destination - and no replication performed.

 

Using following mm2.properties:
{code:java}
# mm2.propertiesclusters=src,dest

src.bootstrap.servers=kafka-1:9092,kafka-2:19092,kafka-3:29092
dest.bootstrap.servers=kafka-4:39092,kafka-5:49092,kafka-6:59092

src->dest.enabled=true
src->dest.topics=.*
{code}
and running MirrorMaker with
{code:java}
connect-mirror-maker /etc/mm2.properties --clusters src dest
{code}
Note:

when I am using Kafka-Streams to read from initial topic, there are few KTable topics created automatically by Kafka-Stream - and these topics created OK (of course, when initial topic created at the beginning)



--
This message was sent by Atlassian Jira
(v8.3.4#803005)