You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@kafka.apache.org by "Mikhail Grinfeld (Jira)" <ji...@apache.org> on 2020/01/30 06:44:00 UTC
[jira] [Created] (KAFKA-9482) mirror maker 2.0 doesn't replicates
(create topic) created automatically by producing messages
Mikhail Grinfeld created KAFKA-9482:
---------------------------------------
Summary: mirror maker 2.0 doesn't replicates (create topic) created automatically by producing messages
Key: KAFKA-9482
URL: https://issues.apache.org/jira/browse/KAFKA-9482
Project: Kafka
Issue Type: Bug
Components: mirrormaker
Affects Versions: 2.4.0
Reporter: Mikhail Grinfeld
I have 2 kafka (3 brokers each) clusters and MirrorMaker instance. (built with docker and docker-compose)
Both cluster is defined to create topics automatically (no auto.create.topics.enable in conf and default, at least as it appears in docs, is true).
If topic created on source cluster before MirrorMaker starts, everything works as expected: producig messages to source cluster, causes replication to destination cluster.
If topic doesn't exist on source cluster, when starting to produce messages, it created in source cluster, but not in destination - and no replication performed.
Using following mm2.properties:
{code:java}
# mm2.propertiesclusters=src,dest
src.bootstrap.servers=kafka-1:9092,kafka-2:19092,kafka-3:29092
dest.bootstrap.servers=kafka-4:39092,kafka-5:49092,kafka-6:59092
src->dest.enabled=true
src->dest.topics=.*
{code}
and running MirrorMaker with
{code:java}
connect-mirror-maker /etc/mm2.properties --clusters src dest
{code}
Note:
when I am using Kafka-Streams to read from initial topic, there are few KTable topics created automatically by Kafka-Stream - and these topics created OK (of course, when initial topic created at the beginning)
--
This message was sent by Atlassian Jira
(v8.3.4#803005)