You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@kafka.apache.org by "Ning Zhang (Jira)" <ji...@apache.org> on 2020/08/23 03:29:00 UTC
[jira] [Comment Edited] (KAFKA-10424) MirrorMaker 2.0 does not
replicates topic's "clean.policy"
[ https://issues.apache.org/jira/browse/KAFKA-10424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17182572#comment-17182572 ]
Ning Zhang edited comment on KAFKA-10424 at 8/23/20, 3:28 AM:
--------------------------------------------------------------
[~grinfeld] "_schemas" topic is a compacted topic. When it is replicated, make sure its name on the target cluster prefix with <source_cluster_alias_placeholder>, e.g. "primary._schemas" and having your schema registry service on target cluster using the correct topic name.
MirrorSourceConnector should periodically sync the topic config (including "cleanup.policy") from source to target (https://github.com/apache/kafka/blob/trunk/connect/mirror/src/main/java/org/apache/kafka/connect/mirror/MirrorSourceConnector.java#L122) so the "_schemas" topic on target cluster should be compacted topic.
To debug,
check if "_schemas" topic on target cluster is *indeed* compacted topic, especially at the moment when you see the above exception.
was (Author: yangguo1220):
[~grinfeld] "_schemas" topic is a compacted topic. When it is replicated, make sure its name on the target cluster prefix with <source_cluster_alias_placeholder>, e.g. "primary._schemas"
MirrorSourceConnector should periodically sync the topic config (including "cleanup.policy") from source to target (https://github.com/apache/kafka/blob/trunk/connect/mirror/src/main/java/org/apache/kafka/connect/mirror/MirrorSourceConnector.java#L122) so the "_schemas" topic on target cluster should be compacted topic.
To debug,
check if "_schemas" topic on target cluster is *indeed* compacted topic, especially at the moment when you see the above exception.
> MirrorMaker 2.0 does not replicates topic's "clean.policy"
> ----------------------------------------------------------
>
> Key: KAFKA-10424
> URL: https://issues.apache.org/jira/browse/KAFKA-10424
> Project: Kafka
> Issue Type: Bug
> Components: mirrormaker
> Affects Versions: 2.5.0
> Reporter: Mikhail Grinfeld
> Priority: Major
>
> I needed to replicate schema-registry "_schemas" topic.
> data was replicated successfully and everything looked good, but new schema-registry started with warning that replicated topic's cleanup.policy is not "compact"
--
This message was sent by Atlassian Jira
(v8.3.4#803005)