You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@kafka.apache.org by "Zhijian Chen (Jira)" <ji...@apache.org> on 2024/10/22 12:01:00 UTC

[jira] [Created] (KAFKA-17851) Save internal topic to a separate kafka cluster

Zhijian Chen created KAFKA-17851:
------------------------------------

             Summary: Save internal topic to a separate kafka cluster
                 Key: KAFKA-17851
                 URL: https://issues.apache.org/jira/browse/KAFKA-17851
             Project: Kafka
          Issue Type: Improvement
          Components: mirrormaker
            Reporter: Zhijian Chen


For the mm2-offset-syncs topic there is a parameter to control its storage cluster: offset-syncs.topic.location, but this parameter can only control whether it is in the source or target cluster.
For checkpoints topic and heartbeat topic, there is no parameter to control their storage clusters.

In a multi-cluster backup scenario, we would like to store these internal topics in a separate kafka cluster, which has the advantage of being easy to manage, and we can deploy this separate cluster across three server rooms so that we don't have to worry about the failure of this separate cluster, which also solves the problem of the existing scenario, where the internal topics cannot be accessed due to the failure of the source or target clusters. 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)