[jira] [Created] (KAFKA-17828) Reverse Checkpointing in MirrorMaker2

["Daniel Urban (Jira)" <ji...@apache.org>]

Daniel Urban created KAFKA-17828:
------------------------------------

             Summary: Reverse Checkpointing in MirrorMaker2
                 Key: KAFKA-17828
                 URL: https://issues.apache.org/jira/browse/KAFKA-17828
             Project: Kafka
          Issue Type: Improvement
          Components: mirrormaker
            Reporter: Daniel Urban
            Assignee: Daniel Urban


MM2 supports checkpointing - replicating the committed offsets of groups across Kafka clusters.

This is a one-way replication, meaning that consumers can rely on this when they fail over from the upstream cluster to the downstream cluster. But checkpointing would be desirable in failbacks, too: if the consumers processed messages from the downstream topic, they do not want to consume the same messages again in the upstream topic.

To avoid this, checkpointing should also support reverse checkpointing in the context of a bidirectional replication: creating checkpoints between downstream->upstream topics.

This ticket implements KIP-1098.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)