[jira] [Created] (KAFKA-9121) Mirror Maker 2.0 doesn't handle the topic names in consumer checkpoints properly when topic name contain separator

["Jakub Scholz (Jira)" <ji...@apache.org>]

Jakub Scholz created KAFKA-9121:
-----------------------------------

             Summary: Mirror Maker 2.0 doesn't handle the topic names in consumer checkpoints properly when topic name contain separator
                 Key: KAFKA-9121
                 URL: https://issues.apache.org/jira/browse/KAFKA-9121
             Project: Kafka
          Issue Type: Bug
          Components: mirrormaker
    Affects Versions: 2.4.0
            Reporter: Jakub Scholz


I was trying the Kafka Mirror Maker 2.0 and run into the following situation:

1) I have 2 Kafka clusters with topic {{kafka-test-apps}} topic
2) I configured Mirror Maker with {{replication.policy.separator=-}} and with mirroring between cluster {{a}} and {{b}}.
3) When running Mirror Maker the mirroring of topics works fine. But when I use the {{RemoteClusterUtils}} to recover the offsets, the names of the topics for which the offsets are found are {{a-kafka-test-apps}} and {{apps}}. While the expected topic names would be {{a-kafka-test-apps}} and {{kafka-test-apps}}.

I tried to find the issue, but didn't found it so far. But it doesn't seem to be in {{RemoteClusterUtils}} because the topic names seem to be wrong already in {{checkpoints.internal}} topic. So it is probably already processed in the wrong way in the source cluster. 

When I use {{.}} as the separator, it seems to work fine for me. It looks like the problem is only when the topci names contain already the separator in the original topic name. But using the right separator might not be a solution for this, because you migth have topics with different characters and always have this problem.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)