Kafka Mirror Maker, cannot read topic's offset/group

[Manoj Narayan <mn...@syr.edu>]

Hello,

I am trying to setup mirroring between two kafka servers using MirrorMaker. The messages are successfully mirrored between the servers on all topics. I can list all topics on both the master and the slave (kafka-topics.sh --list).

The problem that I am facing now is that when I try to retrieve the offsets (kafka.tools.ConsumerOffsetChecker) for the topics from both the master and the slave for the default consumer group (test-consumer-group) (which I have never changed), I am able to retrieve all the topics from the master but none from the slave. Also, I don't see any topic that was mirrored when I run kafka.tools.ExportZkOffsets on the slave whereas I see all of them on the master.

Note that I did not explicitly create these topics on both the master and the slave as I wanted this auto.create.topic functionality. I just used the producer to inject some messages. Also, I had to use the auto.offset.reset to be smallest since I did not want to lose any message if the mirrorMaker was not started from the beginning.

Could anyone please help me understand the following.
1. As to why I don't see those mirrored topic offsets?
2. What consumer group are the mirrored topics created with and how can I access their offsets?
3. Is there any other way I can display all the consumer groups present?

Thanks in advance for any help!


-Manoj