You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@kafka.apache.org by "Olumide Ajiboye (Jira)" <ji...@apache.org> on 2021/03/18 16:29:00 UTC
[jira] [Created] (KAFKA-12498) Consumer Group is zero when
MirrorMaker 2.0 is running
Olumide Ajiboye created KAFKA-12498:
---------------------------------------
Summary: Consumer Group is zero when MirrorMaker 2.0 is running
Key: KAFKA-12498
URL: https://issues.apache.org/jira/browse/KAFKA-12498
Project: Kafka
Issue Type: Bug
Components: consumer, replication
Affects Versions: 2.7.0
Environment: Kubernetes 1.19.7
Strimzi 0.21.1
Reporter: Olumide Ajiboye
I have two Kafka clusters in Active\Passive replication using MM 2.0.
When I produce messages to a topic and try to read from it in the same cluster, the consumer group lag is already set to zero. The replica topic also has the same lag and log-end-offset.
My MM2 is using a superuser account and I am using a separate consumer-group with permission just to read and write to this topic.
Just to elaborate further, * Write 10 messages to a topic without any active consumers but with MM2 replicating the topic to a passive Cluster.
* Attempt to read 3 messages from the topic, this creates my consumer group and adds an active consumer. The result is no messages are read
* Describe the consumer group, the result shows Log-End-Offset with correct number of messages, but Lag shows 0
* Attempt to read 3 messages from passive cluster using same consumer-group. Result: no messages consumed, Lag shows 0, Log-End-Offset shows correct number of messages (i.e. same as active cluster)
* Keep consumer running
* Write a few more messages.
* Consumer is now reading latest messages
* Stop consumer
* Keep writing new messages
* Lag shows correct value.
In the absence of MM2, Kafka operation is as expected.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)