You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@kafka.apache.org by "Tomasz Gański (JIRA)" <ji...@apache.org> on 2017/02/13 12:33:41 UTC

[jira] [Created] (KAFKA-4760) Restarting one MirrorMaker causes a global pause in mirroring.

Tomasz Gański created KAFKA-4760:
------------------------------------

             Summary:  Restarting one MirrorMaker causes a global pause in mirroring.
                 Key: KAFKA-4760
                 URL: https://issues.apache.org/jira/browse/KAFKA-4760
             Project: Kafka
          Issue Type: Improvement
            Reporter: Tomasz Gański
         Attachments: 1_mm_stop.png

When 1 MirrorMaker is restarted in consumer group, the whole consumer group stop working and lead to big consumer lag. 

 !1_mm_stop.png|thumbnail! 

It becoming huge problem when you want keep system stable and guarantee that crucial messages come as soon as possible. In this case each deployment or setting change is risky. 

It would be grate if MirrorMaker could rejoin to previous assigned partitions and not caused consumer group rebalance.

The rejoins to existing consumer group is based on *memberId* and *group generation id*.  I would nice if it would be possible to make them persistence and keep this variable during MirrorMaker restart.




--
This message was sent by Atlassian JIRA
(v6.3.15#6346)