[jira] [Commented] (KAFKA-4723) offsets.storage=kafka - groups stuck in rebalancing with committed offsets

["Jason Bew (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/KAFKA-4723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15850173#comment-15850173 ] 

Jason Bew commented on KAFKA-4723:
----------------------------------

On further examination it does in deed look as though the brokers are caught in a confused state. Some offsets are correctly stored in Kafka, but some are still stored in Zookeeper despite doing a rolling restart to store in both zookeeper and kafka, and then just to kafka.  

Not sure if this is a bug or some other problem has arisen.

> offsets.storage=kafka - groups stuck in rebalancing with committed offsets
> --------------------------------------------------------------------------
>
>                 Key: KAFKA-4723
>                 URL: https://issues.apache.org/jira/browse/KAFKA-4723
>             Project: Kafka
>          Issue Type: Bug
>    Affects Versions: 0.10.0.1
>            Reporter: Jason Bew
>            Priority: Minor
>
> Hi, I have moved offset store to kafka only, when I now run;
>  bin/kafka-consumer-groups.sh  --bootstrap-server localhost:9094 --describe  --new-consumer --group my_consumer_group
> I get the message;
> Consumer group `my_consumer_group` does not exist or is rebalancing.
> I have found the  issue KAFKA-3144 however this refers to consumer groups that have no committed offsets, the groups I am looking do and are constantly in use.
> using --list I get all my consumer groups returned. Although some are inactive I have around 6 very active ones (millions of messages a day constantly). looking at the mbean data and kafka tool etc I can see the lags and offsets changing every second. Therefore I would expect the kafka-consumer-groups.sh script to return the lags and offsets for all 6 active consumer groups.
> I think what has happened is when I moved offset storage to kafka from zookeeper (and then disabled sending to both), something has got confused.  Querying zookeeper I get the offsets for the alleged missing consumer groups - but they should be stored and committed to kafka.
> Many thanks.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)