You are viewing a plain text version of this content. The canonical link for it is here.

Posted to jira@kafka.apache.org by "Jordan Moore (Jira)" <ji...@apache.org> on 2020/04/08 05:04:00 UTC

[jira] [Commented] (KAFKA-9813) __consumer_offsets loaded cost very long time

    [ https://issues.apache.org/jira/browse/KAFKA-9813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17077837#comment-17077837 ] 

Jordan Moore commented on KAFKA-9813:
-------------------------------------

How large is each segment file on disk? How large is each partition?

> __consumer_offsets loaded cost very long time
> ---------------------------------------------
>
>                 Key: KAFKA-9813
>                 URL: https://issues.apache.org/jira/browse/KAFKA-9813
>             Project: Kafka
>          Issue Type: Bug
>          Components: core
>    Affects Versions: 2.1.1
>            Reporter: leibo
>            Priority: Major
>         Attachments: 2020-04-03_163556.png
>
>
> __consumer_offsets loaded with a long time.
>  
> After I restart kafka(3 HA), one of __consumer_offsets loaded with  41256909 ms (about 11 hours),  the others __consumer_offsets partition that load after __consumer_offsets-14 can not be loaded , that lead many consumer can not commit offsets and consume.
> restart time:  2020-04-02 19:06
> __consumer_offsets-14 loaded time: 2020-04-03 06:32,  41256909 ms
> other info: 
>     1.  there are 72408 consumer groups in kafka cluster, and most of it (70498) are empty.
>     2. there was no exception can be found in server.log
>    3. the disk i/o and cpu ,memory load are very low.
>   



--
This message was sent by Atlassian Jira
(v8.3.4#803005)