You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@kafka.apache.org by "Ayyandurai Mani (Jira)" <ji...@apache.org> on 2021/09/06 12:23:00 UTC

[jira] [Updated] (KAFKA-13265) Kafka consumers disappearing after certain point of time

     [ https://issues.apache.org/jira/browse/KAFKA-13265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Ayyandurai Mani updated KAFKA-13265:
------------------------------------
    Priority: Blocker  (was: Critical)

> Kafka consumers disappearing after certain point of time 
> ---------------------------------------------------------
>
>                 Key: KAFKA-13265
>                 URL: https://issues.apache.org/jira/browse/KAFKA-13265
>             Project: Kafka
>          Issue Type: Test
>          Components: consumer
>    Affects Versions: 2.4.0
>            Reporter: Ayyandurai Mani
>            Priority: Blocker
>         Attachments: Consumer_Disappear_Issue_Screen.png, server.log
>
>
> Dear Kafka Team,
> We are facing one issue for past few days in our development environment. We have topic called 'search-service-topic-dev' and consumer group 'search-service-group' with 10 partitions, and concurrency also 10 at  consumer side. 
> When we publish more messages( each message is 115kb) into the topic after some certain point of the time consumers disappeared from the consumer group (note : consumer service are running). Have attached screenshot for reference (filename : Consumer_Disappear_Issue_Screen.png) 
> From screenshot when i execute describe command for the consumer group at 14:35:32 (IST) consumers were available but when i execute at 14:38:17(IST) consumers were not there. 
> Attached kafka server.log for that particular time(kafka is running in UTC timezone server).
> Note : Message size in each partitions is around 2GB.
>  
> We are kind of blocked due to this behavior. Please help me to resolve this. 
> Thanks in advance.
> Ayyandurai
>  
>  
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)