[jira] [Created] (KAFKA-14798) corrupted consumer offsets

["Aravind (Jira)" <ji...@apache.org>]

Aravind created KAFKA-14798:
-------------------------------

             Summary: corrupted consumer offsets
                 Key: KAFKA-14798
                 URL: https://issues.apache.org/jira/browse/KAFKA-14798
             Project: Kafka
          Issue Type: Bug
            Reporter: Aravind


Kafka version 3.2.3

The consumer offsets for some partitions in a kafka topic are not refreshing after a restart of consumer application which made negative lag accumulating and the messages in the partitions are not consumed by the application until the log-end offset equals to older consumer offset. 
{noformat}
2023-02-07 14:33:43.485 ERROR 15 --- [ntainer#0-0-C-1] o.a.k.c.c.internals.ConsumerCoordinator  : [Consumer clientId=consumer-dummy-1, groupId=dummy] User provided listener org.springframework.kafka.listener.KafkaMessageListenerContainer$ListenerConsumer$ListenerConsumerRebalanceListener failed on invocation of onPartitionsAssigned for partitions [dummy-0, dummy-1, dummy-2] 
org.apache.kafka.common.errors.TimeoutException: Timeout of 60000ms expired before the position for partition dummy-0 could be determined
 
2023-02-07 14:33:43.487 ERROR 15 --- [ntainer#0-0-C-1] essageListenerContainer$ListenerConsumer : Consumer exceptionjava.lang.IllegalStateException: This error handler cannot process 'org.apache.kafka.common.errors.TimeoutException's; no record information is available     at org.springframework.kafka.listener.SeekUtils.seekOrRecover(SeekUtils.java:200) ~[spring-kafka-2.7.9.jar!/:2.7.9]     at org.springframework.kafka.listener.SeekToCurrentErrorHandler.handle(SeekToCurrentErrorHandler.java:112) ~[spring-kafka-2.7.9.jar!/:2.7.9]     at org.springframework.kafka.listener.KafkaMessageListenerContainer$ListenerConsumer.handleConsumerException(KafkaMessageListenerContainer.java:1604) ~[spring-kafka-2.7.9.jar!/:2.7.9]     at org.springframework.kafka.listener.KafkaMessageListenerContainer$ListenerConsumer.run(KafkaMessageListenerContainer.java:1212) ~[spring-kafka-2.7.9.jar!/:2.7.9]     at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:na]     at java.base/java.util.concurrent.FutureTask.run(Unknown Source) ~[na:na]     at java.base/java.lang.Thread.run(Unknown Source) ~[na:na] Caused by: org.apache.kafka.common.errors.TimeoutException: Timeout of 60000ms expired before the position for partition dummy-0 could be determined
 {noformat}
Getting "no record information available" consumer exception as the FetchPosition is pointing to old committed offset.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)