[jira] [Commented] (KAFKA-16227) Console consumer fails with `IllegalStateException`

["Lianet Magrans (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/KAFKA-16227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17814894#comment-17814894 ] 

Lianet Magrans commented on KAFKA-16227:
----------------------------------------

[~kirktrue] Seems like a similar challenge came out in the context of KIP-951, might be helpful https://issues.apache.org/jira/browse/KAFKA-15824 when we get to this one

> Console consumer fails with `IllegalStateException`
> ---------------------------------------------------
>
>                 Key: KAFKA-16227
>                 URL: https://issues.apache.org/jira/browse/KAFKA-16227
>             Project: Kafka
>          Issue Type: Sub-task
>          Components: clients
>    Affects Versions: 3.7.0
>            Reporter: David Jacot
>            Assignee: Kirk True
>            Priority: Major
>
> I have seen a few occurrences like the following one. There is a race between the background thread and the foreground thread. I imagine the following steps:
>  * quickstart-events-2 is assigned by the background thread;
>  * the foreground thread starts the initialization of the partition (e.g. reset offset);
>  * quickstart-events-2 is removed by the background thread;
>  * the initialization completes and quickstart-events-2 does not exist anymore.
>  
> {code:java}
> [2024-02-06 16:21:57,375] ERROR Error processing message, terminating consumer process:  (kafka.tools.ConsoleConsumer$)
> java.lang.IllegalStateException: No current assignment for partition quickstart-events-2
> 	at org.apache.kafka.clients.consumer.internals.SubscriptionState.assignedState(SubscriptionState.java:367)
> 	at org.apache.kafka.clients.consumer.internals.SubscriptionState.updateHighWatermark(SubscriptionState.java:579)
> 	at org.apache.kafka.clients.consumer.internals.FetchCollector.handleInitializeSuccess(FetchCollector.java:283)
> 	at org.apache.kafka.clients.consumer.internals.FetchCollector.initialize(FetchCollector.java:226)
> 	at org.apache.kafka.clients.consumer.internals.FetchCollector.collectFetch(FetchCollector.java:110)
> 	at org.apache.kafka.clients.consumer.internals.AsyncKafkaConsumer.collectFetch(AsyncKafkaConsumer.java:1540)
> 	at org.apache.kafka.clients.consumer.internals.AsyncKafkaConsumer.pollForFetches(AsyncKafkaConsumer.java:1525)
> 	at org.apache.kafka.clients.consumer.internals.AsyncKafkaConsumer.poll(AsyncKafkaConsumer.java:711)
> 	at org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:874)
> 	at kafka.tools.ConsoleConsumer$ConsumerWrapper.receive(ConsoleConsumer.scala:473)
> 	at kafka.tools.ConsoleConsumer$.process(ConsoleConsumer.scala:103)
> 	at kafka.tools.ConsoleConsumer$.run(ConsoleConsumer.scala:77)
> 	at kafka.tools.ConsoleConsumer$.main(ConsoleConsumer.scala:54)
> 	at kafka.tools.ConsoleConsumer.main(ConsoleConsumer.scala) {code}
>  
>  



--
This message was sent by Atlassian Jira
(v8.20.10#820010)