You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@kafka.apache.org by "Luke Stephenson (JIRA)" <ji...@apache.org> on 2019/08/05 01:49:00 UTC
[jira] [Commented] (KAFKA-8325) Remove from the incomplete set
failed. This should be impossible
[ https://issues.apache.org/jira/browse/KAFKA-8325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16899717#comment-16899717 ]
Luke Stephenson commented on KAFKA-8325:
----------------------------------------
I'm also seeing this issue with version 2.2.1 of the client (brokers are running kafka 2.1.1).
In my application, when the KafkaProducer callback is invoked, I'm completing a Scala Future. This is also triggering a `java.lang.IllegalStateException: Promise already completed.` to be logged. So that's in alignment with the `IncompleteBatches` reporting.
As [~bob-barrett] reported, the initial cause of this seems to be triggered by
```
Got error produce response in correlation id 1386 on topic-partition my.topic-0, splitting and retrying (30 attempts left). Error: MESSAGE_TOO_LARGE
```
> Remove from the incomplete set failed. This should be impossible
> ----------------------------------------------------------------
>
> Key: KAFKA-8325
> URL: https://issues.apache.org/jira/browse/KAFKA-8325
> Project: Kafka
> Issue Type: Bug
> Components: producer
> Affects Versions: 2.1.0, 2.3.0
> Reporter: Mattia Barbon
> Assignee: Bob Barrett
> Priority: Major
>
> I got this error when using the Kafka producer. So far it happened twice, with an interval of about 1 week.
> {{ERROR [2019-05-05 08:43:07,505] org.apache.kafka.clients.producer.internals.Sender: [Producer clientId=<redacted>, transactionalId=<redacted>] Uncaught error in kafka producer I/O thread:}}
> {{ ! java.lang.IllegalStateException: Remove from the incomplete set failed. This should be impossible.}}
> {{ ! at org.apache.kafka.clients.producer.internals.IncompleteBatches.remove(IncompleteBatches.java:44)}}
> {{ ! at org.apache.kafka.clients.producer.internals.RecordAccumulator.deallocate(RecordAccumulator.java:645)}}
> {{ ! at org.apache.kafka.clients.producer.internals.Sender.failBatch(Sender.java:717)}}
> {{ ! at org.apache.kafka.clients.producer.internals.Sender.sendProducerData(Sender.java:365)}}
> {{ ! at org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:308)}}
> {{ ! at org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:233)}}
> {{ ! at java.lang.Thread.run(Thread.java:748)}}
--
This message was sent by Atlassian JIRA
(v7.6.14#76016)