You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@kafka.apache.org by "Andrew Schofield (Jira)" <ji...@apache.org> on 2025/05/12 17:18:00 UTC

[jira] [Resolved] (KAFKA-19051) Fix implicit acknowledgement cannot be overridden when RecordDeserializationException occurs

     [ https://issues.apache.org/jira/browse/KAFKA-19051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Andrew Schofield resolved KAFKA-19051.
--------------------------------------
    Resolution: Won't Fix

Reviewing this issue, it is clear that the behaviour suggested in the KIP whereby a consumer using explicit acknowledgement would be able to override the automatic release of a record which could not be deserialized did not make sense, because the application does not have a ConsumerRecord to support to the ShareConsumer.acknowledge method.

As a result, I have changed the KIP slightly to make it clear that "The {{KafkaShareConsumer}}  automatically releases the record, and the application cannot override this behavior".

> Fix implicit acknowledgement cannot be overridden when RecordDeserializationException occurs
> --------------------------------------------------------------------------------------------
>
>                 Key: KAFKA-19051
>                 URL: https://issues.apache.org/jira/browse/KAFKA-19051
>             Project: Kafka
>          Issue Type: Sub-task
>          Components: consumer
>            Reporter: Frédérik ROULEAU
>            Assignee: Kuan Po Tseng
>            Priority: Major
>
> When a record generates a RecordDeserializationException, KIP mentioned that with explicit acknowledgement the default Release can be overridden.
> When tried, I have:
> {code:java}
> Exception in thread "main" java.lang.IllegalStateException: The record cannot be acknowledged.
>     at org.apache.kafka.clients.consumer.internals.ShareFetch.acknowledge(ShareFetch.java:123)
>     at org.apache.kafka.clients.consumer.internals.ShareConsumerImpl.acknowledge(ShareConsumerImpl.java:683)
>     at org.apache.kafka.clients.consumer.KafkaShareConsumer.acknowledge(KafkaShareConsumer.java:534)
>     at org.example.frouleau.kip932.Main.main(Main.java:62) {code}
> It looks like the record was already released.
> Code used:
> {code:java}
> //....
> } catch (RecordDeserializationException re) {
>     long offset = re.offset();
>     Throwable t = re.getCause();
>     LOGGER.error("Failed to deserialize record at partition={} offset={}", re.topicPartition().partition(), offset, t);
>     ConsumerRecord<String,String> record = new ConsumerRecord<>(re.topicPartition().topic(), re.topicPartition().partition(), offset, "", "");
>     consumer.acknowledge(record, AcknowledgeType.REJECT);
> } {code}



--
This message was sent by Atlassian Jira
(v8.20.10#820010)