You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@kafka.apache.org by "Jiangjie Qin (JIRA)" <ji...@apache.org> on 2017/05/12 20:02:04 UTC

[jira] [Work started] (KAFKA-5211) KafkaConsumer should not skip a corrupted record after throwing an exception.

     [ https://issues.apache.org/jira/browse/KAFKA-5211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Work on KAFKA-5211 started by Jiangjie Qin.
-------------------------------------------
> KafkaConsumer should not skip a corrupted record after throwing an exception.
> -----------------------------------------------------------------------------
>
>                 Key: KAFKA-5211
>                 URL: https://issues.apache.org/jira/browse/KAFKA-5211
>             Project: Kafka
>          Issue Type: Bug
>            Reporter: Jiangjie Qin
>            Assignee: Jiangjie Qin
>              Labels: clients, consumer
>             Fix For: 0.11.0.0
>
>
> In 0.10.2, when there is a corrupted record, KafkaConsumer.poll() will throw an exception and block on that corrupted record. In the latest trunk this behavior has changed to skip the corrupted record (which is the old consumer behavior). With KIP-98, skipping corrupted messages would be a little dangerous as the message could be a control message for a transaction. We should fix the issue to let the KafkaConsumer block on the corrupted messages.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)