You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@kafka.apache.org by "Eugen Feller (JIRA)" <ji...@apache.org> on 2018/09/12 19:14:00 UTC

[jira] [Created] (KAFKA-7405) Support for graceful handling of corrupted records in Kafka consumer

Eugen Feller created KAFKA-7405:
-----------------------------------

             Summary: Support for graceful handling of corrupted records in Kafka consumer
                 Key: KAFKA-7405
                 URL: https://issues.apache.org/jira/browse/KAFKA-7405
             Project: Kafka
          Issue Type: Improvement
          Components: consumer, streams
    Affects Versions: 1.1.1, 0.11.0.3, 0.10.2.2
            Reporter: Eugen Feller


We have run into issues several times where a corrupted records cause the Kafka consumer to throw an error code 2 exception in the fetch layer that can not be handled gracefully. Specifically, when using Kafka streams we run into KAFKA-6977 that throws an IllegalStateException. It would be great if the Kafka consumer could be extended with a setting similar to [KIP-161|https://cwiki.apache.org/confluence/display/KAFKA/KIP-161%3A+streams+deserialization+exception+handlers], that would allow one to cleanly ignore corrupted records.

 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)