You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@kafka.apache.org by "Knowles Atchison Jr (Jira)" <ji...@apache.org> on 2021/10/05 16:59:00 UTC

[jira] [Assigned] (KAFKA-13348) Allow Source Tasks to Handle Producer Exceptions

     [ https://issues.apache.org/jira/browse/KAFKA-13348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Knowles Atchison Jr reassigned KAFKA-13348:
-------------------------------------------

    Assignee: Knowles Atchison Jr

> Allow Source Tasks to Handle Producer Exceptions
> ------------------------------------------------
>
>                 Key: KAFKA-13348
>                 URL: https://issues.apache.org/jira/browse/KAFKA-13348
>             Project: Kafka
>          Issue Type: Improvement
>          Components: KafkaConnect
>    Affects Versions: 3.1.0, 2.8.1, 3.0.0
>            Reporter: Knowles Atchison Jr
>            Assignee: Knowles Atchison Jr
>            Priority: Major
>
> KAFKA-8586 added capture of Producer Exceptions which will kill the connector.
> There is a need to allow the connector itself to be aware of these errors, handle it in some manner, and continuing processing records.
> The proposed change is to add a function to SourceTask that allows handling of the SourceRecord and Exception as thrown from the Producer. The SourceTask can examine these items and determine if it is appropriate to die (current behavior) or let the record be thrown away and continue processing.
> The current behavior will be maintained by defaulting to returning false from this function. If the implementing SourceTask override of this function returns true, Kafka Connect will ignore this error record and continue processing.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)