You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@kafka.apache.org by "Knowles Atchison Jr (Jira)" <ji...@apache.org> on 2021/11/02 13:50:00 UTC
[jira] [Updated] (KAFKA-13348) Allow Source Tasks to Handle
Producer Exceptions
[ https://issues.apache.org/jira/browse/KAFKA-13348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Knowles Atchison Jr updated KAFKA-13348:
----------------------------------------
Description:
KAFKA-8586 added capture of Producer Exceptions which will kill the connector.
There is a need to allow the connector itself to be aware of these errors, handle it in some manner, and continuing processing records.
The proposed change is to add a getter to the retry operator and allow producer failure to be ignored via the "errors.tolerance" configuration setting. The connect will receive a callback to commitRecord() with a null MetadataRecord.
The current behavior is kept if errors.tolerance is not set to all.
see: https://cwiki.apache.org/confluence/display/KAFKA/KIP-779%3A+Allow+Source+Tasks+to+Handle+Producer+Exceptions
was:
KAFKA-8586 added capture of Producer Exceptions which will kill the connector.
There is a need to allow the connector itself to be aware of these errors, handle it in some manner, and continuing processing records.
The proposed change is to add a getter to the retry operator and allow producer failure to be ignored via the "errors.tolerance" configuration setting. The connect will receive a callback to commitRecord() with a null MetadataRecord.
The current behavior is kept if errors.tolerance is not set to all.
> Allow Source Tasks to Handle Producer Exceptions
> ------------------------------------------------
>
> Key: KAFKA-13348
> URL: https://issues.apache.org/jira/browse/KAFKA-13348
> Project: Kafka
> Issue Type: Improvement
> Components: KafkaConnect
> Affects Versions: 3.1.0, 2.8.1, 3.0.0
> Reporter: Knowles Atchison Jr
> Assignee: Knowles Atchison Jr
> Priority: Major
>
> KAFKA-8586 added capture of Producer Exceptions which will kill the connector.
> There is a need to allow the connector itself to be aware of these errors, handle it in some manner, and continuing processing records.
> The proposed change is to add a getter to the retry operator and allow producer failure to be ignored via the "errors.tolerance" configuration setting. The connect will receive a callback to commitRecord() with a null MetadataRecord.
> The current behavior is kept if errors.tolerance is not set to all.
>
> see: https://cwiki.apache.org/confluence/display/KAFKA/KIP-779%3A+Allow+Source+Tasks+to+Handle+Producer+Exceptions
--
This message was sent by Atlassian Jira
(v8.3.4#803005)