You are viewing a plain text version of this content. The canonical link for it is here.

Posted to jira@kafka.apache.org by "Jiri Syrovy (Jira)" <ji...@apache.org> on 2021/08/10 08:51:00 UTC

[jira] [Created] (KAFKA-13185) Kafka Connect should clear messageBatch after rewind

Jiri Syrovy created KAFKA-13185:
-----------------------------------

             Summary: Kafka Connect should clear messageBatch after rewind
                 Key: KAFKA-13185
                 URL: https://issues.apache.org/jira/browse/KAFKA-13185
             Project: Kafka
          Issue Type: Bug
          Components: KafkaConnect
            Reporter: Jiri Syrovy


WorkerSinkTask contains logic to handle RetriableException that happened in either put or flush. If the same Exception happens for longer than poll or timeout interval and it's thrown as well in preCommit/flush it causes offset to rewind back to the last committed position. Meanwhile messageBatch (message buffer) is not cleared and during the next poll it's used passed to the put method. 

During the next poll the same message is read from the broker and again passed to the put method. 

This results into duplicated message sent by the connector after RetrieableException.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)