You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kafka.apache.org by "Konstantine Karantasis (Jira)" <ji...@apache.org> on 2022/03/22 23:55:00 UTC

[jira] [Created] (KAFKA-13759) Disable producer idempotency by default in producers instantiated by Connect

Konstantine Karantasis created KAFKA-13759:
----------------------------------------------

             Summary: Disable producer idempotency by default in producers instantiated by Connect
                 Key: KAFKA-13759
                 URL: https://issues.apache.org/jira/browse/KAFKA-13759
             Project: Kafka
          Issue Type: Bug
          Components: KafkaConnect
            Reporter: Konstantine Karantasis
            Assignee: Konstantine Karantasis


https://issues.apache.org/jira/browse/KAFKA-7077 was merged recently referring to KIP-318. Before that in AK 3.0 idempotency was enabled by default across Kafka producers. 

However, some compatibility implications were missed in both cases. 

If idempotency is enabled by default Connect won't be able to communicate via its producers with Kafka brokers older than version 0.11. Perhaps more importantly, for brokers older than version 2.8 the {{IDEMPOTENT_WRITE}} ACL is required to be granted to the principal of the Connect worker. 

Given the above caveats, this ticket proposes to explicitly disable producer idempotency in Connect by default. This feature, as it happens today, can be enabled by setting worker and/or connector properties. However, enabling it by default should be considered in a major version upgrade and after KIP-318 is updated to mention the compatibility requirements and gets officially approved. 



--
This message was sent by Atlassian Jira
(v8.20.1#820001)