You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kafka.apache.org by "Konstantine Karantasis (Jira)" <ji...@apache.org> on 2022/03/22 23:55:00 UTC
[jira] [Created] (KAFKA-13759) Disable producer idempotency by default in producers instantiated by Connect
Konstantine Karantasis created KAFKA-13759:
----------------------------------------------
Summary: Disable producer idempotency by default in producers instantiated by Connect
Key: KAFKA-13759
URL: https://issues.apache.org/jira/browse/KAFKA-13759
Project: Kafka
Issue Type: Bug
Components: KafkaConnect
Reporter: Konstantine Karantasis
Assignee: Konstantine Karantasis
https://issues.apache.org/jira/browse/KAFKA-7077 was merged recently referring to KIP-318. Before that in AK 3.0 idempotency was enabled by default across Kafka producers.
However, some compatibility implications were missed in both cases.
If idempotency is enabled by default Connect won't be able to communicate via its producers with Kafka brokers older than version 0.11. Perhaps more importantly, for brokers older than version 2.8 the {{IDEMPOTENT_WRITE}} ACL is required to be granted to the principal of the Connect worker.
Given the above caveats, this ticket proposes to explicitly disable producer idempotency in Connect by default. This feature, as it happens today, can be enabled by setting worker and/or connector properties. However, enabling it by default should be considered in a major version upgrade and after KIP-318 is updated to mention the compatibility requirements and gets officially approved.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)