You are viewing a plain text version of this content. The canonical link for it is here.

Posted to jira@kafka.apache.org by "Boyang Chen (Jira)" <ji...@apache.org> on 2020/04/16 15:55:00 UTC

[jira] [Updated] (KAFKA-9860) Transactional Producer could pre-add partitions

     [ https://issues.apache.org/jira/browse/KAFKA-9860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Boyang Chen updated KAFKA-9860:
-------------------------------
    Summary: Transactional Producer could pre-add partitions  (was: Transactional Producer could add partitions by batch at the end)

> Transactional Producer could pre-add partitions
> -----------------------------------------------
>
>                 Key: KAFKA-9860
>                 URL: https://issues.apache.org/jira/browse/KAFKA-9860
>             Project: Kafka
>          Issue Type: Improvement
>            Reporter: Boyang Chen
>            Assignee: Boyang Chen
>            Priority: Major
>
> As of today, the Producer transaction manager bookkeeps the partitions involved with current transaction. Each time it sees a new partition, it will try to send a request to add all the involved partitions to the broker, which results in multiple requests. If we could batch the work by the end of the transaction, we save unnecessary round trips.
> The proposed solution is to bump the EndTxn request with a field of partitions being added.
> We need to discuss the edge cases and correctness however, for sure.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)