You are viewing a plain text version of this content. The canonical link for it is here.

Posted to jira@kafka.apache.org by "Jeff Kim (Jira)" <ji...@apache.org> on 2023/05/26 01:33:00 UTC

[jira] [Updated] (KAFKA-15029) Make ProducerIdBlock size configurable

     [ https://issues.apache.org/jira/browse/KAFKA-15029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jeff Kim updated KAFKA-15029:
-----------------------------
    Description: 
The producer id block size is currently fixed at 1000. Increasing the size allows the pid manager to process more init pid requests before allocating more. The current 1000 is quite small and given that clusters can have thousands of producers, we should make this configurable to adapt in the future. We shoudl also consider updating to a global block size of 5000

 

ProducerIdsIntegrationTest.scala has a disabled test (from KAFKA-14694) that we should also enable once we have configurable block sizes.

  was:
The producer id block size is currently fixed at 1000. Increasing the size allows the pid manager to process more init pid requests before allocating more. The current 1000 is quite small and given that clusters can have thousands of producers, we should make this configurable to adapt in the future. We shoudl also consider updating to a global block size of 5000

 

ProducerIdsIntegrationTest.scala has a disabled test that we should also enable once we have configurable block sizes.


> Make ProducerIdBlock size configurable
> --------------------------------------
>
>                 Key: KAFKA-15029
>                 URL: https://issues.apache.org/jira/browse/KAFKA-15029
>             Project: Kafka
>          Issue Type: Task
>            Reporter: Jeff Kim
>            Priority: Major
>
> The producer id block size is currently fixed at 1000. Increasing the size allows the pid manager to process more init pid requests before allocating more. The current 1000 is quite small and given that clusters can have thousands of producers, we should make this configurable to adapt in the future. We shoudl also consider updating to a global block size of 5000
>  
> ProducerIdsIntegrationTest.scala has a disabled test (from KAFKA-14694) that we should also enable once we have configurable block sizes.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)