You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@kafka.apache.org by "Guozhang Wang (Jira)" <ji...@apache.org> on 2019/10/16 16:51:00 UTC

[jira] [Resolved] (KAFKA-9039) Optimize replica fetching CPU utilization with large number of partitions

     [ https://issues.apache.org/jira/browse/KAFKA-9039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Guozhang Wang resolved KAFKA-9039.
----------------------------------
    Fix Version/s: 2.5.0
         Assignee: Lucas Bradstreet
       Resolution: Fixed

> Optimize replica fetching CPU utilization with large number of partitions
> -------------------------------------------------------------------------
>
>                 Key: KAFKA-9039
>                 URL: https://issues.apache.org/jira/browse/KAFKA-9039
>             Project: Kafka
>          Issue Type: Improvement
>          Components: core
>            Reporter: Guozhang Wang
>            Assignee: Lucas Bradstreet
>            Priority: Major
>             Fix For: 2.5.0
>
>
> Our current follower replica fetching logic has huge CPU cost with num.partitions to fetch from, and it scales non-linearly as well. There are a bunch of optimizations we can consider to try to reduce its cost and hopefully make it to be linear against the num.partitions.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)