[jira] [Created] (KAFKA-20535) Investigate potential improvements to async consumer CPU usage under low max.poll.records

["Lianet Magrans (Jira)" <ji...@apache.org>]

Lianet Magrans created KAFKA-20535:
--------------------------------------

             Summary: Investigate potential improvements to async consumer CPU usage under low max.poll.records 
                 Key: KAFKA-20535
                 URL: https://issues.apache.org/jira/browse/KAFKA-20535
             Project: Kafka
          Issue Type: Task
          Components: clients, consumer
            Reporter: Lianet Magrans


As series of improvements were already made to reduce CPU usage on the async consumer for low max.poll.records (e.g, 5).

Changes to improve CPU usage https://issues.apache.org/jira/browse/KAFKA-18376

That showed good improvements (async CPU usage aligned with the classic consumer), but it introduced some correctness issues that had to be fixed (https://issues.apache.org/jira/browse/KAFKA-20332 ). After these correctness fixes, low max.poll.record scenarios CPU went from 18% to 25% +- (classic remains at 18%) in some validations (scenarios with default configs remained unaffected)

This task is to look into the low max.poll.records case and CPU usage for the async consumer, to identify what else could be improved there (without sacrificing any correctness guarantees) 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)