You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@kafka.apache.org by "Hechao Li (Jira)" <ji...@apache.org> on 2024/04/09 21:56:00 UTC

[jira] [Created] (KAFKA-16496) Make the default of receive.buffer.bytes -1 instead of 5

Hechao Li created KAFKA-16496:
---------------------------------

             Summary: Make the default of receive.buffer.bytes -1 instead of 5
                 Key: KAFKA-16496
                 URL: https://issues.apache.org/jira/browse/KAFKA-16496
             Project: Kafka
          Issue Type: Improvement
            Reporter: Hechao Li


Currently, kafka has a default config receive.buffer.bytes=64k, which translates to SO_RCVBUF = 65536. As a result, the Linux kernel can't auto tune the receive window. This will cripple performance in many scenarios, especially for internet traffic.

In our environment, we have seen a timeout after [a kernel patch|https://lore.kernel.org/netdev/20230717152917.751987-1-edumazet@google.com/T/] that makes the initial receive window 25% instead of 50% of SO_RCVBUF, together with the default request.timeout.ms=30000, it causes an application-level timeout.

See also https://lore.kernel.org/all/20240409164355.1721078-1-hli@netflix.com/



--
This message was sent by Atlassian Jira
(v8.20.10#820010)