You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@flink.apache.org by "zhijiang (Jira)" <ji...@apache.org> on 2020/02/10 07:12:00 UTC

[jira] [Created] (FLINK-15962) Reduce the default chunk size in netty stack

zhijiang created FLINK-15962:
--------------------------------

             Summary: Reduce the default chunk size in netty stack
                 Key: FLINK-15962
                 URL: https://issues.apache.org/jira/browse/FLINK-15962
             Project: Flink
          Issue Type: Improvement
          Components: Runtime / Network
            Reporter: zhijiang


The current default chunk size inside netty stack is 16MB, and one arena would create multiple chunks based on demands. But it does not mean that the new chunk is created after the previous one was fully exhausted, which would further boost the direct memory overhead.

In order to decrease the total memory overhead caused by netty, we can reduce the default chunk size and measure the effect via existing e2e, and also verify the performance concern via the benchmarks.

This improvement is orthogonal to the [FLINK-10742|https://issues.apache.org/jira/browse/FLINK-10742] 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)