You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@flink.apache.org by "Zhijiang (Jira)" <ji...@apache.org> on 2020/03/20 09:22:00 UTC

[jira] [Closed] (FLINK-15962) Reduce the default chunk size in netty stack

     [ https://issues.apache.org/jira/browse/FLINK-15962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Zhijiang closed FLINK-15962.
----------------------------
    Resolution: Fixed

Merged in master : 0bc38ba058165aa6751e7e4c654e37203df3aa35

> Reduce the default chunk size in netty stack
> --------------------------------------------
>
>                 Key: FLINK-15962
>                 URL: https://issues.apache.org/jira/browse/FLINK-15962
>             Project: Flink
>          Issue Type: Improvement
>          Components: Runtime / Network
>            Reporter: Zhijiang
>            Assignee: Yun Gao
>            Priority: Major
>              Labels: pull-request-available
>          Time Spent: 20m
>  Remaining Estimate: 0h
>
> The current default chunk size inside netty stack is 16MB, and one arena would create multiple chunks based on demands. But it does not mean that the new chunk is created after the previous one was fully exhausted, which would further boost the direct memory overhead.
> In order to decrease the total memory overhead caused by netty, we can reduce the default chunk size and measure the effect via existing e2e, and also verify the performance concern via the benchmarks.
> This improvement is orthogonal to the [FLINK-10742|https://issues.apache.org/jira/browse/FLINK-10742] 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)