[jira] [Updated] (FLINK-24191) Adjusting number of buffers besides buffer size

["Yun Gao (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/FLINK-24191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Yun Gao updated FLINK-24191:
----------------------------
    Fix Version/s: 1.16.0

> Adjusting number of buffers besides buffer size
> -----------------------------------------------
>
>                 Key: FLINK-24191
>                 URL: https://issues.apache.org/jira/browse/FLINK-24191
>             Project: Flink
>          Issue Type: Sub-task
>          Components: Runtime / Network
>    Affects Versions: 1.14.0
>            Reporter: Anton Kalashnikov
>            Priority: Major
>             Fix For: 1.15.0, 1.16.0
>
>
> "Buffer debloat" adjusts only the buffer size but it also makes sense to adjust the number of buffers. It is not clear for now what should be adjusted and in which proportions so it needs to think about how to figure this out.
> The main idea of this ticket is to understand what is better to have one buffer of 10 records or 10 buffers of 1 record. On one hand handling of each buffer has an overhead on another hand,  in case of low load it doesn't really make sense and it is ok to have many buffers with small sizes. Perhaps, we need benchmarks(microbenchamrk) to understand correlation between performance / buffers number / buffer size.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)