[jira] [Reopened] (FLINK-23974) Decreased throughput with enabled buffer debloat

["Piotr Nowojski (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/FLINK-23974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Piotr Nowojski reopened FLINK-23974:
------------------------------------

> Decreased throughput with enabled buffer debloat
> ------------------------------------------------
>
>                 Key: FLINK-23974
>                 URL: https://issues.apache.org/jira/browse/FLINK-23974
>             Project: Flink
>          Issue Type: Sub-task
>    Affects Versions: 1.14.0
>            Reporter: Anton Kalashnikov
>            Assignee: Anton Kalashnikov
>            Priority: Major
>             Fix For: 1.15.0
>
>
> According to task https://issues.apache.org/jira/browse/FLINK-23456, we have some performance drop when the buffer debloat is enabled:
>  * for static load with throttling in source - 1-3%
>  * for sinus shape load with throttling in source - 2-3%
>  * for erratic load with throttling in source - 5-6%
> It needs to investigate the reason for that and try to improve if it is possible.
> It makes sense to write the microbenchmarks for these scenarios to reproduce the problem locally.
> Problem assumption:
> Highly likely the problem is the speed of reaction on increasing load. During the investigation, it needs to pay attention to the calculation throughput for different load profiles. It is possible that when the load is low we are decreasing the buffer size to a small value(maybe minimum value) and when the load gets back to high we need several iterations of the throughput calculation to reach the appropriate buffer size.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)