You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@flink.apache.org by "Yun Gao (Jira)" <ji...@apache.org> on 2022/01/27 08:05:00 UTC

[jira] [Closed] (FLINK-25780) Reduce the maximum size of data output buffers per result partition for sort-shuffle

     [ https://issues.apache.org/jira/browse/FLINK-25780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Yun Gao closed FLINK-25780.
---------------------------
    Resolution: Fixed

> Reduce the maximum size of data output buffers per result partition for sort-shuffle
> ------------------------------------------------------------------------------------
>
>                 Key: FLINK-25780
>                 URL: https://issues.apache.org/jira/browse/FLINK-25780
>             Project: Flink
>          Issue Type: Sub-task
>          Components: Runtime / Network
>            Reporter: Yingjie Cao
>            Assignee: Yingjie Cao
>            Priority: Major
>              Labels: pull-request-available
>             Fix For: 1.15.0
>
>
> The data output buffer of sort-shuffle is for better disk IO performance and currently, the total data output buffer size is 16M which is pretty big. However, blocking request too many buffers may influence performance. This ticket aims to reduce the maximum number of data output buffers to reduce the buffer request time. The selected value is an empirical one based on the TPC-DS test results.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)