You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@flink.apache.org by "Yingjie Cao (Jira)" <ji...@apache.org> on 2022/01/24 11:28:00 UTC

[jira] [Created] (FLINK-25780) Reduce the maximum number of data output buffers for sort-shuffle

Yingjie Cao created FLINK-25780:
-----------------------------------

             Summary: Reduce the maximum number of data output buffers for sort-shuffle
                 Key: FLINK-25780
                 URL: https://issues.apache.org/jira/browse/FLINK-25780
             Project: Flink
          Issue Type: Sub-task
          Components: Runtime / Network
            Reporter: Yingjie Cao
             Fix For: 1.15.0


The data output buffer of sort-shuffle is for better disk IO performance and currently, the total data output buffer size is 16M which is pretty big. However, blocking request too many buffers may influence performance. This ticket aims to reduce the maximum number of data output buffers to reduce the buffer request time. The selected value is an empirical one based on the TPC-DS test results.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)