You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@flink.apache.org by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2022/10/08 07:17:00 UTC

[jira] [Updated] (FLINK-29351) Enable input buffer floating for blocking shuffle

     [ https://issues.apache.org/jira/browse/FLINK-29351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

ASF GitHub Bot updated FLINK-29351:
-----------------------------------
    Labels: pull-request-available  (was: )

> Enable input buffer floating for blocking shuffle
> -------------------------------------------------
>
>                 Key: FLINK-29351
>                 URL: https://issues.apache.org/jira/browse/FLINK-29351
>             Project: Flink
>          Issue Type: Improvement
>          Components: Runtime / Network
>            Reporter: Yingjie Cao
>            Priority: Major
>              Labels: pull-request-available
>             Fix For: 1.17.0
>
>
> At input gate, Flink needs exclusive buffers for each input channel. For large parallelism jobs, it is easy to cause "Insufficient number of network buffers" error. This ticket aims to make all input network buffers floating for blocking shuffle to reduce the possibility of "Insufficient number of network buffers" error. This change can also improve the default blocking shuffle performance because buffer floating can increase the buffer utilization.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)