You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Yingjie Cao (Jira)" <ji...@apache.org> on 2020/10/15 04:30:00 UTC

[jira] [Updated] (FLINK-19602) Introduce new config options to enable sort-merge based blocking shuffle

     [ https://issues.apache.org/jira/browse/FLINK-19602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Yingjie Cao updated FLINK-19602:
--------------------------------
    Description: 
1. taskmanager.network.sort-merge-blocking-shuffle.buffers-per-partition: Number of network buffers required for each sort-merge blocking result partition.

2. taskmanager.network.sort-merge-blocking-shuffle.min-parallelism: Minimum parallelism to enable the sort-merge based blocking shuffle.

With these new config options, the default behavior of blocking shuffle stays unchanged.

  was:
1. taskmanager.network.sort-merge-blocking-shuffle.enabled: Boolean flag to enable/disable sort-merge based blocking shuffle.

2. taskmanager.network.sort-merge-blocking-shuffle.buffers-per-partition: Number of network buffers required for each sort-merge blocking result partition.

3. taskmanager.network.sort-merge-blocking-shuffle.min-parallelism: Minimum parallelism to enable the sort-merge based blocking shuffle.

With these new config options, the default behavior of blocking shuffle stays unchanged.


> Introduce new config options to enable sort-merge based blocking shuffle
> ------------------------------------------------------------------------
>
>                 Key: FLINK-19602
>                 URL: https://issues.apache.org/jira/browse/FLINK-19602
>             Project: Flink
>          Issue Type: Sub-task
>          Components: Runtime / Network
>    Affects Versions: 1.12.0
>            Reporter: Yingjie Cao
>            Priority: Major
>             Fix For: 1.12.0
>
>
> 1. taskmanager.network.sort-merge-blocking-shuffle.buffers-per-partition: Number of network buffers required for each sort-merge blocking result partition.
> 2. taskmanager.network.sort-merge-blocking-shuffle.min-parallelism: Minimum parallelism to enable the sort-merge based blocking shuffle.
> With these new config options, the default behavior of blocking shuffle stays unchanged.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)