You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@flink.apache.org by "Yun Gao (Jira)" <ji...@apache.org> on 2022/01/27 08:06:00 UTC

[jira] [Commented] (FLINK-25786) Adjust the generation of subpartition data storage order for sort-shuffle from random shuffle to random shift

    [ https://issues.apache.org/jira/browse/FLINK-25786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17482953#comment-17482953 ] 

Yun Gao commented on FLINK-25786:
---------------------------------

Fix on master via 8bd62ec0819d73b7b42d74835b3077f7f25ab48d

> Adjust the generation of subpartition data storage order for sort-shuffle from random shuffle to random shift
> -------------------------------------------------------------------------------------------------------------
>
>                 Key: FLINK-25786
>                 URL: https://issues.apache.org/jira/browse/FLINK-25786
>             Project: Flink
>          Issue Type: Sub-task
>          Components: Runtime / Network
>            Reporter: Yingjie Cao
>            Assignee: Yingjie Cao
>            Priority: Major
>              Labels: pull-request-available
>             Fix For: 1.15.0
>
>
> Currently, for sort-shuffle the generation of subpartition data storage order  is random shuffle. However, if there is no enough resources to run the downstream consumer tasks in parallel, the performance can be influenced because of the random disk IO caused by the random subpartition data storage order. This ticket aims to improve this scenario.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)