You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Yingjie Cao (Jira)" <ji...@apache.org> on 2022/07/21 02:51:00 UTC
[jira] [Resolved] (FLINK-28446) Expose more information in PartitionDescriptor to support more optimized Shuffle Service
[ https://issues.apache.org/jira/browse/FLINK-28446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Yingjie Cao resolved FLINK-28446.
---------------------------------
Resolution: Fixed
Merged into master via e630778eb8b500148b01583d34ec195a80c99c3f
> Expose more information in PartitionDescriptor to support more optimized Shuffle Service
> ----------------------------------------------------------------------------------------
>
> Key: FLINK-28446
> URL: https://issues.apache.org/jira/browse/FLINK-28446
> Project: Flink
> Issue Type: Improvement
> Affects Versions: 1.16.0
> Reporter: Yuxin Tan
> Assignee: Yuxin Tan
> Priority: Critical
> Labels: pull-request-available
>
> To improve shuffle performance, more detailed fields should be added to PartitionDescriptor, for example, whether the partition is a broadcast partition or the distribution pattern of the intermediate result.
> After the detailed information is added, the Shuffle Service can use different Shuffle strategies in different situations, which may lead to better shuffle performance.
> In addition, we only add fields to PartitionDescriptor, which is compatible with the previous version, and the added fields are insensitive to earlier users.
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)