You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@flink.apache.org by "Yuxin Tan (Jira)" <ji...@apache.org> on 2022/07/07 10:07:00 UTC

[jira] [Created] (FLINK-28446) Expose more information in PartitionDescriptor to support more optimized Shuffle Service

Yuxin Tan created FLINK-28446:
---------------------------------

             Summary: Expose more information in PartitionDescriptor to support more optimized Shuffle Service
                 Key: FLINK-28446
                 URL: https://issues.apache.org/jira/browse/FLINK-28446
             Project: Flink
          Issue Type: Improvement
    Affects Versions: 1.16.0
            Reporter: Yuxin Tan


To improve shuffle performance, more detailed fields should be added to PartitionDescriptor, for example, whether the partition is a broadcast partition or the distribution pattern of the intermediate result.

After the detailed information is added, the Shuffle Service can use different Shuffle strategies in different situations, which may lead to better shuffle performance.

In addition, we only add fields to PartitionDescriptor, which is compatible with the previous version, and the added fields are insensitive to earlier users.

 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)