You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@flink.apache.org by "Yuxin Tan (Jira)" <ji...@apache.org> on 2022/08/05 06:34:00 UTC

[jira] [Created] (FLINK-28823) Enlarge the max requested buffers for SortMergeResultPartitionReadScheduler

Yuxin Tan created FLINK-28823:
---------------------------------

             Summary: Enlarge the max requested buffers for SortMergeResultPartitionReadScheduler
                 Key: FLINK-28823
                 URL: https://issues.apache.org/jira/browse/FLINK-28823
             Project: Flink
          Issue Type: Sub-task
          Components: Runtime / Network
    Affects Versions: 1.16.0
            Reporter: Yuxin Tan


The num of the max requested buffers in SortMergeResultPartitionReadScheduler is determined by the num of subpartitions, which may be insufficient in some scenarios, such as speculative execution and partition reuse.

Therefore, we should increase the max requested buffers to make full use of available memory when TM memory is sufficient.

 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)