You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@flink.apache.org by "Yuxin Tan (Jira)" <ji...@apache.org> on 2022/08/05 07:23:00 UTC

[jira] [Created] (FLINK-28828) Sorting all unfinished readers in batches at one time in SortMergeResultPartitionReadScheduler

Yuxin Tan created FLINK-28828:
---------------------------------

             Summary: Sorting all unfinished readers in batches at one time in SortMergeResultPartitionReadScheduler
                 Key: FLINK-28828
                 URL: https://issues.apache.org/jira/browse/FLINK-28828
             Project: Flink
          Issue Type: Sub-task
          Components: Runtime / Network
    Affects Versions: 1.16.0
            Reporter: Yuxin Tan


Currently, when reading data in SortMergeResultPartitionReadScheduler, the reader is added to the priority queue immediately. However, the data read from this reader may not have been consumed, which will cause this reader to be ranked later in the queue, which is unfavorable to sequential reading.

To solve the issue, After reading the data, we should sort all unfinished readers in batches at one time, that is, add all unfinished readers to the priority queue, which is more conducive to sequential reading.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)