[jira] [Created] (FLINK-21734) Allow BLOCKING result partition to be individually consumable

["Zhu Zhu (Jira)" <ji...@apache.org>]

Zhu Zhu created FLINK-21734:
-------------------------------

             Summary: Allow BLOCKING result partition to be individually consumable
                 Key: FLINK-21734
                 URL: https://issues.apache.org/jira/browse/FLINK-21734
             Project: Flink
          Issue Type: Improvement
          Components: Runtime / Coordination
    Affects Versions: 1.13.0
            Reporter: Zhu Zhu


Currently a BLOCKING result partition is consumable only when all the partitions of the corresponding IntermediateResult become consumable. This is an unnecessary complication and has caused some problems (FLINK-21707). 
Therefore I propose to simplify it to let BLOCKING result partitions be consumable individually. 
Note that this will result in the scheduling to become execution-vertex-wise instead of stage-wise, with a nice side effect towards better resource utilization. The PipelinedRegionSchedulingStrategy can be simplified along with change to get rid of the {{correlatedResultPartitions}}.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)