You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@flink.apache.org by "Weijie Guo (Jira)" <ji...@apache.org> on 2022/11/29 04:27:00 UTC

[jira] [Created] (FLINK-30233) Hybrid full result partition should also work with speculative execution

Weijie Guo created FLINK-30233:
----------------------------------

             Summary: Hybrid full result partition should also work with speculative execution
                 Key: FLINK-30233
                 URL: https://issues.apache.org/jira/browse/FLINK-30233
             Project: Flink
          Issue Type: Sub-task
          Components: Runtime / Coordination
    Affects Versions: 1.17.0
            Reporter: Weijie Guo
            Assignee: Weijie Guo


Hybrid full result partition is re-consumable now, and we have enabled `VertexwiseSchedulingStrategy` to support the scheduling of hybrid type edges in FLINK-29767. Now is the time to enable hybrid full result partition to support speculative execution.

In the case of speculative execution, downstream task can be scheduled only if all upstream task finished. In the next ticket, we will introduce a new mechanism to enable the downstream to be scheduled after partial upstream task is finished, thus improving the performance.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)