You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Yun Gao (Jira)" <ji...@apache.org> on 2021/01/22 04:02:00 UTC

[jira] [Updated] (FLINK-21066) Refactor the CheckpointCoordinator to compute the tasks to trigger/wait/commit dynamically

     [ https://issues.apache.org/jira/browse/FLINK-21066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Yun Gao updated FLINK-21066:
----------------------------
    Component/s: Runtime / Checkpointing

> Refactor the CheckpointCoordinator to compute the tasks to trigger/wait/commit dynamically
> ------------------------------------------------------------------------------------------
>
>                 Key: FLINK-21066
>                 URL: https://issues.apache.org/jira/browse/FLINK-21066
>             Project: Flink
>          Issue Type: Sub-task
>          Components: Runtime / Checkpointing
>            Reporter: Yun Gao
>            Assignee: Yun Gao
>            Priority: Major
>
> Currently Flink would identify the tasks to trigger/wait/commit in compile phase, and pass them to the CheckpointCoordinator via JobGraph and cache them in CheckpointCoordinator. However, to support checkpoint after some tasks finished, we might need to recompute the tasks to trigger/wait/commit for each checkpoint, thus we would first refactor CheckpointCoordinator to compute the tasks to trigger/wait/commit dynamically, but keeps the computing logic unchange (e.g., tasks to trigger are source tasks and tasks to wait/commit are all tasks)



--
This message was sent by Atlassian Jira
(v8.3.4#803005)