You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Zhu Zhu (Jira)" <ji...@apache.org> on 2019/10/14 12:28:00 UTC

[jira] [Updated] (FLINK-14232) Support global failure handling for DefaultScheduler (SchedulerNG)

     [ https://issues.apache.org/jira/browse/FLINK-14232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Zhu Zhu updated FLINK-14232:
----------------------------
    Summary: Support global failure handling for DefaultScheduler (SchedulerNG)  (was: Support full restarts for DefaultScheduler (SchedulerNG))

> Support global failure handling for DefaultScheduler (SchedulerNG)
> ------------------------------------------------------------------
>
>                 Key: FLINK-14232
>                 URL: https://issues.apache.org/jira/browse/FLINK-14232
>             Project: Flink
>          Issue Type: Sub-task
>          Components: Runtime / Coordination
>    Affects Versions: 1.10.0
>            Reporter: Zhu Zhu
>            Assignee: Zhu Zhu
>            Priority: Major
>             Fix For: 1.10.0
>
>
> Global failure handling(full restarts) is widely used in ExecutionGraph components and even other components to recover the job from an inconsistent state. 
> We need to support it for DefaultScheduler to not break the safety net. More details see [here|https://github.com/apache/flink/pull/9663/files#r326892524].
> There can be follow ups of this task to replace usages of full restarts with JVM termination, in cases that are considered as bugs/unexpected to happen.
> Implementation plan:
> 1. Add {{getGlobalFailureHandlingResult(Throwable)}} in {{ExecutionFailureHandler}}
> 2. Add an interface {{handleGlobalFailure(Throwable)}} in {{SchedulerNG}} and implement it in {{DefaultScheduler}}
> 3. Add an interface {{notifyGlobalFailure(Throwable)}} in {{InternalTaskFailuresListener}} and rework the implementations to use {{SchedulerNG#handleGlobalFailure}}
> 4. Rework {{ExecutionGraph#failGlobal}} to invoke {{InternalTaskFailuresListener#notifyGlobalFailure}} for ng scheduler



--
This message was sent by Atlassian Jira
(v8.3.4#803005)