You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@flink.apache.org by "Till Rohrmann (Jira)" <ji...@apache.org> on 2020/03/27 14:13:00 UTC

[jira] [Closed] (FLINK-10078) Dispatcher should only block job submission during recovery

     [ https://issues.apache.org/jira/browse/FLINK-10078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Till Rohrmann closed FLINK-10078.
---------------------------------
    Resolution: Won't Do

This approach would complicate the whole state management of the {{Dispatcher}} component.

> Dispatcher should only block job submission during recovery
> -----------------------------------------------------------
>
>                 Key: FLINK-10078
>                 URL: https://issues.apache.org/jira/browse/FLINK-10078
>             Project: Flink
>          Issue Type: Improvement
>          Components: Runtime / Coordination
>    Affects Versions: 1.5.0
>            Reporter: Joey Echeverria
>            Priority: Major
>
> The Dispatcher currently doesn't confirm leadership until all jobs are recovered. This prevents any operations that require an active Dispatcher from working until after job recovery. This is primarily done to prevent race conditions between client retries and recovering jobs. An alternative approach would be to only block job submission while recovery is happening.
>  
> Note: we also need to check that no other RPCs change the internal state in such a way that it interferes with the job recovery.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)