You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Shimin Yang (JIRA)" <ji...@apache.org> on 2018/09/17 07:28:00 UTC

[jira] [Assigned] (FLINK-10344) Rethink SubmittedJobGraphListener

     [ https://issues.apache.org/jira/browse/FLINK-10344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Shimin Yang reassigned FLINK-10344:
-----------------------------------

    Assignee: Shimin Yang

> Rethink SubmittedJobGraphListener
> ---------------------------------
>
>                 Key: FLINK-10344
>                 URL: https://issues.apache.org/jira/browse/FLINK-10344
>             Project: Flink
>          Issue Type: Sub-task
>          Components: Distributed Coordination
>    Affects Versions: 1.5.3, 1.6.0, 1.7.0
>            Reporter: Till Rohrmann
>            Assignee: Shimin Yang
>            Priority: Major
>             Fix For: 1.7.0
>
>
> The {{SubmittedJobGraphListener}} in {{ZooKeeperSubmittedJobGraphStore}} can return false positives. This is obviously problematic, because it causes the subsequent recovery operation to fail. Ideally we would not require the {{SubmittedJobGraphListener}}. One could, for example, periodically check from the main thread whether there are new jobs. That way we would know which jobs are currently running and which are being cleaned up. 
> Alternatively it is necessary to tolerate false positives :-(



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)