[jira] [Created] (FLINK-2332) Assign session IDs to JobManager and TaskManager messages

["Till Rohrmann (JIRA)" <ji...@apache.org>]

Till Rohrmann created FLINK-2332:
------------------------------------

             Summary: Assign session IDs to JobManager and TaskManager messages
                 Key: FLINK-2332
                 URL: https://issues.apache.org/jira/browse/FLINK-2332
             Project: Flink
          Issue Type: Sub-task
            Reporter: Till Rohrmann
            Assignee: Till Rohrmann


In order to support true high availability {{TaskManager}} and {{JobManager}} have to be able to distinguish whether a message was sent from the leader or whether a message was sent from a former leader. Messages which come from a former leader have to be discarded in order to guarantee a consistent state.

A way to do achieve this is to assign a leader session ID to a {{JobManager}} once he's elected as leader. This leader session ID is sent to the {{TaskManager}} upon registration at the {{JobManager}}. All subsequent messages should then be decorated with this leader session ID to mark them as valid. On the {{TaskManager}} side the received leader session ID as a response to the registration message, can then be used to validate incoming messages.

The same holds true for registration messages which should have a registration session ID, too. That way, it is possible to distinguish invalid registration messages from valid ones. The registration session ID can be assigned once the TaskManager is notified about the new leader.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)