You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flink.apache.org by "Piotr Nowojski (Jira)" <ji...@apache.org> on 2021/08/13 19:25:00 UTC

[jira] [Created] (FLINK-23772) Double check if non-keyed FullyFinishedOperatorState can be mixed up with non finished OperatorState on recovery

Piotr Nowojski created FLINK-23772:
--------------------------------------

             Summary: Double check if non-keyed FullyFinishedOperatorState can be mixed up with non finished OperatorState on recovery
                 Key: FLINK-23772
                 URL: https://issues.apache.org/jira/browse/FLINK-23772
             Project: Flink
          Issue Type: Sub-task
          Components: Runtime / Checkpointing
    Affects Versions: 1.14.0
            Reporter: Piotr Nowojski
             Fix For: 1.14.0


I'm not sure if with non-keyed state we have an issue that it can be reshuffled to different operators during recovery. Are there any guarantees that if subtask 1 has state A, while subtask 2 has B, that after recovery it won’t be rotated?
# is this an issue?
# if so, if we have partially finished tasks with some operators having, {{FullyFinishedOperatorState}}, what prevents {{VerticesFinishedCache.calculateIfFinished}} from failing if the {{FullyFinishedOperatorState}} gets assigned to an operator chain with non finished operator?

For example an operator chain with parallelism of two, non-keyed, before recovery:
{noformat}
src1 (finished state) -> foo1 (finished state)
src2 -> foo2
{noformat}
Can we end up after recovery with:
{noformat}
src1 (finished state) -> foo2
src2 -> foo1 (finished state)
{noformat}
?



--
This message was sent by Atlassian Jira
(v8.3.4#803005)