You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@flink.apache.org by "Brian Zhou (Jira)" <ji...@apache.org> on 2021/01/28 06:35:00 UTC

[jira] [Created] (FLINK-21178) Task failure will not trigger master hook's reset()

Brian Zhou created FLINK-21178:
----------------------------------

             Summary: Task failure will not trigger master hook's reset()
                 Key: FLINK-21178
                 URL: https://issues.apache.org/jira/browse/FLINK-21178
             Project: Flink
          Issue Type: Bug
          Components: Runtime / Checkpointing
    Affects Versions: 1.11.3, 1.12.0
            Reporter: Brian Zhou


In Pravega Flink connector integration with Flink 1.12, we found an issue with our no-checkpoint recovery test case [1].

We expect the recovery will call the ReaderCheckpointHook::reset() function which was the behaviour before 1.12. However FLINK-20222 changes the logic, the reset() call will only be called along with a global recovery. This causes Pravega source data loss when failure happens before the first checkpoint.

[1]  [https://github.com/crazyzhou/flink-connectors/blob/da9f76d04404071471ebd86bf6889b307c9122ff/src/test/java/io/pravega/connectors/flink/FlinkPravegaReaderRGStateITCase.java#L78]



--
This message was sent by Atlassian Jira
(v8.3.4#803005)