You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@flink.apache.org by "Rui Fan (Jira)" <ji...@apache.org> on 2023/04/20 10:33:00 UTC

[jira] [Created] (FLINK-31864) Generate unaligned checkpoint type based on persisted data

Rui Fan created FLINK-31864:
-------------------------------

             Summary: Generate unaligned checkpoint type based on persisted data
                 Key: FLINK-31864
                 URL: https://issues.apache.org/jira/browse/FLINK-31864
             Project: Flink
          Issue Type: Technical Debt
          Components: Runtime / Checkpointing
            Reporter: Rui Fan


FLINK-31588 wants to correct the unaligned checkpoint type after aligned barrier timeout to unaligned barrier on PipelinedSubpartition.

Initially, we wanted to try to keep the semantic of that flag in sync with what StreamTask was actually doing. If checkpoint was unaligned, as it arrived unaligned, it should be reported as such, even if that particular subtask didn't persist any data.

However, we found the code is too complicated, and it probably not worth of making the code so much more complicated, so we prefer generate unaligned checkpoint type based on persisted data.

The detailed discussion: [https://github.com/apache/flink/pull/22392#discussion_r1165613057]

 

cc [~pnowojski] 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)