You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@flink.apache.org by "Roman Khachatryan (Jira)" <ji...@apache.org> on 2021/06/28 13:23:00 UTC

[jira] [Created] (FLINK-23170) Write metadata after materialization

Roman Khachatryan created FLINK-23170:
-----------------------------------------

             Summary: Write metadata after materialization
                 Key: FLINK-23170
                 URL: https://issues.apache.org/jira/browse/FLINK-23170
             Project: Flink
          Issue Type: Sub-task
          Components: Runtime / State Backends
            Reporter: Roman Khachatryan
             Fix For: 1.14.0


Currently, changelog state backend writes state metadata on first state access. It is written to the changelog
On materialization, the changelog can be truncated, so the metadata needs to be written again.

This can be achieved by resetting AbstractStateChangeLogger.metaDataWritten flag. 
It can be further optimized by storing the SQN at which the metadata was written and only resetting the flag if materializedSqn >= metadataSqn; but materialization is relatively rare so it probably doesn't worth it.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)