You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@flink.apache.org by "Roman Khachatryan (Jira)" <ji...@apache.org> on 2021/06/24 11:43:00 UTC

[jira] [Created] (FLINK-23143) Support state migration

Roman Khachatryan created FLINK-23143:
-----------------------------------------

             Summary: Support state migration
                 Key: FLINK-23143
                 URL: https://issues.apache.org/jira/browse/FLINK-23143
             Project: Flink
          Issue Type: Sub-task
          Components: Runtime / State Backends
         Environment: ChangelogKeyedStateBackend.getOrCreateKeyedState is currently used during recovery; on 1st user access, it doesn't update metadata nor migrate state (as opposed to other backends).

 

The proposed solution is to
 # wrap serializers (and maybe other objects) in getOrCreateKeyedState
 # store wrapping objects in a new map keyed by state name
 # pass wrapped objects to delegatedBackend.createInternalState
 # on 1st user access, lookup wrapper and upgrade its wrapped serializer

This should be done for both KV/PQ states.

 

See also [https://github.com/apache/flink/pull/15420#discussion_r656934791]

 

cc: [~yunta]
            Reporter: Roman Khachatryan
             Fix For: 1.14.0






--
This message was sent by Atlassian Jira
(v8.3.4#803005)