You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2017/05/16 17:26:04 UTC
[jira] [Commented] (FLINK-6600) Add key serializer's config
snapshot to KeyedBackendSerializationProxy
[ https://issues.apache.org/jira/browse/FLINK-6600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16012769#comment-16012769 ]
ASF GitHub Bot commented on FLINK-6600:
---------------------------------------
GitHub user tzulitai opened a pull request:
https://github.com/apache/flink/pull/3925
[FLINK-6600] Add key serializer config snapshot to keyed backend checkpoints
This PR adds the config snapshot of the key serializer of keyed
backends to its checkpoints. This allows the opportunity to upgrade key
serializers, as well as state migration in the future in the case of
incompatible old and new key serializers.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/tzulitai/flink FLINK-6600
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/flink/pull/3925.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #3925
----
commit afe1acb02a95cc04f6efd929e66c4b919a4b7757
Author: Tzu-Li (Gordon) Tai <tz...@apache.org>
Date: 2017-05-16T17:15:57Z
[FLINK-6600] Add key serializer config snapshot to keyed backend checkpoints
This commit adds the config snapshot of the key serializer of keyed
backends to its checkpoints. This allows the oppurtunity to upgrade key
serializers, as well as state migration in the future in the case of
incompatible old and new key serializers.
----
> Add key serializer's config snapshot to KeyedBackendSerializationProxy
> ----------------------------------------------------------------------
>
> Key: FLINK-6600
> URL: https://issues.apache.org/jira/browse/FLINK-6600
> Project: Flink
> Issue Type: Improvement
> Components: State Backends, Checkpointing
> Reporter: Tzu-Li (Gordon) Tai
> Assignee: Tzu-Li (Gordon) Tai
> Fix For: 1.3.0, 1.4.0
>
>
> Currently, only the key serializer is included in what's written for a keyed state backend in checkpoints. The namespace and state serializer already have their config snapshots included in the individual registered state's metainfo.
> We should also include the configuration snapshot of the key serializer in {{KeyedBackendSerializationProxy}} so that we can also be flexible in allowing migration / transformation of the key in the future.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)