You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Stefan Richter (JIRA)" <ji...@apache.org> on 2017/03/28 18:10:41 UTC
[jira] [Closed] (FLINK-6034) Add KeyedStateHandle for the snapshots
in keyed streams
[ https://issues.apache.org/jira/browse/FLINK-6034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Stefan Richter closed FLINK-6034.
---------------------------------
Resolution: Fixed
Fix Version/s: 1.3.0
Implemented in cd5527417a1cae57073a8855c6c3b88c88c780aa
> Add KeyedStateHandle for the snapshots in keyed streams
> -------------------------------------------------------
>
> Key: FLINK-6034
> URL: https://issues.apache.org/jira/browse/FLINK-6034
> Project: Flink
> Issue Type: Sub-task
> Components: State Backends, Checkpointing
> Reporter: Xiaogang Shi
> Assignee: Xiaogang Shi
> Fix For: 1.3.0
>
>
> Currently, the only type of the snapshots in keyed streams is {{KeyGroupsStateHandle}} which is full and store the states one group after another. With the introduction of incremental checkpointing, we need a higher level abstraction of keyed snapshots to allow flexible snapshot formats.
> The implementation of {{KeyedStateHandle}} s may vary a lot in different backends. The only information needed in {{KeyedStateHandle}} s is their key group range. When recovering the job with a different degree of parallelism, {{KeyedStateHandle}} s will be assigned to those subtasks whose key group ranges overlap with their ranges.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)