You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Stephan Ewen (Jira)" <ji...@apache.org> on 2020/01/17 13:20:00 UTC
[jira] [Closed] (FLINK-10026) Integrate heap based timers in
RocksDB backend with incremental checkpoints
[ https://issues.apache.org/jira/browse/FLINK-10026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Stephan Ewen closed FLINK-10026.
--------------------------------
Resolution: Won't Do
> Integrate heap based timers in RocksDB backend with incremental checkpoints
> ---------------------------------------------------------------------------
>
> Key: FLINK-10026
> URL: https://issues.apache.org/jira/browse/FLINK-10026
> Project: Flink
> Issue Type: Sub-task
> Components: Runtime / Checkpointing
> Affects Versions: 1.6.0
> Reporter: Stefan Richter
> Priority: Major
>
> Currently, heap based priority queue state does not participate in RocksDB incremental checkpointing and still uses the legacy (synchronous) way of checkpointing timers.
> We should integrate it with incremental checkpoints in such way that the state is written non-incrementally into a file, and another key-grouped state handle becomes part of the non-shared section of the incremental state handle.
> After that we can also remove the path for legacy checkpointing completely and also remove the key-grouping from the de-duplication hash map in the {{HeapPriorityQueueSet}}. All can go into one map.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)