You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Stephan Ewen (Jira)" <ji...@apache.org> on 2020/01/17 08:23:00 UTC

[jira] [Assigned] (FLINK-10026) Integrate heap based timers in RocksDB backend with incremental checkpoints

     [ https://issues.apache.org/jira/browse/FLINK-10026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Stephan Ewen reassigned FLINK-10026:
------------------------------------

    Assignee:     (was: boshu Zheng)

> Integrate heap based timers in RocksDB backend with incremental checkpoints
> ---------------------------------------------------------------------------
>
>                 Key: FLINK-10026
>                 URL: https://issues.apache.org/jira/browse/FLINK-10026
>             Project: Flink
>          Issue Type: Sub-task
>          Components: Runtime / Checkpointing
>    Affects Versions: 1.6.0
>            Reporter: Stefan Richter
>            Priority: Major
>
> Currently, heap based priority queue state does not participate in RocksDB incremental checkpointing and still uses the legacy (synchronous) way of checkpointing timers.
> We should integrate it with incremental checkpoints in such way that the state is written non-incrementally into a file, and another key-grouped state handle becomes part of the non-shared section of the incremental state handle.
> After that we can also remove the path for legacy checkpointing completely and also remove the key-grouping from the de-duplication hash map in the {{HeapPriorityQueueSet}}. All can go into one map.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)