You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Congxian Qiu (Jira)" <ji...@apache.org> on 2021/10/02 12:50:00 UTC
[jira] [Commented] (FLINK-23139) State ownership: track and discard
private state (registry+changelog)
[ https://issues.apache.org/jira/browse/FLINK-23139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17423520#comment-17423520 ]
Congxian Qiu commented on FLINK-23139:
--------------------------------------
hi [~roman] seems the doc is not public, is there any public documentation for this?
> State ownership: track and discard private state (registry+changelog)
> ---------------------------------------------------------------------
>
> Key: FLINK-23139
> URL: https://issues.apache.org/jira/browse/FLINK-23139
> Project: Flink
> Issue Type: Sub-task
> Components: Runtime / State Backends
> Reporter: Roman Khachatryan
> Assignee: Roman Khachatryan
> Priority: Major
> Labels: pull-request-available
> Fix For: 1.15.0
>
>
> TM should own changelog backend state to prevent re-uploading state on checkpoint abortion (or missing confirmation). A simpler solution to only own aborted state is less maintanable in the long run.
> For that, on TM state should be tracked and discarded (on subsumption+materialization; on shutdown).
> See [state ownership design doc|https://docs.google.com/document/d/1NJJQ30P27BmUvD7oa4FChvkYxMEgjRPTVdO1dHLl_9I/edit?usp=sharing], in particular [Tracking private state|https://docs.google.com/document/d/1NJJQ30P27BmUvD7oa4FChvkYxMEgjRPTVdO1dHLl_9I/edit#heading=h.9dxopqajsy7].
>
> This ticket is about creating TaskStateRegistry and using it in ChangelogStateBackend (for non-materialized part only; for materialized see FLINK-23344).
>
> Externalized checkpoints and savepoints should be supported (or please create a separate ticket).
>
> Retained checkpoints is a separate ticket: FLINK-23251
--
This message was sent by Atlassian Jira
(v8.3.4#803005)