You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Zhijiang (Jira)" <ji...@apache.org> on 2020/04/07 15:28:00 UTC
[jira] [Closed] (FLINK-16537) Implement ResultPartition state
recovery for unaligned checkpoint
[ https://issues.apache.org/jira/browse/FLINK-16537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Zhijiang closed FLINK-16537.
----------------------------
Resolution: Fixed
Merged in master: 693cb6adc42d75d1db720b45013430a4c6817d4a
> Implement ResultPartition state recovery for unaligned checkpoint
> -----------------------------------------------------------------
>
> Key: FLINK-16537
> URL: https://issues.apache.org/jira/browse/FLINK-16537
> Project: Flink
> Issue Type: Sub-task
> Components: Runtime / Checkpointing, Runtime / Network
> Reporter: Zhijiang
> Assignee: Zhijiang
> Priority: Major
> Labels: pull-request-available
> Fix For: 1.11.0
>
> Time Spent: 20m
> Remaining Estimate: 0h
>
> During recovery process for unaligned checkpoint, the partition state should also be recovered besides with existing operator states.
> The ResultPartition would request buffer from local pool and then interact with ChannelStateReader to fill in the state data. The filled buffer would be inserted into respective ResultSubpartition queue in normal way.
> It should guarantee that op can not process any inputs before finishing all the output recovery to avoid mis-order issue.
> Refer to more details by [https://docs.google.com/document/d/16_MOQymzxrKvUHXh6QFr2AAXIKt_2vPUf8vzKy4H_tU/edit]
--
This message was sent by Atlassian Jira
(v8.3.4#803005)