You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Arvid Heise (Jira)" <ji...@apache.org> on 2020/12/07 09:20:00 UTC

[jira] [Updated] (FLINK-19801) Add support for virtual channels

     [ https://issues.apache.org/jira/browse/FLINK-19801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Arvid Heise updated FLINK-19801:
--------------------------------
    Fix Version/s: 1.13.0

> Add support for virtual channels
> --------------------------------
>
>                 Key: FLINK-19801
>                 URL: https://issues.apache.org/jira/browse/FLINK-19801
>             Project: Flink
>          Issue Type: Sub-task
>          Components: Runtime / Checkpointing
>    Affects Versions: 1.12.0
>            Reporter: Arvid Heise
>            Assignee: Arvid Heise
>            Priority: Major
>              Labels: pull-request-available
>             Fix For: 1.13.0
>
>
> During rescaling of unaligned checkpoints, if state from multiple former channels are read on input or output side to recover a specific channel, then these buffers are multiplexed on output side and demultiplexed on input side to guarantee a consistent recovery of spanning records:
> Assume two channels C1, C2 connect operator A and B and both have one buffer in the output and in the input part of the channel respectively, where a record spans. Assume that the buffers are named O1 for output buffer of C1 and I2 for input buffer of C2 etc. Then after rescaling both channels become one channel C. Then, the buffers may be restored as I1, I2, O1, O2.
> Channels use the mapping of FLINK-19533 to infer the need for virtual channels and distribute the needed resources. Virtual channels are removed on the EndOfChannelRecovery epoch marker.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)