You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@flink.apache.org by "Piotr Nowojski (Jira)" <ji...@apache.org> on 2020/05/10 09:27:00 UTC

[jira] [Closed] (FLINK-17564) Inflight data of incoming channel may be disordered for unaligned checkpoint

     [ https://issues.apache.org/jira/browse/FLINK-17564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Piotr Nowojski closed FLINK-17564.
----------------------------------
    Resolution: Fixed

> Inflight data of incoming channel may be disordered for unaligned checkpoint
> ----------------------------------------------------------------------------
>
>                 Key: FLINK-17564
>                 URL: https://issues.apache.org/jira/browse/FLINK-17564
>             Project: Flink
>          Issue Type: Bug
>          Components: Runtime / Checkpointing
>    Affects Versions: 1.11.0
>            Reporter: Yingjie Cao
>            Assignee: Yingjie Cao
>            Priority: Major
>              Labels: pull-request-available
>             Fix For: 1.11.0
>
>
> For unaligned checkpoint, when checkpointing the inflight data of incoming channel, both task thread and Netty thread may add data to the channel state writer. More specifically, the task thread will first request inflight buffers from the input channel and add the buffers to the channel state writer, and then the Netty thread will add the following up buffers (if any) to the channel state writer. The buffer adding of task thread and Netty thread is not synchronized so the Netty thread may add buffers before the task thread which leads to disorder of the data and corruption of the data stream.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)