You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@flink.apache.org by "Jingsong Lee (Jira)" <ji...@apache.org> on 2022/03/25 11:20:00 UTC

[jira] [Created] (FLINK-26867) Hybrid reading wrong because of disordered commits

Jingsong Lee created FLINK-26867:
------------------------------------

             Summary: Hybrid reading wrong because of disordered commits
                 Key: FLINK-26867
                 URL: https://issues.apache.org/jira/browse/FLINK-26867
             Project: Flink
          Issue Type: Sub-task
          Components: Table Store
            Reporter: Jingsong Lee
             Fix For: table-store-0.1.0


In AbstractCommitterOperator.endInput:

Suppose the last checkpoint before endInput is 5. Flink Streaming Job calling order:
1. Accept elements from upstream prepareSnapshotPreBarrier(5)
2. this.snapshotState(5)
3. Accept elements from upstream endInput
4. this.endInput
5. this.notifyCheckpointComplete(5)
So we should submit all the data in the endInput in order to avoid disordered commits.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)