[jira] [Created] (FLINK-29840) Old record may overwrite new record in Table Store when snapshot committing is slow

["Caizhi Weng (Jira)" <ji...@apache.org>]

Caizhi Weng created FLINK-29840:
-----------------------------------

             Summary: Old record may overwrite new record in Table Store when snapshot committing is slow
                 Key: FLINK-29840
                 URL: https://issues.apache.org/jira/browse/FLINK-29840
             Project: Flink
          Issue Type: Bug
          Components: Table Store
    Affects Versions: table-store-0.3.0, table-store-0.2.2
            Reporter: Caizhi Weng
            Assignee: Caizhi Weng
             Fix For: table-store-0.3.0, table-store-0.2.2


Consider the following scenario when snapshot committing is slow:
* A writer produces some records at checkpoint T.
* It produces no record at checkpoint T+1 and is closed.
* It produces some records at checkpoint T+2. It will be reopened and read the latest sequence number from disk. However snapshot at checkpoint T may not be committed so the sequence number it reads might be too small.

In this scenario, records from checkpoint T may overwrite records from checkpoint T+2 because they have larger sequence numbers.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)