[jira] [Created] (FLINK-28582) LSM tree structure may be incorrect when multiple jobs are committing into the same bucket

["Caizhi Weng (Jira)" <ji...@apache.org>]

Caizhi Weng created FLINK-28582:
-----------------------------------

             Summary: LSM tree structure may be incorrect when multiple jobs are committing into the same bucket
                 Key: FLINK-28582
                 URL: https://issues.apache.org/jira/browse/FLINK-28582
             Project: Flink
          Issue Type: Bug
          Components: Table Store
    Affects Versions: table-store-0.2.0
            Reporter: Caizhi Weng
             Fix For: table-store-0.2.0


Currently `FileStoreCommitImpl` only checks for conflicts by checking the files we're going to delete (due to compaction) are still there.

However, consider two jobs committing into the same LSM tree at the same time. For their first compaction no conflict is detected because they'll only delete their own level 0 files. But they will both produce level 1 files and the key ranges of these files may overlap. This is not correct for our LSM tree structure.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)