[jira] [Created] (FLINK-29805) Table Store sink continuously fails with "Trying to add file which is already added" when snapshot committing is slow

["Caizhi Weng (Jira)" <ji...@apache.org>]

Caizhi Weng created FLINK-29805:
-----------------------------------

             Summary: Table Store sink continuously fails with "Trying to add file which is already added" when snapshot committing is slow
                 Key: FLINK-29805
                 URL: https://issues.apache.org/jira/browse/FLINK-29805
             Project: Flink
          Issue Type: Bug
          Components: Table Store
    Affects Versions: table-store-0.3.0, table-store-0.2.2
            Reporter: Caizhi Weng
            Assignee: Caizhi Weng
             Fix For: table-store-0.3.0, table-store-0.2.2


Table Store sink continuously fails with "Trying to add file which is already added" when snapshot committing is slow.

This is due to a bug in {{FileStoreCommitImpl#filterCommitted}}. When this method finds an identifier, it removes the identifier from a map. However different snapshots may have the same identifier (for example an APPEND commit and the following COMPACT commit will have the same identifier), so we need to use another set to check for identifiers.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)