You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@flink.apache.org by "Caizhi Weng (Jira)" <ji...@apache.org> on 2022/11/25 08:50:00 UTC

[jira] [Created] (FLINK-30209) Introduce CompactFileStoreSource for compact jobs of Table Store

Caizhi Weng created FLINK-30209:
-----------------------------------

             Summary: Introduce CompactFileStoreSource for compact jobs of Table Store
                 Key: FLINK-30209
                 URL: https://issues.apache.org/jira/browse/FLINK-30209
             Project: Flink
          Issue Type: Sub-task
          Components: Table Store
    Affects Versions: table-store-0.3.0
            Reporter: Caizhi Weng
            Assignee: Caizhi Weng
             Fix For: table-store-0.3.0


In this ticket we create the {{CompactFileStoreSource}} Flink source for separated compact jobs.

The behavior of this source is sketched as follows:
* For batch compact jobs, this source produces records containing all partitions and buckets of the current table.
* For streaming compact jobs, this source produces records containing all modified partitions and buckets of a snapshot. This source will also monitor on newly created snapshots.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)