You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@flink.apache.org by "Caizhi Weng (Jira)" <ji...@apache.org> on 2022/11/25 08:26:00 UTC

[jira] [Created] (FLINK-30204) Table Store support separated compact jobs

Caizhi Weng created FLINK-30204:
-----------------------------------

             Summary: Table Store support separated compact jobs
                 Key: FLINK-30204
                 URL: https://issues.apache.org/jira/browse/FLINK-30204
             Project: Flink
          Issue Type: New Feature
          Components: Table Store
    Affects Versions: table-store-0.3.0
            Reporter: Caizhi Weng
            Assignee: Caizhi Weng
             Fix For: table-store-0.3.0


Currently table store sinks will write and compact data files from the same job. While this implementation is enough and more economical for most users, some user may expect higher or more steady write throughput.

We decided to support creating separated compact jobs for Table Store. This will bring us the following advantages:
* Write jobs can concentrate only on writing files. Their throughput will be higher and more steady.
* By creating only one compact job for each table, no commit conflicts will occur.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)