You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@flink.apache.org by "Jingsong Lee (Jira)" <ji...@apache.org> on 2022/04/21 04:12:00 UTC

[jira] [Created] (FLINK-27335) Optimize async compaction in MergeTreeWriter

Jingsong Lee created FLINK-27335:
------------------------------------

             Summary: Optimize async compaction in MergeTreeWriter
                 Key: FLINK-27335
                 URL: https://issues.apache.org/jira/browse/FLINK-27335
             Project: Flink
          Issue Type: Improvement
          Components: Table Store
            Reporter: Jingsong Lee
            Assignee: Jingsong Lee
             Fix For: table-store-0.2.0


Currently Full Compaction may cause the writer to be blocked, which has an impact on LogStore latency.

We need to decouple compact and write, compact completely asynchronous.
But too many files will lead to unstable reads, when too many files, Compaction processing speed can not keep up with Writer, need to back press Writer.

Stop parameter: num-sorted-run.stop-trigger, default 10



--
This message was sent by Atlassian Jira
(v8.20.7#820007)