You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@flink.apache.org by "Jingsong Lee (Jira)" <ji...@apache.org> on 2022/04/27 04:19:00 UTC

[jira] [Closed] (FLINK-27335) Optimize async compaction in MergeTreeWriter

     [ https://issues.apache.org/jira/browse/FLINK-27335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jingsong Lee closed FLINK-27335.
--------------------------------
    Fix Version/s: table-store-0.1.0
                       (was: table-store-0.2.0)
       Resolution: Fixed

master: 72af2638b978963959bdc72fb2394f43f89161bb

release-0.1: 1d0965a8622e53f4da46d267f6e13b1c0cc22213

> Optimize async compaction in MergeTreeWriter
> --------------------------------------------
>
>                 Key: FLINK-27335
>                 URL: https://issues.apache.org/jira/browse/FLINK-27335
>             Project: Flink
>          Issue Type: Improvement
>          Components: Table Store
>            Reporter: Jingsong Lee
>            Assignee: Jingsong Lee
>            Priority: Major
>              Labels: pull-request-available
>             Fix For: table-store-0.1.0
>
>
> Currently Full Compaction may cause the writer to be blocked, which has an impact on LogStore latency.
> We need to decouple compact and write, compact completely asynchronous.
> But too many files will lead to unstable reads, when too many files, Compaction processing speed can not keep up with Writer, need to back press Writer.
> Stop parameter: num-sorted-run.stop-trigger, default 10



--
This message was sent by Atlassian Jira
(v8.20.7#820007)