You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by mo...@apache.org on 2022/07/05 02:03:42 UTC

[doris] branch master updated: [docs] add quick compaction configs (#10559)

This is an automated email from the ASF dual-hosted git repository.

morningman pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/doris.git


The following commit(s) were added to refs/heads/master by this push:
     new cc2de23455 [docs] add quick compaction configs (#10559)
cc2de23455 is described below

commit cc2de23455db500797e5b9291791da673404add1
Author: chenlinzhong <49...@qq.com>
AuthorDate: Tue Jul 5 10:03:37 2022 +0800

    [docs] add quick compaction configs (#10559)
---
 docs/en/docs/admin-manual/config/be-config.md    | 21 +++++++++++++++++++++
 docs/zh-CN/docs/admin-manual/config/be-config.md | 21 +++++++++++++++++++++
 2 files changed, 42 insertions(+)

diff --git a/docs/en/docs/admin-manual/config/be-config.md b/docs/en/docs/admin-manual/config/be-config.md
index 62a11993de..31291455ce 100644
--- a/docs/en/docs/admin-manual/config/be-config.md
+++ b/docs/en/docs/admin-manual/config/be-config.md
@@ -1537,3 +1537,24 @@ Translated with www.DeepL.com/Translator (free version)
 * Type: int32
 * Description: The maximum amount of data read by each OlapScanner.
 * Default: 1024
+
+### `enable_quick_compaction`
+* Type: bool
+* Description: enable quick compaction,It is mainly used in the scenario of frequent import of small amount of data. The problem of -235 can be effectively avoided by merging the imported versions in time through the mechanism of rapid compaction. The definition of small amount of data is currently defined according to the number of rows
+* Default: false
+
+### `quick_compaction_max_rows`
+* Type: int32
+* Description: When the number of imported rows is less than this value, it is considered that this import is an import of small amount of data, which will be selected during quick compaction
+* Default: 1000
+
+### `quick_compaction_batch_size`
+* Type: int32
+* Description: trigger time, when import times reach quick_compaction_batch_size will trigger immediately 
+* Default: 10
+
+### `quick_compaction_min_rowsets`
+* Type: int32
+* Description: at least the number of versions to be compaction, and the number of rowsets with a small amount of data in the selection. If it is greater than this value, the real compaction will be carried out
+* Default: 10
+
diff --git a/docs/zh-CN/docs/admin-manual/config/be-config.md b/docs/zh-CN/docs/admin-manual/config/be-config.md
index 4002e7a969..11fa254a2d 100644
--- a/docs/zh-CN/docs/admin-manual/config/be-config.md
+++ b/docs/zh-CN/docs/admin-manual/config/be-config.md
@@ -1559,3 +1559,24 @@ webserver默认工作线程数
 * 类型: int32
 * 描述: String 类型最大长度的软限,单位是字节
 * 默认值: 1048576
+
+### `enable_quick_compaction`
+* 类型: bool
+* 描述: 是否开启quick_compaction,主要用在小数据量频繁导入的场景,通过快速compaction的机制及时合并导入版本可以有效避免-235的问题,小数据量的定义目前是根据行数来定义
+* 默认值: false
+
+### `quick_compaction_max_rows`
+* 类型: int32
+* 描述: 当导入的行数小于这个值认为这次导入是小数据量的导入,在快速合并时会被选中
+* 默认值: 1000
+
+### `quick_compaction_batch_size`
+* 类型: int32
+* 描述: 快速合并的触发时机,导入次数达到quick_compaction_batch_size时触发一次
+* 默认值: 10
+
+### `quick_compaction_min_rowsets`
+* 类型: int32
+* 描述: 最少进行合并的版本数,当选中的小数据量的rowset个数,大于这个值是才会进行真正的合并
+* 默认值: 10
+


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org