You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@iotdb.apache.org by qi...@apache.org on 2022/11/25 14:40:13 UTC
[iotdb] branch master updated: update compaction docs (#8156)
This is an automated email from the ASF dual-hosted git repository.
qiaojialin pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/iotdb.git
The following commit(s) were added to refs/heads/master by this push:
new 2236421f2f update compaction docs (#8156)
2236421f2f is described below
commit 2236421f2f90af7a1d7d1964fc5e5fc7c6b54445
Author: Liu Xuxin <37...@users.noreply.github.com>
AuthorDate: Fri Nov 25 22:40:06 2022 +0800
update compaction docs (#8156)
---
docs/UserGuide/Reference/Common-Config-Manual.md | 90 +++++++++++++++++-----
.../zh/UserGuide/Reference/Common-Config-Manual.md | 75 +++++++++++++++++-
2 files changed, 141 insertions(+), 24 deletions(-)
diff --git a/docs/UserGuide/Reference/Common-Config-Manual.md b/docs/UserGuide/Reference/Common-Config-Manual.md
index aa8426bbf9..e92ee690bb 100644
--- a/docs/UserGuide/Reference/Common-Config-Manual.md
+++ b/docs/UserGuide/Reference/Common-Config-Manual.md
@@ -190,7 +190,6 @@ IoTDB common files for ConfigNode and DataNode are under `conf`.
|Default| 1 |
|Effective|After restarting system|
-
* primitive\_array\_size
|Name| primitive\_array\_size |
@@ -245,7 +244,6 @@ IoTDB common files for ConfigNode and DataNode are under `conf`.
| Default | 0.001 |
| Effective | After restarting system |
-
* check\_period\_when\_insert\_blocked
|Name| check\_period\_when\_insert\_blocked |
@@ -282,7 +280,6 @@ IoTDB common files for ConfigNode and DataNode are under `conf`.
|Default| 1000 |
|Effective|After restarting system|
-
### Schema Engine Configuration
* mlog\_buffer\_size
@@ -616,7 +613,6 @@ IoTDB common files for ConfigNode and DataNode are under `conf`.
|Default| true |
|Effective|After restarting system|
-
* insert\_multi\_tablet\_enable\_multithreading\_column\_threshold
| Name | insert\_multi\_tablet\_enable\_multithreading\_column\_threshold |
@@ -655,23 +651,59 @@ IoTDB common files for ConfigNode and DataNode are under `conf`.
| Default | true |
| Effective | After restart system |
-* cross\_compaction\_strategy
+* cross\_selector
-| Name | cross\_compaction\_strategy |
-| :---------: | :--------------------------------- |
-| Description | strategy of cross space compaction |
-| Type | String |
-| Default | rewrite\_compaction |
-| Effective | After restart system |
+|Name| cross\_selector |
+|:---:|:-------------------------------------------------|
+|Description| the task selector type of cross space compaction |
+|Type| String |
+|Default| rewrite |
+|Effective| After restart system |
-* inner\_compaction\_strategy
+* cross\_performer
-| Name | inner\_compaction\_strategy |
-| :---------: | :--------------------------------- |
-| Description | strategy of inner space compaction |
-| Type | String |
-| Default | size\_tiered\_compaction |
-| Effective | After restart system |
+|Name| cross\_performer |
+|:---:|:--------------------------------------------------|
+|Description| the task performer type of cross space compaction |
+|Type| String |
+|Default| read\_point |
+|Effective| After restart system |
+
+* inner\_seq\_selector
+
+|Name| inner\_seq\_selector |
+|:---:|:----------------------------------------------------------|
+|Description| the task selector type of inner sequence space compaction |
+|Type| String |
+|Default| size\_tiered |
+|Effective| After restart system |
+
+* inner\_seq\_performer
+
+|Name| inner\_seq\_peformer |
+|:---:|:-----------------------------------------------------------|
+|Description| the task performer type of inner sequence space compaction |
+|Type| String |
+|Default| read\_chunk |
+|Effective| After restart system |
+
+* inner\_unseq\_selector
+
+|Name| inner\_unseq\_selector |
+|:---:|:------------------------------------------------------------|
+|Description| the task selector type of inner unsequence space compaction |
+|Type| String |
+|Default| size\_tiered |
+|Effective| After restart system |
+
+* inner\_unseq\_performer
+
+|Name| inner\_unseq\_peformer |
+|:---:|:-------------------------------------------------------------|
+|Description| the task performer type of inner unsequence space compaction |
+|Type| String |
+|Default| read\_point |
+|Effective| After restart system |
* compaction\_priority
@@ -745,6 +777,15 @@ IoTDB common files for ConfigNode and DataNode are under `conf`.
|Default| 1000 |
|Effective|After restart system|
+* max\_cross\_compaction\_file\_size
+
+|Name| max\_cross\_compaction\_candidate\_file\_size |
+|:---:|:----------------------------------------------------------|
+|Description| The max size of files encounter in cross space compaction |
+|Type| Int64 |
+|Default| 5368709120 |
+|Effective| After restart system |
+
* cross\_compaction\_file\_selection\_time\_budget
|Name| cross\_compaction\_file\_selection\_time\_budget |
@@ -799,6 +840,15 @@ IoTDB common files for ConfigNode and DataNode are under `conf`.
|Default| 16 |
|Effective|After restart system|
+* sub\_compaction\_thread\_count
+
+|Name| sub\_compaction\_thread\_count |
+|:---:|:--------------------------------------------------------------------------|
+|Description| the number of sub-compaction threads to accelerate cross space compaction |
+|Type| Int32 |
+|Default| 4 |
+|Effective| After restart system |
+
### Write Ahead Log Configuration
### TsFile Configurations
@@ -988,7 +1038,6 @@ IoTDB common files for ConfigNode and DataNode are under `conf`.
| Default | 30 |
| Effective | After restarting system |
-
### UDF Configuration
* udf\_initial\_byte\_array\_length\_for\_memory\_control
@@ -1131,8 +1180,8 @@ IoTDB common files for ConfigNode and DataNode are under `conf`.
| Default | 800 |
| Effective | After restarting system |
-
### MQTT Broker Configuration
+
* enable\_mqtt\_service
| Name | enable\_mqtt\_service。 |
@@ -1187,7 +1236,6 @@ IoTDB common files for ConfigNode and DataNode are under `conf`.
| Default | 1048576 |
| Effective | Trigger |
-
### REST Service Configuration
* enable\_rest\_service
diff --git a/docs/zh/UserGuide/Reference/Common-Config-Manual.md b/docs/zh/UserGuide/Reference/Common-Config-Manual.md
index 0187a52df5..1ffd4c36f9 100644
--- a/docs/zh/UserGuide/Reference/Common-Config-Manual.md
+++ b/docs/zh/UserGuide/Reference/Common-Config-Manual.md
@@ -104,7 +104,6 @@ IoTDB ConfigNode 和 DataNode 的通用配置参数位于 `conf` 目录下。
| 默认值 | GREEDY |
| 改后生效方式 | 重启服务生效 |
-
### 集群管理
* time\_partition\_interval
@@ -273,7 +272,6 @@ IoTDB ConfigNode 和 DataNode 的通用配置参数位于 `conf` 目录下。
|默认值| 1000 |
|改后生效方式|重启服务生效|
-
### 元数据引擎配置
* mlog\_buffer\_size
@@ -797,6 +795,60 @@ IoTDB ConfigNode 和 DataNode 的通用配置参数位于 `conf` 目录下。
| 默认值 | true |
| 改后生效方式 | 重启服务生效 |
+* cross\_selector
+
+|名字| cross\_selector |
+|:---:|:----------------|
+|描述| 跨空间合并任务选择器的类型 |
+|类型| String |
+|默认值| rewrite |
+|改后生效方式| 重启服务生效 |
+
+* cross\_performer
+
+|名字| cross\_performer |
+|:---:|:-----------------|
+|描述| 跨空间合并任务执行器的类型 |
+|类型| String |
+|默认值| read\_point |
+|改后生效方式| 重启服务生效 |
+
+* inner\_seq\_selector
+
+|名字| inner\_seq\_selector |
+|:---:|:---------------------|
+|描述| 顺序空间内合并任务选择器的类型 |
+|类型| String |
+|默认值| size\_tiered |
+|改后生效方式| 重启服务生效 |
+
+* inner\_seq\_performer
+
+|名字| inner\_seq\_performer |
+|:---:|:----------------------|
+|描述| 顺序空间内合并任务执行器的类型 |
+|类型| String |
+|默认值| read\_chunk |
+|改后生效方式| 重启服务生效 |
+
+* inner\_unseq\_selector
+
+|名字| inner\_unseq\_selector |
+|:---:|:-----------------------|
+|描述| 乱序空间内合并任务选择器的类型 |
+|类型| String |
+|默认值| size\_tiered |
+|改后生效方式| 重启服务生效 |
+
+* inner\_unseq\_performer
+
+|名字| inner\_unseq\_performer |
+|:---:|:------------------------|
+|描述| 乱序空间内合并任务执行器的类型 |
+|类型| String |
+|默认值| read\_point |
+|改后生效方式| 重启服务生效 |
+
* compaction\_priority
| 名字 | compaction\_priority |
@@ -869,6 +921,15 @@ IoTDB ConfigNode 和 DataNode 的通用配置参数位于 `conf` 目录下。
|默认值| 1000|
|改后生效方式|重启服务生效|
+* max\_cross\_compaction\_candidate\_file\_size
+
+|名字| max\_cross\_compaction\_candidate\_file\_size |
+|:---:|:----------------------------------------------|
+|描述| 跨空间合并中一次合并最多参与的文件总大小 |
+|类型| Int64 |
+|默认值| 5368709120 |
+|改后生效方式| 重启服务生效 |
+
* cross\_compaction\_file\_selection\_time\_budget
|名字| cross\_compaction\_file\_selection\_time\_budget |
@@ -932,6 +993,15 @@ IoTDB ConfigNode 和 DataNode 的通用配置参数位于 `conf` 目录下。
|默认值| 60000 |
|改后生效方式| 重启服务生效|
+* sub\_compaction\_thread\_count
+
+|名字| sub\_compaction\_thread\_count |
+|:---:|:--|
+|描述| 每个跨空间合并任务的子任务线程数 |
+|类型| Int32 |
+|默认值| 4 |
+|改后生效方式| 重启服务生效|
+
### 写前日志配置
* wal\_buffer\_size
@@ -1166,7 +1236,6 @@ IoTDB ConfigNode 和 DataNode 的通用配置参数位于 `conf` 目录下。
| 默认值 | 30 |
| 改后生效方式 | 重启服务生效 |
-
### UDF查询配置
* udf\_initial\_byte\_array\_length\_for\_memory\_control