You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@iotdb.apache.org by ma...@apache.org on 2022/11/25 09:56:23 UTC

[iotdb] branch update-compaction-docs created (now eac667f36c)

This is an automated email from the ASF dual-hosted git repository.

marklau99 pushed a change to branch update-compaction-docs
in repository https://gitbox.apache.org/repos/asf/iotdb.git


      at eac667f36c update compaction docs

This branch includes the following new commits:

     new eac667f36c update compaction docs

The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.



[iotdb] 01/01: update compaction docs

Posted by ma...@apache.org.
This is an automated email from the ASF dual-hosted git repository.

marklau99 pushed a commit to branch update-compaction-docs
in repository https://gitbox.apache.org/repos/asf/iotdb.git

commit eac667f36c2c3d4ca27e627154d21632adeadf45
Author: LiuXuxin <li...@outlook.com>
AuthorDate: Fri Nov 25 17:56:10 2022 +0800

    update compaction docs
---
 docs/UserGuide/Reference/Common-Config-Manual.md   | 88 +++++++++++++++++-----
 .../zh/UserGuide/Reference/Common-Config-Manual.md | 83 ++++++++++++++++++--
 2 files changed, 148 insertions(+), 23 deletions(-)

diff --git a/docs/UserGuide/Reference/Common-Config-Manual.md b/docs/UserGuide/Reference/Common-Config-Manual.md
index 6b67107746..91180449a6 100644
--- a/docs/UserGuide/Reference/Common-Config-Manual.md
+++ b/docs/UserGuide/Reference/Common-Config-Manual.md
@@ -489,23 +489,59 @@ IoTDB common files for ConfigNode and DataNode are under `conf`.
 |Default| true |
 |Effective|After restart system|
 
-* cross\_compaction\_strategy
-
-|Name| cross\_compaction\_strategy |
-|:---:|:---|
-|Description| strategy of cross space compaction |
-|Type| String |
-|Default| rewrite\_compaction|
-|Effective|After restart system|
-
-* inner\_compaction\_strategy
-
-|Name| inner\_compaction\_strategy |
-|:---:|:---|
-|Description| strategy of inner space compaction |
-|Type| String |
-|Default| size\_tiered\_compaction |
-|Effective|After restart system|
+* cross\_selector
+
+|Name| cross\_selector                                  |
+|:---:|:-------------------------------------------------|
+|Description| the task selector type of cross space compaction |
+|Type| String                                           |
+|Default| rewrite                                          |
+|Effective| After restart system                             |
+
+* cross\_performer
+
+|Name| cross\_performer                                  |
+|:---:|:--------------------------------------------------|
+|Description| the task performer type of cross space compaction |
+|Type| String                                            |
+|Default| read\_point                                       |
+|Effective| After restart system                              |
+
+* inner\_seq\_selector
+
+|Name| inner\_seq\_selector                                      |
+|:---:|:----------------------------------------------------------|
+|Description| the task selector type of inner sequence space compaction |
+|Type| String                                                    |
+|Default| size\_tiered                                              |
+|Effective| After restart system                                      |
+
+* inner\_seq\_performer
+
+|Name| inner\_seq\_peformer                                       |
+|:---:|:-----------------------------------------------------------|
+|Description| the task performer type of inner sequence space compaction |
+|Type| String                                                     |
+|Default| read\_chunk                                                |
+|Effective| After restart system                                       |
+
+* inner\_unseq\_selector
+
+|Name| inner\_unseq\_selector                                      |
+|:---:|:------------------------------------------------------------|
+|Description| the task selector type of inner unsequence space compaction |
+|Type| String                                                      |
+|Default| size\_tiered                                                |
+|Effective| After restart system                                        |
+
+* inner\_unseq\_performer
+
+|Name| inner\_unseq\_peformer                                       |
+|:---:|:-------------------------------------------------------------|
+|Description| the task performer type of inner unsequence space compaction |
+|Type| String                                                       |
+|Default| read\_point                                                  |
+|Effective| After restart system                                         |
 
 * compaction\_priority
 
@@ -579,6 +615,15 @@ IoTDB common files for ConfigNode and DataNode are under `conf`.
 |Default| 1000 |
 |Effective|After restart system|
 
+* max\_cross\_compaction\_file\_size
+
+|Name| max\_cross\_compaction\_candidate\_file\_size             |
+|:---:|:----------------------------------------------------------|
+|Description| The max size of files encounter in cross space compaction |
+|Type| Int64                                                     |
+|Default| 5368709120                                                      |
+|Effective| After restart system                                      |
+
 * cross\_compaction\_file\_selection\_time\_budget
 
 |Name| cross\_compaction\_file\_selection\_time\_budget |
@@ -633,6 +678,15 @@ IoTDB common files for ConfigNode and DataNode are under `conf`.
 |Default| 16 |
 |Effective|After restart system|
 
+* sub\_compaction\_thread\_count
+
+|Name| sub\_compaction\_thread\_count                                            |
+|:---:|:--------------------------------------------------------------------------|
+|Description| the number of sub-compaction threads to accelerate cross space compaction |
+|Type| Int32                                                                     |
+|Default| 4                                                                         |
+|Effective| After restart system                                                      |
+
 ### Write Ahead Log Configuration
 
 ### TsFile Configurations
diff --git a/docs/zh/UserGuide/Reference/Common-Config-Manual.md b/docs/zh/UserGuide/Reference/Common-Config-Manual.md
index f7f66d8d84..968733530d 100644
--- a/docs/zh/UserGuide/Reference/Common-Config-Manual.md
+++ b/docs/zh/UserGuide/Reference/Common-Config-Manual.md
@@ -103,18 +103,17 @@ IoTDB ConfigNode 和 DataNode 的通用配置参数位于 `conf` 目录下。
 |默认值| GREEDY |
 |改后生效方式|重启服务生效|
 
-
 ### 集群管理
 
 * time\_partition\_interval
 
 |名字| time\_partition\_interval |
 |:--:|:----------------------------------------|
-|描述| Database 默认的数据时间分区间隔                          |
-|类型| Long                                    |
-|单位| 毫秒                                      |
-|默认值| 604800000                                |
-|改后生效方式| 仅允许在第一次启动服务前修改                          |
+|描述| Database 默认的数据时间分区间隔 |
+|类型| Long |
+|单位| 毫秒 |
+|默认值| 604800000 |
+|改后生效方式| 仅允许在第一次启动服务前修改 |
 
 * heartbeat\_interval\_in\_ms
 
@@ -705,6 +704,60 @@ IoTDB ConfigNode 和 DataNode 的通用配置参数位于 `conf` 目录下。
 |默认值| true |
 |改后生效方式|重启服务生效|
 
+* cross\_selector
+
+|名字| cross\_selector |
+|:---:|:----------------|
+|描述| 跨空间合并任务选择器的类型   |
+|类型| String          |
+|默认值| rewrite         |
+|改后生效方式| 重启服务生效          |
+
+* cross\_performer
+
+|名字| cross\_performer |
+|:---:|:-----------------|
+|描述| 跨空间合并任务执行器的类型    |
+|类型| String           |
+|默认值| read\_point      |
+|改后生效方式| 重启服务生效           |
+
+* inner\_seq\_selector
+
+|名字| inner\_seq\_selector |
+|:---:|:---------------------|
+|描述| 顺序空间内合并任务选择器的类型      |
+|类型| String               |
+|默认值| size\_tiered         |
+|改后生效方式| 重启服务生效               |
+
+* inner\_seq\_performer
+
+|名字| inner\_seq\_performer |
+|:---:|:----------------------|
+|描述| 顺序空间内合并任务执行器的类型       |
+|类型| String                |
+|默认值| read\_chunk           |
+|改后生效方式| 重启服务生效                |
+
+* inner\_unseq\_selector
+
+|名字| inner\_unseq\_selector |
+|:---:|:-----------------------|
+|描述| 乱序空间内合并任务选择器的类型        |
+|类型| String                 |
+|默认值| size\_tiered           |
+|改后生效方式| 重启服务生效                 |
+
+* inner\_unseq\_performer
+
+|名字| inner\_unseq\_performer |
+|:---:|:------------------------|
+|描述| 乱序空间内合并任务执行器的类型         |
+|类型| String                  |
+|默认值| read\_point             |
+|改后生效方式| 重启服务生效                  |
+
 * compaction\_priority
 
 |名字| compaction\_priority |
@@ -777,6 +830,15 @@ IoTDB ConfigNode 和 DataNode 的通用配置参数位于 `conf` 目录下。
 |默认值| 1000|
 |改后生效方式|重启服务生效|
 
+* max\_cross\_compaction\_candidate\_file\_size
+
+|名字| max\_cross\_compaction\_candidate\_file\_size |
+|:---:|:----------------------------------------------|
+|描述| 跨空间合并中一次合并最多参与的文件总大小                          |
+|类型| Int64                                         |
+|默认值| 5368709120                                          |
+|改后生效方式| 重启服务生效                                        |
+
 * cross\_compaction\_file\_selection\_time\_budget
 
 |名字| cross\_compaction\_file\_selection\_time\_budget |
@@ -840,6 +902,15 @@ IoTDB ConfigNode 和 DataNode 的通用配置参数位于 `conf` 目录下。
 |默认值| 60000 |
 |改后生效方式| 重启服务生效|
 
+* sub\_compaction\_thread\_count
+
+|名字| sub\_compaction\_thread\_count |
+|:---:|:--|
+|描述| 每个跨空间合并任务的子任务线程数 |
+|类型| Int32 |
+|默认值| 4 |
+|改后生效方式| 重启服务生效|
+
 ### 写前日志配置
 
 * wal\_buffer\_size