You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by ji...@apache.org on 2022/10/09 03:50:01 UTC
[doris-website] branch master updated: be config fix
This is an automated email from the ASF dual-hosted git repository.
jiafengzheng pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/doris-website.git
The following commit(s) were added to refs/heads/master by this push:
new fb0dbf7f6ab be config fix
fb0dbf7f6ab is described below
commit fb0dbf7f6ab0ce462bf3e5a2aca7beaeb70f4cbf
Author: jiafeng.zhang <zh...@gmail.com>
AuthorDate: Sun Oct 9 11:47:25 2022 +0800
be config fix
---
docs/admin-manual/config/be-config.md | 8 ++++++--
.../current/admin-manual/config/be-config.md | 4 ++++
2 files changed, 10 insertions(+), 2 deletions(-)
diff --git a/docs/admin-manual/config/be-config.md b/docs/admin-manual/config/be-config.md
index e5316c03235..66282b1acfb 100644
--- a/docs/admin-manual/config/be-config.md
+++ b/docs/admin-manual/config/be-config.md
@@ -1171,9 +1171,9 @@ Shard size of StoragePageCache, the value must be power of two. It's recommended
* /home/disk1/doris.HDD : The storage medium is HDD;
* /home/disk2/doris.SSD : The storage medium is SSD;
* /home/disk2/doris : The storage medium is HDD HDD(default)
-
+
eg.2: `storage_root_path=/home/disk1/doris,medium:hdd;/home/disk2/doris,medium:ssd`
-
+
* /home/disk1/doris,medium:hdd The storage medium is HDD;
* /home/disk2/doris,medium:ssd The storage medium is SSD;
@@ -1294,6 +1294,8 @@ Default: 300
Update interval of tablet state cache, unit: second
+The RPC timeout for sending a Batch (1024 lines) during import. The default is 60 seconds. Since this RPC may involve writing multiple batches of memory, the RPC timeout may be caused by writing batches, so this timeout can be adjusted to reduce timeout errors (such as send batch fail errors). Also, if you increase the write_buffer_size configuration, you need to increase this parameter as well.
+
### `tablet_writer_ignore_eovercrowded`
* Type: bool
@@ -1421,6 +1423,8 @@ Default: 104857600
The size of the buffer before flashing
+Imported data is first written to a memory block on the BE, and only written back to disk when this memory block reaches the threshold. The default size is 100MB. too small a threshold may result in a large number of small files on the BE. This threshold can be increased to reduce the number of files. However, too large a threshold may cause RPC timeouts, see the configuration notes below.
+
### `zone_map_row_num_threshold`
* Type: int32
diff --git a/i18n/zh-CN/docusaurus-plugin-content-docs/current/admin-manual/config/be-config.md b/i18n/zh-CN/docusaurus-plugin-content-docs/current/admin-manual/config/be-config.md
index 04efab651d2..47b85bff9c1 100644
--- a/i18n/zh-CN/docusaurus-plugin-content-docs/current/admin-manual/config/be-config.md
+++ b/i18n/zh-CN/docusaurus-plugin-content-docs/current/admin-manual/config/be-config.md
@@ -1316,6 +1316,8 @@ tablet状态缓存的更新间隔，单位：秒
在远程BE 中打开tablet writer的 rpc 超时。 操作时间短，可设置短超时时间
+导入过程中，发送一个 Batch（1024行）的 RPC 超时时间。默认 60 秒。因为该 RPC 可能涉及多个 分片内存块的写盘操作，所以可能会因为写盘导致 RPC 超时，可以适当调整这个超时时间来减少超时错误（如 send batch fail 错误）。同时，如果调大 write_buffer_size 配置，也需要适当调大这个参数。
+
### `tablet_writer_ignore_eovercrowded`
* 类型：bool
@@ -1442,6 +1444,8 @@ webserver默认工作线程数
刷写前缓冲区的大小
+导入数据在 BE 上会先写入到一个内存块，当这个内存块达到阈值后才会写回磁盘。默认大小是 100MB。过小的阈值可能导致 BE 上存在大量的小文件。可以适当提高这个阈值减少文件数量。但过大的阈值可能导致 RPC 超时。
+
### `zone_map_row_num_threshold`
* 类型： int32
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org