You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by da...@apache.org on 2023/01/13 14:53:07 UTC
[doris] branch master updated: [typo](doc) add solutions to solve the problem of fetching stream load record slowly (#15911)
This is an automated email from the ASF dual-hosted git repository.
dataroaring pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/doris.git
The following commit(s) were added to refs/heads/master by this push:
new 38de7ce6c9 [typo](doc) add solutions to solve the problem of fetching stream load record slowly (#15911)
38de7ce6c9 is described below
commit 38de7ce6c9d615fdccd6a09d5d6fa1fbe03f9c14
Author: gnehil <ad...@gmail.com>
AuthorDate: Fri Jan 13 22:53:00 2023 +0800
[typo](doc) add solutions to solve the problem of fetching stream load record slowly (#15911)
---
docs/en/docs/data-operate/import/import-way/stream-load-manual.md | 7 +++++++
.../docs/data-operate/import/import-way/stream-load-manual.md | 8 ++++++++
2 files changed, 15 insertions(+)
diff --git a/docs/en/docs/data-operate/import/import-way/stream-load-manual.md b/docs/en/docs/data-operate/import/import-way/stream-load-manual.md
index 1d8d7e0254..926685be73 100644
--- a/docs/en/docs/data-operate/import/import-way/stream-load-manual.md
+++ b/docs/en/docs/data-operate/import/import-way/stream-load-manual.md
@@ -404,7 +404,14 @@ Cluster situation: The concurrency of Stream load is not affected by cluster siz
<version>4.5.13</version>
</dependency>
```
+
+* After enabling the Stream Load record on the BE, the record cannot be queried
+ This is caused by the slowness of fetching records, you can try to adjust the following parameters:
+
+ 1. Increase the BE configuration `stream_load_record_batch_size`. This configuration indicates how many Stream load records can be pulled from BE each time. The default value is 50, which can be increased to 500.
+ 2. Reduce the FE configuration `fetch_stream_load_record_interval_second`, this configuration indicates the interval for obtaining Stream load records, the default is to fetch once every 120 seconds, and it can be adjusted to 60 seconds.
+ 3. If you want to save more Stream load records (not recommended, it will take up more resources of FE), you can increase the configuration `max_stream_load_record_size` of FE, the default is 5000.
## More Help
diff --git a/docs/zh-CN/docs/data-operate/import/import-way/stream-load-manual.md b/docs/zh-CN/docs/data-operate/import/import-way/stream-load-manual.md
index c82849e51a..a915a5eed0 100644
--- a/docs/zh-CN/docs/data-operate/import/import-way/stream-load-manual.md
+++ b/docs/zh-CN/docs/data-operate/import/import-way/stream-load-manual.md
@@ -421,6 +421,14 @@ timeout = 1000s 等于 10G / 10M/s
<version>4.5.13</version>
</dependency>
```
+- 用户在开启 BE 上的 Stream Load 记录后，查询不到记录
+
+ 这是因为拉取速度慢造成的，可以尝试调整下面的参数：
+
+ 1. 调大 BE 配置 `stream_load_record_batch_size`，这个配置表示每次从 BE 上最多拉取多少条 Stream load 的记录数，默认值为50条，可以调大到500条。
+ 2. 调小 FE 的配置 `fetch_stream_load_record_interval_second`，这个配置表示获取 Stream load 记录间隔，默认每120秒拉取一次，可以调整到60秒。
+ 3. 如果要保存更多的 Stream load 记录（不建议，占用 FE 更多的资源）可以将 FE 的配置 `max_stream_load_record_size` 调大，默认是5000条。
+
## 更多帮助
关于 Stream Load 使用的更多详细语法及最佳实践，请参阅 [Stream Load](../../../sql-manual/sql-reference/Data-Manipulation-Statements/Load/STREAM-LOAD.md) 命令手册，你也可以在 MySql 客户端命令行下输入 `HELP STREAM LOAD` 获取更多帮助信息。
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org