You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by GitBox <gi...@apache.org> on 2021/07/27 03:19:11 UTC

[GitHub] [incubator-doris] EmmyMiao87 commented on a change in pull request #6290: [Config] Add default configuration of load_parallelism

EmmyMiao87 commented on a change in pull request #6290:
URL: https://github.com/apache/incubator-doris/pull/6290#discussion_r677086844



##########
File path: fe/fe-core/src/main/java/org/apache/doris/common/Config.java
##########
@@ -128,6 +128,13 @@
     @ConfField(mutable = true, masterOnly = true)
     public static int label_keep_max_second = 3 * 24 * 3600; // 3 days
 
+    /**
+     * The default parallelism of the load execution plan
+     * on a single node when the broker load is submitted
+     */
+    @ConfField(mutable = true, masterOnly = true)
+    public static int load_parallelism = 1;

Review comment:
       ```suggestion
       public static int default_load_parallelism = 1;
   ```

##########
File path: docs/zh-CN/administrator-guide/config/fe_config.md
##########
@@ -1049,6 +1049,16 @@ colocote join PlanFragment instance 的 memory_limit = exec_mem_limit / min (que
 
 导出检查器的运行间隔
 
+### load_parallelism
+
+默认值:1
+
+是否可以动态配置:true
+
+是否为 Master FE 节点独有的配置项:true
+
+单个节点导入的默认并发度

Review comment:
       首先这里要强调,这是一个默认的导入并发度。如果用户指定自定义的并发度,则使用自定义并发度。
   其次导入任务的并发度取决于多个参数,这只是其中之一,参见 BrokerScanNode 的 line 355 ~ 362




-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org