[GitHub] [doris] zhannngchen commented on a diff in pull request #14215: [improvement](load) some simple optimization for reduce load memory policy

[GitBox <gi...@apache.org>]

zhannngchen commented on code in PR #14215:
URL: https://github.com/apache/doris/pull/14215#discussion_r1020673756


##########
be/src/common/config.h:
##########
@@ -486,7 +486,7 @@ CONF_Int32(load_process_max_memory_limit_percent, "50");         // 50%
 // soft limit which can trigger the memtable flush for the load channel who
 // consumes lagest memory size before we reach the hard limit. The soft limit
 // might avoid all load jobs hang at the same time.
-CONF_Int32(load_process_soft_mem_limit_percent, "50");

Review Comment:
   50% is too low, very easy to trigger frequent flush. and in our test, leaving 20% memory is enough.



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org