[GitHub] [doris] yiguolei commented on pull request #13285: [improvement](memory) disable page cache and chunk allocator, optimize memory allocate size

[GitBox <gi...@apache.org>]

yiguolei commented on PR #13285:
URL: https://github.com/apache/doris/pull/13285#issuecomment-1275693556

   > Gives the performance impact of `disable page cache` and `disable chunk allocator`, and the benefits of doing so, such as increasing OOM risk because they have no gc.
   
   1. Currently, we use a hard limit for page cache(20%) or chunk allocator(10%), if the application need memory, there is no gc mechanism to collect memory from page cache or chunk allocator.
   2. page cache is very useful in some cases such as POC test, run benchmarks, some reporting secenarios. But in some cases like adhoc query, etl query, it is not very useful. And we have disable page cache in 1.1 and many company have disable page cache online such as xiaomi.
   3. chunk allocator impacts about 10% performance in clickbench test. 
   
   Doris's memory usage is not very stable, I want to disable them first, and try to fix other memory problems and then open them again. This may need about 2 months and there are many releases during this stage, so that I disable them  like we have done in branch 1.1-lts.
   
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org