[GitHub] [incubator-doris] ZhangYu0123 commented on issue #4164: [Proposal] Compaction rules optimization

[GitBox <gi...@apache.org>]

ZhangYu0123 commented on issue #4164:
URL: https://github.com/apache/incubator-doris/issues/4164#issuecomment-669154779


   ## Self-test performance data
   ### Optimized version
   **_Import 2m files every 5s, total 1000 times:_**
   
   base compaction times = 2,  cumulative times = 115
   max number of files after cumulative point = 4
   max number of files before cumulative point = 16
   
   **_Import 42m files every 5s, total 100 times:_**
   
   base compaction times = 2,  cumulative times = 80
   max number of files after cumulative point = 6
   max number of files before cumulative point = 9
   
   ### original version
   
   **_Import 2m files every 5s, total 1000 times:_**
   
   base compaction times = 5,  cumulative times = 125
   max number of files after cumulative point = 74
   max number of files before cumulative point = 12
   
   **_Import 42m files every 5s, total 100 times:_**
   
   base compaction times = 3,  cumulative times = 100
   max number of files after cumulative point = 95
   max number of files before cumulative point = 2
   
   
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org