You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by GitBox <gi...@apache.org> on 2019/12/16 10:49:39 UTC

[GitHub] [incubator-doris] morningman opened a new pull request #2473: Optimize compaction strategy of tablet on BE

morningman opened a new pull request #2473: Optimize compaction strategy of tablet on BE
URL: https://github.com/apache/incubator-doris/pull/2473
 
 
   The current compaction selection strategy and cumulative point update logic
   will cause the cumulative compaction to not work, and all compaction tasks
   will be completed only by the base compaction. This can cause a large number
   of data versions to pile up.
   
   In the current cumulative point update logic, when a cumulative cannot select
   enough number of rowsets, it will directly increase the cumulative point.
   Therefore, when the data version generates the same speed as the cumulative
   compaction polling, it will cause the cumulative point to continuously increase
   without triggering the cumulative compaction.
   
   The new strategy mainly modifies the update logic of cumulative point to ensure
   that the above problems do not occur. At the same time, the new strategy also
   takes into account the problem that compaction cannot be performed if cumulative
   points stagnate for a long time. Cumulative points will be forced to increase
   through threshold settings to ensure that compaction has a chance to execute.
   
   Also add a new HTTP API to view the compaction status of specified tablet.
   See `compaction-action.md` for details.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org