[jira] [Updated] (KUDU-2057) Dynamic budget for DRS compactions

["Grant Henke (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/KUDU-2057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Grant Henke updated KUDU-2057:
------------------------------
    Component/s: compaction

> Dynamic budget for DRS compactions
> ----------------------------------
>
>                 Key: KUDU-2057
>                 URL: https://issues.apache.org/jira/browse/KUDU-2057
>             Project: Kudu
>          Issue Type: Improvement
>          Components: compaction, tablet
>            Reporter: Jean-Daniel Cryans
>            Priority: Major
>
> Clusters have busier and quieter periods, so by default Kudu leverages the latter to schedule compactions because during the former it's mostly flushing.
> A further improvement would be to somehow recognize that a tserver is mostly scheduling DRS compactions and to start giving them bigger and bigger budgets. Compacting more DRSes at a time lowers the overall write amplification, by running the risk of compacting for too long and not be able to schedule important flushes. We could lower the risk by re-adding an emergency flush thread, and/or making it possible to cancel tasks.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)