[GitHub] [bookkeeper] dlg99 opened a new issue, #3389: Prioritize compaction of entry logs with the lowest amount of remaining usable data

[GitBox <gi...@apache.org>]

dlg99 opened a new issue, #3389:
URL: https://github.com/apache/bookkeeper/issues/3389

   **FEATURE REQUEST**
   
   1. Please describe the feature you are requesting.
   
   Prioritize compaction to free up more space faster.
   
   2. Indicate the importance of this issue to you (blocker, must-have, should-have, nice-to-have).
      
   must-have
   
   3. Provide any additional detail on your proposed use case for this feature.
   
   Looking at GarbageCollectorThread:
   
   doCompactEntryLogs() iterates over entry logs in whatever natural order they happen to be, picks the first with usage below thresholds and starts compacting.
   Do major compaction it means we can start compaction with an entry log at 80% utilization instead of e.g. one with 10%.
   This can be easily fixed by building a PriorityQueue of entry logs, ordering by lowest utilization (meta.getUsage()) to free up more space sooner.
   Building of the queue should not take too much time and can be combined with doGcEntryLogs() which iterates over all entries in entryLogMetaMap anyway; memory-wise it should be fine too. 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@bookkeeper.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org