[GitHub] [bookkeeper] gaozhangmin commented on issue #3973: Introduce disk cache storage layer.

["gaozhangmin (via GitHub)" <gi...@apache.org>]

gaozhangmin commented on issue #3973:
URL: https://github.com/apache/bookkeeper/issues/3973#issuecomment-1643006599

   ## The revisied proposal：
   The new features will not have any impact on the existing architecture implementation.
   
   We have introduced a new implementation called DirectDbLedgerStorage, which eliminates the use of journal pre-writing logs. Now, ledger data can be directly written to the SSD disk, eliminating the need for data to be written twice to the SSD disk.
   
   Data in the SSD disk cache is evicted to the HDD disk based on the write time at the granularity of entry logs.
   
   Furthermore, we have added support for write degradation. When the SSD disk cache reaches the warning threshold, the system automatically switches to the journal+ledger approach to ensure system stability.
   
   I'd like to split this proposal into tasks:
   - [ ]  Introduce an new LedgerStorage implementation `DirectDbLedgerStorage` 
   - [ ] Introduce `ColdStorageArchiveThread`, the main class to archive log file in disk cache to cold storage.
   - [ ] cookie validation include cold ledger dirs
   - [ ] disk cache wtiteing status api
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@bookkeeper.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org