[jira] [Created] (IGNITE-5938) Implement WAL logs compaction and compression after checkpoint

["Alexey Goncharuk (JIRA)" <ji...@apache.org>]

Alexey Goncharuk created IGNITE-5938:
----------------------------------------

             Summary: Implement WAL logs compaction and compression after checkpoint
                 Key: IGNITE-5938
                 URL: https://issues.apache.org/jira/browse/IGNITE-5938
             Project: Ignite
          Issue Type: Improvement
          Components: persistence
    Affects Versions: 2.1
            Reporter: Alexey Goncharuk
             Fix For: 2.2


Currently, we simply move WAL segments to archive when WAL segment is written and delete when checkpoint history becomes too old. 
Archived WAL segment contains physical delta records that are no longer needed for rebalancing, so these records may be thrown away. In order to optimize disk space and delta WAL rebalancing, we can do the following:
1) Clean the WAL segments from the physical records
2) Compress the cleaned segments (I expect this to be very effective since we write full objects)




--
This message was sent by Atlassian JIRA
(v6.4.14#64029)