[jira] [Assigned] (IGNITE-5938) Implement WAL logs compaction and compression after checkpoint

["Ivan Rakov (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/IGNITE-5938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Ivan Rakov reassigned IGNITE-5938:
----------------------------------

    Assignee: Ivan Rakov  (was: Dmitriy Govorukhin)

> Implement WAL logs compaction and compression after checkpoint
> --------------------------------------------------------------
>
>                 Key: IGNITE-5938
>                 URL: https://issues.apache.org/jira/browse/IGNITE-5938
>             Project: Ignite
>          Issue Type: Improvement
>          Components: persistence
>    Affects Versions: 2.1
>            Reporter: Alexey Goncharuk
>            Assignee: Ivan Rakov
>            Priority: Major
>             Fix For: 2.4
>
>
> Currently, we simply move WAL segments to archive when WAL segment is written and delete when checkpoint history becomes too old. 
> Archived WAL segment contains physical delta records that are no longer needed for rebalancing, so these records may be thrown away. In order to optimize disk space and delta WAL rebalancing, we can do the following:
> 1) Clean the WAL segments from the physical records
> 2) Compress the cleaned segments (I expect this to be very effective since we write full objects)



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)