You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@ignite.apache.org by "Pavel Pereslegin (Jira)" <ji...@apache.org> on 2024/07/01 13:29:00 UTC

[jira] [Updated] (IGNITE-22638) Catalog compaction. Provide listener API on MvPartitionStorage with semantic onBeforeCheckpoint.

     [ https://issues.apache.org/jira/browse/IGNITE-22638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Pavel Pereslegin updated IGNITE-22638:
--------------------------------------
    Description: 
To perform catalog compaction, we need to determine and save a minimum time (low watermark) that guarantees that when next time we'll apply the raft log, we don't need the history up to that timestamp.
To implement local calculation of the minimum timestamp, we need to provide an API with semantics similar to CheckpointListener#beforeCheckpointBegin (or afterCheckpointEnd, *to be clarified*) to save this timestamp.
This timestamp make sence only for groups (*clarify*) with persistence, but it would be nice to have a common API (for example in MvPartitionStorage). So the implementation requires collaboration with the storage engine team).

  was:
To perform catalog compaction, we need to determine and save a minimum time (low watermark) that guarantees that when next time we'll apply the raft log, we don't need the history up to that timestamp.
To implement local calculation of the minimum timestamp, we need to provide an API with semantics similar to CheckpointListener#beforeCheckpointBegin (or afterCheckpointEnd, *to be clarified*) to save this timestamp.
This timestamp make sence only for groups (*clarify*) with persistence, but it would be nice to have a common API (for example in MvPartitionStorage), and so the implementation requires collaboration with the storage engine team).


> Catalog compaction. Provide listener API on MvPartitionStorage with semantic onBeforeCheckpoint.
> ------------------------------------------------------------------------------------------------
>
>                 Key: IGNITE-22638
>                 URL: https://issues.apache.org/jira/browse/IGNITE-22638
>             Project: Ignite
>          Issue Type: Task
>            Reporter: Pavel Pereslegin
>            Priority: Major
>
> To perform catalog compaction, we need to determine and save a minimum time (low watermark) that guarantees that when next time we'll apply the raft log, we don't need the history up to that timestamp.
> To implement local calculation of the minimum timestamp, we need to provide an API with semantics similar to CheckpointListener#beforeCheckpointBegin (or afterCheckpointEnd, *to be clarified*) to save this timestamp.
> This timestamp make sence only for groups (*clarify*) with persistence, but it would be nice to have a common API (for example in MvPartitionStorage). So the implementation requires collaboration with the storage engine team).



--
This message was sent by Atlassian Jira
(v8.20.10#820010)