You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@ignite.apache.org by "Kirill Tkalenko (Jira)" <ji...@apache.org> on 2022/06/29 12:06:00 UTC

[jira] [Updated] (IGNITE-17267) Preparing a checkpoint for a DeltaFilePageStore

|  ![](cid:jira-generated-image-avatar-714b2d1f-7521-4904-a2ac-68894b1d26fd) |
[Kirill
Tkalenko](https://issues.apache.org/jira/secure/ViewProfile.jspa?name=ktkalenko%40gridgain.com)
**updated** an issue  
---|---  
|  
---  
|  [Ignite](https://issues.apache.org/jira/browse/IGNITE) /
[![Improvement](cid:jira-generated-image-
avatar-7f5f4d4f-dd56-49c8-b70c-2c5fc7e191c6)](https://issues.apache.org/jira/browse/IGNITE-17267)
[IGNITE-17267](https://issues.apache.org/jira/browse/IGNITE-17267)  
---  
[Preparing a checkpoint for a
DeltaFilePageStore](https://issues.apache.org/jira/browse/IGNITE-17267)  
| Change By: |  [Kirill
Tkalenko](https://issues.apache.org/jira/secure/ViewProfile.jspa?name=ktkalenko%40gridgain.com)  
---|---  
|  To implement the *DeltaFilePageStore*, we need to prepare a checkpoint for
their creation.  
  
What should be done:  
# Sort dirty pages (*FullPageId*) by *groupId*, *partitionId*, *pageIdx*;  
# In several threads, write dirty pages in batches for each partition and know
the number of these pages.  
  
What can we look at:  
* *org.apache.ignite.internal.pagememory.persistence.checkpoint.CheckpointWorkflow#beginCheckpoint*  
* *org.apache.ignite.internal.pagememory.persistence.checkpoint.CheckpointWorkflow#splitAndSortCheckpointPagesIfNeeded*  
* *org.apache.ignite.internal.pagememory.persistence.checkpoint.Checkpointer#writePages*   
  
Some implementation notes:  
* We can replace *CheckpointWorkflow#parallelSortThreshold* with a constant at 40k, according to the article from 1.  
---  
|  |  [ ![Add Comment](cid:jira-generated-image-static-comment-
icon-d9a1ef0d-8a83-4d83-a5f1-4ea811510036)
](https://issues.apache.org/jira/browse/IGNITE-17267#add-comment "Add
Comment") |  [Add
Comment](https://issues.apache.org/jira/browse/IGNITE-17267#add-comment "Add
Comment")  
---|---  
  
|  This message was sent by Atlassian Jira (v8.20.10#820010-sha1:ace47f9) |  |
![Atlassian logo](https://issues.apache.org/jira/images/mail/atlassian-email-
logo.png)  
---