You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@resilientdb.apache.org by "cjcchen (via GitHub)" <gi...@apache.org> on 2025/08/29 22:25:09 UTC

[I] [NewFeature] Allow recovering from data storage [incubator-resilientdb]

cjcchen opened a new issue, #184:
URL: https://github.com/apache/incubator-resilientdb/issues/184

   Currently, ResilientDB supports recovering the data
   ResilientDB will record every operation in the log and redo the log when starting up.
    ([code](https://github.com/apache/incubator.-resilientdb/blob/master/platform/consensus/recovery/recovery.cpp#L40)).
   
   However, the current version does not utilize the stable checkpoint among the logs. What we do is to scan all the log other than starting from the recent checkpoint.  
   This is because we leverage the memory as the default storage, and we need to reconstruct the memory to avoid data loss.
   
   However, as the log grows larger, the starting time increases.
   To mitigate this, we can apply any existing data storage, like leveldb.
   
   When starting ResilientDB, it only needs to start from what the datastorage has and redo the missing logs.
   
   
   
   
    


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@resilientdb.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] [Engine] Allow recovering from data storage [incubator-resilientdb]

Posted by "cjcchen (via GitHub)" <gi...@apache.org>.
cjcchen closed issue #184: [Engine] Allow recovering from data storage
URL: https://github.com/apache/incubator-resilientdb/issues/184


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@resilientdb.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] [Engine] Allow recovering from data storage [incubator-resilientdb]

Posted by "cjcchen (via GitHub)" <gi...@apache.org>.
cjcchen commented on issue #184:
URL: https://github.com/apache/incubator-resilientdb/issues/184#issuecomment-3638583269

   #208 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@resilientdb.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org