You are viewing a plain text version of this content. The canonical link for it is here.
Posted to gsoc@community.apache.org by "Mingyang Liu (Jira)" <ji...@apache.org> on 2025/02/12 14:23:00 UTC
[jira] [Updated] (GSOC-276) [GSOC][Kvrocks] Support database backup to cloud storage
[ https://issues.apache.org/jira/browse/GSOC-276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Mingyang Liu updated GSOC-276:
------------------------------
Description:
h2. Backgroud:
Kvrocks is a key-value database that provides a Redis-compatible API on top of RocksDB. Currently, Kvrocks lacks a built-in mechanism for database backup to cloud storage, which is crucial for data durability, disaster recovery, and scalability in cloud environments.
This project aims to implement a robust backup system that allows users to store Kvrocks backups directly in cloud storage services such as Amazon S3, Google Cloud Storage, and/or Azure Blob Storage. The solution will integrate with the existing Kvrocks backup and restore mechanisms while ensuring efficient and secure data transfer.
h2. Deliverables:
# *Cloud Storage Integration:* Implement backup storage support for Amazon S3, Google Cloud Storage, and Azure Blob Storage using SDKs, REST APIs or libraries (e.g. Apache OpenDAL).
# *Backup & Restore Commands:* Extend Kvrocks’ backup functionality to allow exporting and importing database snapshots from cloud storage.
# *Configuration & Authentication:* Provide user-configurable options to specify storage credentials and backup parameters.
# *Incremental Backup Support (Stretch Goal):* Optimize storage usage by implementing differential or incremental backup capabilities.
# *Documentation & Tests:* Comprehensive documentation and test coverage to ensure reliability and ease of use.
h2. Recommended Skills:
# Good at coding in C++;
# Knowledge about database internals and cloud storage;
# Knowledge about Kvrocks or Redis.
Mentor: Mingyang Liu, Apache Kvrocks PMC member, twice@apache.org
Mailing List: dev@kvrocks.apache.org
was:
h2. Backgroud:
Kvrocks is a key-value database that provides a Redis-compatible API on top of RocksDB. Currently, Kvrocks lacks a built-in mechanism for database backup to cloud storage, which is crucial for data durability, disaster recovery, and scalability in cloud environments.
This project aims to implement a robust backup system that allows users to store Kvrocks backups directly in cloud storage services such as Amazon S3, Google Cloud Storage, and/or Azure Blob Storage. The solution will integrate with the existing Kvrocks backup and restore mechanisms while ensuring efficient and secure data transfer.
h2. Deliverables:
# *Cloud Storage Integration:* Implement backup storage support for Amazon S3, Google Cloud Storage, and Azure Blob Storage using SDKs, REST APIs or libraries (e.g. Apache OpenDAL).
# *Backup & Restore Commands:* Extend Kvrocks’ backup functionality to allow exporting and importing database snapshots from cloud storage.
# *Configuration & Authentication:* Provide user-configurable options to specify storage credentials and backup parameters.
# *Incremental Backup Support (Stretch Goal):* Optimize storage usage by implementing differential or incremental backup capabilities.
# *Documentation & Tests:* Comprehensive documentation and test coverage to ensure reliability and ease of use.
h2. Recommended Skills:
# Good at coding in C++;
# Knowledge about database internals and cloud storage;
# Knowledge about Kvrocks or Redis.
> [GSOC][Kvrocks] Support database backup to cloud storage
> --------------------------------------------------------
>
> Key: GSOC-276
> URL: https://issues.apache.org/jira/browse/GSOC-276
> Project: Comdev GSOC
> Issue Type: New Feature
> Reporter: Mingyang Liu
> Priority: Major
>
> h2. Backgroud:
> Kvrocks is a key-value database that provides a Redis-compatible API on top of RocksDB. Currently, Kvrocks lacks a built-in mechanism for database backup to cloud storage, which is crucial for data durability, disaster recovery, and scalability in cloud environments.
> This project aims to implement a robust backup system that allows users to store Kvrocks backups directly in cloud storage services such as Amazon S3, Google Cloud Storage, and/or Azure Blob Storage. The solution will integrate with the existing Kvrocks backup and restore mechanisms while ensuring efficient and secure data transfer.
> h2. Deliverables:
> # *Cloud Storage Integration:* Implement backup storage support for Amazon S3, Google Cloud Storage, and Azure Blob Storage using SDKs, REST APIs or libraries (e.g. Apache OpenDAL).
> # *Backup & Restore Commands:* Extend Kvrocks’ backup functionality to allow exporting and importing database snapshots from cloud storage.
> # *Configuration & Authentication:* Provide user-configurable options to specify storage credentials and backup parameters.
> # *Incremental Backup Support (Stretch Goal):* Optimize storage usage by implementing differential or incremental backup capabilities.
> # *Documentation & Tests:* Comprehensive documentation and test coverage to ensure reliability and ease of use.
> h2. Recommended Skills:
> # Good at coding in C++;
> # Knowledge about database internals and cloud storage;
> # Knowledge about Kvrocks or Redis.
> Mentor: Mingyang Liu, Apache Kvrocks PMC member, twice@apache.org
> Mailing List: dev@kvrocks.apache.org
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: gsoc-unsubscribe@community.apache.org
For additional commands, e-mail: gsoc-help@community.apache.org