You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@paimon.apache.org by "hililiwei (via GitHub)" <gi...@apache.org> on 2023/03/30 12:42:38 UTC

[GitHub] [incubator-paimon] hililiwei opened a new issue, #781: [Feature] Refactor the recording method of snapshot linear history

hililiwei opened a new issue, #781:
URL: https://github.com/apache/incubator-paimon/issues/781

   ### Search before asking
   
   - [X] I searched in the [issues](https://github.com/apache/incubator-paimon/issues) and found nothing similar.
   
   
   ### Motivation
   
   Apache Paimon currently uses the file prefix and file system List command to manage the linear history of snapshots, but this method has the following drawbacks:
   
   - It is not friendly with object storage, where operations such as List\Rename are very resource-intensive.
   - This method has a single linear relationship, which is not conducive to creating complex relationships, such as create a new branch\tag.
   
   ### Solution
   
   Store the file path of the previous Snapshot directly in the Snapshot object.
   
   
   
   ### Anything else?
   
   _No response_
   
   ### Are you willing to submit a PR?
   
   - [X] I'm willing to submit a PR!


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org