[GitHub] [incubator-iceberg] rdblue commented on issue #181: Add mechanism to expire old metadata versions

[GitBox <gi...@apache.org>]

rdblue commented on issue #181: Add mechanism to expire old metadata versions
URL: https://github.com/apache/incubator-iceberg/issues/181#issuecomment-541449685
 
 
   From discussion on #309, I think the right way to expire old metadata is to keep a list of the N previous metadata files in each metadata file, then regularly clean up the old files after each commit. Both the number of old versions and whether to delete the oldest file after each commit should be configured by a table properties.
   
   We can also add additional checking in the snapshot expiration code since we can go back and read the old metadata locations to find what should have been deleted (but may have failed).

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org