[GitHub] [iceberg] singhpk234 commented on issue #5965: Iceberg with Glue Catalog updates glue table version on every commit, but there's a maximum of 100,000 versions

[GitBox <gi...@apache.org>]

singhpk234 commented on issue #5965:
URL: https://github.com/apache/iceberg/issues/5965#issuecomment-1275693583

   I think we can expire the previous table version when the current version is successfully committed, or you can override glue table level version count default to a big value as per : https://docs.aws.amazon.com/general/latest/gr/glue.html
   
   to get rid of existing version of table via a separate clean-up job you can use this util as well : https://github.com/aws-samples/aws-glue-table-versions-cleanup-utility
   
   cc @jackye1995 
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org