You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@iceberg.apache.org by "lirui-apache (via GitHub)" <gi...@apache.org> on 2023/08/09 04:25:39 UTC
[GitHub] [iceberg] lirui-apache commented on issue #8255: RemoveSnapshots can incorrectly remove files that are still valid
lirui-apache commented on issue #8255:
URL: https://github.com/apache/iceberg/issues/8255#issuecomment-1670631552
Hey @zhongyujiang @RussellSpitzer , thanks for the comments and pointers. I agree adding a deleted file back should not be encouraged. But the problem is we're unable to detect and block such usage. And leaving that burden to users seems unfriendly or even infeasible.
I also believe the spark algorithm does the right thing. So I guess we'll just always use the spark action to clean up expired files.
Thanks again, I'm closing the issue.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org