[GitHub] [iceberg] RussellSpitzer commented on issue #5216: Rewritedatafiles is not work with total-delete-files on Spark 3.2.1, Scala 2.12, Iceberg 0.14.0

[GitBox <gi...@apache.org>]

RussellSpitzer commented on issue #5216:
URL: https://github.com/apache/iceberg/issues/5216#issuecomment-1179083356

   It does merge data and delete files. Unfortunately the logic for cleaning up delete files is more complicated and we haven't set that up quite yet. The main issue being that just because a delete file is applied to 1 data file doesn't mean it was applied to all relevant data files. Currently the way we do the processing doesn't let us know if a delete file has been completely or only partially merged. There are various efforts going forward to clean this up at the moment.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org