[GitHub] [iceberg] sgcowell commented on issue #6042: Add delete file information to partitions table

[GitBox <gi...@apache.org>]

sgcowell commented on issue #6042:
URL: https://github.com/apache/iceberg/issues/6042#issuecomment-1292605184

   From the perspective of estimating scan costs with partition pruning - pos_delete_record_count is definitely useful for calculating the effective record count, eq_delete_record_count/eq_delete_file_count is less useful, but can at least be a signal of there being increased costs for handling those eq deletes, even if the cost estimate becomes much less precise.  Eq delete stats at least would be a good signal on increased mem usage requirements.  Computing actual record counts impacted by eq deletes up front seems cost-prohibitive and starts to erode their value proposition.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org