[GitHub] [incubator-iceberg] rdblue opened a new issue #1023: Add a row filter implementation for equality deletes

[GitBox <gi...@apache.org>]

rdblue opened a new issue #1023:
URL: https://github.com/apache/incubator-iceberg/issues/1023


   Equality deletes will be applied in row-based reads using a row filter. The filter should bind to the projected record schema using accessors, like expression evaluators. Because the order in an equality delete file is not guaranteed to match the order of incoming rows, the most generic filter should build a hash set of rows from equality delete files and filter out data file rows that produce a "key" row in the set.
   
   Note that when Iceberg tracks sort order for delete and data files, a merge strategy can be used in place of the set-based filter if the delete and data file sort order matches.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org