[GitHub] [incubator-iceberg] rdblue commented on issue #682: Add Parquet user-defined predicate to push down StartsWith

[GitBox <gi...@apache.org>]

rdblue commented on issue #682: Add Parquet user-defined predicate to push down StartsWith
URL: https://github.com/apache/incubator-iceberg/issues/682#issuecomment-575734167
 
 
   When I opened this issue, I was thinking about the old read path. That's the one that @maqroll correctly pointed to. But we now use the new read path and the row group filters are [`ParquetMetricsRowGroupFilter`](https://github.com/apache/incubator-iceberg/blob/master/parquet/src/main/java/org/apache/iceberg/parquet/ParquetMetricsRowGroupFilter.java) and [`ParquetDictionaryRowGroupFilter`](https://github.com/apache/incubator-iceberg/blob/master/parquet/src/main/java/org/apache/iceberg/parquet/ParquetDictionaryRowGroupFilter.java). We need to add support to those classes for the `startsWith` predicate added by #327.
   
   Part of the advantage of the new read path is that we don't need to use Parquet's filter API, which is difficult to work with and doesn't natively support all of the expression types that Iceberg uses.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org