You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@iceberg.apache.org by "led-disney (via GitHub)" <gi...@apache.org> on 2026/07/17 14:34:05 UTC
[I] Support Parquet bloom filter pruning on read [iceberg-rust]
led-disney opened a new issue, #2841:
URL: https://github.com/apache/iceberg-rust/issues/2841
### Is your feature request related to a problem or challenge?
Right now `ArrowReader` only prunes row groups using min/max stats. But for lookups like `trace_id = '...'` (where values are basically random 128-bit ids), min/max overlaps every row group and nothing gets pruned. The files do have bloom filters on those columns, the reader just never looks at them.
Writing bloom filters already works, you can turn them on per column via `WriterProperties`. It's purely the read side that's missing.
### Describe the solution you'd like
When a predicate has an eq or IN check on a column with a `bloom_filter_offset`, load the filter and skip any row group that comes back negative. Might make sense as an opt-in on the scan builder, since it's an extra read per row group checked.
#2398 already did this, but it got closed by the stale bot before anyone reviewed it. @dannycjones suggested to file a feature request, so here it is.
A few other places already do this if it helps: Iceberg Java has `ParquetBloomRowGroupFilter`, DataFusion does it by default (`bloom_filter_on_read`), and both Trino and DuckDB check bloom filters on read too.
### Willingness to contribute
None
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [I] Support Parquet bloom filter pruning on read [iceberg-rust]
Posted by "laskoviymishka (via GitHub)" <gi...@apache.org>.
laskoviymishka closed issue #2841: Support Parquet bloom filter pruning on read
URL: https://github.com/apache/iceberg-rust/issues/2841
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [I] Support Parquet bloom filter pruning on read [iceberg-rust]
Posted by "xanderbailey (via GitHub)" <gi...@apache.org>.
xanderbailey commented on issue #2841:
URL: https://github.com/apache/iceberg-rust/issues/2841#issuecomment-5085198105
Hi there, yes happy to reopen this and see if we can get it over the line. @CTTY are you about to reopen closed PRs or should I just open a new one?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [I] Support Parquet bloom filter pruning on read [iceberg-rust]
Posted by "manishgaurav84 (via GitHub)" <gi...@apache.org>.
manishgaurav84 commented on issue #2841:
URL: https://github.com/apache/iceberg-rust/issues/2841#issuecomment-5036928176
Hi @led-d, I'm a new contributor and would love to pick this up! I'll take a look at the previous work in #2398 to get started.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org