You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@parquet.apache.org by "aadant (via GitHub)" <gi...@apache.org> on 2025/03/31 03:10:04 UTC
[I] N-gram Bloom Filter Support [parquet-format]
aadant opened a new issue, #490:
URL: https://github.com/apache/parquet-format/issues/490
### Describe the enhancement requested
Some database support bloom filters on n-grams from a String. This facilitates some operations like "like" operations.
Searching for a particular discriminant token with rare n-grams can be greatly sped up.
https://clickhouse.com/docs/optimize/skipping-indexes#bloom-filter-types
see `ngrambf_v1`
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@parquet.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@parquet.apache.org
For additional commands, e-mail: issues-help@parquet.apache.org
Re: [I] N-gram Bloom Filter Support [parquet-format]
Posted by "alamb (via GitHub)" <gi...@apache.org>.
alamb commented on issue #490:
URL: https://github.com/apache/parquet-format/issues/490#issuecomment-2833438869
- See also https://github.com/apache/parquet-format/issues/489#issuecomment-2833438755
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@parquet.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@parquet.apache.org
For additional commands, e-mail: issues-help@parquet.apache.org
Re: [I] N-gram Bloom Filter Support [parquet-format]
Posted by "aadant (via GitHub)" <gi...@apache.org>.
aadant commented on issue #490:
URL: https://github.com/apache/parquet-format/issues/490#issuecomment-2767026932
this one is language independent @wgtmac
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@parquet.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@parquet.apache.org
For additional commands, e-mail: issues-help@parquet.apache.org
Re: [I] N-gram Bloom Filter Support [parquet-format]
Posted by "alamb (via GitHub)" <gi...@apache.org>.
alamb commented on issue #490:
URL: https://github.com/apache/parquet-format/issues/490#issuecomment-3196134267
BTW it is possible today to add user defined indexes for this usecase
You can put such indices in Parquet files, as described here
- https://datafusion.apache.org/blog/2025/07/14/user-defined-parquet-indexes/
Or you can store such indices externally, as described here:
- https://datafusion.apache.org/blog/2025/08/15/external-parquet-indexes/
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@parquet.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@parquet.apache.org
For additional commands, e-mail: issues-help@parquet.apache.org