[jira] [Commented] (PARQUET-41) Add bloom filters to parquet statistics

["Nicholas Chammas (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/PARQUET-41?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17276842#comment-17276842 ] 

Nicholas Chammas commented on PARQUET-41:
-----------------------------------------

Where is the user documentation for all the bloom filter-related functionality that will be released as part of parquet-mr 1.12? I'm thinking of user settings like {{parquet.filter.bloom.enabled}} and {{parquet.bloom.filter.*}}, along with anything else a user might care about.

For example, if a Spark user wants to use or configure bloom filters on their Parquet data, what documentation should they reference?

> Add bloom filters to parquet statistics
> ---------------------------------------
>
>                 Key: PARQUET-41
>                 URL: https://issues.apache.org/jira/browse/PARQUET-41
>             Project: Parquet
>          Issue Type: New Feature
>          Components: parquet-format, parquet-mr
>            Reporter: Alex Levenson
>            Assignee: Junjie Chen
>            Priority: Major
>              Labels: filter2, pull-request-available
>             Fix For: format-2.7.0, 1.12.0
>
>
> For row groups with no dictionary, we could still produce a bloom filter. This could be very useful in filtering entire row groups.
> Pull request:
> https://github.com/apache/parquet-mr/pull/215



--
This message was sent by Atlassian Jira
(v8.3.4#803005)