You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@parquet.apache.org by "Gang Wu (Jira)" <ji...@apache.org> on 2023/04/12 01:51:00 UTC

[jira] [Resolved] (PARQUET-2260) Bloom filter bytes size shouldn't be larger than maxBytes size in the configuration

     [ https://issues.apache.org/jira/browse/PARQUET-2260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Gang Wu resolved PARQUET-2260.
------------------------------
    Resolution: Fixed

>  Bloom filter bytes size shouldn't be larger than maxBytes size in the configuration
> ------------------------------------------------------------------------------------
>
>                 Key: PARQUET-2260
>                 URL: https://issues.apache.org/jira/browse/PARQUET-2260
>             Project: Parquet
>          Issue Type: Bug
>            Reporter: Mars
>            Assignee: Mars
>            Priority: Major
>             Fix For: 1.14.0
>
>
> Before this PR: If {{parquet.bloom.filter.max.bytes}} configuration is not a power of 2 value, the size of the bloom filter generated will exceed this value. For example, if set {{parquet.bloom.filter.max.bytes}} as 1024 * 1024+1= 1048577 , the bytes size of bloom filter generated will be 1024 * 1024 * 2 = 2097152. This does not match the definition of the parameter
> After this PR: If {{parquet.bloom.filter.max.bytes}} configuration is not a power of 2, and the size of {{parquet.bloom.filter.max.bytes}} is the final bloom filter bytes size.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)