[jira] [Commented] (IMPALA-12700) Impala should take Iceberg bloom filter properties into consideration

["Ranga Reddy (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/IMPALA-12700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17805078#comment-17805078 ] 

Ranga Reddy commented on IMPALA-12700:
--------------------------------------

For *orc* file format, the following properties needs to be picked from iceberg side.
|write.orc.bloom.filter.columns|(not set)|Comma separated list of column names for which a Bloom filter must be created|
|write.orc.bloom.filter.fpp|0.05|False positive probability for Bloom filter (must > 0.0 and < 1.0)|

> Impala should take Iceberg bloom filter properties into consideration
> ---------------------------------------------------------------------
>
>                 Key: IMPALA-12700
>                 URL: https://issues.apache.org/jira/browse/IMPALA-12700
>             Project: IMPALA
>          Issue Type: Bug
>          Components: Frontend
>            Reporter: Zoltán Borók-Nagy
>            Priority: Major
>              Labels: impala-iceberg
>
> Currenty Impala uses the query option "parquet_bloom_filter_write" and table property "parquet.bloom.filter.columns" to decide whether to write bloom filters or not.
> Iceberg uses different table properties: https://iceberg.apache.org/docs/1.4.0/configuration/
> * write.parquet.bloom-filter-enabled.column.col1
> * write.parquet.bloom-filter-max-bytes
> Impala should also respect the Iceberg table properties when it writes Parquet files in Iceberg tables.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org