You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "Zoltán Borók-Nagy (Jira)" <ji...@apache.org> on 2022/09/01 15:21:00 UTC

[jira] [Commented] (IMPALA-11546) Set Options for Iceberg tables

    [ https://issues.apache.org/jira/browse/IMPALA-11546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17599030#comment-17599030 ] 

Zoltán Borók-Nagy commented on IMPALA-11546:
--------------------------------------------

The options and default values are already documented at https://impala.apache.org/docs/build/html/topics/impala_iceberg.html

For some options we already have query options that can even override the table properties: COMPRESSION_CODEC, PARQUET_FILE_SIZE.

Impala cannot write Avro (Impala cannot even read Iceberg tables with Avro files currently) and ORC files, so we don't have query options for them.

> Set Options for Iceberg tables
> ------------------------------
>
>                 Key: IMPALA-11546
>                 URL: https://issues.apache.org/jira/browse/IMPALA-11546
>             Project: IMPALA
>          Issue Type: Improvement
>            Reporter: Manish Maheshwari
>            Priority: Major
>              Labels: impala-iceberg, ramp-up
>
> Set options for iceberg tables should be allowed to set at session/impala level rather than just at table properties level. Also we should document the current defaults for them.
> From the current doc we should allow these to be set and unset -
>  * write.format.default (only parquet for now to be extended to avro and maybe orc eventually)
>  * write.parquet.compression-codec
>  * write.parquet.compression-level
>  * write.parquet.row-group-size-bytes
>  * write.parquet.page-size-bytes
>  * write.parquet.dict-size-bytes
> Next can the user not set compression codec for avro? How does one set that?
> These configs - iceberg.catalog, iceberg.catalog_location and iceberg.table_identifier should not be allowed to be modified.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org