You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "Zoltán Borók-Nagy (Jira)" <ji...@apache.org> on 2022/09/01 15:21:00 UTC
[jira] [Commented] (IMPALA-11546) Set Options for Iceberg tables
[ https://issues.apache.org/jira/browse/IMPALA-11546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17599030#comment-17599030 ]
Zoltán Borók-Nagy commented on IMPALA-11546:
--------------------------------------------
The options and default values are already documented at https://impala.apache.org/docs/build/html/topics/impala_iceberg.html
For some options we already have query options that can even override the table properties: COMPRESSION_CODEC, PARQUET_FILE_SIZE.
Impala cannot write Avro (Impala cannot even read Iceberg tables with Avro files currently) and ORC files, so we don't have query options for them.
> Set Options for Iceberg tables
> ------------------------------
>
> Key: IMPALA-11546
> URL: https://issues.apache.org/jira/browse/IMPALA-11546
> Project: IMPALA
> Issue Type: Improvement
> Reporter: Manish Maheshwari
> Priority: Major
> Labels: impala-iceberg, ramp-up
>
> Set options for iceberg tables should be allowed to set at session/impala level rather than just at table properties level. Also we should document the current defaults for them.
> From the current doc we should allow these to be set and unset -
> * write.format.default (only parquet for now to be extended to avro and maybe orc eventually)
> * write.parquet.compression-codec
> * write.parquet.compression-level
> * write.parquet.row-group-size-bytes
> * write.parquet.page-size-bytes
> * write.parquet.dict-size-bytes
> Next can the user not set compression codec for avro? How does one set that?
> These configs - iceberg.catalog, iceberg.catalog_location and iceberg.table_identifier should not be allowed to be modified.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org