You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "Noemi Pap-Takacs (Jira)" <ji...@apache.org> on 2022/12/12 14:52:00 UTC
[jira] [Commented] (IMPALA-10569) Impala should determine Iceberg data file format from Iceberg metadata
[ https://issues.apache.org/jira/browse/IMPALA-10569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17646134#comment-17646134 ]
Noemi Pap-Takacs commented on IMPALA-10569:
-------------------------------------------
This feature is added to IcebergContentFileStore (introduced by IMPALA-11591) in IMPALA-11158.
> Impala should determine Iceberg data file format from Iceberg metadata
> ----------------------------------------------------------------------
>
> Key: IMPALA-10569
> URL: https://issues.apache.org/jira/browse/IMPALA-10569
> Project: IMPALA
> Issue Type: Bug
> Components: Frontend
> Reporter: Zoltán Borók-Nagy
> Priority: Major
> Labels: impala-iceberg
>
> When Impala creates an Iceberg table it sets HMS table property 'iceberg.file_format' to indicate the underlying data file format.
> However, when the table was created by Hive or Spark, we don't have this property and Impala assumes that the data file format is PARQUET. This assumption is just a wild guess, and when it's wrong Impala raises an error during query execution.
> Instead of only checking the table property, Impala could also try to determine the file format based on Iceberg metadata.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org