You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "Zoltán Borók-Nagy (Jira)" <ji...@apache.org> on 2021/03/09 13:48:00 UTC
[jira] [Created] (IMPALA-10569) Impala should determine Iceberg
data file format from Iceberg metadata
Zoltán Borók-Nagy created IMPALA-10569:
------------------------------------------
Summary: Impala should determine Iceberg data file format from Iceberg metadata
Key: IMPALA-10569
URL: https://issues.apache.org/jira/browse/IMPALA-10569
Project: IMPALA
Issue Type: Bug
Reporter: Zoltán Borók-Nagy
When Impala creates an Iceberg table it sets HMS table property 'iceberg.file_format' to indicate the underlying data file format.
However, when the table was created by Hive or Spark, we don't have this property and Impala assumes that the data file format is PARQUET. This assumption is just a wild guess, and when it's wrong Impala raises an error during query execution.
Instead of only checking the table property, Impala could also try to determine the file format based on Iceberg metadata.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org