You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "Zoltán Borók-Nagy (Jira)" <ji...@apache.org> on 2021/03/09 13:48:00 UTC

[jira] [Created] (IMPALA-10569) Impala should determine Iceberg data file format from Iceberg metadata

Zoltán Borók-Nagy created IMPALA-10569:
------------------------------------------

             Summary: Impala should determine Iceberg data file format from Iceberg metadata
                 Key: IMPALA-10569
                 URL: https://issues.apache.org/jira/browse/IMPALA-10569
             Project: IMPALA
          Issue Type: Bug
            Reporter: Zoltán Borók-Nagy


When Impala creates an Iceberg table it sets HMS table property 'iceberg.file_format' to indicate the underlying data file format.

However, when the table was created by Hive or Spark, we don't have this property and Impala assumes that the data file format is PARQUET. This assumption is just a wild guess, and when it's wrong Impala raises an error during query execution.

Instead of only checking the table property, Impala could also try to determine the file format based on Iceberg metadata.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org