You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@impala.apache.org by "Zoltán Borók-Nagy (Jira)" <ji...@apache.org> on 2021/12/08 16:20:00 UTC

[jira] [Created] (IMPALA-11053) Impala should be able to read migrated partitioned Iceberg tables

Zoltán Borók-Nagy created IMPALA-11053:
------------------------------------------

             Summary: Impala should be able to read migrated partitioned Iceberg tables
                 Key: IMPALA-11053
                 URL: https://issues.apache.org/jira/browse/IMPALA-11053
             Project: IMPALA
          Issue Type: Bug
            Reporter: Zoltán Borók-Nagy


When Hive (and probably other engines as well) converts a legacy Hive table to Iceberg it doesn't rewrite the data files.

It means that the data files don't have write ids, moreover they don't have the partition columns neither.

Currently Impala expects tha partition columns to be present in the data files, so it won't be able to read converted partitioned tables.

So we need to inject partition values from the Iceberg metadata, plus resolve columns correctly (position-based resolution needs an offset).



--
This message was sent by Atlassian Jira
(v8.20.1#820001)