You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "Gergely Fürnstáhl (Jira)" <ji...@apache.org> on 2022/08/03 10:29:00 UTC

[jira] [Resolved] (IMPALA-11034) Resolve schema of old data files in migrated Iceberg tables

     [ https://issues.apache.org/jira/browse/IMPALA-11034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Gergely Fürnstáhl resolved IMPALA-11034.
----------------------------------------
    Fix Version/s: Impala 4.2.0
       Resolution: Fixed

> Resolve schema of old data files in migrated Iceberg tables
> -----------------------------------------------------------
>
>                 Key: IMPALA-11034
>                 URL: https://issues.apache.org/jira/browse/IMPALA-11034
>             Project: IMPALA
>          Issue Type: Bug
>            Reporter: Zoltán Borók-Nagy
>            Assignee: Gergely Fürnstáhl
>            Priority: Major
>              Labels: impala-iceberg
>             Fix For: Impala 4.2.0
>
>
> When external tables are converted to Iceberg, the data files remain intact.
> This means that the old data files don't have field id information which is essential for schema evolution.
> However, there is a workaround for this, see: [https://github.com/trinodb/trino/issues/9843]
> We need to create a NameMapping which maps field ids to column names, then we can do column resolution in the legacy files with the help of the name mapping.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org