You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "Zoltán Borók-Nagy (Jira)" <ji...@apache.org> on 2022/07/12 14:07:00 UTC

[jira] [Commented] (IMPALA-11003) Disallow schema evolution for migrated Iceberg tables

    [ https://issues.apache.org/jira/browse/IMPALA-11003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17565855#comment-17565855 ] 

Zoltán Borók-Nagy commented on IMPALA-11003:
--------------------------------------------

[~LiPenglin] once IMPALA-11034 is in we don't need to disallow schema evolution. And it seems like it is close to completeness:
http://gerrit.cloudera.org/#/c/18639/

> Disallow schema evolution for migrated Iceberg tables
> -----------------------------------------------------
>
>                 Key: IMPALA-11003
>                 URL: https://issues.apache.org/jira/browse/IMPALA-11003
>             Project: IMPALA
>          Issue Type: Bug
>          Components: Frontend
>            Reporter: Zoltán Borók-Nagy
>            Assignee: LiPenglin
>            Priority: Major
>              Labels: impala-iceberg
>
> When external tables are converted to Iceberg, the data files remain intact.
> This means that the old data files don't have field id information which is essential for schema evolution.
> Migrated tables are tagged with table property "MIGRATED_TO_ICEBERG". See https://github.com/apache/hive/pull/2744/files
> Hive disallows some schema changing operations, e.g. "replace col" and "change col". See HIVE-25643.
> Impala should also disallow delete column / change column. ADD COLUMN should be fine.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org