You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "Noemi Pap-Takacs (Jira)" <ji...@apache.org> on 2022/11/07 15:26:00 UTC
[jira] [Updated] (IMPALA-11710) Table properties are not updated in Iceberg metadata files
[ https://issues.apache.org/jira/browse/IMPALA-11710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Noemi Pap-Takacs updated IMPALA-11710:
--------------------------------------
Description:
This issue occurs in true external Hive Catalog tables.
Iceberg stores the default file format in a table property called 'write.format.default'. HMS also stores this value loaded from the Iceberg metadata json file.
However, when this table property is altered through Impala, it is only changed in HMS, but does not update the Iceberg snapshot. When the table data is reloaded from Iceberg metadata, the old value will appear in HMS and the change is lost.
This bug does not affect table properties that are not stored in Iceberg, because they will not be reloaded.
was:
Iceberg stores the default file format in a table property called 'write.format.default'. HMS also stores this value loaded from the Iceberg metadata json file.
However, when this table property is altered through Impala, it is only changed in HMS, but does not update the Iceberg snapshot. When the table data is reloaded from Iceberg metadata, the old value will appear in HMS and the change is lost.
This bug does not affect table properties that are not stored in Iceberg, because they will not be reloaded.
> Table properties are not updated in Iceberg metadata files
> ----------------------------------------------------------
>
> Key: IMPALA-11710
> URL: https://issues.apache.org/jira/browse/IMPALA-11710
> Project: IMPALA
> Issue Type: Bug
> Reporter: Noemi Pap-Takacs
> Priority: Major
> Labels: impala-iceberg
>
> This issue occurs in true external Hive Catalog tables.
> Iceberg stores the default file format in a table property called 'write.format.default'. HMS also stores this value loaded from the Iceberg metadata json file.
> However, when this table property is altered through Impala, it is only changed in HMS, but does not update the Iceberg snapshot. When the table data is reloaded from Iceberg metadata, the old value will appear in HMS and the change is lost.
> This bug does not affect table properties that are not stored in Iceberg, because they will not be reloaded.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org