You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "Sai Hemanth Gantasala (Jira)" <ji...@apache.org> on 2023/06/26 17:43:00 UTC
[jira] [Resolved] (IMPALA-11534) Skip reloading file metadata for some ALTER_TABLE events
[ https://issues.apache.org/jira/browse/IMPALA-11534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Sai Hemanth Gantasala resolved IMPALA-11534.
--------------------------------------------
Fix Version/s: Impala 4.3.0
Resolution: Fixed
> Skip reloading file metadata for some ALTER_TABLE events
> --------------------------------------------------------
>
> Key: IMPALA-11534
> URL: https://issues.apache.org/jira/browse/IMPALA-11534
> Project: IMPALA
> Issue Type: Improvement
> Components: Catalog
> Reporter: Quanlong Huang
> Assignee: Sai Hemanth Gantasala
> Priority: Critical
> Fix For: Impala 4.3.0
>
>
> EventProcessor will ignore trivial ALTER_TABLE events that only modify tblproperties like "transient_lastDdlTime", "totalSize", "numFilesErasureCoded", and "numFiles" (IMPALA-8579). For other kinds of non-rename ALTER_TABLE events, it will trigger a full refresh on the table, which is expensive when there are tens of thousands of partitions.
> We can actually skip reloading file metadata for some ALTER_TABLE events, e.g. events that
> * changing table comment
> * adding/dropping columns
> * changing column definition (name/type/comment)
> * changing ownership
> * setting customized tblproperties
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org