[jira] [Updated] (IMPALA-11534) Skip reloading file metadata for some ALTER_TABLE events

["Sai Hemanth Gantasala (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/IMPALA-11534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Sai Hemanth Gantasala updated IMPALA-11534:
-------------------------------------------
    Affects Version/s: Impala 4.3.0

> Skip reloading file metadata for some ALTER_TABLE events
> --------------------------------------------------------
>
>                 Key: IMPALA-11534
>                 URL: https://issues.apache.org/jira/browse/IMPALA-11534
>             Project: IMPALA
>          Issue Type: Improvement
>          Components: Catalog
>    Affects Versions: Impala 4.3.0
>            Reporter: Quanlong Huang
>            Assignee: Sai Hemanth Gantasala
>            Priority: Critical
>             Fix For: Impala 4.3.0
>
>
> EventProcessor will ignore trivial ALTER_TABLE events that only modify tblproperties like "transient_lastDdlTime", "totalSize", "numFilesErasureCoded", and "numFiles" (IMPALA-8579). For other kinds of non-rename ALTER_TABLE events, it will trigger a full refresh on the table, which is expensive when there are tens of thousands of partitions.
> We can actually skip reloading file metadata for some ALTER_TABLE events, e.g. events that
>  * changing table comment
>  * adding/dropping columns
>  * changing column definition (name/type/comment)
>  * changing ownership
>  * setting customized tblproperties



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org