You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "Noemi Pap-Takacs (Jira)" <ji...@apache.org> on 2024/03/04 13:50:00 UTC
[jira] [Resolved] (IMPALA-12412) Support partition evolution in OPTIMIZE statement
[ https://issues.apache.org/jira/browse/IMPALA-12412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Noemi Pap-Takacs resolved IMPALA-12412.
---------------------------------------
Resolution: Fixed
> Support partition evolution in OPTIMIZE statement
> -------------------------------------------------
>
> Key: IMPALA-12412
> URL: https://issues.apache.org/jira/browse/IMPALA-12412
> Project: IMPALA
> Issue Type: Sub-task
> Components: Frontend
> Reporter: Noemi Pap-Takacs
> Assignee: Noemi Pap-Takacs
> Priority: Major
> Labels: impala-iceberg
>
> OPTIMIZE TABLE statement currently uses INSERT OVERWRITE to rewrite Iceberg tables. Therefore it inherits its limitations as well, such as the inability to rewrite tables with partition evolution.
> This change aims to increase the support OPTIMIZE TABLE provides, by making it independent from INSERT statment. After the refactoring, OPTIMIZE TABLE statement will be able to:
> * rewrite all files in Iceberg tables according to the latest partition spec
> * compact tables with partition evolution
> This change also serves as a base for further improvements.
> {code:java}
> Syntax: OPTIMIZE TABLE <table_name>;{code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org