You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "Manish Maheshwari (Jira)" <ji...@apache.org> on 2023/03/06 11:55:00 UTC
[jira] [Updated] (IMPALA-11971) Simple syntax to Compact and Overwrite Iceberg Tables and Partitions
[ https://issues.apache.org/jira/browse/IMPALA-11971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Manish Maheshwari updated IMPALA-11971:
---------------------------------------
Labels: impala-iceberg (was: )
> Simple syntax to Compact and Overwrite Iceberg Tables and Partitions
> --------------------------------------------------------------------
>
> Key: IMPALA-11971
> URL: https://issues.apache.org/jira/browse/IMPALA-11971
> Project: IMPALA
> Issue Type: New Feature
> Components: Frontend
> Reporter: Manish Maheshwari
> Priority: Major
> Labels: impala-iceberg
>
> Impala supports overwriting iceberg tables. Overwriting iceberg tables / partitions can be used as an effective way to
> * compact small files
> * rewrite partitions according to latest spec
> * merge deltas due to deletes and updates (if any) due to Merge-on-read strategy
> * delete orphan files in table/partition
> Doing all of this as part of an overwrite partition is not intuitive. We should support a syntax verb like `compact` or `consolidate` or `tune` to do these operations
> {code:java}
> alter table compact table;
> alter table compact table partition <>;
> alter table compact table partition <>;{code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org