[jira] [Assigned] (IMPALA-11971) Simple syntax to Compact, RePartition, Clean Orphans etc for Iceberg Tables

["Noemi Pap-Takacs (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/IMPALA-11971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Noemi Pap-Takacs reassigned IMPALA-11971:
-----------------------------------------

    Assignee:     (was: Noemi Pap-Takacs)

> Simple syntax to Compact, RePartition, Clean Orphans etc for Iceberg Tables
> ---------------------------------------------------------------------------
>
>                 Key: IMPALA-11971
>                 URL: https://issues.apache.org/jira/browse/IMPALA-11971
>             Project: IMPALA
>          Issue Type: Epic
>          Components: Frontend
>            Reporter: Manish Maheshwari
>            Priority: Major
>              Labels: impala-iceberg
>
> Impala supports overwriting iceberg tables. Overwriting iceberg tables / partitions can be used as an cheap way to implement the below without the user having to run spark jobs
>  * compact small files
>  * rewrite partitions according to latest spec
>  * merge deltas due to deletes and updates (if any) due to Merge-on-read strategy
>  * delete orphan files in table/partition
> Doing all of this as part of an overwrite partition is not intuitive. We should support a syntax verb like `compact` or `consolidate` or `tune` to do these operations 
> {code:java}
> alter table compact table;
> alter table compact table partition <>;
> alter table compact table partition <>;{code}



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org