You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "ASF subversion and git services (Jira)" <ji...@apache.org> on 2021/08/06 01:35:00 UTC

[jira] [Commented] (IMPALA-10739) Add support for ALTER TABLE tbl SET PARTITION SPEC for Iceberg tables

    [ https://issues.apache.org/jira/browse/IMPALA-10739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17394414#comment-17394414 ] 

ASF subversion and git services commented on IMPALA-10739:
----------------------------------------------------------

Commit 4fc42c379e767842e74e1664cc3a4aacb80da846 in impala's branch refs/heads/master from Attila Jeges
[ https://gitbox.apache.org/repos/asf?p=impala.git;h=4fc42c3 ]

IMPALA-10739: Support setting new partition spec for Iceberg tables

With this patch Impala will support partition evolution for
Iceberg tables.

The DDL statement to change the default partition spec is:
ALTER TABLE <tbl> SET PARTITION SPEC(<partition-spec>)

Hive uses the same SQL syntax.

Testing:
- Added FE test to exercise parsing various well-formed and ill-formed
  ALTER TABLE SET PARTITION SPEC statements.

- Added e2e tests for:
  - ALTER TABLE SET PARTITION SPEC works for tables with HadoopTables
    and HadoopCatalog Catalog.
  - When evolving partition spec, the old data written with an earlier
    spec remains unchanged. New data is written using the new spec in
    a new layout. Data written with earlier spec and new spec can be
    fetched in a single query.
  - Invalid ALTER TABLE SET PARTITION SPEC statements yield the
    expected analysis error messages.

Change-Id: I9bd935b8a82e977df9ee90d464b5fe2a7acc83f2
Reviewed-on: http://gerrit.cloudera.org:8080/17723
Reviewed-by: Impala Public Jenkins <im...@cloudera.com>
Tested-by: Impala Public Jenkins <im...@cloudera.com>


> Add support for ALTER TABLE tbl SET PARTITION SPEC for Iceberg tables
> ---------------------------------------------------------------------
>
>                 Key: IMPALA-10739
>                 URL: https://issues.apache.org/jira/browse/IMPALA-10739
>             Project: IMPALA
>          Issue Type: New Feature
>            Reporter: Zoltán Borók-Nagy
>            Assignee: Attila Jeges
>            Priority: Major
>              Labels: impala-iceberg
>
> Impala should support partition evolution for Iceberg tables, i.e. it should be able to set a new partition spec for an Iceberg table via DDL.
> The command should be
> {noformat}
> ALTER TABLE <tbl> SET PARTITION SPEC(<partition-spec>)
> {noformat}
> to be aligned with Hive.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org