You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "Zoltán Borók-Nagy (Jira)" <ji...@apache.org> on 2021/08/05 16:12:00 UTC

[jira] [Resolved] (IMPALA-10732) Use consistent DDL for specifying Iceberg partitions

     [ https://issues.apache.org/jira/browse/IMPALA-10732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Zoltán Borók-Nagy resolved IMPALA-10732.
----------------------------------------
    Fix Version/s: Impala 4.1.0
       Resolution: Fixed

> Use consistent DDL for specifying Iceberg partitions
> ----------------------------------------------------
>
>                 Key: IMPALA-10732
>                 URL: https://issues.apache.org/jira/browse/IMPALA-10732
>             Project: IMPALA
>          Issue Type: Bug
>            Reporter: Zoltán Borók-Nagy
>            Assignee: Zoltán Borók-Nagy
>            Priority: Major
>              Labels: impala-iceberg
>             Fix For: Impala 4.1.0
>
>
> Currently we have a DDL syntax for defining Iceberg partitions that differs from SparkSQL:
>  [https://iceberg.apache.org/spark-ddl/#partitioned-by]
>   
>  E.g. Impala is using the following syntax:
>   
>  CREATE TABLE ice_t (i int, s string, ts timestamp, d date)
> *PARTITION BY SPEC (i BUCKET 5, ts MONTH, d YEAR)*
> STORED AS ICEBERG;
>  The same in Spark is:
>  CREATE TABLE ice_t (i int, s string, ts timestamp, d date)
> USING ICEBERG
> *PARTITIONED BY (bucket(5, i), months(ts), years(d))*
>   
>  Impala's syntax is older but hasn't been released yet. Spark's syntax is released so it cannot be changed.
>   
>  Hive is also working on DDL support for Iceberg partitions, and they are favoring the released SparkSQL syntax. See HIVE-25179
>   
>  After dicsussing it on dev@impala we decided to use SparkSQL's syntax.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org