You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "Noémi Pap-Takács (Jira)" <ji...@apache.org> on 2025/05/07 09:40:00 UTC
[jira] [Assigned] (IMPALA-14013) DROP INCREMENTAL STATS throws NullPointerException for Iceberg tables
[ https://issues.apache.org/jira/browse/IMPALA-14013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Noémi Pap-Takács reassigned IMPALA-14013:
-----------------------------------------
Assignee: Dániel Gábor Vankó
> DROP INCREMENTAL STATS throws NullPointerException for Iceberg tables
> ---------------------------------------------------------------------
>
> Key: IMPALA-14013
> URL: https://issues.apache.org/jira/browse/IMPALA-14013
> Project: IMPALA
> Issue Type: Bug
> Components: Frontend
> Reporter: Noémi Pap-Takács
> Assignee: Dániel Gábor Vankó
> Priority: Major
> Labels: impala-iceberg, ramp-up
>
> Create the table and insert values so that there will be at least 1 partition
>
> {code:java}
> > create table ice_t (i int) partitioned by (j int, s string) stored by iceberg;
> > insert into ice_t select 20, 1, '2012'; {code}
>
> Compute incremental stats for the table.
> {code:java}
> > compute incremental stats ice_t;
> Query: compute incremental stats ice_t
> +-----------------------------------------+
> | summary |
> +-----------------------------------------+
> | Updated 1 partition(s) and 3 column(s). |
> +-----------------------------------------+
> Fetched 1 row(s) in 0.20s
> {code}
>
> We must specify the partition if we want to drop the incremental stats:
> {code:java}
> > drop incremental stats ice_t;
> [Exception] ERROR: Query bc41297c26b997b2:3c2750b400000000 failed:
> ParseException: Syntax error in line 1:
> drop incremental stats ice_t
> ^
> Encountered: EOF
> Expected: PARTITION
> CAUSED BY: Exception: Syntax error {code}
>
> Specifying the partition (correctly) produces a NullPointerException:
> {code:java}
> > drop incremental stats ice_t partition (j=1, s='2012');
> [Exception] ERROR: Query 2b4dcbe0b140a566:8844a7c600000000 failed: NullPointerException: null {code}
>
>
> The partitions of Iceberg tables are handled by the Iceberg library. Impala does not have an internal representation of them, it handles Iceberg tables as if they had only 1 HDFS partition, similarly to an unpartitioned HDFS table. This might explain why we get an exception.
> We should throw an AnalysisException with explanation if we cannot handle incremental stats for Iceberg tables.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org