You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "ASF subversion and git services (Jira)" <ji...@apache.org> on 2022/07/06 11:53:00 UTC
[jira] [Commented] (IMPALA-11320) SHOW PARTITIONS on Iceberg table doesn't list the partitions
[ https://issues.apache.org/jira/browse/IMPALA-11320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17563175#comment-17563175 ]
ASF subversion and git services commented on IMPALA-11320:
----------------------------------------------------------
Commit 4174ff5ea6a1b413a6218d26bbb7cf20809623cd in impala's branch refs/heads/master from gaoxq
[ https://gitbox.apache.org/repos/asf?p=impala.git;h=4174ff5ea ]
IMPALA-11320: SHOW PARTITIONS on Iceberg table doesn't list the partitions
Currently, SHOW PARTITIONS on Iceberg tables only outputs the partition
spec which is not too useful.
Instead it should output the concrete partitions, number of files, number
of rows in each partitions. E.g.:
SHOW PARTITIONS ice_ctas_hadoop_tables_part;
'{"d_month":"613"}',4,2
'{"d_month":"614"}',3,1
'{"d_month":"615"}',2,1
Testing:
- Added end-to-end test
Change-Id: I3b4399ae924dadb89875735b12a2f92453b6754c
Reviewed-on: http://gerrit.cloudera.org:8080/18641
Reviewed-by: Impala Public Jenkins <im...@cloudera.com>
Tested-by: Impala Public Jenkins <im...@cloudera.com>
> SHOW PARTITIONS on Iceberg table doesn't list the partitions
> ------------------------------------------------------------
>
> Key: IMPALA-11320
> URL: https://issues.apache.org/jira/browse/IMPALA-11320
> Project: IMPALA
> Issue Type: Bug
> Components: Frontend
> Reporter: Dharmik Thakkar
> Assignee: gaoxiaoqing
> Priority: Major
> Labels: impala-iceberg
>
> Currently, SHOW PARTITIONS on Iceberg tables only outputs the partition spec which is not too useful.
> E.g.:
>
> {noformat}
> [localhost:21050] default> create table ice_part (i int, j int) partitioned by spec (i, bucket(9, j)) stored as iceberg;
> ...
> [localhost:21050] default> show partitions ice_part;
> +--------------+-----------+----------+------------+---------------------------+
> | Partition Id | Source Id | Field Id | Field Name | Field Partition Transform |
> +--------------+-----------+----------+------------+---------------------------+
> | 0 | 1 | 1000 | i | IDENTITY |
> | 0 | 2 | 1001 | j_bucket | BUCKET 9 |
> +--------------+-----------+----------+------------+---------------------------+{noformat}
> Instead it should output the concrete partitions, number of files, number of rows in each partitions, similarly to Hive:
> [https://github.com/apache/hive/blob/34b24d55ade393673424f077b69add43bad9f731/iceberg/iceberg-handler/src/test/results/positive/query_iceberg_metadata_of_partitioned_table.q.out#L306-L316]
> {noformat}
> query: select * from default.ice_meta_3.partitions
> {"b":"four","c":"Saturday"} 3 1
> {"b":"four","c":"Sunday"} 1 1
> {"b":"four","c":"Thursday"} 1 1
> {"b":"one","c":"Monday"} 3 1
> {"b":"three","c":"Wednesday"} 3 1
> {"b":"two","c":"Friday"} 2 1
> {"b":"two","c":"Tuesday"} 2 1
> {noformat}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org