You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2025/04/06 13:26:00 UTC
[jira] [Updated] (HIVE-28765) Iceberg: Incorrect partition statistics on time travel + partition evolution
[ https://issues.apache.org/jira/browse/HIVE-28765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
ASF GitHub Bot updated HIVE-28765:
----------------------------------
Labels: pull-request-available (was: )
> Iceberg: Incorrect partition statistics on time travel + partition evolution
> ----------------------------------------------------------------------------
>
> Key: HIVE-28765
> URL: https://issues.apache.org/jira/browse/HIVE-28765
> Project: Hive
> Issue Type: Bug
> Components: Iceberg integration
> Reporter: Shohei Okumiya
> Assignee: Shohei Okumiya
> Priority: Major
> Labels: pull-request-available
>
> HiveIcebergStorageHandler fails to fetch stats of evolved partitions. It triggers schema and FS level stats estimation as a fallback and results in unreasonable counts.
> {code:java}
> CREATE TABLE test (key INT, id INT) PARTITIONED BY SPEC (bucket(4, key)) STORED BY ICEBERG;
> INSERT INTO test VALUES (1, 1), (2, 2), (3, 3), (4, 4);
> ALTER TABLE test CREATE TAG version1;ALTER TABLE test SET PARTITION SPEC (bucket(256, key));
> INSERT INTO test VALUES (1, 5), (2, 6), (3, 7), (4, 8);
> ALTER TABLE test CREATE TAG version2;SET hive.fetch.task.conversion=none;
> EXPLAIN SELECT * FROM default.test.tag_version1;
> +----------------------------------------------------+
> | Explain |
> +----------------------------------------------------+
> | Plan optimized by CBO. |
> | |
> | Stage-0 |
> | Fetch Operator |
> | limit:-1 |
> | Stage-1 |
> | Map 1 vectorized |
> | File Output Operator [FS_4] |
> | Select Operator [SEL_3] (rows=12940 width=8) |
> | Output:["_col0","_col1"] |
> | TableScan [TS_0] (rows=12940 width=8) |
> | default@test,test,Tbl:PARTIAL,Col:COMPLETE,Output:["key","id"] |
> | |
> +----------------------------------------------------+{code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)