You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2022/04/29 11:10:00 UTC
[jira] [Work logged] (HIVE-26189) Iceberg metadata query throws exceptions after partition evolution
[ https://issues.apache.org/jira/browse/HIVE-26189?focusedWorklogId=764153&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-764153 ]
ASF GitHub Bot logged work on HIVE-26189:
-----------------------------------------
Author: ASF GitHub Bot
Created on: 29/Apr/22 11:09
Start Date: 29/Apr/22 11:09
Worklog Time Spent: 10m
Work Description: szlta opened a new pull request, #3258:
URL: https://github.com/apache/hive/pull/3258
The following test case surfaced two issues with metadata table queries:
```
CREATE EXTERNAL TABLE `partevv`( `id` int, `ts` timestamp, `ts2` timestamp) STORED BY ICEBERG STORED AS ORC TBLPROPERTIES ('format-version'='1');
ALTER TABLE partevv SET PARTITION SPEC (id);
INSERT INTO partevv VALUES (1, current_timestamp(), current_timestamp());
INSERT INTO partevv VALUES (2, current_timestamp(), current_timestamp());
ALTER TABLE partevv SET PARTITION SPEC (day(ts));
INSERT INTO partevv VALUES (100, current_timestamp(), current_timestamp());
select * from default.partevv.partitions;
```
- NPE for removed partition columns from new specs:
```
Caused by: java.lang.NullPointerException
at org.apache.iceberg.mr.mapreduce.IcebergInternalRecordWrapper.lambda$converter$5(IcebergInternalRecordWrapper.java:147)
```
- ClassCastException for day partition transforms
```
java.lang.ClassCastException: java.lang.Integer cannot be cast to java.time.LocalDate
```
Issue Time Tracking
-------------------
Worklog Id: (was: 764153)
Remaining Estimate: 0h
Time Spent: 10m
> Iceberg metadata query throws exceptions after partition evolution
> ------------------------------------------------------------------
>
> Key: HIVE-26189
> URL: https://issues.apache.org/jira/browse/HIVE-26189
> Project: Hive
> Issue Type: Bug
> Reporter: Ádám Szita
> Assignee: Ádám Szita
> Priority: Major
> Time Spent: 10m
> Remaining Estimate: 0h
>
> The following test case surfaced two issues with metadata table queries:
> {code:java}
> CREATE EXTERNAL TABLE `partevv`( `id` int, `ts` timestamp, `ts2` timestamp) STORED BY ICEBERG STORED AS ORC TBLPROPERTIES ('format-version'='1');
> ALTER TABLE partevv SET PARTITION SPEC (id);
> INSERT INTO partevv VALUES (1, current_timestamp(), current_timestamp());
> INSERT INTO partevv VALUES (2, current_timestamp(), current_timestamp());
> ALTER TABLE partevv SET PARTITION SPEC (day(ts));
> INSERT INTO partevv VALUES (100, current_timestamp(), current_timestamp());
> select * from default.partevv.partitions; {code}
> * NPE for removed partition columns from new specs:
> {code:java}
> Caused by: java.lang.NullPointerException
> at org.apache.iceberg.mr.mapreduce.IcebergInternalRecordWrapper.lambda$converter$5(IcebergInternalRecordWrapper.java:147) {code}
> * ClassCastException for day partition transforms
> {code:java}
> java.lang.ClassCastException: java.lang.Integer cannot be cast to java.time.LocalDate {code}
--
This message was sent by Atlassian Jira
(v8.20.7#820007)