You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "Ethan Guo (Jira)" <ji...@apache.org> on 2024/06/11 01:31:01 UTC
[jira] [Updated] (HUDI-7554) HiveAvroSerializer breaks compatibility between Hive2 an Hive3
[ https://issues.apache.org/jira/browse/HUDI-7554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ethan Guo updated HUDI-7554:
----------------------------
Fix Version/s: 0.16.0
> HiveAvroSerializer breaks compatibility between Hive2 an Hive3
> --------------------------------------------------------------
>
> Key: HUDI-7554
> URL: https://issues.apache.org/jira/browse/HUDI-7554
> Project: Apache Hudi
> Issue Type: Sub-task
> Reporter: Sagar Sumit
> Priority: Major
> Fix For: 0.15.0, 0.16.0
>
>
> {code:java}
> java.lang.NoSuchMethodError: 'java.sql.Timestamp org.apache.hadoop.hive.serde2.objectinspector.primitive.WritableTimestampObjectInspector.getPrimitiveJavaObject(java.lang.Object)'
> at org.apache.hudi.hadoop.utils.HiveAvroSerializer.serializePrimitive(HiveAvroSerializer.java:305)
> at org.apache.hudi.hadoop.utils.HiveAvroSerializer.serialize(HiveAvroSerializer.java:212)
> at org.apache.hudi.hadoop.utils.HiveAvroSerializer.setUpRecordFieldFromWritable(HiveAvroSerializer.java:121)
> at org.apache.hudi.hadoop.utils.HiveAvroSerializer.serialize(HiveAvroSerializer.java:108)
> at org.apache.hudi.hadoop.realtime.RealtimeCompactedRecordReader.convertArrayWritableToHoodieRecord(RealtimeCompactedRecordReader.java:198)
> at org.apache.hudi.hadoop.realtime.RealtimeCompactedRecordReader.mergeRecord(RealtimeCompactedRecordReader.java:183)
> at org.apache.hudi.hadoop.realtime.RealtimeCompactedRecordReader.next(RealtimeCompactedRecordReader.java:123)
> at org.apache.hudi.hadoop.realtime.RealtimeCompactedRecordReader.next(RealtimeCompactedRecordReader.java:53)
> at org.apache.hudi.hadoop.realtime.HoodieRealtimeRecordReader.next(HoodieRealtimeRecordReader.java:86)
> at org.apache.hudi.hadoop.realtime.HoodieRealtimeRecordReader.next(HoodieRealtimeRecordReader.java:36)
> at io.trino.plugin.hive.GenericHiveRecordCursor.advanceNextPosition(GenericHiveRecordCursor.java:221)
> at io.trino.plugin.hive.util.ForwardingRecordCursor.advanceNextPosition(ForwardingRecordCursor.java:46)
> at io.trino.spi.connector.RecordPageSource.getNextPage(RecordPageSource.java:88) {code}
> Inspected the Hive code for `WritableTimestampObjectInspector` class and the return type for one of the methods changed from `java.sql.Timestamp` to `org.apache.hadoop.hive.common.type.Timestamp` in Hive 3.1. While Hudi code is still running with Hive 2.3.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)