You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Stamatis Zampetakis (Jira)" <ji...@apache.org> on 2022/10/21 09:56:00 UTC

[jira] [Commented] (HIVE-23345) INT64 Parquet timestamps cannot be read into bigint Hive type

    [ https://issues.apache.org/jira/browse/HIVE-23345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17622162#comment-17622162 ] 

Stamatis Zampetakis commented on HIVE-23345:
--------------------------------------------

This ticket requires HIVE-26612 to successfully treat Parquet Timestamp conversion to BIGINT. 

Although this ticket claims to have addressed the problem for INT64 timestamps in reality it only addressed the INT96 timestamp datatype. The INT64 timestamp to BIGINT was actually fixed in HIVE-26612.

> INT64 Parquet timestamps cannot be read into bigint Hive type
> -------------------------------------------------------------
>
>                 Key: HIVE-23345
>                 URL: https://issues.apache.org/jira/browse/HIVE-23345
>             Project: Hive
>          Issue Type: Bug
>    Affects Versions: 4.0.0
>            Reporter: Marta Kuczora
>            Assignee: Panagiotis Garefalakis
>            Priority: Major
>              Labels: pull-request-available
>             Fix For: 4.0.0-alpha-1
>
>         Attachments: HIVE-23345.01.patch
>
>          Time Spent: 20m
>  Remaining Estimate: 0h
>
> How to reproduce:
> - create external table ts_pq (ts timestamp) stored as parquet;
> - insert into ts_pq values ('1998-10-03 09:58:31.231');
> - create external table ts_pq_2 (ts bigint) stored as parquet location '<location of ts_pq>';
> - select * from ts_pq_2;
> The following exception occurs during the select:
> Failed with exception java.io.IOException:org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassCastException: org.apache.hadoop.hive.serde2.io.TimestampWritableV2 cannot be cast to org.apache.hadoop.io.LongWritable



--
This message was sent by Atlassian Jira
(v8.20.10#820010)