You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@hive.apache.org by "Karen Coppage (JIRA)" <ji...@apache.org> on 2019/02/05 14:59:00 UTC

[jira] [Created] (HIVE-21215) Read Parquet INT64 timestamp

Karen Coppage created HIVE-21215:
------------------------------------

             Summary: Read Parquet INT64 timestamp
                 Key: HIVE-21215
                 URL: https://issues.apache.org/jira/browse/HIVE-21215
             Project: Hive
          Issue Type: New Feature
            Reporter: Karen Coppage
            Assignee: Marta Kuczora


[WIP]
This patch enables Hive to start reading timestamps from Parquet written with the new semantics:

With Parquet version 1.11, a new timestamp LogicalType with base INT64 and the following metadata is introduced:
* boolean isAdjustedToUtc: marks whether the timestamp is converted to UTC (aka Instant semantics) or not (LocalDateTime semantics).
* enum TimeUnit (NANOS, MICROS, MILLIS): granularity of timestamp

Upon reading, the semantics of these new timestamps will be determined by their metadata, while the semantics of INT96 timestamps will continue to be deduced from the writer metadata.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)