You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@hive.apache.org by "Karen Coppage (JIRA)" <ji...@apache.org> on 2019/02/05 15:00:00 UTC

[jira] [Created] (HIVE-21216) Write Parquet INT64 timestamp

Karen Coppage created HIVE-21216:
------------------------------------

             Summary: Write Parquet INT64 timestamp
                 Key: HIVE-21216
                 URL: https://issues.apache.org/jira/browse/HIVE-21216
             Project: Hive
          Issue Type: New Feature
          Components: Hive
            Reporter: Karen Coppage
            Assignee: Karen Coppage


[WIP]
This patch enables Hive to start writing int64 timestamps in Parquet.

With Parquet version 1.11, a new timestamp LogicalType with base INT64 and the following metadata is introduced:
boolean isAdjustedToUtc: marks whether the timestamp is converted to UTC (aka Instant semantics) or not (LocalDateTime semantics)
enum TimeUnit (NANOS, MICROS, MILLIS): granularity of timestamp

The timestamp will have LocalDateTime semantics (not converted to UTC).
Time unit (granularity) will be determined by the user. Default is milliseconds.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)