You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@parquet.apache.org by "Ryan Blue (JIRA)" <ji...@apache.org> on 2015/06/16 18:58:00 UTC

[jira] [Resolved] (PARQUET-200) Add microsecond time and timestamp annotations

     [ https://issues.apache.org/jira/browse/PARQUET-200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Ryan Blue resolved PARQUET-200.
-------------------------------
    Resolution: Fixed

> Add microsecond time and timestamp annotations
> ----------------------------------------------
>
>                 Key: PARQUET-200
>                 URL: https://issues.apache.org/jira/browse/PARQUET-200
>             Project: Parquet
>          Issue Type: Improvement
>          Components: parquet-format
>            Reporter: Ryan Blue
>            Assignee: Ryan Blue
>
> When the date/time type annotations were added, we decided not to add precisions smaller than milliseconds because there wasn't a clear requirement. I think that the requirement is for nanosecond precision. The SQL spec requires at least microsecond. Some databases support nanosecond, including SQL engines on Hadoop like Phoenix. Hive and Impala currently support nanosecond times using an int96, but intend to move to microsecond precision with this spec.
> I propose adding the following type annotations:
> * {{TIME_MICROS}}: annotates an int64 (8 bytes), represents the number of microseconds from midnight.
> * {{TIMESTAMP_MICROS}}: annotates an int64 (8 bytes), represents the number of microseconds from the unix epoch.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)