[jira] [Assigned] (ARROW-5888) [Python][C++] Add metadata to store Arrow time zones in Parquet file metadata

["Wes McKinney (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/ARROW-5888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Wes McKinney reassigned ARROW-5888:
-----------------------------------

    Assignee: Wes McKinney

> [Python][C++] Add metadata to store Arrow time zones in Parquet file metadata
> -----------------------------------------------------------------------------
>
>                 Key: ARROW-5888
>                 URL: https://issues.apache.org/jira/browse/ARROW-5888
>             Project: Apache Arrow
>          Issue Type: Improvement
>          Components: C++, Python
>            Reporter: Florian Jetter
>            Assignee: Wes McKinney
>            Priority: Minor
>              Labels: parquet, pull-request-available
>             Fix For: 0.15.0
>
>          Time Spent: 40m
>  Remaining Estimate: 0h
>
> The timezone is not roundtrip safe for timezones other than UTC when storing to parquet. Expected behavior would be that the timezone is properly reconstructed
> {code:python}
> schema = pa.schema(
>     [
>         pa.field("no_tz", pa.timestamp('us')),
>         pa.field("no_tz", pa.timestamp('us', tz="UTC")),
>         pa.field("no_tz", pa.timestamp('us', tz="Europe/Berlin")),
> ]
> )
> buf = pa.BufferOutputStream()
> pq.write_metadata(
>     schema,
>     buf,
>     coerce_timestamps="us"
> )
> pq_bytes = buf.getvalue().to_pybytes()
> reader = pa.BufferReader(pq_bytes)
> parquet_file = pq.ParquetFile(reader)
> parquet_file.schema.to_arrow_schema()
> # Output:
> # no_tz: timestamp[us]
> # utc: timestamp[us, tz=UTC]
> # europe: timestamp[us, tz=UTC]
> {code}



--
This message was sent by Atlassian Jira
(v8.3.2#803003)