You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@arrow.apache.org by "Wes McKinney (JIRA)" <ji...@apache.org> on 2017/07/16 23:48:00 UTC

[jira] [Commented] (ARROW-1120) [Python] Write support for int96

    [ https://issues.apache.org/jira/browse/ARROW-1120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16089189#comment-16089189 ] 

Wes McKinney commented on ARROW-1120:
-------------------------------------

Support for writing deprecated int96 timestamps landed in parquet-cpp today (thanks Colin and Uwe!) https://github.com/apache/parquet-cpp/commit/e998dfb40403197dbb8efa53d077449c81552d26, so we should be able to thread this option through to the Python API without _too_ much work. I will take a look hopefully soon

> [Python] Write support for int96
> --------------------------------
>
>                 Key: ARROW-1120
>                 URL: https://issues.apache.org/jira/browse/ARROW-1120
>             Project: Apache Arrow
>          Issue Type: Improvement
>          Components: Python
>            Reporter: colin nichols
>             Fix For: 0.5.0
>
>
> Hi there,
> I am trying to use pyarrow to convert CSV files to Parquet for use with Redshift Spectrum.  I've got everything sorted... almost :)
> Unfortunately, the only format they accept for timestamp columns is int96.  I understand that int96 timestamps are unofficial/deprecated, but unfortunately it's what I am stuck with for integrating with, at least for the moment.  I contacted Amazon support and 64-bit timestamp support has been added to the list of feature requests, but it's unclear when it will be prioritized/added/released.
> In the meantime, I am thinking of adding write support for int96 columns to arrow.  Would that be a welcome addition?
> Thanks,
> Colin



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)