You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@arrow.apache.org by "Wes McKinney (JIRA)" <ji...@apache.org> on 2017/07/16 23:48:00 UTC
[jira] [Commented] (ARROW-1120) [Python] Write support for int96
[ https://issues.apache.org/jira/browse/ARROW-1120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16089189#comment-16089189 ]
Wes McKinney commented on ARROW-1120:
-------------------------------------
Support for writing deprecated int96 timestamps landed in parquet-cpp today (thanks Colin and Uwe!) https://github.com/apache/parquet-cpp/commit/e998dfb40403197dbb8efa53d077449c81552d26, so we should be able to thread this option through to the Python API without _too_ much work. I will take a look hopefully soon
> [Python] Write support for int96
> --------------------------------
>
> Key: ARROW-1120
> URL: https://issues.apache.org/jira/browse/ARROW-1120
> Project: Apache Arrow
> Issue Type: Improvement
> Components: Python
> Reporter: colin nichols
> Fix For: 0.5.0
>
>
> Hi there,
> I am trying to use pyarrow to convert CSV files to Parquet for use with Redshift Spectrum. I've got everything sorted... almost :)
> Unfortunately, the only format they accept for timestamp columns is int96. I understand that int96 timestamps are unofficial/deprecated, but unfortunately it's what I am stuck with for integrating with, at least for the moment. I contacted Amazon support and 64-bit timestamp support has been added to the list of feature requests, but it's unclear when it will be prioritized/added/released.
> In the meantime, I am thinking of adding write support for int96 columns to arrow. Would that be a welcome addition?
> Thanks,
> Colin
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)