You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@arrow.apache.org by "Wes McKinney (JIRA)" <ji...@apache.org> on 2018/10/01 10:09:02 UTC

[jira] [Resolved] (ARROW-2555) [Python] Provide an option to convert on coerce_timestamps instead of error

     [ https://issues.apache.org/jira/browse/ARROW-2555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Wes McKinney resolved ARROW-2555.
---------------------------------
    Resolution: Fixed

Issue resolved by pull request 2629
[https://github.com/apache/arrow/pull/2629]

> [Python] Provide an option to convert on coerce_timestamps instead of error
> ---------------------------------------------------------------------------
>
>                 Key: ARROW-2555
>                 URL: https://issues.apache.org/jira/browse/ARROW-2555
>             Project: Apache Arrow
>          Issue Type: Improvement
>          Components: Python
>            Reporter: Uwe L. Korn
>            Assignee: Eric Conlon
>            Priority: Major
>              Labels: pull-request-available
>             Fix For: 0.11.0
>
>          Time Spent: 3h
>  Remaining Estimate: 0h
>
> At the moment, we error out on {{coerce_timestamps='ms'}} on {{pyarrow.parquet.write_table}} if the data contains a timestamp that would loose information when converted to milliseconds. In a lot of cases the user does not care about this granularity and rather wants the comfort functionality that the timestamp are stored regardlessly in Parquet. Thus we should provide an option to ignore the error and do the lossy conversion.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)