You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@arrow.apache.org by "Joris Van den Bossche (Jira)" <ji...@apache.org> on 2021/04/28 07:53:00 UTC

[jira] [Commented] (ARROW-12576) [Python] Inferring cftime._cftime.DatetimeNoLeap raises ArrowInvalid

    [ https://issues.apache.org/jira/browse/ARROW-12576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17334532#comment-17334532 ] 

Joris Van den Bossche commented on ARROW-12576:
-----------------------------------------------

This is not supported (for timestamp, we currently only infer {{datetime.datetime}} or subclasses), so the error is to be expected. 

Given there are several other "datetime" implementations in Python, and we generally only support standard library types (+ numpy scalars) when inferring the type for a sequence of Python objects, I am wary of adding such support for cftime.

> [Python] Inferring cftime._cftime.DatetimeNoLeap raises ArrowInvalid
> --------------------------------------------------------------------
>
>                 Key: ARROW-12576
>                 URL: https://issues.apache.org/jira/browse/ARROW-12576
>             Project: Apache Arrow
>          Issue Type: Bug
>          Components: Python
>    Affects Versions: 3.0.0
>            Reporter: Javier
>            Priority: Blocker
>
> I have data loaded as DatetimeNoLeap that is not recognized by PyArrow.
> Should this be supported by Apache Arrow?
> This happens when I call pyarrow.array(data)
> {noformat}
> File "pyarrow/array.pxi", line 301, in pyarrow.lib.array 
> File "pyarrow/array.pxi", line 83, in pyarrow.lib._ndarray_to_array 
> File "pyarrow/error.pxi", line 84, in pyarrow.lib.check_status 
> pyarrow.lib.ArrowInvalid: Could not convert 2018-01-13 09:00:00 with type cftime._cftime.DatetimeNoLeap: did not recognize Python value type when inferring an Arrow data type
> {noformat}
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)