You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@arrow.apache.org by "Joris Van den Bossche (Jira)" <ji...@apache.org> on 2021/04/28 07:53:00 UTC
[jira] [Commented] (ARROW-12576) [Python] Inferring
cftime._cftime.DatetimeNoLeap raises ArrowInvalid
[ https://issues.apache.org/jira/browse/ARROW-12576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17334532#comment-17334532 ]
Joris Van den Bossche commented on ARROW-12576:
-----------------------------------------------
This is not supported (for timestamp, we currently only infer {{datetime.datetime}} or subclasses), so the error is to be expected.
Given there are several other "datetime" implementations in Python, and we generally only support standard library types (+ numpy scalars) when inferring the type for a sequence of Python objects, I am wary of adding such support for cftime.
> [Python] Inferring cftime._cftime.DatetimeNoLeap raises ArrowInvalid
> --------------------------------------------------------------------
>
> Key: ARROW-12576
> URL: https://issues.apache.org/jira/browse/ARROW-12576
> Project: Apache Arrow
> Issue Type: Bug
> Components: Python
> Affects Versions: 3.0.0
> Reporter: Javier
> Priority: Blocker
>
> I have data loaded as DatetimeNoLeap that is not recognized by PyArrow.
> Should this be supported by Apache Arrow?
> This happens when I call pyarrow.array(data)
> {noformat}
> File "pyarrow/array.pxi", line 301, in pyarrow.lib.array
> File "pyarrow/array.pxi", line 83, in pyarrow.lib._ndarray_to_array
> File "pyarrow/error.pxi", line 84, in pyarrow.lib.check_status
> pyarrow.lib.ArrowInvalid: Could not convert 2018-01-13 09:00:00 with type cftime._cftime.DatetimeNoLeap: did not recognize Python value type when inferring an Arrow data type
> {noformat}
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)