[jira] [Created] (ARROW-15026) datetime.timedelta to pyarrow.duration('us') silently overflows

["Andreas Rappold (Jira)" <ji...@apache.org>]

Andreas Rappold created ARROW-15026:
---------------------------------------

             Summary: datetime.timedelta to pyarrow.duration('us') silently overflows
                 Key: ARROW-15026
                 URL: https://issues.apache.org/jira/browse/ARROW-15026
             Project: Apache Arrow
          Issue Type: Bug
          Components: Python
            Reporter: Andreas Rappold


 

Hi! This reproduces the issue:
{code:java}
# python 3.9.9
# pyarrow 6.0.1
import datetime
import pyarrow
d = datetime.timedelta(days=-106751992, seconds=71945, microseconds=224192)
pyarrow.scalar(d)
# <pyarrow.DurationScalar: datetime.timedelta(days=-106751992, seconds=71945, microseconds=224192)>
pyarrow.scalar(d).as_py() == d
# True
d2 = d - datetime.timedelta(microseconds=1)
pyarrow.scalar(d2)
# <pyarrow.DurationScalar: datetime.timedelta(days=106751991, seconds=14454, microseconds=775807)>
pyarrow.scalar(d2).as_py() == d2
# False{code}
Other conversions (e.g. to int*) raise an exception instead. I didn't check if duration overflows for too large timedeltas. If its easy to fix, point me in the right direction and I try to create a PR. Thanks

 



--
This message was sent by Atlassian Jira
(v8.20.1#820001)