You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@iceberg.apache.org by "rongxinyu (via GitHub)" <gi...@apache.org> on 2025/05/07 16:17:37 UTC
[I] DayTransform issues with pyarrow timestamp[ms] [iceberg-python]
rongxinyu opened a new issue, #1980:
URL: https://github.com/apache/iceberg-python/issues/1980
I have a table with timestamp[ms] and created a partition on this column with DayTransform. The pyarrow_transform raises due to epoch is timestamp[us]
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [I] DayTransform issues with pyarrow timestamp[ms] [iceberg-python]
Posted by "sungwy (via GitHub)" <gi...@apache.org>.
sungwy commented on issue #1980:
URL: https://github.com/apache/iceberg-python/issues/1980#issuecomment-2861523219
Hi @rongxinyu - thanks for reporting this issue!
I think this is the limitation of the current implementation that makes use of the `pyarrow.compute.days_between` function.
```
pyarrow.lib.ArrowNotImplementedError: Function 'days_between' has no kernel matching input types (timestamp[ms], timestamp[us])
```
Thankfully, there is an open PR that will use in the `pyiceberg-core` transforms that will handle this case which is waiting on the 0.5.0 `pyiceberg-core` release: https://github.com/apache/iceberg-python/pull/1592
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [I] DayTransform issues with pyarrow timestamp[ms] [iceberg-python]
Posted by "kevinjqliu (via GitHub)" <gi...@apache.org>.
kevinjqliu commented on issue #1980:
URL: https://github.com/apache/iceberg-python/issues/1980#issuecomment-2863370101
And we're actively working to get 0.5.0 pyiceberg-core out :)
https://github.com/apache/iceberg-rust/milestone/4
almost there
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [I] DayTransform issues with pyarrow timestamp[ms] [iceberg-python]
Posted by "rongxinyu (via GitHub)" <gi...@apache.org>.
rongxinyu commented on issue #1980:
URL: https://github.com/apache/iceberg-python/issues/1980#issuecomment-2862599816
Got it, thank you!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [I] DayTransform issues with pyarrow timestamp[ms] [iceberg-python]
Posted by "Fokko (via GitHub)" <gi...@apache.org>.
Fokko commented on issue #1980:
URL: https://github.com/apache/iceberg-python/issues/1980#issuecomment-2970194112
Since https://github.com/apache/iceberg-python/pull/1833 has been merged, I'll close this issue. If you want to give it a try already, you can give the nightly built a try: https://py.iceberg.apache.org/nightly-build/
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [I] DayTransform issues with pyarrow timestamp[ms] [iceberg-python]
Posted by "Fokko (via GitHub)" <gi...@apache.org>.
Fokko closed issue #1980: DayTransform issues with pyarrow timestamp[ms]
URL: https://github.com/apache/iceberg-python/issues/1980
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org