You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@datafusion.apache.org by "ngoldbaum (via GitHub)" <gi...@apache.org> on 2026/06/16 16:09:57 UTC
[I] Update PyO3 to 0.29 [datafusion-python]
ngoldbaum opened a new issue, #1603:
URL: https://github.com/apache/datafusion-python/issues/1603
I'm working on free-threaded support in polars with @kumaraditya303: https://github.com/pola-rs/polars/issues/27955. Datafusion shows up in the polars dependency tree.
Updating to PyO3 0.29 enables builds with the new Python 3.15 free-threaded stable ABI, which should allow datafusion to enable free-threaded support without an ongoing need to upload version-specific wheels every time Python does a release.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [I] Update PyO3 to 0.29 and explore abi3t support [datafusion-python]
Posted by "kumaraditya303 (via GitHub)" <gi...@apache.org>.
kumaraditya303 commented on issue #1603:
URL: https://github.com/apache/datafusion-python/issues/1603#issuecomment-4721130806
> Can you point out where datafusion shows up in the dependency tree for polars? That's new to me.
`polars` has dependency on [deltalake](https://github.com/delta-io/delta-rs/tree/main/python/) which in turn depends on `datafusion`. It is heavily used by `polars` for io.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [I] Update PyO3 to 0.29 and explore abi3t support [datafusion-python]
Posted by "timsaucer (via GitHub)" <gi...@apache.org>.
timsaucer commented on issue #1603:
URL: https://github.com/apache/datafusion-python/issues/1603#issuecomment-4831893237
DataFusion-54.0.0 is released with free threaded Python wheels available. Do you want to keep this issue open? We will auto-upgrade pyo3 as our dependencies update.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [I] Update PyO3 to 0.29 and explore abi3t support [datafusion-python]
Posted by "ngoldbaum (via GitHub)" <gi...@apache.org>.
ngoldbaum commented on issue #1603:
URL: https://github.com/apache/datafusion-python/issues/1603#issuecomment-4722259933
OK great. Just an FYI though that PyO3 0.29 dropped 3.13t support. See [the release notes](https://github.com/PyO3/pyo3/releases/tag/v0.29.0) and [the free-threading guide](https://py-free-threading.github.io/ci/#building-free-threaded-wheels-with-cibuildwheel) for more detail about that. I'd suggest simply never shipping 3.13t wheels. 3.13t never gained support for a few key packages and that makes it difficult to use 3.13t with a nontrivial set of dependencies. 3.14t is supported much more widely so we're trying to get people to start support there.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [I] Update PyO3 to 0.29 and explore abi3t support [datafusion-python]
Posted by "timsaucer (via GitHub)" <gi...@apache.org>.
timsaucer commented on issue #1603:
URL: https://github.com/apache/datafusion-python/issues/1603#issuecomment-4720997949
Thanks for the issue! We have to update pyo3 in lock step with arrow-rs. I just merged a PR to updated it to 0.29, so it will be the next major arrow release (60). Then we need datafusion upstream to update, which it generally does very quickly. After that we'll follow suit.
Can you point out where datafusion shows up in the dependency tree for polars? That's new to me.
FWIW our next release of datafusion-python does have free threaded support with 3.13 (experimental) and 3.14 (stable) python.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [I] Update PyO3 to 0.29 and explore abi3t support [datafusion-python]
Posted by "edgarrmondragon (via GitHub)" <gi...@apache.org>.
edgarrmondragon commented on issue #1603:
URL: https://github.com/apache/datafusion-python/issues/1603#issuecomment-6253942288
I think abi3t support is worth investigating, so I gave it a try locally and the new `cp315-abi3.abi3t` wheels seem to be working as expected. I opened https://github.com/apache/datafusion-python/pull/1799.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [I] Update PyO3 to 0.29 and explore abi3t support [datafusion-python]
Posted by "timsaucer (via GitHub)" <gi...@apache.org>.
timsaucer commented on issue #1603:
URL: https://github.com/apache/datafusion-python/issues/1603#issuecomment-4722774508
Sounds good! I will exclude them when I do the upload! Thanks for the feedback!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [I] Update PyO3 to 0.29 and explore abi3t support [datafusion-python]
Posted by "ngoldbaum (via GitHub)" <gi...@apache.org>.
ngoldbaum commented on issue #1603:
URL: https://github.com/apache/datafusion-python/issues/1603#issuecomment-4833317987
Let's close it if it's not useful for you.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [I] Update PyO3 to 0.29 and explore abi3t support [datafusion-python]
Posted by "ngoldbaum (via GitHub)" <gi...@apache.org>.
ngoldbaum closed issue #1603: Update PyO3 to 0.29 and explore abi3t support
URL: https://github.com/apache/datafusion-python/issues/1603
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org