You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@arrow.apache.org by "jorisvandenbossche (via GitHub)" <gi...@apache.org> on 2024/01/09 12:30:40 UTC
[I] [Python] Compatibility with NumPy 2.0 [arrow]
jorisvandenbossche opened a new issue, #39532:
URL: https://github.com/apache/arrow/issues/39532
NumPy 2.0 is coming soon, and we should ensure pyarrow is fully compatible to ensure a smooth transition of our users. Overview issue on numpy's side: https://github.com/numpy/numpy/issues/24300
We already test with nightly numpy (eg https://github.com/ursacomputing/crossbow/actions/runs/7454906275/job/20283098411), and currently this build is working fine.
There is one warning about the usage of `numpy.core.numerictypes` that we should still solve.
Further, we need to check if we are all OK on the packaging side: do we need to pin numpy<2 for now in our upcoming release? What do we need to update in our wheel building? (stop using oldest-supported-numpy?)
- [ ] [Python] NumPy 2.0 compat: remove usage of np.core
- [ ] Packaging questions
cc @raulcd
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@arrow.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Python] Compatibility with NumPy 2.0 [arrow]
Posted by "jorisvandenbossche (via GitHub)" <gi...@apache.org>.
jorisvandenbossche closed issue #39532: [Python] Compatibility with NumPy 2.0
URL: https://github.com/apache/arrow/issues/39532
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Python] Compatibility with NumPy 2.0 [arrow]
Posted by "jorisvandenbossche (via GitHub)" <gi...@apache.org>.
jorisvandenbossche commented on issue #39532:
URL: https://github.com/apache/arrow/issues/39532#issuecomment-1883045140
Some other observations / relevant bits from the linked issues:
* Since numpy 1.25, we don't need `oldest-supported-numpy` anymore (https://numpy.org/devdocs/release/1.25.0-notes.html#compiling-against-the-numpy-c-api-is-now-backwards-compatible-by-default and https://github.com/scipy/oldest-supported-numpy#deprecation-notice-for-numpy-20), so for newer Python versions (where the minimum supported version of numpy is <=1.25), we can start compiling with the latest numpy
* At the moment, pip install pyarrow in an environment with numpy 2.0, the import of pyarrow fails. So at a minimum, we should add a `numpy<2.0` pin in the release branch
* If we want wheels that support both numpy 1.x and 2.0 at runtime, we need to build our wheels with numpy 2.0 (https://numpy.org/devdocs/dev/depending_on_numpy.html#numpy-2-0-specific-advice). The recommendation is to start doing that (and then a numpy<2.0 pin in the released version is no longer needed) once numpy 2.0rc1 is out. This is targeted for around 1 Feb 2024, but other projects already started building their wheels with numpy 2.0.dev, as far as I understand (eg https://github.com/scikit-learn/scikit-learn/pull/27735, or that is only for the nightly wheels?)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Python] Compatibility with NumPy 2.0 [arrow]
Posted by "raulcd (via GitHub)" <gi...@apache.org>.
raulcd commented on issue #39532:
URL: https://github.com/apache/arrow/issues/39532#issuecomment-2057163382
@jorisvandenbossche is there something else to do on this one or are we ready for the release on this?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Python] Compatibility with NumPy 2.0 [arrow]
Posted by "jorisvandenbossche (via GitHub)" <gi...@apache.org>.
jorisvandenbossche commented on issue #39532:
URL: https://github.com/apache/arrow/issues/39532#issuecomment-2057264293
I think all sub-tasks are done, and this can be closed now
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org