You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@arrow.apache.org by GitBox <gi...@apache.org> on 2022/10/25 11:50:23 UTC
[GitHub] [arrow] raulcd opened a new pull request, #14499: ARROW-17487: [Python][Packaging][CI] Add support for Python 3.11
raulcd opened a new pull request, #14499:
URL: https://github.com/apache/arrow/pull/14499
WIP
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] pitrou commented on pull request #14499: ARROW-17487: [Python][Packaging][CI] Add support for Python 3.11
Posted by GitBox <gi...@apache.org>.
pitrou commented on PR #14499:
URL: https://github.com/apache/arrow/pull/14499#issuecomment-1293115196
> So it is here that the deployment target should be changed in case of 3.11:
But why would that be necessary only for `universal2`, not `arm64`?
Note that Numpy doesn't even provide `universal2` wheels!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] github-actions[bot] commented on pull request #14499: ARROW-17487: [Python][Packaging][CI] Add support for Python 3.11
Posted by GitBox <gi...@apache.org>.
github-actions[bot] commented on PR #14499:
URL: https://github.com/apache/arrow/pull/14499#issuecomment-1292266600
Revision: d5adbac21b4bafda8c488b75a1fd122bdffc98e6
Submitted crossbow builds: [ursacomputing/crossbow @ actions-f88a7ca39e](https://github.com/ursacomputing/crossbow/branches/all?query=actions-f88a7ca39e)
|Task|Status|
|----|------|
|wheel-macos-big-sur-cp311-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/3330588690/jobs/5509267855)|
|wheel-macos-big-sur-cp311-universal2|[](https://github.com/ursacomputing/crossbow/actions/runs/3330588225/jobs/5509266898)|
|wheel-macos-mojave-cp311-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/3330587742/jobs/5509265963)|
|wheel-manylinux2014-cp311-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/3330587212/jobs/5509264589)|
|wheel-manylinux2014-cp311-arm64|[](https://github.com/ursacomputing/crossbow/runs/9121587049)|
|wheel-windows-cp311-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/3330586070/jobs/5509262219)|
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] pitrou commented on pull request #14499: ARROW-17487: [Python][Packaging][CI] Add support for Python 3.11
Posted by GitBox <gi...@apache.org>.
pitrou commented on PR #14499:
URL: https://github.com/apache/arrow/pull/14499#issuecomment-1293118779
Oh, I see.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] ursabot commented on pull request #14499: ARROW-17487: [Python][Packaging][CI] Add support for Python 3.11
Posted by GitBox <gi...@apache.org>.
ursabot commented on PR #14499:
URL: https://github.com/apache/arrow/pull/14499#issuecomment-1304323891
Benchmark runs are scheduled for baseline = 8e3a1e1b7c17213eb8b79fba49c496de6199fd50 and contender = e21d5aab7690ac3e86c22345a284588a70b892eb. e21d5aab7690ac3e86c22345a284588a70b892eb is a master commit associated with this PR. Results will be available as each benchmark for each run completes.
Conbench compare runs links:
[Finished :arrow_down:0.0% :arrow_up:0.0%] [ec2-t3-xlarge-us-east-2](https://conbench.ursa.dev/compare/runs/7483db1eb02a404c9e9a900979ffee9d...a1a7d78533ec46e68e82a5d2f1706af5/)
[Failed :arrow_down:0.03% :arrow_up:0.0%] [test-mac-arm](https://conbench.ursa.dev/compare/runs/3cfef86768964ec996929efb4cc3e9ce...222ed19fef324692866a4a715258776c/)
[Finished :arrow_down:0.27% :arrow_up:0.0%] [ursa-i9-9960x](https://conbench.ursa.dev/compare/runs/c6830316bf924da4b83c0384159eadd7...35659416d3cf42288f207a1a2d2b8fab/)
[Finished :arrow_down:0.21% :arrow_up:0.18%] [ursa-thinkcentre-m75q](https://conbench.ursa.dev/compare/runs/e60ed6346ae34f8db1b92ea23db759b5...5c1d09855d0f4a3498431b289ab39df6/)
Buildkite builds:
[Finished] [`e21d5aab` ec2-t3-xlarge-us-east-2](https://buildkite.com/apache-arrow/arrow-bci-benchmark-on-ec2-t3-xlarge-us-east-2/builds/1820)
[Failed] [`e21d5aab` test-mac-arm](https://buildkite.com/apache-arrow/arrow-bci-benchmark-on-test-mac-arm/builds/1842)
[Finished] [`e21d5aab` ursa-i9-9960x](https://buildkite.com/apache-arrow/arrow-bci-benchmark-on-ursa-i9-9960x/builds/1808)
[Finished] [`e21d5aab` ursa-thinkcentre-m75q](https://buildkite.com/apache-arrow/arrow-bci-benchmark-on-ursa-thinkcentre-m75q/builds/1834)
[Finished] [`8e3a1e1b` ec2-t3-xlarge-us-east-2](https://buildkite.com/apache-arrow/arrow-bci-benchmark-on-ec2-t3-xlarge-us-east-2/builds/1819)
[Finished] [`8e3a1e1b` test-mac-arm](https://buildkite.com/apache-arrow/arrow-bci-benchmark-on-test-mac-arm/builds/1841)
[Finished] [`8e3a1e1b` ursa-i9-9960x](https://buildkite.com/apache-arrow/arrow-bci-benchmark-on-ursa-i9-9960x/builds/1807)
[Finished] [`8e3a1e1b` ursa-thinkcentre-m75q](https://buildkite.com/apache-arrow/arrow-bci-benchmark-on-ursa-thinkcentre-m75q/builds/1833)
Supported benchmarks:
ec2-t3-xlarge-us-east-2: Supported benchmark langs: Python, R. Runs only benchmarks with cloud = True
test-mac-arm: Supported benchmark langs: C++, Python, R
ursa-i9-9960x: Supported benchmark langs: Python, R, JavaScript
ursa-thinkcentre-m75q: Supported benchmark langs: C++, Java
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] joekohlsdorf commented on pull request #14499: ARROW-17487: [Python][Packaging][CI] Add support for Python 3.11
Posted by GitBox <gi...@apache.org>.
joekohlsdorf commented on PR #14499:
URL: https://github.com/apache/arrow/pull/14499#issuecomment-1305545187
Are the wheels which were built during the test runs here downloadable?
They don't have to be on PyPI, we can install them manually from the filesystem to get tests of projects which depend on arrow to run in the meantime.
Unfortunately this project is almost impossible to build on your own, if it was easier we wouldn't be sitting here waiting on wheels.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] kou commented on pull request #14499: ARROW-17487: [Python][Packaging][CI] Add support for Python 3.11
Posted by GitBox <gi...@apache.org>.
kou commented on PR #14499:
URL: https://github.com/apache/arrow/pull/14499#issuecomment-1304183853
@github-actions crossbow submit -g verify-rc-wheels
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] github-actions[bot] commented on pull request #14499: ARROW-17487: [Python][Packaging][CI] Add support for Python 3.11
Posted by GitBox <gi...@apache.org>.
github-actions[bot] commented on PR #14499:
URL: https://github.com/apache/arrow/pull/14499#issuecomment-1290524967
Revision: 8e2613ff74b28f04f6bc449e204eed451bfa61c2
Submitted crossbow builds: [ursacomputing/crossbow @ actions-fd1ab80f49](https://github.com/ursacomputing/crossbow/branches/all?query=actions-fd1ab80f49)
|Task|Status|
|----|------|
|wheel-macos-big-sur-cp311-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/3321158454/jobs/5488423726)|
|wheel-macos-big-sur-cp311-universal2|[](https://github.com/ursacomputing/crossbow/actions/runs/3321159890/jobs/5488427007)|
|wheel-macos-mojave-cp311-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/3321157700/jobs/5488421796)|
|wheel-manylinux2014-cp311-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/3321159029/jobs/5488424802)|
|wheel-manylinux2014-cp311-arm64|[](https://github.com/ursacomputing/crossbow/runs/9093631995)|
|wheel-windows-cp311-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/3321159481/jobs/5488425934)|
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] Fokko commented on a diff in pull request #14499: ARROW-17487: [Python][Packaging][CI] Add support for Python 3.11
Posted by GitBox <gi...@apache.org>.
Fokko commented on code in PR #14499:
URL: https://github.com/apache/arrow/pull/14499#discussion_r1006685048
##########
filetype_fix.patch:
##########
@@ -0,0 +1,29 @@
+index e7b028a07..557c08149 100644
Review Comment:
This one got committed by accident :)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] raulcd commented on pull request #14499: ARROW-17487: [Python][Packaging][CI] Add support for Python 3.11
Posted by GitBox <gi...@apache.org>.
raulcd commented on PR #14499:
URL: https://github.com/apache/arrow/pull/14499#issuecomment-1292644787
The only wheel job failing is `wheel-macos-big-sur-cp311-universal2`. There are issues resolving the `numpy` version from `old_supported_numpy`. I am trying to understand why this issue is only happening on this specific job:
```
Collecting oldest-supported-numpy>=0.14
Using cached oldest_supported_numpy-2022.8.16-py3-none-any.whl (3.9 kB)
Collecting setuptools_scm
Using cached setuptools_scm-7.0.5-py3-none-any.whl (42 kB)
Collecting setuptools>=58
Using cached setuptools-65.5.0-py3-none-any.whl (1.2 MB)
Collecting wheel
Using cached wheel-0.37.1-py2.py3-none-any.whl (35 kB)
Collecting oldest-supported-numpy>=0.14
Using cached oldest_supported_numpy-2022.5.28-py3-none-any.whl (3.9 kB)
Using cached oldest_supported_numpy-2022.5.27-py3-none-any.whl (3.9 kB)
Using cached oldest_supported_numpy-2022.4.18-py3-none-any.whl (3.9 kB)
Using cached oldest_supported_numpy-2022.4.10-py3-none-any.whl (3.9 kB)
Using cached oldest_supported_numpy-2022.4.8-py3-none-any.whl (3.9 kB)
Using cached oldest_supported_numpy-2022.3.27-py3-none-any.whl (3.9 kB)
Using cached oldest_supported_numpy-2022.1.30-py3-none-any.whl (3.9 kB)
Using cached oldest_supported_numpy-0.15-py3-none-any.whl (3.8 kB)
Using cached oldest_supported_numpy-0.14-py3-none-any.whl (3.8 kB)
INFO: pip is looking at multiple versions of <Python from Requires-Python> to determine which version is compatible with other requirements. This could take a while.
INFO: pip is looking at multiple versions of cython to determine which version is compatible with other requirements. This could take a while.
Collecting cython>=0.29.11
Using cached Cython-0.29.30-py2.py3-none-any.whl (985 kB)
ERROR: Cannot install -r /Users/voltrondata/github-actions-runner/_work/crossbow/crossbow/arrow/python/requirements-wheel-build.txt (line 2) because these package versions have conflicting dependencies.
ERROR: ResolutionImpossible: for help visit https://pip.pypa.io/en/latest/topics/dependency-resolution/#dealing-with-dependency-conflicts
The conflict is caused by:
oldest-supported-numpy 2022.8.16 depends on numpy==1.23.2; python_version == "3.11" and platform_python_implementation != "PyPy"
oldest-supported-numpy 2022.5.28 depends on numpy; python_version >= "3.11"
oldest-supported-numpy 2022.5.27 depends on numpy; python_version >= "3.11"
oldest-supported-numpy 2022.4.18 depends on numpy; python_version >= "3.11"
oldest-supported-numpy 2022.4.10 depends on numpy; python_version >= "3.11"
oldest-supported-numpy 2022.4.8 depends on numpy; python_version >= "3.11"
oldest-supported-numpy 2022.3.27 depends on numpy; python_version >= "3.11"
oldest-supported-numpy 2022.1.30 depends on numpy; python_version >= "3.11"
oldest-supported-numpy 0.15 depends on numpy; python_version >= "3.11"
oldest-supported-numpy 0.14 depends on numpy; python_version >= "3.11"
To fix this you could try to:
1. loosen the range of package versions you've specified
2. remove package versions to allow pip attempt to solve the dependency conflict
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] potiuk commented on pull request #14499: ARROW-17487: [Python][Packaging][CI] Add support for Python 3.11
Posted by GitBox <gi...@apache.org>.
potiuk commented on PR #14499:
URL: https://github.com/apache/arrow/pull/14499#issuecomment-1291895618
We are looking forward to this one being merged in Apache Airflow -> Pyarrow is one of the blocking factors to make Airflow work for Py3.11 and I am trying to make all the oss projects that we consided as friends :) a concerted effort to make Py3.11 support works - as Py 3.11 brings mainly huge improvements in performance that our users are eager to start using !
If there is any help needed - happy to help also by talking to some dependencies of yours (which are likely also Airflow depenendencies). Good luck with it :)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] raulcd commented on a diff in pull request #14499: ARROW-17487: [Python][Packaging][CI] Add support for Python 3.11
Posted by GitBox <gi...@apache.org>.
raulcd commented on code in PR #14499:
URL: https://github.com/apache/arrow/pull/14499#discussion_r1006691224
##########
filetype_fix.patch:
##########
@@ -0,0 +1,29 @@
+index e7b028a07..557c08149 100644
Review Comment:
Thanks :)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] raulcd commented on pull request #14499: ARROW-17487: [Python][Packaging][CI] Add support for Python 3.11
Posted by GitBox <gi...@apache.org>.
raulcd commented on PR #14499:
URL: https://github.com/apache/arrow/pull/14499#issuecomment-1292069724
@github-actions crossbow submit *cp311*
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] raulcd commented on pull request #14499: ARROW-17487: [Python][Packaging][CI] Add support for Python 3.11
Posted by GitBox <gi...@apache.org>.
raulcd commented on PR #14499:
URL: https://github.com/apache/arrow/pull/14499#issuecomment-1291717344
@github-actions crossbow submit *cp311*
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] github-actions[bot] commented on pull request #14499: ARROW-17487: [Python][Packaging][CI] Add support for Python 3.11
Posted by GitBox <gi...@apache.org>.
github-actions[bot] commented on PR #14499:
URL: https://github.com/apache/arrow/pull/14499#issuecomment-1291879091
Revision: 936164bee69dd42aee0d83d4b5e166709d821aac
Submitted crossbow builds: [ursacomputing/crossbow @ actions-2255056a88](https://github.com/ursacomputing/crossbow/branches/all?query=actions-2255056a88)
|Task|Status|
|----|------|
|wheel-macos-big-sur-cp311-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/3328531998/jobs/5504628433)|
|wheel-macos-big-sur-cp311-universal2|[](https://github.com/ursacomputing/crossbow/actions/runs/3328532395/jobs/5504629328)|
|wheel-macos-mojave-cp311-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/3328533191/jobs/5504631065)|
|wheel-manylinux2014-cp311-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/3328531419/jobs/5504627379)|
|wheel-manylinux2014-cp311-arm64|[](https://github.com/ursacomputing/crossbow/runs/9115346559)|
|wheel-windows-cp311-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/3328530461/jobs/5504625422)|
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] raulcd commented on pull request #14499: ARROW-17487: [Python][Packaging][CI] Add support for Python 3.11
Posted by GitBox <gi...@apache.org>.
raulcd commented on PR #14499:
URL: https://github.com/apache/arrow/pull/14499#issuecomment-1303189868
@github-actions crossbow submit -g wheel
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] github-actions[bot] commented on pull request #14499: ARROW-17487: [Python][Packaging][CI] Add support for Python 3.11
Posted by GitBox <gi...@apache.org>.
github-actions[bot] commented on PR #14499:
URL: https://github.com/apache/arrow/pull/14499#issuecomment-1303438986
Revision: db9ff9f2770f5033c408ba3925ed7f14e2988a81
Submitted crossbow builds: [ursacomputing/crossbow @ actions-e42c6b854c](https://github.com/ursacomputing/crossbow/branches/all?query=actions-e42c6b854c)
|Task|Status|
|----|------|
|wheel-macos-big-sur-cp310-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/3393811704/jobs/5641580500)|
|wheel-macos-big-sur-cp311-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/3393812540/jobs/5641582359)|
|wheel-macos-big-sur-cp38-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/3393813423/jobs/5641584122)|
|wheel-macos-big-sur-cp39-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/3393812077/jobs/5641581268)|
|wheel-macos-mojave-cp310-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/3393813171/jobs/5641583581)|
|wheel-macos-mojave-cp311-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/3393811397/jobs/5641579685)|
|wheel-macos-mojave-cp37-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/3393811203/jobs/5641579061)|
|wheel-macos-mojave-cp38-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/3393810859/jobs/5641578248)|
|wheel-macos-mojave-cp39-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/3393814260/jobs/5641585937)|
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] assignUser commented on pull request #14499: ARROW-17487: [Python][Packaging][CI] Add support for Python 3.11
Posted by GitBox <gi...@apache.org>.
assignUser commented on PR #14499:
URL: https://github.com/apache/arrow/pull/14499#issuecomment-1295038216
@joshuataylor Yes that should not be a problem but if you have a Monterey mac at your disposal you can just download the wheel and test it from here https://github.com/ursacomputing/crossbow/actions/runs/3336108578
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] raulcd commented on pull request #14499: ARROW-17487: [Python][Packaging][CI] Add support for Python 3.11
Posted by GitBox <gi...@apache.org>.
raulcd commented on PR #14499:
URL: https://github.com/apache/arrow/pull/14499#issuecomment-1293322795
@github-actions crossbow submit wheel-windows-*
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] pitrou commented on a diff in pull request #14499: ARROW-17487: [Python][Packaging][CI] Add support for Python 3.11
Posted by GitBox <gi...@apache.org>.
pitrou commented on code in PR #14499:
URL: https://github.com/apache/arrow/pull/14499#discussion_r1004540075
##########
ci/docker/python-wheel-windows-vs2017.dockerfile:
##########
@@ -81,7 +81,8 @@ ARG python=3.8
RUN (if "%python%"=="3.7" setx PYTHON_VERSION "3.7.9" && setx PATH "%PATH%;C:\Python37;C:\Python37\Scripts") & \
(if "%python%"=="3.8" setx PYTHON_VERSION "3.8.10" && setx PATH "%PATH%;C:\Python38;C:\Python38\Scripts") & \
(if "%python%"=="3.9" setx PYTHON_VERSION "3.9.7" && setx PATH "%PATH%;C:\Python39;C:\Python39\Scripts") & \
- (if "%python%"=="3.10" setx PYTHON_VERSION "3.10.2" && setx PATH "%PATH%;C:\Python310;C:\Python310\Scripts")
+ (if "%python%"=="3.10" setx PYTHON_VERSION "3.10.2" && setx PATH "%PATH%;C:\Python310;C:\Python310\Scripts") & \
Review Comment:
Yes, that was my assumption.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] raulcd commented on pull request #14499: ARROW-17487: [Python][Packaging][CI] Add support for Python 3.11
Posted by GitBox <gi...@apache.org>.
raulcd commented on PR #14499:
URL: https://github.com/apache/arrow/pull/14499#issuecomment-1290825813
@github-actions crossbow submit *cp311*
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] github-actions[bot] commented on pull request #14499: ARROW-17487: [Python][Packaging][CI] Add support for Python 3.11
Posted by GitBox <gi...@apache.org>.
github-actions[bot] commented on PR #14499:
URL: https://github.com/apache/arrow/pull/14499#issuecomment-1302122531
Revision: a655655b056aa6fade07d7243605702a58a6e55a
Submitted crossbow builds: [ursacomputing/crossbow @ actions-e3ad152283](https://github.com/ursacomputing/crossbow/branches/all?query=actions-e3ad152283)
|Task|Status|
|----|------|
|wheel-macos-big-sur-cp311-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/3386099703/jobs/5625065609)|
|wheel-macos-mojave-cp311-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/3386101830/jobs/5625069866)|
|wheel-manylinux2014-cp311-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/3386100955/jobs/5625067941)|
|wheel-manylinux2014-cp311-arm64|[](https://github.com/ursacomputing/crossbow/runs/9273542815)|
|wheel-windows-cp311-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/3386100598/jobs/5625067021)|
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] kou merged pull request #14499: ARROW-17487: [Python][Packaging][CI] Add support for Python 3.11
Posted by GitBox <gi...@apache.org>.
kou merged PR #14499:
URL: https://github.com/apache/arrow/pull/14499
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] raulcd commented on pull request #14499: ARROW-17487: [Python][Packaging][CI] Add support for Python 3.11
Posted by GitBox <gi...@apache.org>.
raulcd commented on PR #14499:
URL: https://github.com/apache/arrow/pull/14499#issuecomment-1290620038
@github-actions crossbow submit cp311
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] jorisvandenbossche commented on pull request #14499: ARROW-17487: [Python][Packaging][CI] Add support for Python 3.11
Posted by GitBox <gi...@apache.org>.
jorisvandenbossche commented on PR #14499:
URL: https://github.com/apache/arrow/pull/14499#issuecomment-1293099048
> it seems like numpy arm64 wheels are only available [for the macosx_11.0](https://pypi.org/project/numpy/1.23.2/#files)
That's also the case for older Python versions, so if this is the reason it would be strange we only see it for 3.11?
I don't understand the version resolution conflict from pip. It seems total nonsense:
```
oldest-supported-numpy 2022.8.16 depends on numpy==1.23.2; python_version == "3.11" and platform_python_implementation != "PyPy"
oldest-supported-numpy 2022.5.28 depends on numpy; python_version >= "3.11"
...
```
How is that a conflict?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] raulcd commented on a diff in pull request #14499: ARROW-17487: [Python][Packaging][CI] Add support for Python 3.11
Posted by GitBox <gi...@apache.org>.
raulcd commented on code in PR #14499:
URL: https://github.com/apache/arrow/pull/14499#discussion_r1006593752
##########
python/requirements-wheel-test.txt:
##########
@@ -8,14 +8,18 @@ pytz
tzdata; sys_platform == 'win32'
numpy==1.19.5; platform_system == "Linux" and platform_machine == "aarch64" and python_version < "3.7"
-numpy==1.21.3; platform_system == "Linux" and platform_machine == "aarch64" and python_version >= "3.7"
+numpy==1.21.3; platform_system == "Linux" and platform_machine == "aarch64" and python_version >= "3.7" and python_version < "3.11"
+numpy==1.23.4; platform_system == "Linux" and platform_machine == "aarch64" and python_version >= "3.11"
numpy==1.19.5; platform_system == "Linux" and platform_machine != "aarch64" and python_version < "3.9"
-numpy==1.21.3; platform_system == "Linux" and platform_machine != "aarch64" and python_version >= "3.9"
+numpy==1.21.3; platform_system == "Linux" and platform_machine != "aarch64" and python_version >= "3.9" and python_version < "3.11"
+numpy==1.23.4; platform_system == "Linux" and platform_machine != "aarch64" and python_version >= "3.11"
numpy==1.21.3; platform_system == "Darwin" and platform_machine == "arm64"
numpy==1.19.5; platform_system == "Darwin" and platform_machine != "arm64" and python_version < "3.9"
-numpy==1.21.3; platform_system == "Darwin" and platform_machine != "arm64" and python_version >= "3.9"
+numpy==1.21.3; platform_system == "Darwin" and platform_machine != "arm64" and python_version >= "3.9" and python_version < "3.11"
+numpy==1.23.4; platform_system == "Darwin" and platform_machine != "arm64" and python_version >= "3.11"
numpy==1.19.5; platform_system == "Windows" and python_version < "3.9"
-numpy==1.21.3; platform_system == "Windows" and python_version >= "3.9"
+numpy==1.21.3; platform_system == "Windows" and python_version >= "3.9" and python_version < "3.11"
+numpy==1.23.4; platform_system == "Windows" and python_version >= "3.11"
Review Comment:
I have created a follow up ticket (https://issues.apache.org/jira/browse/ARROW-18170) to see whether we can get rid of this by using the `oldest-supported-numpy` as the current requirements-wheel-test.txt feels overly complex.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] pitrou commented on pull request #14499: ARROW-17487: [Python][Packaging][CI] Add support for Python 3.11
Posted by GitBox <gi...@apache.org>.
pitrou commented on PR #14499:
URL: https://github.com/apache/arrow/pull/14499#issuecomment-1292330616
The tests are trying to compile grpcio, can we avoid that?
https://github.com/ursacomputing/crossbow/actions/runs/3330588690/jobs/5509267855#step:11:116
Either install the GCS testbench on a different Python (with binary wheels), or don't test GCS at all on 3.11.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] pitrou commented on pull request #14499: ARROW-17487: [Python][Packaging][CI] Add support for Python 3.11
Posted by GitBox <gi...@apache.org>.
pitrou commented on PR #14499:
URL: https://github.com/apache/arrow/pull/14499#issuecomment-1293113016
For the record, I posted https://discuss.python.org/t/dependency-resolution-conflict-on-universal2-with-pip-22-3-and-python-3-11/20419
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] raulcd commented on a diff in pull request #14499: ARROW-17487: [Python][Packaging][CI] Add support for Python 3.11
Posted by GitBox <gi...@apache.org>.
raulcd commented on code in PR #14499:
URL: https://github.com/apache/arrow/pull/14499#discussion_r1014052047
##########
dev/tasks/tasks.yml:
##########
@@ -498,7 +499,9 @@ tasks:
macos_deployment_target: "11.0"
artifacts:
- pyarrow-{no_rc_version}-{{ python_tag }}-{{ python_tag }}-macosx_11_0_arm64.whl
+{% endfor %}
+{% for python_version, python_tag in [("3.9", "cp39"), ("3.10", "cp310")] %}
Review Comment:
Done
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] pitrou commented on pull request #14499: ARROW-17487: [Python][Packaging][CI] Add support for Python 3.11
Posted by GitBox <gi...@apache.org>.
pitrou commented on PR #14499:
URL: https://github.com/apache/arrow/pull/14499#issuecomment-1291993453
@raulcd Perhaps try applying this patch?
```diff
diff --git a/python/pyproject.toml b/python/pyproject.toml
index edbc4ade6..a799dc761 100644
--- a/python/pyproject.toml
+++ b/python/pyproject.toml
@@ -18,7 +18,7 @@
[build-system]
requires = [
"cython >= 0.29.22",
- "oldest-supported-numpy>=0.14",
+ "oldest-supported-numpy>=2022.8.16",
"setuptools_scm",
"setuptools >= 40.1.0",
"wheel"
diff --git a/python/requirements-build.txt b/python/requirements-build.txt
index 46eb288c5..927c50d73 100644
--- a/python/requirements-build.txt
+++ b/python/requirements-build.txt
@@ -1,4 +1,4 @@
cython>=0.29
-oldest-supported-numpy>=0.14
+oldest-supported-numpy>=2022.8.16
setuptools_scm
setuptools>=38.6.0
diff --git a/python/requirements-wheel-build.txt b/python/requirements-wheel-build.txt
index 856164f09..a48b30d35 100644
--- a/python/requirements-wheel-build.txt
+++ b/python/requirements-wheel-build.txt
@@ -1,5 +1,5 @@
cython>=0.29.11
-oldest-supported-numpy>=0.14
+oldest-supported-numpy>=2022.8.16
setuptools_scm
setuptools>=58
wheel
diff --git a/python/requirements-wheel-test.txt b/python/requirements-wheel-test.txt
index 1644b2f8b..665b2ce77 100644
--- a/python/requirements-wheel-test.txt
+++ b/python/requirements-wheel-test.txt
@@ -2,26 +2,8 @@ cffi
cython
hypothesis
pickle5; platform_system != "Windows" and python_version < "3.8"
+oldest-supported-numpy>=2022.8.16
pytest
pytest-lazy-fixture
pytz
tzdata; sys_platform == 'win32'
-
-numpy==1.19.5; platform_system == "Linux" and platform_machine == "aarch64" and python_version < "3.7"
-numpy==1.21.3; platform_system == "Linux" and platform_machine == "aarch64" and python_version >= "3.7"
-numpy==1.19.5; platform_system == "Linux" and platform_machine != "aarch64" and python_version < "3.9"
-numpy==1.21.3; platform_system == "Linux" and platform_machine != "aarch64" and python_version >= "3.9"
-numpy==1.21.3; platform_system == "Darwin" and platform_machine == "arm64"
-numpy==1.19.5; platform_system == "Darwin" and platform_machine != "arm64" and python_version < "3.9"
-numpy==1.21.3; platform_system == "Darwin" and platform_machine != "arm64" and python_version >= "3.9"
-numpy==1.19.5; platform_system == "Windows" and python_version < "3.9"
-numpy==1.21.3; platform_system == "Windows" and python_version >= "3.9"
-
-pandas<1.1.0; platform_system == "Linux" and platform_machine != "aarch64" and python_version < "3.8"
-pandas; platform_system == "Linux" and platform_machine != "aarch64" and python_version >= "3.8"
-pandas; platform_system == "Linux" and platform_machine == "aarch64"
-pandas<1.1.0; platform_system == "Darwin" and platform_machine != "arm64" and python_version < "3.8"
-pandas; platform_system == "Darwin" and platform_machine != "arm64" and python_version >= "3.8"
-pandas; platform_system == "Darwin" and platform_machine == "arm64"
-pandas<1.1.0; platform_system == "Windows" and python_version < "3.8"
-pandas; platform_system == "Windows" and python_version >= "3.8"
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] github-actions[bot] commented on pull request #14499: ARROW-17487: [Python][Packaging][CI] Add support for Python 3.11
Posted by GitBox <gi...@apache.org>.
github-actions[bot] commented on PR #14499:
URL: https://github.com/apache/arrow/pull/14499#issuecomment-1293319219
Revision: 4eb0d7f3b7f071647af3579e78aaf2edcc81f4d6
Submitted crossbow builds: [ursacomputing/crossbow @ actions-eaa99e46d0](https://github.com/ursacomputing/crossbow/branches/all?query=actions-eaa99e46d0)
|Task|Status|
|----|------|
|wheel-macos-mojave-cp310-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/3336581159/jobs/5521905568)|
|wheel-macos-mojave-cp311-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/3336581986/jobs/5521907309)|
|wheel-macos-mojave-cp37-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/3336580746/jobs/5521904396)|
|wheel-macos-mojave-cp38-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/3336582425/jobs/5521908254)|
|wheel-macos-mojave-cp39-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/3336580338/jobs/5521903439)|
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] jorisvandenbossche commented on a diff in pull request #14499: ARROW-17487: [Python][Packaging][CI] Add support for Python 3.11
Posted by GitBox <gi...@apache.org>.
jorisvandenbossche commented on code in PR #14499:
URL: https://github.com/apache/arrow/pull/14499#discussion_r1013066869
##########
python/pyarrow/_fs.pyx:
##########
@@ -78,6 +78,12 @@ cdef CFileType _unwrap_file_type(FileType ty) except *:
assert 0
+def _file_type_to_string(ty):
+ # Python 3.11 changed str(IntEnum) to return the string representation
+ # of the integer value: https://github.com/python/cpython/issues/94763
+ return f"{ty.__class__.__name__}.{ty._name_}"
Review Comment:
While this is good fix to get the tests passing and the repr of `FileInfo` working, we should maybe consider changing FileType to be a StrEnum instead? (although I don't know if cython supports that)
Or to change the repr of `FileType` as well. As with the current change, also the FileType repr on python 3.11 will no longer be informative (not just the FileInfo repr)
(but this can certainly be left for a follow-up)
##########
dev/tasks/tasks.yml:
##########
@@ -498,7 +499,9 @@ tasks:
macos_deployment_target: "11.0"
artifacts:
- pyarrow-{no_rc_version}-{{ python_tag }}-{{ python_tag }}-macosx_11_0_arm64.whl
+{% endfor %}
+{% for python_version, python_tag in [("3.9", "cp39"), ("3.10", "cp310")] %}
Review Comment:
I think we could also stop providing universal wheels altogether for new pyarrow versions? (and not just stop providing them for the python 3.11 wheels?)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] raulcd commented on a diff in pull request #14499: ARROW-17487: [Python][Packaging][CI] Add support for Python 3.11
Posted by GitBox <gi...@apache.org>.
raulcd commented on code in PR #14499:
URL: https://github.com/apache/arrow/pull/14499#discussion_r1014052950
##########
python/pyarrow/_fs.pyx:
##########
@@ -78,6 +78,12 @@ cdef CFileType _unwrap_file_type(FileType ty) except *:
assert 0
+def _file_type_to_string(ty):
+ # Python 3.11 changed str(IntEnum) to return the string representation
+ # of the integer value: https://github.com/python/cpython/issues/94763
+ return f"{ty.__class__.__name__}.{ty._name_}"
Review Comment:
I understand that there's no need for a follow up ticket, right?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] Fokko commented on pull request #14499: ARROW-17487: [Python][Packaging][CI] Add support for Python 3.11
Posted by GitBox <gi...@apache.org>.
Fokko commented on PR #14499:
URL: https://github.com/apache/arrow/pull/14499#issuecomment-1304231885
This is awesome, thanks @raulcd for adding support for 3.11 👏🏻
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] ursabot commented on pull request #14499: ARROW-17487: [Python][Packaging][CI] Add support for Python 3.11
Posted by GitBox <gi...@apache.org>.
ursabot commented on PR #14499:
URL: https://github.com/apache/arrow/pull/14499#issuecomment-1304324008
['Python', 'R'] benchmarks have high level of regressions.
[ursa-i9-9960x](https://conbench.ursa.dev/compare/runs/c6830316bf924da4b83c0384159eadd7...35659416d3cf42288f207a1a2d2b8fab/)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] raulcd commented on a diff in pull request #14499: ARROW-17487: [Python][Packaging][CI] Add support for Python 3.11
Posted by GitBox <gi...@apache.org>.
raulcd commented on code in PR #14499:
URL: https://github.com/apache/arrow/pull/14499#discussion_r1004539463
##########
ci/docker/python-wheel-windows-vs2017.dockerfile:
##########
@@ -81,7 +81,8 @@ ARG python=3.8
RUN (if "%python%"=="3.7" setx PYTHON_VERSION "3.7.9" && setx PATH "%PATH%;C:\Python37;C:\Python37\Scripts") & \
(if "%python%"=="3.8" setx PYTHON_VERSION "3.8.10" && setx PATH "%PATH%;C:\Python38;C:\Python38\Scripts") & \
(if "%python%"=="3.9" setx PYTHON_VERSION "3.9.7" && setx PATH "%PATH%;C:\Python39;C:\Python39\Scripts") & \
- (if "%python%"=="3.10" setx PYTHON_VERSION "3.10.2" && setx PATH "%PATH%;C:\Python310;C:\Python310\Scripts")
+ (if "%python%"=="3.10" setx PYTHON_VERSION "3.10.2" && setx PATH "%PATH%;C:\Python310;C:\Python310\Scripts") & \
Review Comment:
Should we update the others too? "3.9.7" --> "3.9.15", etcetera?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] github-actions[bot] commented on pull request #14499: ARROW-17487: [Python][Packaging][CI] Add support for Python 3.11
Posted by GitBox <gi...@apache.org>.
github-actions[bot] commented on PR #14499:
URL: https://github.com/apache/arrow/pull/14499#issuecomment-1290451176
https://issues.apache.org/jira/browse/ARROW-17487
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] pitrou commented on a diff in pull request #14499: ARROW-17487: [Python][Packaging][CI] Add support for Python 3.11
Posted by GitBox <gi...@apache.org>.
pitrou commented on code in PR #14499:
URL: https://github.com/apache/arrow/pull/14499#discussion_r1005632906
##########
python/requirements-wheel-test.txt:
##########
@@ -8,14 +8,18 @@ pytz
tzdata; sys_platform == 'win32'
numpy==1.19.5; platform_system == "Linux" and platform_machine == "aarch64" and python_version < "3.7"
-numpy==1.21.3; platform_system == "Linux" and platform_machine == "aarch64" and python_version >= "3.7"
+numpy==1.21.3; platform_system == "Linux" and platform_machine == "aarch64" and python_version >= "3.7" and python_version < "3.11"
+numpy==1.23.4; platform_system == "Linux" and platform_machine == "aarch64" and python_version >= "3.11"
numpy==1.19.5; platform_system == "Linux" and platform_machine != "aarch64" and python_version < "3.9"
-numpy==1.21.3; platform_system == "Linux" and platform_machine != "aarch64" and python_version >= "3.9"
+numpy==1.21.3; platform_system == "Linux" and platform_machine != "aarch64" and python_version >= "3.9" and python_version < "3.11"
+numpy==1.23.4; platform_system == "Linux" and platform_machine != "aarch64" and python_version >= "3.11"
numpy==1.21.3; platform_system == "Darwin" and platform_machine == "arm64"
numpy==1.19.5; platform_system == "Darwin" and platform_machine != "arm64" and python_version < "3.9"
-numpy==1.21.3; platform_system == "Darwin" and platform_machine != "arm64" and python_version >= "3.9"
+numpy==1.21.3; platform_system == "Darwin" and platform_machine != "arm64" and python_version >= "3.9" and python_version < "3.11"
+numpy==1.23.4; platform_system == "Darwin" and platform_machine != "arm64" and python_version >= "3.11"
numpy==1.19.5; platform_system == "Windows" and python_version < "3.9"
-numpy==1.21.3; platform_system == "Windows" and python_version >= "3.9"
+numpy==1.21.3; platform_system == "Windows" and python_version >= "3.9" and python_version < "3.11"
+numpy==1.23.4; platform_system == "Windows" and python_version >= "3.11"
Review Comment:
What surprises me is that we have this but we also depend on `oldest-supported-numpy` in other places. That might be the cause for the conflicts?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] raulcd commented on pull request #14499: ARROW-17487: [Python][Packaging][CI] Add support for Python 3.11
Posted by GitBox <gi...@apache.org>.
raulcd commented on PR #14499:
URL: https://github.com/apache/arrow/pull/14499#issuecomment-1292069177
Wheels are built successfully at the moment, I am going to trigger the job again to validate the MacOS ones but the jobs are failing due to 7 tests failing due to the change of behaviour of repr on the FileType enum, see: https://github.com/python/cpython/issues/94763
Thanks @jorisvandenbossche
We probably can fix those on a following PR
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] raulcd commented on pull request #14499: ARROW-17487: [Python][Packaging][CI] Add support for Python 3.11
Posted by GitBox <gi...@apache.org>.
raulcd commented on PR #14499:
URL: https://github.com/apache/arrow/pull/14499#issuecomment-1303911182
@jorisvandenbossche @kou I think this is ready for review again after working on your suggestions
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] jorisvandenbossche commented on a diff in pull request #14499: ARROW-17487: [Python][Packaging][CI] Add support for Python 3.11
Posted by GitBox <gi...@apache.org>.
jorisvandenbossche commented on code in PR #14499:
URL: https://github.com/apache/arrow/pull/14499#discussion_r1014062868
##########
python/pyarrow/_fs.pyx:
##########
@@ -78,6 +78,12 @@ cdef CFileType _unwrap_file_type(FileType ty) except *:
assert 0
+def _file_type_to_string(ty):
+ # Python 3.11 changed str(IntEnum) to return the string representation
+ # of the integer value: https://github.com/python/cpython/issues/94763
+ return f"{ty.__class__.__name__}.{ty._name_}"
Review Comment:
Yes, I think it is fine
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] raulcd commented on pull request #14499: ARROW-17487: [Python][Packaging][CI] Add support for Python 3.11
Posted by GitBox <gi...@apache.org>.
raulcd commented on PR #14499:
URL: https://github.com/apache/arrow/pull/14499#issuecomment-1292401700
@github-actions crossbow submit *cp311*
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] raulcd commented on pull request #14499: ARROW-17487: [Python][Packaging][CI] Add support for Python 3.11
Posted by GitBox <gi...@apache.org>.
raulcd commented on PR #14499:
URL: https://github.com/apache/arrow/pull/14499#issuecomment-1305431148
> When will an official release become available?
Hi @noamcohen97 , wheels are part of the official release of Apache Arrow. I have sent an email to the developers mailing list to ask the rest of the community if a new minor release of Apache Arrow is required. You can join the developers mailing list or follow the thread here:
https://lists.apache.org/thread/xrlztoz8no289rt6kr6qz52b8yjr3mob
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] robinlandstrom commented on pull request #14499: ARROW-17487: [Python][Packaging][CI] Add support for Python 3.11
Posted by GitBox <gi...@apache.org>.
robinlandstrom commented on PR #14499:
URL: https://github.com/apache/arrow/pull/14499#issuecomment-1305630015
@joekohlsdorf you can find the wheel in the @github-actions [links](https://github.com/apache/arrow/pull/14499#issuecomment-1303653185) above. For linux on amd64 the last build is here
[https://github.com/ursacomputing/crossbow/releases/download/actions-e03f7d03d3-github-wheel-manylinux2014-cp311-amd64/pyarrow-11.0.0.dev52-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl](https://github.com/ursacomputing/crossbow/releases/download/actions-e03f7d03d3-github-wheel-manylinux2014-cp311-amd64/pyarrow-11.0.0.dev52-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl)
I have not tested it yet but at least possible to install in latest python:3.11 docker container 😃
``` sh
# pip install pyarrow-11.0.0.dev52-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Processing /pyarrow-11.0.0.dev52-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Collecting numpy>=1.16.6
Downloading numpy-1.23.4-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (17.1 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 17.1/17.1 MB 73.6 MB/s eta 0:00:00
Installing collected packages: numpy, pyarrow
Successfully installed numpy-1.23.4 pyarrow-11.0.0.dev52
WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
[notice] A new release of pip available: 22.3 -> 22.3.1
[notice] To update, run: pip install --upgrade pip
root@98b070b9e41f:/# python
Python 3.11.0 (main, Oct 25 2022, 05:00:36) [GCC 10.2.1 20210110] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> import pyarrow
>>>
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] jorisvandenbossche commented on a diff in pull request #14499: ARROW-17487: [Python][Packaging][CI] Add support for Python 3.11
Posted by GitBox <gi...@apache.org>.
jorisvandenbossche commented on code in PR #14499:
URL: https://github.com/apache/arrow/pull/14499#discussion_r1005704494
##########
python/requirements-wheel-test.txt:
##########
@@ -8,14 +8,18 @@ pytz
tzdata; sys_platform == 'win32'
numpy==1.19.5; platform_system == "Linux" and platform_machine == "aarch64" and python_version < "3.7"
-numpy==1.21.3; platform_system == "Linux" and platform_machine == "aarch64" and python_version >= "3.7"
+numpy==1.21.3; platform_system == "Linux" and platform_machine == "aarch64" and python_version >= "3.7" and python_version < "3.11"
+numpy==1.23.4; platform_system == "Linux" and platform_machine == "aarch64" and python_version >= "3.11"
numpy==1.19.5; platform_system == "Linux" and platform_machine != "aarch64" and python_version < "3.9"
-numpy==1.21.3; platform_system == "Linux" and platform_machine != "aarch64" and python_version >= "3.9"
+numpy==1.21.3; platform_system == "Linux" and platform_machine != "aarch64" and python_version >= "3.9" and python_version < "3.11"
+numpy==1.23.4; platform_system == "Linux" and platform_machine != "aarch64" and python_version >= "3.11"
numpy==1.21.3; platform_system == "Darwin" and platform_machine == "arm64"
numpy==1.19.5; platform_system == "Darwin" and platform_machine != "arm64" and python_version < "3.9"
-numpy==1.21.3; platform_system == "Darwin" and platform_machine != "arm64" and python_version >= "3.9"
+numpy==1.21.3; platform_system == "Darwin" and platform_machine != "arm64" and python_version >= "3.9" and python_version < "3.11"
+numpy==1.23.4; platform_system == "Darwin" and platform_machine != "arm64" and python_version >= "3.11"
numpy==1.19.5; platform_system == "Windows" and python_version < "3.9"
-numpy==1.21.3; platform_system == "Windows" and python_version >= "3.9"
+numpy==1.21.3; platform_system == "Windows" and python_version >= "3.9" and python_version < "3.11"
+numpy==1.23.4; platform_system == "Windows" and python_version >= "3.11"
Review Comment:
This file is for testing, not building, I think? (so it doesn't need to match exactly with the versions from oldest-supported-numpy)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] pitrou commented on pull request #14499: ARROW-17487: [Python][Packaging][CI] Add support for Python 3.11
Posted by GitBox <gi...@apache.org>.
pitrou commented on PR #14499:
URL: https://github.com/apache/arrow/pull/14499#issuecomment-1297627821
@raulcd Can you rebase/merge from master?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] github-actions[bot] commented on pull request #14499: ARROW-17487: [Python][Packaging][CI] Add support for Python 3.11
Posted by GitBox <gi...@apache.org>.
github-actions[bot] commented on PR #14499:
URL: https://github.com/apache/arrow/pull/14499#issuecomment-1297678550
Revision: 43ad787c3a83712d9ffef59adb90bacc477fb48e
Submitted crossbow builds: [ursacomputing/crossbow @ actions-2bed700501](https://github.com/ursacomputing/crossbow/branches/all?query=actions-2bed700501)
|Task|Status|
|----|------|
|wheel-macos-big-sur-cp311-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/3364715790/jobs/5579383365)|
|wheel-macos-mojave-cp311-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/3364717364/jobs/5579386731)|
|wheel-manylinux2014-cp311-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/3364716833/jobs/5579385516)|
|wheel-manylinux2014-cp311-arm64|[](https://github.com/ursacomputing/crossbow/runs/9212560000)|
|wheel-windows-cp311-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/3364717174/jobs/5579386195)|
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] kleschenko commented on pull request #14499: ARROW-17487: [Python][Packaging][CI] Add support for Python 3.11
Posted by GitBox <gi...@apache.org>.
kleschenko commented on PR #14499:
URL: https://github.com/apache/arrow/pull/14499#issuecomment-1292765853
@raulcd it seems like `numpy` arm64 wheels are only available [for the macosx_11.0](https://pypi.org/project/numpy/1.23.2/#files) while the failing job is trying to use the `MACOSX_DEPLOYMENT_TARGET=10.14`
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] raulcd commented on pull request #14499: ARROW-17487: [Python][Packaging][CI] Add support for Python 3.11
Posted by GitBox <gi...@apache.org>.
raulcd commented on PR #14499:
URL: https://github.com/apache/arrow/pull/14499#issuecomment-1297640921
> @raulcd Can you rebase/merge from master?
Done, rebased master
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] jorisvandenbossche commented on pull request #14499: ARROW-17487: [Python][Packaging][CI] Add support for Python 3.11
Posted by GitBox <gi...@apache.org>.
jorisvandenbossche commented on PR #14499:
URL: https://github.com/apache/arrow/pull/14499#issuecomment-1293118364
> But why would that be necessary only for `universal2`, not `arm64`?
> Note that Numpy doesn't even provide `universal2` wheels!
Because for arm64 we set a different deployment target in tasks.yml, for that task we already set it to 11
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] pitrou commented on pull request #14499: ARROW-17487: [Python][Packaging][CI] Add support for Python 3.11
Posted by GitBox <gi...@apache.org>.
pitrou commented on PR #14499:
URL: https://github.com/apache/arrow/pull/14499#issuecomment-1295106403
> I can investigate further but that seems to be an existing issue on the other Mojave ones too, see Python 3.8 for example: https://github.com/ursacomputing/crossbow/actions/runs/3336582425/jobs/5521908254
I see. Then let's just open another JIRA for it and investigate later?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] raulcd commented on pull request #14499: ARROW-17487: [Python][Packaging][CI] Add support for Python 3.11
Posted by GitBox <gi...@apache.org>.
raulcd commented on PR #14499:
URL: https://github.com/apache/arrow/pull/14499#issuecomment-1293264552
@github-actions crossbow submit wheel-macos-mojave-*
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] raulcd commented on pull request #14499: ARROW-17487: [Python][Packaging][CI] Add support for Python 3.11
Posted by GitBox <gi...@apache.org>.
raulcd commented on PR #14499:
URL: https://github.com/apache/arrow/pull/14499#issuecomment-1303349703
I am temporary pinning wheels to `<0.38` (was recently released) due to this issue on delocate:
https://github.com/matthew-brett/delocate/issues/166
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] raulcd commented on pull request #14499: ARROW-17487: [Python][Packaging][CI] Add support for Python 3.11
Posted by GitBox <gi...@apache.org>.
raulcd commented on PR #14499:
URL: https://github.com/apache/arrow/pull/14499#issuecomment-1303320750
@github-actions crossbow submit wheel-macos-*
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] github-actions[bot] commented on pull request #14499: ARROW-17487: [Python][Packaging][CI] Add support for Python 3.11
Posted by GitBox <gi...@apache.org>.
github-actions[bot] commented on PR #14499:
URL: https://github.com/apache/arrow/pull/14499#issuecomment-1303653185
Revision: c933cb3f919b79c4b5a2f12a8aaa9e3765a1e838
Submitted crossbow builds: [ursacomputing/crossbow @ actions-e03f7d03d3](https://github.com/ursacomputing/crossbow/branches/all?query=actions-e03f7d03d3)
|Task|Status|
|----|------|
|wheel-macos-big-sur-cp310-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/3394616140/jobs/5643401731)|
|wheel-macos-big-sur-cp311-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/3394624775/jobs/5643420990)|
|wheel-macos-big-sur-cp38-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/3394619303/jobs/5643408528)|
|wheel-macos-big-sur-cp39-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/3394622285/jobs/5643415205)|
|wheel-macos-mojave-cp310-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/3394625824/jobs/5643423343)|
|wheel-macos-mojave-cp311-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/3394621324/jobs/5643413083)|
|wheel-macos-mojave-cp37-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/3394628167/jobs/5643429173)|
|wheel-macos-mojave-cp38-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/3394624523/jobs/5643420435)|
|wheel-macos-mojave-cp39-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/3394627742/jobs/5643428019)|
|wheel-manylinux2014-cp310-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/3394618361/jobs/5643406437)|
|wheel-manylinux2014-cp310-arm64|[](https://github.com/ursacomputing/crossbow/runs/9297950435)|
|wheel-manylinux2014-cp311-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/3394626716/jobs/5643425545)|
|wheel-manylinux2014-cp311-arm64|[](https://github.com/ursacomputing/crossbow/runs/9297967790)|
|wheel-manylinux2014-cp37-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/3394620808/jobs/5643411799)|
|wheel-manylinux2014-cp37-arm64|[](https://github.com/ursacomputing/crossbow/runs/9297947617)|
|wheel-manylinux2014-cp38-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/3394627275/jobs/5643426983)|
|wheel-manylinux2014-cp38-arm64|[](https://github.com/ursacomputing/crossbow/runs/9297966530)|
|wheel-manylinux2014-cp39-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/3394624000/jobs/5643419042)|
|wheel-manylinux2014-cp39-arm64|[](https://github.com/ursacomputing/crossbow/runs/9297956864)|
|wheel-windows-cp310-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/3394617413/jobs/5643404267)|
|wheel-windows-cp311-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/3394621774/jobs/5643414078)|
|wheel-windows-cp37-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/3394625252/jobs/5643422179)|
|wheel-windows-cp38-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/3394619048/jobs/5643407971)|
|wheel-windows-cp39-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/3394620440/jobs/5643411128)|
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] jorisvandenbossche commented on a diff in pull request #14499: ARROW-17487: [Python][Packaging][CI] Add support for Python 3.11
Posted by GitBox <gi...@apache.org>.
jorisvandenbossche commented on code in PR #14499:
URL: https://github.com/apache/arrow/pull/14499#discussion_r1013122843
##########
python/pyarrow/_fs.pyx:
##########
@@ -78,6 +78,12 @@ cdef CFileType _unwrap_file_type(FileType ty) except *:
assert 0
+def _file_type_to_string(ty):
+ # Python 3.11 changed str(IntEnum) to return the string representation
+ # of the integer value: https://github.com/python/cpython/issues/94763
+ return f"{ty.__class__.__name__}.{ty._name_}"
Review Comment:
Actually, the change is only for `str(..)`, not for the repr. So then I suppose the above is fine (just checking `FileInfo.type` interactively will still give an informative repr, it's only when printing it that it will now return just an int)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] raulcd commented on pull request #14499: ARROW-17487: [Python][Packaging][CI] Add support for Python 3.11
Posted by GitBox <gi...@apache.org>.
raulcd commented on PR #14499:
URL: https://github.com/apache/arrow/pull/14499#issuecomment-1305680302
> Are the wheels which were built during the test runs here downloadable? They don't have to be on PyPI, we can install them manually from the filesystem to get tests of projects which depend on arrow to run in the meantime.
We do publish nightly development versions of pyarrow as seen on the Python development docs:
https://arrow.apache.org/docs/developers/python.html#installing-nightly-packages
As the documentation says these are not official releases and are development builds that can be used to test downstream libraries CI. These are not official releases and will contain any other change on development.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] kou commented on pull request #14499: ARROW-17487: [Python][Packaging][CI] Add support for Python 3.11
Posted by GitBox <gi...@apache.org>.
kou commented on PR #14499:
URL: https://github.com/apache/arrow/pull/14499#issuecomment-1304193841
Ah, it seems that `verify-rc-wheels` jobs don't support local verification yet.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] github-actions[bot] commented on pull request #14499: ARROW-17487: [Python][Packaging][CI] Add support for Python 3.11
Posted by GitBox <gi...@apache.org>.
github-actions[bot] commented on PR #14499:
URL: https://github.com/apache/arrow/pull/14499#issuecomment-1291001365
Revision: 5dc9f31155413426b5d719bd8b1de3a6ef983afb
Submitted crossbow builds: [ursacomputing/crossbow @ actions-3375acd0f2](https://github.com/ursacomputing/crossbow/branches/all?query=actions-3375acd0f2)
|Task|Status|
|----|------|
|wheel-macos-big-sur-cp311-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/3323495009/jobs/5493907581)|
|wheel-macos-big-sur-cp311-universal2|[](https://github.com/ursacomputing/crossbow/actions/runs/3323496386/jobs/5493910339)|
|wheel-macos-mojave-cp311-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/3323494171/jobs/5493905625)|
|wheel-manylinux2014-cp311-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/3323493850/jobs/5493904723)|
|wheel-manylinux2014-cp311-arm64|[](https://github.com/ursacomputing/crossbow/runs/9101112225)|
|wheel-windows-cp311-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/3323495898/jobs/5493909465)|
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] raulcd commented on pull request #14499: ARROW-17487: [Python][Packaging][CI] Add support for Python 3.11
Posted by GitBox <gi...@apache.org>.
raulcd commented on PR #14499:
URL: https://github.com/apache/arrow/pull/14499#issuecomment-1290425530
@github-actions crossbow submit *cp311*
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] pitrou commented on a diff in pull request #14499: ARROW-17487: [Python][Packaging][CI] Add support for Python 3.11
Posted by GitBox <gi...@apache.org>.
pitrou commented on code in PR #14499:
URL: https://github.com/apache/arrow/pull/14499#discussion_r1004451476
##########
ci/docker/python-wheel-windows-vs2017.dockerfile:
##########
@@ -81,7 +81,8 @@ ARG python=3.8
RUN (if "%python%"=="3.7" setx PYTHON_VERSION "3.7.9" && setx PATH "%PATH%;C:\Python37;C:\Python37\Scripts") & \
(if "%python%"=="3.8" setx PYTHON_VERSION "3.8.10" && setx PATH "%PATH%;C:\Python38;C:\Python38\Scripts") & \
(if "%python%"=="3.9" setx PYTHON_VERSION "3.9.7" && setx PATH "%PATH%;C:\Python39;C:\Python39\Scripts") & \
- (if "%python%"=="3.10" setx PYTHON_VERSION "3.10.2" && setx PATH "%PATH%;C:\Python310;C:\Python310\Scripts")
+ (if "%python%"=="3.10" setx PYTHON_VERSION "3.10.2" && setx PATH "%PATH%;C:\Python310;C:\Python310\Scripts") & \
Review Comment:
Can we also bump make these releases up to date? ("3.10.8" instead of "3.10.2", etc.)
See https://www.python.org/downloads/ for the current list
##########
ci/scripts/install_python.sh:
##########
@@ -28,7 +28,8 @@ declare -A versions
versions=([3.7]=3.7.9
[3.8]=3.8.10
[3.9]=3.9.9
- [3.10]=3.10.1)
+ [3.10]=3.10.1
Review Comment:
Same here.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] github-actions[bot] commented on pull request #14499: ARROW-17487: [Python][Packaging][CI] Add support for Python 3.11
Posted by GitBox <gi...@apache.org>.
github-actions[bot] commented on PR #14499:
URL: https://github.com/apache/arrow/pull/14499#issuecomment-1293413683
Revision: 4eb0d7f3b7f071647af3579e78aaf2edcc81f4d6
Submitted crossbow builds: [ursacomputing/crossbow @ actions-96d21285c8](https://github.com/ursacomputing/crossbow/branches/all?query=actions-96d21285c8)
|Task|Status|
|----|------|
|wheel-windows-cp310-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/3337132840/jobs/5523094456)|
|wheel-windows-cp311-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/3337134954/jobs/5523099089)|
|wheel-windows-cp37-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/3337133661/jobs/5523096141)|
|wheel-windows-cp38-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/3337133277/jobs/5523095346)|
|wheel-windows-cp39-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/3337134065/jobs/5523097032)|
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] pitrou commented on a diff in pull request #14499: ARROW-17487: [Python][Packaging][CI] Add support for Python 3.11
Posted by GitBox <gi...@apache.org>.
pitrou commented on code in PR #14499:
URL: https://github.com/apache/arrow/pull/14499#discussion_r1005619591
##########
python/requirements-wheel-test.txt:
##########
@@ -8,14 +8,18 @@ pytz
tzdata; sys_platform == 'win32'
numpy==1.19.5; platform_system == "Linux" and platform_machine == "aarch64" and python_version < "3.7"
-numpy==1.21.3; platform_system == "Linux" and platform_machine == "aarch64" and python_version >= "3.7"
+numpy==1.21.3; platform_system == "Linux" and platform_machine == "aarch64" and python_version >= "3.7" and python_version < "3.11"
+numpy==1.23.4; platform_system == "Linux" and platform_machine == "aarch64" and python_version >= "3.11"
numpy==1.19.5; platform_system == "Linux" and platform_machine != "aarch64" and python_version < "3.9"
-numpy==1.21.3; platform_system == "Linux" and platform_machine != "aarch64" and python_version >= "3.9"
+numpy==1.21.3; platform_system == "Linux" and platform_machine != "aarch64" and python_version >= "3.9" and python_version < "3.11"
+numpy==1.23.4; platform_system == "Linux" and platform_machine != "aarch64" and python_version >= "3.11"
numpy==1.21.3; platform_system == "Darwin" and platform_machine == "arm64"
numpy==1.19.5; platform_system == "Darwin" and platform_machine != "arm64" and python_version < "3.9"
-numpy==1.21.3; platform_system == "Darwin" and platform_machine != "arm64" and python_version >= "3.9"
+numpy==1.21.3; platform_system == "Darwin" and platform_machine != "arm64" and python_version >= "3.9" and python_version < "3.11"
+numpy==1.23.4; platform_system == "Darwin" and platform_machine != "arm64" and python_version >= "3.11"
numpy==1.19.5; platform_system == "Windows" and python_version < "3.9"
-numpy==1.21.3; platform_system == "Windows" and python_version >= "3.9"
+numpy==1.21.3; platform_system == "Windows" and python_version >= "3.9" and python_version < "3.11"
+numpy==1.23.4; platform_system == "Windows" and python_version >= "3.11"
Review Comment:
Is this copied from `oldest-supported-numpy`, or did we do our own thing?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] jorisvandenbossche commented on pull request #14499: ARROW-17487: [Python][Packaging][CI] Add support for Python 3.11
Posted by GitBox <gi...@apache.org>.
jorisvandenbossche commented on PR #14499:
URL: https://github.com/apache/arrow/pull/14499#issuecomment-1293111086
> > it seems like numpy arm64 wheels are only available [for the macosx_11.0](https://pypi.org/project/numpy/1.23.2/#files)
>
> That's also the case for older Python versions, so if this is the reason it would be strange we only see it for 3.11?
Ah, but with older Python versions, `oldest-supported-numpy` will also pick an older numpy(eg 1.21.6 for Python 3.10: https://pypi.org/project/numpy/1.21.6/#files), and yes, older numpy versions have "universal" wheels with 10_9 deployment target
So it is here that the deployment target should be changed in case of 3.11:
https://github.com/apache/arrow/blob/c56934b57922a6cbb46eaef097a36ed8d2473467/dev/tasks/tasks.yml#L533-L539
(we would maybe also stop building universal2 wheels, since we provide also both arm64 and x86_64 wheels)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] github-actions[bot] commented on pull request #14499: ARROW-17487: [Python][Packaging][CI] Add support for Python 3.11
Posted by GitBox <gi...@apache.org>.
github-actions[bot] commented on PR #14499:
URL: https://github.com/apache/arrow/pull/14499#issuecomment-1293236682
Revision: 636784eee0992d6e5b85ec6f5483d793688302e2
Submitted crossbow builds: [ursacomputing/crossbow @ actions-abc57b7436](https://github.com/ursacomputing/crossbow/branches/all?query=actions-abc57b7436)
|Task|Status|
|----|------|
|wheel-macos-big-sur-cp310-arm64|[](https://github.com/ursacomputing/crossbow/tree/actions-abc57b7436-github-wheel-macos-big-sur-cp310-arm64)|
|wheel-macos-big-sur-cp310-universal2|[](https://github.com/ursacomputing/crossbow/actions/runs/3336109683/jobs/5520863779)|
|wheel-macos-big-sur-cp311-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/3336108578/jobs/5520861281)|
|wheel-macos-big-sur-cp38-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/3336115397/jobs/5520876535)|
|wheel-macos-big-sur-cp39-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/3336119176/jobs/5520885201)|
|wheel-macos-big-sur-cp39-universal2|[](https://github.com/ursacomputing/crossbow/actions/runs/3336110935/jobs/5520866877)|
|wheel-macos-mojave-cp310-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/3336117632/jobs/5520881080)|
|wheel-macos-mojave-cp311-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/3336119529/jobs/5520886131)|
|wheel-macos-mojave-cp37-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/3336106668/jobs/5520857259)|
|wheel-macos-mojave-cp38-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/3336115020/jobs/5520875518)|
|wheel-macos-mojave-cp39-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/3336110521/jobs/5520865837)|
|wheel-manylinux2014-cp310-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/3336109177/jobs/5520862669)|
|wheel-manylinux2014-cp310-arm64|[](https://github.com/ursacomputing/crossbow/runs/9137132486)|
|wheel-manylinux2014-cp311-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/3336118843/jobs/5520884265)|
|wheel-manylinux2014-cp311-arm64|[](https://github.com/ursacomputing/crossbow/runs/9137104500)|
|wheel-manylinux2014-cp37-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/3336118052/jobs/5520882218)|
|wheel-manylinux2014-cp37-arm64|[](https://github.com/ursacomputing/crossbow/runs/9137106205)|
|wheel-manylinux2014-cp38-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/3336114557/jobs/5520874535)|
|wheel-manylinux2014-cp38-arm64|[](https://github.com/ursacomputing/crossbow/runs/9137112682)|
|wheel-manylinux2014-cp39-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/3336112235/jobs/5520869387)|
|wheel-manylinux2014-cp39-arm64|[](https://github.com/ursacomputing/crossbow/runs/9137132131)|
|wheel-windows-cp310-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/3336111386/jobs/5520867922)|
|wheel-windows-cp311-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/3336114153/jobs/5520873393)|
|wheel-windows-cp37-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/3336115869/jobs/5520877529)|
|wheel-windows-cp38-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/3336113142/jobs/5520871223)|
|wheel-windows-cp39-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/3336106411/jobs/5520856744)|
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] noamcohen97 commented on pull request #14499: ARROW-17487: [Python][Packaging][CI] Add support for Python 3.11
Posted by GitBox <gi...@apache.org>.
noamcohen97 commented on PR #14499:
URL: https://github.com/apache/arrow/pull/14499#issuecomment-1304850442
When will an official release become available?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] github-actions[bot] commented on pull request #14499: ARROW-17487: [Python][Packaging][CI] Add support for Python 3.11
Posted by GitBox <gi...@apache.org>.
github-actions[bot] commented on PR #14499:
URL: https://github.com/apache/arrow/pull/14499#issuecomment-1304189784
Revision: c933cb3f919b79c4b5a2f12a8aaa9e3765a1e838
Submitted crossbow builds: [ursacomputing/crossbow @ actions-46dd9703ee](https://github.com/ursacomputing/crossbow/branches/all?query=actions-46dd9703ee)
|Task|Status|
|----|------|
|verify-rc-binaries-wheels-linux-almalinux-8-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/3396892415/jobs/5648462734)|
|verify-rc-binaries-wheels-linux-conda-latest-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/3396892129/jobs/5648462178)|
|verify-rc-binaries-wheels-linux-ubuntu-18.04-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/3396893152/jobs/5648464305)|
|verify-rc-binaries-wheels-linux-ubuntu-20.04-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/3396893152/jobs/5648464305)|
|verify-rc-binaries-wheels-linux-ubuntu-22.04-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/3396893152/jobs/5648464305)|
|verify-rc-binaries-wheels-macos-11-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/3396893528/jobs/5648465256)|
|verify-rc-binaries-wheels-macos-11-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/3396893842/jobs/5648465836)|
|verify-rc-binaries-wheels-macos-12-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/3396891426/jobs/5648460679)|
|verify-rc-binaries-wheels-windows|[](https://github.com/ursacomputing/crossbow/actions/runs/3396891026/jobs/5648459776)|
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] raulcd commented on pull request #14499: ARROW-17487: [Python][Packaging][CI] Add support for Python 3.11
Posted by GitBox <gi...@apache.org>.
raulcd commented on PR #14499:
URL: https://github.com/apache/arrow/pull/14499#issuecomment-1303581638
@github-actions crossbow submit -g wheel
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] raulcd commented on pull request #14499: ARROW-17487: [Python][Packaging][CI] Add support for Python 3.11
Posted by GitBox <gi...@apache.org>.
raulcd commented on PR #14499:
URL: https://github.com/apache/arrow/pull/14499#issuecomment-1295102798
> Is it normal that it doesn't run any tests?
I can investigate further but that seems to be an existing issue on the other Mojave ones too, see Python 3.8 for example: https://github.com/ursacomputing/crossbow/actions/runs/3336582425/jobs/5521908254
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] raulcd commented on pull request #14499: ARROW-17487: [Python][Packaging][CI] Add support for Python 3.11
Posted by GitBox <gi...@apache.org>.
raulcd commented on PR #14499:
URL: https://github.com/apache/arrow/pull/14499#issuecomment-1295120305
> I see. Then let's just open another JIRA for it and investigate later?
Sounds good to me, I've opened a JIRA ticket: https://issues.apache.org/jira/browse/ARROW-18190.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] github-actions[bot] commented on pull request #14499: ARROW-17487: [Python][Packaging][CI] Add support for Python 3.11
Posted by GitBox <gi...@apache.org>.
github-actions[bot] commented on PR #14499:
URL: https://github.com/apache/arrow/pull/14499#issuecomment-1292593804
Revision: fdac52b0490287e88978b694daf5083f3eaf40ac
Submitted crossbow builds: [ursacomputing/crossbow @ actions-77a8b7ac66](https://github.com/ursacomputing/crossbow/branches/all?query=actions-77a8b7ac66)
|Task|Status|
|----|------|
|wheel-macos-big-sur-cp311-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/3332185681/jobs/5512765441)|
|wheel-macos-big-sur-cp311-universal2|[](https://github.com/ursacomputing/crossbow/actions/runs/3332186845/jobs/5512768206)|
|wheel-macos-mojave-cp311-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/3332188346/jobs/5512771669)|
|wheel-manylinux2014-cp311-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/3332187856/jobs/5512770442)|
|wheel-manylinux2014-cp311-arm64|[](https://github.com/ursacomputing/crossbow/runs/9126410150)|
|wheel-windows-cp311-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/3332186062/jobs/5512766276)|
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] pitrou commented on pull request #14499: ARROW-17487: [Python][Packaging][CI] Add support for Python 3.11
Posted by GitBox <gi...@apache.org>.
pitrou commented on PR #14499:
URL: https://github.com/apache/arrow/pull/14499#issuecomment-1293115797
(I'd also be in favor of not bothering with universal wheels, btw)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] raulcd commented on pull request #14499: ARROW-17487: [Python][Packaging][CI] Add support for Python 3.11
Posted by GitBox <gi...@apache.org>.
raulcd commented on PR #14499:
URL: https://github.com/apache/arrow/pull/14499#issuecomment-1293172794
@github-actions crossbow submit -g wheel
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] joshuataylor commented on pull request #14499: ARROW-17487: [Python][Packaging][CI] Add support for Python 3.11
Posted by GitBox <gi...@apache.org>.
joshuataylor commented on PR #14499:
URL: https://github.com/apache/arrow/pull/14499#issuecomment-1294847478
Sorry for the naivety, but would the Big Sur (11.x) arm64 wheels here also work on Monterey (12.x)?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] raulcd commented on a diff in pull request #14499: ARROW-17487: [Python][Packaging][CI] Add support for Python 3.11
Posted by GitBox <gi...@apache.org>.
raulcd commented on code in PR #14499:
URL: https://github.com/apache/arrow/pull/14499#discussion_r1005626420
##########
python/requirements-wheel-test.txt:
##########
@@ -8,14 +8,18 @@ pytz
tzdata; sys_platform == 'win32'
numpy==1.19.5; platform_system == "Linux" and platform_machine == "aarch64" and python_version < "3.7"
-numpy==1.21.3; platform_system == "Linux" and platform_machine == "aarch64" and python_version >= "3.7"
+numpy==1.21.3; platform_system == "Linux" and platform_machine == "aarch64" and python_version >= "3.7" and python_version < "3.11"
+numpy==1.23.4; platform_system == "Linux" and platform_machine == "aarch64" and python_version >= "3.11"
numpy==1.19.5; platform_system == "Linux" and platform_machine != "aarch64" and python_version < "3.9"
-numpy==1.21.3; platform_system == "Linux" and platform_machine != "aarch64" and python_version >= "3.9"
+numpy==1.21.3; platform_system == "Linux" and platform_machine != "aarch64" and python_version >= "3.9" and python_version < "3.11"
+numpy==1.23.4; platform_system == "Linux" and platform_machine != "aarch64" and python_version >= "3.11"
numpy==1.21.3; platform_system == "Darwin" and platform_machine == "arm64"
numpy==1.19.5; platform_system == "Darwin" and platform_machine != "arm64" and python_version < "3.9"
-numpy==1.21.3; platform_system == "Darwin" and platform_machine != "arm64" and python_version >= "3.9"
+numpy==1.21.3; platform_system == "Darwin" and platform_machine != "arm64" and python_version >= "3.9" and python_version < "3.11"
+numpy==1.23.4; platform_system == "Darwin" and platform_machine != "arm64" and python_version >= "3.11"
numpy==1.19.5; platform_system == "Windows" and python_version < "3.9"
-numpy==1.21.3; platform_system == "Windows" and python_version >= "3.9"
+numpy==1.21.3; platform_system == "Windows" and python_version >= "3.9" and python_version < "3.11"
+numpy==1.23.4; platform_system == "Windows" and python_version >= "3.11"
Review Comment:
you mean the origin of this file? I am not sure about the origin of it but it currently fails due to trying to install `numpy==1.21.3` for Python 3.11 on our test wheels container when the first numpy version that support Python 3.11 is 1.23.3 (https://pypi.org/project/numpy/1.23.3/)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] raulcd commented on pull request #14499: ARROW-17487: [Python][Packaging][CI] Add support for Python 3.11
Posted by GitBox <gi...@apache.org>.
raulcd commented on PR #14499:
URL: https://github.com/apache/arrow/pull/14499#issuecomment-1292049339
> @raulcd Perhaps try applying this patch?
I tested the patch locally and while the build of the images is successful I got a lot of test failures:
```
640 failed, 3430 passed, 348 skipped, 15 xfailed, 2 xpassed, 5 warnings, 8 errors in 103.69s (0:01:43)
```
This is how I reproduce locally:
```shell
# generate wheel
PYTHON=3.11 docker-compose build --no-cache --progress plain python-wheel-manylinux-2014
PYTHON=3.11 docker-compose run --rm python-wheel-manylinux-2014
# test wheel
PYTHON=3.11 docker-compose build --no-cache python-wheel-manylinux-test-unittests
PYTHON=3.11 docker-compose run --rm python-wheel-manylinux-test-unittests
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] raulcd commented on pull request #14499: ARROW-17487: [Python][Packaging][CI] Add support for Python 3.11
Posted by GitBox <gi...@apache.org>.
raulcd commented on PR #14499:
URL: https://github.com/apache/arrow/pull/14499#issuecomment-1302017016
@github-actions crossbow submit *cp311*
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] pitrou commented on pull request #14499: ARROW-17487: [Python][Packaging][CI] Add support for Python 3.11
Posted by GitBox <gi...@apache.org>.
pitrou commented on PR #14499:
URL: https://github.com/apache/arrow/pull/14499#issuecomment-1292157095
This patch should help fix the 3.11 enum issue:
```diff
diff --git a/python/pyarrow/_fs.pyx b/python/pyarrow/_fs.pyx
index e7b028a07..557c08149 100644
--- a/python/pyarrow/_fs.pyx
+++ b/python/pyarrow/_fs.pyx
@@ -78,6 +78,12 @@ cdef CFileType _unwrap_file_type(FileType ty) except *:
assert 0
+def _file_type_to_string(ty):
+ # Python 3.11 changed str(IntEnum) to return the string representation
+ # of the integer value: https://github.com/python/cpython/issues/94763
+ return f"{ty.__class__.__name__}.{ty._name_}"
+
+
cdef class FileInfo(_Weakrefable):
"""
FileSystem entry info.
@@ -185,9 +191,10 @@ cdef class FileInfo(_Weakrefable):
except ValueError:
return ''
- s = '<FileInfo for {!r}: type={}'.format(self.path, str(self.type))
+ s = (f'<FileInfo for {self.path!r}: '
+ f'type={_file_type_to_string(self.type)}')
if self.is_file:
- s += ', size={}'.format(self.size)
+ s += f', size={self.size}'
s += '>'
return s
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] pitrou commented on pull request #14499: ARROW-17487: [Python][Packaging][CI] Add support for Python 3.11
Posted by GitBox <gi...@apache.org>.
pitrou commented on PR #14499:
URL: https://github.com/apache/arrow/pull/14499#issuecomment-1295070686
I don't understand the "Test wheel" step here (Mojave, Python 3.11): https://github.com/ursacomputing/crossbow/actions/runs/3336581986/jobs/5521907309#step:13:1
Is it normal that it doesn't run any tests?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] pitrou commented on pull request #14499: ARROW-17487: [Python][Packaging][CI] Add support for Python 3.11
Posted by GitBox <gi...@apache.org>.
pitrou commented on PR #14499:
URL: https://github.com/apache/arrow/pull/14499#issuecomment-1297645044
@github-actions crossbow submit *cp311*
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] kou commented on pull request #14499: ARROW-17487: [Python][Packaging][CI] Add support for Python 3.11
Posted by GitBox <gi...@apache.org>.
kou commented on PR #14499:
URL: https://github.com/apache/arrow/pull/14499#issuecomment-1301385367
Could you add 3.11 to `dev/release/verify-release-candidate.sh` too?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] kou commented on a diff in pull request #14499: ARROW-17487: [Python][Packaging][CI] Add support for Python 3.11
Posted by GitBox <gi...@apache.org>.
kou commented on code in PR #14499:
URL: https://github.com/apache/arrow/pull/14499#discussion_r1012287446
##########
ci/scripts/install_gcs_testbench.sh:
##########
@@ -38,14 +38,14 @@ case "$(uname -s)-$(uname -m)" in
Darwin-arm64)
# Workaround for https://github.com/grpc/grpc/issues/28387 .
# Build grpcio instead of using wheel.
- # storage-testbench 0.27.0 pins grpcio to 1.46.1.
- ${PYTHON:-python3} -m pip install --no-binary :all: "grpcio==1.46.1"
+ # storage-testbench 0.32.0 pins grpcio to 1.49.1.
+ ${PYTHON:-python3} -m pip install --no-binary :all: "grpcio==1.49.1"
Review Comment:
Can we remove this workaround?
It seems that grpcio 1.47.0 or later doesn't have this problem: https://github.com/grpc/grpc/issues/28387#issuecomment-1163468600
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] github-actions[bot] commented on pull request #14499: ARROW-17487: [Python][Packaging][CI] Add support for Python 3.11
Posted by GitBox <gi...@apache.org>.
github-actions[bot] commented on PR #14499:
URL: https://github.com/apache/arrow/pull/14499#issuecomment-1303276887
Revision: 6f79c8fc2a9b789e40902d3c7f24d6fd50f85cdd
Submitted crossbow builds: [ursacomputing/crossbow @ actions-0d61bab5f3](https://github.com/ursacomputing/crossbow/branches/all?query=actions-0d61bab5f3)
|Task|Status|
|----|------|
|wheel-macos-big-sur-cp310-arm64|[](https://github.com/ursacomputing/crossbow/tree/actions-0d61bab5f3-github-wheel-macos-big-sur-cp310-arm64)|
|wheel-macos-big-sur-cp311-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/3393293792/jobs/5640462104)|
|wheel-macos-big-sur-cp38-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/3393296692/jobs/5640468843)|
|wheel-macos-big-sur-cp39-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/3393301059/jobs/5640478192)|
|wheel-macos-mojave-cp310-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/3393295926/jobs/5640467052)|
|wheel-macos-mojave-cp311-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/3393299571/jobs/5640475133)|
|wheel-macos-mojave-cp37-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/3393295321/jobs/5640466069)|
|wheel-macos-mojave-cp38-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/3393297145/jobs/5640469839)|
|wheel-macos-mojave-cp39-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/3393300158/jobs/5640476337)|
|wheel-manylinux2014-cp310-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/3393298231/jobs/5640472405)|
|wheel-manylinux2014-cp310-arm64|[](https://github.com/ursacomputing/crossbow/runs/9294042284)|
|wheel-manylinux2014-cp311-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/3393294599/jobs/5640464163)|
|wheel-manylinux2014-cp311-arm64|[](https://github.com/ursacomputing/crossbow/runs/9294037390)|
|wheel-manylinux2014-cp37-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/3393294876/jobs/5640464995)|
|wheel-manylinux2014-cp37-arm64|[](https://github.com/ursacomputing/crossbow/runs/9294023351)|
|wheel-manylinux2014-cp38-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/3393300578/jobs/5640477355)|
|wheel-manylinux2014-cp38-arm64|[](https://github.com/ursacomputing/crossbow/runs/9294028692)|
|wheel-manylinux2014-cp39-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/3393291844/jobs/5640458039)|
|wheel-manylinux2014-cp39-arm64|[](https://github.com/ursacomputing/crossbow/runs/9294044189)|
|wheel-windows-cp310-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/3393297560/jobs/5640470757)|
|wheel-windows-cp311-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/3393290663/jobs/5640455540)|
|wheel-windows-cp37-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/3393292866/jobs/5640460137)|
|wheel-windows-cp38-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/3393294361/jobs/5640463597)|
|wheel-windows-cp39-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/3393290931/jobs/5640456118)|
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] github-actions[bot] commented on pull request #14499: ARROW-17487: [Python][Packaging][CI] Add support for Python 3.11
Posted by GitBox <gi...@apache.org>.
github-actions[bot] commented on PR #14499:
URL: https://github.com/apache/arrow/pull/14499#issuecomment-1290451213
:warning: Ticket **has not been started in JIRA**, please click 'Start Progress'.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] github-actions[bot] commented on pull request #14499: ARROW-17487: [Python][Packaging][CI] Add support for Python 3.11
Posted by GitBox <gi...@apache.org>.
github-actions[bot] commented on PR #14499:
URL: https://github.com/apache/arrow/pull/14499#issuecomment-1290824543
```
Unable to match any tasks for `cp311`
The Archery job run can be found at: https://github.com/apache/arrow/actions/runs/3321608980
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org