You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@arrow.apache.org by "lysnikolaou (via GitHub)" <gi...@apache.org> on 2024/09/05 08:10:05 UTC
[PR] GH-43964: [Python] Build macOS and manylinux wheels for free-threading [arrow]
lysnikolaou opened a new pull request, #43965:
URL: https://github.com/apache/arrow/pull/43965
<!--
Thanks for opening a pull request!
If this is your first pull request you can find detailed information on how
to contribute here:
* [New Contributor's Guide](https://arrow.apache.org/docs/dev/developers/guide/step_by_step/pr_lifecycle.html#reviews-and-merge-of-the-pull-request)
* [Contributing Overview](https://arrow.apache.org/docs/dev/developers/overview.html)
If this is not a [minor PR](https://github.com/apache/arrow/blob/main/CONTRIBUTING.md#Minor-Fixes). Could you open an issue for this pull request on GitHub? https://github.com/apache/arrow/issues/new/choose
Opening GitHub issues ahead of time contributes to the [Openness](http://theapacheway.com/open/#:~:text=Openness%20allows%20new%20users%20the,must%20happen%20in%20the%20open.) of the Apache Arrow project.
Then could you also rename the pull request title in the following format?
GH-${GITHUB_ISSUE_ID}: [${COMPONENT}] ${SUMMARY}
or
MINOR: [${COMPONENT}] ${SUMMARY}
In the case of PARQUET issues on JIRA the title also supports:
PARQUET-${JIRA_ISSUE_ID}: [${COMPONENT}] ${SUMMARY}
-->
### Rationale for this change
<!--
Why are you proposing this change? If this is already explained clearly in the issue then this section is not needed.
Explaining clearly why changes are proposed helps reviewers understand your changes and offer better suggestions for fixes.
-->
### What changes are included in this PR?
<!--
There is no need to duplicate the description in the issue here but it is sometimes worth providing a summary of the individual changes in this PR.
-->
### Are these changes tested?
<!--
We typically require tests for all PRs in order to:
1. Prevent the code from being accidentally broken by subsequent changes
2. Serve as another way to document the expected behavior of the code
If tests are not included in your PR, please explain why (for example, are they covered by existing tests)?
-->
### Are there any user-facing changes?
<!--
If there are user-facing changes then we may require documentation to be updated before approving the PR.
-->
<!--
If there are any breaking changes to public APIs, please uncomment the line below and explain which changes are breaking.
-->
<!-- **This PR includes breaking changes to public APIs.** -->
<!--
Please uncomment the line below (and provide explanation) if the changes fix either (a) a security vulnerability, (b) a bug that caused incorrect or invalid data to be produced, or (c) a bug that causes a crash (even when the API contract is upheld). We use this to highlight fixes to issues that may affect users without their knowledge. For this reason, fixing bugs that cause errors don't count, since those are usually obvious.
-->
<!-- **This PR contains a "Critical Fix".** -->
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-43964: [Python] Build macOS and manylinux wheels for free-threading [arrow]
Posted by "pitrou (via GitHub)" <gi...@apache.org>.
pitrou commented on code in PR #43965:
URL: https://github.com/apache/arrow/pull/43965#discussion_r1763259797
##########
ci/docker/python-free-threaded-wheel-manylinux-test-unittests.dockerfile:
##########
@@ -0,0 +1,44 @@
+# Licensed to the Apache Software Foundation (ASF) under one
+# or more contributor license agreements. See the NOTICE file
+# distributed with this work for additional information
+# regarding copyright ownership. The ASF licenses this file
+# to you under the Apache License, Version 2.0 (the
+# "License"); you may not use this file except in compliance
+# with the License. You may obtain a copy of the License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing,
+# software distributed under the License is distributed on an
+# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+# KIND, either express or implied. See the License for the
+# specific language governing permissions and limitations
+# under the License.
+
+ARG base
+FROM ${base}
+
+ENV DEBIAN_FRONTEND=noninteractive
+
+RUN apt-get update
+RUN apt-get install -y -q --no-install-recommends build-essential software-properties-common gpg-agent
+RUN add-apt-repository -y ppa:deadsnakes/ppa && apt-get update
+RUN apt-get install -y -q --no-install-recommends python3.13-dev python3.13-nogil python3.13-venv
+RUN apt-get install -y -q --no-install-recommends libffi-dev
+
+ENV ARROW_PYTHON_VENV /arrow-dev
+RUN python3.13t -m venv ${ARROW_PYTHON_VENV}
+
+ENV PYTHON_GIL 0
+ENV PATH "${ARROW_PYTHON_VENV}/bin:${PATH}"
+
+# pandas doesn't provide wheels for aarch64 yet, so we have to install nightly Cython
+# along with the rest of pandas' build dependencies and disable build isolation
+COPY python/requirements-wheel-test.txt /arrow/python/
+RUN python -m pip install \
+ --pre \
+ --prefer-binary \
+ --extra-index-url "https://pypi.anaconda.org/scientific-python-nightly-wheels/simple" \
+ Cython numpy
+RUN python -m pip install "meson-python==0.13.1" "meson==1.2.1" wheel "versioneer[toml]" ninja
Review Comment:
I'm curious, Pandas requires meson and ninja nowadays?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-43964: [Python] Build macOS and manylinux wheels for free-threading [arrow]
Posted by "lysnikolaou (via GitHub)" <gi...@apache.org>.
lysnikolaou commented on code in PR #43965:
URL: https://github.com/apache/arrow/pull/43965#discussion_r1763328729
##########
docker-compose.yml:
##########
@@ -1175,6 +1177,25 @@ services:
CHECK_WHEEL_CONTENT: "ON"
command: /arrow/ci/scripts/python_wheel_unix_test.sh /arrow
+ # TODO: Remove this when the official Docker Python image supports the free-threaded build
Review Comment:
Added.
##########
dev/tasks/tasks.yml:
##########
@@ -435,21 +438,25 @@ tasks:
{% endfor %}
- wheel-macos-monterey-{{ python_tag }}-arm64:
+ wheel-macos-monterey-{{ python_tag }}-{{ abi_tag }}-arm64:
ci: github
template: python-wheels/github.osx.yml
params:
arch: "arm64"
arrow_jemalloc: "OFF"
python_version: "{{ python_version }}"
+ python_abi_tag: "{{ abi_tag }}"
macos_deployment_target: "12.0"
runs_on: "macos-14"
vcpkg_arch: "arm64"
artifacts:
- - pyarrow-{no_rc_version}-{{ python_tag }}-{{ python_tag }}-macosx_12_0_arm64.whl
+ - pyarrow-{no_rc_version}-{{ python_tag }}-{{ abi_tag }}-macosx_12_0_arm64.whl
{############################## Wheel Windows ################################}
+# TODO: Remove this when there's NumPy wheels for Windows
Review Comment:
Done.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-43964: [Python] Build macOS and manylinux wheels for free-threading [arrow]
Posted by "pitrou (via GitHub)" <gi...@apache.org>.
pitrou commented on code in PR #43965:
URL: https://github.com/apache/arrow/pull/43965#discussion_r1763288901
##########
docker-compose.yml:
##########
@@ -1175,6 +1177,25 @@ services:
CHECK_WHEEL_CONTENT: "ON"
command: /arrow/ci/scripts/python_wheel_unix_test.sh /arrow
+ # TODO: Remove this when the official Docker Python image supports the free-threaded build
Review Comment:
Is there an upstream ticket we can link to here?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-43964: [Python] Build macOS and manylinux wheels for free-threading [arrow]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #43965:
URL: https://github.com/apache/arrow/pull/43965#issuecomment-2338308753
Revision: 7fd6c084720fa9c729dceb7609eafe41d6ba79e6
Submitted crossbow builds: [ursacomputing/crossbow @ actions-3d24c7a697](https://github.com/ursacomputing/crossbow/branches/all?query=actions-3d24c7a697)
|Task|Status|
|----|------|
|wheel-macos-monterey-cp313-cp313t-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10775473638/job/29879956669)|
|wheel-macos-monterey-cp313-cp313t-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/10775473633/job/29879956636)|
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-43964: [Python] Build macOS and manylinux wheels for free-threading [arrow]
Posted by "jorisvandenbossche (via GitHub)" <gi...@apache.org>.
jorisvandenbossche commented on code in PR #43965:
URL: https://github.com/apache/arrow/pull/43965#discussion_r1756722317
##########
ci/docker/python-free-threaded-wheel-manylinux-test-unittests.dockerfile:
##########
@@ -0,0 +1,44 @@
+# Licensed to the Apache Software Foundation (ASF) under one
+# or more contributor license agreements. See the NOTICE file
+# distributed with this work for additional information
+# regarding copyright ownership. The ASF licenses this file
+# to you under the Apache License, Version 2.0 (the
+# "License"); you may not use this file except in compliance
+# with the License. You may obtain a copy of the License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing,
+# software distributed under the License is distributed on an
+# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+# KIND, either express or implied. See the License for the
+# specific language governing permissions and limitations
+# under the License.
+
+ARG base
+FROM ${base}
+
+ENV DEBIAN_FRONTEND=noninteractive
+
+RUN apt-get update
+RUN apt-get install -y -q --no-install-recommends build-essential software-properties-common gpg-agent
+RUN add-apt-repository -y ppa:deadsnakes/ppa && apt-get update
+RUN apt-get install -y -q --no-install-recommends python3.13-dev python3.13-nogil python3.13-venv
+RUN apt-get install -y -q --no-install-recommends libffi-dev
+
+ENV ARROW_PYTHON_VENV /arrow-dev
+RUN python3.13t -m venv ${ARROW_PYTHON_VENV}
+
+ENV PYTHON /arrow-dev/bin/python
+ENV PYTHON_GIL 0
+
+# pandas doesn't provide wheels for aarch64 yet, so we have to install nightly Cython
+# along with the rest of pandas' build dependencies and disable build isolation
+COPY python/requirements-wheel-test.txt /arrow/python/
+RUN ${PYTHON} -m pip install \
+ --pre \
+ --prefer-binary \
+ --extra-index-url "https://pypi.anaconda.org/scientific-python-nightly-wheels/simple" \
+ Cython
+RUN ${PYTHON} -m pip install "meson-python==0.13.1" "meson==1.2.1" "wheel" "versioneer[toml]"
Review Comment:
https://mesonbuild.com/Quick-guide.html#troubleshooting
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-43964: [Python] Build macOS and manylinux wheels for free-threading [arrow]
Posted by "lysnikolaou (via GitHub)" <gi...@apache.org>.
lysnikolaou commented on PR #43965:
URL: https://github.com/apache/arrow/pull/43965#issuecomment-2345996528
I tried to look more into this, but couldn't figure out what's going wrong. On my arm64 macOS host, everything is okay.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-43964: [Python] Build macOS and manylinux wheels for free-threading [arrow]
Posted by "lysnikolaou (via GitHub)" <gi...@apache.org>.
lysnikolaou commented on PR #43965:
URL: https://github.com/apache/arrow/pull/43965#issuecomment-2340622478
Can we run `wheel-manylinux-*` again please?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-43964: [Python] Build macOS and manylinux wheels for free-threading [arrow]
Posted by "pitrou (via GitHub)" <gi...@apache.org>.
pitrou commented on PR #43965:
URL: https://github.com/apache/arrow/pull/43965#issuecomment-2356325960
@github-actions crossbow submit wheel*cp312* wheel*cp313*
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-43964: [Python] Build macOS and manylinux wheels for free-threading [arrow]
Posted by "pitrou (via GitHub)" <gi...@apache.org>.
pitrou commented on PR #43965:
URL: https://github.com/apache/arrow/pull/43965#issuecomment-2357785470
@github-actions crossbow submit wheel-macos-* wheel*linux*
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-43964: [Python] Build macOS and manylinux wheels for free-threading [arrow]
Posted by "lysnikolaou (via GitHub)" <gi...@apache.org>.
lysnikolaou commented on PR #43965:
URL: https://github.com/apache/arrow/pull/43965#issuecomment-2354965331
Ok, I ran `archery crossbow` through a debugger after following [the instructions](https://arrow.apache.org/docs/dev/developers/crossbow.html) (BTW they're really helpful, but they probably need to be updated for Github Actions as well). Turns out it was just a simple config error. It should be okay now.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-43964: [Python] Build macOS and manylinux wheels for free-threading [arrow]
Posted by "jorisvandenbossche (via GitHub)" <gi...@apache.org>.
jorisvandenbossche commented on PR #43965:
URL: https://github.com/apache/arrow/pull/43965#issuecomment-2355126103
@github-actions crossbow submit wheel-*-cp313t*
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-43964: [Python] Build macOS and manylinux wheels for free-threading [arrow]
Posted by "pitrou (via GitHub)" <gi...@apache.org>.
pitrou commented on PR #43965:
URL: https://github.com/apache/arrow/pull/43965#issuecomment-2355463633
I've restarted them.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-43964: [Python] Build macOS and manylinux wheels for free-threading [arrow]
Posted by "lysnikolaou (via GitHub)" <gi...@apache.org>.
lysnikolaou commented on PR #43965:
URL: https://github.com/apache/arrow/pull/43965#issuecomment-2352503966
Cython nightly has been updated. Shall we rerun the wheel jobs?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-43964: [Python] Build macOS and manylinux wheels for free-threading [arrow]
Posted by "jorisvandenbossche (via GitHub)" <gi...@apache.org>.
jorisvandenbossche commented on PR #43965:
URL: https://github.com/apache/arrow/pull/43965#issuecomment-2340090333
Based on the wheel file name in the upload step in the arm64 build, it seems it tries to upload a non-free-threaded cp313 wheel (instead of cp313t), but a normal one. Although it certainly did build the cp313t wheel (maybe that is related to why it is failing to upload?)
There is also still a warning about cffi enabling the GIL, so there needs to be a `PYTHON_GIL=0` somewhere?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-43964: [Python] Build macOS and manylinux wheels for free-threading [arrow]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #43965:
URL: https://github.com/apache/arrow/pull/43965#issuecomment-2346136068
Revision: 58832e2113ac8a5001048e238fa5397f5492c5a5
Submitted crossbow builds: [ursacomputing/crossbow @ actions-288089f853](https://github.com/ursacomputing/crossbow/branches/all?query=actions-288089f853)
|Task|Status|
|----|------|
|wheel-macos-monterey-cp313-cp313t-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10830658141/job/30050893035)|
|wheel-macos-monterey-cp313-cp313t-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/10830658131/job/30050893859)|
|wheel-manylinux-2-28-cp313-cp313t-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10830658122/job/30050893045)|
|wheel-manylinux-2-28-cp313-cp313t-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/10830658217/job/30050893010)|
|wheel-manylinux-2014-cp313-cp313t-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10830658138/job/30050893034)|
|wheel-manylinux-2014-cp313-cp313t-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/10830658126/job/30050893853)|
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-43964: [Python] Build macOS and manylinux wheels for free-threading [arrow]
Posted by "jorisvandenbossche (via GitHub)" <gi...@apache.org>.
jorisvandenbossche commented on code in PR #43965:
URL: https://github.com/apache/arrow/pull/43965#discussion_r1761185214
##########
.env:
##########
@@ -72,6 +72,7 @@ NUMPY=latest
PANDAS=latest
PYTHON=3.8
PYTHON_IMAGE_TAG=3.8
+PYTHON_ABI_TAG=cp38
Review Comment:
```suggestion
PYTHON_ABI_TAG=cp39
```
I just merged the PR to drop Python 3.8, so can bump this new variable as well (and there will be some small merge conflicts to solve, sorry!)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-43964: [Python] Build macOS and manylinux wheels for free-threading [arrow]
Posted by "raulcd (via GitHub)" <gi...@apache.org>.
raulcd commented on PR #43965:
URL: https://github.com/apache/arrow/pull/43965#issuecomment-2352571758
@github-actions crossbow submit wheel-*-cp313t*
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-43964: [Python] Build macOS and manylinux wheels for free-threading [arrow]
Posted by "lysnikolaou (via GitHub)" <gi...@apache.org>.
lysnikolaou commented on PR #43965:
URL: https://github.com/apache/arrow/pull/43965#issuecomment-2355435934
The two manylinux arm64 failures look like temporary glitches? Should we rerun them?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-43964: [Python] Build macOS and manylinux wheels for free-threading [arrow]
Posted by "pitrou (via GitHub)" <gi...@apache.org>.
pitrou commented on code in PR #43965:
URL: https://github.com/apache/arrow/pull/43965#discussion_r1763264763
##########
ci/scripts/install_python.sh:
##########
@@ -61,15 +62,38 @@ if [ $platform = "macOS" ]; then
wget "https://www.python.org/ftp/python/${full_version}/${fname}"
echo "Installing Python..."
- installer -pkg $fname -target /
+ if [[ $2 == "3.13t" ]]; then
+ cat > ./choicechanges.plist <<EOF
Review Comment:
Is there a URL reference that you can give in comment for this?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-43964: [Python] Build macOS and manylinux wheels for free-threading [arrow]
Posted by "lysnikolaou (via GitHub)" <gi...@apache.org>.
lysnikolaou commented on PR #43965:
URL: https://github.com/apache/arrow/pull/43965#issuecomment-2356324597
> I see this error on a regular Python 3.13 wheel test:
>
> ```
> Fatal Python error: config_read_gil: Disabling the GIL is not supported by this build
> Python runtime state: preinitialized
> ```
>
> https://github.com/ursacomputing/crossbow/actions/runs/10906089565/job/30266520154#step:17:39
Hmm, good catch. Fixed, along with removing `--no-build-isolation` from macOS now that `pandas` wheels for macOS.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-43964: [Python] Build macOS and manylinux wheels for free-threading [arrow]
Posted by "jorisvandenbossche (via GitHub)" <gi...@apache.org>.
jorisvandenbossche commented on PR #43965:
URL: https://github.com/apache/arrow/pull/43965#issuecomment-2358773738
> It seems that compiling Pandas' dev version on arm64 can sometimes fail:
We could potentially also skip installing pandas when testing the arm64 cp313t wheels, if it turns out to be unstable (given it's not a required test dependency)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-43964: [Python] Build macOS and manylinux wheels for free-threading [arrow]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #43965:
URL: https://github.com/apache/arrow/pull/43965#issuecomment-2355133531
Revision: c05158da8f91f4f313965e3f86a1c4c6690dc148
Submitted crossbow builds: [ursacomputing/crossbow @ actions-8ae41d1ef4](https://github.com/ursacomputing/crossbow/branches/all?query=actions-8ae41d1ef4)
|Task|Status|
|----|------|
|wheel-macos-monterey-cp313-cp313t-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10900764552/job/30249103638)|
|wheel-macos-monterey-cp313-cp313t-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/10900764575/job/30249103660)|
|wheel-manylinux-2-28-cp313-cp313t-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10900764571/job/30249103753)|
|wheel-manylinux-2-28-cp313-cp313t-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/10900764554/job/30249103900)|
|wheel-manylinux-2014-cp313-cp313t-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10900764559/job/30249103622)|
|wheel-manylinux-2014-cp313-cp313t-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/10900764662/job/30249104054)|
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-43964: [Python] Build macOS and manylinux wheels for free-threading [arrow]
Posted by "lysnikolaou (via GitHub)" <gi...@apache.org>.
lysnikolaou commented on PR #43965:
URL: https://github.com/apache/arrow/pull/43965#issuecomment-2355976899
Btw, I found out that I can run the jobs myself, using my own repo as a job queue. So here's a couple of jobs after the latest changes to the `github.osx.yml` file (that changed the disabling of build isolation to only happen for free-threaded wheels).
- [github-wheel-macos-monterey-cp313-cp313t-arm64](https://github.com/lysnikolaou/crossbow/actions/runs/10904554381/job/30261266266)
- [github-wheel-macos-monterey-cp313-cp313t-amd64](https://github.com/lysnikolaou/crossbow/actions/runs/10904554383/job/30261266203)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-43964: [Python] Build macOS and manylinux wheels for free-threading [arrow]
Posted by "jorisvandenbossche (via GitHub)" <gi...@apache.org>.
jorisvandenbossche commented on PR #43965:
URL: https://github.com/apache/arrow/pull/43965#issuecomment-2330988337
@github-actions crossbow submit -g wheel
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-43964: [Python] Build macOS and manylinux wheels for free-threading [arrow]
Posted by "lysnikolaou (via GitHub)" <gi...@apache.org>.
lysnikolaou commented on PR #43965:
URL: https://github.com/apache/arrow/pull/43965#issuecomment-2355807952
Looks like everything's passing now! So this might be ready to be merged.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-43964: [Python] Build macOS and manylinux wheels for free-threading [arrow]
Posted by "pitrou (via GitHub)" <gi...@apache.org>.
pitrou commented on PR #43965:
URL: https://github.com/apache/arrow/pull/43965#issuecomment-2356538038
Ahah! Nice find, and sorry for the disruption.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-43964: [Python] Build macOS and manylinux wheels for free-threading [arrow]
Posted by "conbench-apache-arrow[bot] (via GitHub)" <gi...@apache.org>.
conbench-apache-arrow[bot] commented on PR #43965:
URL: https://github.com/apache/arrow/pull/43965#issuecomment-2358904628
After merging your PR, Conbench analyzed the 4 benchmarking runs that have been run so far on merge-commit 1c1f7f359d61b59e446b0a47e0279728551ed89f.
There were no benchmark performance regressions. 🎉
The [full Conbench report](https://github.com/apache/arrow/runs/30329480678) has more details. It also includes information about 11 possible false positives for unstable benchmarks that are known to sometimes produce them.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-43964: [Python] Build macOS and manylinux wheels for free-threading [arrow]
Posted by "jorisvandenbossche (via GitHub)" <gi...@apache.org>.
jorisvandenbossche commented on PR #43965:
URL: https://github.com/apache/arrow/pull/43965#issuecomment-2338068003
@github-actions crossbow submit -g wheel
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-43964: [Python] Build macOS and manylinux wheels for free-threading [arrow]
Posted by "lysnikolaou (via GitHub)" <gi...@apache.org>.
lysnikolaou commented on PR #43965:
URL: https://github.com/apache/arrow/pull/43965#issuecomment-2341093228
The two `cp313t-arm64` jobs now fail to pull an image with:
```
#2 [python-free-threaded-wheel-manylinux-test-imports internal] load metadata for docker.io/arm64v8/ubuntu:20.04
--progress is a global compose flag, better use `docker compose --progress xx build ...failed to solve: arm64v8/ubuntu:20.04: failed to resolve source metadata for docker.io/arm64v8/ubuntu:20.04: failed to authorize: failed to fetch oauth token: unexpected status from POST request to https://auth.docker.io/token: 502 Bad Gateway
#2 ERROR: failed to authorize: failed to fetch oauth token: unexpected status from POST request to https://auth.docker.io/token: 502 Bad Gateway
```
Any clues as to what might be going wrong there?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-43964: [Python] Build macOS and manylinux wheels for free-threading [arrow]
Posted by "jorisvandenbossche (via GitHub)" <gi...@apache.org>.
jorisvandenbossche commented on PR #43965:
URL: https://github.com/apache/arrow/pull/43965#issuecomment-2346152100
> Additionally, we still need to figure out what's going wrong with `archery crossbow` trying to upload a non-free-threaded wheel to the nightlies index. I tried to look around but wasn't able to find what's wrong. I can look deeper if you give me a few pointers.
Looking at the failure above again, I think I was wrong with using "upload", because it was the "Verify uploaded artifacts" step that was failing. But indeed then for arm64 it was for some reason trying to verify the wrong wheel name (without the "t").
If that is still failing now in the latest run (it might also have been some temporary glitch?), you could maybe add some debug prints to `dev/archery/archery/crossbow/reports.py` which is the code that is doing this verification (`ConsoleReport.show()` I think, from the `status` function in `dev/archery/archery/crossbow/cli.py`)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-43964: [Python] Build macOS and manylinux wheels for free-threading [arrow]
Posted by "lysnikolaou (via GitHub)" <gi...@apache.org>.
lysnikolaou commented on PR #43965:
URL: https://github.com/apache/arrow/pull/43965#issuecomment-2338258509
Not sure why the `install_python` script fails. The failure seems like the `$PYTHON` environment variable is not defined, but I'm pretty sure it is defined in `github.osx.yml`. I've pushed a commit that falls back to explicitly declaring the `$python` bash variable inside the script.
Let's please rerun the jobs. (maybe only the macos ones?)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-43964: [Python] Build macOS and manylinux wheels for free-threading [arrow]
Posted by "jorisvandenbossche (via GitHub)" <gi...@apache.org>.
jorisvandenbossche commented on PR #43965:
URL: https://github.com/apache/arrow/pull/43965#issuecomment-2346131380
@github-actions crossbow submit wheel*cp313t*
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-43964: [Python] Build macOS and manylinux wheels for free-threading [arrow]
Posted by "lysnikolaou (via GitHub)" <gi...@apache.org>.
lysnikolaou commented on PR #43965:
URL: https://github.com/apache/arrow/pull/43965#issuecomment-2354904029
Building and testing the free-threaded wheels succeeds now. Only thing remaining is `archery crossbow` and how it tries to validate the wrong wheel on arm64 macOS. I had a look, but I couldn't understand the code around there too much.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-43964: [Python] Build macOS and manylinux wheels for free-threading [arrow]
Posted by "pitrou (via GitHub)" <gi...@apache.org>.
pitrou commented on PR #43965:
URL: https://github.com/apache/arrow/pull/43965#issuecomment-2357909817
Ok, hopefully it won't break too often then...
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-43964: [Python] Build macOS and manylinux wheels for free-threading [arrow]
Posted by "pitrou (via GitHub)" <gi...@apache.org>.
pitrou merged PR #43965:
URL: https://github.com/apache/arrow/pull/43965
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-43964: [Python] Build macOS and manylinux wheels for free-threading [arrow]
Posted by "pitrou (via GitHub)" <gi...@apache.org>.
pitrou commented on code in PR #43965:
URL: https://github.com/apache/arrow/pull/43965#discussion_r1763270672
##########
dev/tasks/python-wheels/github.osx.yml:
##########
@@ -136,11 +141,17 @@ jobs:
- name: Test Wheel
env:
PYTEST_ADDOPTS: "-k 'not test_cancellation'"
+ PYTHON_GIL: 0
run: |
$PYTHON -m venv test-env
source test-env/bin/activate
pip install --upgrade pip wheel
- arch -{{ arch }} pip install -r arrow/python/requirements-wheel-test.txt
+ arch -{{ arch }} pip install --pre \
Review Comment:
Shouldn't this be only for free-threaded wheels? Regular wheels should work fine with PyPI-originating packages, and we want to ensure that.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-43964: [Python] Build macOS and manylinux wheels for free-threading [arrow]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #43965:
URL: https://github.com/apache/arrow/pull/43965#issuecomment-2356230147
Revision: d865c960c58ada4c18f4a907866c91d26f3b71ab
Submitted crossbow builds: [ursacomputing/crossbow @ actions-e930e959a3](https://github.com/ursacomputing/crossbow/branches/all?query=actions-e930e959a3)
|Task|Status|
|----|------|
|example-python-minimal-build-fedora-conda|[](https://github.com/ursacomputing/crossbow/actions/runs/10906115969/job/30266608129)|
|example-python-minimal-build-ubuntu-venv|[](https://github.com/ursacomputing/crossbow/actions/runs/10906116468/job/30266610798)|
|test-conda-python-3.10|[](https://github.com/ursacomputing/crossbow/actions/runs/10906116031/job/30266608695)|
|test-conda-python-3.10-cython2|[](https://github.com/ursacomputing/crossbow/actions/runs/10906116503/job/30266611352)|
|test-conda-python-3.10-hdfs-2.9.2|[](https://github.com/ursacomputing/crossbow/actions/runs/10906116246/job/30266609803)|
|test-conda-python-3.10-hdfs-3.2.1|[](https://github.com/ursacomputing/crossbow/actions/runs/10906116535/job/30266611386)|
|test-conda-python-3.10-pandas-latest-numpy-latest|[](https://github.com/ursacomputing/crossbow/actions/runs/10906116842/job/30266613332)|
|test-conda-python-3.10-substrait|[](https://github.com/ursacomputing/crossbow/actions/runs/10906116137/job/30266609123)|
|test-conda-python-3.11|[](https://github.com/ursacomputing/crossbow/actions/runs/10906116632/job/30266612099)|
|test-conda-python-3.11-dask-latest|[](https://github.com/ursacomputing/crossbow/actions/runs/10906116322/job/30266610412)|
|test-conda-python-3.11-dask-upstream_devel|[](https://github.com/ursacomputing/crossbow/actions/runs/10906116283/job/30266610370)|
|test-conda-python-3.11-hypothesis|[](https://github.com/ursacomputing/crossbow/actions/runs/10906115919/job/30266608155)|
|test-conda-python-3.11-pandas-latest-numpy-1.26|[](https://github.com/ursacomputing/crossbow/actions/runs/10906116512/job/30266611339)|
|test-conda-python-3.11-pandas-latest-numpy-latest|[](https://github.com/ursacomputing/crossbow/actions/runs/10906116858/job/30266614485)|
|test-conda-python-3.11-pandas-nightly-numpy-nightly|[](https://github.com/ursacomputing/crossbow/actions/runs/10906116424/job/30266610785)|
|test-conda-python-3.11-pandas-upstream_devel-numpy-nightly|[](https://github.com/ursacomputing/crossbow/actions/runs/10906116342/job/30266610092)|
|test-conda-python-3.11-spark-master|[](https://github.com/ursacomputing/crossbow/actions/runs/10906116901/job/30266614870)|
|test-conda-python-3.12|[](https://github.com/ursacomputing/crossbow/actions/runs/10906116696/job/30266612941)|
|test-conda-python-3.12-cpython-debug|[](https://github.com/ursacomputing/crossbow/actions/runs/10906116576/job/30266612137)|
|test-conda-python-3.9|[](https://github.com/ursacomputing/crossbow/actions/runs/10906116896/job/30266614848)|
|test-conda-python-3.9-pandas-1.1.3-numpy-1.19.5|[](https://github.com/ursacomputing/crossbow/actions/runs/10906116739/job/30266613314)|
|test-conda-python-emscripten|[](https://github.com/ursacomputing/crossbow/actions/runs/10906116775/job/30266614515)|
|test-cuda-python-ubuntu-22.04-cuda-11.7.1|[](https://github.com/ursacomputing/crossbow/actions/runs/10906116756/job/30266613322)|
|test-debian-12-python-3-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10906116181/job/30266609112)|
|test-debian-12-python-3-i386|[](https://github.com/ursacomputing/crossbow/actions/runs/10906116730/job/30266612938)|
|test-fedora-39-python-3|[](https://github.com/ursacomputing/crossbow/actions/runs/10906115993/job/30266608597)|
|test-ubuntu-22.04-python-3|[](https://github.com/ursacomputing/crossbow/actions/runs/10906116608/job/30266612107)|
|test-ubuntu-22.04-python-313-freethreading|[](https://github.com/ursacomputing/crossbow/actions/runs/10906116380/job/30266610057)|
|test-ubuntu-24.04-python-3|[](https://github.com/ursacomputing/crossbow/actions/runs/10906116729/job/30266612905)|
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-43964: [Python] Build macOS and manylinux wheels for free-threading [arrow]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #43965:
URL: https://github.com/apache/arrow/pull/43965#issuecomment-2356398585
Revision: 8a24b39a92398e506e8949777f85ccaedb8b063d
Submitted crossbow builds: [ursacomputing/crossbow @ actions-9acbb057ba](https://github.com/ursacomputing/crossbow/branches/all?query=actions-9acbb057ba)
|Task|Status|
|----|------|
|python-sdist|[](https://github.com/ursacomputing/crossbow/actions/runs/10906821919/job/30268981615)|
|wheel-macos-monterey-cp310-cp310-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10906821986/job/30268982050)|
|wheel-macos-monterey-cp310-cp310-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/10906821349/job/30268979350)|
|wheel-macos-monterey-cp311-cp311-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10906821417/job/30268979345)|
|wheel-macos-monterey-cp311-cp311-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/10906822221/job/30268982816)|
|wheel-macos-monterey-cp312-cp312-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10906822062/job/30268982189)|
|wheel-macos-monterey-cp312-cp312-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/10906821789/job/30268981044)|
|wheel-macos-monterey-cp313-cp313-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10906821404/job/30268979295)|
|wheel-macos-monterey-cp313-cp313-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/10906821641/job/30268980174)|
|wheel-macos-monterey-cp313-cp313t-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10906821772/job/30268980729)|
|wheel-macos-monterey-cp313-cp313t-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/10906821896/job/30268981580)|
|wheel-macos-monterey-cp39-cp39-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10906822114/job/30268982275)|
|wheel-macos-monterey-cp39-cp39-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/10906821806/job/30268981002)|
|wheel-manylinux-2-28-cp310-cp310-amd64|[](https://github.com/ursacomputing/crossbow/tree/actions-9acbb057ba-github-wheel-manylinux-2-28-cp310-cp310-amd64)|
|wheel-manylinux-2-28-cp310-cp310-arm64|[](https://github.com/ursacomputing/crossbow/tree/actions-9acbb057ba-github-wheel-manylinux-2-28-cp310-cp310-arm64)|
|wheel-manylinux-2-28-cp311-cp311-amd64|[](https://github.com/ursacomputing/crossbow/tree/actions-9acbb057ba-github-wheel-manylinux-2-28-cp311-cp311-amd64)|
|wheel-manylinux-2-28-cp311-cp311-arm64|[](https://github.com/ursacomputing/crossbow/tree/actions-9acbb057ba-github-wheel-manylinux-2-28-cp311-cp311-arm64)|
|wheel-manylinux-2-28-cp312-cp312-amd64|[](https://github.com/ursacomputing/crossbow/tree/actions-9acbb057ba-github-wheel-manylinux-2-28-cp312-cp312-amd64)|
|wheel-manylinux-2-28-cp312-cp312-arm64|[](https://github.com/ursacomputing/crossbow/tree/actions-9acbb057ba-github-wheel-manylinux-2-28-cp312-cp312-arm64)|
|wheel-manylinux-2-28-cp313-cp313-amd64|[](https://github.com/ursacomputing/crossbow/tree/actions-9acbb057ba-github-wheel-manylinux-2-28-cp313-cp313-amd64)|
|wheel-manylinux-2-28-cp313-cp313-arm64|[](https://github.com/ursacomputing/crossbow/tree/actions-9acbb057ba-github-wheel-manylinux-2-28-cp313-cp313-arm64)|
|wheel-manylinux-2-28-cp313-cp313t-amd64|[](https://github.com/ursacomputing/crossbow/tree/actions-9acbb057ba-github-wheel-manylinux-2-28-cp313-cp313t-amd64)|
|wheel-manylinux-2-28-cp313-cp313t-arm64|[](https://github.com/ursacomputing/crossbow/tree/actions-9acbb057ba-github-wheel-manylinux-2-28-cp313-cp313t-arm64)|
|wheel-manylinux-2-28-cp39-cp39-amd64|[](https://github.com/ursacomputing/crossbow/tree/actions-9acbb057ba-github-wheel-manylinux-2-28-cp39-cp39-amd64)|
|wheel-manylinux-2-28-cp39-cp39-arm64|[](https://github.com/ursacomputing/crossbow/tree/actions-9acbb057ba-github-wheel-manylinux-2-28-cp39-cp39-arm64)|
|wheel-manylinux-2014-cp310-cp310-amd64|[](https://github.com/ursacomputing/crossbow/tree/actions-9acbb057ba-github-wheel-manylinux-2014-cp310-cp310-amd64)|
|wheel-manylinux-2014-cp310-cp310-arm64|[](https://github.com/ursacomputing/crossbow/tree/actions-9acbb057ba-github-wheel-manylinux-2014-cp310-cp310-arm64)|
|wheel-manylinux-2014-cp311-cp311-amd64|[](https://github.com/ursacomputing/crossbow/tree/actions-9acbb057ba-github-wheel-manylinux-2014-cp311-cp311-amd64)|
|wheel-manylinux-2014-cp311-cp311-arm64|[](https://github.com/ursacomputing/crossbow/tree/actions-9acbb057ba-github-wheel-manylinux-2014-cp311-cp311-arm64)|
|wheel-manylinux-2014-cp312-cp312-amd64|[](https://github.com/ursacomputing/crossbow/tree/actions-9acbb057ba-github-wheel-manylinux-2014-cp312-cp312-amd64)|
|wheel-manylinux-2014-cp312-cp312-arm64|[](https://github.com/ursacomputing/crossbow/tree/actions-9acbb057ba-github-wheel-manylinux-2014-cp312-cp312-arm64)|
|wheel-manylinux-2014-cp313-cp313-amd64|[](https://github.com/ursacomputing/crossbow/tree/actions-9acbb057ba-github-wheel-manylinux-2014-cp313-cp313-amd64)|
|wheel-manylinux-2014-cp313-cp313-arm64|[](https://github.com/ursacomputing/crossbow/tree/actions-9acbb057ba-github-wheel-manylinux-2014-cp313-cp313-arm64)|
|wheel-manylinux-2014-cp313-cp313t-amd64|[](https://github.com/ursacomputing/crossbow/tree/actions-9acbb057ba-github-wheel-manylinux-2014-cp313-cp313t-amd64)|
|wheel-manylinux-2014-cp313-cp313t-arm64|[](https://github.com/ursacomputing/crossbow/tree/actions-9acbb057ba-github-wheel-manylinux-2014-cp313-cp313t-arm64)|
|wheel-manylinux-2014-cp39-cp39-amd64|[](https://github.com/ursacomputing/crossbow/tree/actions-9acbb057ba-github-wheel-manylinux-2014-cp39-cp39-amd64)|
|wheel-manylinux-2014-cp39-cp39-arm64|[](https://github.com/ursacomputing/crossbow/tree/actions-9acbb057ba-github-wheel-manylinux-2014-cp39-cp39-arm64)|
|wheel-windows-cp310-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10906821505/job/30268979790)|
|wheel-windows-cp311-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10906821758/job/30268980673)|
|wheel-windows-cp312-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10906822117/job/30268982562)|
|wheel-windows-cp313-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10906821878/job/30268981636)|
|wheel-windows-cp39-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10906822099/job/30268982372)|
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-43964: [Python] Build macOS and manylinux wheels for free-threading [arrow]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #43965:
URL: https://github.com/apache/arrow/pull/43965#issuecomment-2356356820
Revision: 8a24b39a92398e506e8949777f85ccaedb8b063d
Submitted crossbow builds: [ursacomputing/crossbow @ actions-db6da84ae3](https://github.com/ursacomputing/crossbow/branches/all?query=actions-db6da84ae3)
|Task|Status|
|----|------|
|wheel-macos-monterey-cp312-cp312-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10906688863/job/30268517557)|
|wheel-macos-monterey-cp312-cp312-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/10906688846/job/30268517247)|
|wheel-macos-monterey-cp313-cp313-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10906689060/job/30268518149)|
|wheel-macos-monterey-cp313-cp313-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/10906689202/job/30268518536)|
|wheel-macos-monterey-cp313-cp313t-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10906688757/job/30268517216)|
|wheel-macos-monterey-cp313-cp313t-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/10906688867/job/30268517584)|
|wheel-manylinux-2-28-cp312-cp312-amd64|[](https://github.com/ursacomputing/crossbow/tree/actions-db6da84ae3-github-wheel-manylinux-2-28-cp312-cp312-amd64)|
|wheel-manylinux-2-28-cp312-cp312-arm64|[](https://github.com/ursacomputing/crossbow/tree/actions-db6da84ae3-github-wheel-manylinux-2-28-cp312-cp312-arm64)|
|wheel-manylinux-2-28-cp313-cp313-amd64|[](https://github.com/ursacomputing/crossbow/tree/actions-db6da84ae3-github-wheel-manylinux-2-28-cp313-cp313-amd64)|
|wheel-manylinux-2-28-cp313-cp313-arm64|[](https://github.com/ursacomputing/crossbow/tree/actions-db6da84ae3-github-wheel-manylinux-2-28-cp313-cp313-arm64)|
|wheel-manylinux-2-28-cp313-cp313t-amd64|[](https://github.com/ursacomputing/crossbow/tree/actions-db6da84ae3-github-wheel-manylinux-2-28-cp313-cp313t-amd64)|
|wheel-manylinux-2-28-cp313-cp313t-arm64|[](https://github.com/ursacomputing/crossbow/tree/actions-db6da84ae3-github-wheel-manylinux-2-28-cp313-cp313t-arm64)|
|wheel-manylinux-2014-cp312-cp312-amd64|[](https://github.com/ursacomputing/crossbow/tree/actions-db6da84ae3-github-wheel-manylinux-2014-cp312-cp312-amd64)|
|wheel-manylinux-2014-cp312-cp312-arm64|[](https://github.com/ursacomputing/crossbow/tree/actions-db6da84ae3-github-wheel-manylinux-2014-cp312-cp312-arm64)|
|wheel-manylinux-2014-cp313-cp313-amd64|[](https://github.com/ursacomputing/crossbow/tree/actions-db6da84ae3-github-wheel-manylinux-2014-cp313-cp313-amd64)|
|wheel-manylinux-2014-cp313-cp313-arm64|[](https://github.com/ursacomputing/crossbow/tree/actions-db6da84ae3-github-wheel-manylinux-2014-cp313-cp313-arm64)|
|wheel-manylinux-2014-cp313-cp313t-amd64|[](https://github.com/ursacomputing/crossbow/tree/actions-db6da84ae3-github-wheel-manylinux-2014-cp313-cp313t-amd64)|
|wheel-manylinux-2014-cp313-cp313t-arm64|[](https://github.com/ursacomputing/crossbow/tree/actions-db6da84ae3-github-wheel-manylinux-2014-cp313-cp313t-arm64)|
|wheel-windows-cp312-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10906688769/job/30268517211)|
|wheel-windows-cp313-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10906689082/job/30268518231)|
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-43964: [Python] Build macOS and manylinux wheels for free-threading [arrow]
Posted by "lysnikolaou (via GitHub)" <gi...@apache.org>.
lysnikolaou commented on PR #43965:
URL: https://github.com/apache/arrow/pull/43965#issuecomment-2346234591
Can we rerun the two macOS wheel jobs? The failures look like temporary glitches because of a timeout trying to download nigthly Cython from `scientific-python-nightly-wheels`.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-43964: [Python] Build macOS and manylinux wheels for free-threading [arrow]
Posted by "jorisvandenbossche (via GitHub)" <gi...@apache.org>.
jorisvandenbossche commented on PR #43965:
URL: https://github.com/apache/arrow/pull/43965#issuecomment-2346089318
It's failing with `No such file or directory: 'meson'`, so somehow the installed meson is not on the path?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-43964: [Python] Build macOS and manylinux wheels for free-threading [arrow]
Posted by "lysnikolaou (via GitHub)" <gi...@apache.org>.
lysnikolaou commented on PR #43965:
URL: https://github.com/apache/arrow/pull/43965#issuecomment-2355698114
And once more for `wheel-manylinux-2014-cp313-cp313t-arm64`?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-43964: [Python] Build macOS and manylinux wheels for free-threading [arrow]
Posted by "lysnikolaou (via GitHub)" <gi...@apache.org>.
lysnikolaou commented on PR #43965:
URL: https://github.com/apache/arrow/pull/43965#issuecomment-2356501746
Turns out the following construct was indeed needed in `github.linux.yml`:
```
if: |
'{{ python_abi_tag }}' == 'cp313t'
```
Otherwise a syntax error is reported. Probably something to do with how Github evaluates expressions.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-43964: [Python] Build macOS and manylinux wheels for free-threading [arrow]
Posted by "pitrou (via GitHub)" <gi...@apache.org>.
pitrou commented on PR #43965:
URL: https://github.com/apache/arrow/pull/43965#issuecomment-2356255013
I see this error on a regular Python 3.13 wheel test:
```
Fatal Python error: config_read_gil: Disabling the GIL is not supported by this build
Python runtime state: preinitialized
```
https://github.com/ursacomputing/crossbow/actions/runs/10906089565/job/30266520154#step:17:39
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-43964: [Python] Build macOS and manylinux wheels for free-threading [arrow]
Posted by "lysnikolaou (via GitHub)" <gi...@apache.org>.
lysnikolaou commented on code in PR #43965:
URL: https://github.com/apache/arrow/pull/43965#discussion_r1763274351
##########
ci/docker/python-free-threaded-wheel-manylinux-test-unittests.dockerfile:
##########
@@ -0,0 +1,44 @@
+# Licensed to the Apache Software Foundation (ASF) under one
+# or more contributor license agreements. See the NOTICE file
+# distributed with this work for additional information
+# regarding copyright ownership. The ASF licenses this file
+# to you under the Apache License, Version 2.0 (the
+# "License"); you may not use this file except in compliance
+# with the License. You may obtain a copy of the License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing,
+# software distributed under the License is distributed on an
+# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+# KIND, either express or implied. See the License for the
+# specific language governing permissions and limitations
+# under the License.
+
+ARG base
+FROM ${base}
+
+ENV DEBIAN_FRONTEND=noninteractive
+
+RUN apt-get update
+RUN apt-get install -y -q --no-install-recommends build-essential software-properties-common gpg-agent
+RUN add-apt-repository -y ppa:deadsnakes/ppa && apt-get update
+RUN apt-get install -y -q --no-install-recommends python3.13-dev python3.13-nogil python3.13-venv
+RUN apt-get install -y -q --no-install-recommends libffi-dev
+
+ENV ARROW_PYTHON_VENV /arrow-dev
+RUN python3.13t -m venv ${ARROW_PYTHON_VENV}
+
+ENV PYTHON_GIL 0
+ENV PATH "${ARROW_PYTHON_VENV}/bin:${PATH}"
+
+# pandas doesn't provide wheels for aarch64 yet, so we have to install nightly Cython
+# along with the rest of pandas' build dependencies and disable build isolation
+COPY python/requirements-wheel-test.txt /arrow/python/
+RUN python -m pip install \
+ --pre \
+ --prefer-binary \
+ --extra-index-url "https://pypi.anaconda.org/scientific-python-nightly-wheels/simple" \
+ Cython numpy
+RUN python -m pip install "meson-python==0.13.1" "meson==1.2.1" wheel "versioneer[toml]" ninja
Review Comment:
Yes, pandas uses meson/ninja to build.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-43964: [Python] Build macOS and manylinux wheels for free-threading [arrow]
Posted by "lysnikolaou (via GitHub)" <gi...@apache.org>.
lysnikolaou commented on PR #43965:
URL: https://github.com/apache/arrow/pull/43965#issuecomment-2356349305
> crossbow submit wheel_cp312_ wheel_cp313_
Do you see the statuses from this somewhere?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-43964: [Python] Build macOS and manylinux wheels for free-threading [arrow]
Posted by "lysnikolaou (via GitHub)" <gi...@apache.org>.
lysnikolaou commented on PR #43965:
URL: https://github.com/apache/arrow/pull/43965#issuecomment-2331354062
> For linux (where it already succeeds to the testing step), we will also need to get a 3.13t build of the test image (`python-wheel-manylinux-test-unittests`)
Yeah, I'm working on that as well. My understanding was that both `python-wheel-manylinux-test-unittests` and `python-wheel-manylinux-test-imports` need some changes, but they both depend on the Docker official Python images, which do not have a free-threaded variant.
It might make sense for me to work on that, too, but for now, I'm trying to see how to best circumvent that. Maybe start with an ubuntu images and install a Python from deadsnakes?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-43964: [Python] Build macOS and manylinux wheels for free-threading [arrow]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #43965:
URL: https://github.com/apache/arrow/pull/43965#issuecomment-2338074888
Revision: 24ac56e3414eb187b0b520d11578231f53c702e8
Submitted crossbow builds: [ursacomputing/crossbow @ actions-580ab798d7](https://github.com/ursacomputing/crossbow/branches/all?query=actions-580ab798d7)
|Task|Status|
|----|------|
|python-sdist|[](https://github.com/ursacomputing/crossbow/actions/runs/10773786859/job/29874339542)|
|wheel-macos-monterey-cp310-cp310-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10773788176/job/29874350234)|
|wheel-macos-monterey-cp310-cp310-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/10773788065/job/29874350233)|
|wheel-macos-monterey-cp311-cp311-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10773787660/job/29874346058)|
|wheel-macos-monterey-cp311-cp311-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/10773787640/job/29874345646)|
|wheel-macos-monterey-cp312-cp312-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10773787674/job/29874346252)|
|wheel-macos-monterey-cp312-cp312-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/10773787364/job/29874343404)|
|wheel-macos-monterey-cp313-cp313-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10773788009/job/29874349992)|
|wheel-macos-monterey-cp313-cp313-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/10773787560/job/29874345724)|
|wheel-macos-monterey-cp313-cp313t-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10773788364/job/29874351959)|
|wheel-macos-monterey-cp313-cp313t-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/10773787744/job/29874346393)|
|wheel-macos-monterey-cp38-cp38-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10773787911/job/29874348378)|
|wheel-macos-monterey-cp38-cp38-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/10773787117/job/29874341256)|
|wheel-macos-monterey-cp39-cp39-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10773786998/job/29874340485)|
|wheel-macos-monterey-cp39-cp39-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/10773787881/job/29874348358)|
|wheel-manylinux-2-28-cp310-cp310-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10773787464/job/29874345710)|
|wheel-manylinux-2-28-cp310-cp310-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/10773787257/job/29874341893)|
|wheel-manylinux-2-28-cp311-cp311-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10773787794/job/29874346632)|
|wheel-manylinux-2-28-cp311-cp311-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/10773788222/job/29874350564)|
|wheel-manylinux-2-28-cp312-cp312-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10773786976/job/29874340481)|
|wheel-manylinux-2-28-cp312-cp312-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/10773787457/job/29874343998)|
|wheel-manylinux-2-28-cp313-cp313-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10773787995/job/29874349967)|
|wheel-manylinux-2-28-cp313-cp313-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/10773787438/job/29874343934)|
|wheel-manylinux-2-28-cp313-cp313t-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10773788523/job/29874352252)|
|wheel-manylinux-2-28-cp313-cp313t-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/10773788252/job/29874350705)|
|wheel-manylinux-2-28-cp38-cp38-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10773787351/job/29874342774)|
|wheel-manylinux-2-28-cp38-cp38-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/10773787049/job/29874341077)|
|wheel-manylinux-2-28-cp39-cp39-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10773787600/job/29874347273)|
|wheel-manylinux-2-28-cp39-cp39-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/10773788024/job/29874350230)|
|wheel-manylinux-2014-cp310-cp310-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10773787247/job/29874341533)|
|wheel-manylinux-2014-cp310-cp310-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/10773786767/job/29874341412)|
|wheel-manylinux-2014-cp311-cp311-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10773787952/job/29874349908)|
|wheel-manylinux-2014-cp311-cp311-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/10773788003/job/29874349917)|
|wheel-manylinux-2014-cp312-cp312-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10773788451/job/29874352053)|
|wheel-manylinux-2014-cp312-cp312-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/10773787543/job/29874345630)|
|wheel-manylinux-2014-cp313-cp313-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10773788004/job/29874349484)|
|wheel-manylinux-2014-cp313-cp313-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/10773786961/job/29874340007)|
|wheel-manylinux-2014-cp313-cp313t-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10773787141/job/29874341338)|
|wheel-manylinux-2014-cp313-cp313t-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/10773788214/job/29874350539)|
|wheel-manylinux-2014-cp38-cp38-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10773788189/job/29874350375)|
|wheel-manylinux-2014-cp38-cp38-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/10773787700/job/29874346266)|
|wheel-manylinux-2014-cp39-cp39-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10773788358/job/29874351926)|
|wheel-manylinux-2014-cp39-cp39-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/10773786951/job/29874339685)|
|wheel-windows-cp310-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10773788210/job/29874350653)|
|wheel-windows-cp311-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10773787382/job/29874342899)|
|wheel-windows-cp312-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10773787773/job/29874346604)|
|wheel-windows-cp313-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10773787863/job/29874348312)|
|wheel-windows-cp38-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10773788516/job/29874351963)|
|wheel-windows-cp39-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10773786946/job/29874339786)|
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-43964: [Python] Build macOS and manylinux wheels for free-threading [arrow]
Posted by "lysnikolaou (via GitHub)" <gi...@apache.org>.
lysnikolaou commented on PR #43965:
URL: https://github.com/apache/arrow/pull/43965#issuecomment-2338050805
@jorisvandenbossche Could you rerun the wheel building jobs?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-43964: [Python] Build macOS and manylinux wheels for free-threading [arrow]
Posted by "lysnikolaou (via GitHub)" <gi...@apache.org>.
lysnikolaou commented on PR #43965:
URL: https://github.com/apache/arrow/pull/43965#issuecomment-2357798430
> @lysnikolaou Do you also plan to submit a PR for Windows wheels?
Yes, I was planning to do so, as soon as NumPy has a Windows wheel for the `cp313t` ABI.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-43964: [Python] Build macOS and manylinux wheels for free-threading [arrow]
Posted by "pitrou (via GitHub)" <gi...@apache.org>.
pitrou commented on PR #43965:
URL: https://github.com/apache/arrow/pull/43965#issuecomment-2357788055
@lysnikolaou Do you also plan to submit a PR for Windows wheels?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-43964: [Python] Build macOS and manylinux wheels for free-threading [arrow]
Posted by "lysnikolaou (via GitHub)" <gi...@apache.org>.
lysnikolaou commented on PR #43965:
URL: https://github.com/apache/arrow/pull/43965#issuecomment-2357859899
I'm not sure exactly what the plan is about that, but there's definitely challenges to producing `aarch64` wheels. NumPy produces its `aarch64` wheels on CirrusCI, because Github does not provide aarch64 Linux runners to non-entrprise accounts. However, they've indicated that they'll do so by the end of the year, so maybe it makes sense for pandas to wait until then and not introduce another CI service. Either way, I'll open an upstream issue about it.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-43964: [Python] Build macOS and manylinux wheels for free-threading [arrow]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #43965:
URL: https://github.com/apache/arrow/pull/43965#issuecomment-2352576381
Revision: 58832e2113ac8a5001048e238fa5397f5492c5a5
Submitted crossbow builds: [ursacomputing/crossbow @ actions-4a801a92e5](https://github.com/ursacomputing/crossbow/branches/all?query=actions-4a801a92e5)
|Task|Status|
|----|------|
|wheel-macos-monterey-cp313-cp313t-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10882251491/job/30192879957)|
|wheel-macos-monterey-cp313-cp313t-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/10882251276/job/30192879333)|
|wheel-manylinux-2-28-cp313-cp313t-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10882251391/job/30192879955)|
|wheel-manylinux-2-28-cp313-cp313t-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/10882251379/job/30192879789)|
|wheel-manylinux-2014-cp313-cp313t-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10882251246/job/30192879430)|
|wheel-manylinux-2014-cp313-cp313t-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/10882251289/job/30192879328)|
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-43964: [Python] Build macOS and manylinux wheels for free-threading [arrow]
Posted by "jorisvandenbossche (via GitHub)" <gi...@apache.org>.
jorisvandenbossche commented on PR #43965:
URL: https://github.com/apache/arrow/pull/43965#issuecomment-2352844138
@github-actions crossbow submit wheel-*-cp313t*
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-43964: [Python] Build macOS and manylinux wheels for free-threading [arrow]
Posted by "lysnikolaou (via GitHub)" <gi...@apache.org>.
lysnikolaou commented on PR #43965:
URL: https://github.com/apache/arrow/pull/43965#issuecomment-2352757493
The docker-compose jobs pass locally on my macOS host now. Should be good to try another time.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-43964: [Python] Build macOS and manylinux wheels for free-threading [arrow]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #43965:
URL: https://github.com/apache/arrow/pull/43965#issuecomment-2353716902
Revision: 6197237099357e68b78d3ca2f4d30524d2e45bd0
Submitted crossbow builds: [ursacomputing/crossbow @ actions-e3e3d25812](https://github.com/ursacomputing/crossbow/branches/all?query=actions-e3e3d25812)
|Task|Status|
|----|------|
|wheel-macos-monterey-cp313-cp313t-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10890488167/job/30219323527)|
|wheel-macos-monterey-cp313-cp313t-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/10890488343/job/30219324480)|
|wheel-manylinux-2-28-cp313-cp313t-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10890488201/job/30219323487)|
|wheel-manylinux-2-28-cp313-cp313t-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/10890488288/job/30219323961)|
|wheel-manylinux-2014-cp313-cp313t-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10890488244/job/30219323836)|
|wheel-manylinux-2014-cp313-cp313t-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/10890488272/job/30219323800)|
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-43964: [Python] Build macOS and manylinux wheels for free-threading [arrow]
Posted by "pitrou (via GitHub)" <gi...@apache.org>.
pitrou commented on code in PR #43965:
URL: https://github.com/apache/arrow/pull/43965#discussion_r1763267019
##########
dev/tasks/python-wheels/github.linux.yml:
##########
@@ -57,12 +58,24 @@ jobs:
# TODO(kszucs): auditwheel show
- name: Test wheel
+ if: |
+ '{{ python_abi_tag }}' != 'cp313t'
Review Comment:
Nit
```suggestion
if: '{{ python_abi_tag }}' != 'cp313t'
```
##########
dev/tasks/python-wheels/github.linux.yml:
##########
@@ -57,12 +58,24 @@ jobs:
# TODO(kszucs): auditwheel show
- name: Test wheel
+ if: |
+ '{{ python_abi_tag }}' != 'cp313t'
shell: bash
run: |
source arrow/ci/scripts/util_enable_core_dumps.sh
archery docker run python-wheel-manylinux-test-imports
archery docker run python-wheel-manylinux-test-unittests
+ # Free-threaded wheels need to be tested using a different docker-compose service
+ - name: Test free-threaded wheel
+ if: |
+ '{{ python_abi_tag }}' == 'cp313t'
Review Comment:
Same here
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-43964: [Python] Build macOS and manylinux wheels for free-threading [arrow]
Posted by "pitrou (via GitHub)" <gi...@apache.org>.
pitrou commented on PR #43965:
URL: https://github.com/apache/arrow/pull/43965#issuecomment-2356361275
> Do you see the statuses from this somewhere?
Well, it took some time, but they've just appeared above :-)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-43964: [Python] Build macOS and manylinux wheels for free-threading [arrow]
Posted by "jorisvandenbossche (via GitHub)" <gi...@apache.org>.
jorisvandenbossche commented on PR #43965:
URL: https://github.com/apache/arrow/pull/43965#issuecomment-2331456946
> Maybe start with an ubuntu images and install a Python from deadsnakes?
I assume it could be similar as the one you are adding for https://github.com/apache/arrow/pull/43671? (that's also using deadsnakes I think)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-43964: [Python] Build macOS and manylinux wheels for free-threading [arrow]
Posted by "pitrou (via GitHub)" <gi...@apache.org>.
pitrou commented on PR #43965:
URL: https://github.com/apache/arrow/pull/43965#issuecomment-2356360204
> Do you see the statuses from this somewhere?
No, for some reason this specific incantation seems to hang in its GHA job.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-43964: [Python] Build macOS and manylinux wheels for free-threading [arrow]
Posted by "pitrou (via GitHub)" <gi...@apache.org>.
pitrou commented on PR #43965:
URL: https://github.com/apache/arrow/pull/43965#issuecomment-2357847141
It seems that compiling Pandas' dev version on arm64 can sometimes fail:
https://github.com/ursacomputing/crossbow/actions/runs/10918109629/job/30302833788#step:11:2259
Hopefully they will soon produce wheels? @lysnikolaou
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-43964: [Python] Build macOS and manylinux wheels for free-threading [arrow]
Posted by "pitrou (via GitHub)" <gi...@apache.org>.
pitrou commented on PR #43965:
URL: https://github.com/apache/arrow/pull/43965#issuecomment-2357911244
I'm going to merge now.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-43964: [Python] Build macOS and manylinux wheels for free-threading [arrow]
Posted by "jorisvandenbossche (via GitHub)" <gi...@apache.org>.
jorisvandenbossche commented on PR #43965:
URL: https://github.com/apache/arrow/pull/43965#issuecomment-2353712806
@github-actions crossbow submit wheel-*-cp313t*
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-43964: [Python] Build macOS and manylinux wheels for free-threading [arrow]
Posted by "jorisvandenbossche (via GitHub)" <gi...@apache.org>.
jorisvandenbossche commented on PR #43965:
URL: https://github.com/apache/arrow/pull/43965#issuecomment-2355125089
> following [the instructions](https://arrow.apache.org/docs/dev/developers/crossbow.html) (BTW they're really helpful, but they probably need to be updated for Github Actions as well).
FYI the more recent link is https://arrow.apache.org/docs/dev/developers/continuous_integration/crossbow.html (it's a bit strange that the old page still exists in the dev docs as a leftover from the docs of a few years ago, that is something we should fix), not sure if it is that more up to date though
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-43964: [Python] Build macOS and manylinux wheels for free-threading [arrow]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #43965:
URL: https://github.com/apache/arrow/pull/43965#issuecomment-2357791560
Revision: b966c78ca7693942e243d6e5d78c48bb57ee4bea
Submitted crossbow builds: [ursacomputing/crossbow @ actions-70086a21bd](https://github.com/ursacomputing/crossbow/branches/all?query=actions-70086a21bd)
|Task|Status|
|----|------|
|wheel-macos-monterey-cp310-cp310-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10918110028/job/30302837105)|
|wheel-macos-monterey-cp310-cp310-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/10918109833/job/30302835213)|
|wheel-macos-monterey-cp311-cp311-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10918110232/job/30302837982)|
|wheel-macos-monterey-cp311-cp311-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/10918110019/job/30302836346)|
|wheel-macos-monterey-cp312-cp312-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10918110250/job/30302838109)|
|wheel-macos-monterey-cp312-cp312-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/10918110026/job/30302836627)|
|wheel-macos-monterey-cp313-cp313-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10918110411/job/30302838710)|
|wheel-macos-monterey-cp313-cp313-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/10918110097/job/30302837552)|
|wheel-macos-monterey-cp313-cp313t-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10918109848/job/30302835222)|
|wheel-macos-monterey-cp313-cp313t-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/10918109825/job/30302835075)|
|wheel-macos-monterey-cp39-cp39-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10918109551/job/30302833456)|
|wheel-macos-monterey-cp39-cp39-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/10918109741/job/30302834422)|
|wheel-manylinux-2-28-cp310-cp310-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10918109934/job/30302835869)|
|wheel-manylinux-2-28-cp310-cp310-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/10918109643/job/30302833944)|
|wheel-manylinux-2-28-cp311-cp311-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10918110567/job/30302838843)|
|wheel-manylinux-2-28-cp311-cp311-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/10918109890/job/30302835672)|
|wheel-manylinux-2-28-cp312-cp312-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10918109502/job/30302833047)|
|wheel-manylinux-2-28-cp312-cp312-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/10918110079/job/30302837142)|
|wheel-manylinux-2-28-cp313-cp313-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10918110329/job/30302838165)|
|wheel-manylinux-2-28-cp313-cp313-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/10918110365/job/30302838707)|
|wheel-manylinux-2-28-cp313-cp313t-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10918110033/job/30302836752)|
|wheel-manylinux-2-28-cp313-cp313t-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/10918109629/job/30302833788)|
|wheel-manylinux-2-28-cp39-cp39-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10918109839/job/30302834859)|
|wheel-manylinux-2-28-cp39-cp39-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/10918109534/job/30302833465)|
|wheel-manylinux-2014-cp310-cp310-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10918109905/job/30302835290)|
|wheel-manylinux-2014-cp310-cp310-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/10918109563/job/30302833403)|
|wheel-manylinux-2014-cp311-cp311-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10918110318/job/30302838319)|
|wheel-manylinux-2014-cp311-cp311-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/10918109976/job/30302836249)|
|wheel-manylinux-2014-cp312-cp312-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10918110027/job/30302836586)|
|wheel-manylinux-2014-cp312-cp312-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/10918109476/job/30302833098)|
|wheel-manylinux-2014-cp313-cp313-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10918109761/job/30302834661)|
|wheel-manylinux-2014-cp313-cp313-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/10918110011/job/30302836340)|
|wheel-manylinux-2014-cp313-cp313t-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10918109826/job/30302834820)|
|wheel-manylinux-2014-cp313-cp313t-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/10918110094/job/30302837165)|
|wheel-manylinux-2014-cp39-cp39-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10918110476/job/30302839061)|
|wheel-manylinux-2014-cp39-cp39-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/10918109700/job/30302834152)|
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-43964: [Python] Build macOS and manylinux wheels for free-threading [arrow]
Posted by "jorisvandenbossche (via GitHub)" <gi...@apache.org>.
jorisvandenbossche commented on PR #43965:
URL: https://github.com/apache/arrow/pull/43965#issuecomment-2346084395
That docker error might have been something temporary? If I look at the latest output above (the github interface is a bit confusing, you have to ensure to select the "latest attempt" because the failing build was restarted), it's actually failing to build pandas later on?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-43964: [Python] Build macOS and manylinux wheels for free-threading [arrow]
Posted by "raulcd (via GitHub)" <gi...@apache.org>.
raulcd commented on PR #43965:
URL: https://github.com/apache/arrow/pull/43965#issuecomment-2340652517
@github-actions crossbow submit wheel-manylinux-*
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-43964: [Python] Build macOS and manylinux wheels for free-threading [arrow]
Posted by "raulcd (via GitHub)" <gi...@apache.org>.
raulcd commented on PR #43965:
URL: https://github.com/apache/arrow/pull/43965#issuecomment-2338298716
> Sorry for the back and forth, but this is difficult to test locally, cause it might mess up my Python installation.
No worries at all, I understand the need of testing back and forth on CI
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-43964: [Python] Build macOS and manylinux wheels for free-threading [arrow]
Posted by "raulcd (via GitHub)" <gi...@apache.org>.
raulcd commented on PR #43965:
URL: https://github.com/apache/arrow/pull/43965#issuecomment-2338299475
@github-actions crossbow submit wheel-macos-monterey-cp313-cp313t-*
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-43964: [Python] Build macOS and manylinux wheels for free-threading [arrow]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #43965:
URL: https://github.com/apache/arrow/pull/43965#issuecomment-2330884833
:warning: GitHub issue #43964 **has been automatically assigned in GitHub** to PR creator.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-43964: [Python] Build macOS and manylinux wheels for free-threading [arrow]
Posted by "raulcd (via GitHub)" <gi...@apache.org>.
raulcd commented on PR #43965:
URL: https://github.com/apache/arrow/pull/43965#issuecomment-2338263367
@github-actions crossbow submit wheel-macos-*
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-43964: [Python] Build macOS and manylinux wheels for free-threading [arrow]
Posted by "pitrou (via GitHub)" <gi...@apache.org>.
pitrou commented on PR #43965:
URL: https://github.com/apache/arrow/pull/43965#issuecomment-2356538597
@github-actions crossbow submit wheel*linux*
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-43964: [Python] Build macOS and manylinux wheels for free-threading [arrow]
Posted by "jorisvandenbossche (via GitHub)" <gi...@apache.org>.
jorisvandenbossche commented on code in PR #43965:
URL: https://github.com/apache/arrow/pull/43965#discussion_r1761193121
##########
dev/tasks/python-wheels/github.osx.yml:
##########
@@ -131,11 +136,17 @@ jobs:
- name: Test Wheel
env:
PYTEST_ADDOPTS: "-k 'not test_cancellation'"
+ PYTHON_GIL: 0
run: |
$PYTHON -m venv test-env
source test-env/bin/activate
pip install --upgrade pip wheel
- arch -{{ arch }} pip install -r arrow/python/requirements-wheel-test.txt
+ arch -{{ arch }} pip install -pre \
Review Comment:
```suggestion
arch -{{ arch }} pip install --pre \
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-43964: [Python] Build macOS and manylinux wheels for free-threading [arrow]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #43965:
URL: https://github.com/apache/arrow/pull/43965#issuecomment-2352849880
Revision: e288b9828b751e0730968db4bf4004b5057e45f9
Submitted crossbow builds: [ursacomputing/crossbow @ actions-94953fbbad](https://github.com/ursacomputing/crossbow/branches/all?query=actions-94953fbbad)
|Task|Status|
|----|------|
|wheel-macos-monterey-cp313-cp313t-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10884292045/job/30199263661)|
|wheel-macos-monterey-cp313-cp313t-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/10884292028/job/30199263169)|
|wheel-manylinux-2-28-cp313-cp313t-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10884292000/job/30199263111)|
|wheel-manylinux-2-28-cp313-cp313t-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/10884291965/job/30199263040)|
|wheel-manylinux-2014-cp313-cp313t-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10884292009/job/30199263418)|
|wheel-manylinux-2014-cp313-cp313t-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/10884291987/job/30199263187)|
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-43964: [Python] Build macOS and manylinux wheels for free-threading [arrow]
Posted by "jorisvandenbossche (via GitHub)" <gi...@apache.org>.
jorisvandenbossche commented on PR #43965:
URL: https://github.com/apache/arrow/pull/43965#issuecomment-2331319756
For linux (where it already succeeds to the testing step), we will also need to get a 3.13t build of the test image (`python-wheel-manylinux-test-unittests`)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-43964: [Python] Build macOS and manylinux wheels for free-threading [arrow]
Posted by "lysnikolaou (via GitHub)" <gi...@apache.org>.
lysnikolaou commented on PR #43965:
URL: https://github.com/apache/arrow/pull/43965#issuecomment-2331724905
That's one option. To basically add a _new_ service that installs `python3.13-nogil` and then uses that to test the wheels, however that would mean that we have to call different test services depending on the python version in `github.linux.yml`. I was trying to avoid that by adjusting the already existing services, but it might be too complicated for no good value.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-43964: [Python] Build macOS and manylinux wheels for free-threading [arrow]
Posted by "jorisvandenbossche (via GitHub)" <gi...@apache.org>.
jorisvandenbossche commented on PR #43965:
URL: https://github.com/apache/arrow/pull/43965#issuecomment-2330987094
> We probably want to upload these wheels as nightlies somewhere as well, so that downstream users can test the free-threading-related changes.
We are uploading the nightly wheels the scientific-python-nightly-wheels index like other package do (since yesterday, and we still have our own index on gemfury as well), so this should happen automatically
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-43964: [Python] Build macOS and manylinux wheels for free-threading [arrow]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #43965:
URL: https://github.com/apache/arrow/pull/43965#issuecomment-2340661432
Revision: ae1fb8e48b917e3990449469c989f04f95c4fe59
Submitted crossbow builds: [ursacomputing/crossbow @ actions-78557d7127](https://github.com/ursacomputing/crossbow/branches/all?query=actions-78557d7127)
|Task|Status|
|----|------|
|wheel-manylinux-2-28-cp310-cp310-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10792814160/job/29933308784)|
|wheel-manylinux-2-28-cp310-cp310-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/10792813820/job/29933307899)|
|wheel-manylinux-2-28-cp311-cp311-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10792813788/job/29933307436)|
|wheel-manylinux-2-28-cp311-cp311-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/10792814199/job/29933309616)|
|wheel-manylinux-2-28-cp312-cp312-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10792814229/job/29933309960)|
|wheel-manylinux-2-28-cp312-cp312-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/10792813733/job/29933307365)|
|wheel-manylinux-2-28-cp313-cp313-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10792813629/job/29933307274)|
|wheel-manylinux-2-28-cp313-cp313-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/10792814163/job/29933309077)|
|wheel-manylinux-2-28-cp313-cp313t-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10792813392/job/29933306200)|
|wheel-manylinux-2-28-cp313-cp313t-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/10792813688/job/29933307901)|
|wheel-manylinux-2-28-cp38-cp38-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10792814172/job/29933309667)|
|wheel-manylinux-2-28-cp38-cp38-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/10792814549/job/29933311457)|
|wheel-manylinux-2-28-cp39-cp39-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10792813597/job/29933307081)|
|wheel-manylinux-2-28-cp39-cp39-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/10792814248/job/29933309650)|
|wheel-manylinux-2014-cp310-cp310-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10792814169/job/29933309121)|
|wheel-manylinux-2014-cp310-cp310-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/10792813486/job/29933306206)|
|wheel-manylinux-2014-cp311-cp311-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10792814469/job/29933311202)|
|wheel-manylinux-2014-cp311-cp311-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/10792813991/job/29933308448)|
|wheel-manylinux-2014-cp312-cp312-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10792814159/job/29933308828)|
|wheel-manylinux-2014-cp312-cp312-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/10792813669/job/29933307301)|
|wheel-manylinux-2014-cp313-cp313-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10792813391/job/29933306230)|
|wheel-manylinux-2014-cp313-cp313-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/10792814139/job/29933308696)|
|wheel-manylinux-2014-cp313-cp313t-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10792814198/job/29933309645)|
|wheel-manylinux-2014-cp313-cp313t-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/10792814430/job/29933310937)|
|wheel-manylinux-2014-cp38-cp38-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10792813539/job/29933306540)|
|wheel-manylinux-2014-cp38-cp38-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/10792814442/job/29933310970)|
|wheel-manylinux-2014-cp39-cp39-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10792814483/job/29933311452)|
|wheel-manylinux-2014-cp39-cp39-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/10792813797/job/29933307904)|
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-43964: [Python] Build macOS and manylinux wheels for free-threading [arrow]
Posted by "lysnikolaou (via GitHub)" <gi...@apache.org>.
lysnikolaou commented on PR #43965:
URL: https://github.com/apache/arrow/pull/43965#issuecomment-2346107049
> That docker error might have been something temporary? If I look at the latest output above (the github interface is a bit confusing, you have to ensure to select the "latest attempt" because the failing build was restarted), it's actually failing to build pandas later on?
Oh I actually hadn't seen that. Thanks for the pointer.
I've now changed to dockerfile to add `/arrow-dev/bin` to the `PATH`. Additionally, we still need to figure out what's going wrong with `archery crossbow` trying to upload a non-free-threaded wheel to the nightlies index. I tried to look around but wasn't able to find what's wrong. I can look deeper if you give me a few pointers.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-43964: [Python] Build macOS and manylinux wheels for free-threading [arrow]
Posted by "jorisvandenbossche (via GitHub)" <gi...@apache.org>.
jorisvandenbossche commented on PR #43965:
URL: https://github.com/apache/arrow/pull/43965#issuecomment-2346609357
Cython had a bug when building for free-threaded python (https://github.com/cython/cython/issues/6387) for a short time, which we are probably picking up, and hopefully fixed tomorrow when the nightly package is updated.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-43964: [Python] Build macOS and manylinux wheels for free-threading [arrow]
Posted by "lysnikolaou (via GitHub)" <gi...@apache.org>.
lysnikolaou commented on PR #43965:
URL: https://github.com/apache/arrow/pull/43965#issuecomment-2353395231
Fixed the remaining spots as well as some conflicts after your PR was merged. Let's run the jobs again, please.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-43964: [Python] Build macOS and manylinux wheels for free-threading [arrow]
Posted by "pitrou (via GitHub)" <gi...@apache.org>.
pitrou commented on PR #43965:
URL: https://github.com/apache/arrow/pull/43965#issuecomment-2356184783
@github-actions crossbow submit wheel*cp312* wheel*cp313*
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-43964: [Python] Build macOS and manylinux wheels for free-threading [arrow]
Posted by "pitrou (via GitHub)" <gi...@apache.org>.
pitrou commented on code in PR #43965:
URL: https://github.com/apache/arrow/pull/43965#discussion_r1763279410
##########
dev/tasks/tasks.yml:
##########
@@ -435,21 +438,25 @@ tasks:
{% endfor %}
- wheel-macos-monterey-{{ python_tag }}-arm64:
+ wheel-macos-monterey-{{ python_tag }}-{{ abi_tag }}-arm64:
ci: github
template: python-wheels/github.osx.yml
params:
arch: "arm64"
arrow_jemalloc: "OFF"
python_version: "{{ python_version }}"
+ python_abi_tag: "{{ abi_tag }}"
macos_deployment_target: "12.0"
runs_on: "macos-14"
vcpkg_arch: "arm64"
artifacts:
- - pyarrow-{no_rc_version}-{{ python_tag }}-{{ python_tag }}-macosx_12_0_arm64.whl
+ - pyarrow-{no_rc_version}-{{ python_tag }}-{{ abi_tag }}-macosx_12_0_arm64.whl
{############################## Wheel Windows ################################}
+# TODO: Remove this when there's NumPy wheels for Windows
Review Comment:
Can you add a reference to https://github.com/numpy/numpy/issues/26157 ?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-43964: [Python] Build macOS and manylinux wheels for free-threading [arrow]
Posted by "pitrou (via GitHub)" <gi...@apache.org>.
pitrou commented on PR #43965:
URL: https://github.com/apache/arrow/pull/43965#issuecomment-2356218686
@github-actions crossbow submit -g python
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-43964: [Python] Build macOS and manylinux wheels for free-threading [arrow]
Posted by "lysnikolaou (via GitHub)" <gi...@apache.org>.
lysnikolaou commented on code in PR #43965:
URL: https://github.com/apache/arrow/pull/43965#discussion_r1763329428
##########
dev/tasks/python-wheels/github.osx.yml:
##########
@@ -136,11 +141,17 @@ jobs:
- name: Test Wheel
env:
PYTEST_ADDOPTS: "-k 'not test_cancellation'"
+ PYTHON_GIL: 0
run: |
$PYTHON -m venv test-env
source test-env/bin/activate
pip install --upgrade pip wheel
- arch -{{ arch }} pip install -r arrow/python/requirements-wheel-test.txt
+ arch -{{ arch }} pip install --pre \
Review Comment:
Right! I changed the step to include a conditional.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-43964: [Python] Build macOS and manylinux wheels for free-threading [arrow]
Posted by "pitrou (via GitHub)" <gi...@apache.org>.
pitrou commented on PR #43965:
URL: https://github.com/apache/arrow/pull/43965#issuecomment-2356344003
@github-actions crossbow submit -g wheel
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-43964: [Python] Build macOS and manylinux wheels for free-threading [arrow]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #43965:
URL: https://github.com/apache/arrow/pull/43965#issuecomment-2356543326
Revision: 2a62d376737fcc035a3992f31c433cbd5448215e
Submitted crossbow builds: [ursacomputing/crossbow @ actions-7e79fa4b45](https://github.com/ursacomputing/crossbow/branches/all?query=actions-7e79fa4b45)
|Task|Status|
|----|------|
|wheel-manylinux-2-28-cp310-cp310-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10908238714/job/30273744084)|
|wheel-manylinux-2-28-cp310-cp310-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/10908238408/job/30273742228)|
|wheel-manylinux-2-28-cp311-cp311-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10908238528/job/30273742737)|
|wheel-manylinux-2-28-cp311-cp311-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/10908238717/job/30273743965)|
|wheel-manylinux-2-28-cp312-cp312-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10908238718/job/30273743813)|
|wheel-manylinux-2-28-cp312-cp312-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/10908238540/job/30273742800)|
|wheel-manylinux-2-28-cp313-cp313-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10908238739/job/30273744624)|
|wheel-manylinux-2-28-cp313-cp313-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/10908238585/job/30273743552)|
|wheel-manylinux-2-28-cp313-cp313t-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10908238508/job/30273742412)|
|wheel-manylinux-2-28-cp313-cp313t-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/10908238546/job/30273743400)|
|wheel-manylinux-2-28-cp39-cp39-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10908238745/job/30273744240)|
|wheel-manylinux-2-28-cp39-cp39-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/10908238362/job/30273741872)|
|wheel-manylinux-2014-cp310-cp310-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10908238291/job/30273741416)|
|wheel-manylinux-2014-cp310-cp310-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/10908238709/job/30273743819)|
|wheel-manylinux-2014-cp311-cp311-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10908238343/job/30273741554)|
|wheel-manylinux-2014-cp311-cp311-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/10908238907/job/30273744653)|
|wheel-manylinux-2014-cp312-cp312-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10908238601/job/30273743595)|
|wheel-manylinux-2014-cp312-cp312-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/10908238436/job/30273742223)|
|wheel-manylinux-2014-cp313-cp313-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10908238431/job/30273742365)|
|wheel-manylinux-2014-cp313-cp313-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/10908238400/job/30273742153)|
|wheel-manylinux-2014-cp313-cp313t-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10908238280/job/30273741446)|
|wheel-manylinux-2014-cp313-cp313t-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/10908238437/job/30273742165)|
|wheel-manylinux-2014-cp39-cp39-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10908238445/job/30273742807)|
|wheel-manylinux-2014-cp39-cp39-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/10908238532/job/30273742774)|
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-43964: [Python] Build macOS and manylinux wheels for free-threading [arrow]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #43965:
URL: https://github.com/apache/arrow/pull/43965#issuecomment-2338269578
Revision: ff22883e0be3244e549750029e50f92ce536b5be
Submitted crossbow builds: [ursacomputing/crossbow @ actions-eb7e4999bb](https://github.com/ursacomputing/crossbow/branches/all?query=actions-eb7e4999bb)
|Task|Status|
|----|------|
|wheel-macos-monterey-cp310-cp310-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10775189546/job/29879035818)|
|wheel-macos-monterey-cp310-cp310-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/10775190134/job/29879038122)|
|wheel-macos-monterey-cp311-cp311-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10775189747/job/29879036861)|
|wheel-macos-monterey-cp311-cp311-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/10775190218/job/29879038183)|
|wheel-macos-monterey-cp312-cp312-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10775189573/job/29879035831)|
|wheel-macos-monterey-cp312-cp312-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/10775189715/job/29879036744)|
|wheel-macos-monterey-cp313-cp313-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10775189861/job/29879037286)|
|wheel-macos-monterey-cp313-cp313-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/10775189837/job/29879037116)|
|wheel-macos-monterey-cp313-cp313t-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10775189629/job/29879036341)|
|wheel-macos-monterey-cp313-cp313t-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/10775189913/job/29879037411)|
|wheel-macos-monterey-cp38-cp38-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10775189904/job/29879037396)|
|wheel-macos-monterey-cp38-cp38-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/10775189642/job/29879036307)|
|wheel-macos-monterey-cp39-cp39-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10775189506/job/29879035763)|
|wheel-macos-monterey-cp39-cp39-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/10775189983/job/29879037832)|
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-43964: [Python] Build macOS and manylinux wheels for free-threading [arrow]
Posted by "lysnikolaou (via GitHub)" <gi...@apache.org>.
lysnikolaou commented on PR #43965:
URL: https://github.com/apache/arrow/pull/43965#issuecomment-2338289031
And another `wheel-macos-monterey-cp313-cp313t-*` might be needed. Sorry for the back and forth, but this is difficult to test locally, cause it might mess up my Python installation.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-43964: [Python] Build macOS and manylinux wheels for free-threading [arrow]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #43965:
URL: https://github.com/apache/arrow/pull/43965#issuecomment-2330994490
Revision: d38d42da37db5acd14da5552b9c5febb21a36d88
Submitted crossbow builds: [ursacomputing/crossbow @ actions-7169a37d95](https://github.com/ursacomputing/crossbow/branches/all?query=actions-7169a37d95)
|Task|Status|
|----|------|
|python-sdist|[](https://github.com/ursacomputing/crossbow/actions/runs/10717278675/job/29716640847)|
|wheel-macos-monterey-cp310-cp310-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10717278337/job/29716638733)|
|wheel-macos-monterey-cp310-cp310-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/10717278235/job/29716638016)|
|wheel-macos-monterey-cp311-cp311-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10717278764/job/29716641517)|
|wheel-macos-monterey-cp311-cp311-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/10717278686/job/29716641314)|
|wheel-macos-monterey-cp312-cp312-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10717278642/job/29716641055)|
|wheel-macos-monterey-cp312-cp312-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/10717278305/job/29716638639)|
|wheel-macos-monterey-cp313-cp313-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10717278250/job/29716638103)|
|wheel-macos-monterey-cp313-cp313-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/10717278630/job/29716640763)|
|wheel-macos-monterey-cp313-cp313t-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10717279068/job/29716644305)|
|wheel-macos-monterey-cp313-cp313t-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/10717278210/job/29716637593)|
|wheel-macos-monterey-cp38-cp38-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10717278545/job/29716639605)|
|wheel-macos-monterey-cp38-cp38-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/10717278773/job/29716642092)|
|wheel-macos-monterey-cp39-cp39-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10717279090/job/29716644826)|
|wheel-macos-monterey-cp39-cp39-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/10717278854/job/29716642334)|
|wheel-manylinux-2-28-cp310-cp310-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10717278397/job/29716638892)|
|wheel-manylinux-2-28-cp310-cp310-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/10717278940/job/29716642652)|
|wheel-manylinux-2-28-cp311-cp311-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10717278655/job/29716640861)|
|wheel-manylinux-2-28-cp311-cp311-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/10717278426/job/29716639121)|
|wheel-manylinux-2-28-cp312-cp312-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10717278963/job/29716643097)|
|wheel-manylinux-2-28-cp312-cp312-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/10717278898/job/29716642542)|
|wheel-manylinux-2-28-cp313-cp313-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10717279020/job/29716643691)|
|wheel-manylinux-2-28-cp313-cp313-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/10717279070/job/29716644495)|
|wheel-manylinux-2-28-cp313-cp313t-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10717278956/job/29716643761)|
|wheel-manylinux-2-28-cp313-cp313t-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/10717278606/job/29716640502)|
|wheel-manylinux-2-28-cp38-cp38-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10717278508/job/29716639633)|
|wheel-manylinux-2-28-cp38-cp38-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/10717278579/job/29716640168)|
|wheel-manylinux-2-28-cp39-cp39-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10717279019/job/29716643554)|
|wheel-manylinux-2-28-cp39-cp39-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/10717278659/job/29716641489)|
|wheel-manylinux-2014-cp310-cp310-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10717278259/job/29716638113)|
|wheel-manylinux-2014-cp310-cp310-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/10717278970/job/29716642968)|
|wheel-manylinux-2014-cp311-cp311-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10717279047/job/29716644070)|
|wheel-manylinux-2014-cp311-cp311-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/10717279161/job/29716645212)|
|wheel-manylinux-2014-cp312-cp312-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10717279072/job/29716644764)|
|wheel-manylinux-2014-cp312-cp312-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/10717278763/job/29716641782)|
|wheel-manylinux-2014-cp313-cp313-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10717278795/job/29716641773)|
|wheel-manylinux-2014-cp313-cp313-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/10717278343/job/29716638805)|
|wheel-manylinux-2014-cp313-cp313t-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10717278356/job/29716638849)|
|wheel-manylinux-2014-cp313-cp313t-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/10717278240/job/29716638046)|
|wheel-manylinux-2014-cp38-cp38-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10717278557/job/29716639950)|
|wheel-manylinux-2014-cp38-cp38-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/10717278177/job/29716637495)|
|wheel-manylinux-2014-cp39-cp39-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10717278743/job/29716641388)|
|wheel-manylinux-2014-cp39-cp39-arm64|[](https://github.com/ursacomputing/crossbow/actions/runs/10717279074/job/29716644523)|
|wheel-windows-cp310-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10717278850/job/29716642387)|
|wheel-windows-cp311-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10717278181/job/29716637613)|
|wheel-windows-cp312-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10717279060/job/29716644189)|
|wheel-windows-cp313-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10717278490/job/29716639694)|
|wheel-windows-cp38-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10717278600/job/29716640376)|
|wheel-windows-cp39-amd64|[](https://github.com/ursacomputing/crossbow/actions/runs/10717279043/job/29716643981)|
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-43964: [Python] Build macOS and manylinux wheels for free-threading [arrow]
Posted by "jorisvandenbossche (via GitHub)" <gi...@apache.org>.
jorisvandenbossche commented on code in PR #43965:
URL: https://github.com/apache/arrow/pull/43965#discussion_r1756718244
##########
ci/docker/python-free-threaded-wheel-manylinux-test-unittests.dockerfile:
##########
@@ -0,0 +1,44 @@
+# Licensed to the Apache Software Foundation (ASF) under one
+# or more contributor license agreements. See the NOTICE file
+# distributed with this work for additional information
+# regarding copyright ownership. The ASF licenses this file
+# to you under the Apache License, Version 2.0 (the
+# "License"); you may not use this file except in compliance
+# with the License. You may obtain a copy of the License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing,
+# software distributed under the License is distributed on an
+# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+# KIND, either express or implied. See the License for the
+# specific language governing permissions and limitations
+# under the License.
+
+ARG base
+FROM ${base}
+
+ENV DEBIAN_FRONTEND=noninteractive
+
+RUN apt-get update
+RUN apt-get install -y -q --no-install-recommends build-essential software-properties-common gpg-agent
+RUN add-apt-repository -y ppa:deadsnakes/ppa && apt-get update
+RUN apt-get install -y -q --no-install-recommends python3.13-dev python3.13-nogil python3.13-venv
+RUN apt-get install -y -q --no-install-recommends libffi-dev
+
+ENV ARROW_PYTHON_VENV /arrow-dev
+RUN python3.13t -m venv ${ARROW_PYTHON_VENV}
+
+ENV PYTHON /arrow-dev/bin/python
+ENV PYTHON_GIL 0
+
+# pandas doesn't provide wheels for aarch64 yet, so we have to install nightly Cython
+# along with the rest of pandas' build dependencies and disable build isolation
+COPY python/requirements-wheel-test.txt /arrow/python/
+RUN ${PYTHON} -m pip install \
+ --pre \
+ --prefer-binary \
+ --extra-index-url "https://pypi.anaconda.org/scientific-python-nightly-wheels/simple" \
+ Cython
+RUN ${PYTHON} -m pip install "meson-python==0.13.1" "meson==1.2.1" "wheel" "versioneer[toml]"
Review Comment:
We might have to add `/arrow-dev/bin` to the path, because I assume that pip will install the `meson` executable there, but it is not automatically found?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] GH-43964: [Python] Build macOS and manylinux wheels for free-threading [arrow]
Posted by "lysnikolaou (via GitHub)" <gi...@apache.org>.
lysnikolaou commented on PR #43965:
URL: https://github.com/apache/arrow/pull/43965#issuecomment-2346108187
Also can we run something like `wheel-*-cp313t`?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org