You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@beam.apache.org by "bvolpato (via GitHub)" <gi...@apache.org> on 2026/08/05 02:19:06 UTC
[I] [Task]: Investigate native ARM runners for Python aarch64 wheels [beam]
bvolpato opened a new issue, #39620:
URL: https://github.com/apache/beam/issues/39620
### What needs to happen?
Python wheel workflow currently builds Linux aarch64 wheel on an `ubuntu-22.04` x64 GitHub-hosted runner through QEMU.
In a representative PR run, aarch64 Python 3.14 leg took 91 minutes and determined almost all workflow latency. Other active legs took 5 to 26 minutes:
- Beam run: https://github.com/apache/beam/actions/runs/30917964633
- aarch64 job: https://github.com/apache/beam/actions/runs/30917964633/job/92021083741
- workflow configuration: https://github.com/apache/beam/blob/master/.github/workflows/build_wheels.yml
GitHub provides standard `ubuntu-24.04-arm` runners for public repositories. Other Apache projects already use them for native wheel builds. For example, Arrow Nanoarrow runs `cibuildwheel` on `ubuntu-24.04-arm`; a recent Linux ARM64 job completed successfully in about 11 minutes:
- GitHub runner documentation: https://docs.github.com/en/actions/reference/runners/github-hosted-runners
- cibuildwheel native ARM guidance: https://cibuildwheel.pypa.io/en/stable/faq/
- Arrow Nanoarrow workflow: https://github.com/apache/arrow-nanoarrow/blob/main/.github/workflows/python-wheels.yaml
- Example job: https://github.com/apache/arrow-nanoarrow/actions/runs/30664577816/job/91268851254
Could someone familiar with Beam or Apache runner constraints confirm whether this wheel leg can use `ubuntu-24.04-arm`, or whether current QEMU path is intentional?
A bounded experiment could switch only aarch64 matrix row to native ARM, use `CIBW_ARCHS_LINUX=auto`, and skip QEMU for that row. Validation should compare wheel platform tags, `auditwheel show`, installation/import smoke tests, existing wheel tests, and wall-clock time against current QEMU job.
### Issue Priority
Priority: 2 (default / most normal work should be filed as P2)
### Issue Components
- [x] Component: Python SDK
- [ ] Component: Java SDK
- [ ] Component: Go SDK
- [ ] Component: Typescript SDK
- [ ] Component: IO connector
- [ ] Component: Beam YAML
- [ ] Component: Beam examples
- [ ] Component: Beam playground
- [ ] Component: Beam katas
- [ ] Component: Website
- [x] Component: Infrastructure
- [ ] Component: Spark Runner
- [ ] Component: Flink Runner
- [ ] Component: Prism Runner
- [ ] Component: Twister2 Runner
- [ ] Component: Hazelcast Jet Runner
- [ ] Component: Google Cloud Dataflow Runner
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Task]: Investigate native ARM runners for Python aarch64 wheels [beam]
Posted by "bvolpato (via GitHub)" <gi...@apache.org>.
bvolpato commented on issue #39620:
URL: https://github.com/apache/beam/issues/39620#issuecomment-5186784658
.add-labels python,infra,task,P2,'awaiting triage'
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org