You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@arrow.apache.org by "raulcd (via GitHub)" <gi...@apache.org> on 2026/06/30 07:05:23 UTC
[I] [Python][Packaging] Nightly wheels fail with segmentation fault on Parquet [arrow]
raulcd opened a new issue, #50291:
URL: https://github.com/apache/arrow/issues/50291
### Describe the bug, including details regarding any error messages, version, and platform.
All our nightly wheels have started failing with a segmentation fault on Parquet:
```
usr/local/lib/python3.13/site-packages/pyarrow/tests/parquet/test_basic.py . [ 36%]
Fatal Python error: Segmentation fault
Current thread 0x00007f2c097d7380 (most recent call first):
File "/usr/local/lib/python3.13/site-packages/pandas/core/indexes/datetimes.py", line 1442 in date_range
File "/usr/local/lib/python3.13/site-packages/pyarrow/tests/parquet/test_basic.py", line 763 in test_write_error_deletes_incomplete_file
File "/usr/local/lib/python3.13/site-packages/_pytest/python.py", line 167 in pytest_pyfunc_call
File "/usr/local/lib/python3.13/site-packages/pluggy/_callers.py", line 121 in _multicall
File "/usr/local/lib/python3.13/site-packages/pluggy/_manager.py", line 120 in _hookexec
File "/usr/local/lib/python3.13/site-packages/pluggy/_hooks.py", line 512 in __call__
File "/usr/local/lib/python3.13/site-packages/_pytest/python.py", line 1707 in runtest
File "/usr/local/lib/python3.13/site-packages/_pytest/runner.py", line 184 in pytest_runtest_call
File "/usr/local/lib/python3.13/site-packages/pluggy/_callers.py", line 121 in _multicall
File "/usr/local/lib/python3.13/site-packages/pluggy/_manager.py", line 120 in _hookexec
File "/usr/local/lib/python3.13/site-packages/pluggy/_hooks.py", line 512 in __call__
File "/usr/local/lib/python3.13/site-packages/_pytest/runner.py", line 250 in <lambda>
File "/usr/local/lib/python3.13/site-packages/_pytest/runner.py", line 361 in from_call
File "/usr/local/lib/python3.13/site-packages/_pytest/runner.py", line 249 in call_and_report
File "/usr/local/lib/python3.13/site-packages/_pytest/runner.py", line 139 in runtestprotocol
File "/usr/local/lib/python3.13/site-packages/_pytest/runner.py", line 118 in pytest_runtest_protocol
File "/usr/local/lib/python3.13/site-packages/pluggy/_callers.py", line 121 in _multicall
File "/usr/local/lib/python3.13/site-packages/pluggy/_manager.py", line 120 in _hookexec
File "/usr/local/lib/python3.13/site-packages/pluggy/_hooks.py", line 512 in __call__
File "/usr/local/lib/python3.13/site-packages/_pytest/main.py", line 408 in pytest_runtestloop
File "/usr/local/lib/python3.13/site-packages/pluggy/_callers.py", line 121 in _multicall
File "/usr/local/lib/python3.13/site-packages/pluggy/_manager.py", line 120 in _hookexec
File "/usr/local/lib/python3.13/site-packages/pluggy/_hooks.py", line 512 in __call__
File "/usr/local/lib/python3.13/site-packages/_pytest/main.py", line 384 in _main
File "/usr/local/lib/python3.13/site-packages/_pytest/main.py", line 330 in wrap_session
File "/usr/local/lib/python3.13/site-packages/_pytest/main.py", line 377 in pytest_cmdline_main
File "/usr/local/lib/python3.13/site-packages/pluggy/_callers.py", line 121 in _multicall
File "/usr/local/lib/python3.13/site-packages/pluggy/_manager.py", line 120 in _hookexec
File "/usr/local/lib/python3.13/site-packages/pluggy/_hooks.py", line 512 in __call__
File "/usr/local/lib/python3.13/site-packages/_pytest/config/__init__.py", line 229 in _main
File "/usr/local/lib/python3.13/site-packages/_pytest/config/__init__.py", line 253 in _console_main
File "/usr/local/lib/python3.13/site-packages/pytest/__main__.py", line 9 in <module>
File "<frozen runpy>", line 88 in _run_code
File "<frozen runpy>", line 203 in _run_module_as_main
Extension modules: numpy._core._multiarray_umath, numpy.linalg._umath_linalg, pyarrow.lib, pyarrow._fs, pyarrow._azurefs, pyarrow._hdfs, pyarrow._gcsfs, pyarrow._s3fs, cython.cimports.libc.math, pyarrow._compute, pyarrow._acero, pyarrow._csv, pyarrow._json, pyarrow._substrait, numpy.random._common, numpy.random.bit_generator, numpy.random._bounded_integers, numpy.random._mt19937, numpy.random.mtrand, numpy.random._philox, numpy.random._pcg64, numpy.random._sfc64, numpy.random._generator, _cyutility, pandas._libs._cyutility, pandas._libs.tslibs.ccalendar, pandas._libs.tslibs.np_datetime, pandas._libs.tslibs.dtypes, pandas._libs.tslibs.base, pandas._libs.tslibs.nattype, pandas._libs.tslibs.timezones, pandas._libs.properties, pandas._libs.tslibs.fields, pandas._libs.tslibs.timedeltas, pandas._libs.tslibs.tzconversion, pandas._libs.tslibs.timestamps, pandas._libs.tslibs.offsets, pandas._libs.tslibs.strptime, pandas._libs.tslibs.parsing, pandas._libs.tslibs.conversion, pandas._libs.tsl
ibs.period, pandas._libs.tslibs.vectorized, pandas._libs.ops_dispatch, pandas._libs.missing, pandas._libs.hashtable, pandas._libs.algos, pandas._libs.interval, pandas._libs.lib, pandas._libs.ops, pandas._libs.hashing, pandas._libs.arrays, pandas._libs.tslib, pandas._libs.sparse, pandas._libs.internals, pandas._libs.indexing, pandas._libs.index, pandas._libs.writers, pandas._libs.join, pandas._libs.window.aggregations, pandas._libs.window.indexers, pandas._libs.reshape, pandas._libs.groupby, pandas._libs.json, pandas._libs.parsers, pandas._libs.testing, pyarrow._dataset, pyarrow._dataset_orc, pyarrow._parquet, pyarrow._parquet_encryption, pyarrow._dataset_parquet_encryption, pyarrow._dataset_parquet, pyarrow._orc, pyarrow._flight, _cffi_backend, pyarrow._pyarrow_cpp_tests, pyarrow._feather (total: 76)
/arrow/ci/scripts/python_wheel_unix_test.sh: line 110: 21 Segmentation fault (core dumped) python -m pytest -r s --pyargs pyarrow
```
Current failure details:
- [wheel-macos-monterey-cp312-cp312-amd64](https://github.com/ursacomputing/crossbow/actions/runs/28364076340/job/84025524093)
- [wheel-macos-monterey-cp312-cp312-arm64](https://github.com/ursacomputing/crossbow/actions/runs/28364074532/job/84025517289)
- [wheel-macos-monterey-cp313-cp313-amd64](https://github.com/ursacomputing/crossbow/actions/runs/28364075850/job/84025522043)
- [wheel-macos-monterey-cp313-cp313-arm64](https://github.com/ursacomputing/crossbow/actions/runs/28364074857/job/84025518450)
- [wheel-macos-monterey-cp314-cp314-amd64](https://github.com/ursacomputing/crossbow/actions/runs/28364073913/job/84025515095)
- [wheel-macos-monterey-cp314-cp314-arm64](https://github.com/ursacomputing/crossbow/actions/runs/28364074567/job/84025517385)
- [wheel-macos-monterey-cp314-cp314t-amd64](https://github.com/ursacomputing/crossbow/actions/runs/28364076782/job/84025525805)
- [wheel-macos-monterey-cp314-cp314t-arm64](https://github.com/ursacomputing/crossbow/actions/runs/28364075919/job/84025522734)
- [wheel-manylinux-2-28-cp312-cp312-amd64](https://github.com/ursacomputing/crossbow/actions/runs/28364073050/job/84025512656)
- [wheel-manylinux-2-28-cp312-cp312-arm64](https://github.com/ursacomputing/crossbow/actions/runs/28364076818/job/84025525436)
- [wheel-manylinux-2-28-cp313-cp313-amd64](https://github.com/ursacomputing/crossbow/actions/runs/28364075377/job/84025520229)
- [wheel-manylinux-2-28-cp313-cp313-arm64](https://github.com/ursacomputing/crossbow/actions/runs/28364073011/job/84025511938)
- [wheel-manylinux-2-28-cp314-cp314-amd64](https://github.com/ursacomputing/crossbow/actions/runs/28364075629/job/84025521117)
- [wheel-manylinux-2-28-cp314-cp314-arm64](https://github.com/ursacomputing/crossbow/actions/runs/28364075715/job/84025521659)
- [wheel-manylinux-2-28-cp314-cp314t-amd64](https://github.com/ursacomputing/crossbow/actions/runs/28364076084/job/84025523027)
- [wheel-manylinux-2-28-cp314-cp314t-arm64](https://github.com/ursacomputing/crossbow/actions/runs/28364076697/job/84025525273)
- [wheel-musllinux-1-2-cp312-cp312-amd64](https://github.com/ursacomputing/crossbow/actions/runs/28364073881/job/84025514998)
- [wheel-musllinux-1-2-cp312-cp312-arm64](https://github.com/ursacomputing/crossbow/actions/runs/28364075849/job/84025522342)
- [wheel-musllinux-1-2-cp313-cp313-amd64](https://github.com/ursacomputing/crossbow/actions/runs/28364077192/job/84025527076)
- [wheel-musllinux-1-2-cp313-cp313-arm64](https://github.com/ursacomputing/crossbow/actions/runs/28364076518/job/84025524611)
- [wheel-musllinux-1-2-cp314-cp314-amd64](https://github.com/ursacomputing/crossbow/actions/runs/28364077284/job/84025527339)
- [wheel-musllinux-1-2-cp314-cp314-arm64](https://github.com/ursacomputing/crossbow/actions/runs/28364075071/job/84025519016)
- [wheel-musllinux-1-2-cp314-cp314t-amd64](https://github.com/ursacomputing/crossbow/actions/runs/28364076058/job/84025523006)
- [wheel-musllinux-1-2-cp314-cp314t-arm64](https://github.com/ursacomputing/crossbow/actions/runs/28364076661/job/84025525152)
- [wheel-windows-cp312-cp312-amd64](https://github.com/ursacomputing/crossbow/actions/runs/28364075064/job/84025518854)
- [wheel-windows-cp313-cp313-amd64](https://github.com/ursacomputing/crossbow/actions/runs/28364077069/job/84025526634)
- [wheel-windows-cp314-cp314-amd64](https://github.com/ursacomputing/crossbow/actions/runs/28364073059/job/84025511962)
- [wheel-windows-cp314-cp314t-amd64](https://github.com/ursacomputing/crossbow/actions/runs/28364073621/job/84025514004)
### Component(s)
Continuous Integration, Integration
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@arrow.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Python][Packaging] Nightly wheels fail with segmentation fault on Parquet [arrow]
Posted by "raulcd (via GitHub)" <gi...@apache.org>.
raulcd closed issue #50291: [Python][Packaging] Nightly wheels fail with segmentation fault on Parquet
URL: https://github.com/apache/arrow/issues/50291
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Python][Packaging] Nightly wheels fail with segmentation fault on Parquet [arrow]
Posted by "raulcd (via GitHub)" <gi...@apache.org>.
raulcd commented on issue #50291:
URL: https://github.com/apache/arrow/issues/50291#issuecomment-4841832314
I can't seem to reproduce locally:
```bash
$ ARCHERY_DEBUG=1 ARCH=amd64 PYTHON=3.14 PYTHON_ABI_TAG=cp314 PYTHON_IMAGE_TAG=3.14 archery docker run -e SETUPTOOLS_SCM_PRETEND_VERSION=25.0.0.dev193 python-wheel-manylinux-2-28
...
$ ARCHERY_DEBUG=1 ARCH=amd64 PYTHON=3.14 PYTHON_ABI_TAG=cp314 PYTHON_IMAGE_TAG=3.14 archery docker run -e SETUPTOOLS_SCM_PRETEND_VERSION=25.0.0.dev193 python-wheel-manylinux-test-unittests
...
================== 7576 passed, 667 skipped, 15 xfailed, 2 xpassed, 23 warnings in 153.34s (0:02:33) ==============
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Python][Packaging] Nightly wheels fail with segmentation fault on Parquet [arrow]
Posted by "raulcd (via GitHub)" <gi...@apache.org>.
raulcd commented on issue #50291:
URL: https://github.com/apache/arrow/issues/50291#issuecomment-4857242689
Issue resolved by pull request 50315
https://github.com/apache/arrow/pull/50315
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Python][Packaging] Nightly wheels fail with segmentation fault on Parquet [arrow]
Posted by "raulcd (via GitHub)" <gi...@apache.org>.
raulcd commented on issue #50291:
URL: https://github.com/apache/arrow/issues/50291#issuecomment-4852412705
This has been solved, nightlies are all working except one which seems to be triggered by the same issue:
- [wheel-windows-cp314-cp314t-amd64](https://github.com/ursacomputing/crossbow/actions/runs/28435095197/job/84259001373)
```
Users\ContainerAdministrator\AppData\Local\Programs\Python\Python314\Lib\site-packages\pyarrow\tests\parquet\test_basic.py . [ 36%]
Windows fatal exception: access violation
<Cannot show all threads while the GIL is disabled>
Stack (most recent call first):
File "C:\Users\ContainerAdministrator\AppData\Local\Programs\Python\Python314\Lib\site-packages\pandas\core\arrays\_ranges.py", line 65 in generate_regular_range
File "C:\Users\ContainerAdministrator\AppData\Local\Programs\Python\Python314\Lib\site-packages\pandas\core\arrays\datetimes.py", line 456 in _generate_range
File "C:\Users\ContainerAdministrator\AppData\Local\Programs\Python\Python314\Lib\site-packages\pandas\core\indexes\datetimes.py", line 1751 in date_range
File "C:\Users\ContainerAdministrator\AppData\Local\Programs\Python\Python314\Lib\site-packages\pyarrow\tests\parquet\test_basic.py", line 763 in test_write_error_deletes_incomplete_file
File "C:\Users\ContainerAdministrator\AppData\Local\Programs\Python\Python314\Lib\site-packages\_pytest\python.py", line 167 in pytest_pyfunc_call
File "C:\Users\ContainerAdministrator\AppData\Local\Programs\Python\Python314\Lib\site-packages\pluggy\_callers.py", line 121 in _multicall
File "C:\Users\ContainerAdministrator\AppData\Local\Programs\Python\Python314\Lib\site-packages\pluggy\_manager.py", line 120 in _hookexec
File "C:\Users\ContainerAdministrator\AppData\Local\Programs\Python\Python314\Lib\site-packages\pluggy\_hooks.py", line 512 in __call__
File "C:\Users\ContainerAdministrator\AppData\Local\Programs\Python\Python314\Lib\site-packages\_pytest\python.py", line 1707 in runtest
File "C:\Users\ContainerAdministrator\AppData\Local\Programs\Python\Python314\Lib\site-packages\_pytest\runner.py", line 184 in pytest_runtest_call
File "C:\Users\ContainerAdministrator\AppData\Local\Programs\Python\Python314\Lib\site-packages\pluggy\_callers.py", line 121 in _multicall
File "C:\Users\ContainerAdministrator\AppData\Local\Programs\Python\Python314\Lib\site-packages\pluggy\_manager.py", line 120 in _hookexec
File "C:\Users\ContainerAdministrator\AppData\Local\Programs\Python\Python314\Lib\site-packages\pluggy\_hooks.py", line 512 in __call__
File "C:\Users\ContainerAdministrator\AppData\Local\Programs\Python\Python314\Lib\site-packages\_pytest\runner.py", line 250 in <lambda>
File "C:\Users\ContainerAdministrator\AppData\Local\Programs\Python\Python314\Lib\site-packages\_pytest\runner.py", line 361 in from_call
File "C:\Users\ContainerAdministrator\AppData\Local\Programs\Python\Python314\Lib\site-packages\_pytest\runner.py", line 249 in call_and_report
File "C:\Users\ContainerAdministrator\AppData\Local\Programs\Python\Python314\Lib\site-packages\_pytest\runner.py", line 139 in runtestprotocol
File "C:\Users\ContainerAdministrator\AppData\Local\Programs\Python\Python314\Lib\site-packages\_pytest\runner.py", line 118 in pytest_runtest_protocol
File "C:\Users\ContainerAdministrator\AppData\Local\Programs\Python\Python314\Lib\site-packages\pluggy\_callers.py", line 121 in _multicall
File "C:\Users\ContainerAdministrator\AppData\Local\Programs\Python\Python314\Lib\site-packages\pluggy\_manager.py", line 120 in _hookexec
File "C:\Users\ContainerAdministrator\AppData\Local\Programs\Python\Python314\Lib\site-packages\pluggy\_hooks.py", line 512 in __call__
File "C:\Users\ContainerAdministrator\AppData\Local\Programs\Python\Python314\Lib\site-packages\_pytest\main.py", line 408 in pytest_runtestloop
File "C:\Users\ContainerAdministrator\AppData\Local\Programs\Python\Python314\Lib\site-packages\pluggy\_callers.py", line 121 in _multicall
File "C:\Users\ContainerAdministrator\AppData\Local\Programs\Python\Python314\Lib\site-packages\pluggy\_manager.py", line 120 in _hookexec
File "C:\Users\ContainerAdministrator\AppData\Local\Programs\Python\Python314\Lib\site-packages\pluggy\_hooks.py", line 512 in __call__
File "C:\Users\ContainerAdministrator\AppData\Local\Programs\Python\Python314\Lib\site-packages\_pytest\main.py", line 384 in _main
File "C:\Users\ContainerAdministrator\AppData\Local\Programs\Python\Python314\Lib\site-packages\_pytest\main.py", line 330 in wrap_session
File "C:\Users\ContainerAdministrator\AppData\Local\Programs\Python\Python314\Lib\site-packages\_pytest\main.py", line 377 in pytest_cmdline_main
File "C:\Users\ContainerAdministrator\AppData\Local\Programs\Python\Python314\Lib\site-packages\pluggy\_callers.py", line 121 in _multicall
File "C:\Users\ContainerAdministrator\AppData\Local\Programs\Python\Python314\Lib\site-packages\pluggy\_manager.py", line 120 in _hookexec
File "C:\Users\ContainerAdministrator\AppData\Local\Programs\Python\Python314\Lib\site-packages\pluggy\_hooks.py", line 512 in __call__
File "C:\Users\ContainerAdministrator\AppData\Local\Programs\Python\Python314\Lib\site-packages\_pytest\config\__init__.py", line 229 in _main
File "C:\Users\ContainerAdministrator\AppData\Local\Programs\Python\Python314\Lib\site-packages\_pytest\config\__init__.py", line 253 in _console_main
File "C:\Users\ContainerAdministrator\AppData\Local\Programs\Python\Python314\Lib\site-packages\pytest\__main__.py", line 9 in <module>
File "<frozen runpy>", line 88 in _run_code
File "<frozen runpy>", line 203 in _run_module_as_main
Current thread's C stack trace (most recent call first):
<cannot get C stack on this system>
Error: `docker compose --file=D:\a\crossbow\crossbow\arrow\compose.yaml run --rm python-free-threaded-wheel-windows-test` exited with a non-zero exit code 1, see the process log above.
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Python][Packaging] Nightly wheels fail with segmentation fault on Parquet [arrow]
Posted by "raulcd (via GitHub)" <gi...@apache.org>.
raulcd commented on issue #50291:
URL: https://github.com/apache/arrow/issues/50291#issuecomment-4842477605
It seems to be working now, I haven't been able to reproduce with archery on a PR, see:
https://github.com/apache/arrow/pull/50301#issuecomment-4842017204
I'll keep it open, validate the wheels for the next daily but will close if not reproducible.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org