You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@arrow.apache.org by "Joris Van den Bossche (Jira)" <ji...@apache.org> on 2022/10/21 12:35:00 UTC
[jira] [Created] (ARROW-18127) [CI][Python] Have a way to reproduce hypothesis failures from CI
Joris Van den Bossche created ARROW-18127:
---------------------------------------------
Summary: [CI][Python] Have a way to reproduce hypothesis failures from CI
Key: ARROW-18127
URL: https://issues.apache.org/jira/browse/ARROW-18127
Project: Apache Arrow
Issue Type: Test
Components: Continuous Integration, Python
Reporter: Joris Van den Bossche
We have a nightly test build with hypothesis enabled, and those tests fail / crash from time to time, eg https://github.com/ursacomputing/crossbow/actions/runs/3286024804/jobs/5413689973
Ideally, if there is such a failure, we should actually fix that test case. But that requires us to be able to reproduce the failure locally.
If it's an actual test failure, hypothesis should print some information to re-run it locally with the same input (https://hypothesis.readthedocs.io/en/latest/reproducing.html#reproducing-an-example-with-reproduce-failure).
But if it is segfaulting, this information is not printed by default.
Another idea might to save the ./hypothesis/examples directory as artifact on the CI build, to use it locally, but probably that might have the same issue of not having the information we need in case of a crash.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)