You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@arrow.apache.org by "raulcd (via GitHub)" <gi...@apache.org> on 2025/01/17 12:25:24 UTC
[I] [Python] test_dtypes hypotesis test fails sporadically [arrow]
raulcd opened a new issue, #45292:
URL: https://github.com/apache/arrow/issues/45292
### Describe the bug, including details regarding any error messages, version, and platform.
`test-conda-python-3.11-hypothesis` have been failing sporadically with the following error:
```
=================================== FAILURES ===================================
_________________________________ test_dtypes __________________________________
@pytest.mark.numpy
> @h.given(past.arrays(all_types, size=3))
E hypothesis.errors.FailedHealthCheck: Data generation is extremely slow: Only produced 3 valid examples in 1.49 seconds (0 invalid ones and 0 exceeded maximum size). Try decreasing size of the data you're generating (with e.g. max_size or max_leaves parameters).
E count | fraction | slowest draws (seconds)
E arr | 3 | 100% | -- -- 0.001, 0.001, 1.487
E See https://hypothesis.readthedocs.io/en/latest/healthchecks.html for more information about this. If you want to disable just this health check, add HealthCheck.too_slow to the suppress_health_check settings for this test.
opt/conda/envs/arrow/lib/python3.11/site-packages/pyarrow/tests/interchange/test_interchange_spec.py:46: FailedHealthCheck
---------------------------------- Hypothesis ----------------------------------
You can add @seed(50675225575349708009971759516150298645) to this test or run pytest with --hypothesis-seed=50675225575349708009971759516150298645 to reproduce this failure.
```
I've seen failures on several nightly jobs here:
- 17th Jan - [test-conda-python-3.11-hypothesis](https://github.com/ursacomputing/crossbow/actions/runs/12820187249/job/35749320370)
- 15th Jan - [test-conda-python-3.11-hypothesis](https://github.com/ursacomputing/crossbow/actions/runs/12779007661/job/35622922521)
- 14th Jan - [test-conda-python-3.11-hypothesis](https://github.com/ursacomputing/crossbow/actions/runs/12758593941/job/35560947916)
but also on PRs like:
- https://github.com/ursacomputing/crossbow/actions/runs/12828673021/job/35773213468
Given the randomness on those tests a retry might make them pass but given they fail quite often there might be an existing issue.
### Component(s)
Python
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@arrow.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Python] test_dtypes hypotesis test fails sporadically [arrow]
Posted by "kszucs (via GitHub)" <gi...@apache.org>.
kszucs closed issue #45292: [Python] test_dtypes hypotesis test fails sporadically
URL: https://github.com/apache/arrow/issues/45292
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Python] test_dtypes hypotesis test fails sporadically [arrow]
Posted by "AlenkaF (via GitHub)" <gi...@apache.org>.
AlenkaF commented on issue #45292:
URL: https://github.com/apache/arrow/issues/45292#issuecomment-2777698965
Sorry for not looking into it before and thank you for the ping @kou!
I think we have two options that do not need the test to be removed:
- we could try to select a subset of types in the strategy, like in this test here: https://github.com/apache/arrow/blob/7df396eec4c620ddc4a4db780ea0d5ffa4cf685b/python/pyarrow/tests/test_pandas.py#L3355
- if we are OK with the fact that the hypothesis might take a bit longer to gather all the test cases, we can use `suppress_health_check` setting as is done in this test here: https://github.com/apache/arrow/blob/7df396eec4c620ddc4a4db780ea0d5ffa4cf685b/python/pyarrow/tests/test_array.py#L2214
I would go with the second one, adding a `suppress_health_check` setting. From the health check it shows that the third draw took `1.487` seconds which is a lot but I think we could do with?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Python] test_dtypes hypotesis test fails sporadically [arrow]
Posted by "AlenkaF (via GitHub)" <gi...@apache.org>.
AlenkaF commented on issue #45292:
URL: https://github.com/apache/arrow/issues/45292#issuecomment-2777728958
Opened a draft PR that adds `suppress_health_check` setting: https://github.com/apache/arrow/pull/46029
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Python] test_dtypes hypotesis test fails sporadically [arrow]
Posted by "pitrou (via GitHub)" <gi...@apache.org>.
pitrou commented on issue #45292:
URL: https://github.com/apache/arrow/issues/45292#issuecomment-2777838591
Well, @kszucs could probably look into it.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Python] test_dtypes hypotesis test fails sporadically [arrow]
Posted by "kou (via GitHub)" <gi...@apache.org>.
kou commented on issue #45292:
URL: https://github.com/apache/arrow/issues/45292#issuecomment-2777380548
@jorisvandenbossche @AlenkaF @pitrou Can we remove the test? It seems that we can't maintain the test.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Python] test_dtypes hypotesis test fails sporadically [arrow]
Posted by "kszucs (via GitHub)" <gi...@apache.org>.
kszucs commented on issue #45292:
URL: https://github.com/apache/arrow/issues/45292#issuecomment-2783309592
Issue resolved by pull request 46029
https://github.com/apache/arrow/pull/46029
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org