You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@iceberg.apache.org by "JonasJ-ap (via GitHub)" <gi...@apache.org> on 2023/03/18 05:32:39 UTC
[GitHub] [iceberg] JonasJ-ap opened a new issue, #7135: PyIceberg: Current Python CI ignore most unit tests
JonasJ-ap opened a new issue, #7135:
URL: https://github.com/apache/iceberg/issues/7135
### Apache Iceberg version
main (development)
### Query engine
None
### Please describe the bug 🐞
Currently, the two tasks: `Test S3` and `Test Adlfs` in Python CI only runs some tests in `test_fsspec.py`, ignoring most unit tests:
Screenshot of a recent Python CI log:
![Screen Shot 2023-03-18 at 01 24 06](https://user-images.githubusercontent.com/55990951/226086664-98ec3e5e-3f0d-4526-929b-54e53658fe92.png)
![Screen Shot 2023-03-18 at 01 24 25](https://user-images.githubusercontent.com/55990951/226086718-530563a5-8aac-4def-b646-9953512b89b6.png)
I also checked the Python CI (integration test) and it only runs tests in `test_integration.py`. So it seems most of the unit tests are ignored now.
I also noticed that there are two unit tests failing in the current master branch when running locally:
```bash
_____________________________________________________________________________________________________________________________________________ test_expr_is_nan_to_pyarrow ______________________________________________________________________________________________________________________________________________
bound_double_reference = BoundReference(field=NestedField(field_id=1, name='foo', field_type=DoubleType(), required=False), accessor=Accessor(position=0,inner=None))
def test_expr_is_nan_to_pyarrow(bound_double_reference: BoundReference[str]) -> None:
> assert (
repr(expression_to_pyarrow(BoundIsNaN(bound_double_reference)))
== "<pyarrow.compute.Expression (is_null(foo, {nan_is_null=true}) and is_valid(foo))>"
)
E AssertionError: assert '<pyarrow.com... is_nan(foo)>' == '<pyarrow.com..._valid(foo))>'
E - <pyarrow.compute.Expression (is_null(foo, {nan_is_null=true}) and is_valid(foo))>
E + <pyarrow.compute.Expression is_nan(foo)>
tests/io/test_pyarrow.py:453: AssertionError
_____________________________________________________________________________________________________________________________________________ test_expr_not_nan_to_pyarrow _____________________________________________________________________________________________________________________________________________
bound_double_reference = BoundReference(field=NestedField(field_id=1, name='foo', field_type=DoubleType(), required=False), accessor=Accessor(position=0,inner=None))
def test_expr_not_nan_to_pyarrow(bound_double_reference: BoundReference[str]) -> None:
> assert (
repr(expression_to_pyarrow(BoundNotNaN(bound_double_reference)))
== "<pyarrow.compute.Expression invert((is_null(foo, {nan_is_null=true}) and is_valid(foo)))>"
)
E AssertionError: assert '<pyarrow.com...is_nan(foo))>' == '<pyarrow.com...valid(foo)))>'
E - <pyarrow.compute.Expression invert((is_null(foo, {nan_is_null=true}) and is_valid(foo)))>
E + <pyarrow.compute.Expression invert(is_nan(foo))>
tests/io/test_pyarrow.py:460: AssertionError
```
Seems related to the changes made in #6398 . But before making any change, I want to post this issue to make sure I did not misunderstood anything.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
[GitHub] [iceberg] jackye1995 closed issue #7135: Python: Current Python CI ignore most of the unit tests
Posted by "jackye1995 (via GitHub)" <gi...@apache.org>.
jackye1995 closed issue #7135: Python: Current Python CI ignore most of the unit tests
URL: https://github.com/apache/iceberg/issues/7135
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org