You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Tobiasz Kedzierski (Jira)" <ji...@apache.org> on 2020/08/05 08:51:00 UTC
[jira] [Commented] (BEAM-10624) tests fails on windows - pyarrow
stores int always as 32 bit
[ https://issues.apache.org/jira/browse/BEAM-10624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17171351#comment-17171351 ]
Tobiasz Kedzierski commented on BEAM-10624:
-------------------------------------------
This may be related: https://stackoverflow.com/questions/36278590/numpy-array-dtype-is-coming-as-int32-by-default-in-a-windows-10-64-bit-machine
> tests fails on windows - pyarrow stores int always as 32 bit
> ------------------------------------------------------------
>
> Key: BEAM-10624
> URL: https://issues.apache.org/jira/browse/BEAM-10624
> Project: Beam
> Issue Type: Bug
> Components: sdk-py-core, testing
> Reporter: Tobiasz Kedzierski
> Assignee: Brian Hulette
> Priority: P2
> Attachments: BEAM-10624.txt
>
>
> Failing test:
> apache_beam.testing.datatype_inference_test.DatatypeInferenceTest.test_infer_pyarrow_schema
> Link to the github workflow run with mentioned error:
> [https://github.com/TobKed/beam/runs/937414511?check_suite_focus=true]
> partial log:
> 2020-08-02T11:59:00.9369328Z ================================== FAILURES ===================================
> 2020-08-02T11:59:00.9470134Z ___________ DatatypeInferenceTest.test_infer_pyarrow_schema_1_main ____________
> 2020-08-02T11:59:00.9470741Z [gw4] win32 -- Python 3.7.8 d:\a\beam\beam\sdks\python\target\.tox\py37-win\scripts\python.exe
> 2020-08-02T11:59:00.9471799Z
> 2020-08-02T11:59:00.9472229Z a = (<apache_beam.testing.datatype_inference_test.DatatypeInferenceTest testMethod=test_infer_pyarrow_schema_1_main>,)
> 2020-08-02T11:59:00.9472480Z
> 2020-08-02T11:59:00.9472784Z @wraps(func)
> 2020-08-02T11:59:00.9473094Z def standalone_func(*a):
> 2020-08-02T11:59:00.9473370Z > return func(*(a + p.args), **p.kwargs)
> 2020-08-02T11:59:00.9473579Z
> 2020-08-02T11:59:00.9473858Z target\.tox\py37-win\lib\site-packages\parameterized\parameterized.py:530:
> 2020-08-02T11:59:00.9474175Z _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
> 2020-08-02T11:59:00.9474571Z apache_beam\testing\datatype_inference_test.py:183: in test_infer_pyarrow_schema
> 2020-08-02T11:59:00.9474893Z self.assertEqual(pyarrow_schema, schema)
> 2020-08-02T11:59:00.9475190Z E AssertionError: a: in[14 chars]c: string
> 2020-08-02T11:59:00.9475478Z E d: list<item: int32>
> 2020-08-02T11:59:00.9475766Z E child 0, item: int32
> 2020-08-02T11:59:00.9476074Z E e: binary != a: in[14 chars]c: string
> 2020-08-02T11:59:00.9476366Z E d: list<item: int64>
> 2020-08-02T11:59:00.9476668Z E child 0, item: int64
> 2020-08-02T11:59:00.9476948Z E e: binary
> 2020-08-02T11:59:00.9477336Z ______ DatatypeInferenceTest.test_infer_pyarrow_schema_2_main_nullified _______
> 2020-08-02T11:59:00.9477924Z [gw4] win32 -- Python 3.7.8 d:\a\beam\beam\sdks\python\target\.tox\py37-win\scripts\python.exe
> 2020-08-02T11:59:00.9478180Z
> 2020-08-02T11:59:00.9478977Z a = (<apache_beam.testing.datatype_inference_test.DatatypeInferenceTest testMethod=test_infer_pyarrow_schema_2_main_nullified>,)
> 2020-08-02T11:59:00.9479255Z
> 2020-08-02T11:59:00.9479512Z @wraps(func)
> 2020-08-02T11:59:00.9479809Z def standalone_func(*a):
> 2020-08-02T11:59:00.9480081Z > return func(*(a + p.args), **p.kwargs)
> 2020-08-02T11:59:00.9480288Z
> 2020-08-02T11:59:00.9480562Z target\.tox\py37-win\lib\site-packages\parameterized\parameterized.py:530:
> 2020-08-02T11:59:00.9481023Z _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
> 2020-08-02T11:59:00.9481594Z apache_beam\testing\datatype_inference_test.py:183: in test_infer_pyarrow_schema
> 2020-08-02T11:59:00.9481922Z self.assertEqual(pyarrow_schema, schema)
> 2020-08-02T11:59:00.9482390Z E AssertionError: a: in[14 chars]c: string
> 2020-08-02T11:59:00.9482697Z E d: list<item: int32>
> 2020-08-02T11:59:00.9482956Z E child 0, item: int32
> 2020-08-02T11:59:00.9483261Z E e: binary != a: in[14 chars]c: string
> 2020-08-02T11:59:00.9483524Z E d: list<item: int64>
> 2020-08-02T11:59:00.9483812Z E child 0, item: int64
> 2020-08-02T11:59:00.9484071Z E e: binary
--
This message was sent by Atlassian Jira
(v8.3.4#803005)