You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2022/06/24 15:19:16 UTC
Build failed in Jenkins: beam_PostCommit_Python_VR_Samza #1322
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/1322/display/redirect?page=changes>
Changes:
[noreply] Enable close issue as not planned (#22032)
[noreply] Rename README.md to ACTIONS.md (#22043)
------------------------------------------
[...truncated 41.02 KB...]
Successfully installed distlib-0.3.1 filelock-3.7.1 grpcio-1.47.0 grpcio-tools-1.37.0 importlib-metadata-2.1.3 mypy-protobuf-1.18 packaging-21.3 platformdirs-2.5.2 pluggy-1.0.0 protobuf-3.20.1 py-1.11.0 pyparsing-3.0.9 setuptools-62.6.0 six-1.16.0 toml-0.10.2 tox-3.20.1 virtualenv-20.14.1 wheel-0.37.1 zipp-3.8.0
> Task :sdks:python:sdist
org/apache/beam/model/interactive/v1/beam_interactive_api.proto:36:1: warning: Import google/protobuf/timestamp.proto is unused.
Writing mypy to org/apache/beam/model/pipeline/v1/external_transforms_pb2.pyi
Writing mypy to org/apache/beam/model/pipeline/v1/beam_runner_api_pb2.pyi
Writing mypy to org/apache/beam/model/pipeline/v1/standard_window_fns_pb2.pyi
Writing mypy to org/apache/beam/model/pipeline/v1/metrics_pb2.pyi
Writing mypy to org/apache/beam/model/pipeline/v1/endpoints_pb2.pyi
Writing mypy to org/apache/beam/model/pipeline/v1/schema_pb2.pyi
Writing mypy to org/apache/beam/model/job_management/v1/beam_artifact_api_pb2.pyi
Writing mypy to org/apache/beam/model/job_management/v1/beam_expansion_api_pb2.pyi
Writing mypy to org/apache/beam/model/job_management/v1/beam_job_api_pb2.pyi
Writing mypy to org/apache/beam/model/fn_execution/v1/beam_provision_api_pb2.pyi
Writing mypy to org/apache/beam/model/fn_execution/v1/beam_fn_api_pb2.pyi
Writing mypy to org/apache/beam/model/interactive/v1/beam_interactive_api_pb2.pyi
<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/setuptools/dist.py>:531: UserWarning: Normalizing '2.41.0.dev' to '2.41.0.dev0'
warnings.warn(tmpl.format(**locals()))
warning: no files found matching 'README.md'
warning: no files found matching 'NOTICE'
warning: no files found matching 'LICENSE'
warning: no files found matching 'LICENSE.python'
warning: sdist: standard file not found: should have one of README, README.rst, README.txt, README.md
> Task :sdks:python:test-suites:portable:py37:samzaCompatibilityMatrixLOOPBACK
[1msamza-runner-test create: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py37/build/srcs/sdks/python/target/.tox-samza-runner-test/samza-runner-test>
[0m[1msamza-runner-test installdeps: -rbuild-requirements.txt
[0m[1msamza-runner-test inst: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py37/build/srcs/sdks/python/target/.tox-samza-runner-test/.tmp/package/1/apache-beam.tar.gz>
[0m[1msamza-runner-test installed: apache-beam @ file://<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py37/build/srcs/sdks/python/target/.tox-samza-runner-test/.tmp/package/1/apache-beam.tar.gz,attrs==21.4.0,certifi==2022.6.15,cffi==1.15.0,charset-normalizer==2.0.12,cloudpickle==2.1.0,crcmod==1.7,cryptography==37.0.2,deprecation==2.1.0,dill==0.3.1.1,distlib==0.3.1,docker==5.0.3,docopt==0.6.2,execnet==1.9.0,fastavro==1.5.1,freezegun==1.2.1,greenlet==1.1.2,grpcio==1.47.0,grpcio-tools==1.37.0,hdfs==2.7.0,httplib2==0.20.4,idna==3.3,importlib-metadata==4.11.4,iniconfig==1.1.1,joblib==1.1.0,mock==2.0.0,mypy-protobuf==1.18,numpy==1.21.6,orjson==3.7.3,packaging==21.3,pandas==1.3.5,parameterized==0.8.1,pbr==5.9.0,pluggy==1.0.0,proto-plus==1.20.6,protobuf==3.20.1,psycopg2-binary==2.9.3,py==1.11.0,pyarrow==7.0.0,pycparser==2.21,pydot==1.4.2,PyHamcrest==1.10.1,pymongo==3.12.3,PyMySQL==1.0.2,pyparsing==3.0.9,pytest==7.1.2,pytest-forked==1.4.0,pytest-timeout==2.1.0,pytest-xdist==2.5.0,python-dateutil==2.8.2,pytz==2022.1,PyYAML==6.0,requests==2.28.0,requests-mock==1.9.3,scikit-learn==1.0.2,scipy==1.7.3,six==1.16.0,SQLAlchemy==1.4.38,tenacity==5.1.5,testcontainers==3.6.0,threadpoolctl==3.1.0,tomli==2.0.1,typing_extensions==4.2.0,urllib3==1.26.9,websocket-client==1.3.3,wrapt==1.14.1,zipp==3.8.0>
[0m[1msamza-runner-test run-test-pre: PYTHONHASHSEED='3132781024'
[0m[1msamza-runner-test run-test-pre: commands[0] | python --version
[0mPython 3.7.12
[1msamza-runner-test run-test-pre: commands[1] | pip --version
[0mpip 22.1.2 from <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py37/build/srcs/sdks/python/target/.tox-samza-runner-test/samza-runner-test/lib/python3.7/site-packages/pip> (python 3.7)
[1msamza-runner-test run-test-pre: commands[2] | pip check
[0mNo broken requirements found.
[1msamza-runner-test run-test-pre: commands[3] | bash <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py37/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
[0m[1msamza-runner-test run-test: commands[0] | <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py37/build/srcs/sdks/python/scripts/pytest_validates_runner.sh> samza-runner-test <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py37/build/srcs/sdks/python/apache_beam/runners/portability/samza_runner_test.py> '--samza_job_server_jar=<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/runners/samza/job-server/build/libs/beam-runners-samza-job-server-2.41.0-SNAPSHOT.jar> --environment_type=LOOPBACK'
[0m============================= test session starts ==============================
platform linux -- Python 3.7.12, pytest-7.1.2, pluggy-1.0.0
cachedir: target/.tox-samza-runner-test/samza-runner-test/.pytest_cache
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py37/build/srcs/sdks/python,> configfile: pytest.ini
plugins: xdist-2.5.0, timeout-2.1.0, forked-1.4.0, requests-mock-1.9.3
timeout: 600.0s
timeout method: signal
timeout func_only: False
collected 65 items
apache_beam/runners/portability/samza_runner_test.py F.....s...s...ss... [ 29%]
......ss.......s..s......s.....s..ss...sssss.. [100%]
=================================== FAILURES ===================================
_______________________ SamzaRunnerTest.test_assert_that _______________________
RuntimeError: Subprocess terminated unexpectedly with exit code 0.
During handling of the above exception, another exception occurred:
self = <apache_beam.runners.portability.samza_runner_test.SamzaRunnerTest testMethod=test_assert_that>
def test_assert_that(self):
# TODO: figure out a way for fn_api_runner to parse and raise the
# underlying exception.
with self.assertRaisesRegex(Exception, 'Failed assert'):
with self.create_pipeline() as p:
> assert_that(p | beam.Create(['a', 'b']), equal_to(['a']))
E AssertionError: "Failed assert" does not match "Subprocess terminated unexpectedly with exit code 0."
apache_beam/runners/portability/fn_api_runner/fn_runner_test.py:113: AssertionError
----------------------------- Captured stderr call -----------------------------
[main] INFO org.apache.beam.runners.jobsubmission.JobServerDriver - ArtifactStagingService started on localhost:46827
[main] INFO org.apache.beam.runners.jobsubmission.JobServerDriver - Java ExpansionService started on localhost:35139
[main] WARN org.apache.beam.runners.jobsubmission.JobServerDriver - Exception during job server creation
java.io.IOException: Failed to bind to address 0.0.0.0/0.0.0.0:46827
at org.apache.beam.vendor.grpc.v1p43p2.io.grpc.netty.NettyServer.start(NettyServer.java:328)
at org.apache.beam.vendor.grpc.v1p43p2.io.grpc.internal.ServerImpl.start(ServerImpl.java:183)
at org.apache.beam.vendor.grpc.v1p43p2.io.grpc.internal.ServerImpl.start(ServerImpl.java:92)
at org.apache.beam.sdk.fn.server.ServerFactory$InetSocketAddressServerFactory.createServer(ServerFactory.java:162)
at org.apache.beam.sdk.fn.server.ServerFactory$InetSocketAddressServerFactory.create(ServerFactory.java:145)
at org.apache.beam.sdk.fn.server.GrpcFnServer.create(GrpcFnServer.java:110)
at org.apache.beam.runners.jobsubmission.JobServerDriver.createJobServer(JobServerDriver.java:238)
at org.apache.beam.runners.jobsubmission.JobServerDriver.run(JobServerDriver.java:176)
at org.apache.beam.runners.samza.SamzaJobServerDriver.main(SamzaJobServerDriver.java:43)
Caused by: org.apache.beam.vendor.grpc.v1p43p2.io.netty.channel.unix.Errors$NativeIoException: bind(..) failed: Address already in use
[main] INFO org.apache.beam.runners.jobsubmission.JobServerDriver - ArtifactStagingServer stopped on localhost:46827
[main] INFO org.apache.beam.runners.jobsubmission.JobServerDriver - Expansion stopped on localhost:35139
=============================== warnings summary ===============================
target/.tox-samza-runner-test/samza-runner-test/lib/python3.7/site-packages/hdfs/config.py:15
<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py37/build/srcs/sdks/python/target/.tox-samza-runner-test/samza-runner-test/lib/python3.7/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
from imp import load_source
apache_beam/runners/portability/samza_runner_test.py::SamzaRunnerTest::test_element_to_batch_pardo
<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py37/build/srcs/sdks/python/apache_beam/runners/worker/operations.py>:358: InefficientExecutionWarning: Input to operation <DoOperation ParDo(ArrayMultiplyDoFn) output_tags=['None'], receivers=[GeneralPurposeConsumerSet[ParDo(ArrayMultiplyDoFn).out0, coder=WindowedValueCoder[FastPrimitivesCoder], len(consumers)=1]]> must be rebatched from type NumpyArray[dtype('int64')] to NumpyArray[dtype('O')].
This is very inefficient, consider re-structuring your pipeline or adding a DoFn to directly convert between these types.
InefficientExecutionWarning)
apache_beam/runners/portability/samza_runner_test.py::SamzaRunnerTest::test_element_to_batch_pardo
<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py37/build/srcs/sdks/python/apache_beam/runners/common.py>:1704: FutureWarning: arrays to stack must be passed as a "sequence" type such as list or tuple. Support for non-sequence iterables such as generators is deprecated as of NumPy 1.16 and will raise an error in the future.
self.main_receivers.receive_batch(windowed_batch)
-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py37/build/srcs/sdks/python/pytest_samza-runner-test.xml> -
=========================== short test summary info ============================
FAILED apache_beam/runners/portability/samza_runner_test.py::SamzaRunnerTest::test_assert_that
============ 1 failed, 47 passed, 17 skipped, 3 warnings in 59.79s =============
[31mERROR: InvocationError for command <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py37/build/srcs/sdks/python/scripts/pytest_validates_runner.sh> samza-runner-test apache_beam/runners/portability/samza_runner_test.py '--samza_job_server_jar=<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/runners/samza/job-server/build/libs/beam-runners-samza-job-server-2.41.0-SNAPSHOT.jar> --environment_type=LOOPBACK' (exited with code 1)
[0m[1msamza-runner-test run-test-post: commands[0] | bash <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py37/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
[0m___________________________________ summary ____________________________________
[31mERROR: samza-runner-test: commands failed
[0m
> Task :sdks:python:test-suites:portable:py37:samzaCompatibilityMatrixLOOPBACK FAILED
> Task :sdks:python:test-suites:portable:py38:samzaCompatibilityMatrixLOOPBACK
[1msamza-runner-test create: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/target/.tox-samza-runner-test/samza-runner-test>
[0m[1msamza-runner-test installdeps: -rbuild-requirements.txt
[0m[1msamza-runner-test inst: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/target/.tox-samza-runner-test/.tmp/package/1/apache-beam.tar.gz>
[0m[1msamza-runner-test installed: apache-beam @ file://<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/target/.tox-samza-runner-test/.tmp/package/1/apache-beam.tar.gz,attrs==21.4.0,certifi==2022.6.15,cffi==1.15.0,charset-normalizer==2.0.12,cloudpickle==2.1.0,crcmod==1.7,cryptography==37.0.2,deprecation==2.1.0,dill==0.3.1.1,distlib==0.3.1,docker==5.0.3,docopt==0.6.2,execnet==1.9.0,fastavro==1.5.1,freezegun==1.2.1,greenlet==1.1.2,grpcio==1.47.0,grpcio-tools==1.37.0,hdfs==2.7.0,httplib2==0.20.4,idna==3.3,iniconfig==1.1.1,joblib==1.1.0,mock==2.0.0,mypy-protobuf==1.18,numpy==1.22.4,orjson==3.7.3,packaging==21.3,pandas==1.4.3,parameterized==0.8.1,pbr==5.9.0,pluggy==1.0.0,proto-plus==1.20.6,protobuf==3.20.1,psycopg2-binary==2.9.3,py==1.11.0,pyarrow==7.0.0,pycparser==2.21,pydot==1.4.2,PyHamcrest==1.10.1,pymongo==3.12.3,PyMySQL==1.0.2,pyparsing==3.0.9,pytest==7.1.2,pytest-forked==1.4.0,pytest-timeout==2.1.0,pytest-xdist==2.5.0,python-dateutil==2.8.2,pytz==2022.1,PyYAML==6.0,requests==2.28.0,requests-mock==1.9.3,scikit-learn==1.1.1,scipy==1.8.1,six==1.16.0,SQLAlchemy==1.4.38,tenacity==5.1.5,testcontainers==3.6.0,threadpoolctl==3.1.0,tomli==2.0.1,typing_extensions==4.2.0,urllib3==1.26.9,websocket-client==1.3.3,wrapt==1.14.1>
[0m[1msamza-runner-test run-test-pre: PYTHONHASHSEED='3054360273'
[0m[1msamza-runner-test run-test-pre: commands[0] | python --version
[0mPython 3.8.10
[1msamza-runner-test run-test-pre: commands[1] | pip --version
[0mpip 22.1.2 from <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/target/.tox-samza-runner-test/samza-runner-test/lib/python3.8/site-packages/pip> (python 3.8)
[1msamza-runner-test run-test-pre: commands[2] | pip check
[0mNo broken requirements found.
[1msamza-runner-test run-test-pre: commands[3] | bash <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
[0m[1msamza-runner-test run-test: commands[0] | <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/scripts/pytest_validates_runner.sh> samza-runner-test <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/apache_beam/runners/portability/samza_runner_test.py> '--samza_job_server_jar=<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/runners/samza/job-server/build/libs/beam-runners-samza-job-server-2.41.0-SNAPSHOT.jar> --environment_type=LOOPBACK'
[0m============================= test session starts ==============================
platform linux -- Python 3.8.10, pytest-7.1.2, pluggy-1.0.0
cachedir: target/.tox-samza-runner-test/samza-runner-test/.pytest_cache
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python,> configfile: pytest.ini
plugins: xdist-2.5.0, timeout-2.1.0, forked-1.4.0, requests-mock-1.9.3
timeout: 600.0s
timeout method: signal
timeout func_only: False
collected 65 items
apache_beam/runners/portability/samza_runner_test.py ......s...s...ss... [ 29%]
......ss.......s..s......s.....s..ss...sssss.. [100%]
=============================== warnings summary ===============================
target/.tox-samza-runner-test/samza-runner-test/lib/python3.8/site-packages/hdfs/config.py:15
<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/target/.tox-samza-runner-test/samza-runner-test/lib/python3.8/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
from imp import load_source
target/.tox-samza-runner-test/samza-runner-test/lib/python3.8/site-packages/tenacity/_asyncio.py:42
<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/target/.tox-samza-runner-test/samza-runner-test/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
apache_beam/runners/portability/samza_runner_test.py::SamzaRunnerTest::test_element_to_batch_pardo
<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/apache_beam/runners/worker/operations.py>:352: InefficientExecutionWarning: Input to operation <DoOperation ParDo(ArrayMultiplyDoFn) output_tags=['None'], receivers=[GeneralPurposeConsumerSet[ParDo(ArrayMultiplyDoFn).out0, coder=WindowedValueCoder[FastPrimitivesCoder], len(consumers)=1]]> must be rebatched from type NumpyArray[dtype('int64')] to NumpyArray[dtype('O')].
This is very inefficient, consider re-structuring your pipeline or adding a DoFn to directly convert between these types.
warnings.warn(
apache_beam/runners/portability/samza_runner_test.py::SamzaRunnerTest::test_element_to_batch_pardo
<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/apache_beam/runners/common.py>:1704: FutureWarning: arrays to stack must be passed as a "sequence" type such as list or tuple. Support for non-sequence iterables such as generators is deprecated as of NumPy 1.16 and will raise an error in the future.
self.main_receivers.receive_batch(windowed_batch)
-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/pytest_samza-runner-test.xml> -
================= 48 passed, 17 skipped, 4 warnings in 56.41s ==================
[1msamza-runner-test run-test-post: commands[0] | bash <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
[0m___________________________________ summary ____________________________________
[32m samza-runner-test: commands succeeded
[0m[32m congratulations :)
[0m
> Task :sdks:python:test-suites:portable:py38:samzaValidatesRunner
> Task :sdks:python:test-suites:portable:py39:samzaCompatibilityMatrixLOOPBACK
[1msamza-runner-test create: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/target/.tox-samza-runner-test/samza-runner-test>
[0m[1msamza-runner-test installdeps: -rbuild-requirements.txt
[0m[1msamza-runner-test inst: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/target/.tox-samza-runner-test/.tmp/package/1/apache-beam.tar.gz>
[0m[1msamza-runner-test installed: apache-beam @ file://<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/target/.tox-samza-runner-test/.tmp/package/1/apache-beam.tar.gz,attrs==21.4.0,certifi==2022.6.15,cffi==1.15.0,charset-normalizer==2.0.12,cloudpickle==2.1.0,crcmod==1.7,cryptography==37.0.2,deprecation==2.1.0,dill==0.3.1.1,distlib==0.3.1,docker==5.0.3,docopt==0.6.2,execnet==1.9.0,fastavro==1.5.1,freezegun==1.2.1,greenlet==1.1.2,grpcio==1.47.0,grpcio-tools==1.37.0,hdfs==2.7.0,httplib2==0.20.4,idna==3.3,iniconfig==1.1.1,joblib==1.1.0,mock==2.0.0,mypy-protobuf==1.18,numpy==1.22.4,orjson==3.7.3,packaging==21.3,pandas==1.4.3,parameterized==0.8.1,pbr==5.9.0,pluggy==1.0.0,proto-plus==1.20.6,protobuf==3.20.1,psycopg2-binary==2.9.3,py==1.11.0,pyarrow==7.0.0,pycparser==2.21,pydot==1.4.2,PyHamcrest==1.10.1,pymongo==3.12.3,PyMySQL==1.0.2,pyparsing==3.0.9,pytest==7.1.2,pytest-forked==1.4.0,pytest-timeout==2.1.0,pytest-xdist==2.5.0,python-dateutil==2.8.2,pytz==2022.1,PyYAML==6.0,requests==2.28.0,requests-mock==1.9.3,scikit-learn==1.1.1,scipy==1.8.1,six==1.16.0,SQLAlchemy==1.4.38,tenacity==5.1.5,testcontainers==3.6.0,threadpoolctl==3.1.0,tomli==2.0.1,typing_extensions==4.2.0,urllib3==1.26.9,websocket-client==1.3.3,wrapt==1.14.1>
[0m[1msamza-runner-test run-test-pre: PYTHONHASHSEED='4251995175'
[0m[1msamza-runner-test run-test-pre: commands[0] | python --version
[0mPython 3.9.10
[1msamza-runner-test run-test-pre: commands[1] | pip --version
[0mpip 22.1.2 from <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/target/.tox-samza-runner-test/samza-runner-test/lib/python3.9/site-packages/pip> (python 3.9)
[1msamza-runner-test run-test-pre: commands[2] | pip check
[0mNo broken requirements found.
[1msamza-runner-test run-test-pre: commands[3] | bash <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
[0m[1msamza-runner-test run-test: commands[0] | <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/scripts/pytest_validates_runner.sh> samza-runner-test <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/apache_beam/runners/portability/samza_runner_test.py> '--samza_job_server_jar=<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/runners/samza/job-server/build/libs/beam-runners-samza-job-server-2.41.0-SNAPSHOT.jar> --environment_type=LOOPBACK'
[0m============================= test session starts ==============================
platform linux -- Python 3.9.10, pytest-7.1.2, pluggy-1.0.0
cachedir: target/.tox-samza-runner-test/samza-runner-test/.pytest_cache
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python,> configfile: pytest.ini
plugins: xdist-2.5.0, timeout-2.1.0, forked-1.4.0, requests-mock-1.9.3
timeout: 600.0s
timeout method: signal
timeout func_only: False
collected 65 items
apache_beam/runners/portability/samza_runner_test.py ......s...s...ss... [ 29%]
......ss.......s..s......s.....s..ss...sssss.. [100%]
=============================== warnings summary ===============================
target/.tox-samza-runner-test/samza-runner-test/lib/python3.9/site-packages/hdfs/config.py:15
<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/target/.tox-samza-runner-test/samza-runner-test/lib/python3.9/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
from imp import load_source
target/.tox-samza-runner-test/samza-runner-test/lib/python3.9/site-packages/tenacity/_asyncio.py:42
<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/target/.tox-samza-runner-test/samza-runner-test/lib/python3.9/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
apache_beam/runners/portability/samza_runner_test.py::SamzaRunnerTest::test_element_to_batch_pardo
<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/apache_beam/runners/worker/operations.py>:352: InefficientExecutionWarning: Input to operation <DoOperation ParDo(ArrayMultiplyDoFn) output_tags=['None'], receivers=[GeneralPurposeConsumerSet[ParDo(ArrayMultiplyDoFn).out0, coder=WindowedValueCoder[FastPrimitivesCoder], len(consumers)=1]]> must be rebatched from type NumpyArray[dtype('int64')] to NumpyArray[dtype('O')].
This is very inefficient, consider re-structuring your pipeline or adding a DoFn to directly convert between these types.
warnings.warn(
apache_beam/runners/portability/samza_runner_test.py::SamzaRunnerTest::test_element_to_batch_pardo
<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/apache_beam/runners/common.py>:1704: FutureWarning: arrays to stack must be passed as a "sequence" type such as list or tuple. Support for non-sequence iterables such as generators is deprecated as of NumPy 1.16 and will raise an error in the future.
self.main_receivers.receive_batch(windowed_batch)
-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/pytest_samza-runner-test.xml> -
================= 48 passed, 17 skipped, 4 warnings in 56.89s ==================
[1msamza-runner-test run-test-post: commands[0] | bash <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
[0m___________________________________ summary ____________________________________
[32m samza-runner-test: commands succeeded
[0m[32m congratulations :)
[0m
> Task :sdks:python:test-suites:portable:py39:samzaValidatesRunner
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:samzaCompatibilityMatrixLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.4/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 5m 49s
75 actionable tasks: 47 executed, 26 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/zgnhm5vsxjo5a
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal : beam_PostCommit_Python_VR_Samza #1323
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Samza/1323/display/redirect?page=changes>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org