You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2022/09/13 17:10:28 UTC

Build failed in Jenkins: beam_PostCommit_Python_VR_Flink #2842

See <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/2842/display/redirect?page=changes>

Changes:

[noreply] [Playground] [Backend] Datastore queries and mappers to get precompiled


------------------------------------------
[...truncated 86.88 KB...]

apache_beam/runners/portability/flink_runner_test.py ......s...s...ss... [  9%]
.........s....s...s..s............s..ss.....ss.s........s...s...ss...sss [ 43%]
......s....s...s..s............s..ss.....ssss........s...s...ss......... [ 78%]
...s....s...s..s............s..ss.....ss.s..                             [100%]

=============================== warnings summary ===============================
target/.tox-flink-runner-test/flink-runner-test/lib/python3.8/site-packages/hdfs/config.py:15
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/lib/python3.8/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

target/.tox-flink-runner-test/flink-runner-test/lib/python3.8/site-packages/tenacity/_asyncio.py:42
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
    def call(self, fn, *args, **kwargs):

apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTest::test_pardo_state_with_custom_key_coder
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/lib/python3.8/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.8/threading.py", line 932, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.8/threading.py", line 870, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/lib/python3.8/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/lib/python3.8/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:41375 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-09-13T16:32:38.082380994+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/pytest_flink-runner-test.xml> -
=========== 161 passed, 46 skipped, 3 warnings in 866.13s (0:14:26) ============
flink-runner-test run-test-post: commands[0] | bash <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
___________________________________ summary ____________________________________
  flink-runner-test: commands succeeded
  congratulations :)

> Task :sdks:python:test-suites:portable:py38:flinkValidatesRunner

> Task :sdks:python:test-suites:portable:py37:flinkCompatibilityMatrixLOOPBACK
flink-runner-test create: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py37/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test>
flink-runner-test installdeps: -rbuild-requirements.txt
flink-runner-test inst: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py37/build/srcs/sdks/python/target/.tox-flink-runner-test/.tmp/package/1/apache-beam.tar.gz>
flink-runner-test installed: apache-beam @ file://<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py37/build/srcs/sdks/python/target/.tox-flink-runner-test/.tmp/package/1/apache-beam.tar.gz,attrs==22.1.0,certifi==2022.6.15.1,cffi==1.15.1,charset-normalizer==2.1.1,cloudpickle==2.2.0,crcmod==1.7,cryptography==38.0.1,deprecation==2.1.0,dill==0.3.1.1,distlib==0.3.1,docker==6.0.0,docopt==0.6.2,execnet==1.9.0,fastavro==1.6.1,freezegun==1.2.2,greenlet==1.1.3,grpcio==1.48.1,grpcio-tools==1.37.0,hdfs==2.7.0,httplib2==0.20.4,idna==3.3,importlib-metadata==4.12.0,iniconfig==1.1.1,joblib==1.1.0,mock==2.0.0,mypy-protobuf==1.18,numpy==1.21.6,objsize==0.5.2,orjson==3.8.0,packaging==21.3,pandas==1.3.5,parameterized==0.8.1,pbr==5.10.0,pluggy==1.0.0,proto-plus==1.22.1,protobuf==3.20.1,psycopg2-binary==2.9.3,py==1.11.0,pyarrow==7.0.0,pycparser==2.21,pydot==1.4.2,PyHamcrest==1.10.1,pymongo==3.12.3,PyMySQL==1.0.2,pyparsing==3.0.9,pytest==7.1.3,pytest-forked==1.4.0,pytest-timeout==2.1.0,pytest-xdist==2.5.0,python-dateutil==2.8.2,pytz==2022.2.1,PyYAML==6.0,regex==2022.9.13,requests==2.28.1,requests-mock==1.10.0,scikit-learn==1.0.2,scipy==1.7.3,six==1.16.0,SQLAlchemy==1.4.41,tenacity==5.1.5,testcontainers==3.6.1,threadpoolctl==3.1.0,tomli==2.0.1,typing_extensions==4.3.0,urllib3==1.26.12,websocket-client==1.4.1,wrapt==1.14.1,zipp==3.8.1,zstandard==0.18.0>
flink-runner-test run-test-pre: PYTHONHASHSEED='3249616168'
flink-runner-test run-test-pre: commands[0] | python --version
Python 3.7.12
flink-runner-test run-test-pre: commands[1] | pip --version
pip 22.2.2 from <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py37/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/lib/python3.7/site-packages/pip> (python 3.7)
flink-runner-test run-test-pre: commands[2] | pip check
No broken requirements found.
flink-runner-test run-test-pre: commands[3] | bash <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py37/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
flink-runner-test run-test: commands[0] | <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py37/build/srcs/sdks/python/scripts/pytest_validates_runner.sh> flink-runner-test <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py37/build/srcs/sdks/python/apache_beam/runners/portability/flink_runner_test.py> '--flink_job_server_jar=<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/runners/flink/1.15/job-server/build/libs/beam-runners-flink-1.15-job-server-2.43.0-SNAPSHOT.jar> --environment_type=LOOPBACK'
============================= test session starts ==============================
platform linux -- Python 3.7.12, pytest-7.1.3, pluggy-1.0.0
cachedir: target/.tox-flink-runner-test/flink-runner-test/.pytest_cache
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py37/build/srcs/sdks/python,> configfile: pytest.ini
plugins: xdist-2.5.0, timeout-2.1.0, forked-1.4.0, requests-mock-1.10.0
timeout: 600.0s
timeout method: signal
timeout func_only: False
collected 207 items

apache_beam/runners/portability/flink_runner_test.py ......s...s...ss... [  9%]
.........s....s...s..s............s..ss.....ss.s..F.....s...s...ss...sss [ 43%]
......s....s...s..s............s..ss.....ssss........s...s...ss......... [ 78%]
...s....s...s..s............s..ss.....ss.s..                             [100%]

=================================== FAILURES ===================================
__________________ FlinkRunnerTestOptimized.test_assert_that ___________________
RuntimeError: Pipeline timed out waiting for job service subprocess.

During handling of the above exception, another exception occurred:

self = <apache_beam.runners.portability.flink_runner_test.FlinkRunnerTestOptimized testMethod=test_assert_that>

    def test_assert_that(self):
      # TODO: figure out a way for fn_api_runner to parse and raise the
      # underlying exception.
      with self.assertRaisesRegex(Exception, 'Failed assert'):
        with self.create_pipeline() as p:
>         assert_that(p | beam.Create(['a', 'b']), equal_to(['a']))
E         AssertionError: "Failed assert" does not match "Pipeline timed out waiting for job service subprocess."

apache_beam/runners/portability/fn_api_runner/fn_runner_test.py:113: AssertionError
----------------------------- Captured stderr call -----------------------------
Sep 13, 2022 4:48:24 PM software.amazon.awssdk.regions.internal.util.EC2MetadataUtils getItems
WARNING: Unable to retrieve the requested metadata.
Sep 13, 2022 4:48:24 PM org.apache.beam.runners.jobsubmission.JobServerDriver createArtifactStagingService
INFO: ArtifactStagingService started on localhost:34909
Sep 13, 2022 4:48:24 PM org.apache.beam.runners.jobsubmission.JobServerDriver createExpansionService
INFO: Java ExpansionService started on localhost:36521
Sep 13, 2022 4:48:24 PM org.apache.beam.runners.jobsubmission.JobServerDriver createJobServer
INFO: JobService started on localhost:34785
Sep 13, 2022 4:48:24 PM org.apache.beam.runners.jobsubmission.JobServerDriver run
INFO: Job server now running, terminate with Ctrl+C
=============================== warnings summary ===============================
target/.tox-flink-runner-test/flink-runner-test/lib/python3.7/site-packages/hdfs/config.py:15
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py37/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/lib/python3.7/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py37/build/srcs/sdks/python/pytest_flink-runner-test.xml> -
=========================== short test summary info ============================
FAILED apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTestOptimized::test_assert_that
======= 1 failed, 160 passed, 46 skipped, 1 warning in 799.99s (0:13:19) =======
ERROR: InvocationError for command <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py37/build/srcs/sdks/python/scripts/pytest_validates_runner.sh> flink-runner-test apache_beam/runners/portability/flink_runner_test.py '--flink_job_server_jar=<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/runners/flink/1.15/job-server/build/libs/beam-runners-flink-1.15-job-server-2.43.0-SNAPSHOT.jar> --environment_type=LOOPBACK' (exited with code 1)
flink-runner-test run-test-post: commands[0] | bash <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py37/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
___________________________________ summary ____________________________________
ERROR:   flink-runner-test: commands failed

> Task :sdks:python:test-suites:portable:py37:flinkCompatibilityMatrixLOOPBACK FAILED

> Task :sdks:python:test-suites:portable:py39:flinkCompatibilityMatrixLOOPBACK
flink-runner-test create: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test>
flink-runner-test installdeps: -rbuild-requirements.txt
flink-runner-test inst: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/target/.tox-flink-runner-test/.tmp/package/1/apache-beam.tar.gz>
flink-runner-test installed: apache-beam @ file://<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/target/.tox-flink-runner-test/.tmp/package/1/apache-beam.tar.gz,attrs==22.1.0,certifi==2022.6.15.1,cffi==1.15.1,charset-normalizer==2.1.1,cloudpickle==2.2.0,crcmod==1.7,cryptography==38.0.1,deprecation==2.1.0,dill==0.3.1.1,distlib==0.3.1,docker==6.0.0,docopt==0.6.2,execnet==1.9.0,fastavro==1.6.1,freezegun==1.2.2,greenlet==1.1.3,grpcio==1.48.1,grpcio-tools==1.37.0,hdfs==2.7.0,httplib2==0.20.4,idna==3.3,iniconfig==1.1.1,joblib==1.1.0,mock==2.0.0,mypy-protobuf==1.18,numpy==1.22.4,objsize==0.5.2,orjson==3.8.0,packaging==21.3,pandas==1.4.4,parameterized==0.8.1,pbr==5.10.0,pluggy==1.0.0,proto-plus==1.22.1,protobuf==3.20.1,psycopg2-binary==2.9.3,py==1.11.0,pyarrow==7.0.0,pycparser==2.21,pydot==1.4.2,PyHamcrest==1.10.1,pymongo==3.12.3,PyMySQL==1.0.2,pyparsing==3.0.9,pytest==7.1.3,pytest-forked==1.4.0,pytest-timeout==2.1.0,pytest-xdist==2.5.0,python-dateutil==2.8.2,pytz==2022.2.1,PyYAML==6.0,regex==2022.9.13,requests==2.28.1,requests-mock==1.10.0,scikit-learn==1.1.2,scipy==1.9.1,six==1.16.0,SQLAlchemy==1.4.41,tenacity==5.1.5,testcontainers==3.6.1,threadpoolctl==3.1.0,tomli==2.0.1,typing_extensions==4.3.0,urllib3==1.26.12,websocket-client==1.4.1,wrapt==1.14.1,zstandard==0.18.0>
flink-runner-test run-test-pre: PYTHONHASHSEED='257593192'
flink-runner-test run-test-pre: commands[0] | python --version
Python 3.9.10
flink-runner-test run-test-pre: commands[1] | pip --version
pip 22.2.2 from <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/lib/python3.9/site-packages/pip> (python 3.9)
flink-runner-test run-test-pre: commands[2] | pip check
No broken requirements found.
flink-runner-test run-test-pre: commands[3] | bash <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
flink-runner-test run-test: commands[0] | <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/scripts/pytest_validates_runner.sh> flink-runner-test <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/apache_beam/runners/portability/flink_runner_test.py> '--flink_job_server_jar=<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/runners/flink/1.15/job-server/build/libs/beam-runners-flink-1.15-job-server-2.43.0-SNAPSHOT.jar> --environment_type=LOOPBACK'
============================= test session starts ==============================
platform linux -- Python 3.9.10, pytest-7.1.3, pluggy-1.0.0
cachedir: target/.tox-flink-runner-test/flink-runner-test/.pytest_cache
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python,> configfile: pytest.ini
plugins: xdist-2.5.0, timeout-2.1.0, forked-1.4.0, requests-mock-1.10.0
timeout: 600.0s
timeout method: signal
timeout func_only: False
collected 207 items

apache_beam/runners/portability/flink_runner_test.py ......s...s...ss... [  9%]
.........s....s...s..s............s..ss.....ss.s........s...s...ss...sss [ 43%]
......s....s...s..s............s..ss.....ssss........s...s...ss......... [ 78%]
...s....s...s..s............s..ss.....ss.s..                             [100%]

=============================== warnings summary ===============================
target/.tox-flink-runner-test/flink-runner-test/lib/python3.9/site-packages/hdfs/config.py:15
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/lib/python3.9/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

target/.tox-flink-runner-test/flink-runner-test/lib/python3.9/site-packages/tenacity/_asyncio.py:42
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/lib/python3.9/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
    def call(self, fn, *args, **kwargs):

apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTestOptimized::test_metrics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/lib/python3.9/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.9/threading.py", line 973, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.9/threading.py", line 910, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/lib/python3.9/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/lib/python3.9/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:37737 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-09-13T17:04:10.721195378+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTestOptimized::test_pardo_unfusable_side_inputs_with_separation
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/lib/python3.9/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.9/threading.py", line 973, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.9/threading.py", line 910, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/lib/python3.9/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/lib/python3.9/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:37719 {created_time:"2022-09-13T17:05:32.35697961+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/pytest_flink-runner-test.xml> -
=========== 161 passed, 46 skipped, 4 warnings in 791.26s (0:13:11) ============
E0913 17:10:25.477340667 2644370 backup_poller.cc:124]       run_poller: UNKNOWN:Timer list shutdown {created_time:"2022-09-13T17:10:25.477293228+00:00"}
flink-runner-test run-test-post: commands[0] | bash <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
___________________________________ summary ____________________________________
  flink-runner-test: commands succeeded
  congratulations :)

> Task :sdks:python:test-suites:portable:py39:flinkValidatesRunner

FAILURE: Build failed with an exception.

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkCompatibilityMatrixLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.

BUILD FAILED in 44m 55s
151 actionable tasks: 102 executed, 45 from cache, 4 up-to-date

Publishing build scan...
https://gradle.com/s/anv2hvzir2r4e

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Jenkins build is back to normal : beam_PostCommit_Python_VR_Flink #2849

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/2849/display/redirect>


---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_VR_Flink #2848

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/2848/display/redirect?page=changes>

Changes:

[noreply] Optimize varint reading and writing for small ints. (#23192)


------------------------------------------
[...truncated 79.01 KB...]
github.com/golang/protobuf,https://github.com/golang/protobuf/blob/v1.5.2/LICENSE,BSD-3-Clause
golang.org/x/net,https://cs.opensource.google/go/x/net/+/1bab6f36:LICENSE,BSD-3-Clause
golang.org/x/sys,https://cs.opensource.google/go/x/sys/+/87e55d71:LICENSE,BSD-3-Clause
golang.org/x/text,https://cs.opensource.google/go/x/text/+/v0.3.7:LICENSE,BSD-3-Clause
google.golang.org/genproto/googleapis/rpc/status,https://github.com/googleapis/go-genproto/blob/042d03aeabc9/LICENSE,Apache-2.0
google.golang.org/grpc,https://github.com/grpc/grpc-go/blob/v1.48.0/LICENSE,Apache-2.0
google.golang.org/protobuf,https://github.com/protocolbuffers/protobuf-go/blob/v1.28.0/LICENSE,BSD-3-Clause
+ chmod -R a+w /output/licenses

> Task :sdks:java:container:java8:copyJavaThirdPartyLicenses

> Task :sdks:java:container:goBuild
/home/jenkins/go/bin/go1.18.1 build -o ./build/target/linux_amd64/boot boot.go boot_test.go

> Task :runners:flink:1.15:job-server:shadowJar FROM-CACHE

> Task :sdks:java:container:java8:copySdkHarnessLauncher
Execution optimizations have been disabled for task ':sdks:java:container:java8:copySdkHarnessLauncher' to ensure correctness due to the following reasons:
  - Gradle detected a problem with the following location: '<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/java/container/build/target'.> Reason: Task ':sdks:java:container:java8:copySdkHarnessLauncher' uses this output of task ':sdks:java:container:downloadCloudProfilerAgent' without declaring an explicit or implicit dependency. This can lead to incorrect results being produced, depending on what order the tasks are executed. Please refer to https://docs.gradle.org/7.5.1/userguide/validation_problems.html#implicit_dependency for more details about this problem.
  - Gradle detected a problem with the following location: '<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/java/container/build/target'.> Reason: Task ':sdks:java:container:java8:copySdkHarnessLauncher' uses this output of task ':sdks:java:container:pullLicenses' without declaring an explicit or implicit dependency. This can lead to incorrect results being produced, depending on what order the tasks are executed. Please refer to https://docs.gradle.org/7.5.1/userguide/validation_problems.html#implicit_dependency for more details about this problem.

> Task :release:go-licenses:java:createLicenses
> Task :sdks:java:container:java8:copyGolangLicenses
> Task :sdks:java:container:java8:dockerPrepare
> Task :sdks:java:container:java8:docker

> Task :sdks:python:test-suites:portable:py37:flinkCompatibilityMatrixLOOPBACK
flink-runner-test create: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py37/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test>
flink-runner-test installdeps: -rbuild-requirements.txt
flink-runner-test inst: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py37/build/srcs/sdks/python/target/.tox-flink-runner-test/.tmp/package/1/apache-beam.tar.gz>
flink-runner-test installed: apache-beam @ file://<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py37/build/srcs/sdks/python/target/.tox-flink-runner-test/.tmp/package/1/apache-beam.tar.gz,attrs==22.1.0,certifi==2022.9.14,cffi==1.15.1,charset-normalizer==2.1.1,cloudpickle==2.2.0,crcmod==1.7,cryptography==38.0.1,deprecation==2.1.0,dill==0.3.1.1,distlib==0.3.1,docker==6.0.0,docopt==0.6.2,exceptiongroup==1.0.0rc9,execnet==1.9.0,fastavro==1.6.1,freezegun==1.2.2,greenlet==1.1.3,grpcio==1.48.1,grpcio-tools==1.37.0,hdfs==2.7.0,httplib2==0.20.4,hypothesis==6.54.5,idna==3.4,importlib-metadata==4.12.0,iniconfig==1.1.1,joblib==1.1.0,mock==2.0.0,mypy-protobuf==1.18,numpy==1.21.6,objsize==0.5.2,orjson==3.8.0,packaging==21.3,pandas==1.3.5,parameterized==0.8.1,pbr==5.10.0,pluggy==1.0.0,proto-plus==1.22.1,protobuf==3.20.1,psycopg2-binary==2.9.3,py==1.11.0,pyarrow==9.0.0,pycparser==2.21,pydot==1.4.2,PyHamcrest==1.10.1,pymongo==3.12.3,PyMySQL==1.0.2,pyparsing==3.0.9,pytest==7.1.3,pytest-forked==1.4.0,pytest-timeout==2.1.0,pytest-xdist==2.5.0,python-dateutil==2.8.2,pytz==2022.2.1,PyYAML==6.0,regex==2022.9.13,requests==2.28.1,requests-mock==1.10.0,scikit-learn==1.0.2,scipy==1.7.3,six==1.16.0,sortedcontainers==2.4.0,SQLAlchemy==1.4.41,tenacity==5.1.5,testcontainers==3.6.1,threadpoolctl==3.1.0,tomli==2.0.1,typing_extensions==4.3.0,urllib3==1.26.12,websocket-client==1.4.1,wrapt==1.14.1,zipp==3.8.1,zstandard==0.18.0>
flink-runner-test run-test-pre: PYTHONHASHSEED='301925316'
flink-runner-test run-test-pre: commands[0] | python --version
Python 3.7.12
flink-runner-test run-test-pre: commands[1] | pip --version
pip 22.2.2 from <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py37/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/lib/python3.7/site-packages/pip> (python 3.7)
flink-runner-test run-test-pre: commands[2] | pip check
No broken requirements found.
flink-runner-test run-test-pre: commands[3] | bash <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py37/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
flink-runner-test run-test: commands[0] | <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py37/build/srcs/sdks/python/scripts/pytest_validates_runner.sh> flink-runner-test <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py37/build/srcs/sdks/python/apache_beam/runners/portability/flink_runner_test.py> '--flink_job_server_jar=<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/runners/flink/1.15/job-server/build/libs/beam-runners-flink-1.15-job-server-2.43.0-SNAPSHOT.jar> --environment_type=LOOPBACK'
============================= test session starts ==============================
platform linux -- Python 3.7.12, pytest-7.1.3, pluggy-1.0.0
cachedir: target/.tox-flink-runner-test/flink-runner-test/.pytest_cache
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py37/build/srcs/sdks/python,> configfile: pytest.ini
plugins: xdist-2.5.0, timeout-2.1.0, hypothesis-6.54.5, forked-1.4.0, requests-mock-1.10.0
timeout: 600.0s
timeout method: signal
timeout func_only: False
collected 207 items

apache_beam/runners/portability/flink_runner_test.py ......s...s...ss... [  9%]
.........s....s...s..s............s..ss.....ss.s........s...s...ss...sss [ 43%]
......s....s...s..s............s..ss.....ssss........s...s...ss......... [ 78%]
...s....s...s..s............s..ss.....ss.s..                             [100%]

=============================== warnings summary ===============================
target/.tox-flink-runner-test/flink-runner-test/lib/python3.7/site-packages/hdfs/config.py:15
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py37/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/lib/python3.7/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py37/build/srcs/sdks/python/pytest_flink-runner-test.xml> -
============ 161 passed, 46 skipped, 1 warning in 825.33s (0:13:45) ============
flink-runner-test run-test-post: commands[0] | bash <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py37/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
___________________________________ summary ____________________________________
  flink-runner-test: commands succeeded
  congratulations :)

> Task :sdks:python:test-suites:portable:py37:flinkValidatesRunner

> Task :sdks:python:test-suites:portable:py38:flinkCompatibilityMatrixLOOPBACK
flink-runner-test create: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test>
flink-runner-test installdeps: -rbuild-requirements.txt
flink-runner-test inst: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/target/.tox-flink-runner-test/.tmp/package/1/apache-beam.tar.gz>
flink-runner-test installed: apache-beam @ file://<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/target/.tox-flink-runner-test/.tmp/package/1/apache-beam.tar.gz,attrs==22.1.0,certifi==2022.9.14,cffi==1.15.1,charset-normalizer==2.1.1,cloudpickle==2.2.0,crcmod==1.7,cryptography==38.0.1,deprecation==2.1.0,dill==0.3.1.1,distlib==0.3.1,docker==6.0.0,docopt==0.6.2,exceptiongroup==1.0.0rc9,execnet==1.9.0,fastavro==1.6.1,freezegun==1.2.2,greenlet==1.1.3,grpcio==1.48.1,grpcio-tools==1.37.0,hdfs==2.7.0,httplib2==0.20.4,hypothesis==6.54.5,idna==3.4,iniconfig==1.1.1,joblib==1.1.0,mock==2.0.0,mypy-protobuf==1.18,numpy==1.22.4,objsize==0.5.2,orjson==3.8.0,packaging==21.3,pandas==1.4.4,parameterized==0.8.1,pbr==5.10.0,pluggy==1.0.0,proto-plus==1.22.1,protobuf==3.20.1,psycopg2-binary==2.9.3,py==1.11.0,pyarrow==9.0.0,pycparser==2.21,pydot==1.4.2,PyHamcrest==1.10.1,pymongo==3.12.3,PyMySQL==1.0.2,pyparsing==3.0.9,pytest==7.1.3,pytest-forked==1.4.0,pytest-timeout==2.1.0,pytest-xdist==2.5.0,python-dateutil==2.8.2,pytz==2022.2.1,PyYAML==6.0,regex==2022.9.13,requests==2.28.1,requests-mock==1.10.0,scikit-learn==1.1.2,scipy==1.9.1,six==1.16.0,sortedcontainers==2.4.0,SQLAlchemy==1.4.41,tenacity==5.1.5,testcontainers==3.6.1,threadpoolctl==3.1.0,tomli==2.0.1,typing_extensions==4.3.0,urllib3==1.26.12,websocket-client==1.4.1,wrapt==1.14.1,zstandard==0.18.0>
flink-runner-test run-test-pre: PYTHONHASHSEED='2294215395'
flink-runner-test run-test-pre: commands[0] | python --version
Python 3.8.10
flink-runner-test run-test-pre: commands[1] | pip --version
pip 22.2.2 from <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/lib/python3.8/site-packages/pip> (python 3.8)
flink-runner-test run-test-pre: commands[2] | pip check
No broken requirements found.
flink-runner-test run-test-pre: commands[3] | bash <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
flink-runner-test run-test: commands[0] | <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/scripts/pytest_validates_runner.sh> flink-runner-test <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/apache_beam/runners/portability/flink_runner_test.py> '--flink_job_server_jar=<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/runners/flink/1.15/job-server/build/libs/beam-runners-flink-1.15-job-server-2.43.0-SNAPSHOT.jar> --environment_type=LOOPBACK'
============================= test session starts ==============================
platform linux -- Python 3.8.10, pytest-7.1.3, pluggy-1.0.0
cachedir: target/.tox-flink-runner-test/flink-runner-test/.pytest_cache
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python,> configfile: pytest.ini
plugins: xdist-2.5.0, timeout-2.1.0, hypothesis-6.54.5, forked-1.4.0, requests-mock-1.10.0
timeout: 600.0s
timeout method: signal
timeout func_only: False
collected 207 items

apache_beam/runners/portability/flink_runner_test.py ......s...s...ss... [  9%]
.........s....s...s..s............s..ss.....ss.s..F.....s...s...ss...sss [ 43%]
......s....s...s..s............s..ss.....ssss........s...s...ss......... [ 78%]
...s....s...s..s............s..ss.....ss.s..                             [100%]

=================================== FAILURES ===================================
__________________ FlinkRunnerTestOptimized.test_assert_that ___________________
RuntimeError: Pipeline timed out waiting for job service subprocess.

During handling of the above exception, another exception occurred:

self = <apache_beam.runners.portability.flink_runner_test.FlinkRunnerTestOptimized testMethod=test_assert_that>

    def test_assert_that(self):
      # TODO: figure out a way for fn_api_runner to parse and raise the
      # underlying exception.
      with self.assertRaisesRegex(Exception, 'Failed assert'):
        with self.create_pipeline() as p:
>         assert_that(p | beam.Create(['a', 'b']), equal_to(['a']))
E         AssertionError: "Failed assert" does not match "Pipeline timed out waiting for job service subprocess."

apache_beam/runners/portability/fn_api_runner/fn_runner_test.py:113: AssertionError
----------------------------- Captured stderr call -----------------------------
Sep 15, 2022 4:47:30 AM software.amazon.awssdk.regions.internal.util.EC2MetadataUtils getItems
WARNING: Unable to retrieve the requested metadata.
Sep 15, 2022 4:47:31 AM org.apache.beam.runners.jobsubmission.JobServerDriver createArtifactStagingService
INFO: ArtifactStagingService started on localhost:39517
Sep 15, 2022 4:47:31 AM org.apache.beam.runners.jobsubmission.JobServerDriver createExpansionService
INFO: Java ExpansionService started on localhost:41209
Sep 15, 2022 4:47:31 AM org.apache.beam.runners.jobsubmission.JobServerDriver createJobServer
INFO: JobService started on localhost:52545
Sep 15, 2022 4:47:31 AM org.apache.beam.runners.jobsubmission.JobServerDriver run
INFO: Job server now running, terminate with Ctrl+C
=============================== warnings summary ===============================
target/.tox-flink-runner-test/flink-runner-test/lib/python3.8/site-packages/hdfs/config.py:15
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/lib/python3.8/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

target/.tox-flink-runner-test/flink-runner-test/lib/python3.8/site-packages/tenacity/_asyncio.py:42
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
    def call(self, fn, *args, **kwargs):

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/pytest_flink-runner-test.xml> -
=========================== short test summary info ============================
FAILED apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTestOptimized::test_assert_that
====== 1 failed, 160 passed, 46 skipped, 2 warnings in 793.77s (0:13:13) =======
ERROR: InvocationError for command <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/scripts/pytest_validates_runner.sh> flink-runner-test apache_beam/runners/portability/flink_runner_test.py '--flink_job_server_jar=<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/runners/flink/1.15/job-server/build/libs/beam-runners-flink-1.15-job-server-2.43.0-SNAPSHOT.jar> --environment_type=LOOPBACK' (exited with code 1)
flink-runner-test run-test-post: commands[0] | bash <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
___________________________________ summary ____________________________________
ERROR:   flink-runner-test: commands failed

> Task :sdks:python:test-suites:portable:py38:flinkCompatibilityMatrixLOOPBACK FAILED

> Task :sdks:python:test-suites:portable:py39:flinkCompatibilityMatrixLOOPBACK
flink-runner-test create: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test>
flink-runner-test installdeps: -rbuild-requirements.txt
flink-runner-test inst: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/target/.tox-flink-runner-test/.tmp/package/1/apache-beam.tar.gz>
flink-runner-test installed: apache-beam @ file://<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/target/.tox-flink-runner-test/.tmp/package/1/apache-beam.tar.gz,attrs==22.1.0,certifi==2022.9.14,cffi==1.15.1,charset-normalizer==2.1.1,cloudpickle==2.2.0,crcmod==1.7,cryptography==38.0.1,deprecation==2.1.0,dill==0.3.1.1,distlib==0.3.1,docker==6.0.0,docopt==0.6.2,exceptiongroup==1.0.0rc9,execnet==1.9.0,fastavro==1.6.1,freezegun==1.2.2,greenlet==1.1.3,grpcio==1.48.1,grpcio-tools==1.37.0,hdfs==2.7.0,httplib2==0.20.4,hypothesis==6.54.5,idna==3.4,iniconfig==1.1.1,joblib==1.1.0,mock==2.0.0,mypy-protobuf==1.18,numpy==1.22.4,objsize==0.5.2,orjson==3.8.0,packaging==21.3,pandas==1.4.4,parameterized==0.8.1,pbr==5.10.0,pluggy==1.0.0,proto-plus==1.22.1,protobuf==3.20.1,psycopg2-binary==2.9.3,py==1.11.0,pyarrow==9.0.0,pycparser==2.21,pydot==1.4.2,PyHamcrest==1.10.1,pymongo==3.12.3,PyMySQL==1.0.2,pyparsing==3.0.9,pytest==7.1.3,pytest-forked==1.4.0,pytest-timeout==2.1.0,pytest-xdist==2.5.0,python-dateutil==2.8.2,pytz==2022.2.1,PyYAML==6.0,regex==2022.9.13,requests==2.28.1,requests-mock==1.10.0,scikit-learn==1.1.2,scipy==1.9.1,six==1.16.0,sortedcontainers==2.4.0,SQLAlchemy==1.4.41,tenacity==5.1.5,testcontainers==3.6.1,threadpoolctl==3.1.0,tomli==2.0.1,typing_extensions==4.3.0,urllib3==1.26.12,websocket-client==1.4.1,wrapt==1.14.1,zstandard==0.18.0>
flink-runner-test run-test-pre: PYTHONHASHSEED='3897880751'
flink-runner-test run-test-pre: commands[0] | python --version
Python 3.9.10
flink-runner-test run-test-pre: commands[1] | pip --version
pip 22.2.2 from <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/lib/python3.9/site-packages/pip> (python 3.9)
flink-runner-test run-test-pre: commands[2] | pip check
No broken requirements found.
flink-runner-test run-test-pre: commands[3] | bash <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
flink-runner-test run-test: commands[0] | <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/scripts/pytest_validates_runner.sh> flink-runner-test <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/apache_beam/runners/portability/flink_runner_test.py> '--flink_job_server_jar=<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/runners/flink/1.15/job-server/build/libs/beam-runners-flink-1.15-job-server-2.43.0-SNAPSHOT.jar> --environment_type=LOOPBACK'
============================= test session starts ==============================
platform linux -- Python 3.9.10, pytest-7.1.3, pluggy-1.0.0
cachedir: target/.tox-flink-runner-test/flink-runner-test/.pytest_cache
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python,> configfile: pytest.ini
plugins: xdist-2.5.0, timeout-2.1.0, hypothesis-6.54.5, forked-1.4.0, requests-mock-1.10.0
timeout: 600.0s
timeout method: signal
timeout func_only: False
collected 207 items

apache_beam/runners/portability/flink_runner_test.py ......s...s...ss... [  9%]
.........s....s...s..s............s..ss.....ss.s........s...s...ss...sss [ 43%]
......s....s...s..s............s..ss.....ssss........s...s...ss......... [ 78%]
...s....s...s..s............s..ss.....ss.s..                             [100%]

=============================== warnings summary ===============================
target/.tox-flink-runner-test/flink-runner-test/lib/python3.9/site-packages/hdfs/config.py:15
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/lib/python3.9/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

target/.tox-flink-runner-test/flink-runner-test/lib/python3.9/site-packages/tenacity/_asyncio.py:42
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/lib/python3.9/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
    def call(self, fn, *args, **kwargs):

apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTestOptimized::test_assert_that
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/lib/python3.9/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.9/threading.py", line 973, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.9/threading.py", line 910, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/lib/python3.9/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/lib/python3.9/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.UNAVAILABLE
  	details = "Socket closed"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:38123 {created_time:"2022-09-15T05:01:00.40844703+00:00", grpc_status:14, grpc_message:"Socket closed"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/pytest_flink-runner-test.xml> -
=========== 161 passed, 46 skipped, 3 warnings in 720.14s (0:12:00) ============
flink-runner-test run-test-post: commands[0] | bash <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
___________________________________ summary ____________________________________
  flink-runner-test: commands succeeded
  congratulations :)

> Task :sdks:python:test-suites:portable:py39:flinkValidatesRunner

FAILURE: Build failed with an exception.

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py38:flinkCompatibilityMatrixLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.

BUILD FAILED in 42m 37s
151 actionable tasks: 102 executed, 45 from cache, 4 up-to-date

Publishing build scan...
https://gradle.com/s/66rsohxwkkwe4

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_VR_Flink #2847

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/2847/display/redirect?page=changes>

Changes:

[noreply] Update cibuildwheel (#23024)

[noreply] Add section to docs on resource hints/RunInference (#23215)

[noreply] (BQ Python) Perform job waits in finish_bundle to allow BQ streaming

[noreply] Update to newest version of CloudPickle. (#23223)

[noreply] Resolve script parsing error when changing from bash to sh. (#23199)

[noreply] Bump cloud.google.com/go/bigquery from 1.39.0 to 1.40.0 in /sdks

[noreply] Bump github.com/google/go-cmp from 0.5.8 to 0.5.9 in /sdks (#23123)

[noreply] Update google-cloud-bigquery requirement from <3,>=1.6.0 to >=1.6.0,<4


------------------------------------------
[...truncated 79.34 KB...]
github.com/apache/beam/sdks/v2/go/pkg/beam,https://github.com/apache/beam/blob/sdks/v2.41.0/sdks/go/README.md,Apache-2.0
github.com/apache/beam/sdks/v2/java/container,https://github.com/apache/beam/blob/sdks/v2.41.0/sdks/LICENSE,Apache-2.0
github.com/golang/protobuf,https://github.com/golang/protobuf/blob/v1.5.2/LICENSE,BSD-3-Clause
golang.org/x/net,https://cs.opensource.google/go/x/net/+/1bab6f36:LICENSE,BSD-3-Clause
golang.org/x/sys,https://cs.opensource.google/go/x/sys/+/87e55d71:LICENSE,BSD-3-Clause
golang.org/x/text,https://cs.opensource.google/go/x/text/+/v0.3.7:LICENSE,BSD-3-Clause
google.golang.org/genproto/googleapis/rpc/status,https://github.com/googleapis/go-genproto/blob/042d03aeabc9/LICENSE,Apache-2.0
google.golang.org/grpc,https://github.com/grpc/grpc-go/blob/v1.48.0/LICENSE,Apache-2.0
google.golang.org/protobuf,https://github.com/protocolbuffers/protobuf-go/blob/v1.28.0/LICENSE,BSD-3-Clause
+ chmod -R a+w /output/licenses

> Task :sdks:java:container:java8:copyJavaThirdPartyLicenses
> Task :runners:flink:1.15:job-server:shadowJar FROM-CACHE

> Task :sdks:java:container:goBuild
/home/jenkins/go/bin/go1.18.1 build -o ./build/target/linux_amd64/boot boot.go boot_test.go

> Task :release:go-licenses:java:createLicenses
> Task :sdks:java:container:java8:copyGolangLicenses

> Task :sdks:java:container:java8:copySdkHarnessLauncher
Execution optimizations have been disabled for task ':sdks:java:container:java8:copySdkHarnessLauncher' to ensure correctness due to the following reasons:
  - Gradle detected a problem with the following location: '<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/java/container/build/target'.> Reason: Task ':sdks:java:container:java8:copySdkHarnessLauncher' uses this output of task ':sdks:java:container:downloadCloudProfilerAgent' without declaring an explicit or implicit dependency. This can lead to incorrect results being produced, depending on what order the tasks are executed. Please refer to https://docs.gradle.org/7.5.1/userguide/validation_problems.html#implicit_dependency for more details about this problem.
  - Gradle detected a problem with the following location: '<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/java/container/build/target'.> Reason: Task ':sdks:java:container:java8:copySdkHarnessLauncher' uses this output of task ':sdks:java:container:pullLicenses' without declaring an explicit or implicit dependency. This can lead to incorrect results being produced, depending on what order the tasks are executed. Please refer to https://docs.gradle.org/7.5.1/userguide/validation_problems.html#implicit_dependency for more details about this problem.

> Task :sdks:java:container:java8:dockerPrepare
> Task :sdks:java:container:java8:docker

> Task :sdks:python:test-suites:portable:py37:flinkCompatibilityMatrixLOOPBACK
flink-runner-test create: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py37/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test>
flink-runner-test installdeps: -rbuild-requirements.txt
flink-runner-test inst: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py37/build/srcs/sdks/python/target/.tox-flink-runner-test/.tmp/package/1/apache-beam.tar.gz>
flink-runner-test installed: apache-beam @ file://<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py37/build/srcs/sdks/python/target/.tox-flink-runner-test/.tmp/package/1/apache-beam.tar.gz,attrs==22.1.0,certifi==2022.9.14,cffi==1.15.1,charset-normalizer==2.1.1,cloudpickle==2.2.0,crcmod==1.7,cryptography==38.0.1,deprecation==2.1.0,dill==0.3.1.1,distlib==0.3.1,docker==6.0.0,docopt==0.6.2,exceptiongroup==1.0.0rc9,execnet==1.9.0,fastavro==1.6.1,freezegun==1.2.2,greenlet==1.1.3,grpcio==1.48.1,grpcio-tools==1.37.0,hdfs==2.7.0,httplib2==0.20.4,hypothesis==6.54.5,idna==3.4,importlib-metadata==4.12.0,iniconfig==1.1.1,joblib==1.1.0,mock==2.0.0,mypy-protobuf==1.18,numpy==1.21.6,objsize==0.5.2,orjson==3.8.0,packaging==21.3,pandas==1.3.5,parameterized==0.8.1,pbr==5.10.0,pluggy==1.0.0,proto-plus==1.22.1,protobuf==3.20.1,psycopg2-binary==2.9.3,py==1.11.0,pyarrow==9.0.0,pycparser==2.21,pydot==1.4.2,PyHamcrest==1.10.1,pymongo==3.12.3,PyMySQL==1.0.2,pyparsing==3.0.9,pytest==7.1.3,pytest-forked==1.4.0,pytest-timeout==2.1.0,pytest-xdist==2.5.0,python-dateutil==2.8.2,pytz==2022.2.1,PyYAML==6.0,regex==2022.9.13,requests==2.28.1,requests-mock==1.10.0,scikit-learn==1.0.2,scipy==1.7.3,six==1.16.0,sortedcontainers==2.4.0,SQLAlchemy==1.4.41,tenacity==5.1.5,testcontainers==3.6.1,threadpoolctl==3.1.0,tomli==2.0.1,typing_extensions==4.3.0,urllib3==1.26.12,websocket-client==1.4.1,wrapt==1.14.1,zipp==3.8.1,zstandard==0.18.0>
flink-runner-test run-test-pre: PYTHONHASHSEED='1102481510'
flink-runner-test run-test-pre: commands[0] | python --version
Python 3.7.12
flink-runner-test run-test-pre: commands[1] | pip --version
pip 22.2.2 from <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py37/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/lib/python3.7/site-packages/pip> (python 3.7)
flink-runner-test run-test-pre: commands[2] | pip check
No broken requirements found.
flink-runner-test run-test-pre: commands[3] | bash <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py37/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
flink-runner-test run-test: commands[0] | <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py37/build/srcs/sdks/python/scripts/pytest_validates_runner.sh> flink-runner-test <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py37/build/srcs/sdks/python/apache_beam/runners/portability/flink_runner_test.py> '--flink_job_server_jar=<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/runners/flink/1.15/job-server/build/libs/beam-runners-flink-1.15-job-server-2.43.0-SNAPSHOT.jar> --environment_type=LOOPBACK'
============================= test session starts ==============================
platform linux -- Python 3.7.12, pytest-7.1.3, pluggy-1.0.0
cachedir: target/.tox-flink-runner-test/flink-runner-test/.pytest_cache
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py37/build/srcs/sdks/python,> configfile: pytest.ini
plugins: xdist-2.5.0, timeout-2.1.0, hypothesis-6.54.5, forked-1.4.0, requests-mock-1.10.0
timeout: 600.0s
timeout method: signal
timeout func_only: False
collected 207 items

apache_beam/runners/portability/flink_runner_test.py ......s...s...ss... [  9%]
.........s....s...s..s............s..ss.....ss.s........s...s...ss...sss [ 43%]
......s....s...s..s............s..ss.....ssss........s...s...ss......... [ 78%]
...s....s...s..s............s..ss.....ss.s..                             [100%]

=============================== warnings summary ===============================
target/.tox-flink-runner-test/flink-runner-test/lib/python3.7/site-packages/hdfs/config.py:15
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py37/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/lib/python3.7/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py37/build/srcs/sdks/python/pytest_flink-runner-test.xml> -
============ 161 passed, 46 skipped, 1 warning in 911.20s (0:15:11) ============
flink-runner-test run-test-post: commands[0] | bash <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py37/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
___________________________________ summary ____________________________________
  flink-runner-test: commands succeeded
  congratulations :)

> Task :sdks:python:test-suites:portable:py37:flinkValidatesRunner

> Task :sdks:python:test-suites:portable:py38:flinkCompatibilityMatrixLOOPBACK
flink-runner-test create: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test>
flink-runner-test installdeps: -rbuild-requirements.txt
flink-runner-test inst: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/target/.tox-flink-runner-test/.tmp/package/1/apache-beam.tar.gz>
flink-runner-test installed: apache-beam @ file://<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/target/.tox-flink-runner-test/.tmp/package/1/apache-beam.tar.gz,attrs==22.1.0,certifi==2022.9.14,cffi==1.15.1,charset-normalizer==2.1.1,cloudpickle==2.2.0,crcmod==1.7,cryptography==38.0.1,deprecation==2.1.0,dill==0.3.1.1,distlib==0.3.1,docker==6.0.0,docopt==0.6.2,exceptiongroup==1.0.0rc9,execnet==1.9.0,fastavro==1.6.1,freezegun==1.2.2,greenlet==1.1.3,grpcio==1.48.1,grpcio-tools==1.37.0,hdfs==2.7.0,httplib2==0.20.4,hypothesis==6.54.5,idna==3.4,iniconfig==1.1.1,joblib==1.1.0,mock==2.0.0,mypy-protobuf==1.18,numpy==1.22.4,objsize==0.5.2,orjson==3.8.0,packaging==21.3,pandas==1.4.4,parameterized==0.8.1,pbr==5.10.0,pluggy==1.0.0,proto-plus==1.22.1,protobuf==3.20.1,psycopg2-binary==2.9.3,py==1.11.0,pyarrow==9.0.0,pycparser==2.21,pydot==1.4.2,PyHamcrest==1.10.1,pymongo==3.12.3,PyMySQL==1.0.2,pyparsing==3.0.9,pytest==7.1.3,pytest-forked==1.4.0,pytest-timeout==2.1.0,pytest-xdist==2.5.0,python-dateutil==2.8.2,pytz==2022.2.1,PyYAML==6.0,regex==2022.9.13,requests==2.28.1,requests-mock==1.10.0,scikit-learn==1.1.2,scipy==1.9.1,six==1.16.0,sortedcontainers==2.4.0,SQLAlchemy==1.4.41,tenacity==5.1.5,testcontainers==3.6.1,threadpoolctl==3.1.0,tomli==2.0.1,typing_extensions==4.3.0,urllib3==1.26.12,websocket-client==1.4.1,wrapt==1.14.1,zstandard==0.18.0>
flink-runner-test run-test-pre: PYTHONHASHSEED='3690646095'
flink-runner-test run-test-pre: commands[0] | python --version
Python 3.8.10
flink-runner-test run-test-pre: commands[1] | pip --version
pip 22.2.2 from <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/lib/python3.8/site-packages/pip> (python 3.8)
flink-runner-test run-test-pre: commands[2] | pip check
No broken requirements found.
flink-runner-test run-test-pre: commands[3] | bash <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
flink-runner-test run-test: commands[0] | <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/scripts/pytest_validates_runner.sh> flink-runner-test <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/apache_beam/runners/portability/flink_runner_test.py> '--flink_job_server_jar=<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/runners/flink/1.15/job-server/build/libs/beam-runners-flink-1.15-job-server-2.43.0-SNAPSHOT.jar> --environment_type=LOOPBACK'
============================= test session starts ==============================
platform linux -- Python 3.8.10, pytest-7.1.3, pluggy-1.0.0
cachedir: target/.tox-flink-runner-test/flink-runner-test/.pytest_cache
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python,> configfile: pytest.ini
plugins: xdist-2.5.0, timeout-2.1.0, hypothesis-6.54.5, forked-1.4.0, requests-mock-1.10.0
timeout: 600.0s
timeout method: signal
timeout func_only: False
collected 207 items

apache_beam/runners/portability/flink_runner_test.py ......s...s...ss... [  9%]
.........s....s...s..s............s..ss.....ss.s........s...s...ss...sss [ 43%]
......s....s...s..s............s..ss.....ssss........s...s...ss......... [ 78%]
...s....s...s..s............s..ss.....ss.s..                             [100%]

=============================== warnings summary ===============================
target/.tox-flink-runner-test/flink-runner-test/lib/python3.8/site-packages/hdfs/config.py:15
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/lib/python3.8/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

target/.tox-flink-runner-test/flink-runner-test/lib/python3.8/site-packages/tenacity/_asyncio.py:42
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
    def call(self, fn, *args, **kwargs):

apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTestOptimized::test_windowing
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/lib/python3.8/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_state
  
  Traceback (most recent call last):
    File "/usr/lib/python3.8/threading.py", line 932, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.8/threading.py", line 870, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 1006, in pull_responses
      for response in responses:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/lib/python3.8/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/lib/python3.8/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Received RST_STREAM with error code 8"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:36765 {created_time:"2022-09-14T22:55:43.103714128+00:00", grpc_status:1, grpc_message:"Received RST_STREAM with error code 8"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/pytest_flink-runner-test.xml> -
=========== 161 passed, 46 skipped, 3 warnings in 922.07s (0:15:22) ============
flink-runner-test run-test-post: commands[0] | bash <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
___________________________________ summary ____________________________________
  flink-runner-test: commands succeeded
  congratulations :)

> Task :sdks:python:test-suites:portable:py38:flinkValidatesRunner

> Task :sdks:python:test-suites:portable:py39:flinkCompatibilityMatrixLOOPBACK
flink-runner-test create: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test>
flink-runner-test installdeps: -rbuild-requirements.txt
flink-runner-test inst: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/target/.tox-flink-runner-test/.tmp/package/1/apache-beam.tar.gz>
flink-runner-test installed: apache-beam @ file://<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/target/.tox-flink-runner-test/.tmp/package/1/apache-beam.tar.gz,attrs==22.1.0,certifi==2022.9.14,cffi==1.15.1,charset-normalizer==2.1.1,cloudpickle==2.2.0,crcmod==1.7,cryptography==38.0.1,deprecation==2.1.0,dill==0.3.1.1,distlib==0.3.1,docker==6.0.0,docopt==0.6.2,exceptiongroup==1.0.0rc9,execnet==1.9.0,fastavro==1.6.1,freezegun==1.2.2,greenlet==1.1.3,grpcio==1.48.1,grpcio-tools==1.37.0,hdfs==2.7.0,httplib2==0.20.4,hypothesis==6.54.5,idna==3.4,iniconfig==1.1.1,joblib==1.1.0,mock==2.0.0,mypy-protobuf==1.18,numpy==1.22.4,objsize==0.5.2,orjson==3.8.0,packaging==21.3,pandas==1.4.4,parameterized==0.8.1,pbr==5.10.0,pluggy==1.0.0,proto-plus==1.22.1,protobuf==3.20.1,psycopg2-binary==2.9.3,py==1.11.0,pyarrow==9.0.0,pycparser==2.21,pydot==1.4.2,PyHamcrest==1.10.1,pymongo==3.12.3,PyMySQL==1.0.2,pyparsing==3.0.9,pytest==7.1.3,pytest-forked==1.4.0,pytest-timeout==2.1.0,pytest-xdist==2.5.0,python-dateutil==2.8.2,pytz==2022.2.1,PyYAML==6.0,regex==2022.9.13,requests==2.28.1,requests-mock==1.10.0,scikit-learn==1.1.2,scipy==1.9.1,six==1.16.0,sortedcontainers==2.4.0,SQLAlchemy==1.4.41,tenacity==5.1.5,testcontainers==3.6.1,threadpoolctl==3.1.0,tomli==2.0.1,typing_extensions==4.3.0,urllib3==1.26.12,websocket-client==1.4.1,wrapt==1.14.1,zstandard==0.18.0>
flink-runner-test run-test-pre: PYTHONHASHSEED='60316831'
flink-runner-test run-test-pre: commands[0] | python --version
Python 3.9.10
flink-runner-test run-test-pre: commands[1] | pip --version
pip 22.2.2 from <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/lib/python3.9/site-packages/pip> (python 3.9)
flink-runner-test run-test-pre: commands[2] | pip check
No broken requirements found.
flink-runner-test run-test-pre: commands[3] | bash <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
flink-runner-test run-test: commands[0] | <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/scripts/pytest_validates_runner.sh> flink-runner-test <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/apache_beam/runners/portability/flink_runner_test.py> '--flink_job_server_jar=<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/runners/flink/1.15/job-server/build/libs/beam-runners-flink-1.15-job-server-2.43.0-SNAPSHOT.jar> --environment_type=LOOPBACK'
============================= test session starts ==============================
platform linux -- Python 3.9.10, pytest-7.1.3, pluggy-1.0.0
cachedir: target/.tox-flink-runner-test/flink-runner-test/.pytest_cache
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python,> configfile: pytest.ini
plugins: xdist-2.5.0, timeout-2.1.0, hypothesis-6.54.5, forked-1.4.0, requests-mock-1.10.0
timeout: 600.0s
timeout method: signal
timeout func_only: False
collected 207 items

apache_beam/runners/portability/flink_runner_test.py ......s...s...ss... [  9%]
.........s....s...s..s............s..ss.....ss.s..F.....s...s...ss...sss [ 43%]
......s....s...s..s............s..ss.....ssss........s...s...ss......... [ 78%]
...s....s...s..s............s..ss.....ss.s..                             [100%]

=================================== FAILURES ===================================
__________________ FlinkRunnerTestOptimized.test_assert_that ___________________
RuntimeError: Pipeline timed out waiting for job service subprocess.

During handling of the above exception, another exception occurred:

self = <apache_beam.runners.portability.flink_runner_test.FlinkRunnerTestOptimized testMethod=test_assert_that>

    def test_assert_that(self):
      # TODO: figure out a way for fn_api_runner to parse and raise the
      # underlying exception.
      with self.assertRaisesRegex(Exception, 'Failed assert'):
        with self.create_pipeline() as p:
>         assert_that(p | beam.Create(['a', 'b']), equal_to(['a']))
E         AssertionError: "Failed assert" does not match "Pipeline timed out waiting for job service subprocess."

apache_beam/runners/portability/fn_api_runner/fn_runner_test.py:113: AssertionError
----------------------------- Captured stderr call -----------------------------
Sep 14, 2022 11:06:44 PM software.amazon.awssdk.regions.internal.util.EC2MetadataUtils getItems
WARNING: Unable to retrieve the requested metadata.
Sep 14, 2022 11:06:45 PM org.apache.beam.runners.jobsubmission.JobServerDriver createArtifactStagingService
INFO: ArtifactStagingService started on localhost:36543
Sep 14, 2022 11:06:45 PM org.apache.beam.runners.jobsubmission.JobServerDriver createExpansionService
INFO: Java ExpansionService started on localhost:46171
Sep 14, 2022 11:06:45 PM org.apache.beam.runners.jobsubmission.JobServerDriver createJobServer
INFO: JobService started on localhost:36385
Sep 14, 2022 11:06:45 PM org.apache.beam.runners.jobsubmission.JobServerDriver run
INFO: Job server now running, terminate with Ctrl+C
=============================== warnings summary ===============================
target/.tox-flink-runner-test/flink-runner-test/lib/python3.9/site-packages/hdfs/config.py:15
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/lib/python3.9/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

target/.tox-flink-runner-test/flink-runner-test/lib/python3.9/site-packages/tenacity/_asyncio.py:42
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/lib/python3.9/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
    def call(self, fn, *args, **kwargs):

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/pytest_flink-runner-test.xml> -
=========================== short test summary info ============================
FAILED apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTestOptimized::test_assert_that
====== 1 failed, 160 passed, 46 skipped, 2 warnings in 931.19s (0:15:31) =======
ERROR: InvocationError for command <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/scripts/pytest_validates_runner.sh> flink-runner-test apache_beam/runners/portability/flink_runner_test.py '--flink_job_server_jar=<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/runners/flink/1.15/job-server/build/libs/beam-runners-flink-1.15-job-server-2.43.0-SNAPSHOT.jar> --environment_type=LOOPBACK' (exited with code 1)
flink-runner-test run-test-post: commands[0] | bash <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
___________________________________ summary ____________________________________
ERROR:   flink-runner-test: commands failed

> Task :sdks:python:test-suites:portable:py39:flinkCompatibilityMatrixLOOPBACK FAILED

FAILURE: Build failed with an exception.

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py39:flinkCompatibilityMatrixLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.

BUILD FAILED in 50m 57s
151 actionable tasks: 102 executed, 45 from cache, 4 up-to-date

Publishing build scan...
https://gradle.com/s/ritt4qedg5n62

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_VR_Flink #2846

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/2846/display/redirect?page=changes>

Changes:

[noreply] Fix assignees check

[noreply] Exclude protobuf 3.20.2 (#23226)

[noreply] Fix IllegalStateException in StorageApiWriteUnshardedRecords error


------------------------------------------
[...truncated 87.47 KB...]
collected 207 items

apache_beam/runners/portability/flink_runner_test.py ......s...s...ss... [  9%]
.........s....s...s..s............s..ss.....ss.s..F.....s...s...ss...sss [ 43%]
......s....s...s..s............s..ss.....ssss........s...s...ss......... [ 78%]
...s....s...s..s............s..ss.....ss.s..                             [100%]

=================================== FAILURES ===================================
__________________ FlinkRunnerTestOptimized.test_assert_that ___________________
RuntimeError: Pipeline timed out waiting for job service subprocess.

During handling of the above exception, another exception occurred:

self = <apache_beam.runners.portability.flink_runner_test.FlinkRunnerTestOptimized testMethod=test_assert_that>

    def test_assert_that(self):
      # TODO: figure out a way for fn_api_runner to parse and raise the
      # underlying exception.
      with self.assertRaisesRegex(Exception, 'Failed assert'):
        with self.create_pipeline() as p:
>         assert_that(p | beam.Create(['a', 'b']), equal_to(['a']))
E         AssertionError: "Failed assert" does not match "Pipeline timed out waiting for job service subprocess."

apache_beam/runners/portability/fn_api_runner/fn_runner_test.py:113: AssertionError
----------------------------- Captured stderr call -----------------------------
Sep 14, 2022 4:32:46 PM software.amazon.awssdk.regions.internal.util.EC2MetadataUtils getItems
WARNING: Unable to retrieve the requested metadata.
Sep 14, 2022 4:32:46 PM org.apache.beam.runners.jobsubmission.JobServerDriver createArtifactStagingService
INFO: ArtifactStagingService started on localhost:35063
Sep 14, 2022 4:32:46 PM org.apache.beam.runners.jobsubmission.JobServerDriver createExpansionService
INFO: Java ExpansionService started on localhost:60399
Sep 14, 2022 4:32:46 PM org.apache.beam.runners.jobsubmission.JobServerDriver createJobServer
INFO: JobService started on localhost:44127
Sep 14, 2022 4:32:46 PM org.apache.beam.runners.jobsubmission.JobServerDriver run
INFO: Job server now running, terminate with Ctrl+C
=============================== warnings summary ===============================
target/.tox-flink-runner-test/flink-runner-test/lib/python3.7/site-packages/hdfs/config.py:15
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py37/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/lib/python3.7/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py37/build/srcs/sdks/python/pytest_flink-runner-test.xml> -
=========================== short test summary info ============================
FAILED apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTestOptimized::test_assert_that
====== 1 failed, 160 passed, 46 skipped, 1 warning in 1383.53s (0:23:03) =======
ERROR: InvocationError for command <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py37/build/srcs/sdks/python/scripts/pytest_validates_runner.sh> flink-runner-test apache_beam/runners/portability/flink_runner_test.py '--flink_job_server_jar=<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/runners/flink/1.15/job-server/build/libs/beam-runners-flink-1.15-job-server-2.43.0-SNAPSHOT.jar> --environment_type=LOOPBACK' (exited with code 1)
flink-runner-test run-test-post: commands[0] | bash <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py37/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
___________________________________ summary ____________________________________
ERROR:   flink-runner-test: commands failed

> Task :sdks:python:test-suites:portable:py37:flinkCompatibilityMatrixLOOPBACK FAILED

> Task :sdks:python:test-suites:portable:py38:flinkCompatibilityMatrixLOOPBACK
flink-runner-test create: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test>
flink-runner-test installdeps: -rbuild-requirements.txt
flink-runner-test inst: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/target/.tox-flink-runner-test/.tmp/package/1/apache-beam.tar.gz>
flink-runner-test installed: apache-beam @ file://<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/target/.tox-flink-runner-test/.tmp/package/1/apache-beam.tar.gz,attrs==22.1.0,certifi==2022.6.15.2,cffi==1.15.1,charset-normalizer==2.1.1,cloudpickle==2.1.0,crcmod==1.7,cryptography==38.0.1,deprecation==2.1.0,dill==0.3.1.1,distlib==0.3.1,docker==6.0.0,docopt==0.6.2,exceptiongroup==1.0.0rc9,execnet==1.9.0,fastavro==1.6.1,freezegun==1.2.2,greenlet==1.1.3,grpcio==1.48.1,grpcio-tools==1.37.0,hdfs==2.7.0,httplib2==0.20.4,hypothesis==6.54.5,idna==3.4,iniconfig==1.1.1,joblib==1.1.0,mock==2.0.0,mypy-protobuf==1.18,numpy==1.22.4,objsize==0.5.2,orjson==3.8.0,packaging==21.3,pandas==1.4.4,parameterized==0.8.1,pbr==5.10.0,pluggy==1.0.0,proto-plus==1.22.1,protobuf==3.20.1,psycopg2-binary==2.9.3,py==1.11.0,pyarrow==9.0.0,pycparser==2.21,pydot==1.4.2,PyHamcrest==1.10.1,pymongo==3.12.3,PyMySQL==1.0.2,pyparsing==3.0.9,pytest==7.1.3,pytest-forked==1.4.0,pytest-timeout==2.1.0,pytest-xdist==2.5.0,python-dateutil==2.8.2,pytz==2022.2.1,PyYAML==6.0,regex==2022.9.13,requests==2.28.1,requests-mock==1.10.0,scikit-learn==1.1.2,scipy==1.9.1,six==1.16.0,sortedcontainers==2.4.0,SQLAlchemy==1.4.41,tenacity==5.1.5,testcontainers==3.6.1,threadpoolctl==3.1.0,tomli==2.0.1,typing_extensions==4.3.0,urllib3==1.26.12,websocket-client==1.4.1,wrapt==1.14.1,zstandard==0.18.0>
flink-runner-test run-test-pre: PYTHONHASHSEED='4176097818'
flink-runner-test run-test-pre: commands[0] | python --version
Python 3.8.10
flink-runner-test run-test-pre: commands[1] | pip --version
pip 22.2.2 from <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/lib/python3.8/site-packages/pip> (python 3.8)
flink-runner-test run-test-pre: commands[2] | pip check
No broken requirements found.
flink-runner-test run-test-pre: commands[3] | bash <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
flink-runner-test run-test: commands[0] | <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/scripts/pytest_validates_runner.sh> flink-runner-test <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/apache_beam/runners/portability/flink_runner_test.py> '--flink_job_server_jar=<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/runners/flink/1.15/job-server/build/libs/beam-runners-flink-1.15-job-server-2.43.0-SNAPSHOT.jar> --environment_type=LOOPBACK'
============================= test session starts ==============================
platform linux -- Python 3.8.10, pytest-7.1.3, pluggy-1.0.0
cachedir: target/.tox-flink-runner-test/flink-runner-test/.pytest_cache
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python,> configfile: pytest.ini
plugins: xdist-2.5.0, timeout-2.1.0, hypothesis-6.54.5, forked-1.4.0, requests-mock-1.10.0
timeout: 600.0s
timeout method: signal
timeout func_only: False
collected 207 items

apache_beam/runners/portability/flink_runner_test.py ......s...s...ss... [  9%]
.........s....s...s..s............s..ss.....ss.s........s...s...ss...sss [ 43%]
......s....s...s..s............s..ss.....ssss........s...s...ss......... [ 78%]
...s....s...s..s............s..ss.....ss.s..                             [100%]

=============================== warnings summary ===============================
target/.tox-flink-runner-test/flink-runner-test/lib/python3.8/site-packages/hdfs/config.py:15
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/lib/python3.8/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

target/.tox-flink-runner-test/flink-runner-test/lib/python3.8/site-packages/tenacity/_asyncio.py:42
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
    def call(self, fn, *args, **kwargs):

apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTest::test_batch_pardo_override_type_inference
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/lib/python3.8/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.8/threading.py", line 932, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.8/threading.py", line 870, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/lib/python3.8/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/lib/python3.8/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:40197 {created_time:"2022-09-14T16:53:54.9021904+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTest::test_multimap_multiside_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/lib/python3.8/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.8/threading.py", line 932, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.8/threading.py", line 870, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/lib/python3.8/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/lib/python3.8/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:44391 {created_time:"2022-09-14T16:57:53.787570454+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/runners/portability/flink_runner_test.py::FlinkRunnerTest::test_sdf_synthetic_source
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/lib/python3.8/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.8/threading.py", line 932, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.8/threading.py", line 870, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/lib/python3.8/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/lib/python3.8/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:37827 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-09-14T17:01:47.385475374+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/pytest_flink-runner-test.xml> -
=========== 161 passed, 46 skipped, 5 warnings in 1432.41s (0:23:52) ===========
flink-runner-test run-test-post: commands[0] | bash <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
___________________________________ summary ____________________________________
  flink-runner-test: commands succeeded
  congratulations :)

> Task :sdks:python:test-suites:portable:py38:flinkValidatesRunner

> Task :sdks:python:test-suites:portable:py39:flinkCompatibilityMatrixLOOPBACK
flink-runner-test create: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test>
flink-runner-test installdeps: -rbuild-requirements.txt
flink-runner-test inst: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/target/.tox-flink-runner-test/.tmp/package/1/apache-beam.tar.gz>
flink-runner-test installed: apache-beam @ file://<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/target/.tox-flink-runner-test/.tmp/package/1/apache-beam.tar.gz,attrs==22.1.0,certifi==2022.6.15.2,cffi==1.15.1,charset-normalizer==2.1.1,cloudpickle==2.1.0,crcmod==1.7,cryptography==38.0.1,deprecation==2.1.0,dill==0.3.1.1,distlib==0.3.1,docker==6.0.0,docopt==0.6.2,exceptiongroup==1.0.0rc9,execnet==1.9.0,fastavro==1.6.1,freezegun==1.2.2,greenlet==1.1.3,grpcio==1.48.1,grpcio-tools==1.37.0,hdfs==2.7.0,httplib2==0.20.4,hypothesis==6.54.5,idna==3.4,iniconfig==1.1.1,joblib==1.1.0,mock==2.0.0,mypy-protobuf==1.18,numpy==1.22.4,objsize==0.5.2,orjson==3.8.0,packaging==21.3,pandas==1.4.4,parameterized==0.8.1,pbr==5.10.0,pluggy==1.0.0,proto-plus==1.22.1,protobuf==3.20.1,psycopg2-binary==2.9.3,py==1.11.0,pyarrow==9.0.0,pycparser==2.21,pydot==1.4.2,PyHamcrest==1.10.1,pymongo==3.12.3,PyMySQL==1.0.2,pyparsing==3.0.9,pytest==7.1.3,pytest-forked==1.4.0,pytest-timeout==2.1.0,pytest-xdist==2.5.0,python-dateutil==2.8.2,pytz==2022.2.1,PyYAML==6.0,regex==2022.9.13,requests==2.28.1,requests-mock==1.10.0,scikit-learn==1.1.2,scipy==1.9.1,six==1.16.0,sortedcontainers==2.4.0,SQLAlchemy==1.4.41,tenacity==5.1.5,testcontainers==3.6.1,threadpoolctl==3.1.0,tomli==2.0.1,typing_extensions==4.3.0,urllib3==1.26.12,websocket-client==1.4.1,wrapt==1.14.1,zstandard==0.18.0>
flink-runner-test run-test-pre: PYTHONHASHSEED='1511496749'
flink-runner-test run-test-pre: commands[0] | python --version
Python 3.9.10
flink-runner-test run-test-pre: commands[1] | pip --version
pip 22.2.2 from <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/lib/python3.9/site-packages/pip> (python 3.9)
flink-runner-test run-test-pre: commands[2] | pip check
No broken requirements found.
flink-runner-test run-test-pre: commands[3] | bash <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
flink-runner-test run-test: commands[0] | <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/scripts/pytest_validates_runner.sh> flink-runner-test <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/apache_beam/runners/portability/flink_runner_test.py> '--flink_job_server_jar=<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/runners/flink/1.15/job-server/build/libs/beam-runners-flink-1.15-job-server-2.43.0-SNAPSHOT.jar> --environment_type=LOOPBACK'
============================= test session starts ==============================
platform linux -- Python 3.9.10, pytest-7.1.3, pluggy-1.0.0
cachedir: target/.tox-flink-runner-test/flink-runner-test/.pytest_cache
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python,> configfile: pytest.ini
plugins: xdist-2.5.0, timeout-2.1.0, hypothesis-6.54.5, forked-1.4.0, requests-mock-1.10.0
timeout: 600.0s
timeout method: signal
timeout func_only: False
collected 207 items

apache_beam/runners/portability/flink_runner_test.py ......s...s...ss... [  9%]
.........s....s...s..s............s..ss.....ss.s........s...s...ss...sss [ 43%]
......s....s...s..s............s..ss.....ssss........s...s...ss......... [ 78%]
...s....s...s..s............s..ss.....ss.s..                             [100%]

=============================== warnings summary ===============================
target/.tox-flink-runner-test/flink-runner-test/lib/python3.9/site-packages/hdfs/config.py:15
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/lib/python3.9/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

target/.tox-flink-runner-test/flink-runner-test/lib/python3.9/site-packages/tenacity/_asyncio.py:42
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/lib/python3.9/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
    def call(self, fn, *args, **kwargs):

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/pytest_flink-runner-test.xml> -
=========== 161 passed, 46 skipped, 2 warnings in 935.25s (0:15:35) ============
flink-runner-test run-test-post: commands[0] | bash <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
___________________________________ summary ____________________________________
  flink-runner-test: commands succeeded
  congratulations :)

> Task :sdks:python:test-suites:portable:py39:flinkValidatesRunner

FAILURE: Build failed with an exception.

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkCompatibilityMatrixLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.

BUILD FAILED in 1h 7m 34s
151 actionable tasks: 102 executed, 45 from cache, 4 up-to-date

Publishing build scan...
https://gradle.com/s/gj57iusfld3ag

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_VR_Flink #2845

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/2845/display/redirect?page=changes>

Changes:

[noreply] Publish results of JMH benchmark runs (Java SDK) to InfluxDB (part of


------------------------------------------
[...truncated 66.29 KB...]
Collecting six>=1.9.0
  Using cached six-1.16.0-py2.py3-none-any.whl (11 kB)
Installing collected packages: soupsieve, six, pyyaml, tenacity, beautifulsoup4
Successfully installed beautifulsoup4-4.11.1 pyyaml-5.4.1 six-1.16.0 soupsieve-2.3.2.post1 tenacity-5.1.5
Executing python <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/java/container/license_scripts/pull_licenses_java.py> --license_index=<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/java/container/build/reports/dependency-license/index.json>        --output_dir=<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/java/container/build/target/java_third_party_licenses>        --dep_url_yaml=<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/java/container/license_scripts/dep_urls_java.yaml>        --manual_license_path=<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/java/container/license_scripts/manual_licenses>
INFO:root:Pulling license for 256 dependencies using 16 threads.

> Task :sdks:python:sdist
org/apache/beam/model/interactive/v1/beam_interactive_api.proto:36:1: warning: Import google/protobuf/timestamp.proto is unused.
Writing mypy to org/apache/beam/model/pipeline/v1/external_transforms_pb2.pyi
Writing mypy to org/apache/beam/model/pipeline/v1/beam_runner_api_pb2.pyi
Writing mypy to org/apache/beam/model/pipeline/v1/standard_window_fns_pb2.pyi
Writing mypy to org/apache/beam/model/pipeline/v1/metrics_pb2.pyi
Writing mypy to org/apache/beam/model/pipeline/v1/endpoints_pb2.pyi
Writing mypy to org/apache/beam/model/pipeline/v1/schema_pb2.pyi
Writing mypy to org/apache/beam/model/job_management/v1/beam_artifact_api_pb2.pyi
Writing mypy to org/apache/beam/model/job_management/v1/beam_expansion_api_pb2.pyi
Writing mypy to org/apache/beam/model/job_management/v1/beam_job_api_pb2.pyi
Writing mypy to org/apache/beam/model/fn_execution/v1/beam_provision_api_pb2.pyi
Writing mypy to org/apache/beam/model/fn_execution/v1/beam_fn_api_pb2.pyi
Writing mypy to org/apache/beam/model/interactive/v1/beam_interactive_api_pb2.pyi
setup.py:142: UserWarning: Could not import gen_protos, skipping proto generation.
  warnings.warn("Could not import gen_protos, skipping proto generation.")
<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/setuptools/dist.py>:530: UserWarning: Normalizing '2.43.0.dev' to '2.43.0.dev0'
  warnings.warn(tmpl.format(**locals()))
warning: no files found matching 'README.md'
warning: no files found matching 'NOTICE'
warning: no files found matching 'LICENSE'
warning: no files found matching 'LICENSE.python'
warning: sdist: standard file not found: should have one of README, README.rst, README.txt, README.md


> Task :release:go-licenses:java:dockerRun
+ go-licenses csv github.com/apache/beam/sdks/v2/java/container
+ tee /output/licenses/list.csv
W0914 10:26:38.283036     184 library.go:94] "golang.org/x/sys/unix" contains non-Go code that can't be inspected for further dependencies:
/go/pkg/mod/golang.org/x/sys@v0.0.0-20220624220833-87e55d714810/unix/asm_linux_amd64.s
github.com/apache/beam/sdks/v2/go/pkg/beam,https://github.com/apache/beam/blob/sdks/v2.41.0/sdks/go/README.md,Apache-2.0
github.com/apache/beam/sdks/v2/java/container,https://github.com/apache/beam/blob/sdks/v2.41.0/sdks/LICENSE,Apache-2.0
github.com/golang/protobuf,https://github.com/golang/protobuf/blob/v1.5.2/LICENSE,BSD-3-Clause
golang.org/x/net,https://cs.opensource.google/go/x/net/+/1bab6f36:LICENSE,BSD-3-Clause
golang.org/x/sys,https://cs.opensource.google/go/x/sys/+/87e55d71:LICENSE,BSD-3-Clause
golang.org/x/text,https://cs.opensource.google/go/x/text/+/v0.3.7:LICENSE,BSD-3-Clause
google.golang.org/genproto/googleapis/rpc/status,https://github.com/googleapis/go-genproto/blob/042d03aeabc9/LICENSE,Apache-2.0
google.golang.org/grpc,https://github.com/grpc/grpc-go/blob/v1.48.0/LICENSE,Apache-2.0
google.golang.org/protobuf,https://github.com/protocolbuffers/protobuf-go/blob/v1.28.0/LICENSE,BSD-3-Clause
+ chmod -R a+w /output/licenses

> Task :sdks:java:container:pullLicenses
INFO:root:Replaced local file URL with file://<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/java/container/license_scripts/manual_licenses/xz/COPYING> for xz-1.5
INFO:root:pull_licenses_java.py succeed. It took 12.138552 seconds with 16 threads.
Copying licenses from <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/java/container/build/target/java_third_party_licenses> to <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/java/container/build/target/third_party_licenses.>
Finished license_scripts.sh

> Task :sdks:java:container:goPrepare UP-TO-DATE
> Task :sdks:java:container:java8:copyJavaThirdPartyLicenses

> Task :sdks:java:container:goBuild
/home/jenkins/go/bin/go1.18.1 build -o ./build/target/linux_amd64/boot boot.go boot_test.go

> Task :sdks:java:container:java8:copySdkHarnessLauncher
Execution optimizations have been disabled for task ':sdks:java:container:java8:copySdkHarnessLauncher' to ensure correctness due to the following reasons:
  - Gradle detected a problem with the following location: '<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/java/container/build/target'.> Reason: Task ':sdks:java:container:java8:copySdkHarnessLauncher' uses this output of task ':sdks:java:container:downloadCloudProfilerAgent' without declaring an explicit or implicit dependency. This can lead to incorrect results being produced, depending on what order the tasks are executed. Please refer to https://docs.gradle.org/7.5.1/userguide/validation_problems.html#implicit_dependency for more details about this problem.
  - Gradle detected a problem with the following location: '<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/java/container/build/target'.> Reason: Task ':sdks:java:container:java8:copySdkHarnessLauncher' uses this output of task ':sdks:java:container:pullLicenses' without declaring an explicit or implicit dependency. This can lead to incorrect results being produced, depending on what order the tasks are executed. Please refer to https://docs.gradle.org/7.5.1/userguide/validation_problems.html#implicit_dependency for more details about this problem.

> Task :release:go-licenses:java:createLicenses
> Task :sdks:java:container:java8:copyGolangLicenses
> Task :sdks:java:container:java8:dockerPrepare
> Task :runners:flink:1.15:job-server:shadowJar
> Task :runners:flink:1.15:job-server:shadowJar FROM-CACHE
> Task :sdks:java:container:java8:docker

> Task :sdks:python:test-suites:portable:py37:flinkCompatibilityMatrixLOOPBACK
flink-runner-test create: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py37/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test>
flink-runner-test installdeps: -rbuild-requirements.txt
flink-runner-test inst: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py37/build/srcs/sdks/python/target/.tox-flink-runner-test/.tmp/package/1/apache-beam.tar.gz>
ERROR: invocation failed (exit code 1), logfile: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py37/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/log/flink-runner-test-2.log>
================================== log start ===================================
Processing ./target/.tox-flink-runner-test/.tmp/package/1/apache-beam.tar.gz
  Preparing metadata (setup.py): started
  Preparing metadata (setup.py): finished with status 'error'
  error: subprocess-exited-with-error
  
  × python setup.py egg_info did not run successfully.
  │ exit code: 1
  ╰─> [10 lines of output]
      Traceback (most recent call last):
        File "<string>", line 36, in <module>
        File "<pip-setuptools-caller>", line 34, in <module>
        File "/tmp/pip-req-build-a4r8wrv8/setup.py", line 169, in <module>
          generate_protos_first()
        File "/tmp/pip-req-build-a4r8wrv8/setup.py", line 139, in generate_protos_first
          gen_protos.generate_proto_files()
        File "/tmp/pip-req-build-a4r8wrv8/gen_protos.py", line 476, in generate_proto_files
          raise RuntimeError(error_msg)
      RuntimeError: Not in apache git tree, unable to find proto definitions.
      [end of output]
  
  note: This error originates from a subprocess, and is likely not a problem with pip.
error: metadata-generation-failed

× Encountered error while generating package metadata.
╰─> See above for output.

note: This is an issue with the package mentioned above, not pip.
hint: See above for details.

=================================== log end ====================================
___________________________________ summary ____________________________________
ERROR:   flink-runner-test: InvocationError for command <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py37/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/bin/python> target/.tox-flink-runner-test/flink-runner-test/bin/pip install --retries 10 --exists-action w '<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py37/build/srcs/sdks/python/target/.tox-flink-runner-test/.tmp/package/1/apache-beam.tar.gz[test]'> (exited with code 1)

> Task :sdks:python:test-suites:portable:py37:flinkCompatibilityMatrixLOOPBACK FAILED

> Task :sdks:python:test-suites:portable:py38:flinkCompatibilityMatrixLOOPBACK
flink-runner-test create: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test>
flink-runner-test installdeps: -rbuild-requirements.txt
flink-runner-test inst: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/target/.tox-flink-runner-test/.tmp/package/1/apache-beam.tar.gz>
ERROR: invocation failed (exit code 1), logfile: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/log/flink-runner-test-2.log>
================================== log start ===================================
Processing ./target/.tox-flink-runner-test/.tmp/package/1/apache-beam.tar.gz
  Preparing metadata (setup.py): started
  Preparing metadata (setup.py): finished with status 'error'
  error: subprocess-exited-with-error
  
  × python setup.py egg_info did not run successfully.
  │ exit code: 1
  ╰─> [10 lines of output]
      Traceback (most recent call last):
        File "<string>", line 2, in <module>
        File "<pip-setuptools-caller>", line 34, in <module>
        File "/tmp/pip-req-build-6sobvc7a/setup.py", line 169, in <module>
          generate_protos_first()
        File "/tmp/pip-req-build-6sobvc7a/setup.py", line 139, in generate_protos_first
          gen_protos.generate_proto_files()
        File "/tmp/pip-req-build-6sobvc7a/gen_protos.py", line 476, in generate_proto_files
          raise RuntimeError(error_msg)
      RuntimeError: Not in apache git tree, unable to find proto definitions.
      [end of output]
  
  note: This error originates from a subprocess, and is likely not a problem with pip.
error: metadata-generation-failed

× Encountered error while generating package metadata.
╰─> See above for output.

note: This is an issue with the package mentioned above, not pip.
hint: See above for details.

=================================== log end ====================================
___________________________________ summary ____________________________________
ERROR:   flink-runner-test: InvocationError for command <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/bin/python> target/.tox-flink-runner-test/flink-runner-test/bin/pip install --retries 10 --exists-action w '<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/target/.tox-flink-runner-test/.tmp/package/1/apache-beam.tar.gz[test]'> (exited with code 1)

> Task :sdks:python:test-suites:portable:py38:flinkCompatibilityMatrixLOOPBACK FAILED

> Task :sdks:python:test-suites:portable:py39:flinkCompatibilityMatrixLOOPBACK
flink-runner-test create: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test>
flink-runner-test installdeps: -rbuild-requirements.txt
flink-runner-test inst: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/target/.tox-flink-runner-test/.tmp/package/1/apache-beam.tar.gz>
ERROR: invocation failed (exit code 1), logfile: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/log/flink-runner-test-2.log>
================================== log start ===================================
Processing ./target/.tox-flink-runner-test/.tmp/package/1/apache-beam.tar.gz
  Preparing metadata (setup.py): started
  Preparing metadata (setup.py): finished with status 'error'
  error: subprocess-exited-with-error
  
  × python setup.py egg_info did not run successfully.
  │ exit code: 1
  ╰─> [10 lines of output]
      Traceback (most recent call last):
        File "<string>", line 2, in <module>
        File "<pip-setuptools-caller>", line 34, in <module>
        File "/tmp/pip-req-build-_52bpp8w/setup.py", line 169, in <module>
          generate_protos_first()
        File "/tmp/pip-req-build-_52bpp8w/setup.py", line 139, in generate_protos_first
          gen_protos.generate_proto_files()
        File "/tmp/pip-req-build-_52bpp8w/gen_protos.py", line 476, in generate_proto_files
          raise RuntimeError(error_msg)
      RuntimeError: Not in apache git tree, unable to find proto definitions.
      [end of output]
  
  note: This error originates from a subprocess, and is likely not a problem with pip.
error: metadata-generation-failed

× Encountered error while generating package metadata.
╰─> See above for output.

note: This is an issue with the package mentioned above, not pip.
hint: See above for details.

=================================== log end ====================================
___________________________________ summary ____________________________________
ERROR:   flink-runner-test: InvocationError for command <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/bin/python> target/.tox-flink-runner-test/flink-runner-test/bin/pip install --retries 10 --exists-action w '<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/target/.tox-flink-runner-test/.tmp/package/1/apache-beam.tar.gz[test]'> (exited with code 1)

> Task :sdks:python:test-suites:portable:py39:flinkCompatibilityMatrixLOOPBACK FAILED

FAILURE: Build completed with 3 failures.

1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkCompatibilityMatrixLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py38:flinkCompatibilityMatrixLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

3: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py39:flinkCompatibilityMatrixLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.

BUILD FAILED in 1m 20s
151 actionable tasks: 102 executed, 45 from cache, 4 up-to-date

Publishing build scan...
https://gradle.com/s/u7sm4x6e4igfs

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_VR_Flink #2844

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/2844/display/redirect?page=changes>

Changes:

[noreply] Trying out property-based tests for Beam python coders (#22233)


------------------------------------------
[...truncated 73.55 KB...]
  warnings.warn(tmpl.format(**locals()))
warning: no files found matching 'README.md'
warning: no files found matching 'NOTICE'
warning: no files found matching 'LICENSE'
warning: no files found matching 'LICENSE.python'
warning: sdist: standard file not found: should have one of README, README.rst, README.txt, README.md


> Task :sdks:java:container:pullLicenses
Collecting setuptools
  Using cached setuptools-65.3.0-py3-none-any.whl (1.2 MB)
Collecting wheel
  Using cached wheel-0.37.1-py2.py3-none-any.whl (35 kB)
Installing collected packages: pip, setuptools, wheel
  Attempting uninstall: pip
    Found existing installation: pip 20.0.2
    Uninstalling pip-20.0.2:
      Successfully uninstalled pip-20.0.2
  Attempting uninstall: setuptools
    Found existing installation: setuptools 44.0.0
    Uninstalling setuptools-44.0.0:
      Successfully uninstalled setuptools-44.0.0
Successfully installed pip-22.2.2 setuptools-65.3.0 wheel-0.37.1
Collecting beautifulsoup4<5.0,>=4.9.0
  Using cached beautifulsoup4-4.11.1-py3-none-any.whl (128 kB)
Collecting pyyaml<6.0.0,>=3.12
  Using cached PyYAML-5.4.1-cp38-cp38-manylinux1_x86_64.whl (662 kB)
Collecting tenacity<6.0,>=5.0.2
  Using cached tenacity-5.1.5-py2.py3-none-any.whl (34 kB)
Collecting soupsieve>1.2
  Using cached soupsieve-2.3.2.post1-py3-none-any.whl (37 kB)
Collecting six>=1.9.0
  Using cached six-1.16.0-py2.py3-none-any.whl (11 kB)
Installing collected packages: soupsieve, six, pyyaml, tenacity, beautifulsoup4
Successfully installed beautifulsoup4-4.11.1 pyyaml-5.4.1 six-1.16.0 soupsieve-2.3.2.post1 tenacity-5.1.5
Executing python <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/java/container/license_scripts/pull_licenses_java.py> --license_index=<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/java/container/build/reports/dependency-license/index.json>        --output_dir=<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/java/container/build/target/java_third_party_licenses>        --dep_url_yaml=<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/java/container/license_scripts/dep_urls_java.yaml>        --manual_license_path=<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/java/container/license_scripts/manual_licenses>
INFO:root:Pulling license for 254 dependencies using 16 threads.
INFO:root:Replaced local file URL with file://<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/java/container/license_scripts/manual_licenses/xz/COPYING> for xz-1.5
INFO:root:pull_licenses_java.py succeed. It took 7.605765 seconds with 16 threads.
Copying licenses from <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/java/container/build/target/java_third_party_licenses> to <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/java/container/build/target/third_party_licenses.>
Finished license_scripts.sh

> Task :sdks:java:container:goPrepare UP-TO-DATE

> Task :release:go-licenses:java:dockerRun
github.com/apache/beam/sdks/v2/go/pkg/beam,https://github.com/apache/beam/blob/sdks/v2.41.0/sdks/go/README.md,Apache-2.0
github.com/apache/beam/sdks/v2/java/container,https://github.com/apache/beam/blob/sdks/v2.41.0/sdks/LICENSE,Apache-2.0
github.com/golang/protobuf,https://github.com/golang/protobuf/blob/v1.5.2/LICENSE,BSD-3-Clause
golang.org/x/net,https://cs.opensource.google/go/x/net/+/1bab6f36:LICENSE,BSD-3-Clause
golang.org/x/sys,https://cs.opensource.google/go/x/sys/+/87e55d71:LICENSE,BSD-3-Clause
golang.org/x/text,https://cs.opensource.google/go/x/text/+/v0.3.7:LICENSE,BSD-3-Clause
google.golang.org/genproto/googleapis/rpc/status,https://github.com/googleapis/go-genproto/blob/042d03aeabc9/LICENSE,Apache-2.0
google.golang.org/grpc,https://github.com/grpc/grpc-go/blob/v1.48.0/LICENSE,Apache-2.0
google.golang.org/protobuf,https://github.com/protocolbuffers/protobuf-go/blob/v1.28.0/LICENSE,BSD-3-Clause
+ chmod -R a+w /output/licenses

> Task :sdks:java:container:java8:copyJavaThirdPartyLicenses

> Task :sdks:java:container:goBuild
/home/jenkins/go/bin/go1.18.1 build -o ./build/target/linux_amd64/boot boot.go boot_test.go

> Task :sdks:java:container:java8:copySdkHarnessLauncher
Execution optimizations have been disabled for task ':sdks:java:container:java8:copySdkHarnessLauncher' to ensure correctness due to the following reasons:
  - Gradle detected a problem with the following location: '<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/java/container/build/target'.> Reason: Task ':sdks:java:container:java8:copySdkHarnessLauncher' uses this output of task ':sdks:java:container:downloadCloudProfilerAgent' without declaring an explicit or implicit dependency. This can lead to incorrect results being produced, depending on what order the tasks are executed. Please refer to https://docs.gradle.org/7.5.1/userguide/validation_problems.html#implicit_dependency for more details about this problem.
  - Gradle detected a problem with the following location: '<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/java/container/build/target'.> Reason: Task ':sdks:java:container:java8:copySdkHarnessLauncher' uses this output of task ':sdks:java:container:pullLicenses' without declaring an explicit or implicit dependency. This can lead to incorrect results being produced, depending on what order the tasks are executed. Please refer to https://docs.gradle.org/7.5.1/userguide/validation_problems.html#implicit_dependency for more details about this problem.

> Task :runners:flink:1.15:job-server:shadowJar FROM-CACHE
> Task :release:go-licenses:java:createLicenses
> Task :sdks:java:container:java8:copyGolangLicenses
> Task :sdks:java:container:java8:dockerPrepare
> Task :sdks:java:container:java8:docker

> Task :sdks:python:test-suites:portable:py37:flinkCompatibilityMatrixLOOPBACK
flink-runner-test create: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py37/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test>
flink-runner-test installdeps: -rbuild-requirements.txt
flink-runner-test inst: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py37/build/srcs/sdks/python/target/.tox-flink-runner-test/.tmp/package/1/apache-beam.tar.gz>
ERROR: invocation failed (exit code 1), logfile: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py37/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/log/flink-runner-test-2.log>
================================== log start ===================================
Processing ./target/.tox-flink-runner-test/.tmp/package/1/apache-beam.tar.gz
  Preparing metadata (setup.py): started
  Preparing metadata (setup.py): finished with status 'error'
  error: subprocess-exited-with-error
  
  × python setup.py egg_info did not run successfully.
  │ exit code: 1
  ╰─> [10 lines of output]
      Traceback (most recent call last):
        File "<string>", line 36, in <module>
        File "<pip-setuptools-caller>", line 34, in <module>
        File "/tmp/pip-req-build-ll9gaxhy/setup.py", line 169, in <module>
          generate_protos_first()
        File "/tmp/pip-req-build-ll9gaxhy/setup.py", line 139, in generate_protos_first
          gen_protos.generate_proto_files()
        File "/tmp/pip-req-build-ll9gaxhy/gen_protos.py", line 476, in generate_proto_files
          raise RuntimeError(error_msg)
      RuntimeError: Not in apache git tree, unable to find proto definitions.
      [end of output]
  
  note: This error originates from a subprocess, and is likely not a problem with pip.
error: metadata-generation-failed

× Encountered error while generating package metadata.
╰─> See above for output.

note: This is an issue with the package mentioned above, not pip.
hint: See above for details.

=================================== log end ====================================
___________________________________ summary ____________________________________
ERROR:   flink-runner-test: InvocationError for command <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py37/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/bin/python> target/.tox-flink-runner-test/flink-runner-test/bin/pip install --retries 10 --exists-action w '<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py37/build/srcs/sdks/python/target/.tox-flink-runner-test/.tmp/package/1/apache-beam.tar.gz[test]'> (exited with code 1)

> Task :sdks:python:test-suites:portable:py37:flinkCompatibilityMatrixLOOPBACK FAILED

> Task :sdks:python:test-suites:portable:py38:flinkCompatibilityMatrixLOOPBACK
flink-runner-test create: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test>
flink-runner-test installdeps: -rbuild-requirements.txt
flink-runner-test inst: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/target/.tox-flink-runner-test/.tmp/package/1/apache-beam.tar.gz>
ERROR: invocation failed (exit code 1), logfile: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/log/flink-runner-test-2.log>
================================== log start ===================================
Processing ./target/.tox-flink-runner-test/.tmp/package/1/apache-beam.tar.gz
  Preparing metadata (setup.py): started
  Preparing metadata (setup.py): finished with status 'error'
  error: subprocess-exited-with-error
  
  × python setup.py egg_info did not run successfully.
  │ exit code: 1
  ╰─> [10 lines of output]
      Traceback (most recent call last):
        File "<string>", line 2, in <module>
        File "<pip-setuptools-caller>", line 34, in <module>
        File "/tmp/pip-req-build-ma2adic1/setup.py", line 169, in <module>
          generate_protos_first()
        File "/tmp/pip-req-build-ma2adic1/setup.py", line 139, in generate_protos_first
          gen_protos.generate_proto_files()
        File "/tmp/pip-req-build-ma2adic1/gen_protos.py", line 476, in generate_proto_files
          raise RuntimeError(error_msg)
      RuntimeError: Not in apache git tree, unable to find proto definitions.
      [end of output]
  
  note: This error originates from a subprocess, and is likely not a problem with pip.
error: metadata-generation-failed

× Encountered error while generating package metadata.
╰─> See above for output.

note: This is an issue with the package mentioned above, not pip.
hint: See above for details.

=================================== log end ====================================
___________________________________ summary ____________________________________
ERROR:   flink-runner-test: InvocationError for command <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/bin/python> target/.tox-flink-runner-test/flink-runner-test/bin/pip install --retries 10 --exists-action w '<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/target/.tox-flink-runner-test/.tmp/package/1/apache-beam.tar.gz[test]'> (exited with code 1)

> Task :sdks:python:test-suites:portable:py38:flinkCompatibilityMatrixLOOPBACK FAILED

> Task :sdks:python:test-suites:portable:py39:flinkCompatibilityMatrixLOOPBACK
flink-runner-test create: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test>
flink-runner-test installdeps: -rbuild-requirements.txt
flink-runner-test inst: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/target/.tox-flink-runner-test/.tmp/package/1/apache-beam.tar.gz>
ERROR: invocation failed (exit code 1), logfile: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/log/flink-runner-test-2.log>
================================== log start ===================================
Processing ./target/.tox-flink-runner-test/.tmp/package/1/apache-beam.tar.gz
  Preparing metadata (setup.py): started
  Preparing metadata (setup.py): finished with status 'error'
  error: subprocess-exited-with-error
  
  × python setup.py egg_info did not run successfully.
  │ exit code: 1
  ╰─> [10 lines of output]
      Traceback (most recent call last):
        File "<string>", line 2, in <module>
        File "<pip-setuptools-caller>", line 34, in <module>
        File "/tmp/pip-req-build-u6yuovpw/setup.py", line 169, in <module>
          generate_protos_first()
        File "/tmp/pip-req-build-u6yuovpw/setup.py", line 139, in generate_protos_first
          gen_protos.generate_proto_files()
        File "/tmp/pip-req-build-u6yuovpw/gen_protos.py", line 476, in generate_proto_files
          raise RuntimeError(error_msg)
      RuntimeError: Not in apache git tree, unable to find proto definitions.
      [end of output]
  
  note: This error originates from a subprocess, and is likely not a problem with pip.
error: metadata-generation-failed

× Encountered error while generating package metadata.
╰─> See above for output.

note: This is an issue with the package mentioned above, not pip.
hint: See above for details.

=================================== log end ====================================
___________________________________ summary ____________________________________
ERROR:   flink-runner-test: InvocationError for command <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/bin/python> target/.tox-flink-runner-test/flink-runner-test/bin/pip install --retries 10 --exists-action w '<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/target/.tox-flink-runner-test/.tmp/package/1/apache-beam.tar.gz[test]'> (exited with code 1)

> Task :sdks:python:test-suites:portable:py39:flinkCompatibilityMatrixLOOPBACK FAILED

FAILURE: Build completed with 3 failures.

1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkCompatibilityMatrixLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py38:flinkCompatibilityMatrixLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

3: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py39:flinkCompatibilityMatrixLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.

BUILD FAILED in 1m 17s
151 actionable tasks: 102 executed, 45 from cache, 4 up-to-date

Publishing build scan...
https://gradle.com/s/3ixp4j3v2h4ws

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_VR_Flink #2843

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/2843/display/redirect?page=changes>

Changes:

[noreply] Open Allow and test pyarrow 8.x and 9.x (#22997)

[noreply] (BQ Python) Pass project field from options or parameter when writing

[noreply] Update python-machine-learning.md (#23209)

[noreply] Pin the version of cloudpickle to 2.1.x (#23120)

[noreply] Add streaming test for Write API sink (#21903)

[noreply] [Go SDK] Proto changes for timer param (#23216)

[noreply] Bump github.com/testcontainers/testcontainers-go in /sdks (#23201)

[noreply] Update to objsize to 0.5.2 which is under BSD-3 license (fixes #23096)

[noreply] Exclude insignificant whitespace from cloud object (#23217)


------------------------------------------
[...truncated 74.36 KB...]
warning: sdist: standard file not found: should have one of README, README.rst, README.txt, README.md


> Task :sdks:java:container:pullLicenses
Collecting setuptools
  Using cached setuptools-65.3.0-py3-none-any.whl (1.2 MB)
Collecting wheel
  Using cached wheel-0.37.1-py2.py3-none-any.whl (35 kB)
Installing collected packages: pip, setuptools, wheel
  Attempting uninstall: pip
    Found existing installation: pip 20.0.2
    Uninstalling pip-20.0.2:
      Successfully uninstalled pip-20.0.2
  Attempting uninstall: setuptools
    Found existing installation: setuptools 44.0.0
    Uninstalling setuptools-44.0.0:
      Successfully uninstalled setuptools-44.0.0
Successfully installed pip-22.2.2 setuptools-65.3.0 wheel-0.37.1
Collecting beautifulsoup4<5.0,>=4.9.0
  Using cached beautifulsoup4-4.11.1-py3-none-any.whl (128 kB)
Collecting pyyaml<6.0.0,>=3.12
  Using cached PyYAML-5.4.1-cp38-cp38-manylinux1_x86_64.whl (662 kB)
Collecting tenacity<6.0,>=5.0.2
  Using cached tenacity-5.1.5-py2.py3-none-any.whl (34 kB)
Collecting soupsieve>1.2
  Using cached soupsieve-2.3.2.post1-py3-none-any.whl (37 kB)
Collecting six>=1.9.0
  Using cached six-1.16.0-py2.py3-none-any.whl (11 kB)
Installing collected packages: soupsieve, six, pyyaml, tenacity, beautifulsoup4
Successfully installed beautifulsoup4-4.11.1 pyyaml-5.4.1 six-1.16.0 soupsieve-2.3.2.post1 tenacity-5.1.5
Executing python <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/java/container/license_scripts/pull_licenses_java.py> --license_index=<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/java/container/build/reports/dependency-license/index.json>        --output_dir=<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/java/container/build/target/java_third_party_licenses>        --dep_url_yaml=<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/java/container/license_scripts/dep_urls_java.yaml>        --manual_license_path=<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/java/container/license_scripts/manual_licenses>
INFO:root:Pulling license for 254 dependencies using 16 threads.
INFO:root:Replaced local file URL with file://<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/java/container/license_scripts/manual_licenses/xz/COPYING> for xz-1.5
INFO:root:pull_licenses_java.py succeed. It took 11.208835 seconds with 16 threads.

> Task :sdks:java:container:goPrepare UP-TO-DATE

> Task :release:go-licenses:java:dockerRun
W0913 22:25:57.276384      29 library.go:94] "golang.org/x/sys/unix" contains non-Go code that can't be inspected for further dependencies:
/go/pkg/mod/golang.org/x/sys@v0.0.0-20220624220833-87e55d714810/unix/asm_linux_amd64.s
+ go-licenses csv github.com/apache/beam/sdks/v2/java/container
+ tee /output/licenses/list.csv
W0913 22:26:01.817986     180 library.go:94] "golang.org/x/sys/unix" contains non-Go code that can't be inspected for further dependencies:
/go/pkg/mod/golang.org/x/sys@v0.0.0-20220624220833-87e55d714810/unix/asm_linux_amd64.s
github.com/apache/beam/sdks/v2/go/pkg/beam,https://github.com/apache/beam/blob/sdks/v2.41.0/sdks/go/README.md,Apache-2.0
github.com/apache/beam/sdks/v2/java/container,https://github.com/apache/beam/blob/sdks/v2.41.0/sdks/LICENSE,Apache-2.0
github.com/golang/protobuf,https://github.com/golang/protobuf/blob/v1.5.2/LICENSE,BSD-3-Clause
golang.org/x/net,https://cs.opensource.google/go/x/net/+/1bab6f36:LICENSE,BSD-3-Clause
golang.org/x/sys,https://cs.opensource.google/go/x/sys/+/87e55d71:LICENSE,BSD-3-Clause
golang.org/x/text,https://cs.opensource.google/go/x/text/+/v0.3.7:LICENSE,BSD-3-Clause
google.golang.org/genproto/googleapis/rpc/status,https://github.com/googleapis/go-genproto/blob/042d03aeabc9/LICENSE,Apache-2.0
google.golang.org/grpc,https://github.com/grpc/grpc-go/blob/v1.48.0/LICENSE,Apache-2.0
google.golang.org/protobuf,https://github.com/protocolbuffers/protobuf-go/blob/v1.28.0/LICENSE,BSD-3-Clause
+ chmod -R a+w /output/licenses

> Task :sdks:java:container:java8:copyJavaThirdPartyLicenses

> Task :sdks:java:container:goBuild
/home/jenkins/go/bin/go1.18.1 build -o ./build/target/linux_amd64/boot boot.go boot_test.go

> Task :runners:flink:1.15:job-server:shadowJar FROM-CACHE

> Task :sdks:java:container:java8:copySdkHarnessLauncher
Execution optimizations have been disabled for task ':sdks:java:container:java8:copySdkHarnessLauncher' to ensure correctness due to the following reasons:
  - Gradle detected a problem with the following location: '<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/java/container/build/target'.> Reason: Task ':sdks:java:container:java8:copySdkHarnessLauncher' uses this output of task ':sdks:java:container:downloadCloudProfilerAgent' without declaring an explicit or implicit dependency. This can lead to incorrect results being produced, depending on what order the tasks are executed. Please refer to https://docs.gradle.org/7.5.1/userguide/validation_problems.html#implicit_dependency for more details about this problem.
  - Gradle detected a problem with the following location: '<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/java/container/build/target'.> Reason: Task ':sdks:java:container:java8:copySdkHarnessLauncher' uses this output of task ':sdks:java:container:pullLicenses' without declaring an explicit or implicit dependency. This can lead to incorrect results being produced, depending on what order the tasks are executed. Please refer to https://docs.gradle.org/7.5.1/userguide/validation_problems.html#implicit_dependency for more details about this problem.

> Task :release:go-licenses:java:createLicenses
> Task :sdks:java:container:java8:copyGolangLicenses
> Task :sdks:java:container:java8:dockerPrepare
> Task :sdks:java:container:java8:docker

> Task :sdks:python:test-suites:portable:py37:flinkCompatibilityMatrixLOOPBACK
flink-runner-test create: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py37/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test>
flink-runner-test installdeps: -rbuild-requirements.txt
flink-runner-test inst: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py37/build/srcs/sdks/python/target/.tox-flink-runner-test/.tmp/package/1/apache-beam.tar.gz>
ERROR: invocation failed (exit code 1), logfile: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py37/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/log/flink-runner-test-2.log>
================================== log start ===================================
Processing ./target/.tox-flink-runner-test/.tmp/package/1/apache-beam.tar.gz
  Preparing metadata (setup.py): started
  Preparing metadata (setup.py): finished with status 'error'
  error: subprocess-exited-with-error
  
  × python setup.py egg_info did not run successfully.
  │ exit code: 1
  ╰─> [10 lines of output]
      Traceback (most recent call last):
        File "<string>", line 36, in <module>
        File "<pip-setuptools-caller>", line 34, in <module>
        File "/tmp/pip-req-build-j3aysrup/setup.py", line 169, in <module>
          generate_protos_first()
        File "/tmp/pip-req-build-j3aysrup/setup.py", line 139, in generate_protos_first
          gen_protos.generate_proto_files()
        File "/tmp/pip-req-build-j3aysrup/gen_protos.py", line 476, in generate_proto_files
          raise RuntimeError(error_msg)
      RuntimeError: Not in apache git tree, unable to find proto definitions.
      [end of output]
  
  note: This error originates from a subprocess, and is likely not a problem with pip.
error: metadata-generation-failed

× Encountered error while generating package metadata.
╰─> See above for output.

note: This is an issue with the package mentioned above, not pip.
hint: See above for details.

=================================== log end ====================================
___________________________________ summary ____________________________________
ERROR:   flink-runner-test: InvocationError for command <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py37/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/bin/python> target/.tox-flink-runner-test/flink-runner-test/bin/pip install --retries 10 --exists-action w '<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py37/build/srcs/sdks/python/target/.tox-flink-runner-test/.tmp/package/1/apache-beam.tar.gz[test]'> (exited with code 1)

> Task :sdks:python:test-suites:portable:py37:flinkCompatibilityMatrixLOOPBACK FAILED

> Task :sdks:python:test-suites:portable:py38:flinkCompatibilityMatrixLOOPBACK
flink-runner-test create: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test>
flink-runner-test installdeps: -rbuild-requirements.txt
flink-runner-test inst: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/target/.tox-flink-runner-test/.tmp/package/1/apache-beam.tar.gz>
ERROR: invocation failed (exit code 1), logfile: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/log/flink-runner-test-2.log>
================================== log start ===================================
Processing ./target/.tox-flink-runner-test/.tmp/package/1/apache-beam.tar.gz
  Preparing metadata (setup.py): started
  Preparing metadata (setup.py): finished with status 'error'
  error: subprocess-exited-with-error
  
  × python setup.py egg_info did not run successfully.
  │ exit code: 1
  ╰─> [10 lines of output]
      Traceback (most recent call last):
        File "<string>", line 2, in <module>
        File "<pip-setuptools-caller>", line 34, in <module>
        File "/tmp/pip-req-build-k7960clp/setup.py", line 169, in <module>
          generate_protos_first()
        File "/tmp/pip-req-build-k7960clp/setup.py", line 139, in generate_protos_first
          gen_protos.generate_proto_files()
        File "/tmp/pip-req-build-k7960clp/gen_protos.py", line 476, in generate_proto_files
          raise RuntimeError(error_msg)
      RuntimeError: Not in apache git tree, unable to find proto definitions.
      [end of output]
  
  note: This error originates from a subprocess, and is likely not a problem with pip.
error: metadata-generation-failed

× Encountered error while generating package metadata.
╰─> See above for output.

note: This is an issue with the package mentioned above, not pip.
hint: See above for details.

=================================== log end ====================================
___________________________________ summary ____________________________________
ERROR:   flink-runner-test: InvocationError for command <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/bin/python> target/.tox-flink-runner-test/flink-runner-test/bin/pip install --retries 10 --exists-action w '<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/target/.tox-flink-runner-test/.tmp/package/1/apache-beam.tar.gz[test]'> (exited with code 1)

> Task :sdks:python:test-suites:portable:py38:flinkCompatibilityMatrixLOOPBACK FAILED

> Task :sdks:python:test-suites:portable:py39:flinkCompatibilityMatrixLOOPBACK
flink-runner-test create: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test>
flink-runner-test installdeps: -rbuild-requirements.txt
flink-runner-test inst: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/target/.tox-flink-runner-test/.tmp/package/1/apache-beam.tar.gz>
ERROR: invocation failed (exit code 1), logfile: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/log/flink-runner-test-2.log>
================================== log start ===================================
Processing ./target/.tox-flink-runner-test/.tmp/package/1/apache-beam.tar.gz
  Preparing metadata (setup.py): started
  Preparing metadata (setup.py): finished with status 'error'
  error: subprocess-exited-with-error
  
  × python setup.py egg_info did not run successfully.
  │ exit code: 1
  ╰─> [10 lines of output]
      Traceback (most recent call last):
        File "<string>", line 2, in <module>
        File "<pip-setuptools-caller>", line 34, in <module>
        File "/tmp/pip-req-build-ajtqomit/setup.py", line 169, in <module>
          generate_protos_first()
        File "/tmp/pip-req-build-ajtqomit/setup.py", line 139, in generate_protos_first
          gen_protos.generate_proto_files()
        File "/tmp/pip-req-build-ajtqomit/gen_protos.py", line 476, in generate_proto_files
          raise RuntimeError(error_msg)
      RuntimeError: Not in apache git tree, unable to find proto definitions.
      [end of output]
  
  note: This error originates from a subprocess, and is likely not a problem with pip.
error: metadata-generation-failed

× Encountered error while generating package metadata.
╰─> See above for output.

note: This is an issue with the package mentioned above, not pip.
hint: See above for details.

=================================== log end ====================================
___________________________________ summary ____________________________________
ERROR:   flink-runner-test: InvocationError for command <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/bin/python> target/.tox-flink-runner-test/flink-runner-test/bin/pip install --retries 10 --exists-action w '<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/target/.tox-flink-runner-test/.tmp/package/1/apache-beam.tar.gz[test]'> (exited with code 1)

> Task :sdks:python:test-suites:portable:py39:flinkCompatibilityMatrixLOOPBACK FAILED

FAILURE: Build completed with 3 failures.

1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkCompatibilityMatrixLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py38:flinkCompatibilityMatrixLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

3: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py39:flinkCompatibilityMatrixLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.

BUILD FAILED in 1m 23s
151 actionable tasks: 102 executed, 45 from cache, 4 up-to-date

Publishing build scan...
https://gradle.com/s/rfld7uankt4ce

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org