You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2023/09/24 22:39:00 UTC

Build failed in Jenkins: beam_PostCommit_Py_VR_Dataflow #11334

See <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/11334/display/redirect>

Changes:


------------------------------------------
[...truncated 1.62 MB...]
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 487, in get
    processor = bundle_processor.BundleProcessor(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py", line 888, in __init__
    _verify_descriptor_created_in_a_compatible_env(process_bundle_descriptor)
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py", line 851, in _verify_descriptor_created_in_a_compatible_env
    raise RuntimeError(
RuntimeError: Pipeline construction environment and pipeline runtime environment are not compatible. If you use a custom container image, check that the Python interpreter minor version and the Apache Beam version in your image match the versions used at pipeline construction time. Submission environment: beam:version:sdk_base:apache/beam_python3.8_sdk:2.52.0.dev. Runtime environment: beam:version:sdk_base:apache/beam_python3.8_sdk:2.51.0.dev.

ERROR    apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:208 2023-09-24T22:17:15.030Z: JOB_MESSAGE_ERROR: generic::unknown: Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 297, in _execute
    response = task()
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 372, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 625, in do_instruction
    return getattr(self, request_type)(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 656, in process_bundle
    bundle_processor = self.bundle_processor_cache.get(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 487, in get
    processor = bundle_processor.BundleProcessor(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py", line 888, in __init__
    _verify_descriptor_created_in_a_compatible_env(process_bundle_descriptor)
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py", line 851, in _verify_descriptor_created_in_a_compatible_env
    raise RuntimeError(
RuntimeError: Pipeline construction environment and pipeline runtime environment are not compatible. If you use a custom container image, check that the Python interpreter minor version and the Apache Beam version in your image match the versions used at pipeline construction time. Submission environment: beam:version:sdk_base:apache/beam_python3.8_sdk:2.52.0.dev. Runtime environment: beam:version:sdk_base:apache/beam_python3.8_sdk:2.51.0.dev.

ERROR    apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:208 2023-09-24T22:17:45.785Z: JOB_MESSAGE_ERROR: generic::unknown: Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 297, in _execute
    response = task()
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 372, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 625, in do_instruction
    return getattr(self, request_type)(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 656, in process_bundle
    bundle_processor = self.bundle_processor_cache.get(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 487, in get
    processor = bundle_processor.BundleProcessor(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py", line 888, in __init__
    _verify_descriptor_created_in_a_compatible_env(process_bundle_descriptor)
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py", line 851, in _verify_descriptor_created_in_a_compatible_env
    raise RuntimeError(
RuntimeError: Pipeline construction environment and pipeline runtime environment are not compatible. If you use a custom container image, check that the Python interpreter minor version and the Apache Beam version in your image match the versions used at pipeline construction time. Submission environment: beam:version:sdk_base:apache/beam_python3.8_sdk:2.52.0.dev. Runtime environment: beam:version:sdk_base:apache/beam_python3.8_sdk:2.51.0.dev.

ERROR    apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:208 2023-09-24T22:18:16.550Z: JOB_MESSAGE_ERROR: generic::unknown: Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 297, in _execute
    response = task()
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 372, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 625, in do_instruction
    return getattr(self, request_type)(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 656, in process_bundle
    bundle_processor = self.bundle_processor_cache.get(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 487, in get
    processor = bundle_processor.BundleProcessor(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py", line 888, in __init__
    _verify_descriptor_created_in_a_compatible_env(process_bundle_descriptor)
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py", line 851, in _verify_descriptor_created_in_a_compatible_env
    raise RuntimeError(
RuntimeError: Pipeline construction environment and pipeline runtime environment are not compatible. If you use a custom container image, check that the Python interpreter minor version and the Apache Beam version in your image match the versions used at pipeline construction time. Submission environment: beam:version:sdk_base:apache/beam_python3.8_sdk:2.52.0.dev. Runtime environment: beam:version:sdk_base:apache/beam_python3.8_sdk:2.51.0.dev.

ERROR    apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:208 2023-09-24T22:18:47.307Z: JOB_MESSAGE_ERROR: generic::unknown: Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 297, in _execute
    response = task()
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 372, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 625, in do_instruction
    return getattr(self, request_type)(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 656, in process_bundle
    bundle_processor = self.bundle_processor_cache.get(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 487, in get
    processor = bundle_processor.BundleProcessor(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py", line 888, in __init__
    _verify_descriptor_created_in_a_compatible_env(process_bundle_descriptor)
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py", line 851, in _verify_descriptor_created_in_a_compatible_env
    raise RuntimeError(
RuntimeError: Pipeline construction environment and pipeline runtime environment are not compatible. If you use a custom container image, check that the Python interpreter minor version and the Apache Beam version in your image match the versions used at pipeline construction time. Submission environment: beam:version:sdk_base:apache/beam_python3.8_sdk:2.52.0.dev. Runtime environment: beam:version:sdk_base:apache/beam_python3.8_sdk:2.51.0.dev.

ERROR    apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:208 2023-09-24T22:19:18.072Z: JOB_MESSAGE_ERROR: generic::unknown: Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 297, in _execute
    response = task()
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 372, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 625, in do_instruction
    return getattr(self, request_type)(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 656, in process_bundle
    bundle_processor = self.bundle_processor_cache.get(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 487, in get
    processor = bundle_processor.BundleProcessor(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py", line 888, in __init__
    _verify_descriptor_created_in_a_compatible_env(process_bundle_descriptor)
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py", line 851, in _verify_descriptor_created_in_a_compatible_env
    raise RuntimeError(
RuntimeError: Pipeline construction environment and pipeline runtime environment are not compatible. If you use a custom container image, check that the Python interpreter minor version and the Apache Beam version in your image match the versions used at pipeline construction time. Submission environment: beam:version:sdk_base:apache/beam_python3.8_sdk:2.52.0.dev. Runtime environment: beam:version:sdk_base:apache/beam_python3.8_sdk:2.51.0.dev.

ERROR    apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:208 2023-09-24T22:19:43.737Z: JOB_MESSAGE_ERROR: generic::unknown: Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 297, in _execute
    response = task()
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 372, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 625, in do_instruction
    return getattr(self, request_type)(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 656, in process_bundle
    bundle_processor = self.bundle_processor_cache.get(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 487, in get
    processor = bundle_processor.BundleProcessor(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py", line 888, in __init__
    _verify_descriptor_created_in_a_compatible_env(process_bundle_descriptor)
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py", line 851, in _verify_descriptor_created_in_a_compatible_env
    raise RuntimeError(
RuntimeError: Pipeline construction environment and pipeline runtime environment are not compatible. If you use a custom container image, check that the Python interpreter minor version and the Apache Beam version in your image match the versions used at pipeline construction time. Submission environment: beam:version:sdk_base:apache/beam_python3.8_sdk:2.52.0.dev. Runtime environment: beam:version:sdk_base:apache/beam_python3.8_sdk:2.51.0.dev.

INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:154 Job 2023-09-24_14_05_13-5298256778415994427 is in state JOB_STATE_CANCELLING
=============================== warnings summary ===============================
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:28
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:28
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:28
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:28
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:28
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:28
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:28
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:28
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:28
  <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py>:28: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

../../build/gradleenv/-1734967051/lib/python3.8/site-packages/google/rpc/__init__.py:18
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/google/rpc/__init__.py:18
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/google/rpc/__init__.py:18
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/google/rpc/__init__.py:18
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/google/rpc/__init__.py:18
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/google/rpc/__init__.py:18
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/google/rpc/__init__.py:18
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/google/rpc/__init__.py:18
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/google/rpc/__init__.py:18
  <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/google/rpc/__init__.py>:18: DeprecationWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html
    import pkg_resources

../../build/gradleenv/-1734967051/lib/python3.8/site-packages/pkg_resources/__init__.py:2871: 171 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/pkg_resources/__init__.py>:2871: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google')`.
  Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
    declare_namespace(pkg)

../../build/gradleenv/-1734967051/lib/python3.8/site-packages/pkg_resources/__init__.py:2871: 144 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/pkg_resources/__init__.py>:2871: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google.cloud')`.
  Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
    declare_namespace(pkg)

../../build/gradleenv/-1734967051/lib/python3.8/site-packages/pkg_resources/__init__.py:2350: 36 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/pkg_resources/__init__.py>:2350: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google')`.
  Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
    declare_namespace(parent)

../../build/gradleenv/-1734967051/lib/python3.8/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/pkg_resources/__init__.py:2871
  <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/pkg_resources/__init__.py>:2871: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google.logging')`.
  Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
    declare_namespace(pkg)

../../build/gradleenv/-1734967051/lib/python3.8/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/pkg_resources/__init__.py:2871
  <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/pkg_resources/__init__.py>:2871: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google.iam')`.
  Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
    declare_namespace(pkg)

../../build/gradleenv/-1734967051/lib/python3.8/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/google/rpc/__init__.py:20
  <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/google/rpc/__init__.py>:20: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google.rpc')`.
  Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
    pkg_resources.declare_namespace(__name__)

apache_beam/ml/inference/base_test.py::RunInferenceBaseTest::test_run_inference_with_side_inputin_streaming
  <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/sdks/python/apache_beam/ml/inference/base_test.py>:1349: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    test_pipeline.options.view_as(StandardOptions).streaming = True

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/sdks/python/pytest_validatesRunnerStreamingTests-df-py38-xdist.xml> -
=========================== short test summary info ============================
FAILED apache_beam/metrics/metric_test.py::MetricsTest::test_user_counter_using_pardo - Failed: Timeout >4500.0s
FAILED apache_beam/transforms/ptransform_test.py::PTransformTest::test_flatten_a_flattened_pcollection - Failed: Timeout >4500.0s
===== 2 failed, 32 passed, 17 skipped, 397 warnings in 6122.99s (1:42:02) ======

> Task :sdks:python:test-suites:dataflow:py38:validatesRunnerStreamingTests FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 253

* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py311:validatesRunnerStreamingTests'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 253

* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:validatesRunnerStreamingTests'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.6.2/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 2h 19m 31s
24 actionable tasks: 18 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://ge.apache.org/s/e4lvupsy2v7rq

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Jenkins build is back to normal : beam_PostCommit_Py_VR_Dataflow #11346

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/11346/display/redirect?page=changes>


---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Py_VR_Dataflow #11345

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/11345/display/redirect>

Changes:


------------------------------------------
[...truncated 507.51 KB...]
                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/bundle_processor.py", line 888, in __init__
    _verify_descriptor_created_in_a_compatible_env(process_bundle_descriptor)
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/bundle_processor.py", line 851, in _verify_descriptor_created_in_a_compatible_env
    raise RuntimeError(
RuntimeError: Pipeline construction environment and pipeline runtime environment are not compatible. If you use a custom container image, check that the Python interpreter minor version and the Apache Beam version in your image match the versions used at pipeline construction time. Submission environment: beam:version:sdk_base:apache/beam_python3.11_sdk:2.52.0.dev. Runtime environment: beam:version:sdk_base:apache/beam_python3.11_sdk:2.51.0.dev.

ERROR    apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:208 2023-09-27T16:04:29.802Z: JOB_MESSAGE_ERROR: generic::unknown: Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 297, in _execute
    response = task()
               ^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 372, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 625, in do_instruction
    return getattr(self, request_type)(
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 656, in process_bundle
    bundle_processor = self.bundle_processor_cache.get(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 487, in get
    processor = bundle_processor.BundleProcessor(
                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/bundle_processor.py", line 888, in __init__
    _verify_descriptor_created_in_a_compatible_env(process_bundle_descriptor)
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/bundle_processor.py", line 851, in _verify_descriptor_created_in_a_compatible_env
    raise RuntimeError(
RuntimeError: Pipeline construction environment and pipeline runtime environment are not compatible. If you use a custom container image, check that the Python interpreter minor version and the Apache Beam version in your image match the versions used at pipeline construction time. Submission environment: beam:version:sdk_base:apache/beam_python3.11_sdk:2.52.0.dev. Runtime environment: beam:version:sdk_base:apache/beam_python3.11_sdk:2.51.0.dev.

ERROR    apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:208 2023-09-27T16:05:00.557Z: JOB_MESSAGE_ERROR: generic::unknown: Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 297, in _execute
    response = task()
               ^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 372, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 625, in do_instruction
    return getattr(self, request_type)(
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 656, in process_bundle
    bundle_processor = self.bundle_processor_cache.get(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 487, in get
    processor = bundle_processor.BundleProcessor(
                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/bundle_processor.py", line 888, in __init__
    _verify_descriptor_created_in_a_compatible_env(process_bundle_descriptor)
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/bundle_processor.py", line 851, in _verify_descriptor_created_in_a_compatible_env
    raise RuntimeError(
RuntimeError: Pipeline construction environment and pipeline runtime environment are not compatible. If you use a custom container image, check that the Python interpreter minor version and the Apache Beam version in your image match the versions used at pipeline construction time. Submission environment: beam:version:sdk_base:apache/beam_python3.11_sdk:2.52.0.dev. Runtime environment: beam:version:sdk_base:apache/beam_python3.11_sdk:2.51.0.dev.

ERROR    apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:208 2023-09-27T16:05:31.295Z: JOB_MESSAGE_ERROR: generic::unknown: Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 297, in _execute
    response = task()
               ^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 372, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 625, in do_instruction
    return getattr(self, request_type)(
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 656, in process_bundle
    bundle_processor = self.bundle_processor_cache.get(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 487, in get
    processor = bundle_processor.BundleProcessor(
                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/bundle_processor.py", line 888, in __init__
    _verify_descriptor_created_in_a_compatible_env(process_bundle_descriptor)
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/bundle_processor.py", line 851, in _verify_descriptor_created_in_a_compatible_env
    raise RuntimeError(
RuntimeError: Pipeline construction environment and pipeline runtime environment are not compatible. If you use a custom container image, check that the Python interpreter minor version and the Apache Beam version in your image match the versions used at pipeline construction time. Submission environment: beam:version:sdk_base:apache/beam_python3.11_sdk:2.52.0.dev. Runtime environment: beam:version:sdk_base:apache/beam_python3.11_sdk:2.51.0.dev.

ERROR    apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:208 2023-09-27T16:06:02.033Z: JOB_MESSAGE_ERROR: generic::unknown: Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 297, in _execute
    response = task()
               ^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 372, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 625, in do_instruction
    return getattr(self, request_type)(
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 656, in process_bundle
    bundle_processor = self.bundle_processor_cache.get(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 487, in get
    processor = bundle_processor.BundleProcessor(
                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/bundle_processor.py", line 888, in __init__
    _verify_descriptor_created_in_a_compatible_env(process_bundle_descriptor)
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/bundle_processor.py", line 851, in _verify_descriptor_created_in_a_compatible_env
    raise RuntimeError(
RuntimeError: Pipeline construction environment and pipeline runtime environment are not compatible. If you use a custom container image, check that the Python interpreter minor version and the Apache Beam version in your image match the versions used at pipeline construction time. Submission environment: beam:version:sdk_base:apache/beam_python3.11_sdk:2.52.0.dev. Runtime environment: beam:version:sdk_base:apache/beam_python3.11_sdk:2.51.0.dev.

ERROR    apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:208 2023-09-27T16:06:32.788Z: JOB_MESSAGE_ERROR: generic::unknown: Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 297, in _execute
    response = task()
               ^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 372, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 625, in do_instruction
    return getattr(self, request_type)(
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 656, in process_bundle
    bundle_processor = self.bundle_processor_cache.get(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 487, in get
    processor = bundle_processor.BundleProcessor(
                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/bundle_processor.py", line 888, in __init__
    _verify_descriptor_created_in_a_compatible_env(process_bundle_descriptor)
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/bundle_processor.py", line 851, in _verify_descriptor_created_in_a_compatible_env
    raise RuntimeError(
RuntimeError: Pipeline construction environment and pipeline runtime environment are not compatible. If you use a custom container image, check that the Python interpreter minor version and the Apache Beam version in your image match the versions used at pipeline construction time. Submission environment: beam:version:sdk_base:apache/beam_python3.11_sdk:2.52.0.dev. Runtime environment: beam:version:sdk_base:apache/beam_python3.11_sdk:2.51.0.dev.

ERROR    apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:208 2023-09-27T16:07:03.551Z: JOB_MESSAGE_ERROR: generic::unknown: Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 297, in _execute
    response = task()
               ^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 372, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 625, in do_instruction
    return getattr(self, request_type)(
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 656, in process_bundle
    bundle_processor = self.bundle_processor_cache.get(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 487, in get
    processor = bundle_processor.BundleProcessor(
                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/bundle_processor.py", line 888, in __init__
    _verify_descriptor_created_in_a_compatible_env(process_bundle_descriptor)
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/bundle_processor.py", line 851, in _verify_descriptor_created_in_a_compatible_env
    raise RuntimeError(
RuntimeError: Pipeline construction environment and pipeline runtime environment are not compatible. If you use a custom container image, check that the Python interpreter minor version and the Apache Beam version in your image match the versions used at pipeline construction time. Submission environment: beam:version:sdk_base:apache/beam_python3.11_sdk:2.52.0.dev. Runtime environment: beam:version:sdk_base:apache/beam_python3.11_sdk:2.51.0.dev.

ERROR    apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:208 2023-09-27T16:07:34.285Z: JOB_MESSAGE_ERROR: generic::unknown: Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 297, in _execute
    response = task()
               ^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 372, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 625, in do_instruction
    return getattr(self, request_type)(
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 656, in process_bundle
    bundle_processor = self.bundle_processor_cache.get(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 487, in get
    processor = bundle_processor.BundleProcessor(
                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/bundle_processor.py", line 888, in __init__
    _verify_descriptor_created_in_a_compatible_env(process_bundle_descriptor)
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/bundle_processor.py", line 851, in _verify_descriptor_created_in_a_compatible_env
    raise RuntimeError(
RuntimeError: Pipeline construction environment and pipeline runtime environment are not compatible. If you use a custom container image, check that the Python interpreter minor version and the Apache Beam version in your image match the versions used at pipeline construction time. Submission environment: beam:version:sdk_base:apache/beam_python3.11_sdk:2.52.0.dev. Runtime environment: beam:version:sdk_base:apache/beam_python3.11_sdk:2.51.0.dev.

ERROR    apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:208 2023-09-27T16:08:05.043Z: JOB_MESSAGE_ERROR: generic::unknown: Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 297, in _execute
    response = task()
               ^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 372, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 625, in do_instruction
    return getattr(self, request_type)(
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 656, in process_bundle
    bundle_processor = self.bundle_processor_cache.get(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 487, in get
    processor = bundle_processor.BundleProcessor(
                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/bundle_processor.py", line 888, in __init__
    _verify_descriptor_created_in_a_compatible_env(process_bundle_descriptor)
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/bundle_processor.py", line 851, in _verify_descriptor_created_in_a_compatible_env
    raise RuntimeError(
RuntimeError: Pipeline construction environment and pipeline runtime environment are not compatible. If you use a custom container image, check that the Python interpreter minor version and the Apache Beam version in your image match the versions used at pipeline construction time. Submission environment: beam:version:sdk_base:apache/beam_python3.11_sdk:2.52.0.dev. Runtime environment: beam:version:sdk_base:apache/beam_python3.11_sdk:2.51.0.dev.

INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:154 Job 2023-09-27_07_53_27-12835166935194281247 is in state JOB_STATE_CANCELLING
=============================== warnings summary ===============================
../../build/gradleenv/2050596099/lib/python3.11/site-packages/hdfs/config.py:28
../../build/gradleenv/2050596099/lib/python3.11/site-packages/hdfs/config.py:28
../../build/gradleenv/2050596099/lib/python3.11/site-packages/hdfs/config.py:28
../../build/gradleenv/2050596099/lib/python3.11/site-packages/hdfs/config.py:28
../../build/gradleenv/2050596099/lib/python3.11/site-packages/hdfs/config.py:28
../../build/gradleenv/2050596099/lib/python3.11/site-packages/hdfs/config.py:28
../../build/gradleenv/2050596099/lib/python3.11/site-packages/hdfs/config.py:28
../../build/gradleenv/2050596099/lib/python3.11/site-packages/hdfs/config.py:28
../../build/gradleenv/2050596099/lib/python3.11/site-packages/hdfs/config.py:28
  <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/build/gradleenv/2050596099/lib/python3.11/site-packages/hdfs/config.py>:28: DeprecationWarning: the imp module is deprecated in favour of importlib and slated for removal in Python 3.12; see the module's documentation for alternative uses
    from imp import load_source

../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
  <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/build/gradleenv/2050596099/lib/python3.11/site-packages/google/api_core/operations_v1/abstract_operations_client.py>:17: DeprecationWarning: The distutils package is deprecated and slated for removal in Python 3.12. Use setuptools or check PEP 632 for potential alternatives
    from distutils import util

apache_beam/ml/inference/base_test.py::RunInferenceBaseTest::test_run_inference_with_side_inputin_streaming
  <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/sdks/python/apache_beam/ml/inference/base_test.py>:1349: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    test_pipeline.options.view_as(StandardOptions).streaming = True

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/sdks/python/pytest_validatesRunnerStreamingTests-df-py311-xdist.xml> -
=========================== short test summary info ============================
FAILED apache_beam/transforms/ptransform_test.py::PTransformTest::test_flatten_one_single_pcollection - Failed: Timeout >4500.0s
====== 1 failed, 33 passed, 17 skipped, 18 warnings in 5177.71s (1:26:17) ======

> Task :sdks:python:test-suites:dataflow:py311:validatesRunnerStreamingTests FAILED

FAILURE: Build failed with an exception.

* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 253

* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py311:validatesRunnerStreamingTests'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.6.2/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 2h
24 actionable tasks: 18 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://ge.apache.org/s/c5yi26pvf3z76

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Py_VR_Dataflow #11344

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/11344/display/redirect>

Changes:


------------------------------------------
[...truncated 3.32 MB...]
    processor = bundle_processor.BundleProcessor(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py", line 888, in __init__
    _verify_descriptor_created_in_a_compatible_env(process_bundle_descriptor)
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py", line 851, in _verify_descriptor_created_in_a_compatible_env
    raise RuntimeError(
RuntimeError: Pipeline construction environment and pipeline runtime environment are not compatible. If you use a custom container image, check that the Python interpreter minor version and the Apache Beam version in your image match the versions used at pipeline construction time. Submission environment: beam:version:sdk_base:apache/beam_python3.8_sdk:2.52.0.dev. Runtime environment: beam:version:sdk_base:apache/beam_python3.8_sdk:2.51.0.dev.

ERROR    apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:208 2023-09-27T10:32:02.109Z: JOB_MESSAGE_ERROR: generic::unknown: Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 297, in _execute
    response = task()
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 372, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 625, in do_instruction
    return getattr(self, request_type)(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 656, in process_bundle
    bundle_processor = self.bundle_processor_cache.get(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 487, in get
    processor = bundle_processor.BundleProcessor(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py", line 888, in __init__
    _verify_descriptor_created_in_a_compatible_env(process_bundle_descriptor)
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py", line 851, in _verify_descriptor_created_in_a_compatible_env
    raise RuntimeError(
RuntimeError: Pipeline construction environment and pipeline runtime environment are not compatible. If you use a custom container image, check that the Python interpreter minor version and the Apache Beam version in your image match the versions used at pipeline construction time. Submission environment: beam:version:sdk_base:apache/beam_python3.8_sdk:2.52.0.dev. Runtime environment: beam:version:sdk_base:apache/beam_python3.8_sdk:2.51.0.dev.

ERROR    apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:208 2023-09-27T10:32:32.856Z: JOB_MESSAGE_ERROR: generic::unknown: Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 297, in _execute
    response = task()
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 372, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 625, in do_instruction
    return getattr(self, request_type)(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 656, in process_bundle
    bundle_processor = self.bundle_processor_cache.get(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 487, in get
    processor = bundle_processor.BundleProcessor(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py", line 888, in __init__
    _verify_descriptor_created_in_a_compatible_env(process_bundle_descriptor)
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py", line 851, in _verify_descriptor_created_in_a_compatible_env
    raise RuntimeError(
RuntimeError: Pipeline construction environment and pipeline runtime environment are not compatible. If you use a custom container image, check that the Python interpreter minor version and the Apache Beam version in your image match the versions used at pipeline construction time. Submission environment: beam:version:sdk_base:apache/beam_python3.8_sdk:2.52.0.dev. Runtime environment: beam:version:sdk_base:apache/beam_python3.8_sdk:2.51.0.dev.

ERROR    apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:208 2023-09-27T10:33:03.604Z: JOB_MESSAGE_ERROR: generic::unknown: Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 297, in _execute
    response = task()
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 372, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 625, in do_instruction
    return getattr(self, request_type)(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 656, in process_bundle
    bundle_processor = self.bundle_processor_cache.get(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 487, in get
    processor = bundle_processor.BundleProcessor(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py", line 888, in __init__
    _verify_descriptor_created_in_a_compatible_env(process_bundle_descriptor)
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py", line 851, in _verify_descriptor_created_in_a_compatible_env
    raise RuntimeError(
RuntimeError: Pipeline construction environment and pipeline runtime environment are not compatible. If you use a custom container image, check that the Python interpreter minor version and the Apache Beam version in your image match the versions used at pipeline construction time. Submission environment: beam:version:sdk_base:apache/beam_python3.8_sdk:2.52.0.dev. Runtime environment: beam:version:sdk_base:apache/beam_python3.8_sdk:2.51.0.dev.

ERROR    apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:208 2023-09-27T10:33:34.348Z: JOB_MESSAGE_ERROR: generic::unknown: Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 297, in _execute
    response = task()
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 372, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 625, in do_instruction
    return getattr(self, request_type)(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 656, in process_bundle
    bundle_processor = self.bundle_processor_cache.get(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 487, in get
    processor = bundle_processor.BundleProcessor(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py", line 888, in __init__
    _verify_descriptor_created_in_a_compatible_env(process_bundle_descriptor)
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py", line 851, in _verify_descriptor_created_in_a_compatible_env
    raise RuntimeError(
RuntimeError: Pipeline construction environment and pipeline runtime environment are not compatible. If you use a custom container image, check that the Python interpreter minor version and the Apache Beam version in your image match the versions used at pipeline construction time. Submission environment: beam:version:sdk_base:apache/beam_python3.8_sdk:2.52.0.dev. Runtime environment: beam:version:sdk_base:apache/beam_python3.8_sdk:2.51.0.dev.

ERROR    apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:208 2023-09-27T10:34:05.105Z: JOB_MESSAGE_ERROR: generic::unknown: Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 297, in _execute
    response = task()
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 372, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 625, in do_instruction
    return getattr(self, request_type)(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 656, in process_bundle
    bundle_processor = self.bundle_processor_cache.get(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 487, in get
    processor = bundle_processor.BundleProcessor(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py", line 888, in __init__
    _verify_descriptor_created_in_a_compatible_env(process_bundle_descriptor)
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py", line 851, in _verify_descriptor_created_in_a_compatible_env
    raise RuntimeError(
RuntimeError: Pipeline construction environment and pipeline runtime environment are not compatible. If you use a custom container image, check that the Python interpreter minor version and the Apache Beam version in your image match the versions used at pipeline construction time. Submission environment: beam:version:sdk_base:apache/beam_python3.8_sdk:2.52.0.dev. Runtime environment: beam:version:sdk_base:apache/beam_python3.8_sdk:2.51.0.dev.

ERROR    apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:208 2023-09-27T10:34:35.850Z: JOB_MESSAGE_ERROR: generic::unknown: Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 297, in _execute
    response = task()
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 372, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 625, in do_instruction
    return getattr(self, request_type)(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 656, in process_bundle
    bundle_processor = self.bundle_processor_cache.get(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 487, in get
    processor = bundle_processor.BundleProcessor(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py", line 888, in __init__
    _verify_descriptor_created_in_a_compatible_env(process_bundle_descriptor)
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py", line 851, in _verify_descriptor_created_in_a_compatible_env
    raise RuntimeError(
RuntimeError: Pipeline construction environment and pipeline runtime environment are not compatible. If you use a custom container image, check that the Python interpreter minor version and the Apache Beam version in your image match the versions used at pipeline construction time. Submission environment: beam:version:sdk_base:apache/beam_python3.8_sdk:2.52.0.dev. Runtime environment: beam:version:sdk_base:apache/beam_python3.8_sdk:2.51.0.dev.

ERROR    apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:208 2023-09-27T10:35:06.599Z: JOB_MESSAGE_ERROR: generic::unknown: Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 297, in _execute
    response = task()
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 372, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 625, in do_instruction
    return getattr(self, request_type)(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 656, in process_bundle
    bundle_processor = self.bundle_processor_cache.get(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 487, in get
    processor = bundle_processor.BundleProcessor(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py", line 888, in __init__
    _verify_descriptor_created_in_a_compatible_env(process_bundle_descriptor)
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py", line 851, in _verify_descriptor_created_in_a_compatible_env
    raise RuntimeError(
RuntimeError: Pipeline construction environment and pipeline runtime environment are not compatible. If you use a custom container image, check that the Python interpreter minor version and the Apache Beam version in your image match the versions used at pipeline construction time. Submission environment: beam:version:sdk_base:apache/beam_python3.8_sdk:2.52.0.dev. Runtime environment: beam:version:sdk_base:apache/beam_python3.8_sdk:2.51.0.dev.

ERROR    apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:208 2023-09-27T10:35:37.356Z: JOB_MESSAGE_ERROR: generic::unknown: Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 297, in _execute
    response = task()
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 372, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 625, in do_instruction
    return getattr(self, request_type)(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 656, in process_bundle
    bundle_processor = self.bundle_processor_cache.get(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 487, in get
    processor = bundle_processor.BundleProcessor(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py", line 888, in __init__
    _verify_descriptor_created_in_a_compatible_env(process_bundle_descriptor)
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py", line 851, in _verify_descriptor_created_in_a_compatible_env
    raise RuntimeError(
RuntimeError: Pipeline construction environment and pipeline runtime environment are not compatible. If you use a custom container image, check that the Python interpreter minor version and the Apache Beam version in your image match the versions used at pipeline construction time. Submission environment: beam:version:sdk_base:apache/beam_python3.8_sdk:2.52.0.dev. Runtime environment: beam:version:sdk_base:apache/beam_python3.8_sdk:2.51.0.dev.

ERROR    apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:208 2023-09-27T10:36:08.098Z: JOB_MESSAGE_ERROR: generic::unknown: Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 297, in _execute
    response = task()
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 372, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 625, in do_instruction
    return getattr(self, request_type)(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 656, in process_bundle
    bundle_processor = self.bundle_processor_cache.get(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 487, in get
    processor = bundle_processor.BundleProcessor(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py", line 888, in __init__
    _verify_descriptor_created_in_a_compatible_env(process_bundle_descriptor)
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py", line 851, in _verify_descriptor_created_in_a_compatible_env
    raise RuntimeError(
RuntimeError: Pipeline construction environment and pipeline runtime environment are not compatible. If you use a custom container image, check that the Python interpreter minor version and the Apache Beam version in your image match the versions used at pipeline construction time. Submission environment: beam:version:sdk_base:apache/beam_python3.8_sdk:2.52.0.dev. Runtime environment: beam:version:sdk_base:apache/beam_python3.8_sdk:2.51.0.dev.

ERROR    apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:208 2023-09-27T10:36:33.720Z: JOB_MESSAGE_ERROR: generic::unknown: Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 297, in _execute
    response = task()
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 372, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 625, in do_instruction
    return getattr(self, request_type)(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 656, in process_bundle
    bundle_processor = self.bundle_processor_cache.get(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 487, in get
    processor = bundle_processor.BundleProcessor(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py", line 888, in __init__
    _verify_descriptor_created_in_a_compatible_env(process_bundle_descriptor)
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py", line 851, in _verify_descriptor_created_in_a_compatible_env
    raise RuntimeError(
RuntimeError: Pipeline construction environment and pipeline runtime environment are not compatible. If you use a custom container image, check that the Python interpreter minor version and the Apache Beam version in your image match the versions used at pipeline construction time. Submission environment: beam:version:sdk_base:apache/beam_python3.8_sdk:2.52.0.dev. Runtime environment: beam:version:sdk_base:apache/beam_python3.8_sdk:2.51.0.dev.

INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:154 Job 2023-09-27_02_21_53-10142743502836424374 is in state JOB_STATE_CANCELLING
=============================== warnings summary ===============================
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:28
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:28
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:28
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:28
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:28
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:28
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:28
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:28
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:28
  <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py>:28: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

apache_beam/ml/inference/base_test.py::RunInferenceBaseTest::test_run_inference_with_side_inputin_streaming
  <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/sdks/python/apache_beam/ml/inference/base_test.py>:1349: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    test_pipeline.options.view_as(StandardOptions).streaming = True

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/sdks/python/pytest_validatesRunnerStreamingTests-df-py38-xdist.xml> -
=========================== short test summary info ============================
FAILED apache_beam/transforms/util_test.py::ReshuffleTest::test_reshuffle_preserves_timestamps - Failed: Timeout >4500.0s
====== 1 failed, 33 passed, 17 skipped, 10 warnings in 6239.43s (1:43:59) ======

> Task :sdks:python:test-suites:dataflow:py38:validatesRunnerStreamingTests FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 253

* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py311:validatesRunnerStreamingTests'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 253

* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:validatesRunnerStreamingTests'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.6.2/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 2h 20m 28s
24 actionable tasks: 18 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://ge.apache.org/s/evfyb6jfybxes

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Py_VR_Dataflow #11343

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/11343/display/redirect>

Changes:


------------------------------------------
[...truncated 1.71 MB...]
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 487, in get
    processor = bundle_processor.BundleProcessor(
                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/bundle_processor.py", line 888, in __init__
    _verify_descriptor_created_in_a_compatible_env(process_bundle_descriptor)
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/bundle_processor.py", line 851, in _verify_descriptor_created_in_a_compatible_env
    raise RuntimeError(
RuntimeError: Pipeline construction environment and pipeline runtime environment are not compatible. If you use a custom container image, check that the Python interpreter minor version and the Apache Beam version in your image match the versions used at pipeline construction time. Submission environment: beam:version:sdk_base:apache/beam_python3.11_sdk:2.52.0.dev. Runtime environment: beam:version:sdk_base:apache/beam_python3.11_sdk:2.51.0.dev.

ERROR    apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:208 2023-09-27T05:22:58.356Z: JOB_MESSAGE_ERROR: generic::unknown: Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 297, in _execute
    response = task()
               ^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 372, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 625, in do_instruction
    return getattr(self, request_type)(
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 656, in process_bundle
    bundle_processor = self.bundle_processor_cache.get(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 487, in get
    processor = bundle_processor.BundleProcessor(
                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/bundle_processor.py", line 888, in __init__
    _verify_descriptor_created_in_a_compatible_env(process_bundle_descriptor)
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/bundle_processor.py", line 851, in _verify_descriptor_created_in_a_compatible_env
    raise RuntimeError(
RuntimeError: Pipeline construction environment and pipeline runtime environment are not compatible. If you use a custom container image, check that the Python interpreter minor version and the Apache Beam version in your image match the versions used at pipeline construction time. Submission environment: beam:version:sdk_base:apache/beam_python3.11_sdk:2.52.0.dev. Runtime environment: beam:version:sdk_base:apache/beam_python3.11_sdk:2.51.0.dev.

ERROR    apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:208 2023-09-27T05:23:29.101Z: JOB_MESSAGE_ERROR: generic::unknown: Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 297, in _execute
    response = task()
               ^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 372, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 625, in do_instruction
    return getattr(self, request_type)(
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 656, in process_bundle
    bundle_processor = self.bundle_processor_cache.get(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 487, in get
    processor = bundle_processor.BundleProcessor(
                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/bundle_processor.py", line 888, in __init__
    _verify_descriptor_created_in_a_compatible_env(process_bundle_descriptor)
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/bundle_processor.py", line 851, in _verify_descriptor_created_in_a_compatible_env
    raise RuntimeError(
RuntimeError: Pipeline construction environment and pipeline runtime environment are not compatible. If you use a custom container image, check that the Python interpreter minor version and the Apache Beam version in your image match the versions used at pipeline construction time. Submission environment: beam:version:sdk_base:apache/beam_python3.11_sdk:2.52.0.dev. Runtime environment: beam:version:sdk_base:apache/beam_python3.11_sdk:2.51.0.dev.

ERROR    apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:208 2023-09-27T05:23:59.868Z: JOB_MESSAGE_ERROR: generic::unknown: Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 297, in _execute
    response = task()
               ^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 372, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 625, in do_instruction
    return getattr(self, request_type)(
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 656, in process_bundle
    bundle_processor = self.bundle_processor_cache.get(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 487, in get
    processor = bundle_processor.BundleProcessor(
                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/bundle_processor.py", line 888, in __init__
    _verify_descriptor_created_in_a_compatible_env(process_bundle_descriptor)
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/bundle_processor.py", line 851, in _verify_descriptor_created_in_a_compatible_env
    raise RuntimeError(
RuntimeError: Pipeline construction environment and pipeline runtime environment are not compatible. If you use a custom container image, check that the Python interpreter minor version and the Apache Beam version in your image match the versions used at pipeline construction time. Submission environment: beam:version:sdk_base:apache/beam_python3.11_sdk:2.52.0.dev. Runtime environment: beam:version:sdk_base:apache/beam_python3.11_sdk:2.51.0.dev.

ERROR    apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:208 2023-09-27T05:24:30.632Z: JOB_MESSAGE_ERROR: generic::unknown: Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 297, in _execute
    response = task()
               ^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 372, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 625, in do_instruction
    return getattr(self, request_type)(
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 656, in process_bundle
    bundle_processor = self.bundle_processor_cache.get(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 487, in get
    processor = bundle_processor.BundleProcessor(
                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/bundle_processor.py", line 888, in __init__
    _verify_descriptor_created_in_a_compatible_env(process_bundle_descriptor)
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/bundle_processor.py", line 851, in _verify_descriptor_created_in_a_compatible_env
    raise RuntimeError(
RuntimeError: Pipeline construction environment and pipeline runtime environment are not compatible. If you use a custom container image, check that the Python interpreter minor version and the Apache Beam version in your image match the versions used at pipeline construction time. Submission environment: beam:version:sdk_base:apache/beam_python3.11_sdk:2.52.0.dev. Runtime environment: beam:version:sdk_base:apache/beam_python3.11_sdk:2.51.0.dev.

ERROR    apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:208 2023-09-27T05:25:01.376Z: JOB_MESSAGE_ERROR: generic::unknown: Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 297, in _execute
    response = task()
               ^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 372, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 625, in do_instruction
    return getattr(self, request_type)(
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 656, in process_bundle
    bundle_processor = self.bundle_processor_cache.get(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 487, in get
    processor = bundle_processor.BundleProcessor(
                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/bundle_processor.py", line 888, in __init__
    _verify_descriptor_created_in_a_compatible_env(process_bundle_descriptor)
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/bundle_processor.py", line 851, in _verify_descriptor_created_in_a_compatible_env
    raise RuntimeError(
RuntimeError: Pipeline construction environment and pipeline runtime environment are not compatible. If you use a custom container image, check that the Python interpreter minor version and the Apache Beam version in your image match the versions used at pipeline construction time. Submission environment: beam:version:sdk_base:apache/beam_python3.11_sdk:2.52.0.dev. Runtime environment: beam:version:sdk_base:apache/beam_python3.11_sdk:2.51.0.dev.

ERROR    apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:208 2023-09-27T05:25:32.136Z: JOB_MESSAGE_ERROR: generic::unknown: Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 297, in _execute
    response = task()
               ^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 372, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 625, in do_instruction
    return getattr(self, request_type)(
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 656, in process_bundle
    bundle_processor = self.bundle_processor_cache.get(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 487, in get
    processor = bundle_processor.BundleProcessor(
                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/bundle_processor.py", line 888, in __init__
    _verify_descriptor_created_in_a_compatible_env(process_bundle_descriptor)
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/bundle_processor.py", line 851, in _verify_descriptor_created_in_a_compatible_env
    raise RuntimeError(
RuntimeError: Pipeline construction environment and pipeline runtime environment are not compatible. If you use a custom container image, check that the Python interpreter minor version and the Apache Beam version in your image match the versions used at pipeline construction time. Submission environment: beam:version:sdk_base:apache/beam_python3.11_sdk:2.52.0.dev. Runtime environment: beam:version:sdk_base:apache/beam_python3.11_sdk:2.51.0.dev.

ERROR    apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:208 2023-09-27T05:26:02.908Z: JOB_MESSAGE_ERROR: generic::unknown: Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 297, in _execute
    response = task()
               ^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 372, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 625, in do_instruction
    return getattr(self, request_type)(
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 656, in process_bundle
    bundle_processor = self.bundle_processor_cache.get(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 487, in get
    processor = bundle_processor.BundleProcessor(
                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/bundle_processor.py", line 888, in __init__
    _verify_descriptor_created_in_a_compatible_env(process_bundle_descriptor)
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/bundle_processor.py", line 851, in _verify_descriptor_created_in_a_compatible_env
    raise RuntimeError(
RuntimeError: Pipeline construction environment and pipeline runtime environment are not compatible. If you use a custom container image, check that the Python interpreter minor version and the Apache Beam version in your image match the versions used at pipeline construction time. Submission environment: beam:version:sdk_base:apache/beam_python3.11_sdk:2.52.0.dev. Runtime environment: beam:version:sdk_base:apache/beam_python3.11_sdk:2.51.0.dev.

INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:154 Job 2023-09-26_21_11_20-9435840290992026452 is in state JOB_STATE_CANCELLING
=============================== warnings summary ===============================
../../build/gradleenv/2050596099/lib/python3.11/site-packages/hdfs/config.py:28
../../build/gradleenv/2050596099/lib/python3.11/site-packages/hdfs/config.py:28
../../build/gradleenv/2050596099/lib/python3.11/site-packages/hdfs/config.py:28
../../build/gradleenv/2050596099/lib/python3.11/site-packages/hdfs/config.py:28
../../build/gradleenv/2050596099/lib/python3.11/site-packages/hdfs/config.py:28
../../build/gradleenv/2050596099/lib/python3.11/site-packages/hdfs/config.py:28
../../build/gradleenv/2050596099/lib/python3.11/site-packages/hdfs/config.py:28
../../build/gradleenv/2050596099/lib/python3.11/site-packages/hdfs/config.py:28
../../build/gradleenv/2050596099/lib/python3.11/site-packages/hdfs/config.py:28
  <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/build/gradleenv/2050596099/lib/python3.11/site-packages/hdfs/config.py>:28: DeprecationWarning: the imp module is deprecated in favour of importlib and slated for removal in Python 3.12; see the module's documentation for alternative uses
    from imp import load_source

../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
  <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/build/gradleenv/2050596099/lib/python3.11/site-packages/google/api_core/operations_v1/abstract_operations_client.py>:17: DeprecationWarning: The distutils package is deprecated and slated for removal in Python 3.12. Use setuptools or check PEP 632 for potential alternatives
    from distutils import util

apache_beam/ml/inference/base_test.py::RunInferenceBaseTest::test_run_inference_with_side_inputin_streaming
  <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/sdks/python/apache_beam/ml/inference/base_test.py>:1349: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    test_pipeline.options.view_as(StandardOptions).streaming = True

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/sdks/python/pytest_validatesRunnerStreamingTests-df-py311-xdist.xml> -
=========================== short test summary info ============================
FAILED apache_beam/transforms/ptransform_test.py::PTransformTest::test_flatten_one_single_pcollection - Failed: Timeout >4500.0s
FAILED apache_beam/transforms/ptransform_test.py::PTransformTest::test_par_do_with_multiple_outputs_and_using_return - Failed: Timeout >4500.0s
FAILED apache_beam/transforms/sideinputs_test.py::SideInputsTest::test_flattened_side_input - Failed: Timeout >4500.0s
FAILED apache_beam/transforms/ptransform_test.py::PTransformTest::test_flatten_pcollections - Failed: Timeout >4500.0s
====== 4 failed, 30 passed, 17 skipped, 18 warnings in 9425.68s (2:37:05) ======

> Task :sdks:python:test-suites:dataflow:py311:validatesRunnerStreamingTests FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 253

* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:validatesRunnerStreamingTests'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 253

* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py311:validatesRunnerStreamingTests'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.6.2/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 3h 10m 13s
24 actionable tasks: 18 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://ge.apache.org/s/raj7o2tkl7bi4

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Py_VR_Dataflow #11342

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/11342/display/redirect>

Changes:


------------------------------------------
[...truncated 3.48 MB...]
RuntimeError: Pipeline construction environment and pipeline runtime environment are not compatible. If you use a custom container image, check that the Python interpreter minor version and the Apache Beam version in your image match the versions used at pipeline construction time. Submission environment: beam:version:sdk_base:apache/beam_python3.8_sdk:2.52.0.dev. Runtime environment: beam:version:sdk_base:apache/beam_python3.8_sdk:2.51.0.dev.

ERROR    apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:208 2023-09-26T22:42:29.588Z: JOB_MESSAGE_ERROR: generic::unknown: Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 297, in _execute
    response = task()
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 372, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 625, in do_instruction
    return getattr(self, request_type)(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 656, in process_bundle
    bundle_processor = self.bundle_processor_cache.get(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 487, in get
    processor = bundle_processor.BundleProcessor(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py", line 888, in __init__
    _verify_descriptor_created_in_a_compatible_env(process_bundle_descriptor)
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py", line 851, in _verify_descriptor_created_in_a_compatible_env
    raise RuntimeError(
RuntimeError: Pipeline construction environment and pipeline runtime environment are not compatible. If you use a custom container image, check that the Python interpreter minor version and the Apache Beam version in your image match the versions used at pipeline construction time. Submission environment: beam:version:sdk_base:apache/beam_python3.8_sdk:2.52.0.dev. Runtime environment: beam:version:sdk_base:apache/beam_python3.8_sdk:2.51.0.dev.

ERROR    apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:208 2023-09-26T22:43:00.383Z: JOB_MESSAGE_ERROR: generic::unknown: Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 297, in _execute
    response = task()
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 372, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 625, in do_instruction
    return getattr(self, request_type)(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 656, in process_bundle
    bundle_processor = self.bundle_processor_cache.get(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 487, in get
    processor = bundle_processor.BundleProcessor(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py", line 888, in __init__
    _verify_descriptor_created_in_a_compatible_env(process_bundle_descriptor)
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py", line 851, in _verify_descriptor_created_in_a_compatible_env
    raise RuntimeError(
RuntimeError: Pipeline construction environment and pipeline runtime environment are not compatible. If you use a custom container image, check that the Python interpreter minor version and the Apache Beam version in your image match the versions used at pipeline construction time. Submission environment: beam:version:sdk_base:apache/beam_python3.8_sdk:2.52.0.dev. Runtime environment: beam:version:sdk_base:apache/beam_python3.8_sdk:2.51.0.dev.

ERROR    apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:208 2023-09-26T22:43:31.152Z: JOB_MESSAGE_ERROR: generic::unknown: Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 297, in _execute
    response = task()
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 372, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 625, in do_instruction
    return getattr(self, request_type)(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 656, in process_bundle
    bundle_processor = self.bundle_processor_cache.get(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 487, in get
    processor = bundle_processor.BundleProcessor(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py", line 888, in __init__
    _verify_descriptor_created_in_a_compatible_env(process_bundle_descriptor)
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py", line 851, in _verify_descriptor_created_in_a_compatible_env
    raise RuntimeError(
RuntimeError: Pipeline construction environment and pipeline runtime environment are not compatible. If you use a custom container image, check that the Python interpreter minor version and the Apache Beam version in your image match the versions used at pipeline construction time. Submission environment: beam:version:sdk_base:apache/beam_python3.8_sdk:2.52.0.dev. Runtime environment: beam:version:sdk_base:apache/beam_python3.8_sdk:2.51.0.dev.

ERROR    apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:208 2023-09-26T22:44:01.917Z: JOB_MESSAGE_ERROR: generic::unknown: Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 297, in _execute
    response = task()
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 372, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 625, in do_instruction
    return getattr(self, request_type)(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 656, in process_bundle
    bundle_processor = self.bundle_processor_cache.get(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 487, in get
    processor = bundle_processor.BundleProcessor(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py", line 888, in __init__
    _verify_descriptor_created_in_a_compatible_env(process_bundle_descriptor)
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py", line 851, in _verify_descriptor_created_in_a_compatible_env
    raise RuntimeError(
RuntimeError: Pipeline construction environment and pipeline runtime environment are not compatible. If you use a custom container image, check that the Python interpreter minor version and the Apache Beam version in your image match the versions used at pipeline construction time. Submission environment: beam:version:sdk_base:apache/beam_python3.8_sdk:2.52.0.dev. Runtime environment: beam:version:sdk_base:apache/beam_python3.8_sdk:2.51.0.dev.

ERROR    apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:208 2023-09-26T22:44:32.700Z: JOB_MESSAGE_ERROR: generic::unknown: Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 297, in _execute
    response = task()
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 372, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 625, in do_instruction
    return getattr(self, request_type)(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 656, in process_bundle
    bundle_processor = self.bundle_processor_cache.get(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 487, in get
    processor = bundle_processor.BundleProcessor(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py", line 888, in __init__
    _verify_descriptor_created_in_a_compatible_env(process_bundle_descriptor)
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py", line 851, in _verify_descriptor_created_in_a_compatible_env
    raise RuntimeError(
RuntimeError: Pipeline construction environment and pipeline runtime environment are not compatible. If you use a custom container image, check that the Python interpreter minor version and the Apache Beam version in your image match the versions used at pipeline construction time. Submission environment: beam:version:sdk_base:apache/beam_python3.8_sdk:2.52.0.dev. Runtime environment: beam:version:sdk_base:apache/beam_python3.8_sdk:2.51.0.dev.

ERROR    apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:208 2023-09-26T22:45:03.144Z: JOB_MESSAGE_ERROR: generic::unknown: Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 297, in _execute
    response = task()
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 372, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 625, in do_instruction
    return getattr(self, request_type)(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 656, in process_bundle
    bundle_processor = self.bundle_processor_cache.get(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 487, in get
    processor = bundle_processor.BundleProcessor(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py", line 888, in __init__
    _verify_descriptor_created_in_a_compatible_env(process_bundle_descriptor)
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py", line 851, in _verify_descriptor_created_in_a_compatible_env
    raise RuntimeError(
RuntimeError: Pipeline construction environment and pipeline runtime environment are not compatible. If you use a custom container image, check that the Python interpreter minor version and the Apache Beam version in your image match the versions used at pipeline construction time. Submission environment: beam:version:sdk_base:apache/beam_python3.8_sdk:2.52.0.dev. Runtime environment: beam:version:sdk_base:apache/beam_python3.8_sdk:2.51.0.dev.

ERROR    apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:208 2023-09-26T22:45:33.592Z: JOB_MESSAGE_ERROR: generic::unknown: Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 297, in _execute
    response = task()
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 372, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 625, in do_instruction
    return getattr(self, request_type)(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 656, in process_bundle
    bundle_processor = self.bundle_processor_cache.get(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 487, in get
    processor = bundle_processor.BundleProcessor(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py", line 888, in __init__
    _verify_descriptor_created_in_a_compatible_env(process_bundle_descriptor)
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py", line 851, in _verify_descriptor_created_in_a_compatible_env
    raise RuntimeError(
RuntimeError: Pipeline construction environment and pipeline runtime environment are not compatible. If you use a custom container image, check that the Python interpreter minor version and the Apache Beam version in your image match the versions used at pipeline construction time. Submission environment: beam:version:sdk_base:apache/beam_python3.8_sdk:2.52.0.dev. Runtime environment: beam:version:sdk_base:apache/beam_python3.8_sdk:2.51.0.dev.

ERROR    apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:208 2023-09-26T22:46:04.042Z: JOB_MESSAGE_ERROR: generic::unknown: Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 297, in _execute
    response = task()
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 372, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 625, in do_instruction
    return getattr(self, request_type)(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 656, in process_bundle
    bundle_processor = self.bundle_processor_cache.get(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 487, in get
    processor = bundle_processor.BundleProcessor(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py", line 888, in __init__
    _verify_descriptor_created_in_a_compatible_env(process_bundle_descriptor)
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py", line 851, in _verify_descriptor_created_in_a_compatible_env
    raise RuntimeError(
RuntimeError: Pipeline construction environment and pipeline runtime environment are not compatible. If you use a custom container image, check that the Python interpreter minor version and the Apache Beam version in your image match the versions used at pipeline construction time. Submission environment: beam:version:sdk_base:apache/beam_python3.8_sdk:2.52.0.dev. Runtime environment: beam:version:sdk_base:apache/beam_python3.8_sdk:2.51.0.dev.

ERROR    apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:208 2023-09-26T22:46:34.491Z: JOB_MESSAGE_ERROR: generic::unknown: Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 297, in _execute
    response = task()
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 372, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 625, in do_instruction
    return getattr(self, request_type)(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 656, in process_bundle
    bundle_processor = self.bundle_processor_cache.get(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 487, in get
    processor = bundle_processor.BundleProcessor(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py", line 888, in __init__
    _verify_descriptor_created_in_a_compatible_env(process_bundle_descriptor)
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py", line 851, in _verify_descriptor_created_in_a_compatible_env
    raise RuntimeError(
RuntimeError: Pipeline construction environment and pipeline runtime environment are not compatible. If you use a custom container image, check that the Python interpreter minor version and the Apache Beam version in your image match the versions used at pipeline construction time. Submission environment: beam:version:sdk_base:apache/beam_python3.8_sdk:2.52.0.dev. Runtime environment: beam:version:sdk_base:apache/beam_python3.8_sdk:2.51.0.dev.

ERROR    apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:208 2023-09-26T22:47:04.938Z: JOB_MESSAGE_ERROR: generic::unknown: Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 297, in _execute
    response = task()
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 372, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 625, in do_instruction
    return getattr(self, request_type)(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 656, in process_bundle
    bundle_processor = self.bundle_processor_cache.get(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 487, in get
    processor = bundle_processor.BundleProcessor(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py", line 888, in __init__
    _verify_descriptor_created_in_a_compatible_env(process_bundle_descriptor)
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py", line 851, in _verify_descriptor_created_in_a_compatible_env
    raise RuntimeError(
RuntimeError: Pipeline construction environment and pipeline runtime environment are not compatible. If you use a custom container image, check that the Python interpreter minor version and the Apache Beam version in your image match the versions used at pipeline construction time. Submission environment: beam:version:sdk_base:apache/beam_python3.8_sdk:2.52.0.dev. Runtime environment: beam:version:sdk_base:apache/beam_python3.8_sdk:2.51.0.dev.

INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:154 Job 2023-09-26_14_32_33-9576319829738869963 is in state JOB_STATE_CANCELLING
=============================== warnings summary ===============================
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:28
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:28
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:28
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:28
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:28
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:28
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:28
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:28
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:28
  <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py>:28: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

apache_beam/ml/inference/base_test.py::RunInferenceBaseTest::test_run_inference_with_side_inputin_streaming
  <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/sdks/python/apache_beam/ml/inference/base_test.py>:1349: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    test_pipeline.options.view_as(StandardOptions).streaming = True

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/sdks/python/pytest_validatesRunnerStreamingTests-df-py38-xdist.xml> -
=========================== short test summary info ============================
FAILED apache_beam/transforms/ptransform_test.py::PTransformTest::test_flatten_pcollections - Failed: Timeout >4500.0s
FAILED apache_beam/transforms/ptransform_test.py::PTransformTest::test_flatten_a_flattened_pcollection - Failed: Timeout >4500.0s
FAILED apache_beam/transforms/combiners_test.py::CombineValuesTest::test_gbk_immediately_followed_by_combine - Failed: Timeout >4500.0s
FAILED apache_beam/transforms/sideinputs_test.py::SideInputsTest::test_as_dict_twice - Failed: Timeout >4500.0s
FAILED apache_beam/transforms/ptransform_test.py::PTransformTest::test_flatten_multiple_pcollections_having_multiple_consumers - Failed: Timeout >4500.0s
FAILED apache_beam/transforms/ptransform_test.py::PTransformTest::test_par_do_with_multiple_outputs_and_using_return - Failed: Timeout >4500.0s
====== 6 failed, 28 passed, 17 skipped, 10 warnings in 7120.33s (1:58:40) ======

> Task :sdks:python:test-suites:dataflow:py38:validatesRunnerStreamingTests FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 253

* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py311:validatesRunnerStreamingTests'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 253

* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:validatesRunnerStreamingTests'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.6.2/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 2h 39m 24s
24 actionable tasks: 18 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://ge.apache.org/s/yno5sf3dghwem

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Py_VR_Dataflow #11341

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/11341/display/redirect?page=changes>

Changes:

[noreply] Add Load Tests ParDo Dataflow Batch Go workflow (#28450)


------------------------------------------
[...truncated 530.14 KB...]
                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/bundle_processor.py", line 888, in __init__
    _verify_descriptor_created_in_a_compatible_env(process_bundle_descriptor)
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/bundle_processor.py", line 851, in _verify_descriptor_created_in_a_compatible_env
    raise RuntimeError(
RuntimeError: Pipeline construction environment and pipeline runtime environment are not compatible. If you use a custom container image, check that the Python interpreter minor version and the Apache Beam version in your image match the versions used at pipeline construction time. Submission environment: beam:version:sdk_base:apache/beam_python3.11_sdk:2.52.0.dev. Runtime environment: beam:version:sdk_base:apache/beam_python3.11_sdk:2.51.0.dev.

ERROR    apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:208 2023-09-26T16:07:59.633Z: JOB_MESSAGE_ERROR: generic::unknown: Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 297, in _execute
    response = task()
               ^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 372, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 625, in do_instruction
    return getattr(self, request_type)(
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 656, in process_bundle
    bundle_processor = self.bundle_processor_cache.get(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 487, in get
    processor = bundle_processor.BundleProcessor(
                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/bundle_processor.py", line 888, in __init__
    _verify_descriptor_created_in_a_compatible_env(process_bundle_descriptor)
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/bundle_processor.py", line 851, in _verify_descriptor_created_in_a_compatible_env
    raise RuntimeError(
RuntimeError: Pipeline construction environment and pipeline runtime environment are not compatible. If you use a custom container image, check that the Python interpreter minor version and the Apache Beam version in your image match the versions used at pipeline construction time. Submission environment: beam:version:sdk_base:apache/beam_python3.11_sdk:2.52.0.dev. Runtime environment: beam:version:sdk_base:apache/beam_python3.11_sdk:2.51.0.dev.

ERROR    apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:208 2023-09-26T16:08:30.074Z: JOB_MESSAGE_ERROR: generic::unknown: Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 297, in _execute
    response = task()
               ^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 372, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 625, in do_instruction
    return getattr(self, request_type)(
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 656, in process_bundle
    bundle_processor = self.bundle_processor_cache.get(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 487, in get
    processor = bundle_processor.BundleProcessor(
                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/bundle_processor.py", line 888, in __init__
    _verify_descriptor_created_in_a_compatible_env(process_bundle_descriptor)
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/bundle_processor.py", line 851, in _verify_descriptor_created_in_a_compatible_env
    raise RuntimeError(
RuntimeError: Pipeline construction environment and pipeline runtime environment are not compatible. If you use a custom container image, check that the Python interpreter minor version and the Apache Beam version in your image match the versions used at pipeline construction time. Submission environment: beam:version:sdk_base:apache/beam_python3.11_sdk:2.52.0.dev. Runtime environment: beam:version:sdk_base:apache/beam_python3.11_sdk:2.51.0.dev.

ERROR    apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:208 2023-09-26T16:09:00.529Z: JOB_MESSAGE_ERROR: generic::unknown: Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 297, in _execute
    response = task()
               ^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 372, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 625, in do_instruction
    return getattr(self, request_type)(
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 656, in process_bundle
    bundle_processor = self.bundle_processor_cache.get(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 487, in get
    processor = bundle_processor.BundleProcessor(
                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/bundle_processor.py", line 888, in __init__
    _verify_descriptor_created_in_a_compatible_env(process_bundle_descriptor)
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/bundle_processor.py", line 851, in _verify_descriptor_created_in_a_compatible_env
    raise RuntimeError(
RuntimeError: Pipeline construction environment and pipeline runtime environment are not compatible. If you use a custom container image, check that the Python interpreter minor version and the Apache Beam version in your image match the versions used at pipeline construction time. Submission environment: beam:version:sdk_base:apache/beam_python3.11_sdk:2.52.0.dev. Runtime environment: beam:version:sdk_base:apache/beam_python3.11_sdk:2.51.0.dev.

ERROR    apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:208 2023-09-26T16:09:31.112Z: JOB_MESSAGE_ERROR: generic::unknown: Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 297, in _execute
    response = task()
               ^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 372, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 625, in do_instruction
    return getattr(self, request_type)(
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 656, in process_bundle
    bundle_processor = self.bundle_processor_cache.get(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 487, in get
    processor = bundle_processor.BundleProcessor(
                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/bundle_processor.py", line 888, in __init__
    _verify_descriptor_created_in_a_compatible_env(process_bundle_descriptor)
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/bundle_processor.py", line 851, in _verify_descriptor_created_in_a_compatible_env
    raise RuntimeError(
RuntimeError: Pipeline construction environment and pipeline runtime environment are not compatible. If you use a custom container image, check that the Python interpreter minor version and the Apache Beam version in your image match the versions used at pipeline construction time. Submission environment: beam:version:sdk_base:apache/beam_python3.11_sdk:2.52.0.dev. Runtime environment: beam:version:sdk_base:apache/beam_python3.11_sdk:2.51.0.dev.

ERROR    apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:208 2023-09-26T16:09:56.443Z: JOB_MESSAGE_ERROR: generic::unknown: Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 297, in _execute
    response = task()
               ^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 372, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 625, in do_instruction
    return getattr(self, request_type)(
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 656, in process_bundle
    bundle_processor = self.bundle_processor_cache.get(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 487, in get
    processor = bundle_processor.BundleProcessor(
                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/bundle_processor.py", line 888, in __init__
    _verify_descriptor_created_in_a_compatible_env(process_bundle_descriptor)
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/bundle_processor.py", line 851, in _verify_descriptor_created_in_a_compatible_env
    raise RuntimeError(
RuntimeError: Pipeline construction environment and pipeline runtime environment are not compatible. If you use a custom container image, check that the Python interpreter minor version and the Apache Beam version in your image match the versions used at pipeline construction time. Submission environment: beam:version:sdk_base:apache/beam_python3.11_sdk:2.52.0.dev. Runtime environment: beam:version:sdk_base:apache/beam_python3.11_sdk:2.51.0.dev.

INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:154 Job 2023-09-26_07_55_23-9222309041743438361 is in state JOB_STATE_CANCELLING
=============================== warnings summary ===============================
../../build/gradleenv/2050596099/lib/python3.11/site-packages/hdfs/config.py:28
../../build/gradleenv/2050596099/lib/python3.11/site-packages/hdfs/config.py:28
../../build/gradleenv/2050596099/lib/python3.11/site-packages/hdfs/config.py:28
../../build/gradleenv/2050596099/lib/python3.11/site-packages/hdfs/config.py:28
../../build/gradleenv/2050596099/lib/python3.11/site-packages/hdfs/config.py:28
../../build/gradleenv/2050596099/lib/python3.11/site-packages/hdfs/config.py:28
../../build/gradleenv/2050596099/lib/python3.11/site-packages/hdfs/config.py:28
../../build/gradleenv/2050596099/lib/python3.11/site-packages/hdfs/config.py:28
../../build/gradleenv/2050596099/lib/python3.11/site-packages/hdfs/config.py:28
  <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/build/gradleenv/2050596099/lib/python3.11/site-packages/hdfs/config.py>:28: DeprecationWarning: the imp module is deprecated in favour of importlib and slated for removal in Python 3.12; see the module's documentation for alternative uses
    from imp import load_source

../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/rpc/__init__.py:18
../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/rpc/__init__.py:18
../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/rpc/__init__.py:18
../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/rpc/__init__.py:18
../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/rpc/__init__.py:18
../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/rpc/__init__.py:18
../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/rpc/__init__.py:18
../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/rpc/__init__.py:18
../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/rpc/__init__.py:18
  <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/build/gradleenv/2050596099/lib/python3.11/site-packages/google/rpc/__init__.py>:18: DeprecationWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html
    import pkg_resources

../../build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py:2871: 171 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py>:2871: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google')`.
  Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
    declare_namespace(pkg)

../../build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py:2871: 144 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py>:2871: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google.cloud')`.
  Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
    declare_namespace(pkg)

../../build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py:2350: 36 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py>:2350: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google')`.
  Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
    declare_namespace(parent)

../../build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py:2871
  <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py>:2871: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google.logging')`.
  Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
    declare_namespace(pkg)

../../build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py:2871
  <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py>:2871: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google.iam')`.
  Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
    declare_namespace(pkg)

../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/rpc/__init__.py:20
  <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/build/gradleenv/2050596099/lib/python3.11/site-packages/google/rpc/__init__.py>:20: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google.rpc')`.
  Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
    pkg_resources.declare_namespace(__name__)

../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
  <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/build/gradleenv/2050596099/lib/python3.11/site-packages/google/api_core/operations_v1/abstract_operations_client.py>:17: DeprecationWarning: The distutils package is deprecated and slated for removal in Python 3.12. Use setuptools or check PEP 632 for potential alternatives
    from distutils import util

apache_beam/ml/inference/base_test.py::RunInferenceBaseTest::test_run_inference_with_side_inputin_streaming
  <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/sdks/python/apache_beam/ml/inference/base_test.py>:1349: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    test_pipeline.options.view_as(StandardOptions).streaming = True

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/sdks/python/pytest_validatesRunnerStreamingTests-df-py311-xdist.xml> -
=========================== short test summary info ============================
FAILED apache_beam/transforms/dofn_lifecycle_test.py::DoFnLifecycleTest::test_dofn_lifecycle - Failed: Timeout >4500.0s
===== 1 failed, 33 passed, 17 skipped, 405 warnings in 5179.55s (1:26:19) ======

> Task :sdks:python:test-suites:dataflow:py311:validatesRunnerStreamingTests FAILED

FAILURE: Build failed with an exception.

* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 253

* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py311:validatesRunnerStreamingTests'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.6.2/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 2h 1m 58s
24 actionable tasks: 18 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://ge.apache.org/s/y7ijjrk233h7a

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Py_VR_Dataflow #11340

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/11340/display/redirect>

Changes:


------------------------------------------
[...truncated 2.61 MB...]
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py", line 888, in __init__
    _verify_descriptor_created_in_a_compatible_env(process_bundle_descriptor)
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py", line 851, in _verify_descriptor_created_in_a_compatible_env
    raise RuntimeError(
RuntimeError: Pipeline construction environment and pipeline runtime environment are not compatible. If you use a custom container image, check that the Python interpreter minor version and the Apache Beam version in your image match the versions used at pipeline construction time. Submission environment: beam:version:sdk_base:apache/beam_python3.8_sdk:2.52.0.dev. Runtime environment: beam:version:sdk_base:apache/beam_python3.8_sdk:2.51.0.dev.

ERROR    apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:208 2023-09-26T10:36:01.896Z: JOB_MESSAGE_ERROR: generic::unknown: Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 297, in _execute
    response = task()
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 372, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 625, in do_instruction
    return getattr(self, request_type)(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 656, in process_bundle
    bundle_processor = self.bundle_processor_cache.get(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 487, in get
    processor = bundle_processor.BundleProcessor(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py", line 888, in __init__
    _verify_descriptor_created_in_a_compatible_env(process_bundle_descriptor)
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py", line 851, in _verify_descriptor_created_in_a_compatible_env
    raise RuntimeError(
RuntimeError: Pipeline construction environment and pipeline runtime environment are not compatible. If you use a custom container image, check that the Python interpreter minor version and the Apache Beam version in your image match the versions used at pipeline construction time. Submission environment: beam:version:sdk_base:apache/beam_python3.8_sdk:2.52.0.dev. Runtime environment: beam:version:sdk_base:apache/beam_python3.8_sdk:2.51.0.dev.

ERROR    apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:208 2023-09-26T10:36:32.636Z: JOB_MESSAGE_ERROR: generic::unknown: Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 297, in _execute
    response = task()
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 372, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 625, in do_instruction
    return getattr(self, request_type)(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 656, in process_bundle
    bundle_processor = self.bundle_processor_cache.get(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 487, in get
    processor = bundle_processor.BundleProcessor(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py", line 888, in __init__
    _verify_descriptor_created_in_a_compatible_env(process_bundle_descriptor)
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py", line 851, in _verify_descriptor_created_in_a_compatible_env
    raise RuntimeError(
RuntimeError: Pipeline construction environment and pipeline runtime environment are not compatible. If you use a custom container image, check that the Python interpreter minor version and the Apache Beam version in your image match the versions used at pipeline construction time. Submission environment: beam:version:sdk_base:apache/beam_python3.8_sdk:2.52.0.dev. Runtime environment: beam:version:sdk_base:apache/beam_python3.8_sdk:2.51.0.dev.

ERROR    apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:208 2023-09-26T10:37:03.373Z: JOB_MESSAGE_ERROR: generic::unknown: Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 297, in _execute
    response = task()
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 372, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 625, in do_instruction
    return getattr(self, request_type)(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 656, in process_bundle
    bundle_processor = self.bundle_processor_cache.get(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 487, in get
    processor = bundle_processor.BundleProcessor(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py", line 888, in __init__
    _verify_descriptor_created_in_a_compatible_env(process_bundle_descriptor)
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py", line 851, in _verify_descriptor_created_in_a_compatible_env
    raise RuntimeError(
RuntimeError: Pipeline construction environment and pipeline runtime environment are not compatible. If you use a custom container image, check that the Python interpreter minor version and the Apache Beam version in your image match the versions used at pipeline construction time. Submission environment: beam:version:sdk_base:apache/beam_python3.8_sdk:2.52.0.dev. Runtime environment: beam:version:sdk_base:apache/beam_python3.8_sdk:2.51.0.dev.

ERROR    apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:208 2023-09-26T10:37:29.021Z: JOB_MESSAGE_ERROR: generic::unknown: Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 297, in _execute
    response = task()
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 372, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 625, in do_instruction
    return getattr(self, request_type)(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 656, in process_bundle
    bundle_processor = self.bundle_processor_cache.get(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 487, in get
    processor = bundle_processor.BundleProcessor(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py", line 888, in __init__
    _verify_descriptor_created_in_a_compatible_env(process_bundle_descriptor)
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py", line 851, in _verify_descriptor_created_in_a_compatible_env
    raise RuntimeError(
RuntimeError: Pipeline construction environment and pipeline runtime environment are not compatible. If you use a custom container image, check that the Python interpreter minor version and the Apache Beam version in your image match the versions used at pipeline construction time. Submission environment: beam:version:sdk_base:apache/beam_python3.8_sdk:2.52.0.dev. Runtime environment: beam:version:sdk_base:apache/beam_python3.8_sdk:2.51.0.dev.

WARNING  apache_beam.utils.retry:retry.py:290 Retry with exponential backoff: waiting for 4.764451808382166 seconds before retrying list_messages because we caught exception: AttributeError: 'NoneType' object has no attribute 'readline'
 Traceback for above exception (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/sdks/python/apache_beam/utils/retry.py",> line 275, in wrapper
    return fun(*args, **kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/sdks/python/apache_beam/runners/dataflow/internal/apiclient.py",> line 1000, in list_messages
    response = self._client.projects_locations_jobs_messages.List(request)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/sdks/python/apache_beam/runners/dataflow/internal/clients/dataflow/dataflow_v1b3_client.py",> line 550, in List
    return self._RunMethod(config, request, global_params=global_params)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/apitools/base/py/base_api.py",> line 728, in _RunMethod
    http_response = http_wrapper.MakeRequest(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/apitools/base/py/http_wrapper.py",> line 359, in MakeRequest
    retry_func(ExceptionRetryArgs(http, http_request, e, retry,
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/apitools/base/py/http_wrapper.py",> line 304, in HandleExceptionsAndRebuildHttpConnections
    raise retry_args.exc
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/apitools/base/py/http_wrapper.py",> line 348, in MakeRequest
    return _MakeRequestNoRetry(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/apitools/base/py/http_wrapper.py",> line 397, in _MakeRequestNoRetry
    info, content = http.request(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/google_auth_httplib2.py",> line 218, in request
    response, content = self.http.request(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/httplib2/__init__.py",> line 1724, in request
    (response, content) = self._request(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/httplib2/__init__.py",> line 1444, in _request
    (response, content) = self._conn_request(conn, request_uri, method, body, headers)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/httplib2/__init__.py",> line 1425, in _conn_request
    content = response.read()
  File "/usr/lib/python3.8/http/client.py", line 466, in read
    return self._readall_chunked()
  File "/usr/lib/python3.8/http/client.py", line 573, in _readall_chunked
    chunk_left = self._get_chunk_left()
  File "/usr/lib/python3.8/http/client.py", line 561, in _get_chunk_left
    self._read_and_discard_trailer()
  File "/usr/lib/python3.8/http/client.py", line 534, in _read_and_discard_trailer
    line = self.fp.readline(_MAXLINE + 1)

INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:154 Job 2023-09-26_02_22_58-2895954632450973446 is in state JOB_STATE_CANCELLING
=============================== warnings summary ===============================
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:28
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:28
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:28
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:28
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:28
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:28
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:28
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:28
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:28
  <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py>:28: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

../../build/gradleenv/-1734967051/lib/python3.8/site-packages/google/rpc/__init__.py:18
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/google/rpc/__init__.py:18
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/google/rpc/__init__.py:18
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/google/rpc/__init__.py:18
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/google/rpc/__init__.py:18
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/google/rpc/__init__.py:18
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/google/rpc/__init__.py:18
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/google/rpc/__init__.py:18
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/google/rpc/__init__.py:18
  <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/google/rpc/__init__.py>:18: DeprecationWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html
    import pkg_resources

../../build/gradleenv/-1734967051/lib/python3.8/site-packages/pkg_resources/__init__.py:2871: 171 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/pkg_resources/__init__.py>:2871: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google')`.
  Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
    declare_namespace(pkg)

../../build/gradleenv/-1734967051/lib/python3.8/site-packages/pkg_resources/__init__.py:2871: 144 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/pkg_resources/__init__.py>:2871: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google.cloud')`.
  Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
    declare_namespace(pkg)

../../build/gradleenv/-1734967051/lib/python3.8/site-packages/pkg_resources/__init__.py:2350: 36 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/pkg_resources/__init__.py>:2350: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google')`.
  Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
    declare_namespace(parent)

../../build/gradleenv/-1734967051/lib/python3.8/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/pkg_resources/__init__.py:2871
  <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/pkg_resources/__init__.py>:2871: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google.logging')`.
  Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
    declare_namespace(pkg)

../../build/gradleenv/-1734967051/lib/python3.8/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/pkg_resources/__init__.py:2871
  <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/pkg_resources/__init__.py>:2871: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google.iam')`.
  Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
    declare_namespace(pkg)

../../build/gradleenv/-1734967051/lib/python3.8/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/google/rpc/__init__.py:20
  <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/google/rpc/__init__.py>:20: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google.rpc')`.
  Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
    pkg_resources.declare_namespace(__name__)

apache_beam/ml/inference/base_test.py::RunInferenceBaseTest::test_run_inference_with_side_inputin_streaming
  <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/sdks/python/apache_beam/ml/inference/base_test.py>:1349: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    test_pipeline.options.view_as(StandardOptions).streaming = True

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/sdks/python/pytest_validatesRunnerStreamingTests-df-py38-xdist.xml> -
=========================== short test summary info ============================
FAILED apache_beam/runners/portability/fn_api_runner/translations_test.py::TranslationsTest::test_run_packable_combine_limit - Failed: Timeout >4500.0s
FAILED apache_beam/transforms/sideinputs_test.py::SideInputsTest::test_empty_singleton_side_input - Failed: Timeout >4500.0s
FAILED apache_beam/transforms/sideinputs_test.py::SideInputsTest::test_flattened_side_input - Failed: Timeout >4500.0s
===== 3 failed, 31 passed, 17 skipped, 397 warnings in 6173.39s (1:42:53) ======

> Task :sdks:python:test-suites:dataflow:py38:validatesRunnerStreamingTests FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 253

* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py311:validatesRunnerStreamingTests'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 253

* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:validatesRunnerStreamingTests'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.6.2/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 2h 21m 33s
24 actionable tasks: 18 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://ge.apache.org/s/3vemxdge2ispe

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


beam_PostCommit_Py_VR_Dataflow - Build # 11339 - Aborted!

Posted by Apache Jenkins Server <je...@builds.apache.org>.
beam_PostCommit_Py_VR_Dataflow - Build # 11339 - Aborted:

Check console output at https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/11339/ to view the results.

Build failed in Jenkins: beam_PostCommit_Py_VR_Dataflow #11338

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/11338/display/redirect>

Changes:


------------------------------------------
[...truncated 1.06 MB...]
    processor = bundle_processor.BundleProcessor(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py", line 888, in __init__
    _verify_descriptor_created_in_a_compatible_env(process_bundle_descriptor)
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py", line 851, in _verify_descriptor_created_in_a_compatible_env
    raise RuntimeError(
RuntimeError: Pipeline construction environment and pipeline runtime environment are not compatible. If you use a custom container image, check that the Python interpreter minor version and the Apache Beam version in your image match the versions used at pipeline construction time. Submission environment: beam:version:sdk_base:apache/beam_python3.8_sdk:2.52.0.dev. Runtime environment: beam:version:sdk_base:apache/beam_python3.8_sdk:2.51.0.dev.

ERROR    apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:208 2023-09-25T22:34:27.142Z: JOB_MESSAGE_ERROR: generic::unknown: Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 297, in _execute
    response = task()
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 372, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 625, in do_instruction
    return getattr(self, request_type)(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 656, in process_bundle
    bundle_processor = self.bundle_processor_cache.get(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 487, in get
    processor = bundle_processor.BundleProcessor(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py", line 888, in __init__
    _verify_descriptor_created_in_a_compatible_env(process_bundle_descriptor)
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py", line 851, in _verify_descriptor_created_in_a_compatible_env
    raise RuntimeError(
RuntimeError: Pipeline construction environment and pipeline runtime environment are not compatible. If you use a custom container image, check that the Python interpreter minor version and the Apache Beam version in your image match the versions used at pipeline construction time. Submission environment: beam:version:sdk_base:apache/beam_python3.8_sdk:2.52.0.dev. Runtime environment: beam:version:sdk_base:apache/beam_python3.8_sdk:2.51.0.dev.

ERROR    apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:208 2023-09-25T22:34:57.903Z: JOB_MESSAGE_ERROR: generic::unknown: Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 297, in _execute
    response = task()
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 372, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 625, in do_instruction
    return getattr(self, request_type)(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 656, in process_bundle
    bundle_processor = self.bundle_processor_cache.get(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 487, in get
    processor = bundle_processor.BundleProcessor(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py", line 888, in __init__
    _verify_descriptor_created_in_a_compatible_env(process_bundle_descriptor)
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py", line 851, in _verify_descriptor_created_in_a_compatible_env
    raise RuntimeError(
RuntimeError: Pipeline construction environment and pipeline runtime environment are not compatible. If you use a custom container image, check that the Python interpreter minor version and the Apache Beam version in your image match the versions used at pipeline construction time. Submission environment: beam:version:sdk_base:apache/beam_python3.8_sdk:2.52.0.dev. Runtime environment: beam:version:sdk_base:apache/beam_python3.8_sdk:2.51.0.dev.

ERROR    apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:208 2023-09-25T22:35:28.698Z: JOB_MESSAGE_ERROR: generic::unknown: Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 297, in _execute
    response = task()
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 372, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 625, in do_instruction
    return getattr(self, request_type)(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 656, in process_bundle
    bundle_processor = self.bundle_processor_cache.get(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 487, in get
    processor = bundle_processor.BundleProcessor(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py", line 888, in __init__
    _verify_descriptor_created_in_a_compatible_env(process_bundle_descriptor)
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py", line 851, in _verify_descriptor_created_in_a_compatible_env
    raise RuntimeError(
RuntimeError: Pipeline construction environment and pipeline runtime environment are not compatible. If you use a custom container image, check that the Python interpreter minor version and the Apache Beam version in your image match the versions used at pipeline construction time. Submission environment: beam:version:sdk_base:apache/beam_python3.8_sdk:2.52.0.dev. Runtime environment: beam:version:sdk_base:apache/beam_python3.8_sdk:2.51.0.dev.

ERROR    apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:208 2023-09-25T22:35:59.491Z: JOB_MESSAGE_ERROR: generic::unknown: Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 297, in _execute
    response = task()
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 372, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 625, in do_instruction
    return getattr(self, request_type)(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 656, in process_bundle
    bundle_processor = self.bundle_processor_cache.get(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 487, in get
    processor = bundle_processor.BundleProcessor(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py", line 888, in __init__
    _verify_descriptor_created_in_a_compatible_env(process_bundle_descriptor)
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py", line 851, in _verify_descriptor_created_in_a_compatible_env
    raise RuntimeError(
RuntimeError: Pipeline construction environment and pipeline runtime environment are not compatible. If you use a custom container image, check that the Python interpreter minor version and the Apache Beam version in your image match the versions used at pipeline construction time. Submission environment: beam:version:sdk_base:apache/beam_python3.8_sdk:2.52.0.dev. Runtime environment: beam:version:sdk_base:apache/beam_python3.8_sdk:2.51.0.dev.

ERROR    apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:208 2023-09-25T22:36:30.392Z: JOB_MESSAGE_ERROR: generic::unknown: Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 297, in _execute
    response = task()
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 372, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 625, in do_instruction
    return getattr(self, request_type)(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 656, in process_bundle
    bundle_processor = self.bundle_processor_cache.get(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 487, in get
    processor = bundle_processor.BundleProcessor(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py", line 888, in __init__
    _verify_descriptor_created_in_a_compatible_env(process_bundle_descriptor)
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py", line 851, in _verify_descriptor_created_in_a_compatible_env
    raise RuntimeError(
RuntimeError: Pipeline construction environment and pipeline runtime environment are not compatible. If you use a custom container image, check that the Python interpreter minor version and the Apache Beam version in your image match the versions used at pipeline construction time. Submission environment: beam:version:sdk_base:apache/beam_python3.8_sdk:2.52.0.dev. Runtime environment: beam:version:sdk_base:apache/beam_python3.8_sdk:2.51.0.dev.

ERROR    apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:208 2023-09-25T22:37:01.178Z: JOB_MESSAGE_ERROR: generic::unknown: Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 297, in _execute
    response = task()
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 372, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 625, in do_instruction
    return getattr(self, request_type)(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 656, in process_bundle
    bundle_processor = self.bundle_processor_cache.get(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 487, in get
    processor = bundle_processor.BundleProcessor(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py", line 888, in __init__
    _verify_descriptor_created_in_a_compatible_env(process_bundle_descriptor)
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py", line 851, in _verify_descriptor_created_in_a_compatible_env
    raise RuntimeError(
RuntimeError: Pipeline construction environment and pipeline runtime environment are not compatible. If you use a custom container image, check that the Python interpreter minor version and the Apache Beam version in your image match the versions used at pipeline construction time. Submission environment: beam:version:sdk_base:apache/beam_python3.8_sdk:2.52.0.dev. Runtime environment: beam:version:sdk_base:apache/beam_python3.8_sdk:2.51.0.dev.

ERROR    apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:208 2023-09-25T22:37:31.961Z: JOB_MESSAGE_ERROR: generic::unknown: Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 297, in _execute
    response = task()
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 372, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 625, in do_instruction
    return getattr(self, request_type)(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 656, in process_bundle
    bundle_processor = self.bundle_processor_cache.get(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 487, in get
    processor = bundle_processor.BundleProcessor(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py", line 888, in __init__
    _verify_descriptor_created_in_a_compatible_env(process_bundle_descriptor)
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py", line 851, in _verify_descriptor_created_in_a_compatible_env
    raise RuntimeError(
RuntimeError: Pipeline construction environment and pipeline runtime environment are not compatible. If you use a custom container image, check that the Python interpreter minor version and the Apache Beam version in your image match the versions used at pipeline construction time. Submission environment: beam:version:sdk_base:apache/beam_python3.8_sdk:2.52.0.dev. Runtime environment: beam:version:sdk_base:apache/beam_python3.8_sdk:2.51.0.dev.

INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:154 Job 2023-09-25_14_23_02-4413790141993472506 is in state JOB_STATE_CANCELLING
=============================== warnings summary ===============================
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:28
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:28
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:28
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:28
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:28
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:28
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:28
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:28
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:28
  <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py>:28: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

../../build/gradleenv/-1734967051/lib/python3.8/site-packages/google/rpc/__init__.py:18
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/google/rpc/__init__.py:18
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/google/rpc/__init__.py:18
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/google/rpc/__init__.py:18
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/google/rpc/__init__.py:18
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/google/rpc/__init__.py:18
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/google/rpc/__init__.py:18
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/google/rpc/__init__.py:18
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/google/rpc/__init__.py:18
  <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/google/rpc/__init__.py>:18: DeprecationWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html
    import pkg_resources

../../build/gradleenv/-1734967051/lib/python3.8/site-packages/pkg_resources/__init__.py:2871: 171 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/pkg_resources/__init__.py>:2871: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google')`.
  Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
    declare_namespace(pkg)

../../build/gradleenv/-1734967051/lib/python3.8/site-packages/pkg_resources/__init__.py:2871: 144 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/pkg_resources/__init__.py>:2871: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google.cloud')`.
  Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
    declare_namespace(pkg)

../../build/gradleenv/-1734967051/lib/python3.8/site-packages/pkg_resources/__init__.py:2350: 36 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/pkg_resources/__init__.py>:2350: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google')`.
  Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
    declare_namespace(parent)

../../build/gradleenv/-1734967051/lib/python3.8/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/pkg_resources/__init__.py:2871
  <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/pkg_resources/__init__.py>:2871: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google.logging')`.
  Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
    declare_namespace(pkg)

../../build/gradleenv/-1734967051/lib/python3.8/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/pkg_resources/__init__.py:2871
  <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/pkg_resources/__init__.py>:2871: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google.iam')`.
  Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
    declare_namespace(pkg)

../../build/gradleenv/-1734967051/lib/python3.8/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/google/rpc/__init__.py:20
  <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/google/rpc/__init__.py>:20: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google.rpc')`.
  Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
    pkg_resources.declare_namespace(__name__)

apache_beam/ml/inference/base_test.py::RunInferenceBaseTest::test_run_inference_with_side_inputin_streaming
  <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/sdks/python/apache_beam/ml/inference/base_test.py>:1349: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    test_pipeline.options.view_as(StandardOptions).streaming = True

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/sdks/python/pytest_validatesRunnerStreamingTests-df-py38-xdist.xml> -
=========================== short test summary info ============================
FAILED apache_beam/ml/inference/base_test.py::RunInferenceBaseTest::test_run_inference_with_side_inputin_streaming - Failed: Timeout >4500.0s
FAILED apache_beam/pipeline_test.py::DoFnTest::test_key_param - Failed: Timeout >4500.0s
FAILED apache_beam/transforms/sideinputs_test.py::SideInputsTest::test_default_value_singleton_side_input - Failed: Timeout >4500.0s
===== 3 failed, 31 passed, 17 skipped, 397 warnings in 6180.60s (1:43:00) ======

> Task :sdks:python:test-suites:dataflow:py38:validatesRunnerStreamingTests FAILED

FAILURE: Build failed with an exception.

* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 253

* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:validatesRunnerStreamingTests'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.6.2/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 2h 21m 38s
24 actionable tasks: 18 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://ge.apache.org/s/nbq445jpsykje

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Py_VR_Dataflow #11337

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/11337/display/redirect?page=changes>

Changes:

[noreply] Bump github.com/aws/aws-sdk-go-v2/config in /sdks (#28639)


------------------------------------------
[...truncated 1.76 MB...]
    bundle_processor = self.bundle_processor_cache.get(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 487, in get
    processor = bundle_processor.BundleProcessor(
                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/bundle_processor.py", line 888, in __init__
    _verify_descriptor_created_in_a_compatible_env(process_bundle_descriptor)
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/bundle_processor.py", line 851, in _verify_descriptor_created_in_a_compatible_env
    raise RuntimeError(
RuntimeError: Pipeline construction environment and pipeline runtime environment are not compatible. If you use a custom container image, check that the Python interpreter minor version and the Apache Beam version in your image match the versions used at pipeline construction time. Submission environment: beam:version:sdk_base:apache/beam_python3.11_sdk:2.52.0.dev. Runtime environment: beam:version:sdk_base:apache/beam_python3.11_sdk:2.51.0.dev.

ERROR    apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:208 2023-09-25T16:34:08.342Z: JOB_MESSAGE_ERROR: generic::unknown: Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 297, in _execute
    response = task()
               ^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 372, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 625, in do_instruction
    return getattr(self, request_type)(
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 656, in process_bundle
    bundle_processor = self.bundle_processor_cache.get(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 487, in get
    processor = bundle_processor.BundleProcessor(
                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/bundle_processor.py", line 888, in __init__
    _verify_descriptor_created_in_a_compatible_env(process_bundle_descriptor)
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/bundle_processor.py", line 851, in _verify_descriptor_created_in_a_compatible_env
    raise RuntimeError(
RuntimeError: Pipeline construction environment and pipeline runtime environment are not compatible. If you use a custom container image, check that the Python interpreter minor version and the Apache Beam version in your image match the versions used at pipeline construction time. Submission environment: beam:version:sdk_base:apache/beam_python3.11_sdk:2.52.0.dev. Runtime environment: beam:version:sdk_base:apache/beam_python3.11_sdk:2.51.0.dev.

ERROR    apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:208 2023-09-25T16:34:39.077Z: JOB_MESSAGE_ERROR: generic::unknown: Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 297, in _execute
    response = task()
               ^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 372, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 625, in do_instruction
    return getattr(self, request_type)(
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 656, in process_bundle
    bundle_processor = self.bundle_processor_cache.get(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 487, in get
    processor = bundle_processor.BundleProcessor(
                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/bundle_processor.py", line 888, in __init__
    _verify_descriptor_created_in_a_compatible_env(process_bundle_descriptor)
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/bundle_processor.py", line 851, in _verify_descriptor_created_in_a_compatible_env
    raise RuntimeError(
RuntimeError: Pipeline construction environment and pipeline runtime environment are not compatible. If you use a custom container image, check that the Python interpreter minor version and the Apache Beam version in your image match the versions used at pipeline construction time. Submission environment: beam:version:sdk_base:apache/beam_python3.11_sdk:2.52.0.dev. Runtime environment: beam:version:sdk_base:apache/beam_python3.11_sdk:2.51.0.dev.

ERROR    apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:208 2023-09-25T16:35:09.824Z: JOB_MESSAGE_ERROR: generic::unknown: Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 297, in _execute
    response = task()
               ^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 372, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 625, in do_instruction
    return getattr(self, request_type)(
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 656, in process_bundle
    bundle_processor = self.bundle_processor_cache.get(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 487, in get
    processor = bundle_processor.BundleProcessor(
                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/bundle_processor.py", line 888, in __init__
    _verify_descriptor_created_in_a_compatible_env(process_bundle_descriptor)
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/bundle_processor.py", line 851, in _verify_descriptor_created_in_a_compatible_env
    raise RuntimeError(
RuntimeError: Pipeline construction environment and pipeline runtime environment are not compatible. If you use a custom container image, check that the Python interpreter minor version and the Apache Beam version in your image match the versions used at pipeline construction time. Submission environment: beam:version:sdk_base:apache/beam_python3.11_sdk:2.52.0.dev. Runtime environment: beam:version:sdk_base:apache/beam_python3.11_sdk:2.51.0.dev.

ERROR    apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:208 2023-09-25T16:35:35.457Z: JOB_MESSAGE_ERROR: generic::unknown: Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 297, in _execute
    response = task()
               ^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 372, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 625, in do_instruction
    return getattr(self, request_type)(
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 656, in process_bundle
    bundle_processor = self.bundle_processor_cache.get(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 487, in get
    processor = bundle_processor.BundleProcessor(
                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/bundle_processor.py", line 888, in __init__
    _verify_descriptor_created_in_a_compatible_env(process_bundle_descriptor)
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/bundle_processor.py", line 851, in _verify_descriptor_created_in_a_compatible_env
    raise RuntimeError(
RuntimeError: Pipeline construction environment and pipeline runtime environment are not compatible. If you use a custom container image, check that the Python interpreter minor version and the Apache Beam version in your image match the versions used at pipeline construction time. Submission environment: beam:version:sdk_base:apache/beam_python3.11_sdk:2.52.0.dev. Runtime environment: beam:version:sdk_base:apache/beam_python3.11_sdk:2.51.0.dev.

INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:154 Job 2023-09-25_08_20_46-8639462308391750753 is in state JOB_STATE_CANCELLING
=============================== warnings summary ===============================
../../build/gradleenv/2050596099/lib/python3.11/site-packages/hdfs/config.py:28
../../build/gradleenv/2050596099/lib/python3.11/site-packages/hdfs/config.py:28
../../build/gradleenv/2050596099/lib/python3.11/site-packages/hdfs/config.py:28
../../build/gradleenv/2050596099/lib/python3.11/site-packages/hdfs/config.py:28
../../build/gradleenv/2050596099/lib/python3.11/site-packages/hdfs/config.py:28
../../build/gradleenv/2050596099/lib/python3.11/site-packages/hdfs/config.py:28
../../build/gradleenv/2050596099/lib/python3.11/site-packages/hdfs/config.py:28
../../build/gradleenv/2050596099/lib/python3.11/site-packages/hdfs/config.py:28
../../build/gradleenv/2050596099/lib/python3.11/site-packages/hdfs/config.py:28
  <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/build/gradleenv/2050596099/lib/python3.11/site-packages/hdfs/config.py>:28: DeprecationWarning: the imp module is deprecated in favour of importlib and slated for removal in Python 3.12; see the module's documentation for alternative uses
    from imp import load_source

../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/rpc/__init__.py:18
../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/rpc/__init__.py:18
../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/rpc/__init__.py:18
../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/rpc/__init__.py:18
../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/rpc/__init__.py:18
../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/rpc/__init__.py:18
../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/rpc/__init__.py:18
../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/rpc/__init__.py:18
../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/rpc/__init__.py:18
  <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/build/gradleenv/2050596099/lib/python3.11/site-packages/google/rpc/__init__.py>:18: DeprecationWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html
    import pkg_resources

../../build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py:2871: 171 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py>:2871: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google')`.
  Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
    declare_namespace(pkg)

../../build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py:2871: 144 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py>:2871: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google.cloud')`.
  Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
    declare_namespace(pkg)

../../build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py:2350: 36 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py>:2350: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google')`.
  Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
    declare_namespace(parent)

../../build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py:2871
  <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py>:2871: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google.logging')`.
  Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
    declare_namespace(pkg)

../../build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py:2871
  <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py>:2871: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google.iam')`.
  Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
    declare_namespace(pkg)

../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/rpc/__init__.py:20
  <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/build/gradleenv/2050596099/lib/python3.11/site-packages/google/rpc/__init__.py>:20: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google.rpc')`.
  Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
    pkg_resources.declare_namespace(__name__)

../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
  <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/build/gradleenv/2050596099/lib/python3.11/site-packages/google/api_core/operations_v1/abstract_operations_client.py>:17: DeprecationWarning: The distutils package is deprecated and slated for removal in Python 3.12. Use setuptools or check PEP 632 for potential alternatives
    from distutils import util

apache_beam/ml/inference/base_test.py::RunInferenceBaseTest::test_run_inference_with_side_inputin_streaming
  <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/sdks/python/apache_beam/ml/inference/base_test.py>:1349: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    test_pipeline.options.view_as(StandardOptions).streaming = True

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/sdks/python/pytest_validatesRunnerStreamingTests-df-py311-xdist.xml> -
=========================== short test summary info ============================
FAILED apache_beam/runners/portability/fn_api_runner/translations_test.py::TranslationsTest::test_run_packable_combine_limit - Failed: Timeout >4500.0s
FAILED apache_beam/transforms/sideinputs_test.py::SideInputsTest::test_iterable_side_input - Failed: Timeout >4500.0s
===== 2 failed, 32 passed, 17 skipped, 405 warnings in 6210.77s (1:43:30) ======

> Task :sdks:python:test-suites:dataflow:py311:validatesRunnerStreamingTests FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 253

* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:validatesRunnerStreamingTests'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 253

* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py311:validatesRunnerStreamingTests'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.6.2/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 2h 19m 25s
24 actionable tasks: 18 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://ge.apache.org/s/pzayqgczs2gek

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Py_VR_Dataflow #11336

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/11336/display/redirect>

Changes:


------------------------------------------
[...truncated 1.45 MB...]
    bundle_processor = self.bundle_processor_cache.get(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 487, in get
    processor = bundle_processor.BundleProcessor(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py", line 888, in __init__
    _verify_descriptor_created_in_a_compatible_env(process_bundle_descriptor)
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py", line 851, in _verify_descriptor_created_in_a_compatible_env
    raise RuntimeError(
RuntimeError: Pipeline construction environment and pipeline runtime environment are not compatible. If you use a custom container image, check that the Python interpreter minor version and the Apache Beam version in your image match the versions used at pipeline construction time. Submission environment: beam:version:sdk_base:apache/beam_python3.8_sdk:2.52.0.dev. Runtime environment: beam:version:sdk_base:apache/beam_python3.8_sdk:2.51.0.dev.

ERROR    apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:208 2023-09-25T10:08:32.677Z: JOB_MESSAGE_ERROR: generic::unknown: Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 297, in _execute
    response = task()
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 372, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 625, in do_instruction
    return getattr(self, request_type)(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 656, in process_bundle
    bundle_processor = self.bundle_processor_cache.get(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 487, in get
    processor = bundle_processor.BundleProcessor(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py", line 888, in __init__
    _verify_descriptor_created_in_a_compatible_env(process_bundle_descriptor)
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py", line 851, in _verify_descriptor_created_in_a_compatible_env
    raise RuntimeError(
RuntimeError: Pipeline construction environment and pipeline runtime environment are not compatible. If you use a custom container image, check that the Python interpreter minor version and the Apache Beam version in your image match the versions used at pipeline construction time. Submission environment: beam:version:sdk_base:apache/beam_python3.8_sdk:2.52.0.dev. Runtime environment: beam:version:sdk_base:apache/beam_python3.8_sdk:2.51.0.dev.

ERROR    apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:208 2023-09-25T10:09:03.483Z: JOB_MESSAGE_ERROR: generic::unknown: Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 297, in _execute
    response = task()
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 372, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 625, in do_instruction
    return getattr(self, request_type)(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 656, in process_bundle
    bundle_processor = self.bundle_processor_cache.get(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 487, in get
    processor = bundle_processor.BundleProcessor(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py", line 888, in __init__
    _verify_descriptor_created_in_a_compatible_env(process_bundle_descriptor)
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py", line 851, in _verify_descriptor_created_in_a_compatible_env
    raise RuntimeError(
RuntimeError: Pipeline construction environment and pipeline runtime environment are not compatible. If you use a custom container image, check that the Python interpreter minor version and the Apache Beam version in your image match the versions used at pipeline construction time. Submission environment: beam:version:sdk_base:apache/beam_python3.8_sdk:2.52.0.dev. Runtime environment: beam:version:sdk_base:apache/beam_python3.8_sdk:2.51.0.dev.

ERROR    apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:208 2023-09-25T10:09:34.134Z: JOB_MESSAGE_ERROR: generic::unknown: Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 297, in _execute
    response = task()
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 372, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 625, in do_instruction
    return getattr(self, request_type)(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 656, in process_bundle
    bundle_processor = self.bundle_processor_cache.get(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 487, in get
    processor = bundle_processor.BundleProcessor(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py", line 888, in __init__
    _verify_descriptor_created_in_a_compatible_env(process_bundle_descriptor)
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py", line 851, in _verify_descriptor_created_in_a_compatible_env
    raise RuntimeError(
RuntimeError: Pipeline construction environment and pipeline runtime environment are not compatible. If you use a custom container image, check that the Python interpreter minor version and the Apache Beam version in your image match the versions used at pipeline construction time. Submission environment: beam:version:sdk_base:apache/beam_python3.8_sdk:2.52.0.dev. Runtime environment: beam:version:sdk_base:apache/beam_python3.8_sdk:2.51.0.dev.

ERROR    apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:208 2023-09-25T10:10:04.881Z: JOB_MESSAGE_ERROR: generic::unknown: Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 297, in _execute
    response = task()
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 372, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 625, in do_instruction
    return getattr(self, request_type)(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 656, in process_bundle
    bundle_processor = self.bundle_processor_cache.get(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 487, in get
    processor = bundle_processor.BundleProcessor(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py", line 888, in __init__
    _verify_descriptor_created_in_a_compatible_env(process_bundle_descriptor)
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py", line 851, in _verify_descriptor_created_in_a_compatible_env
    raise RuntimeError(
RuntimeError: Pipeline construction environment and pipeline runtime environment are not compatible. If you use a custom container image, check that the Python interpreter minor version and the Apache Beam version in your image match the versions used at pipeline construction time. Submission environment: beam:version:sdk_base:apache/beam_python3.8_sdk:2.52.0.dev. Runtime environment: beam:version:sdk_base:apache/beam_python3.8_sdk:2.51.0.dev.

ERROR    apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:208 2023-09-25T10:10:35.666Z: JOB_MESSAGE_ERROR: generic::unknown: Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 297, in _execute
    response = task()
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 372, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 625, in do_instruction
    return getattr(self, request_type)(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 656, in process_bundle
    bundle_processor = self.bundle_processor_cache.get(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 487, in get
    processor = bundle_processor.BundleProcessor(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py", line 888, in __init__
    _verify_descriptor_created_in_a_compatible_env(process_bundle_descriptor)
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py", line 851, in _verify_descriptor_created_in_a_compatible_env
    raise RuntimeError(
RuntimeError: Pipeline construction environment and pipeline runtime environment are not compatible. If you use a custom container image, check that the Python interpreter minor version and the Apache Beam version in your image match the versions used at pipeline construction time. Submission environment: beam:version:sdk_base:apache/beam_python3.8_sdk:2.52.0.dev. Runtime environment: beam:version:sdk_base:apache/beam_python3.8_sdk:2.51.0.dev.

ERROR    apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:208 2023-09-25T10:11:06.317Z: JOB_MESSAGE_ERROR: generic::unknown: Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 297, in _execute
    response = task()
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 372, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 625, in do_instruction
    return getattr(self, request_type)(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 656, in process_bundle
    bundle_processor = self.bundle_processor_cache.get(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/sdk_worker.py", line 487, in get
    processor = bundle_processor.BundleProcessor(
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py", line 888, in __init__
    _verify_descriptor_created_in_a_compatible_env(process_bundle_descriptor)
  File "/usr/local/lib/python3.8/site-packages/apache_beam/runners/worker/bundle_processor.py", line 851, in _verify_descriptor_created_in_a_compatible_env
    raise RuntimeError(
RuntimeError: Pipeline construction environment and pipeline runtime environment are not compatible. If you use a custom container image, check that the Python interpreter minor version and the Apache Beam version in your image match the versions used at pipeline construction time. Submission environment: beam:version:sdk_base:apache/beam_python3.8_sdk:2.52.0.dev. Runtime environment: beam:version:sdk_base:apache/beam_python3.8_sdk:2.51.0.dev.

INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:154 Job 2023-09-25_01_56_31-2582667062334943476 is in state JOB_STATE_CANCELLING
=============================== warnings summary ===============================
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:28
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:28
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:28
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:28
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:28
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:28
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:28
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:28
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:28
  <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py>:28: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

../../build/gradleenv/-1734967051/lib/python3.8/site-packages/google/rpc/__init__.py:18
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/google/rpc/__init__.py:18
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/google/rpc/__init__.py:18
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/google/rpc/__init__.py:18
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/google/rpc/__init__.py:18
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/google/rpc/__init__.py:18
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/google/rpc/__init__.py:18
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/google/rpc/__init__.py:18
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/google/rpc/__init__.py:18
  <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/google/rpc/__init__.py>:18: DeprecationWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html
    import pkg_resources

../../build/gradleenv/-1734967051/lib/python3.8/site-packages/pkg_resources/__init__.py:2871: 171 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/pkg_resources/__init__.py>:2871: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google')`.
  Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
    declare_namespace(pkg)

../../build/gradleenv/-1734967051/lib/python3.8/site-packages/pkg_resources/__init__.py:2871: 144 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/pkg_resources/__init__.py>:2871: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google.cloud')`.
  Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
    declare_namespace(pkg)

../../build/gradleenv/-1734967051/lib/python3.8/site-packages/pkg_resources/__init__.py:2350: 36 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/pkg_resources/__init__.py>:2350: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google')`.
  Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
    declare_namespace(parent)

../../build/gradleenv/-1734967051/lib/python3.8/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/pkg_resources/__init__.py:2871
  <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/pkg_resources/__init__.py>:2871: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google.logging')`.
  Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
    declare_namespace(pkg)

../../build/gradleenv/-1734967051/lib/python3.8/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/pkg_resources/__init__.py:2871
  <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/pkg_resources/__init__.py>:2871: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google.iam')`.
  Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
    declare_namespace(pkg)

../../build/gradleenv/-1734967051/lib/python3.8/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/google/rpc/__init__.py:20
  <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/google/rpc/__init__.py>:20: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google.rpc')`.
  Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
    pkg_resources.declare_namespace(__name__)

apache_beam/ml/inference/base_test.py::RunInferenceBaseTest::test_run_inference_with_side_inputin_streaming
  <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/sdks/python/apache_beam/ml/inference/base_test.py>:1349: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    test_pipeline.options.view_as(StandardOptions).streaming = True

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/sdks/python/pytest_validatesRunnerStreamingTests-df-py38-xdist.xml> -
=========================== short test summary info ============================
FAILED apache_beam/transforms/ptransform_test.py::PTransformTest::test_flatten_one_single_pcollection - Failed: Timeout >4500.0s
===== 1 failed, 33 passed, 17 skipped, 397 warnings in 5215.32s (1:26:55) ======

> Task :sdks:python:test-suites:dataflow:py38:validatesRunnerStreamingTests FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 253

* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py311:validatesRunnerStreamingTests'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 253

* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py38:validatesRunnerStreamingTests'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.6.2/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 2h 3m 36s
24 actionable tasks: 18 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://ge.apache.org/s/azu2zsuydgfvq

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Py_VR_Dataflow #11335

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/11335/display/redirect>

Changes:


------------------------------------------
[...truncated 816.97 KB...]
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/bundle_processor.py", line 888, in __init__
    _verify_descriptor_created_in_a_compatible_env(process_bundle_descriptor)
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/bundle_processor.py", line 851, in _verify_descriptor_created_in_a_compatible_env
    raise RuntimeError(
RuntimeError: Pipeline construction environment and pipeline runtime environment are not compatible. If you use a custom container image, check that the Python interpreter minor version and the Apache Beam version in your image match the versions used at pipeline construction time. Submission environment: beam:version:sdk_base:apache/beam_python3.11_sdk:2.52.0.dev. Runtime environment: beam:version:sdk_base:apache/beam_python3.11_sdk:2.51.0.dev.

ERROR    apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:208 2023-09-25T04:32:50.104Z: JOB_MESSAGE_ERROR: generic::unknown: Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 297, in _execute
    response = task()
               ^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 372, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 625, in do_instruction
    return getattr(self, request_type)(
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 656, in process_bundle
    bundle_processor = self.bundle_processor_cache.get(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 487, in get
    processor = bundle_processor.BundleProcessor(
                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/bundle_processor.py", line 888, in __init__
    _verify_descriptor_created_in_a_compatible_env(process_bundle_descriptor)
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/bundle_processor.py", line 851, in _verify_descriptor_created_in_a_compatible_env
    raise RuntimeError(
RuntimeError: Pipeline construction environment and pipeline runtime environment are not compatible. If you use a custom container image, check that the Python interpreter minor version and the Apache Beam version in your image match the versions used at pipeline construction time. Submission environment: beam:version:sdk_base:apache/beam_python3.11_sdk:2.52.0.dev. Runtime environment: beam:version:sdk_base:apache/beam_python3.11_sdk:2.51.0.dev.

ERROR    apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:208 2023-09-25T04:33:20.642Z: JOB_MESSAGE_ERROR: generic::unknown: Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 297, in _execute
    response = task()
               ^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 372, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 625, in do_instruction
    return getattr(self, request_type)(
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 656, in process_bundle
    bundle_processor = self.bundle_processor_cache.get(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 487, in get
    processor = bundle_processor.BundleProcessor(
                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/bundle_processor.py", line 888, in __init__
    _verify_descriptor_created_in_a_compatible_env(process_bundle_descriptor)
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/bundle_processor.py", line 851, in _verify_descriptor_created_in_a_compatible_env
    raise RuntimeError(
RuntimeError: Pipeline construction environment and pipeline runtime environment are not compatible. If you use a custom container image, check that the Python interpreter minor version and the Apache Beam version in your image match the versions used at pipeline construction time. Submission environment: beam:version:sdk_base:apache/beam_python3.11_sdk:2.52.0.dev. Runtime environment: beam:version:sdk_base:apache/beam_python3.11_sdk:2.51.0.dev.

ERROR    apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:208 2023-09-25T04:33:50.993Z: JOB_MESSAGE_ERROR: generic::unknown: Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 297, in _execute
    response = task()
               ^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 372, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 625, in do_instruction
    return getattr(self, request_type)(
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 656, in process_bundle
    bundle_processor = self.bundle_processor_cache.get(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 487, in get
    processor = bundle_processor.BundleProcessor(
                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/bundle_processor.py", line 888, in __init__
    _verify_descriptor_created_in_a_compatible_env(process_bundle_descriptor)
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/bundle_processor.py", line 851, in _verify_descriptor_created_in_a_compatible_env
    raise RuntimeError(
RuntimeError: Pipeline construction environment and pipeline runtime environment are not compatible. If you use a custom container image, check that the Python interpreter minor version and the Apache Beam version in your image match the versions used at pipeline construction time. Submission environment: beam:version:sdk_base:apache/beam_python3.11_sdk:2.52.0.dev. Runtime environment: beam:version:sdk_base:apache/beam_python3.11_sdk:2.51.0.dev.

ERROR    apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:208 2023-09-25T04:34:21.562Z: JOB_MESSAGE_ERROR: generic::unknown: Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 297, in _execute
    response = task()
               ^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 372, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 625, in do_instruction
    return getattr(self, request_type)(
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 656, in process_bundle
    bundle_processor = self.bundle_processor_cache.get(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 487, in get
    processor = bundle_processor.BundleProcessor(
                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/bundle_processor.py", line 888, in __init__
    _verify_descriptor_created_in_a_compatible_env(process_bundle_descriptor)
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/bundle_processor.py", line 851, in _verify_descriptor_created_in_a_compatible_env
    raise RuntimeError(
RuntimeError: Pipeline construction environment and pipeline runtime environment are not compatible. If you use a custom container image, check that the Python interpreter minor version and the Apache Beam version in your image match the versions used at pipeline construction time. Submission environment: beam:version:sdk_base:apache/beam_python3.11_sdk:2.52.0.dev. Runtime environment: beam:version:sdk_base:apache/beam_python3.11_sdk:2.51.0.dev.

ERROR    apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:208 2023-09-25T04:34:51.881Z: JOB_MESSAGE_ERROR: generic::unknown: Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 297, in _execute
    response = task()
               ^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 372, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 625, in do_instruction
    return getattr(self, request_type)(
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 656, in process_bundle
    bundle_processor = self.bundle_processor_cache.get(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/sdk_worker.py", line 487, in get
    processor = bundle_processor.BundleProcessor(
                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/bundle_processor.py", line 888, in __init__
    _verify_descriptor_created_in_a_compatible_env(process_bundle_descriptor)
  File "/usr/local/lib/python3.11/site-packages/apache_beam/runners/worker/bundle_processor.py", line 851, in _verify_descriptor_created_in_a_compatible_env
    raise RuntimeError(
RuntimeError: Pipeline construction environment and pipeline runtime environment are not compatible. If you use a custom container image, check that the Python interpreter minor version and the Apache Beam version in your image match the versions used at pipeline construction time. Submission environment: beam:version:sdk_base:apache/beam_python3.11_sdk:2.52.0.dev. Runtime environment: beam:version:sdk_base:apache/beam_python3.11_sdk:2.51.0.dev.

INFO     apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:154 Job 2023-09-24_20_20_04-17263961573716867081 is in state JOB_STATE_CANCELLING
=============================== warnings summary ===============================
../../build/gradleenv/2050596099/lib/python3.11/site-packages/hdfs/config.py:28
../../build/gradleenv/2050596099/lib/python3.11/site-packages/hdfs/config.py:28
../../build/gradleenv/2050596099/lib/python3.11/site-packages/hdfs/config.py:28
../../build/gradleenv/2050596099/lib/python3.11/site-packages/hdfs/config.py:28
../../build/gradleenv/2050596099/lib/python3.11/site-packages/hdfs/config.py:28
../../build/gradleenv/2050596099/lib/python3.11/site-packages/hdfs/config.py:28
../../build/gradleenv/2050596099/lib/python3.11/site-packages/hdfs/config.py:28
../../build/gradleenv/2050596099/lib/python3.11/site-packages/hdfs/config.py:28
../../build/gradleenv/2050596099/lib/python3.11/site-packages/hdfs/config.py:28
  <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/build/gradleenv/2050596099/lib/python3.11/site-packages/hdfs/config.py>:28: DeprecationWarning: the imp module is deprecated in favour of importlib and slated for removal in Python 3.12; see the module's documentation for alternative uses
    from imp import load_source

../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/rpc/__init__.py:18
../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/rpc/__init__.py:18
../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/rpc/__init__.py:18
../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/rpc/__init__.py:18
../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/rpc/__init__.py:18
../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/rpc/__init__.py:18
../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/rpc/__init__.py:18
../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/rpc/__init__.py:18
../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/rpc/__init__.py:18
  <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/build/gradleenv/2050596099/lib/python3.11/site-packages/google/rpc/__init__.py>:18: DeprecationWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html
    import pkg_resources

../../build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py:2871: 171 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py>:2871: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google')`.
  Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
    declare_namespace(pkg)

../../build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py:2871: 144 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py>:2871: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google.cloud')`.
  Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
    declare_namespace(pkg)

../../build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py:2350: 36 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py>:2350: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google')`.
  Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
    declare_namespace(parent)

../../build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py:2871
  <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py>:2871: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google.logging')`.
  Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
    declare_namespace(pkg)

../../build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py:2871
../../build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py:2871
  <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/build/gradleenv/2050596099/lib/python3.11/site-packages/pkg_resources/__init__.py>:2871: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google.iam')`.
  Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
    declare_namespace(pkg)

../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/rpc/__init__.py:20
../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/rpc/__init__.py:20
  <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/build/gradleenv/2050596099/lib/python3.11/site-packages/google/rpc/__init__.py>:20: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google.rpc')`.
  Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
    pkg_resources.declare_namespace(__name__)

../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
  <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/build/gradleenv/2050596099/lib/python3.11/site-packages/google/api_core/operations_v1/abstract_operations_client.py>:17: DeprecationWarning: The distutils package is deprecated and slated for removal in Python 3.12. Use setuptools or check PEP 632 for potential alternatives
    from distutils import util

apache_beam/ml/inference/base_test.py::RunInferenceBaseTest::test_run_inference_with_side_inputin_streaming
  <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/sdks/python/apache_beam/ml/inference/base_test.py>:1349: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    test_pipeline.options.view_as(StandardOptions).streaming = True

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/sdks/python/pytest_validatesRunnerStreamingTests-df-py311-xdist.xml> -
=========================== short test summary info ============================
FAILED apache_beam/transforms/ptransform_test.py::PTransformTest::test_par_do_with_multiple_outputs_and_using_return - Failed: Timeout >4500.0s
FAILED apache_beam/transforms/sideinputs_test.py::SideInputsTest::test_iterable_side_input - Failed: Timeout >4500.0s
===== 2 failed, 32 passed, 17 skipped, 405 warnings in 6151.27s (1:42:31) ======

> Task :sdks:python:test-suites:dataflow:py311:validatesRunnerStreamingTests FAILED

FAILURE: Build failed with an exception.

* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 253

* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py311:validatesRunnerStreamingTests'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.6.2/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 2h 18m 22s
24 actionable tasks: 18 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://ge.apache.org/s/rletlle66fel2

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org