You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2022/12/02 15:34:07 UTC
Build failed in Jenkins: beam_LoadTests_Python_ParDo_Flink_Streaming #931
See <https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Streaming/931/display/redirect?page=changes>
Changes:
[noreply] ML notebook formatting and text updates (#24437)
[noreply] lint fixes (#24455)
[noreply] Bump cloud.google.com/go/pubsub from 1.26.0 to 1.27.0 in /sdks (#24450)
[noreply] Install venv dependencies in local env setup (#24461)
[noreply] Don't set BigQuery services in schema transform configuration (#24316)
[noreply] Apache playground blog (#24431)
[noreply] Sort SchemaTransform configuration schema fields by name to establish
[noreply] Rename from default-pool to pool-1 (#24466)
[Kenneth Knowles] Moving to 2.45.0-SNAPSHOT on master branch.
[noreply] [Website] change svg to png (#24268)
[noreply] Fix error messages in cred rotation email (#24474)
[noreply] Add integer to NUMERIC and BIGNUMERIC conversion support (#24447)
[noreply] Update jackson dep. (#24445)
[noreply] Reduce calls to FileSystem.match and API calls in FileSystem._list
[noreply] Capture full response context to provide complete error information
[noreply] Pandas 1.5 support (#23973)
------------------------------------------
[...truncated 161.26 KB...]
INFO:root:Using provided Python SDK container image: gcr.io/apache-beam-testing/beam_portability/beam_python3.7_sdk:latest
INFO:root:Python SDK container image set to "gcr.io/apache-beam-testing/beam_portability/beam_python3.7_sdk:latest" for Docker environment
WARNING:apache_beam.options.pipeline_options:Discarding unparseable args: ['--iterations=1', '--number_of_counter_operations=100', '--number_of_counters=1', '--use_stateful_load_generator']
INFO:apache_beam.runners.portability.portable_runner:Job state changed to STOPPED
INFO:apache_beam.runners.portability.portable_runner:Job state changed to STARTING
INFO:apache_beam.runners.portability.portable_runner:Job state changed to RUNNING
INFO:apache_beam.runners.portability.portable_runner:Job state changed to DONE
INFO:apache_beam.testing.load_tests.load_test_metrics_utils:Load test results for test: 9e6ecfdb25ab4e0a9946ca4bc3c69fe7 and timestamp: 1669995217.9591281:
INFO:apache_beam.testing.load_tests.load_test_metrics_utils:Metric: python_flink_streaming_pardo_4_runtime Value: 917
INFO:apache_beam.testing.load_tests.load_test_metrics_utils:Metric: python_flink_streaming_pardo_4_ref_appliedptransform_measure-latency_9_count_latency Value: 20000000
INFO:apache_beam.testing.load_tests.load_test_metrics_utils:Metric: python_flink_streaming_pardo_4_ref_appliedptransform_measure-latency_9_max_latency Value: 170
INFO:apache_beam.testing.load_tests.load_test_metrics_utils:Metric: python_flink_streaming_pardo_4_ref_appliedptransform_measure-latency_9_min_latency Value: 0
INFO:apache_beam.testing.load_tests.load_test_metrics_utils:Metric: python_flink_streaming_pardo_4_ref_appliedptransform_measure-latency_9_sum_latency Value: 2680967
INFO:apache_beam.testing.load_tests.load_test_metrics_utils:Metric: python_flink_streaming_pardo_4_ref_appliedptransform_measure-latency_9_mean_latency Value: 0
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD SUCCESSFUL in 18m 1s
15 actionable tasks: 4 executed, 11 up-to-date
Publishing build scan...
https://gradle.com/s/gkog5nq3az53g
[beam_LoadTests_Python_ParDo_Flink_Streaming] $ /bin/bash -xe /tmp/jenkins8385691565218670725.sh
+ echo '*** ParDo Python Stateful Streaming with Checkpointing test: 2M 100 byte records ***'
*** ParDo Python Stateful Streaming with Checkpointing test: 2M 100 byte records ***
[Gradle] - Launching build.
[src] $ <https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Streaming/ws/src/gradlew> -PloadTest.mainClass=apache_beam.testing.load_tests.pardo_test -Prunner=PortableRunner '-PloadTest.args=--job_name=load-tests-python-flink-streaming-pardo-6-1202100255 --project=apache-beam-testing --publish_to_big_query=true --metrics_dataset=load_test --metrics_table=python_flink_streaming_pardo_6 --influx_measurement=python_streaming_pardo_6 --input_options='{"num_records": 2000000,"key_size": 10,"value_size": 90}' --iterations=5 --number_of_counter_operations=10 --number_of_counters=3 --parallelism=5 --streaming --stateful --checkpointing_interval=10000 --report_checkpoint_duration=python_flink_streaming_pardo_6 --shutdown_sources_after_idle_ms=300000 --job_endpoint=localhost:8099 --environment_type=DOCKER --environment_config=gcr.io/apache-beam-testing/beam_portability/beam_python3.7_sdk:latest --use_stateful_load_generator --influx_db_name=beam_test_metrics --influx_hostname=http://10.128.0.96:8086 --runner=PortableRunner' -PpythonVersion=3.7 --continue --max-****s=8 -Dorg.gradle.jvmargs=-Xms2g -Dorg.gradle.jvmargs=-Xmx6g -Dorg.gradle.vfs.watch=false -Pdocker-pull-licenses :sdks:python:apache_beam:testing:load_tests:run
Configuration on demand is an incubating feature.
> Task :buildSrc:compileJava NO-SOURCE
> Task :buildSrc:compileGroovy UP-TO-DATE
> Task :buildSrc:pluginDescriptors UP-TO-DATE
> Task :buildSrc:processResources UP-TO-DATE
> Task :buildSrc:classes UP-TO-DATE
> Task :buildSrc:jar UP-TO-DATE
> Task :buildSrc:assemble UP-TO-DATE
> Task :buildSrc:spotlessGroovy UP-TO-DATE
> Task :buildSrc:spotlessGroovyCheck UP-TO-DATE
> Task :buildSrc:spotlessGroovyGradle UP-TO-DATE
> Task :buildSrc:spotlessGroovyGradleCheck UP-TO-DATE
> Task :buildSrc:spotlessCheck UP-TO-DATE
> Task :buildSrc:pluginUnderTestMetadata UP-TO-DATE
> Task :buildSrc:compileTestJava NO-SOURCE
> Task :buildSrc:compileTestGroovy NO-SOURCE
> Task :buildSrc:processTestResources NO-SOURCE
> Task :buildSrc:testClasses UP-TO-DATE
> Task :buildSrc:test NO-SOURCE
> Task :buildSrc:validatePlugins UP-TO-DATE
> Task :buildSrc:check UP-TO-DATE
> Task :buildSrc:build UP-TO-DATE
> Task :sdks:python:setupVirtualenv
Collecting pip
Using cached pip-22.3.1-py3-none-any.whl (2.1 MB)
Installing collected packages: pip
Attempting uninstall: pip
Found existing installation: pip 20.1.1
Uninstalling pip-20.1.1:
Successfully uninstalled pip-20.1.1
Successfully installed pip-22.3.1
Ignoring grpcio: markers 'sys_platform == "darwin"' don't match your environment
Ignoring protobuf: markers 'python_version == "3.10" and sys_platform == "darwin"' don't match your environment
Collecting tox==3.20.1
Using cached tox-3.20.1-py2.py3-none-any.whl (83 kB)
Requirement already satisfied: setuptools in <https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Streaming/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages> (from -r <https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Streaming/ws/src/sdks/python/build-requirements.txt> (line 20)) (47.1.0)
Collecting setuptools
Using cached setuptools-65.6.3-py3-none-any.whl (1.2 MB)
Collecting six
Using cached six-1.16.0-py2.py3-none-any.whl (11 kB)
Collecting wheel>=0.36.0
Using cached wheel-0.38.4-py3-none-any.whl (36 kB)
Collecting grpcio-tools==1.37.0
Using cached grpcio_tools-1.37.0-cp37-cp37m-manylinux2014_x86_64.whl (2.5 MB)
Collecting mypy-protobuf==1.18
Using cached mypy_protobuf-1.18-py3-none-any.whl (7.3 kB)
Collecting distlib==0.3.1
Using cached distlib-0.3.1-py2.py3-none-any.whl (335 kB)
Collecting numpy<1.23.0,>=1.14.3
Using cached numpy-1.21.6-cp37-cp37m-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (15.7 MB)
Collecting importlib-metadata<3,>=0.12
Using cached importlib_metadata-2.1.3-py2.py3-none-any.whl (10 kB)
Collecting toml>=0.9.4
Using cached toml-0.10.2-py2.py3-none-any.whl (16 kB)
Collecting pluggy>=0.12.0
Using cached pluggy-1.0.0-py2.py3-none-any.whl (13 kB)
Collecting py>=1.4.17
Using cached py-1.11.0-py2.py3-none-any.whl (98 kB)
Collecting virtualenv!=20.0.0,!=20.0.1,!=20.0.2,!=20.0.3,!=20.0.4,!=20.0.5,!=20.0.6,!=20.0.7,>=16.0.0
Using cached virtualenv-20.17.0-py3-none-any.whl (8.8 MB)
Collecting packaging>=14
Using cached packaging-21.3-py3-none-any.whl (40 kB)
Collecting filelock>=3.0.0
Using cached filelock-3.8.0-py3-none-any.whl (10 kB)
Collecting protobuf<4.0dev,>=3.5.0.post1
Using cached protobuf-3.20.3-cp37-cp37m-manylinux_2_5_x86_64.manylinux1_x86_64.whl (1.0 MB)
Collecting grpcio>=1.37.0
Using cached grpcio-1.51.1-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (4.8 MB)
Collecting zipp>=0.5
Using cached zipp-3.11.0-py3-none-any.whl (6.6 kB)
Collecting pyparsing!=3.0.5,>=2.0.2
Using cached pyparsing-3.0.9-py3-none-any.whl (98 kB)
Collecting virtualenv!=20.0.0,!=20.0.1,!=20.0.2,!=20.0.3,!=20.0.4,!=20.0.5,!=20.0.6,!=20.0.7,>=16.0.0
Using cached virtualenv-20.16.7-py3-none-any.whl (8.8 MB)
Using cached virtualenv-20.16.6-py3-none-any.whl (8.8 MB)
Using cached virtualenv-20.16.5-py3-none-any.whl (8.8 MB)
Using cached virtualenv-20.16.4-py3-none-any.whl (8.8 MB)
Using cached virtualenv-20.16.3-py2.py3-none-any.whl (8.8 MB)
Using cached virtualenv-20.16.2-py2.py3-none-any.whl (8.8 MB)
Collecting platformdirs<3,>=2
Using cached platformdirs-2.5.4-py3-none-any.whl (14 kB)
Installing collected packages: distlib, zipp, wheel, toml, six, setuptools, pyparsing, py, protobuf, platformdirs, numpy, grpcio, filelock, packaging, mypy-protobuf, importlib-metadata, grpcio-tools, virtualenv, pluggy, tox
Attempting uninstall: setuptools
Found existing installation: setuptools 47.1.0
Uninstalling setuptools-47.1.0:
Successfully uninstalled setuptools-47.1.0
Successfully installed distlib-0.3.1 filelock-3.8.0 grpcio-1.51.1 grpcio-tools-1.37.0 importlib-metadata-2.1.3 mypy-protobuf-1.18 numpy-1.21.6 packaging-21.3 platformdirs-2.5.4 pluggy-1.0.0 protobuf-3.20.3 py-1.11.0 pyparsing-3.0.9 setuptools-65.6.3 six-1.16.0 toml-0.10.2 tox-3.20.1 virtualenv-20.16.2 wheel-0.38.4 zipp-3.11.0
> Task :sdks:python:sdist UP-TO-DATE
> Task :sdks:python:apache_beam:testing:load_tests:setupVirtualenv
Collecting pip
Using cached pip-22.3.1-py3-none-any.whl (2.1 MB)
Installing collected packages: pip
Attempting uninstall: pip
Found existing installation: pip 20.1.1
Uninstalling pip-20.1.1:
Successfully uninstalled pip-20.1.1
Successfully installed pip-22.3.1
Ignoring grpcio: markers 'sys_platform == "darwin"' don't match your environment
Ignoring protobuf: markers 'python_version == "3.10" and sys_platform == "darwin"' don't match your environment
Collecting tox==3.20.1
Using cached tox-3.20.1-py2.py3-none-any.whl (83 kB)
Requirement already satisfied: setuptools in <https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Streaming/ws/src/build/gradleenv/1329484227/lib/python3.7/site-packages> (from -r <https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Streaming/ws/src/sdks/python/build-requirements.txt> (line 20)) (47.1.0)
Collecting setuptools
Using cached setuptools-65.6.3-py3-none-any.whl (1.2 MB)
Collecting six
Using cached six-1.16.0-py2.py3-none-any.whl (11 kB)
Collecting wheel>=0.36.0
Using cached wheel-0.38.4-py3-none-any.whl (36 kB)
Collecting grpcio-tools==1.37.0
Using cached grpcio_tools-1.37.0-cp37-cp37m-manylinux2014_x86_64.whl (2.5 MB)
Collecting mypy-protobuf==1.18
Using cached mypy_protobuf-1.18-py3-none-any.whl (7.3 kB)
Collecting distlib==0.3.1
Using cached distlib-0.3.1-py2.py3-none-any.whl (335 kB)
Collecting numpy<1.23.0,>=1.14.3
Using cached numpy-1.21.6-cp37-cp37m-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (15.7 MB)
Collecting filelock>=3.0.0
Using cached filelock-3.8.0-py3-none-any.whl (10 kB)
Collecting virtualenv!=20.0.0,!=20.0.1,!=20.0.2,!=20.0.3,!=20.0.4,!=20.0.5,!=20.0.6,!=20.0.7,>=16.0.0
Using cached virtualenv-20.17.0-py3-none-any.whl (8.8 MB)
Collecting py>=1.4.17
Using cached py-1.11.0-py2.py3-none-any.whl (98 kB)
Collecting packaging>=14
Using cached packaging-21.3-py3-none-any.whl (40 kB)
Collecting pluggy>=0.12.0
Using cached pluggy-1.0.0-py2.py3-none-any.whl (13 kB)
Collecting importlib-metadata<3,>=0.12
Using cached importlib_metadata-2.1.3-py2.py3-none-any.whl (10 kB)
Collecting toml>=0.9.4
Using cached toml-0.10.2-py2.py3-none-any.whl (16 kB)
Collecting grpcio>=1.37.0
Using cached grpcio-1.51.1-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (4.8 MB)
Collecting protobuf<4.0dev,>=3.5.0.post1
Using cached protobuf-3.20.3-cp37-cp37m-manylinux_2_5_x86_64.manylinux1_x86_64.whl (1.0 MB)
Collecting zipp>=0.5
Using cached zipp-3.11.0-py3-none-any.whl (6.6 kB)
Collecting pyparsing!=3.0.5,>=2.0.2
Using cached pyparsing-3.0.9-py3-none-any.whl (98 kB)
Collecting virtualenv!=20.0.0,!=20.0.1,!=20.0.2,!=20.0.3,!=20.0.4,!=20.0.5,!=20.0.6,!=20.0.7,>=16.0.0
Using cached virtualenv-20.16.7-py3-none-any.whl (8.8 MB)
Using cached virtualenv-20.16.6-py3-none-any.whl (8.8 MB)
Using cached virtualenv-20.16.5-py3-none-any.whl (8.8 MB)
Using cached virtualenv-20.16.4-py3-none-any.whl (8.8 MB)
Using cached virtualenv-20.16.3-py2.py3-none-any.whl (8.8 MB)
Using cached virtualenv-20.16.2-py2.py3-none-any.whl (8.8 MB)
Collecting platformdirs<3,>=2
Using cached platformdirs-2.5.4-py3-none-any.whl (14 kB)
Installing collected packages: distlib, zipp, wheel, toml, six, setuptools, pyparsing, py, protobuf, platformdirs, numpy, grpcio, filelock, packaging, mypy-protobuf, importlib-metadata, grpcio-tools, virtualenv, pluggy, tox
Attempting uninstall: setuptools
Found existing installation: setuptools 47.1.0
Uninstalling setuptools-47.1.0:
Successfully uninstalled setuptools-47.1.0
Successfully installed distlib-0.3.1 filelock-3.8.0 grpcio-1.51.1 grpcio-tools-1.37.0 importlib-metadata-2.1.3 mypy-protobuf-1.18 numpy-1.21.6 packaging-21.3 platformdirs-2.5.4 pluggy-1.0.0 protobuf-3.20.3 py-1.11.0 pyparsing-3.0.9 setuptools-65.6.3 six-1.16.0 toml-0.10.2 tox-3.20.1 virtualenv-20.16.2 wheel-0.38.4 zipp-3.11.0
> Task :sdks:python:apache_beam:testing:load_tests:installGcpTest
Processing <https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Streaming/ws/src/sdks/python/build/apache-beam.tar.gz>
Preparing metadata (setup.py): started
Preparing metadata (setup.py): finished with status 'done'
Requirement already satisfied: protobuf<4,>3.12.2 in <https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Streaming/ws/src/build/gradleenv/1329484227/lib/python3.7/site-packages> (from apache-beam==2.45.0.dev0) (3.20.3)
Collecting crcmod<2.0,>=1.7
Using cached crcmod-1.7-cp37-cp37m-linux_x86_64.whl
Collecting orjson<4.0
Downloading orjson-3.8.3.tar.gz (861 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 861.2/861.2 kB 15.3 MB/s eta 0:00:00
Installing build dependencies: started
Installing build dependencies: finished with status 'done'
Getting requirements to build wheel: started
Getting requirements to build wheel: finished with status 'done'
Preparing metadata (pyproject.toml): started
Preparing metadata (pyproject.toml): finished with status 'error'
error: subprocess-exited-with-error
× Preparing metadata (pyproject.toml) did not run successfully.
│ exit code: 1
╰─> [6 lines of output]
Cargo, the Rust package manager, is not installed or is not on PATH.
This package requires Rust and Cargo to compile extensions. Install it through
the system's package manager or via https://rustup.rs/
Checking for Rust toolchain....
[end of output]
note: This error originates from a subprocess, and is likely not a problem with pip.
error: metadata-generation-failed
× Encountered error while generating package metadata.
╰─> See above for output.
note: This is an issue with the package mentioned above, not pip.
hint: See above for details.
> Task :sdks:python:apache_beam:testing:load_tests:installGcpTest FAILED
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:python:apache_beam:testing:load_tests:installGcpTest'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
BUILD FAILED in 26s
14 actionable tasks: 3 executed, 11 up-to-date
Publishing build scan...
https://gradle.com/s/pxxgqygrjvolw
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal : beam_LoadTests_Python_ParDo_Flink_Streaming #932
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Streaming/932/display/redirect?page=changes>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org