You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2020/03/06 16:57:53 UTC
Build failed in Jenkins: beam_LoadTests_Python_CoGBK_Dataflow_Batch
#238
See <https://builds.apache.org/job/beam_LoadTests_Python_CoGBK_Dataflow_Batch/238/display/redirect?page=changes>
Changes:
[git] Remove optionality and add sensible defaults to PubsubIO builders.
[amaliujia] [BEAM-9288] Not bundle conscrypt in gRPC vendor in META-INF/
[iemejia] [BEAM-9450] Update www.apache.org/dist/ links to downloads.apache.org
[iemejia] [BEAM-9450] Convert links available via https to use https
[lcwik] [BEAM-9452] Update classgraph to latest version to resolve windows
[hktang] [BEAM-9453] Changed new string creation to use StandardCharsets.UTF_8
[chuck.yang] Use Avro format for file loads to BigQuery
[jkai] [Hotfix] fix rabbitmp spotless check
[github] Revert "[BEAM-6374] Emit PCollection metrics from GoSDK (#10942)"
[github] Merge pull request #11032 from [BEAM-8335] Display rather than logging
[github] Fix a bug in performance test for reading data from BigQuery (#11062)
------------------------------------------
Started by timer
Running as SYSTEM
[EnvInject] - Loading node environment variables.
Building remotely on apache-beam-jenkins-1 (beam) in workspace <https://builds.apache.org/job/beam_LoadTests_Python_CoGBK_Dataflow_Batch/ws/>
No credentials specified
Wiping out workspace first.
Cloning the remote Git repository
Cloning repository https://github.com/apache/beam.git
> git init <https://builds.apache.org/job/beam_LoadTests_Python_CoGBK_Dataflow_Batch/ws/src> # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/*
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
> git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/*
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 9457e8d3fc4efe0a199e018831a569babda0f511 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 9457e8d3fc4efe0a199e018831a569babda0f511
Commit message: "Fix a bug in performance test for reading data from BigQuery (#11062)"
> git rev-list --no-walk 8222fcc978a54d98d385c108fb5fcf7615d74829 # timeout=10
No emails were triggered.
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_LoadTests_Python_CoGBK_Dataflow_Batch] $ /bin/bash -xe /tmp/jenkins5014987788094831597.sh
+ echo src CoGroupByKey Python Load test: 2GB of 100B records with a single key src
src CoGroupByKey Python Load test: 2GB of 100B records with a single key src
[Gradle] - Launching build.
[src] $ <https://builds.apache.org/job/beam_LoadTests_Python_CoGBK_Dataflow_Batch/ws/src/gradlew> -PloadTest.mainClass=apache_beam.testing.load_tests.co_group_by_key_test -Prunner=TestDataflowRunner '-PloadTest.args=--project=apache-beam-testing --job_name=load-tests-python-dataflow-batch-cogbk-1-0306150631 --temp_location=gs://temp-storage-for-perf-tests/loadtests --publish_to_big_query=true --metrics_dataset=load_test --metrics_table=python_dataflow_batch_cogbk_1 --input_options='{"num_records": 20000000,"key_size": 10,"value_size": 90,"num_hot_keys": 1,"hot_key_fraction": 1}' --co_input_options='{"num_records": 20000000,"key_size": 10,"value_size": 90,"num_hot_keys": 1,"hot_key_fraction": 1}' --iterations=1 --num_workers=5 --autoscaling_algorithm=NONE --runner=DataflowRunner' --continue --max-workers=12 -Dorg.gradle.jvmargs=-Xms2g -Dorg.gradle.jvmargs=-Xmx4g :sdks:python:apache_beam:testing:load_tests:run
Starting a Gradle Daemon (subsequent builds will be faster)
> Task :buildSrc:compileJava NO-SOURCE
> Task :buildSrc:compileGroovy FROM-CACHE
> Task :buildSrc:pluginDescriptors
> Task :buildSrc:processResources
> Task :buildSrc:classes
> Task :buildSrc:jar
> Task :buildSrc:assemble
> Task :buildSrc:spotlessGroovy
> Task :buildSrc:spotlessGroovyCheck
> Task :buildSrc:spotlessGroovyGradle
> Task :buildSrc:spotlessGroovyGradleCheck
> Task :buildSrc:spotlessCheck
> Task :buildSrc:pluginUnderTestMetadata
> Task :buildSrc:compileTestJava NO-SOURCE
> Task :buildSrc:compileTestGroovy NO-SOURCE
> Task :buildSrc:processTestResources NO-SOURCE
> Task :buildSrc:testClasses UP-TO-DATE
> Task :buildSrc:test NO-SOURCE
> Task :buildSrc:validateTaskProperties FROM-CACHE
> Task :buildSrc:check
> Task :buildSrc:build
Configuration on demand is an incubating feature.
> Task :sdks:python:setupVirtualenv
New python executable in <https://builds.apache.org/job/beam_LoadTests_Python_CoGBK_Dataflow_Batch/ws/src/build/gradleenv/1922375555/bin/python2.7>
Also creating executable in <https://builds.apache.org/job/beam_LoadTests_Python_CoGBK_Dataflow_Batch/ws/src/build/gradleenv/1922375555/bin/python>
Installing setuptools, pip, wheel...
done.
Running virtualenv with interpreter /usr/bin/python2.7
DEPRECATION: Python 2.7 reached the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 is no longer maintained. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support
Collecting tox==3.11.1
Using cached tox-3.11.1-py2.py3-none-any.whl (76 kB)
Collecting grpcio-tools<=1.14.2,>=1.3.5
Using cached grpcio_tools-1.14.2-cp27-cp27mu-manylinux1_x86_64.whl (22.2 MB)
Processing /home/jenkins/.cache/pip/wheels/bf/c9/a3/c538d90ef17cf7823fa51fc701a7a7a910a80f6a405bf15b1a/future-0.16.0-cp27-none-any.whl
Processing /home/jenkins/.cache/pip/wheels/45/c0/60/00682619a42655ca6ccd0c56343441f46e41a886476a34b7eb/mypy_protobuf-1.18-py2-none-any.whl
Collecting six<2,>=1.0.0
Using cached six-1.14.0-py2.py3-none-any.whl (10 kB)
Processing /home/jenkins/.cache/pip/wheels/66/13/60/ef107438d90e4aad6320e3424e50cfce5e16d1e9aad6d38294/filelock-3.0.12-cp27-none-any.whl
Collecting virtualenv>=14.0.0
Using cached virtualenv-20.0.8-py2.py3-none-any.whl (4.6 MB)
Collecting pluggy<1,>=0.3.0
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting py<2,>=1.4.17
Using cached py-1.8.1-py2.py3-none-any.whl (83 kB)
Collecting toml>=0.9.4
Using cached toml-0.10.0-py2.py3-none-any.whl (25 kB)
Requirement already satisfied, skipping upgrade: setuptools>=30.0.0 in <https://builds.apache.org/job/beam_LoadTests_Python_CoGBK_Dataflow_Batch/ws/src/build/gradleenv/1922375555/lib/python2.7/site-packages> (from tox==3.11.1) (44.0.0)
Collecting grpcio>=1.14.2
Using cached grpcio-1.27.2-cp27-cp27mu-manylinux2010_x86_64.whl (2.6 MB)
Collecting protobuf>=3.5.0.post1
Using cached protobuf-3.11.3-cp27-cp27mu-manylinux1_x86_64.whl (1.3 MB)
Processing /home/jenkins/.cache/pip/wheels/0c/88/ac/41500883ea902d3409a83a827870a726346b5ebfd0523e91df/distlib-0.3.0-py2-none-any.whl
Collecting importlib-resources<2,>=1.0; python_version < "3.7"
Using cached importlib_resources-1.2.0-py2.py3-none-any.whl (31 kB)
Collecting pathlib2<3,>=2.3.3; python_version < "3.4" and sys_platform != "win32"
Using cached pathlib2-2.3.5-py2.py3-none-any.whl (18 kB)
Collecting contextlib2<1,>=0.6.0; python_version < "3.3"
Using cached contextlib2-0.6.0.post1-py2.py3-none-any.whl (9.8 kB)
Collecting appdirs<2,>=1.4.3
Using cached appdirs-1.4.3-py2.py3-none-any.whl (12 kB)
Collecting importlib-metadata<2,>=0.12; python_version < "3.8"
Using cached importlib_metadata-1.5.0-py2.py3-none-any.whl (30 kB)
Collecting enum34>=1.0.4; python_version < "3.4"
Using cached enum34-1.1.9-py2-none-any.whl (11 kB)
Collecting futures>=2.2.0; python_version < "3.2"
Using cached futures-3.3.0-py2-none-any.whl (16 kB)
Collecting singledispatch; python_version < "3.4"
Using cached singledispatch-3.4.0.3-py2.py3-none-any.whl (12 kB)
Collecting zipp>=0.4; python_version < "3.8"
Using cached zipp-1.2.0-py2.py3-none-any.whl (4.8 kB)
Collecting typing; python_version < "3.5"
Using cached typing-3.7.4.1-py2-none-any.whl (26 kB)
Processing /home/jenkins/.cache/pip/wheels/91/95/75/19c98a91239878abbc7c59970abd3b4e0438a7dd5b61778335/scandir-1.10.0-cp27-cp27mu-linux_x86_64.whl
Collecting configparser>=3.5; python_version < "3"
Using cached configparser-4.0.2-py2.py3-none-any.whl (22 kB)
Installing collected packages: six, filelock, distlib, singledispatch, scandir, pathlib2, contextlib2, zipp, configparser, importlib-metadata, typing, importlib-resources, appdirs, virtualenv, pluggy, py, toml, tox, enum34, futures, grpcio, protobuf, grpcio-tools, future, mypy-protobuf
ERROR: Could not install packages due to an EnvironmentError: [Errno 28] No space left on device
> Task :sdks:python:setupVirtualenv FAILED
> Task :sdks:python:apache_beam:testing:load_tests:setupVirtualenv
New python executable in <https://builds.apache.org/job/beam_LoadTests_Python_CoGBK_Dataflow_Batch/ws/src/build/gradleenv/1329484227/bin/python2.7>
Also creating executable in <https://builds.apache.org/job/beam_LoadTests_Python_CoGBK_Dataflow_Batch/ws/src/build/gradleenv/1329484227/bin/python>
Installing setuptools, pip, wheel...
done.
Running virtualenv with interpreter /usr/bin/python2.7
DEPRECATION: Python 2.7 reached the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 is no longer maintained. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support
Collecting tox==3.11.1
Using cached tox-3.11.1-py2.py3-none-any.whl (76 kB)
Collecting grpcio-tools<=1.14.2,>=1.3.5
Using cached grpcio_tools-1.14.2-cp27-cp27mu-manylinux1_x86_64.whl (22.2 MB)
Processing /home/jenkins/.cache/pip/wheels/bf/c9/a3/c538d90ef17cf7823fa51fc701a7a7a910a80f6a405bf15b1a/future-0.16.0-cp27-none-any.whl
Processing /home/jenkins/.cache/pip/wheels/45/c0/60/00682619a42655ca6ccd0c56343441f46e41a886476a34b7eb/mypy_protobuf-1.18-py2-none-any.whl
Collecting six<2,>=1.0.0
Using cached six-1.14.0-py2.py3-none-any.whl (10 kB)
Processing /home/jenkins/.cache/pip/wheels/66/13/60/ef107438d90e4aad6320e3424e50cfce5e16d1e9aad6d38294/filelock-3.0.12-cp27-none-any.whl
Collecting virtualenv>=14.0.0
Using cached virtualenv-20.0.8-py2.py3-none-any.whl (4.6 MB)
Collecting pluggy<1,>=0.3.0
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting py<2,>=1.4.17
Using cached py-1.8.1-py2.py3-none-any.whl (83 kB)
Collecting toml>=0.9.4
Using cached toml-0.10.0-py2.py3-none-any.whl (25 kB)
Requirement already satisfied, skipping upgrade: setuptools>=30.0.0 in <https://builds.apache.org/job/beam_LoadTests_Python_CoGBK_Dataflow_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from tox==3.11.1) (44.0.0)
Collecting grpcio>=1.14.2
Using cached grpcio-1.27.2-cp27-cp27mu-manylinux2010_x86_64.whl (2.6 MB)
Collecting protobuf>=3.5.0.post1
Using cached protobuf-3.11.3-cp27-cp27mu-manylinux1_x86_64.whl (1.3 MB)
Processing /home/jenkins/.cache/pip/wheels/0c/88/ac/41500883ea902d3409a83a827870a726346b5ebfd0523e91df/distlib-0.3.0-py2-none-any.whl
Collecting importlib-resources<2,>=1.0; python_version < "3.7"
Using cached importlib_resources-1.2.0-py2.py3-none-any.whl (31 kB)
Collecting pathlib2<3,>=2.3.3; python_version < "3.4" and sys_platform != "win32"
Using cached pathlib2-2.3.5-py2.py3-none-any.whl (18 kB)
Collecting contextlib2<1,>=0.6.0; python_version < "3.3"
Using cached contextlib2-0.6.0.post1-py2.py3-none-any.whl (9.8 kB)
Collecting appdirs<2,>=1.4.3
Using cached appdirs-1.4.3-py2.py3-none-any.whl (12 kB)
Collecting importlib-metadata<2,>=0.12; python_version < "3.8"
Using cached importlib_metadata-1.5.0-py2.py3-none-any.whl (30 kB)
Collecting enum34>=1.0.4; python_version < "3.4"
Using cached enum34-1.1.9-py2-none-any.whl (11 kB)
Collecting futures>=2.2.0; python_version < "3.2"
Using cached futures-3.3.0-py2-none-any.whl (16 kB)
Collecting singledispatch; python_version < "3.4"
Using cached singledispatch-3.4.0.3-py2.py3-none-any.whl (12 kB)
Collecting zipp>=0.4; python_version < "3.8"
Using cached zipp-1.2.0-py2.py3-none-any.whl (4.8 kB)
Collecting typing; python_version < "3.5"
Using cached typing-3.7.4.1-py2-none-any.whl (26 kB)
Processing /home/jenkins/.cache/pip/wheels/91/95/75/19c98a91239878abbc7c59970abd3b4e0438a7dd5b61778335/scandir-1.10.0-cp27-cp27mu-linux_x86_64.whl
Collecting configparser>=3.5; python_version < "3"
Using cached configparser-4.0.2-py2.py3-none-any.whl (22 kB)
Installing collected packages: six, filelock, distlib, singledispatch, scandir, pathlib2, contextlib2, zipp, configparser, importlib-metadata, typing, importlib-resources, appdirs, virtualenv, pluggy, py, toml, tox, enum34, futures, grpcio, protobuf, grpcio-tools, future, mypy-protobuf
Successfully installed appdirs-1.4.3 configparser-4.0.2 contextlib2-0.6.0.post1 distlib-0.3.0 enum34-1.1.9 filelock-3.0.12 future-0.16.0 futures-3.3.0 grpcio-1.27.2 grpcio-tools-1.14.2 importlib-metadata-1.5.0 importlib-resources-1.2.0 mypy-protobuf-1.18 pathlib2-2.3.5 pluggy-0.13.1 protobuf-3.11.3 py-1.8.1 scandir-1.10.0 singledispatch-3.4.0.3 six-1.14.0 toml-0.10.0 tox-3.11.1 typing-3.7.4.1 virtualenv-20.0.8 zipp-1.2.0
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:python:setupVirtualenv'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 30s
2 actionable tasks: 2 executed
Publishing build scan...
https://gradle.com/s/qpw5hcpfhariy
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal :
beam_LoadTests_Python_CoGBK_Dataflow_Batch #239
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_LoadTests_Python_CoGBK_Dataflow_Batch/239/display/redirect?page=changes>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org