You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2020/04/05 20:59:16 UTC
Build failed in Jenkins: beam_LoadTests_Python_ParDo_Flink_Batch
#193
See <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/193/display/redirect?page=changes>
Changes:
[robertwb] ResolveArtifact -> ResolveArtifacts
[robertwb] Regenerate protos.
[github] Merge pull request #11259: Use attachValues in SQL
------------------------------------------
[...truncated 116.16 KB...]
Successfully installed apache-beam-2.21.0.dev0 apipkg-1.5 atomicwrites-1.3.0 attrs-19.3.0 avro-1.9.2 boto3-1.12.36 botocore-1.15.36 cachetools-3.1.1 certifi-2020.4.5 chardet-3.0.4 crcmod-1.7 dill-0.3.1.1 docopt-0.6.2 docutils-0.15.2 execnet-1.7.1 fastavro-0.21.24 fasteners-0.15 freezegun-0.3.15 funcsigs-1.0.2 google-api-core-1.16.0 google-apitools-0.5.28 google-auth-1.13.1 google-cloud-bigquery-1.24.0 google-cloud-bigtable-1.0.0 google-cloud-core-1.3.0 google-cloud-datastore-1.7.4 google-cloud-dlp-0.13.0 google-cloud-language-1.3.0 google-cloud-pubsub-1.0.2 google-cloud-spanner-1.13.0 google-cloud-videointelligence-1.13.0 google-cloud-vision-0.42.0 google-resumable-media-0.5.0 googleapis-common-protos-1.51.0 googledatastore-7.0.2 grpc-google-iam-v1-0.12.3 grpcio-gcp-0.2.2 hdfs-2.5.8 httplib2-0.12.0 idna-2.9 jmespath-0.9.5 mock-2.0.0 monotonic-1.5 more-itertools-5.0.0 nose-1.3.7 nose-xunitmp-0.4.1 numpy-1.16.6 oauth2client-3.0.0 packaging-20.3 pandas-0.24.2 parameterized-0.7.1 pbr-5.4.4 proto-google-cloud-datastore-v1-0.90.4 pyarrow-0.16.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pydot-1.4.1 pyhamcrest-1.10.1 pymongo-3.10.1 pyparsing-2.4.6 pytest-4.6.9 pytest-forked-1.1.3 pytest-timeout-1.3.4 pytest-xdist-1.31.0 python-dateutil-2.8.1 pytz-2019.3 pyvcf-0.6.8 pyyaml-5.3.1 requests-2.23.0 requests-mock-1.7.0 rsa-4.0 s3transfer-0.3.3 tenacity-5.1.5 typing-extensions-3.7.4.2 urllib3-1.25.8 wcwidth-0.1.9
> Task :sdks:python:apache_beam:testing:load_tests:run
apache_beam/__init__.py:82: UserWarning: You are using Apache Beam with Python 2. New releases of Apache Beam will soon support Python 3 only.
'You are using Apache Beam with Python 2. '
WARNING:root:Make sure that locally built Python SDK docker image has Python 2.7 interpreter.
INFO:root:Using Python SDK docker image: apache/beam_python2.7_sdk:2.21.0.dev. If the image is not available at local, we will try to pull from hub.docker.com
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function lift_combiners at 0x7f86c4277398> ====================
WARNING:apache_beam.options.pipeline_options:Discarding unparseable args: ['--iterations=10', '--number_of_counter_operations=0', '--number_of_counters=0']
INFO:apache_beam.runners.portability.portable_runner:Job state changed to STOPPED
INFO:apache_beam.runners.portability.portable_runner:Job state changed to STARTING
INFO:apache_beam.runners.portability.portable_runner:Job state changed to RUNNING
INFO:apache_beam.runners.portability.portable_runner:Job state changed to DONE
INFO:apache_beam.testing.load_tests.load_test_metrics_utils:Load test results for test: e61f5cc887b34515926021c7ebf7b974 and timestamp: 1586117574.55:
INFO:apache_beam.testing.load_tests.load_test_metrics_utils:Metric: python_flink_batch_pardo_1_runtime Value: 630
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD SUCCESSFUL in 11m 43s
5 actionable tasks: 4 executed, 1 up-to-date
Publishing build scan...
https://gradle.com/s/s6w745zrpcrfk
[beam_LoadTests_Python_ParDo_Flink_Batch] $ /bin/bash -xe /tmp/jenkins4373593885309652517.sh
+ echo src ParDo Python Load test: 2GB 100 byte records 200 times src
src ParDo Python Load test: 2GB 100 byte records 200 times src
[Gradle] - Launching build.
[src] $ <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/gradlew> -PloadTest.mainClass=apache_beam.testing.load_tests.pardo_test -Prunner=PortableRunner '-PloadTest.args=--job_name=load-tests-python-flink-batch-pardo-2-0405100455 --project=apache-beam-testing --publish_to_big_query=true --metrics_dataset=load_test --metrics_table=python_flink_batch_pardo_2 --input_options='{"num_records": 20000000,"key_size": 10,"value_size": 90}' --iterations=200 --number_of_counter_operations=0 --number_of_counters=0 --parallelism=5 --job_endpoint=localhost:8099 --environment_config=gcr.io/apache-beam-testing/beam_portability/beam_python2.7_sdk:latest --environment_type=DOCKER --runner=PortableRunner' --continue --max-workers=12 -Dorg.gradle.jvmargs=-Xms2g -Dorg.gradle.jvmargs=-Xmx4g :sdks:python:apache_beam:testing:load_tests:run
> Task :buildSrc:compileJava NO-SOURCE
> Task :buildSrc:compileGroovy UP-TO-DATE
> Task :buildSrc:pluginDescriptors UP-TO-DATE
> Task :buildSrc:processResources UP-TO-DATE
> Task :buildSrc:classes UP-TO-DATE
> Task :buildSrc:jar UP-TO-DATE
> Task :buildSrc:assemble UP-TO-DATE
> Task :buildSrc:spotlessGroovy UP-TO-DATE
> Task :buildSrc:spotlessGroovyCheck UP-TO-DATE
> Task :buildSrc:spotlessGroovyGradle UP-TO-DATE
> Task :buildSrc:spotlessGroovyGradleCheck UP-TO-DATE
> Task :buildSrc:spotlessCheck UP-TO-DATE
> Task :buildSrc:pluginUnderTestMetadata UP-TO-DATE
> Task :buildSrc:compileTestJava NO-SOURCE
> Task :buildSrc:compileTestGroovy NO-SOURCE
> Task :buildSrc:processTestResources NO-SOURCE
> Task :buildSrc:testClasses UP-TO-DATE
> Task :buildSrc:test NO-SOURCE
> Task :buildSrc:validateTaskProperties UP-TO-DATE
> Task :buildSrc:check UP-TO-DATE
> Task :buildSrc:build UP-TO-DATE
Configuration on demand is an incubating feature.
> Task :sdks:python:setupVirtualenv UP-TO-DATE
> Task :sdks:python:apache_beam:testing:load_tests:setupVirtualenv UP-TO-DATE
> Task :sdks:python:sdist
setup.py:251: UserWarning: You are using Apache Beam with Python 2. New releases of Apache Beam will soon support Python 3 only.
'You are using Apache Beam with Python 2. '
<https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1922375555/local/lib/python2.7/site-packages/setuptools/dist.py>:476: UserWarning: Normalizing '2.21.0.dev' to '2.21.0.dev0'
normalized_version,
INFO:gen_protos:Skipping proto regeneration: all files up to date
warning: no files found matching 'README.md'
warning: no files found matching 'NOTICE'
warning: no files found matching 'LICENSE'
warning: sdist: standard file not found: should have one of README, README.rst, README.txt, README.md
> Task :sdks:python:apache_beam:testing:load_tests:installGcpTest
DEPRECATION: Python 2.7 reached the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 is no longer maintained. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support
Processing <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/sdks/python/build/apache-beam.tar.gz>
Requirement already satisfied: crcmod<2.0,>=1.7 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (1.7)
Requirement already satisfied: dill<0.3.2,>=0.3.1.1 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (0.3.1.1)
Requirement already satisfied: fastavro<0.22,>=0.21.4 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (0.21.24)
Requirement already satisfied: future<1.0.0,>=0.16.0 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (0.16.0)
Requirement already satisfied: grpcio<2,>=1.12.1 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (1.28.1)
Requirement already satisfied: hdfs<3.0.0,>=2.1.0 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (2.5.8)
Requirement already satisfied: httplib2<=0.12.0,>=0.8 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (0.12.0)
Requirement already satisfied: mock<3.0.0,>=1.0.1 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (2.0.0)
Requirement already satisfied: numpy<2,>=1.14.3 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (1.16.6)
Requirement already satisfied: pymongo<4.0.0,>=3.8.0 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (3.10.1)
Requirement already satisfied: oauth2client<4,>=2.0.1 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (3.0.0)
Requirement already satisfied: protobuf<4,>=3.5.0.post1 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (3.11.3)
Requirement already satisfied: pydot<2,>=1.2.0 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (1.4.1)
Requirement already satisfied: python-dateutil<3,>=2.8.0 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (2.8.1)
Requirement already satisfied: pytz>=2018.3 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (2019.3)
Requirement already satisfied: typing-extensions<3.8.0,>=3.7.0 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (3.7.4.2)
Requirement already satisfied: avro<1.10.0,>=1.8.1 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (1.9.2)
Requirement already satisfied: funcsigs<2,>=1.0.2 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (1.0.2)
Requirement already satisfied: futures<4.0.0,>=3.2.0 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (3.3.0)
Requirement already satisfied: pyvcf<0.7.0,>=0.6.8 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (0.6.8)
Requirement already satisfied: pyarrow<0.17.0,>=0.15.1 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (0.16.0)
Requirement already satisfied: typing<3.8.0,>=3.7.0 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (3.7.4.1)
Requirement already satisfied: boto3>=1.9 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (1.12.36)
Requirement already satisfied: cachetools<4,>=3.1.0 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (3.1.1)
Requirement already satisfied: google-apitools<0.5.29,>=0.5.28 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (0.5.28)
Requirement already satisfied: google-cloud-datastore<1.8.0,>=1.7.1 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (1.7.4)
Requirement already satisfied: google-cloud-pubsub<1.1.0,>=0.39.0 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (1.0.2)
Requirement already satisfied: google-cloud-bigquery<=1.24.0,>=1.6.0 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (1.24.0)
Requirement already satisfied: google-cloud-core<2,>=0.28.1 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (1.3.0)
Requirement already satisfied: google-cloud-bigtable<1.1.0,>=0.31.1 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (1.0.0)
Requirement already satisfied: google-cloud-spanner<1.14.0,>=1.13.0 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (1.13.0)
Requirement already satisfied: grpcio-gcp<1,>=0.2.2 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (0.2.2)
Requirement already satisfied: google-cloud-dlp<=0.13.0,>=0.12.0 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (0.13.0)
Requirement already satisfied: google-cloud-language<2,>=1.3.0 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (1.3.0)
Requirement already satisfied: google-cloud-videointelligence<1.14.0,>=1.8.0 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (1.13.0)
Requirement already satisfied: google-cloud-vision<0.43.0,>=0.38.0 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (0.42.0)
Requirement already satisfied: googledatastore<7.1,>=7.0.1 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (7.0.2)
Requirement already satisfied: proto-google-cloud-datastore-v1<=0.90.4,>=0.90.0 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (0.90.4)
Requirement already satisfied: freezegun>=0.3.12 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (0.3.15)
Requirement already satisfied: nose>=1.3.7 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (1.3.7)
Requirement already satisfied: nose_xunitmp>=0.4.1 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (0.4.1)
Requirement already satisfied: pandas<0.25,>=0.23.4 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (0.24.2)
Requirement already satisfied: parameterized<0.8.0,>=0.7.1 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (0.7.1)
Requirement already satisfied: pyhamcrest!=1.10.0,<2.0.0,>=1.9 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (1.10.1)
Requirement already satisfied: pyyaml<6.0.0,>=3.12 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (5.3.1)
Requirement already satisfied: requests_mock<2.0,>=1.7 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (1.7.0)
Requirement already satisfied: tenacity<6.0,>=5.0.2 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (5.1.5)
Requirement already satisfied: pytest<5.0,>=4.4.0 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (4.6.9)
Requirement already satisfied: pytest-xdist<2,>=1.29.0 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (1.31.0)
Requirement already satisfied: pytest-timeout<2,>=1.3.3 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (1.3.4)
Requirement already satisfied: six>=1.5.2 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from grpcio<2,>=1.12.1->apache-beam==2.21.0.dev0) (1.14.0)
Requirement already satisfied: enum34>=1.0.4; python_version < "3.4" in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from grpcio<2,>=1.12.1->apache-beam==2.21.0.dev0) (1.1.10)
Requirement already satisfied: docopt in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from hdfs<3.0.0,>=2.1.0->apache-beam==2.21.0.dev0) (0.6.2)
Requirement already satisfied: requests>=2.7.0 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from hdfs<3.0.0,>=2.1.0->apache-beam==2.21.0.dev0) (2.23.0)
Requirement already satisfied: pbr>=0.11 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from mock<3.0.0,>=1.0.1->apache-beam==2.21.0.dev0) (5.4.4)
Requirement already satisfied: rsa>=3.1.4 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from oauth2client<4,>=2.0.1->apache-beam==2.21.0.dev0) (4.0)
Requirement already satisfied: pyasn1>=0.1.7 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from oauth2client<4,>=2.0.1->apache-beam==2.21.0.dev0) (0.4.8)
Requirement already satisfied: pyasn1-modules>=0.0.5 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from oauth2client<4,>=2.0.1->apache-beam==2.21.0.dev0) (0.2.8)
Requirement already satisfied: setuptools in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from protobuf<4,>=3.5.0.post1->apache-beam==2.21.0.dev0) (44.1.0)
Requirement already satisfied: pyparsing>=2.1.4 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from pydot<2,>=1.2.0->apache-beam==2.21.0.dev0) (2.4.6)
Requirement already satisfied: s3transfer<0.4.0,>=0.3.0 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from boto3>=1.9->apache-beam==2.21.0.dev0) (0.3.3)
Requirement already satisfied: botocore<1.16.0,>=1.15.36 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from boto3>=1.9->apache-beam==2.21.0.dev0) (1.15.36)
Requirement already satisfied: jmespath<1.0.0,>=0.7.1 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from boto3>=1.9->apache-beam==2.21.0.dev0) (0.9.5)
Requirement already satisfied: fasteners>=0.14 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from google-apitools<0.5.29,>=0.5.28->apache-beam==2.21.0.dev0) (0.15)
Requirement already satisfied: google-api-core[grpc]<2.0.0dev,>=1.6.0 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from google-cloud-datastore<1.8.0,>=1.7.1->apache-beam==2.21.0.dev0) (1.16.0)
Requirement already satisfied: grpc-google-iam-v1<0.13dev,>=0.12.3 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from google-cloud-pubsub<1.1.0,>=0.39.0->apache-beam==2.21.0.dev0) (0.12.3)
Requirement already satisfied: google-auth<2.0dev,>=1.9.0 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from google-cloud-bigquery<=1.24.0,>=1.6.0->apache-beam==2.21.0.dev0) (1.13.1)
Requirement already satisfied: google-resumable-media<0.6dev,>=0.5.0 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from google-cloud-bigquery<=1.24.0,>=1.6.0->apache-beam==2.21.0.dev0) (0.5.0)
Requirement already satisfied: googleapis-common-protos<2.0dev,>=1.5.2 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from proto-google-cloud-datastore-v1<=0.90.4,>=0.90.0->apache-beam==2.21.0.dev0) (1.51.0)
Requirement already satisfied: monotonic>=0.6; python_version == "2.7" in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from tenacity<6.0,>=5.0.2->apache-beam==2.21.0.dev0) (1.5)
Requirement already satisfied: atomicwrites>=1.0 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.21.0.dev0) (1.3.0)
Requirement already satisfied: pluggy<1.0,>=0.12 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.21.0.dev0) (0.13.1)
Requirement already satisfied: packaging in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.21.0.dev0) (20.3)
Requirement already satisfied: attrs>=17.4.0 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.21.0.dev0) (19.3.0)
Requirement already satisfied: importlib-metadata>=0.12; python_version < "3.8" in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.21.0.dev0) (1.6.0)
Requirement already satisfied: wcwidth in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.21.0.dev0) (0.1.9)
Requirement already satisfied: more-itertools<6.0.0,>=4.0.0; python_version <= "2.7" in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.21.0.dev0) (5.0.0)
Requirement already satisfied: pathlib2>=2.2.0; python_version < "3.6" in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.21.0.dev0) (2.3.5)
Requirement already satisfied: py>=1.5.0 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.21.0.dev0) (1.8.1)
Requirement already satisfied: pytest-forked in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from pytest-xdist<2,>=1.29.0->apache-beam==2.21.0.dev0) (1.1.3)
Requirement already satisfied: execnet>=1.1 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from pytest-xdist<2,>=1.29.0->apache-beam==2.21.0.dev0) (1.7.1)
Requirement already satisfied: certifi>=2017.4.17 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.21.0.dev0) (2020.4.5)
Requirement already satisfied: idna<3,>=2.5 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.21.0.dev0) (2.9)
Requirement already satisfied: chardet<4,>=3.0.2 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.21.0.dev0) (3.0.4)
Requirement already satisfied: urllib3!=1.25.0,!=1.25.1,<1.26,>=1.21.1 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.21.0.dev0) (1.25.8)
Requirement already satisfied: docutils<0.16,>=0.10 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from botocore<1.16.0,>=1.15.36->boto3>=1.9->apache-beam==2.21.0.dev0) (0.15.2)
Requirement already satisfied: contextlib2; python_version < "3" in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from importlib-metadata>=0.12; python_version < "3.8"->pytest<5.0,>=4.4.0->apache-beam==2.21.0.dev0) (0.6.0.post1)
Requirement already satisfied: zipp>=0.5 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from importlib-metadata>=0.12; python_version < "3.8"->pytest<5.0,>=4.4.0->apache-beam==2.21.0.dev0) (1.2.0)
Requirement already satisfied: configparser>=3.5; python_version < "3" in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from importlib-metadata>=0.12; python_version < "3.8"->pytest<5.0,>=4.4.0->apache-beam==2.21.0.dev0) (4.0.2)
Requirement already satisfied: scandir; python_version < "3.5" in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from pathlib2>=2.2.0; python_version < "3.6"->pytest<5.0,>=4.4.0->apache-beam==2.21.0.dev0) (1.10.0)
Requirement already satisfied: apipkg>=1.4 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from execnet>=1.1->pytest-xdist<2,>=1.29.0->apache-beam==2.21.0.dev0) (1.5)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.21.0.dev0-py2-none-any.whl size=2039086 sha256=b415cd72c837daad69d44ca1f7c103e99d793c147567a6e6eb441db431295612
Stored in directory: /home/jenkins/.cache/pip/wheels/c5/a5/04/75eeeeddf3911b5dadec5d4f94a9900a9b8a283eaf5fc786e2
Successfully built apache-beam
Installing collected packages: apache-beam
Attempting uninstall: apache-beam
Found existing installation: apache-beam 2.21.0.dev0
Uninstalling apache-beam-2.21.0.dev0:
Successfully uninstalled apache-beam-2.21.0.dev0
Successfully installed apache-beam-2.21.0.dev0
> Task :sdks:python:apache_beam:testing:load_tests:run
apache_beam/__init__.py:82: UserWarning: You are using Apache Beam with Python 2. New releases of Apache Beam will soon support Python 3 only.
'You are using Apache Beam with Python 2. '
WARNING:root:Make sure that locally built Python SDK docker image has Python 2.7 interpreter.
INFO:root:Using Python SDK docker image: apache/beam_python2.7_sdk:2.21.0.dev. If the image is not available at local, we will try to pull from hub.docker.com
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function lift_combiners at 0x7f4b678cb398> ====================
WARNING:apache_beam.options.pipeline_options:Discarding unparseable args: ['--iterations=200', '--number_of_counter_operations=0', '--number_of_counters=0']
INFO:apache_beam.runners.portability.portable_runner:Job state changed to STOPPED
INFO:apache_beam.runners.portability.portable_runner:Job state changed to STARTING
INFO:apache_beam.runners.portability.portable_runner:Job state changed to RUNNING
Terminated
> Task :sdks:python:apache_beam:testing:load_tests:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/sdks/python/apache_beam/testing/load_tests/build.gradle'> line: 51
* What went wrong:
Execution failed for task ':sdks:python:apache_beam:testing:load_tests:run'.
> error occurred
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 46m 16s
5 actionable tasks: 3 executed, 2 up-to-date
The message received from the daemon indicates that the daemon has disappeared.
Build request sent: Build{id=14dbe55f-2f29-43cf-9dc5-cb765bc7af0c, currentDir=<https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src}>
Attempting to read last messages from the daemon log...
Daemon pid: 8268
log file: /home/jenkins/.gradle/daemon/5.2.1/daemon-8268.out.log
----- Last 20 lines from daemon log file - daemon-8268.out.log -----
* Where:
Build file '<https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/sdks/python/apache_beam/testing/load_tests/build.gradle'> line: 51
* What went wrong:
Execution failed for task ':sdks:python:apache_beam:testing:load_tests:run'.
> error occurred
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 46m 16s
5 actionable tasks: 3 executed, 2 up-to-date
Daemon vm is shutting down... The daemon has exited normally or was terminated in response to a user interrupt.
----- End of the daemon log -----
FAILURE: Build failed with an exception.
* What went wrong:
Gradle build daemon disappeared unexpectedly (it may have been killed or may have crashed)
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal :
beam_LoadTests_Python_ParDo_Flink_Batch #197
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/197/display/redirect?page=changes>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Python_ParDo_Flink_Batch
#196
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/196/display/redirect?page=changes>
Changes:
[ehudm] [BEAM-5422] Document DynamicDestinations.getTable uniqueness requirement
[github] Merge pull request #11226: [BEAM-9557] Fix timer window boundary
[github] Merge pull request #11244 from [BEAM-3097] _ReadFromBigQuery supports
[pabloem] [BEAM-9691] Ensuring BQSource is avoided on FnApi
[pabloem] [BEAM-9715] Ensuring annotations_test passes in all
[github] Name the pipeline_v1 proto import
[github] Update materialize_test.go
[ankurgoenka] [BEAM-9707] Hardcode Unified harness image for fixing dataflow VR 2
[rohde.samuel] Fix flaky interactive_runner_test
[github] Merge pull request #11205 [BEAM-9578] Defer expensive artifact
[robertwb] Update go protos.
[github] Fix some Go SDK linter/vet warnings. (#11330)
[robertwb] [BEAM-9577] Plumb resources through Python job service and runner.
[robertwb] [BEAM-9618] Pull bundle descriptors for Go.
[github] [BEAM-9529] Remove datastore.v1, googledatastore (#11175)
------------------------------------------
[...truncated 46.56 KB...]
b40cd12f4134: Pushed
81939317e0e8: Pushed
cf87579981a6: Pushed
cc3f3e5657b7: Pushed
1048e518159c: Layer already exists
674812c02559: Layer already exists
d485cbbe6a5e: Layer already exists
3ca8339af604: Layer already exists
588545a7a2a3: Layer already exists
8452468a5e50: Layer already exists
55b19a5e648f: Layer already exists
e0f304f7f744: Layer already exists
391c89959588: Layer already exists
6e54383eb202: Pushed
0090b23dd0d2: Pushed
latest: digest: sha256:ff164440067ee509893e02b77ccf78db078dda6ea4c24d639837e7ff7faf010a size: 4733
[Gradle] - Launching build.
[src] $ <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/gradlew> --continue --max-workers=12 -Dorg.gradle.jvmargs=-Xms2g -Dorg.gradle.jvmargs=-Xmx4g -Pdocker-repository-root=gcr.io/apache-beam-testing/beam_portability -Pdocker-tag=latest :runners:flink:1.10:job-server-container:docker
> Task :buildSrc:compileJava NO-SOURCE
> Task :buildSrc:compileGroovy UP-TO-DATE
> Task :buildSrc:pluginDescriptors UP-TO-DATE
> Task :buildSrc:processResources UP-TO-DATE
> Task :buildSrc:classes UP-TO-DATE
> Task :buildSrc:jar UP-TO-DATE
> Task :buildSrc:assemble UP-TO-DATE
> Task :buildSrc:spotlessGroovy UP-TO-DATE
> Task :buildSrc:spotlessGroovyCheck UP-TO-DATE
> Task :buildSrc:spotlessGroovyGradle UP-TO-DATE
> Task :buildSrc:spotlessGroovyGradleCheck UP-TO-DATE
> Task :buildSrc:spotlessCheck UP-TO-DATE
> Task :buildSrc:pluginUnderTestMetadata UP-TO-DATE
> Task :buildSrc:compileTestJava NO-SOURCE
> Task :buildSrc:compileTestGroovy NO-SOURCE
> Task :buildSrc:processTestResources NO-SOURCE
> Task :buildSrc:testClasses UP-TO-DATE
> Task :buildSrc:test NO-SOURCE
> Task :buildSrc:validateTaskProperties UP-TO-DATE
> Task :buildSrc:check UP-TO-DATE
> Task :buildSrc:build UP-TO-DATE
Configuration on demand is an incubating feature.
> Task :sdks:java:core:generateAvroProtocol NO-SOURCE
> Task :runners:core-java:processResources NO-SOURCE
> Task :vendor:sdks-java-extensions-protobuf:processResources NO-SOURCE
> Task :sdks:java:fn-execution:processResources NO-SOURCE
> Task :runners:core-construction-java:processResources NO-SOURCE
> Task :sdks:java:expansion-service:processResources NO-SOURCE
> Task :sdks:java:core:generateAvroJava NO-SOURCE
> Task :runners:java-fn-execution:processResources NO-SOURCE
> Task :sdks:java:extensions:google-cloud-platform-core:processResources NO-SOURCE
> Task :sdks:java:harness:processResources NO-SOURCE
> Task :runners:flink:1.10:copyResourcesOverrides NO-SOURCE
> Task :runners:flink:1.10:job-server:processResources NO-SOURCE
> Task :sdks:java:io:google-cloud-platform:processResources NO-SOURCE
> Task :sdks:java:io:kafka:processResources NO-SOURCE
> Task :model:fn-execution:extractProto
> Task :model:job-management:extractProto
> Task :runners:flink:1.10:job-server-container:copyLicenses
> Task :sdks:java:extensions:protobuf:extractProto
> Task :runners:flink:1.10:job-server-container:dockerClean UP-TO-DATE
> Task :sdks:java:extensions:protobuf:processResources NO-SOURCE
> Task :model:job-management:processResources
> Task :model:fn-execution:processResources
> Task :sdks:java:core:generateGrammarSource FROM-CACHE
> Task :runners:flink:1.10:copySourceOverrides
> Task :runners:flink:1.10:copyTestResourcesOverrides NO-SOURCE
> Task :runners:flink:1.10:processResources
> Task :sdks:java:build-tools:compileJava FROM-CACHE
> Task :sdks:java:build-tools:processResources
> Task :sdks:java:build-tools:classes
> Task :sdks:java:build-tools:jar
> Task :sdks:java:core:processResources
> Task :model:pipeline:extractIncludeProto
> Task :model:pipeline:extractProto
> Task :model:pipeline:generateProto
> Task :model:pipeline:compileJava FROM-CACHE
> Task :model:pipeline:processResources
> Task :model:pipeline:classes
> Task :model:pipeline:jar
> Task :model:job-management:extractIncludeProto
> Task :model:fn-execution:extractIncludeProto
> Task :model:job-management:generateProto
> Task :model:fn-execution:generateProto
> Task :model:job-management:compileJava FROM-CACHE
> Task :model:job-management:classes
> Task :model:fn-execution:compileJava FROM-CACHE
> Task :model:fn-execution:classes
> Task :model:pipeline:shadowJar
> Task :model:job-management:shadowJar
> Task :model:fn-execution:shadowJar
> Task :sdks:java:core:compileJava FROM-CACHE
> Task :sdks:java:core:classes
> Task :sdks:java:core:shadowJar
> Task :sdks:java:extensions:google-cloud-platform-core:compileJava FROM-CACHE
> Task :sdks:java:extensions:google-cloud-platform-core:classes UP-TO-DATE
> Task :sdks:java:extensions:google-cloud-platform-core:jar
> Task :sdks:java:extensions:protobuf:extractIncludeProto
> Task :sdks:java:extensions:protobuf:generateProto NO-SOURCE
> Task :vendor:sdks-java-extensions-protobuf:compileJava FROM-CACHE
> Task :vendor:sdks-java-extensions-protobuf:classes UP-TO-DATE
> Task :sdks:java:extensions:protobuf:compileJava FROM-CACHE
> Task :sdks:java:extensions:protobuf:classes UP-TO-DATE
> Task :sdks:java:extensions:protobuf:jar
> Task :runners:core-construction-java:compileJava FROM-CACHE
> Task :runners:core-construction-java:classes UP-TO-DATE
> Task :sdks:java:fn-execution:compileJava FROM-CACHE
> Task :sdks:java:fn-execution:classes UP-TO-DATE
> Task :vendor:sdks-java-extensions-protobuf:shadowJar
> Task :sdks:java:fn-execution:jar
> Task :runners:core-construction-java:jar
> Task :sdks:java:expansion-service:compileJava FROM-CACHE
> Task :sdks:java:expansion-service:classes UP-TO-DATE
> Task :sdks:java:expansion-service:jar
> Task :sdks:java:io:kafka:compileJava FROM-CACHE
> Task :sdks:java:io:kafka:classes UP-TO-DATE
> Task :runners:core-java:compileJava FROM-CACHE
> Task :runners:core-java:classes UP-TO-DATE
> Task :sdks:java:io:kafka:jar
> Task :runners:core-java:jar
> Task :sdks:java:io:google-cloud-platform:compileJava FROM-CACHE
> Task :sdks:java:io:google-cloud-platform:classes UP-TO-DATE
> Task :sdks:java:harness:compileJava FROM-CACHE
> Task :sdks:java:harness:classes UP-TO-DATE
> Task :sdks:java:harness:jar
> Task :sdks:java:io:google-cloud-platform:jar
> Task :sdks:java:harness:shadowJar
> Task :runners:java-fn-execution:compileJava FROM-CACHE
> Task :runners:java-fn-execution:classes UP-TO-DATE
> Task :runners:java-fn-execution:jar
> Task :runners:flink:1.10:compileJava FROM-CACHE
> Task :runners:flink:1.10:classes
> Task :runners:flink:1.10:jar
> Task :runners:flink:1.10:job-server:compileJava NO-SOURCE
> Task :runners:flink:1.10:job-server:classes UP-TO-DATE
> Task :runners:flink:1.10:job-server:shadowJar
> Task :runners:flink:1.10:job-server-container:copyDockerfileDependencies
> Task :runners:flink:1.10:job-server-container:dockerPrepare
> Task :runners:flink:1.10:job-server-container:docker
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD SUCCESSFUL in 1m 12s
61 actionable tasks: 42 executed, 18 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/mewd77xk2lltk
[beam_LoadTests_Python_ParDo_Flink_Batch] $ /bin/bash -xe /tmp/jenkins3393340728201860540.sh
+ echo 'Tagging image...'
Tagging image...
[beam_LoadTests_Python_ParDo_Flink_Batch] $ /bin/bash -xe /tmp/jenkins2031663417763367917.sh
+ docker tag gcr.io/apache-beam-testing/beam_portability/beam_flink1.10_job_server gcr.io/apache-beam-testing/beam_portability/beam_flink1.10_job_server:latest
[beam_LoadTests_Python_ParDo_Flink_Batch] $ /bin/bash -xe /tmp/jenkins6046136371001216743.sh
+ echo 'Pushing image...'
Pushing image...
[beam_LoadTests_Python_ParDo_Flink_Batch] $ /bin/bash -xe /tmp/jenkins626944237689240129.sh
+ docker push gcr.io/apache-beam-testing/beam_portability/beam_flink1.10_job_server:latest
The push refers to repository [gcr.io/apache-beam-testing/beam_portability/beam_flink1.10_job_server]
f72f3f4ab589: Preparing
0edc3b033635: Preparing
88ed4f088853: Preparing
4c6968473e50: Preparing
8f4649bbb675: Preparing
892007193bb6: Preparing
e811ee12aa10: Preparing
23f8d486123a: Preparing
afae6f50abb9: Preparing
136a15f81f25: Preparing
185574602537: Preparing
24efcd549ab5: Preparing
892007193bb6: Waiting
136a15f81f25: Waiting
185574602537: Waiting
e811ee12aa10: Waiting
24efcd549ab5: Waiting
afae6f50abb9: Waiting
23f8d486123a: Waiting
0edc3b033635: Pushed
892007193bb6: Layer already exists
8f4649bbb675: Pushed
88ed4f088853: Pushed
f72f3f4ab589: Pushed
e811ee12aa10: Layer already exists
23f8d486123a: Layer already exists
24efcd549ab5: Layer already exists
afae6f50abb9: Layer already exists
136a15f81f25: Layer already exists
185574602537: Layer already exists
4c6968473e50: Pushed
latest: digest: sha256:ca99371e52b6040f59c3f8d1c95546ac0ae5827f8e2346264f9a4afd0affbd31 size: 2841
[EnvInject] - Injecting environment variables from a build step.
[EnvInject] - Injecting as environment variables the properties content
JOB_SERVER_IMAGE=gcr.io/apache-beam-testing/beam_portability/beam_flink1.10_job_server:latest
CLUSTER_NAME=beam-loadtests-python-pardo-flink-batch-196
DETACHED_MODE=true
HARNESS_IMAGES_TO_PULL=gcr.io/apache-beam-testing/beam_portability/beam_python2.7_sdk:latest
FLINK_NUM_WORKERS=5
FLINK_DOWNLOAD_URL=https://archive.apache.org/dist/flink/flink-1.10.0/flink-1.10.0-bin-scala_2.11.tgz
GCS_BUCKET=gs://beam-flink-cluster
HADOOP_DOWNLOAD_URL=https://repo.maven.apache.org/maven2/org/apache/flink/flink-shaded-hadoop-2-uber/2.8.3-9.0/flink-shaded-hadoop-2-uber-2.8.3-9.0.jar
FLINK_TASKMANAGER_SLOTS=1
ARTIFACTS_DIR=gs://beam-flink-cluster/beam-loadtests-python-pardo-flink-batch-196
GCLOUD_ZONE=us-central1-a
[EnvInject] - Variables injected successfully.
[beam_LoadTests_Python_ParDo_Flink_Batch] $ /bin/bash -xe /tmp/jenkins7220599708648877615.sh
+ echo Setting up flink cluster
Setting up flink cluster
[beam_LoadTests_Python_ParDo_Flink_Batch] $ /bin/bash -xe /tmp/jenkins1586901850688874661.sh
+ cd <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/.test-infra/dataproc>
+ ./flink_cluster.sh create
+ GCLOUD_ZONE=us-central1-a
+ DATAPROC_VERSION=1.2
+ MASTER_NAME=beam-loadtests-python-pardo-flink-batch-196-m
+ INIT_ACTIONS_FOLDER_NAME=init-actions
+ FLINK_INIT=gs://beam-flink-cluster/init-actions/flink.sh
+ BEAM_INIT=gs://beam-flink-cluster/init-actions/beam.sh
+ DOCKER_INIT=gs://beam-flink-cluster/init-actions/docker.sh
+ FLINK_LOCAL_PORT=8081
+ FLINK_TASKMANAGER_SLOTS=1
+ TASK_MANAGER_MEM=10240
+ YARN_APPLICATION_MASTER=
+ create
+ upload_init_actions
+ echo 'Uploading initialization actions to GCS bucket: gs://beam-flink-cluster'
Uploading initialization actions to GCS bucket: gs://beam-flink-cluster
+ gsutil cp -r init-actions/beam.sh init-actions/docker.sh init-actions/flink.sh gs://beam-flink-cluster/init-actions
Copying file://init-actions/beam.sh [Content-Type=text/x-sh]...
/ [0 files][ 0.0 B/ 2.3 KiB] / [1 files][ 2.3 KiB/ 2.3 KiB] Copying file://init-actions/docker.sh [Content-Type=text/x-sh]...
/ [1 files][ 2.3 KiB/ 6.0 KiB] / [2 files][ 6.0 KiB/ 6.0 KiB] Copying file://init-actions/flink.sh [Content-Type=text/x-sh]...
/ [2 files][ 6.0 KiB/ 13.3 KiB] -- [3 files][ 13.3 KiB/ 13.3 KiB]
Operation completed over 3 objects/13.3 KiB.
+ create_cluster
+ local metadata=flink-snapshot-url=https://archive.apache.org/dist/flink/flink-1.10.0/flink-1.10.0-bin-scala_2.11.tgz,
+ metadata+=flink-start-yarn-session=true,
+ metadata+=flink-taskmanager-slots=1,
+ metadata+=hadoop-jar-url=https://repo.maven.apache.org/maven2/org/apache/flink/flink-shaded-hadoop-2-uber/2.8.3-9.0/flink-shaded-hadoop-2-uber-2.8.3-9.0.jar
+ [[ -n gcr.io/apache-beam-testing/beam_portability/beam_python2.7_sdk:latest ]]
+ metadata+=,beam-sdk-harness-images-to-pull=gcr.io/apache-beam-testing/beam_portability/beam_python2.7_sdk:latest
+ [[ -n gcr.io/apache-beam-testing/beam_portability/beam_flink1.10_job_server:latest ]]
+ metadata+=,beam-job-server-image=gcr.io/apache-beam-testing/beam_portability/beam_flink1.10_job_server:latest
+ local image_version=1.2
+ echo 'Starting dataproc cluster. Dataproc version: 1.2'
Starting dataproc cluster. Dataproc version: 1.2
+ local num_dataproc_workers=6
+ gcloud dataproc clusters create beam-loadtests-python-pardo-flink-batch-196 --region=global --num-workers=6 --initialization-actions gs://beam-flink-cluster/init-actions/docker.sh,gs://beam-flink-cluster/init-actions/beam.sh,gs://beam-flink-cluster/init-actions/flink.sh --metadata flink-snapshot-url=https://archive.apache.org/dist/flink/flink-1.10.0/flink-1.10.0-bin-scala_2.11.tgz,flink-start-yarn-session=true,flink-taskmanager-slots=1,hadoop-jar-url=https://repo.maven.apache.org/maven2/org/apache/flink/flink-shaded-hadoop-2-uber/2.8.3-9.0/flink-shaded-hadoop-2-uber-2.8.3-9.0.jar,beam-sdk-harness-images-to-pull=gcr.io/apache-beam-testing/beam_portability/beam_python2.7_sdk:latest,beam-job-server-image=gcr.io/apache-beam-testing/beam_portability/beam_flink1.10_job_server:latest, --image-version=1.2 --zone=us-central1-a --quiet
ERROR: (gcloud.dataproc.clusters.create) UNAVAILABLE: The service is currently unavailable.
Build step 'Execute shell' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Python_ParDo_Flink_Batch
#195
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/195/display/redirect?page=changes>
Changes:
[echauchot] [BEAM-5980] Change load-tests build to include spark-sql for spark
[echauchot] [BEAM-9436] avoid one flatmap step and a KV creation per element by
[kcweaver] [BEAM-9199] Require Dataflow --region in Python SDK.
[kcweaver] Add --region to tests where needed.
[kcweaver] [BEAM-9199] Require --region option for Dataflow in Java SDK.
[kcweaver] Add --region to Java GCP tests.
[kcweaver] Fix DataflowRunnerTest.
[kcweaver] Fix more Java unit tests missing --region.
[kcweaver] Add --region to DF streaming example tests.
[kcweaver] Add unit tests for get_default_gcp_region
[kcweaver] Add --region to Dataflow runner webpage.
[kcweaver] lint
[kcweaver] Add --region to more Java tests and examples.
[kcweaver] Add --region to more Python tests and examples.
[kcweaver] format
[valentyn] Fixes platform-dependent assumptions in subprocess_server_test.py.
[valentyn] Switches a test helper to a Py3-version thereof.
[alex] Add Beam Schema Options to changelog
[alex] [BEAM-9704] Deprecate FieldType metadata
[eekkaaadrian] [BEAM-9705] Go sdk add value length validation checking on write to
[kcweaver] Remove unrecognized --region option from non-DF tests.
[robertwb] [BEAM-9618] Add protocol for requesting process bundle descriptors.
[robertwb] [BEAM-9618] Update Python to support process bundle descriptor fetching.
[robertwb] [BEAM-9618] Java FnApiClient support for process bundle descriptor
[github] [BEAM-8019] Python SDK support for cross-langauge pipelines in Dataflow.
[robertwb] Typo fix.
[github] remove nose (#11307)
[lcwik] [BEAM-4374, BEAM-6189] Delete and remove deprecated Metrics proto
[ecapoccia] [BEAM-9434] Improve Spark runner reshuffle translation to maximize
[github] [BEAM-9685] remove Go SDK container from release process (#11308)
------------------------------------------
[...truncated 145.36 KB...]
Requirement already satisfied: packaging in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.21.0.dev0) (20.3)
Requirement already satisfied: attrs>=17.4.0 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.21.0.dev0) (19.3.0)
Requirement already satisfied: importlib-metadata>=0.12; python_version < "3.8" in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.21.0.dev0) (1.6.0)
Requirement already satisfied: wcwidth in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.21.0.dev0) (0.1.9)
Requirement already satisfied: more-itertools<6.0.0,>=4.0.0; python_version <= "2.7" in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.21.0.dev0) (5.0.0)
Requirement already satisfied: pathlib2>=2.2.0; python_version < "3.6" in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.21.0.dev0) (2.3.5)
Requirement already satisfied: py>=1.5.0 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.21.0.dev0) (1.8.1)
Requirement already satisfied: pytest-forked in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from pytest-xdist<2,>=1.29.0->apache-beam==2.21.0.dev0) (1.1.3)
Requirement already satisfied: execnet>=1.1 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from pytest-xdist<2,>=1.29.0->apache-beam==2.21.0.dev0) (1.7.1)
Requirement already satisfied: certifi>=2017.4.17 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.21.0.dev0) (2020.4.5.1)
Requirement already satisfied: idna<3,>=2.5 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.21.0.dev0) (2.9)
Requirement already satisfied: chardet<4,>=3.0.2 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.21.0.dev0) (3.0.4)
Requirement already satisfied: urllib3!=1.25.0,!=1.25.1,<1.26,>=1.21.1 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.21.0.dev0) (1.25.8)
Requirement already satisfied: docutils<0.16,>=0.10 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from botocore<1.16.0,>=1.15.37->boto3>=1.9->apache-beam==2.21.0.dev0) (0.15.2)
Requirement already satisfied: contextlib2; python_version < "3" in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from importlib-metadata>=0.12; python_version < "3.8"->pytest<5.0,>=4.4.0->apache-beam==2.21.0.dev0) (0.6.0.post1)
Requirement already satisfied: zipp>=0.5 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from importlib-metadata>=0.12; python_version < "3.8"->pytest<5.0,>=4.4.0->apache-beam==2.21.0.dev0) (1.2.0)
Requirement already satisfied: configparser>=3.5; python_version < "3" in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from importlib-metadata>=0.12; python_version < "3.8"->pytest<5.0,>=4.4.0->apache-beam==2.21.0.dev0) (4.0.2)
Requirement already satisfied: scandir; python_version < "3.5" in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from pathlib2>=2.2.0; python_version < "3.6"->pytest<5.0,>=4.4.0->apache-beam==2.21.0.dev0) (1.10.0)
Requirement already satisfied: apipkg>=1.4 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from execnet>=1.1->pytest-xdist<2,>=1.29.0->apache-beam==2.21.0.dev0) (1.5)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.21.0.dev0-py2-none-any.whl size=2038814 sha256=2a857026be43d659f9b9f49baabdc41154de58c19337989350e300245901d71a
Stored in directory: /home/jenkins/.cache/pip/wheels/c5/a5/04/75eeeeddf3911b5dadec5d4f94a9900a9b8a283eaf5fc786e2
Successfully built apache-beam
Installing collected packages: apache-beam
Attempting uninstall: apache-beam
Found existing installation: apache-beam 2.21.0.dev0
Uninstalling apache-beam-2.21.0.dev0:
Successfully uninstalled apache-beam-2.21.0.dev0
Successfully installed apache-beam-2.21.0.dev0
> Task :sdks:python:apache_beam:testing:load_tests:run
apache_beam/__init__.py:82: UserWarning: You are using Apache Beam with Python 2. New releases of Apache Beam will soon support Python 3 only.
'You are using Apache Beam with Python 2. '
WARNING:root:Make sure that locally built Python SDK docker image has Python 2.7 interpreter.
INFO:root:Using Python SDK docker image: apache/beam_python2.7_sdk:2.21.0.dev. If the image is not available at local, we will try to pull from hub.docker.com
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function lift_combiners at 0x7fa89aa1a0c8> ====================
WARNING:apache_beam.options.pipeline_options:Discarding unparseable args: ['--iterations=200', '--number_of_counter_operations=0', '--number_of_counters=0']
INFO:apache_beam.runners.portability.portable_runner:Job state changed to STOPPED
INFO:apache_beam.runners.portability.portable_runner:Job state changed to STARTING
INFO:apache_beam.runners.portability.portable_runner:Job state changed to RUNNING
INFO:apache_beam.runners.portability.portable_runner:Job state changed to DONE
INFO:apache_beam.testing.load_tests.load_test_metrics_utils:Load test results for test: 4128f33525534f8cb6f8d371a105d26f and timestamp: 1586275395.67:
INFO:apache_beam.testing.load_tests.load_test_metrics_utils:Metric: python_flink_batch_pardo_2_runtime Value: 6531
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD SUCCESSFUL in 1h 49m 36s
5 actionable tasks: 3 executed, 2 up-to-date
Publishing build scan...
https://gradle.com/s/g2g2dribmzgy4
[beam_LoadTests_Python_ParDo_Flink_Batch] $ /bin/bash -xe /tmp/jenkins7139898745204262835.sh
+ echo src ParDo Python Load test: 2GB 100 byte records 10 counters src
src ParDo Python Load test: 2GB 100 byte records 10 counters src
[Gradle] - Launching build.
[src] $ <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/gradlew> -PloadTest.mainClass=apache_beam.testing.load_tests.pardo_test -Prunner=PortableRunner '-PloadTest.args=--job_name=load-tests-python-flink-batch-pardo-3-0407125713 --project=apache-beam-testing --publish_to_big_query=true --metrics_dataset=load_test --metrics_table=python_flink_batch_pardo_3 --input_options='{"num_records": 20000000,"key_size": 10,"value_size": 90}' --iterations=1 --number_of_counter_operations=10 --number_of_counters=1 --parallelism=5 --job_endpoint=localhost:8099 --environment_config=gcr.io/apache-beam-testing/beam_portability/beam_python2.7_sdk:latest --environment_type=DOCKER --runner=PortableRunner' --continue --max-workers=12 -Dorg.gradle.jvmargs=-Xms2g -Dorg.gradle.jvmargs=-Xmx4g :sdks:python:apache_beam:testing:load_tests:run
> Task :buildSrc:compileJava NO-SOURCE
> Task :buildSrc:compileGroovy UP-TO-DATE
> Task :buildSrc:pluginDescriptors UP-TO-DATE
> Task :buildSrc:processResources UP-TO-DATE
> Task :buildSrc:classes UP-TO-DATE
> Task :buildSrc:jar UP-TO-DATE
> Task :buildSrc:assemble UP-TO-DATE
> Task :buildSrc:spotlessGroovy UP-TO-DATE
> Task :buildSrc:spotlessGroovyCheck UP-TO-DATE
> Task :buildSrc:spotlessGroovyGradle UP-TO-DATE
> Task :buildSrc:spotlessGroovyGradleCheck UP-TO-DATE
> Task :buildSrc:spotlessCheck UP-TO-DATE
> Task :buildSrc:pluginUnderTestMetadata UP-TO-DATE
> Task :buildSrc:compileTestJava NO-SOURCE
> Task :buildSrc:compileTestGroovy NO-SOURCE
> Task :buildSrc:processTestResources NO-SOURCE
> Task :buildSrc:testClasses UP-TO-DATE
> Task :buildSrc:test NO-SOURCE
> Task :buildSrc:validateTaskProperties UP-TO-DATE
> Task :buildSrc:check UP-TO-DATE
> Task :buildSrc:build UP-TO-DATE
Configuration on demand is an incubating feature.
> Task :sdks:python:setupVirtualenv UP-TO-DATE
> Task :sdks:python:apache_beam:testing:load_tests:setupVirtualenv UP-TO-DATE
> Task :sdks:python:sdist UP-TO-DATE
> Task :sdks:python:apache_beam:testing:load_tests:installGcpTest
DEPRECATION: Python 2.7 reached the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 is no longer maintained. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support
Processing <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/sdks/python/build/apache-beam.tar.gz>
Requirement already satisfied: crcmod<2.0,>=1.7 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (1.7)
Requirement already satisfied: dill<0.3.2,>=0.3.1.1 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (0.3.1.1)
Requirement already satisfied: fastavro<0.22,>=0.21.4 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (0.21.24)
Requirement already satisfied: future<1.0.0,>=0.16.0 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (0.16.0)
Requirement already satisfied: grpcio<2,>=1.12.1 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (1.28.1)
Requirement already satisfied: hdfs<3.0.0,>=2.1.0 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (2.5.8)
Requirement already satisfied: httplib2<=0.12.0,>=0.8 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (0.12.0)
Requirement already satisfied: mock<3.0.0,>=1.0.1 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (2.0.0)
Requirement already satisfied: numpy<2,>=1.14.3 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (1.16.6)
Requirement already satisfied: pymongo<4.0.0,>=3.8.0 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (3.10.1)
Requirement already satisfied: oauth2client<4,>=2.0.1 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (3.0.0)
Requirement already satisfied: protobuf<4,>=3.5.0.post1 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (3.11.3)
Requirement already satisfied: pydot<2,>=1.2.0 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (1.4.1)
Requirement already satisfied: python-dateutil<3,>=2.8.0 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (2.8.1)
Requirement already satisfied: pytz>=2018.3 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (2019.3)
Requirement already satisfied: typing-extensions<3.8.0,>=3.7.0 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (3.7.4.2)
Requirement already satisfied: avro<1.10.0,>=1.8.1 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (1.9.2)
Requirement already satisfied: funcsigs<2,>=1.0.2 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (1.0.2)
Requirement already satisfied: futures<4.0.0,>=3.2.0 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (3.3.0)
Requirement already satisfied: pyvcf<0.7.0,>=0.6.8 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (0.6.8)
Requirement already satisfied: pyarrow<0.17.0,>=0.15.1 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (0.16.0)
Requirement already satisfied: typing<3.8.0,>=3.7.0 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (3.7.4.1)
Requirement already satisfied: boto3>=1.9 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (1.12.37)
Requirement already satisfied: cachetools<4,>=3.1.0 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (3.1.1)
Requirement already satisfied: google-apitools<0.5.29,>=0.5.28 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (0.5.28)
Requirement already satisfied: google-cloud-datastore<1.8.0,>=1.7.1 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (1.7.4)
Requirement already satisfied: google-cloud-pubsub<1.1.0,>=0.39.0 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (1.0.2)
Requirement already satisfied: google-cloud-bigquery<=1.24.0,>=1.6.0 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (1.24.0)
Requirement already satisfied: google-cloud-core<2,>=0.28.1 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (1.3.0)
Requirement already satisfied: google-cloud-bigtable<1.1.0,>=0.31.1 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (1.0.0)
Requirement already satisfied: google-cloud-spanner<1.14.0,>=1.13.0 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (1.13.0)
Requirement already satisfied: grpcio-gcp<1,>=0.2.2 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (0.2.2)
Requirement already satisfied: google-cloud-dlp<=0.13.0,>=0.12.0 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (0.13.0)
Requirement already satisfied: google-cloud-language<2,>=1.3.0 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (1.3.0)
Requirement already satisfied: google-cloud-videointelligence<1.14.0,>=1.8.0 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (1.13.0)
Requirement already satisfied: google-cloud-vision<0.43.0,>=0.38.0 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (0.42.0)
Requirement already satisfied: googledatastore<7.1,>=7.0.1 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (7.0.2)
Requirement already satisfied: proto-google-cloud-datastore-v1<=0.90.4,>=0.90.0 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (0.90.4)
Requirement already satisfied: freezegun>=0.3.12 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (0.3.15)
Requirement already satisfied: nose>=1.3.7 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (1.3.7)
Requirement already satisfied: nose_xunitmp>=0.4.1 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (0.4.1)
Requirement already satisfied: pandas<0.25,>=0.23.4 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (0.24.2)
Requirement already satisfied: parameterized<0.8.0,>=0.7.1 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (0.7.1)
Requirement already satisfied: pyhamcrest!=1.10.0,<2.0.0,>=1.9 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (1.10.1)
Requirement already satisfied: pyyaml<6.0.0,>=3.12 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (5.3.1)
Requirement already satisfied: requests_mock<2.0,>=1.7 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (1.7.0)
Requirement already satisfied: tenacity<6.0,>=5.0.2 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (5.1.5)
Requirement already satisfied: pytest<5.0,>=4.4.0 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (4.6.9)
Requirement already satisfied: pytest-xdist<2,>=1.29.0 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (1.31.0)
Requirement already satisfied: pytest-timeout<2,>=1.3.3 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (1.3.4)
Requirement already satisfied: six>=1.5.2 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from grpcio<2,>=1.12.1->apache-beam==2.21.0.dev0) (1.14.0)
Requirement already satisfied: enum34>=1.0.4; python_version < "3.4" in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from grpcio<2,>=1.12.1->apache-beam==2.21.0.dev0) (1.1.10)
Requirement already satisfied: docopt in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from hdfs<3.0.0,>=2.1.0->apache-beam==2.21.0.dev0) (0.6.2)
Requirement already satisfied: requests>=2.7.0 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from hdfs<3.0.0,>=2.1.0->apache-beam==2.21.0.dev0) (2.23.0)
Requirement already satisfied: pbr>=0.11 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from mock<3.0.0,>=1.0.1->apache-beam==2.21.0.dev0) (5.4.5)
Requirement already satisfied: rsa>=3.1.4 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from oauth2client<4,>=2.0.1->apache-beam==2.21.0.dev0) (4.0)
Requirement already satisfied: pyasn1>=0.1.7 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from oauth2client<4,>=2.0.1->apache-beam==2.21.0.dev0) (0.4.8)
Requirement already satisfied: pyasn1-modules>=0.0.5 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from oauth2client<4,>=2.0.1->apache-beam==2.21.0.dev0) (0.2.8)
Requirement already satisfied: setuptools in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from protobuf<4,>=3.5.0.post1->apache-beam==2.21.0.dev0) (44.1.0)
Requirement already satisfied: pyparsing>=2.1.4 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from pydot<2,>=1.2.0->apache-beam==2.21.0.dev0) (2.4.7)
Requirement already satisfied: botocore<1.16.0,>=1.15.37 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from boto3>=1.9->apache-beam==2.21.0.dev0) (1.15.37)
Requirement already satisfied: s3transfer<0.4.0,>=0.3.0 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from boto3>=1.9->apache-beam==2.21.0.dev0) (0.3.3)
Requirement already satisfied: jmespath<1.0.0,>=0.7.1 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from boto3>=1.9->apache-beam==2.21.0.dev0) (0.9.5)
Requirement already satisfied: fasteners>=0.14 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from google-apitools<0.5.29,>=0.5.28->apache-beam==2.21.0.dev0) (0.15)
Requirement already satisfied: google-api-core[grpc]<2.0.0dev,>=1.6.0 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from google-cloud-datastore<1.8.0,>=1.7.1->apache-beam==2.21.0.dev0) (1.16.0)
Requirement already satisfied: grpc-google-iam-v1<0.13dev,>=0.12.3 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from google-cloud-pubsub<1.1.0,>=0.39.0->apache-beam==2.21.0.dev0) (0.12.3)
Requirement already satisfied: google-auth<2.0dev,>=1.9.0 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from google-cloud-bigquery<=1.24.0,>=1.6.0->apache-beam==2.21.0.dev0) (1.13.1)
Requirement already satisfied: google-resumable-media<0.6dev,>=0.5.0 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from google-cloud-bigquery<=1.24.0,>=1.6.0->apache-beam==2.21.0.dev0) (0.5.0)
Requirement already satisfied: googleapis-common-protos<2.0dev,>=1.5.2 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from proto-google-cloud-datastore-v1<=0.90.4,>=0.90.0->apache-beam==2.21.0.dev0) (1.51.0)
Requirement already satisfied: monotonic>=0.6; python_version == "2.7" in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from tenacity<6.0,>=5.0.2->apache-beam==2.21.0.dev0) (1.5)
Requirement already satisfied: atomicwrites>=1.0 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.21.0.dev0) (1.3.0)
Requirement already satisfied: pluggy<1.0,>=0.12 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.21.0.dev0) (0.13.1)
Requirement already satisfied: packaging in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.21.0.dev0) (20.3)
Requirement already satisfied: attrs>=17.4.0 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.21.0.dev0) (19.3.0)
Requirement already satisfied: importlib-metadata>=0.12; python_version < "3.8" in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.21.0.dev0) (1.6.0)
Requirement already satisfied: wcwidth in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.21.0.dev0) (0.1.9)
Requirement already satisfied: more-itertools<6.0.0,>=4.0.0; python_version <= "2.7" in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.21.0.dev0) (5.0.0)
Requirement already satisfied: pathlib2>=2.2.0; python_version < "3.6" in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.21.0.dev0) (2.3.5)
Requirement already satisfied: py>=1.5.0 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.21.0.dev0) (1.8.1)
Requirement already satisfied: pytest-forked in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from pytest-xdist<2,>=1.29.0->apache-beam==2.21.0.dev0) (1.1.3)
Requirement already satisfied: execnet>=1.1 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from pytest-xdist<2,>=1.29.0->apache-beam==2.21.0.dev0) (1.7.1)
Requirement already satisfied: certifi>=2017.4.17 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.21.0.dev0) (2020.4.5.1)
Requirement already satisfied: idna<3,>=2.5 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.21.0.dev0) (2.9)
Requirement already satisfied: chardet<4,>=3.0.2 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.21.0.dev0) (3.0.4)
Requirement already satisfied: urllib3!=1.25.0,!=1.25.1,<1.26,>=1.21.1 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.21.0.dev0) (1.25.8)
Requirement already satisfied: docutils<0.16,>=0.10 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from botocore<1.16.0,>=1.15.37->boto3>=1.9->apache-beam==2.21.0.dev0) (0.15.2)
Requirement already satisfied: contextlib2; python_version < "3" in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from importlib-metadata>=0.12; python_version < "3.8"->pytest<5.0,>=4.4.0->apache-beam==2.21.0.dev0) (0.6.0.post1)
Requirement already satisfied: zipp>=0.5 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from importlib-metadata>=0.12; python_version < "3.8"->pytest<5.0,>=4.4.0->apache-beam==2.21.0.dev0) (1.2.0)
Requirement already satisfied: configparser>=3.5; python_version < "3" in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from importlib-metadata>=0.12; python_version < "3.8"->pytest<5.0,>=4.4.0->apache-beam==2.21.0.dev0) (4.0.2)
Requirement already satisfied: scandir; python_version < "3.5" in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from pathlib2>=2.2.0; python_version < "3.6"->pytest<5.0,>=4.4.0->apache-beam==2.21.0.dev0) (1.10.0)
Requirement already satisfied: apipkg>=1.4 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from execnet>=1.1->pytest-xdist<2,>=1.29.0->apache-beam==2.21.0.dev0) (1.5)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.21.0.dev0-py2-none-any.whl size=2038814 sha256=29612c0aba881d464c41bb1fcbe50deaae4fbb3ef2ffe6768f04ddd96ff193e4
Stored in directory: /home/jenkins/.cache/pip/wheels/c5/a5/04/75eeeeddf3911b5dadec5d4f94a9900a9b8a283eaf5fc786e2
Successfully built apache-beam
Installing collected packages: apache-beam
Attempting uninstall: apache-beam
Found existing installation: apache-beam 2.21.0.dev0
Uninstalling apache-beam-2.21.0.dev0:
Successfully uninstalled apache-beam-2.21.0.dev0
Successfully installed apache-beam-2.21.0.dev0
> Task :sdks:python:apache_beam:testing:load_tests:run
apache_beam/__init__.py:82: UserWarning: You are using Apache Beam with Python 2. New releases of Apache Beam will soon support Python 3 only.
'You are using Apache Beam with Python 2. '
WARNING:root:Make sure that locally built Python SDK docker image has Python 2.7 interpreter.
INFO:root:Using Python SDK docker image: apache/beam_python2.7_sdk:2.21.0.dev. If the image is not available at local, we will try to pull from hub.docker.com
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function lift_combiners at 0x7f453f48b0c8> ====================
WARNING:apache_beam.options.pipeline_options:Discarding unparseable args: ['--iterations=1', '--number_of_counter_operations=10', '--number_of_counters=1']
INFO:apache_beam.runners.portability.portable_runner:Job state changed to STOPPED
INFO:apache_beam.runners.portability.portable_runner:Job state changed to STARTING
INFO:apache_beam.runners.portability.portable_runner:Job state changed to RUNNING
ERROR:root:java.lang.OutOfMemoryError: Metaspace
INFO:apache_beam.runners.portability.portable_runner:Job state changed to FAILED
Traceback (most recent call last):
File "/usr/lib/python2.7/runpy.py", line 174, in _run_module_as_main
"__main__", fname, loader, pkg_name)
File "/usr/lib/python2.7/runpy.py", line 72, in _run_code
exec code in run_globals
File "<https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/sdks/python/apache_beam/testing/load_tests/pardo_test.py",> line 128, in <module>
ParDoTest().run()
File "apache_beam/testing/load_tests/load_test.py", line 104, in run
self.result = self.pipeline.run()
File "apache_beam/testing/test_pipeline.py", line 114, in run
state = result.wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 550, in wait_until_finish
(self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline load-tests-python-flink-batch-pardo-3-0407125713_0323d11a-cbac-495e-997c-81fb236dcd18 failed in state FAILED: java.lang.OutOfMemoryError: Metaspace
> Task :sdks:python:apache_beam:testing:load_tests:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/sdks/python/apache_beam/testing/load_tests/build.gradle'> line: 51
* What went wrong:
Execution failed for task ':sdks:python:apache_beam:testing:load_tests:run'.
> error occurred
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 14s
5 actionable tasks: 2 executed, 3 up-to-date
Publishing build scan...
https://gradle.com/s/sfoaov2dutxto
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Python_ParDo_Flink_Batch
#194
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/194/display/redirect?page=changes>
Changes:
[kcweaver] [BEAM-9509] Improve error message for bad job server URL.
[mxm] [BEAM-8201] Cleanup FnServices from DockerEnvironmentFactory and
[iemejia] [website] Update information about Beam's LTS policy
------------------------------------------
[...truncated 145.37 KB...]
Requirement already satisfied: packaging in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.21.0.dev0) (20.3)
Requirement already satisfied: attrs>=17.4.0 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.21.0.dev0) (19.3.0)
Requirement already satisfied: importlib-metadata>=0.12; python_version < "3.8" in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.21.0.dev0) (1.6.0)
Requirement already satisfied: wcwidth in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.21.0.dev0) (0.1.9)
Requirement already satisfied: more-itertools<6.0.0,>=4.0.0; python_version <= "2.7" in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.21.0.dev0) (5.0.0)
Requirement already satisfied: pathlib2>=2.2.0; python_version < "3.6" in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.21.0.dev0) (2.3.5)
Requirement already satisfied: py>=1.5.0 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.21.0.dev0) (1.8.1)
Requirement already satisfied: pytest-forked in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from pytest-xdist<2,>=1.29.0->apache-beam==2.21.0.dev0) (1.1.3)
Requirement already satisfied: execnet>=1.1 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from pytest-xdist<2,>=1.29.0->apache-beam==2.21.0.dev0) (1.7.1)
Requirement already satisfied: certifi>=2017.4.17 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.21.0.dev0) (2020.4.5.1)
Requirement already satisfied: idna<3,>=2.5 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.21.0.dev0) (2.9)
Requirement already satisfied: chardet<4,>=3.0.2 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.21.0.dev0) (3.0.4)
Requirement already satisfied: urllib3!=1.25.0,!=1.25.1,<1.26,>=1.21.1 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.21.0.dev0) (1.25.8)
Requirement already satisfied: docutils<0.16,>=0.10 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from botocore<1.16.0,>=1.15.36->boto3>=1.9->apache-beam==2.21.0.dev0) (0.15.2)
Requirement already satisfied: contextlib2; python_version < "3" in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from importlib-metadata>=0.12; python_version < "3.8"->pytest<5.0,>=4.4.0->apache-beam==2.21.0.dev0) (0.6.0.post1)
Requirement already satisfied: zipp>=0.5 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from importlib-metadata>=0.12; python_version < "3.8"->pytest<5.0,>=4.4.0->apache-beam==2.21.0.dev0) (1.2.0)
Requirement already satisfied: configparser>=3.5; python_version < "3" in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from importlib-metadata>=0.12; python_version < "3.8"->pytest<5.0,>=4.4.0->apache-beam==2.21.0.dev0) (4.0.2)
Requirement already satisfied: scandir; python_version < "3.5" in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from pathlib2>=2.2.0; python_version < "3.6"->pytest<5.0,>=4.4.0->apache-beam==2.21.0.dev0) (1.10.0)
Requirement already satisfied: apipkg>=1.4 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from execnet>=1.1->pytest-xdist<2,>=1.29.0->apache-beam==2.21.0.dev0) (1.5)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.21.0.dev0-py2-none-any.whl size=2039810 sha256=e945141f0f2d9668e2bad82e7c3874c2125ac866ec0ae52cd093f32d32c40f14
Stored in directory: /home/jenkins/.cache/pip/wheels/c5/a5/04/75eeeeddf3911b5dadec5d4f94a9900a9b8a283eaf5fc786e2
Successfully built apache-beam
Installing collected packages: apache-beam
Attempting uninstall: apache-beam
Found existing installation: apache-beam 2.21.0.dev0
Uninstalling apache-beam-2.21.0.dev0:
Successfully uninstalled apache-beam-2.21.0.dev0
Successfully installed apache-beam-2.21.0.dev0
> Task :sdks:python:apache_beam:testing:load_tests:run
apache_beam/__init__.py:82: UserWarning: You are using Apache Beam with Python 2. New releases of Apache Beam will soon support Python 3 only.
'You are using Apache Beam with Python 2. '
WARNING:root:Make sure that locally built Python SDK docker image has Python 2.7 interpreter.
INFO:root:Using Python SDK docker image: apache/beam_python2.7_sdk:2.21.0.dev. If the image is not available at local, we will try to pull from hub.docker.com
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function lift_combiners at 0x7fe86429d320> ====================
WARNING:apache_beam.options.pipeline_options:Discarding unparseable args: ['--iterations=200', '--number_of_counter_operations=0', '--number_of_counters=0']
INFO:apache_beam.runners.portability.portable_runner:Job state changed to STOPPED
INFO:apache_beam.runners.portability.portable_runner:Job state changed to STARTING
INFO:apache_beam.runners.portability.portable_runner:Job state changed to RUNNING
INFO:apache_beam.runners.portability.portable_runner:Job state changed to DONE
INFO:apache_beam.testing.load_tests.load_test_metrics_utils:Load test results for test: 3e7d9b40e8ec467aa10598f772a1333f and timestamp: 1586188901.4:
INFO:apache_beam.testing.load_tests.load_test_metrics_utils:Metric: python_flink_batch_pardo_2_runtime Value: 6509
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD SUCCESSFUL in 1h 49m 12s
5 actionable tasks: 3 executed, 2 up-to-date
Publishing build scan...
https://gradle.com/s/raycelvwmhm2c
[beam_LoadTests_Python_ParDo_Flink_Batch] $ /bin/bash -xe /tmp/jenkins3292877125884435493.sh
+ echo src ParDo Python Load test: 2GB 100 byte records 10 counters src
src ParDo Python Load test: 2GB 100 byte records 10 counters src
[Gradle] - Launching build.
[src] $ <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/gradlew> -PloadTest.mainClass=apache_beam.testing.load_tests.pardo_test -Prunner=PortableRunner '-PloadTest.args=--job_name=load-tests-python-flink-batch-pardo-3-0406125656 --project=apache-beam-testing --publish_to_big_query=true --metrics_dataset=load_test --metrics_table=python_flink_batch_pardo_3 --input_options='{"num_records": 20000000,"key_size": 10,"value_size": 90}' --iterations=1 --number_of_counter_operations=10 --number_of_counters=1 --parallelism=5 --job_endpoint=localhost:8099 --environment_config=gcr.io/apache-beam-testing/beam_portability/beam_python2.7_sdk:latest --environment_type=DOCKER --runner=PortableRunner' --continue --max-workers=12 -Dorg.gradle.jvmargs=-Xms2g -Dorg.gradle.jvmargs=-Xmx4g :sdks:python:apache_beam:testing:load_tests:run
> Task :buildSrc:compileJava NO-SOURCE
> Task :buildSrc:compileGroovy UP-TO-DATE
> Task :buildSrc:pluginDescriptors UP-TO-DATE
> Task :buildSrc:processResources UP-TO-DATE
> Task :buildSrc:classes UP-TO-DATE
> Task :buildSrc:jar UP-TO-DATE
> Task :buildSrc:assemble UP-TO-DATE
> Task :buildSrc:spotlessGroovy UP-TO-DATE
> Task :buildSrc:spotlessGroovyCheck UP-TO-DATE
> Task :buildSrc:spotlessGroovyGradle UP-TO-DATE
> Task :buildSrc:spotlessGroovyGradleCheck UP-TO-DATE
> Task :buildSrc:spotlessCheck UP-TO-DATE
> Task :buildSrc:pluginUnderTestMetadata UP-TO-DATE
> Task :buildSrc:compileTestJava NO-SOURCE
> Task :buildSrc:compileTestGroovy NO-SOURCE
> Task :buildSrc:processTestResources NO-SOURCE
> Task :buildSrc:testClasses UP-TO-DATE
> Task :buildSrc:test NO-SOURCE
> Task :buildSrc:validateTaskProperties UP-TO-DATE
> Task :buildSrc:check UP-TO-DATE
> Task :buildSrc:build UP-TO-DATE
Configuration on demand is an incubating feature.
> Task :sdks:python:setupVirtualenv UP-TO-DATE
> Task :sdks:python:apache_beam:testing:load_tests:setupVirtualenv UP-TO-DATE
> Task :sdks:python:sdist UP-TO-DATE
> Task :sdks:python:apache_beam:testing:load_tests:installGcpTest
DEPRECATION: Python 2.7 reached the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 is no longer maintained. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support
Processing <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/sdks/python/build/apache-beam.tar.gz>
Requirement already satisfied: crcmod<2.0,>=1.7 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (1.7)
Requirement already satisfied: dill<0.3.2,>=0.3.1.1 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (0.3.1.1)
Requirement already satisfied: fastavro<0.22,>=0.21.4 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (0.21.24)
Requirement already satisfied: future<1.0.0,>=0.16.0 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (0.16.0)
Requirement already satisfied: grpcio<2,>=1.12.1 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (1.28.1)
Requirement already satisfied: hdfs<3.0.0,>=2.1.0 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (2.5.8)
Requirement already satisfied: httplib2<=0.12.0,>=0.8 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (0.12.0)
Requirement already satisfied: mock<3.0.0,>=1.0.1 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (2.0.0)
Requirement already satisfied: numpy<2,>=1.14.3 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (1.16.6)
Requirement already satisfied: pymongo<4.0.0,>=3.8.0 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (3.10.1)
Requirement already satisfied: oauth2client<4,>=2.0.1 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (3.0.0)
Requirement already satisfied: protobuf<4,>=3.5.0.post1 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (3.11.3)
Requirement already satisfied: pydot<2,>=1.2.0 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (1.4.1)
Requirement already satisfied: python-dateutil<3,>=2.8.0 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (2.8.1)
Requirement already satisfied: pytz>=2018.3 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (2019.3)
Requirement already satisfied: typing-extensions<3.8.0,>=3.7.0 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (3.7.4.2)
Requirement already satisfied: avro<1.10.0,>=1.8.1 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (1.9.2)
Requirement already satisfied: funcsigs<2,>=1.0.2 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (1.0.2)
Requirement already satisfied: futures<4.0.0,>=3.2.0 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (3.3.0)
Requirement already satisfied: pyvcf<0.7.0,>=0.6.8 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (0.6.8)
Requirement already satisfied: pyarrow<0.17.0,>=0.15.1 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (0.16.0)
Requirement already satisfied: typing<3.8.0,>=3.7.0 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (3.7.4.1)
Requirement already satisfied: boto3>=1.9 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (1.12.36)
Requirement already satisfied: cachetools<4,>=3.1.0 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (3.1.1)
Requirement already satisfied: google-apitools<0.5.29,>=0.5.28 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (0.5.28)
Requirement already satisfied: google-cloud-datastore<1.8.0,>=1.7.1 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (1.7.4)
Requirement already satisfied: google-cloud-pubsub<1.1.0,>=0.39.0 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (1.0.2)
Requirement already satisfied: google-cloud-bigquery<=1.24.0,>=1.6.0 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (1.24.0)
Requirement already satisfied: google-cloud-core<2,>=0.28.1 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (1.3.0)
Requirement already satisfied: google-cloud-bigtable<1.1.0,>=0.31.1 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (1.0.0)
Requirement already satisfied: google-cloud-spanner<1.14.0,>=1.13.0 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (1.13.0)
Requirement already satisfied: grpcio-gcp<1,>=0.2.2 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (0.2.2)
Requirement already satisfied: google-cloud-dlp<=0.13.0,>=0.12.0 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (0.13.0)
Requirement already satisfied: google-cloud-language<2,>=1.3.0 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (1.3.0)
Requirement already satisfied: google-cloud-videointelligence<1.14.0,>=1.8.0 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (1.13.0)
Requirement already satisfied: google-cloud-vision<0.43.0,>=0.38.0 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (0.42.0)
Requirement already satisfied: googledatastore<7.1,>=7.0.1 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (7.0.2)
Requirement already satisfied: proto-google-cloud-datastore-v1<=0.90.4,>=0.90.0 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (0.90.4)
Requirement already satisfied: freezegun>=0.3.12 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (0.3.15)
Requirement already satisfied: nose>=1.3.7 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (1.3.7)
Requirement already satisfied: nose_xunitmp>=0.4.1 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (0.4.1)
Requirement already satisfied: pandas<0.25,>=0.23.4 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (0.24.2)
Requirement already satisfied: parameterized<0.8.0,>=0.7.1 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (0.7.1)
Requirement already satisfied: pyhamcrest!=1.10.0,<2.0.0,>=1.9 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (1.10.1)
Requirement already satisfied: pyyaml<6.0.0,>=3.12 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (5.3.1)
Requirement already satisfied: requests_mock<2.0,>=1.7 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (1.7.0)
Requirement already satisfied: tenacity<6.0,>=5.0.2 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (5.1.5)
Requirement already satisfied: pytest<5.0,>=4.4.0 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (4.6.9)
Requirement already satisfied: pytest-xdist<2,>=1.29.0 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (1.31.0)
Requirement already satisfied: pytest-timeout<2,>=1.3.3 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from apache-beam==2.21.0.dev0) (1.3.4)
Requirement already satisfied: six>=1.5.2 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from grpcio<2,>=1.12.1->apache-beam==2.21.0.dev0) (1.14.0)
Requirement already satisfied: enum34>=1.0.4; python_version < "3.4" in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from grpcio<2,>=1.12.1->apache-beam==2.21.0.dev0) (1.1.10)
Requirement already satisfied: docopt in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from hdfs<3.0.0,>=2.1.0->apache-beam==2.21.0.dev0) (0.6.2)
Requirement already satisfied: requests>=2.7.0 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from hdfs<3.0.0,>=2.1.0->apache-beam==2.21.0.dev0) (2.23.0)
Requirement already satisfied: pbr>=0.11 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from mock<3.0.0,>=1.0.1->apache-beam==2.21.0.dev0) (5.4.4)
Requirement already satisfied: rsa>=3.1.4 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from oauth2client<4,>=2.0.1->apache-beam==2.21.0.dev0) (4.0)
Requirement already satisfied: pyasn1>=0.1.7 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from oauth2client<4,>=2.0.1->apache-beam==2.21.0.dev0) (0.4.8)
Requirement already satisfied: pyasn1-modules>=0.0.5 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from oauth2client<4,>=2.0.1->apache-beam==2.21.0.dev0) (0.2.8)
Requirement already satisfied: setuptools in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from protobuf<4,>=3.5.0.post1->apache-beam==2.21.0.dev0) (44.1.0)
Requirement already satisfied: pyparsing>=2.1.4 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from pydot<2,>=1.2.0->apache-beam==2.21.0.dev0) (2.4.7)
Requirement already satisfied: s3transfer<0.4.0,>=0.3.0 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from boto3>=1.9->apache-beam==2.21.0.dev0) (0.3.3)
Requirement already satisfied: botocore<1.16.0,>=1.15.36 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from boto3>=1.9->apache-beam==2.21.0.dev0) (1.15.36)
Requirement already satisfied: jmespath<1.0.0,>=0.7.1 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from boto3>=1.9->apache-beam==2.21.0.dev0) (0.9.5)
Requirement already satisfied: fasteners>=0.14 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from google-apitools<0.5.29,>=0.5.28->apache-beam==2.21.0.dev0) (0.15)
Requirement already satisfied: google-api-core[grpc]<2.0.0dev,>=1.6.0 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from google-cloud-datastore<1.8.0,>=1.7.1->apache-beam==2.21.0.dev0) (1.16.0)
Requirement already satisfied: grpc-google-iam-v1<0.13dev,>=0.12.3 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from google-cloud-pubsub<1.1.0,>=0.39.0->apache-beam==2.21.0.dev0) (0.12.3)
Requirement already satisfied: google-auth<2.0dev,>=1.9.0 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from google-cloud-bigquery<=1.24.0,>=1.6.0->apache-beam==2.21.0.dev0) (1.13.1)
Requirement already satisfied: google-resumable-media<0.6dev,>=0.5.0 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from google-cloud-bigquery<=1.24.0,>=1.6.0->apache-beam==2.21.0.dev0) (0.5.0)
Requirement already satisfied: googleapis-common-protos<2.0dev,>=1.5.2 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from proto-google-cloud-datastore-v1<=0.90.4,>=0.90.0->apache-beam==2.21.0.dev0) (1.51.0)
Requirement already satisfied: monotonic>=0.6; python_version == "2.7" in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from tenacity<6.0,>=5.0.2->apache-beam==2.21.0.dev0) (1.5)
Requirement already satisfied: atomicwrites>=1.0 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.21.0.dev0) (1.3.0)
Requirement already satisfied: pluggy<1.0,>=0.12 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.21.0.dev0) (0.13.1)
Requirement already satisfied: packaging in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.21.0.dev0) (20.3)
Requirement already satisfied: attrs>=17.4.0 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.21.0.dev0) (19.3.0)
Requirement already satisfied: importlib-metadata>=0.12; python_version < "3.8" in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.21.0.dev0) (1.6.0)
Requirement already satisfied: wcwidth in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.21.0.dev0) (0.1.9)
Requirement already satisfied: more-itertools<6.0.0,>=4.0.0; python_version <= "2.7" in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.21.0.dev0) (5.0.0)
Requirement already satisfied: pathlib2>=2.2.0; python_version < "3.6" in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.21.0.dev0) (2.3.5)
Requirement already satisfied: py>=1.5.0 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.21.0.dev0) (1.8.1)
Requirement already satisfied: pytest-forked in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from pytest-xdist<2,>=1.29.0->apache-beam==2.21.0.dev0) (1.1.3)
Requirement already satisfied: execnet>=1.1 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from pytest-xdist<2,>=1.29.0->apache-beam==2.21.0.dev0) (1.7.1)
Requirement already satisfied: certifi>=2017.4.17 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.21.0.dev0) (2020.4.5.1)
Requirement already satisfied: idna<3,>=2.5 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.21.0.dev0) (2.9)
Requirement already satisfied: chardet<4,>=3.0.2 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.21.0.dev0) (3.0.4)
Requirement already satisfied: urllib3!=1.25.0,!=1.25.1,<1.26,>=1.21.1 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.21.0.dev0) (1.25.8)
Requirement already satisfied: docutils<0.16,>=0.10 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from botocore<1.16.0,>=1.15.36->boto3>=1.9->apache-beam==2.21.0.dev0) (0.15.2)
Requirement already satisfied: contextlib2; python_version < "3" in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from importlib-metadata>=0.12; python_version < "3.8"->pytest<5.0,>=4.4.0->apache-beam==2.21.0.dev0) (0.6.0.post1)
Requirement already satisfied: zipp>=0.5 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from importlib-metadata>=0.12; python_version < "3.8"->pytest<5.0,>=4.4.0->apache-beam==2.21.0.dev0) (1.2.0)
Requirement already satisfied: configparser>=3.5; python_version < "3" in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from importlib-metadata>=0.12; python_version < "3.8"->pytest<5.0,>=4.4.0->apache-beam==2.21.0.dev0) (4.0.2)
Requirement already satisfied: scandir; python_version < "3.5" in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from pathlib2>=2.2.0; python_version < "3.6"->pytest<5.0,>=4.4.0->apache-beam==2.21.0.dev0) (1.10.0)
Requirement already satisfied: apipkg>=1.4 in <https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/build/gradleenv/1329484227/lib/python2.7/site-packages> (from execnet>=1.1->pytest-xdist<2,>=1.29.0->apache-beam==2.21.0.dev0) (1.5)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.21.0.dev0-py2-none-any.whl size=2039810 sha256=3b6e21d5cf33c906e0c129b085e58092eca43579561737f599ae30af1491fbcf
Stored in directory: /home/jenkins/.cache/pip/wheels/c5/a5/04/75eeeeddf3911b5dadec5d4f94a9900a9b8a283eaf5fc786e2
Successfully built apache-beam
Installing collected packages: apache-beam
Attempting uninstall: apache-beam
Found existing installation: apache-beam 2.21.0.dev0
Uninstalling apache-beam-2.21.0.dev0:
Successfully uninstalled apache-beam-2.21.0.dev0
Successfully installed apache-beam-2.21.0.dev0
> Task :sdks:python:apache_beam:testing:load_tests:run
apache_beam/__init__.py:82: UserWarning: You are using Apache Beam with Python 2. New releases of Apache Beam will soon support Python 3 only.
'You are using Apache Beam with Python 2. '
WARNING:root:Make sure that locally built Python SDK docker image has Python 2.7 interpreter.
INFO:root:Using Python SDK docker image: apache/beam_python2.7_sdk:2.21.0.dev. If the image is not available at local, we will try to pull from hub.docker.com
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function lift_combiners at 0x7f91da306320> ====================
WARNING:apache_beam.options.pipeline_options:Discarding unparseable args: ['--iterations=1', '--number_of_counter_operations=10', '--number_of_counters=1']
INFO:apache_beam.runners.portability.portable_runner:Job state changed to STOPPED
INFO:apache_beam.runners.portability.portable_runner:Job state changed to STARTING
INFO:apache_beam.runners.portability.portable_runner:Job state changed to RUNNING
ERROR:root:java.lang.OutOfMemoryError: Metaspace
INFO:apache_beam.runners.portability.portable_runner:Job state changed to FAILED
Traceback (most recent call last):
File "/usr/lib/python2.7/runpy.py", line 174, in _run_module_as_main
"__main__", fname, loader, pkg_name)
File "/usr/lib/python2.7/runpy.py", line 72, in _run_code
exec code in run_globals
File "<https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/sdks/python/apache_beam/testing/load_tests/pardo_test.py",> line 128, in <module>
ParDoTest().run()
File "apache_beam/testing/load_tests/load_test.py", line 104, in run
self.result = self.pipeline.run()
File "apache_beam/testing/test_pipeline.py", line 114, in run
state = result.wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 550, in wait_until_finish
(self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline load-tests-python-flink-batch-pardo-3-0406125656_f91dccc6-c7cf-4cb3-8369-2274db3f8e0e failed in state FAILED: java.lang.OutOfMemoryError: Metaspace
> Task :sdks:python:apache_beam:testing:load_tests:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_LoadTests_Python_ParDo_Flink_Batch/ws/src/sdks/python/apache_beam/testing/load_tests/build.gradle'> line: 51
* What went wrong:
Execution failed for task ':sdks:python:apache_beam:testing:load_tests:run'.
> error occurred
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 16s
5 actionable tasks: 2 executed, 3 up-to-date
Publishing build scan...
https://gradle.com/s/epeyy4mep5ygi
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org