You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2020/07/15 07:06:45 UTC
Build failed in Jenkins: beam_PostCommit_Py_ValCont #6583
See <https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/6583/display/redirect?page=changes>
Changes:
[Kenneth Knowles] Throw exception when file to stage is not found, instead of logging a
[noreply] Make tracking/cleanup of cache and in-environment states per pipeline
[noreply] [BEAM-9198] BeamSQL aggregation analytics functionality (#11975)
------------------------------------------
[...truncated 2.08 MB...]
Collecting typing-extensions==3.7.4.1
Downloading typing_extensions-3.7.4.1-py3-none-any.whl (20 kB)
[91mWARNING: The candidate selected for download or install is a yanked version: 'google-api-core' candidate (version 1.20.0 at https://files.pythonhosted.org/packages/5c/ca/e172037b74fe39535731319e7c936160194204e07ba11222a5366ee0c346/google_api_core-1.20.0-py2.py3-none-any.whl#sha256=65ca5396393b3e592c49cba968380b6d2534d9c78b25fedbedea9dd1c6c50249 (from https://pypi.org/simple/google-api-core/) (requires-python:>=2.7,!=3.0.*,!=3.1.*,!=3.2.*,!=3.3.*))
Reason for being yanked: Pinned protobuf version was too low. See https://github.com/googleapis/python-api-core/issues/48
[0mCollecting google-api-core==1.20.0
Downloading google_api_core-1.20.0-py2.py3-none-any.whl (90 kB)
Collecting google-apitools==0.5.28
Downloading google-apitools-0.5.28.tar.gz (172 kB)
Collecting google-cloud-pubsub==1.0.2
Downloading google_cloud_pubsub-1.0.2-py2.py3-none-any.whl (118 kB)
Collecting google-cloud-bigquery==1.24.0
Downloading google_cloud_bigquery-1.24.0-py2.py3-none-any.whl (165 kB)
Collecting google-cloud-bigtable==1.0.0
Downloading google_cloud_bigtable-1.0.0-py2.py3-none-any.whl (232 kB)
Collecting google-cloud-core==1.1.0
Downloading google_cloud_core-1.1.0-py2.py3-none-any.whl (26 kB)
Collecting google-cloud-datastore==1.7.4
Downloading google_cloud_datastore-1.7.4-py2.py3-none-any.whl (82 kB)
Collecting cython==0.29.13
Downloading Cython-0.29.13-cp37-cp37m-manylinux1_x86_64.whl (2.1 MB)
Collecting guppy3==3.0.9
Downloading guppy3-3.0.9-cp37-cp37m-manylinux1_x86_64.whl (614 kB)
Collecting numpy==1.17.3
Downloading numpy-1.17.3-cp37-cp37m-manylinux1_x86_64.whl (20.0 MB)
Collecting scipy==1.4.1
Downloading scipy-1.4.1-cp37-cp37m-manylinux1_x86_64.whl (26.1 MB)
Collecting pandas==0.25.2
Downloading pandas-0.25.2-cp37-cp37m-manylinux1_x86_64.whl (10.4 MB)
Collecting protorpc==0.12.0
Downloading protorpc-0.12.0.tar.gz (117 kB)
Collecting python-gflags==3.0.6
Downloading python-gflags-3.0.6.tar.gz (49 kB)
Collecting tensorflow==2.2.0
Downloading tensorflow-2.2.0-cp37-cp37m-manylinux2010_x86_64.whl (516.2 MB)
Collecting pymongo==3.9.0
Downloading pymongo-3.9.0-cp37-cp37m-manylinux1_x86_64.whl (447 kB)
Collecting tenacity>=5.0.2
Downloading tenacity-6.2.0-py2.py3-none-any.whl (24 kB)
Collecting pyhamcrest<2.0,>=1.9
Downloading PyHamcrest-1.10.1-py3-none-any.whl (48 kB)
Collecting nose==1.3.7
Downloading nose-1.3.7-py3-none-any.whl (154 kB)
Collecting six>=1.5.2
Downloading six-1.15.0-py2.py3-none-any.whl (10 kB)
Collecting docopt
Downloading docopt-0.6.2.tar.gz (25 kB)
Collecting requests>=2.7.0
Downloading requests-2.24.0-py2.py3-none-any.whl (61 kB)
Collecting pbr>=0.11
Downloading pbr-5.4.5-py2.py3-none-any.whl (110 kB)
Collecting pyasn1>=0.1.7
Downloading pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting pyasn1-modules>=0.0.5
Downloading pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting rsa>=3.1.4
Downloading rsa-4.6-py3-none-any.whl (47 kB)
Requirement already satisfied: setuptools in /usr/local/lib/python3.7/site-packages (from protobuf==3.12.0->-r /tmp/base_image_requirements.txt (line 38)) (47.3.1)
Collecting pyparsing>=2.1.4
Downloading pyparsing-2.4.7-py2.py3-none-any.whl (67 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Downloading googleapis_common_protos-1.52.0-py2.py3-none-any.whl (100 kB)
Collecting google-auth<2.0dev,>=1.14.0
Downloading google_auth-1.19.0-py2.py3-none-any.whl (91 kB)
Collecting fasteners>=0.14
Downloading fasteners-0.15-py2.py3-none-any.whl (23 kB)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Downloading grpc-google-iam-v1-0.12.3.tar.gz (13 kB)
Collecting google-resumable-media<0.6dev,>=0.5.0
Downloading google_resumable_media-0.5.1-py2.py3-none-any.whl (38 kB)
Collecting python-dateutil>=2.6.1
Downloading python_dateutil-2.8.1-py2.py3-none-any.whl (227 kB)
Collecting tensorboard<2.3.0,>=2.2.0
Downloading tensorboard-2.2.2-py3-none-any.whl (3.0 MB)
Collecting termcolor>=1.1.0
Downloading termcolor-1.1.0.tar.gz (3.9 kB)
Collecting wrapt>=1.11.1
Downloading wrapt-1.12.1.tar.gz (27 kB)
Collecting opt-einsum>=2.3.2
Downloading opt_einsum-3.2.1-py3-none-any.whl (63 kB)
Collecting astunparse==1.6.3
Downloading astunparse-1.6.3-py2.py3-none-any.whl (12 kB)
Requirement already satisfied: wheel>=0.26; python_version >= "3" in /usr/local/lib/python3.7/site-packages (from tensorflow==2.2.0->-r /tmp/base_image_requirements.txt (line 71)) (0.34.2)
Collecting google-pasta>=0.1.8
Downloading google_pasta-0.2.0-py3-none-any.whl (57 kB)
Collecting tensorflow-estimator<2.3.0,>=2.2.0
Downloading tensorflow_estimator-2.2.0-py2.py3-none-any.whl (454 kB)
Collecting gast==0.3.3
Downloading gast-0.3.3-py2.py3-none-any.whl (9.7 kB)
Collecting keras-preprocessing>=1.1.0
Downloading Keras_Preprocessing-1.1.2-py2.py3-none-any.whl (42 kB)
Collecting absl-py>=0.7.0
Downloading absl-py-0.9.0.tar.gz (104 kB)
Collecting h5py<2.11.0,>=2.10.0
Downloading h5py-2.10.0-cp37-cp37m-manylinux1_x86_64.whl (2.9 MB)
Collecting chardet<4,>=3.0.2
Downloading chardet-3.0.4-py2.py3-none-any.whl (133 kB)
Collecting urllib3!=1.25.0,!=1.25.1,<1.26,>=1.21.1
Downloading urllib3-1.25.9-py2.py3-none-any.whl (126 kB)
Collecting idna<3,>=2.5
Downloading idna-2.10-py2.py3-none-any.whl (58 kB)
Collecting certifi>=2017.4.17
Downloading certifi-2020.6.20-py2.py3-none-any.whl (156 kB)
Collecting cachetools<5.0,>=2.0.0
Downloading cachetools-4.1.1-py3-none-any.whl (10 kB)
Collecting monotonic>=0.1
Downloading monotonic-1.5-py2.py3-none-any.whl (5.3 kB)
Collecting tensorboard-plugin-wit>=1.6.0
Downloading tensorboard_plugin_wit-1.7.0-py3-none-any.whl (779 kB)
Collecting google-auth-oauthlib<0.5,>=0.4.1
Downloading google_auth_oauthlib-0.4.1-py2.py3-none-any.whl (18 kB)
Collecting werkzeug>=0.11.15
Downloading Werkzeug-1.0.1-py2.py3-none-any.whl (298 kB)
Collecting markdown>=2.6.8
Downloading Markdown-3.2.2-py3-none-any.whl (88 kB)
Collecting requests-oauthlib>=0.7.0
Downloading requests_oauthlib-1.3.0-py2.py3-none-any.whl (23 kB)
Collecting importlib-metadata; python_version < "3.8"
Downloading importlib_metadata-1.7.0-py2.py3-none-any.whl (31 kB)
Collecting oauthlib>=3.0.0
Downloading oauthlib-3.1.0-py2.py3-none-any.whl (147 kB)
Collecting zipp>=0.5
Downloading zipp-3.1.0-py3-none-any.whl (4.9 kB)
Building wheels for collected packages: avro-python3, crcmod, dill, future, hdfs, httplib2, oauth2client, pyyaml, google-apitools, protorpc, python-gflags, docopt, grpc-google-iam-v1, termcolor, wrapt, absl-py
Building wheel for avro-python3 (setup.py): started
Building wheel for avro-python3 (setup.py): finished with status 'done'
Created wheel for avro-python3: filename=avro_python3-1.8.2-py3-none-any.whl size=43249 sha256=100c186e373e079a8b3782a63507ebb5b8f7c69df2756c88c3f5d666f3ba2948
Stored in directory: /root/.cache/pip/wheels/21/13/6f/cb2fe781dd05d05084356d29f660cd669fffc0bbfd87a9a613
Building wheel for crcmod (setup.py): started
Building wheel for crcmod (setup.py): finished with status 'done'
Created wheel for crcmod: filename=crcmod-1.7-cp37-cp37m-linux_x86_64.whl size=36925 sha256=0ecc020d60832ed7dd3a3ac3d0dc710b3986dc5d63730c18d77ec2d6f3aff489
Stored in directory: /root/.cache/pip/wheels/dc/9a/e9/49e627353476cec8484343c4ab656f1e0d783ee77b9dde2d1f
Building wheel for dill (setup.py): started
Building wheel for dill (setup.py): finished with status 'done'
Created wheel for dill: filename=dill-0.3.1.1-py3-none-any.whl size=78530 sha256=5003f646d314efac88e833302262bc55d2e0043c2179d5d2215e0fe104604331
Stored in directory: /root/.cache/pip/wheels/a4/61/fd/c57e374e580aa78a45ed78d5859b3a44436af17e22ca53284f
Building wheel for future (setup.py): started
Building wheel for future (setup.py): finished with status 'done'
Created wheel for future: filename=future-0.18.2-py3-none-any.whl size=491058 sha256=f52f189ebd4598b3fa38dd2b94fc717ed2830f9851ca88fd8d28e97ab8e7aaac
Stored in directory: /root/.cache/pip/wheels/56/b0/fe/4410d17b32f1f0c3cf54cdfb2bc04d7b4b8f4ae377e2229ba0
Building wheel for hdfs (setup.py): started
Building wheel for hdfs (setup.py): finished with status 'done'
Created wheel for hdfs: filename=hdfs-2.5.8-py3-none-any.whl size=33213 sha256=728a02ca4aa865cb7df2d46f8f94587a93220dfd3a3195474d75797d6d302b4c
Stored in directory: /root/.cache/pip/wheels/0a/7d/38/ea4eaf831518e6cd867b515b88919a9785eb66f11def5ab859
Building wheel for httplib2 (setup.py): started
Building wheel for httplib2 (setup.py): finished with status 'done'
Created wheel for httplib2: filename=httplib2-0.12.0-py3-none-any.whl size=93464 sha256=7e0ef2244dc636b61fc604fa861642cdce37602dd7aaad0711d5547529e79cb9
Stored in directory: /root/.cache/pip/wheels/0d/e7/b6/0dd30343ceca921cfbd91f355041bd9c69e0f40b49f25b7b8a
Building wheel for oauth2client (setup.py): started
Building wheel for oauth2client (setup.py): finished with status 'done'
Created wheel for oauth2client: filename=oauth2client-3.0.0-py3-none-any.whl size=106383 sha256=4fcdef974d9bd24eb165be4fa7365c2cdaedaffec72288636721846a38c7217f
Stored in directory: /root/.cache/pip/wheels/86/73/7a/3b3f76a2142176605ff38fbca574327962c71e25a43197a4c1
Building wheel for pyyaml (setup.py): started
Building wheel for pyyaml (setup.py): finished with status 'done'
Created wheel for pyyaml: filename=PyYAML-5.1-cp37-cp37m-linux_x86_64.whl size=468865 sha256=1451bf0b789558a15640245f83fe400da656e9615a9e2201c74922473430f3e5
Stored in directory: /root/.cache/pip/wheels/77/f5/10/d00a2bd30928b972790053b5de0c703ca87324f3fead0f2fd9
Building wheel for google-apitools (setup.py): started
Building wheel for google-apitools (setup.py): finished with status 'done'
Created wheel for google-apitools: filename=google_apitools-0.5.28-py3-none-any.whl size=130110 sha256=89242b16fabeef047e8f1356c3b20608c18fb489a19bb6dafa0c5386d82dbf53
Stored in directory: /root/.cache/pip/wheels/34/3b/69/ecd8e6ae89d9d71102a58962c29faa7a9467ba45f99f205920
Building wheel for protorpc (setup.py): started
Building wheel for protorpc (setup.py): finished with status 'done'
Created wheel for protorpc: filename=protorpc-0.12.0-py3-none-any.whl size=137671 sha256=57256ecc76f3b3b0836d1d09c8d0e0445ecab687038f80336d57acfbb0e5f290
Stored in directory: /root/.cache/pip/wheels/fc/86/a3/44e716af12921112b03d56484f6864de427cd09d658827a903
Building wheel for python-gflags (setup.py): started
Building wheel for python-gflags (setup.py): finished with status 'done'
Created wheel for python-gflags: filename=python_gflags-3.0.6-py3-none-any.whl size=54291 sha256=e692db820cafe2d9779e5be046a20a16d7428049510aca89099df42bf81fde57
Stored in directory: /root/.cache/pip/wheels/86/80/f0/25d8fdfc7735e5cd17d9b26738d19dfbb6cae9042ba89e7c02
Building wheel for docopt (setup.py): started
Building wheel for docopt (setup.py): finished with status 'done'
Created wheel for docopt: filename=docopt-0.6.2-py2.py3-none-any.whl size=13704 sha256=33f49b969ff41fbbfb7d45d842c649a95af4318f2117996ad17559a15e519068
Stored in directory: /root/.cache/pip/wheels/72/b0/3f/1d95f96ff986c7dfffe46ce2be4062f38ebd04b506c77c81b9
Building wheel for grpc-google-iam-v1 (setup.py): started
Building wheel for grpc-google-iam-v1 (setup.py): finished with status 'done'
Created wheel for grpc-google-iam-v1: filename=grpc_google_iam_v1-0.12.3-py3-none-any.whl size=18499 sha256=3b3aacaefe360d5d4a5e82a75cff64e492e56cc62208eaa3b6a4e0dfbc75016f
Stored in directory: /root/.cache/pip/wheels/b9/ee/67/2e444183030cb8d31ce8b34cee34a7afdbd3ba5959ea846380
Building wheel for termcolor (setup.py): started
Building wheel for termcolor (setup.py): finished with status 'done'
Created wheel for termcolor: filename=termcolor-1.1.0-py3-none-any.whl size=4830 sha256=8cad11652f74b2198092b363f82e43a95db2fb165ca9eee2bf5468102cd6c9b6
Stored in directory: /root/.cache/pip/wheels/3f/e3/ec/8a8336ff196023622fbcb36de0c5a5c218cbb24111d1d4c7f2
Building wheel for wrapt (setup.py): started
Building wheel for wrapt (setup.py): finished with status 'done'
Created wheel for wrapt: filename=wrapt-1.12.1-cp37-cp37m-linux_x86_64.whl size=76425 sha256=0afdb5c9146d4c997a640e519af1b32e720249d41fc0e077712eddb35556e0a0
Stored in directory: /root/.cache/pip/wheels/62/76/4c/aa25851149f3f6d9785f6c869387ad82b3fd37582fa8147ac6
Building wheel for absl-py (setup.py): started
Building wheel for absl-py (setup.py): finished with status 'done'
Created wheel for absl-py: filename=absl_py-0.9.0-py3-none-any.whl size=121931 sha256=ac354cb09badb63931e21dac4146ec57b20bb4466aa5b90fb69e484dc59e8eed
Stored in directory: /root/.cache/pip/wheels/cc/af/1a/498a24d0730ef484019e007bb9e8cef3ac00311a672c049a3e
Successfully built avro-python3 crcmod dill future hdfs httplib2 oauth2client pyyaml google-apitools protorpc python-gflags docopt grpc-google-iam-v1 termcolor wrapt absl-py
Installing collected packages: avro-python3, pytz, fastavro, crcmod, dill, future, six, grpcio, docopt, chardet, urllib3, idna, certifi, requests, hdfs, httplib2, pbr, mock, pyasn1, pyasn1-modules, rsa, oauth2client, protobuf, numpy, pyarrow, pyparsing, pydot, pyyaml, typing-extensions, googleapis-common-protos, cachetools, google-auth, google-api-core, monotonic, fasteners, google-apitools, grpc-google-iam-v1, google-cloud-pubsub, google-cloud-core, google-resumable-media, google-cloud-bigquery, google-cloud-bigtable, google-cloud-datastore, cython, guppy3, scipy, python-dateutil, pandas, protorpc, python-gflags, tensorboard-plugin-wit, absl-py, oauthlib, requests-oauthlib, google-auth-oauthlib, werkzeug, zipp, importlib-metadata, markdown, tensorboard, termcolor, wrapt, opt-einsum, astunparse, google-pasta, tensorflow-estimator, gast, keras-preprocessing, h5py, tensorflow, pymongo, tenacity, pyhamcrest, nose
> Task :sdks:python:container:py37:docker FAILED
:sdks:python:container:py37:docker (Thread[Execution worker for ':',5,main]) completed. Took 1 mins 46.001 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:python:container:py37:docker'.
> Process 'command 'docker'' finished with non-zero exit value 143
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1m 55s
20 actionable tasks: 14 executed, 6 up-to-date
The message received from the daemon indicates that the daemon has disappeared.
Build request sent: Build{id=d46e71b7-cae3-46eb-a5a7-ac7a04a86b92, currentDir=<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src}>
Attempting to read last messages from the daemon log...
Daemon pid: 12654
log file: /home/jenkins/.gradle/daemon/5.2.1/daemon-12654.out.log
----- Last 20 lines from daemon log file - daemon-12654.out.log -----
:sdks:python:container:py37:docker (Thread[Execution worker for ':',5,main]) completed. Took 1 mins 46.001 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:python:container:py37:docker'.
> Process 'command 'docker'' finished with non-zero exit value 143
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1m 55s
20 actionable tasks: 14 executed, 6 up-to-date
Daemon vm is shutting down... The daemon has exited normally or was terminated in response to a user interrupt.
----- End of the daemon log -----
FAILURE: Build failed with an exception.
* What went wrong:
Gradle build daemon disappeared unexpectedly (it may have been killed or may have crashed)
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Build step 'Execute shell' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal : beam_PostCommit_Py_ValCont #6585
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/6585/display/redirect?page=changes>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Py_ValCont #6584
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/6584/display/redirect?page=changes>
Changes:
[Kamil Wasilewski] [BEAM-9889] Publish InfluxDB backup to public GCS bucket
[Kamil Wasilewski] [BEAM-9889] Populate local instance of InfluxDB with data
------------------------------------------
[...truncated 684.24 KB...]
copying apache_beam/testing/load_tests/pardo_test.py -> apache-beam-2.24.0.dev0/apache_beam/testing/load_tests
copying apache_beam/testing/load_tests/sideinput_test.py -> apache-beam-2.24.0.dev0/apache_beam/testing/load_tests
copying apache_beam/testing/load_tests/streaming/__init__.py -> apache-beam-2.24.0.dev0/apache_beam/testing/load_tests/streaming
copying apache_beam/testing/load_tests/streaming/group_by_key_streaming_pipeline.py -> apache-beam-2.24.0.dev0/apache_beam/testing/load_tests/streaming
copying apache_beam/testing/load_tests/streaming/group_by_key_streaming_test.py -> apache-beam-2.24.0.dev0/apache_beam/testing/load_tests/streaming
copying apache_beam/tools/__init__.py -> apache-beam-2.24.0.dev0/apache_beam/tools
copying apache_beam/tools/coders_microbenchmark.py -> apache-beam-2.24.0.dev0/apache_beam/tools
copying apache_beam/tools/distribution_counter_microbenchmark.py -> apache-beam-2.24.0.dev0/apache_beam/tools
copying apache_beam/tools/fn_api_runner_microbenchmark.py -> apache-beam-2.24.0.dev0/apache_beam/tools
copying apache_beam/tools/map_fn_microbenchmark.py -> apache-beam-2.24.0.dev0/apache_beam/tools
copying apache_beam/tools/microbenchmarks_test.py -> apache-beam-2.24.0.dev0/apache_beam/tools
copying apache_beam/tools/sideinput_microbenchmark.py -> apache-beam-2.24.0.dev0/apache_beam/tools
copying apache_beam/tools/utils.py -> apache-beam-2.24.0.dev0/apache_beam/tools
copying apache_beam/transforms/__init__.py -> apache-beam-2.24.0.dev0/apache_beam/transforms
copying apache_beam/transforms/combiners.py -> apache-beam-2.24.0.dev0/apache_beam/transforms
copying apache_beam/transforms/combiners_test.py -> apache-beam-2.24.0.dev0/apache_beam/transforms
copying apache_beam/transforms/core.py -> apache-beam-2.24.0.dev0/apache_beam/transforms
copying apache_beam/transforms/create_source.py -> apache-beam-2.24.0.dev0/apache_beam/transforms
copying apache_beam/transforms/create_test.py -> apache-beam-2.24.0.dev0/apache_beam/transforms
copying apache_beam/transforms/cy_combiners.pxd -> apache-beam-2.24.0.dev0/apache_beam/transforms
copying apache_beam/transforms/cy_combiners.py -> apache-beam-2.24.0.dev0/apache_beam/transforms
copying apache_beam/transforms/cy_dataflow_distribution_counter.pxd -> apache-beam-2.24.0.dev0/apache_beam/transforms
copying apache_beam/transforms/cy_dataflow_distribution_counter.pyx -> apache-beam-2.24.0.dev0/apache_beam/transforms
copying apache_beam/transforms/dataflow_distribution_counter_test.py -> apache-beam-2.24.0.dev0/apache_beam/transforms
copying apache_beam/transforms/deduplicate.py -> apache-beam-2.24.0.dev0/apache_beam/transforms
copying apache_beam/transforms/deduplicate_test.py -> apache-beam-2.24.0.dev0/apache_beam/transforms
copying apache_beam/transforms/display.py -> apache-beam-2.24.0.dev0/apache_beam/transforms
copying apache_beam/transforms/display_test.py -> apache-beam-2.24.0.dev0/apache_beam/transforms
copying apache_beam/transforms/dofn_lifecycle_test.py -> apache-beam-2.24.0.dev0/apache_beam/transforms
copying apache_beam/transforms/environments.py -> apache-beam-2.24.0.dev0/apache_beam/transforms
copying apache_beam/transforms/environments_test.py -> apache-beam-2.24.0.dev0/apache_beam/transforms
copying apache_beam/transforms/external.py -> apache-beam-2.24.0.dev0/apache_beam/transforms
copying apache_beam/transforms/external_it_test.py -> apache-beam-2.24.0.dev0/apache_beam/transforms
copying apache_beam/transforms/external_java.py -> apache-beam-2.24.0.dev0/apache_beam/transforms
copying apache_beam/transforms/external_test.py -> apache-beam-2.24.0.dev0/apache_beam/transforms
copying apache_beam/transforms/external_test_py3.py -> apache-beam-2.24.0.dev0/apache_beam/transforms
copying apache_beam/transforms/external_test_py37.py -> apache-beam-2.24.0.dev0/apache_beam/transforms
copying apache_beam/transforms/periodicsequence.py -> apache-beam-2.24.0.dev0/apache_beam/transforms
copying apache_beam/transforms/periodicsequence_test.py -> apache-beam-2.24.0.dev0/apache_beam/transforms
copying apache_beam/transforms/ptransform.py -> apache-beam-2.24.0.dev0/apache_beam/transforms
copying apache_beam/transforms/ptransform_test.py -> apache-beam-2.24.0.dev0/apache_beam/transforms
copying apache_beam/transforms/py_dataflow_distribution_counter.py -> apache-beam-2.24.0.dev0/apache_beam/transforms
copying apache_beam/transforms/sideinputs.py -> apache-beam-2.24.0.dev0/apache_beam/transforms
copying apache_beam/transforms/sideinputs_test.py -> apache-beam-2.24.0.dev0/apache_beam/transforms
copying apache_beam/transforms/sql.py -> apache-beam-2.24.0.dev0/apache_beam/transforms
copying apache_beam/transforms/sql_test.py -> apache-beam-2.24.0.dev0/apache_beam/transforms
copying apache_beam/transforms/stats.py -> apache-beam-2.24.0.dev0/apache_beam/transforms
copying apache_beam/transforms/stats_test.py -> apache-beam-2.24.0.dev0/apache_beam/transforms
copying apache_beam/transforms/timeutil.py -> apache-beam-2.24.0.dev0/apache_beam/transforms
copying apache_beam/transforms/transforms_keyword_only_args_test_py3.py -> apache-beam-2.24.0.dev0/apache_beam/transforms
copying apache_beam/transforms/trigger.py -> apache-beam-2.24.0.dev0/apache_beam/transforms
copying apache_beam/transforms/trigger_test.py -> apache-beam-2.24.0.dev0/apache_beam/transforms
copying apache_beam/transforms/userstate.py -> apache-beam-2.24.0.dev0/apache_beam/transforms
copying apache_beam/transforms/userstate_test.py -> apache-beam-2.24.0.dev0/apache_beam/transforms
copying apache_beam/transforms/util.py -> apache-beam-2.24.0.dev0/apache_beam/transforms
copying apache_beam/transforms/util_test.py -> apache-beam-2.24.0.dev0/apache_beam/transforms
copying apache_beam/transforms/validate_runner_xlang_test.py -> apache-beam-2.24.0.dev0/apache_beam/transforms
copying apache_beam/transforms/window.py -> apache-beam-2.24.0.dev0/apache_beam/transforms
copying apache_beam/transforms/window_test.py -> apache-beam-2.24.0.dev0/apache_beam/transforms
copying apache_beam/transforms/write_ptransform_test.py -> apache-beam-2.24.0.dev0/apache_beam/transforms
copying apache_beam/typehints/__init__.py -> apache-beam-2.24.0.dev0/apache_beam/typehints
copying apache_beam/typehints/decorators.py -> apache-beam-2.24.0.dev0/apache_beam/typehints
copying apache_beam/typehints/decorators_test.py -> apache-beam-2.24.0.dev0/apache_beam/typehints
copying apache_beam/typehints/decorators_test_py3.py -> apache-beam-2.24.0.dev0/apache_beam/typehints
copying apache_beam/typehints/native_type_compatibility.py -> apache-beam-2.24.0.dev0/apache_beam/typehints
copying apache_beam/typehints/native_type_compatibility_test.py -> apache-beam-2.24.0.dev0/apache_beam/typehints
copying apache_beam/typehints/opcodes.py -> apache-beam-2.24.0.dev0/apache_beam/typehints
copying apache_beam/typehints/row_type.py -> apache-beam-2.24.0.dev0/apache_beam/typehints
copying apache_beam/typehints/schemas.py -> apache-beam-2.24.0.dev0/apache_beam/typehints
copying apache_beam/typehints/schemas_test.py -> apache-beam-2.24.0.dev0/apache_beam/typehints
copying apache_beam/typehints/trivial_inference.py -> apache-beam-2.24.0.dev0/apache_beam/typehints
copying apache_beam/typehints/trivial_inference_test.py -> apache-beam-2.24.0.dev0/apache_beam/typehints
copying apache_beam/typehints/trivial_inference_test_py3.py -> apache-beam-2.24.0.dev0/apache_beam/typehints
copying apache_beam/typehints/typecheck.py -> apache-beam-2.24.0.dev0/apache_beam/typehints
copying apache_beam/typehints/typecheck_test_py3.py -> apache-beam-2.24.0.dev0/apache_beam/typehints
copying apache_beam/typehints/typed_pipeline_test.py -> apache-beam-2.24.0.dev0/apache_beam/typehints
copying apache_beam/typehints/typed_pipeline_test_py3.py -> apache-beam-2.24.0.dev0/apache_beam/typehints
copying apache_beam/typehints/typehints.py -> apache-beam-2.24.0.dev0/apache_beam/typehints
copying apache_beam/typehints/typehints_test.py -> apache-beam-2.24.0.dev0/apache_beam/typehints
copying apache_beam/typehints/typehints_test_py3.py -> apache-beam-2.24.0.dev0/apache_beam/typehints
copying apache_beam/utils/__init__.py -> apache-beam-2.24.0.dev0/apache_beam/utils
copying apache_beam/utils/annotations.py -> apache-beam-2.24.0.dev0/apache_beam/utils
copying apache_beam/utils/annotations_test.py -> apache-beam-2.24.0.dev0/apache_beam/utils
copying apache_beam/utils/counters.pxd -> apache-beam-2.24.0.dev0/apache_beam/utils
copying apache_beam/utils/counters.py -> apache-beam-2.24.0.dev0/apache_beam/utils
copying apache_beam/utils/counters_test.py -> apache-beam-2.24.0.dev0/apache_beam/utils
copying apache_beam/utils/interactive_utils.py -> apache-beam-2.24.0.dev0/apache_beam/utils
copying apache_beam/utils/plugin.py -> apache-beam-2.24.0.dev0/apache_beam/utils
copying apache_beam/utils/processes.py -> apache-beam-2.24.0.dev0/apache_beam/utils
copying apache_beam/utils/processes_test.py -> apache-beam-2.24.0.dev0/apache_beam/utils
copying apache_beam/utils/profiler.py -> apache-beam-2.24.0.dev0/apache_beam/utils
copying apache_beam/utils/proto_utils.py -> apache-beam-2.24.0.dev0/apache_beam/utils
copying apache_beam/utils/retry.py -> apache-beam-2.24.0.dev0/apache_beam/utils
copying apache_beam/utils/retry_test.py -> apache-beam-2.24.0.dev0/apache_beam/utils
copying apache_beam/utils/shared.py -> apache-beam-2.24.0.dev0/apache_beam/utils
copying apache_beam/utils/shared_test.py -> apache-beam-2.24.0.dev0/apache_beam/utils
copying apache_beam/utils/subprocess_server.py -> apache-beam-2.24.0.dev0/apache_beam/utils
copying apache_beam/utils/subprocess_server_test.py -> apache-beam-2.24.0.dev0/apache_beam/utils
copying apache_beam/utils/thread_pool_executor.py -> apache-beam-2.24.0.dev0/apache_beam/utils
copying apache_beam/utils/thread_pool_executor_test.py -> apache-beam-2.24.0.dev0/apache_beam/utils
copying apache_beam/utils/timestamp.py -> apache-beam-2.24.0.dev0/apache_beam/utils
copying apache_beam/utils/timestamp_test.py -> apache-beam-2.24.0.dev0/apache_beam/utils
copying apache_beam/utils/urns.py -> apache-beam-2.24.0.dev0/apache_beam/utils
copying apache_beam/utils/windowed_value.pxd -> apache-beam-2.24.0.dev0/apache_beam/utils
copying apache_beam/utils/windowed_value.py -> apache-beam-2.24.0.dev0/apache_beam/utils
copying apache_beam/utils/windowed_value_test.py -> apache-beam-2.24.0.dev0/apache_beam/utils
Writing apache-beam-2.24.0.dev0/setup.cfg
creating dist
Creating tar archive
removing 'apache-beam-2.24.0.dev0' (and everything under it)
SDK_LOCATION=$(find dist/apache-beam-*.tar.gz)
find dist/apache-beam-*.tar.gz
# Run ValidatesRunner tests on Google Cloud Dataflow service
echo ">>> RUNNING DATAFLOW RUNNER VALIDATESCONTAINER TEST"
>>> RUNNING DATAFLOW RUNNER VALIDATESCONTAINER TEST
python setup.py nosetests \
--attr ValidatesContainer \
--nologcapture \
--processes=1 \
--process-timeout=900 \
--with-xunitmp \
--xunitmp-file=$XUNIT_FILE \
--ignore-files '.*py3\d?\.py$' \
--test-pipeline-options=" \
--runner=TestDataflowRunner \
--project=$PROJECT \
--region=$REGION \
--worker_harness_container_image=$CONTAINER:$TAG \
--staging_location=$GCS_LOCATION/staging-validatesrunner-test \
--temp_location=$GCS_LOCATION/temp-validatesrunner-test \
--output=$GCS_LOCATION/output \
--sdk_location=$SDK_LOCATION \
--num_workers=1"
setup.py:265: UserWarning: You are using Apache Beam with Python 2. New releases of Apache Beam will soon support Python 3 only.
'You are using Apache Beam with Python 2. '
<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/container/venv/python/local/lib/python2.7/site-packages/setuptools/dist.py>:476: UserWarning: Normalizing '2.24.0.dev' to '2.24.0.dev0'
normalized_version,
running nosetests
running egg_info
<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/gen_protos.py>:241: UserWarning: Installing grpcio-tools is recommended for development.
warnings.warn('Installing grpcio-tools is recommended for development.')
INFO:gen_protos:Skipping proto regeneration: all files up to date
writing requirements to apache_beam.egg-info/requires.txt
writing apache_beam.egg-info/PKG-INFO
writing top-level names to apache_beam.egg-info/top_level.txt
writing dependency_links to apache_beam.egg-info/dependency_links.txt
writing entry points to apache_beam.egg-info/entry_points.txt
reading manifest file 'apache_beam.egg-info/SOURCES.txt'
reading manifest template 'MANIFEST.in'
warning: no files found matching 'README.md'
warning: no files found matching 'NOTICE'
warning: no files found matching 'LICENSE'
writing manifest file 'apache_beam.egg-info/SOURCES.txt'
<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/__init__.py>:82: UserWarning: You are using Apache Beam with Python 2. New releases of Apache Beam will soon support Python 3 only.
'You are using Apache Beam with Python 2. '
WARNING:root:python-snappy is not installed; some tests will be skipped.
WARNING:root:Tensorflow is not installed, so skipping some tests.
WARNING:apache_beam.runners.interactive.interactive_environment:Interactive Beam requires Python 3.5.3+.
WARNING:apache_beam.runners.interactive.interactive_environment:Dependencies required for Interactive Beam PCollection visualization are not available, please use: `pip install apache-beam[interactive]` to install necessary dependencies to enable all data visualization features.
WARNING:apache_beam.runners.interactive.interactive_environment:You cannot use Interactive Beam features when you are not in an interactive environment such as a Jupyter notebook or ipython terminal.
WARNING:root:Make sure that locally built Python SDK docker image has Python 2.7 interpreter.
WARNING:root:Make sure that locally built Python SDK docker image has Python 2.7 interpreter.
test_wordcount_fnapi_it (apache_beam.examples.wordcount_it_test.WordCountIT) ... WARNING:root:Make sure that locally built Python SDK docker image has Python 2.7 interpreter.
test_metrics_fnapi_it (apache_beam.runners.dataflow.dataflow_exercise_metrics_pipeline_test.ExerciseMetricsPipelineTest) ... ERROR
======================================================================
ERROR: test suite for <class 'apache_beam.runners.dataflow.dataflow_exercise_metrics_pipeline_test.ExerciseMetricsPipelineTest'>
----------------------------------------------------------------------
Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/container/venv/python/local/lib/python2.7/site-packages/nose/plugins/multiprocess.py",> line 812, in run
test(orig)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/container/venv/python/local/lib/python2.7/site-packages/nose/suite.py",> line 177, in __call__
return self.run(*arg, **kw)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/container/venv/python/local/lib/python2.7/site-packages/nose/plugins/multiprocess.py",> line 822, in run
test.config.plugins.addError(test,err)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/container/venv/python/local/lib/python2.7/site-packages/nose/plugins/manager.py",> line 99, in __call__
return self.call(*arg, **kw)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/container/venv/python/local/lib/python2.7/site-packages/nose/plugins/manager.py",> line 167, in simple
result = meth(*arg, **kw)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/container/venv/python/local/lib/python2.7/site-packages/nose/plugins/xunit.py",> line 287, in addError
tb = format_exception(err, self.encoding)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/container/venv/python/local/lib/python2.7/site-packages/nose/pyversion.py",> line 214, in format_exception
''.join(traceback.format_exception(*exc_info)),
File "/usr/lib/python2.7/traceback.py", line 141, in format_exception
list = list + format_tb(tb, limit)
File "/usr/lib/python2.7/traceback.py", line 76, in format_tb
return format_list(extract_tb(tb, limit))
File "/usr/lib/python2.7/traceback.py", line 101, in extract_tb
line = linecache.getline(filename, lineno, f.f_globals)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/container/venv/python/lib/python2.7/linecache.py",> line 14, in getline
lines = getlines(filename, module_globals)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/container/venv/python/lib/python2.7/linecache.py",> line 41, in getlines
return updatecache(filename, module_globals)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/container/venv/python/lib/python2.7/linecache.py",> line 132, in updatecache
lines = fp.readlines()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/container/venv/python/local/lib/python2.7/site-packages/nose/plugins/multiprocess.py",> line 276, in signalhandler
raise TimedOutException()
TimedOutException: '<nose.plugins.multiprocess.NoSharedFixtureContextSuite context=ExerciseMetricsPipelineTest>'
----------------------------------------------------------------------
XML: nosetests-beam_python2.7_sdk.xml
----------------------------------------------------------------------
XML: <https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/nosetests.xml>
----------------------------------------------------------------------
Ran 2 tests in 1804.423s
FAILED (errors=1)
cleanup_container
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_python2.7_sdk:20200715-120024
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_python2.7_sdk@sha256:483f2ea32b4afc03b059f63521d1ca489ca208690e19ddaf3ca3cee11f6235cc
Deleted: sha256:906c111a2d74238591b54e166e203904338b65807e06e6d32f5e7613309122ca
Deleted: sha256:c7d9bf91bd6da351cdb591188bb567942d92c5d56bff64664a79ba3f6e7b773c
Deleted: sha256:f2e66ea580ce824de10458ea1a3d55f2e86875a11c555a432db95e74b3f114e3
Deleted: sha256:2359bab56a68414212ebf70a506fd6c48591aafc8c2eedb25e98aa7b0aa27b31
Deleted: sha256:12684309aee6164f45801acf79781ac7315a583675416a3a0a02ddc04b02b092
Deleted: sha256:7b2ca7b2ff782073095a8f8eb4f0e80b11d1602dc2919a9c549ece31de50433a
Deleted: sha256:979ee13349669100326a4adab89fb815dee53b8b8678b86b8a265fedb7698fe5
Deleted: sha256:033b100fabc40c6d2a4fc29329ee2c107e3ff55883763a7bdb099d8b48c28b29
Deleted: sha256:355a1c2945984e1189460288bf0bdd8c7d4eb43f1f73aba8247a7805a07d509e
Deleted: sha256:dceeadb7fd241827c68b401d135a6531534aa20d7a8704eb821ae79c626196f9
Deleted: sha256:eaeb7b667cf2328a56b0ff21b43b2a605b9e9aeeb29a0f676efe6f88646b1e24
Deleted: sha256:0a022f971b0c67ab47c54c3ef4233cbd7d21824315e17de26366c07269211861
Deleted: sha256:75089b322a644f9228192ffcd2e1d1fa485209398ae92cd03ae099658729d0b1
Deleted: sha256:d11b88eac9dcc96c9352f5d4458d45f78ea5d834e473d42f2e8c11a4e6a47671
Deleted: sha256:f50b64fbb1d7427296e43f846c0efd99fc8731b0804f50eee1e2dc7a74cd698d
Deleted: sha256:ca82aacefbeeff1397698f42690e9e99a2fd1f302122e70d64e6e720b9cbfadc
Deleted: sha256:5c5ca5d396cb53b3d6d506d33a9e1a8232ae0808adab434e2b881176c71768cb
Deleted: sha256:c037530aff7b4cf4d7d2988a0d4062469d40ea7a002b785a005af80f124dff19
Deleted: sha256:86898c364cb05dfac55c647c6ca63580ee0ea4101bf0aee2bd168facc2fb56a2
Deleted: sha256:ba4e1fd64987ab63e67cf4f6d1c633b4d8ba24fc480f79ab9d95925149d900ad
Deleted: sha256:8f885f21f0f630df7446dc5b19d140057d4cb93f384369d6f2378a13c496e0dc
Deleted: sha256:a060a89e1757f4561841f780dc2b95f391151987c0ae1c5dfee2bbe80692f58e
Deleted: sha256:0d1f9653a706cfbdcd3b1b672f276eb4816c3fa0e966c2b3f5a4ce667e32336c
Deleted: sha256:4e3c9abfc16813d63de4c2be7c59b2f0aa3ed087355c680a0bf10ddf31a3038f
Deleted: sha256:792a028a51478ba649ede7990168baac75aea9981c6b262ff90f08f5e51918af
Deleted: sha256:495007d029ce6bd302912248411c09bab772e5323f4e4dc0146d2ad463ffddba
Deleted: sha256:770b417041492374e843aad01f32c4fa3bd420ad2df4680272b0b42c1713fada
Deleted: sha256:bf9f0d1a5792d287983f729e4c95da3468561f33618d9b31963fc9fc19d20229
Digests:
- us.gcr.io/apache-beam-testing/jenkins/beam_python2.7_sdk@sha256:483f2ea32b4afc03b059f63521d1ca489ca208690e19ddaf3ca3cee11f6235cc
Associated tags:
- 20200715-120024
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_python2.7_sdk:20200715-120024
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_python2.7_sdk:20200715-120024].
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_python2.7_sdk@sha256:483f2ea32b4afc03b059f63521d1ca489ca208690e19ddaf3ca3cee11f6235cc].
Removed the container
Build step 'Execute shell' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org