You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2021/08/11 00:52:18 UTC
Build failed in Jenkins: beam_PostCommit_XVR_Dataflow #1057
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/1057/display/redirect?page=changes>
Changes:
[andyxu] Add support for python sdk container to turn on google cloud profiler
[andyxu] format file
[marwant] Update Google Cloud Healthcare API version from v1beta1 to GA
[zyichi] Update beam dataflow python container versions.
------------------------------------------
[...truncated 155.67 KB...]
> Task :sdks:java:container:java8:dockerPrepare
> Task :sdks:python:container:py38:docker
---> Running in e3c65d428460
Removing intermediate container e3c65d428460
---> 708f591336d3
Step 4/27 : ARG pull_licenses
---> Running in b103de4f8796
Removing intermediate container b103de4f8796
---> 43c51247bc53
Step 5/27 : RUN apt-get update && apt-get install -y libsnappy-dev libyaml-dev ccache && rm -rf /var/lib/apt/lists/*
---> Running in 89d17dcdc184
Get:1 http://security.debian.org/debian-security buster/updates InRelease [65.4 kB]
Get:2 http://deb.debian.org/debian buster InRelease [122 kB]
Get:3 http://deb.debian.org/debian buster-updates InRelease [51.9 kB]
Get:4 http://security.debian.org/debian-security buster/updates/main amd64 Packages [300 kB]
Get:5 http://deb.debian.org/debian buster/main amd64 Packages [7907 kB]
Get:6 http://deb.debian.org/debian buster-updates/main amd64 Packages [15.2 kB]
Fetched 8460 kB in 2s (3518 kB/s)
Reading package lists...
Reading package lists...
Building dependency tree...
Reading state information...
libyaml-dev is already the newest version (0.2.1-1).
Suggested packages:
distcc | icecc
The following NEW packages will be installed:
ccache libsnappy-dev libsnappy1v5
0 upgraded, 3 newly installed, 0 to remove and 12 not upgraded.
Need to get 203 kB of archives.
After this operation, 514 kB of additional disk space will be used.
Get:1 http://deb.debian.org/debian buster/main amd64 ccache amd64 3.6-1 [156 kB]
Get:2 http://deb.debian.org/debian buster/main amd64 libsnappy1v5 amd64 1.1.7-1 [17.0 kB]
Get:3 http://deb.debian.org/debian buster/main amd64 libsnappy-dev amd64 1.1.7-1 [29.2 kB]
[91mdebconf: delaying package configuration, since apt-utils is not installed
[0mFetched 203 kB in 0s (515 kB/s)
Selecting previously unselected package ccache.
(Reading database ...
(Reading database ... 5%(Reading database ... 10%(Reading database ... 15%(Reading database ... 20%(Reading database ... 25%(Reading database ... 30%(Reading database ... 35%(Reading database ... 40%(Reading database ... 45%(Reading database ... 50%(Reading database ... 55%(Reading database ... 60%(Reading database ... 65%(Reading database ... 70%
(Reading database ... 75%
(Reading database ... 80%
(Reading database ... 85%
(Reading database ... 90%
(Reading database ... 95%
(Reading database ... 100%(Reading database ... 24613 files and directories currently installed.)
Preparing to unpack .../ccache_3.6-1_amd64.deb ...
Unpacking ccache (3.6-1) ...
Selecting previously unselected package libsnappy1v5:amd64.
Preparing to unpack .../libsnappy1v5_1.1.7-1_amd64.deb ...
Unpacking libsnappy1v5:amd64 (1.1.7-1) ...
Selecting previously unselected package libsnappy-dev:amd64.
Preparing to unpack .../libsnappy-dev_1.1.7-1_amd64.deb ...
Unpacking libsnappy-dev:amd64 (1.1.7-1) ...
Setting up ccache (3.6-1) ...
Updating symlinks in /usr/lib/ccache ...
Setting up libsnappy1v5:amd64 (1.1.7-1) ...
Setting up libsnappy-dev:amd64 (1.1.7-1) ...
Processing triggers for libc-bin (2.28-10) ...
Removing intermediate container 89d17dcdc184
---> 690b05ce02d4
Step 6/27 : COPY target/base_image_requirements.txt /tmp/base_image_requirements.txt
---> e0587b25eeeb
Step 7/27 : RUN pip install -r /tmp/base_image_requirements.txt && python -c "from google.protobuf.internal import api_implementation; assert api_implementation._default_implementation_type == 'cpp'; print ('Verified fast protobuf used.')" && rm -rf /root/.cache/pip && rm -rf /tmp/base_image_requirements.txt
---> Running in a108753ef6ef
Ignoring dataclasses: markers 'python_version == "3.6"' don't match your environment
Ignoring pandas: markers 'python_version < "3.7"' don't match your environment
Collecting avro-python3==1.8.2
Downloading avro-python3-1.8.2.tar.gz (36 kB)
Collecting fastavro==1.0.0.post1
Downloading fastavro-1.0.0.post1-cp38-cp38-manylinux2014_x86_64.whl (1.7 MB)
Collecting crcmod==1.7
Downloading crcmod-1.7.tar.gz (89 kB)
Collecting dill==0.3.1.1
Downloading dill-0.3.1.1.tar.gz (151 kB)
Collecting future==0.18.2
Downloading future-0.18.2.tar.gz (829 kB)
> Task :sdks:java:container:java8:docker
---> Running in 7577272139a9
Removing intermediate container 7577272139a9
---> 61091dc50749
Step 4/18 : ARG pull_licenses
---> Running in d91ec815ef10
Removing intermediate container d91ec815ef10
---> 25d2cd4854eb
Step 5/18 : ADD target/slf4j-api.jar /opt/apache/beam/jars/
---> 5919db92cce4
Step 6/18 : ADD target/slf4j-jdk14.jar /opt/apache/beam/jars/
---> 9b0aafa7438a
Step 7/18 : ADD target/beam-sdks-java-harness.jar /opt/apache/beam/jars/
---> 99f94a8a5033
Step 8/18 : ADD target/beam-sdks-java-io-kafka.jar /opt/apache/beam/jars/
---> 5612b63e141c
Step 9/18 : ADD target/kafka-clients.jar /opt/apache/beam/jars/
---> a54c26a20fed
Step 10/18 : ADD target/linux_amd64/boot /opt/apache/beam/
---> 427f815746f3
Step 11/18 : COPY target/LICENSE /opt/apache/beam/
---> 404f1c041612
Step 12/18 : COPY target/NOTICE /opt/apache/beam/
---> 108b098ed99c
Step 13/18 : ADD target/third_party_licenses /opt/apache/beam/third_party_licenses/
---> 1feff431db3c
Step 14/18 : COPY target/LICENSE target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/
---> a0a0485d223c
Step 15/18 : RUN rm /opt/apache/beam/third_party_licenses/golang/LICENSE
---> Running in 609ecae3f1e7
Removing intermediate container 609ecae3f1e7
---> 4809bdf0222d
Step 16/18 : RUN if [ "${pull_licenses}" = "false" ] ; then rm -rf /opt/apache/beam/third_party_licenses ; fi
---> Running in 4655313b7f7d
Removing intermediate container 4655313b7f7d
---> a10d01367978
Step 17/18 : COPY target/profiler/* /opt/google_cloud_profiler/
---> f73a0e1ac28c
Step 18/18 : ENTRYPOINT ["/opt/apache/beam/boot"]
---> Running in 10bef6cf3bcc
Removing intermediate container 10bef6cf3bcc
---> a054f932f621
Successfully built a054f932f621
Successfully tagged apache/beam_java8_sdk:2.33.0.dev
> Task :runners:google-cloud-dataflow-java:buildAndPushDockerContainer
WARNING: `gcloud docker` will not be supported for Docker client versions above 18.03.
As an alternative, use `gcloud auth configure-docker` to configure `docker` to
use `gcloud` as a credential helper, then use `docker` as you would for non-GCR
registries, e.g. `docker pull gcr.io/project-id/my-image`. Add
`--verbosity=error` to silence this warning: `gcloud docker
--verbosity=error -- pull gcr.io/project-id/my-image`.
See: https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker
> Task :runners:google-cloud-dataflow-java:setupXVR
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerSetup
Launching Java expansion service @ 33921
Launching Python expansion service @ 39019
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerPythonUsingJava
>>> RUNNING integration tests with pipeline options: --runner=TestDataflowRunner --project=apache-beam-testing --region=us-central1 --sdk_harness_container_image_overrides=.*java.*,us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210811003317 --experiments=use_runner_v2 --experiments=shuffle_mode=appliance --sdk_location=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/build/apache-beam.tar.gz>
>>> pytest options: --capture=no --numprocesses=8 --timeout=4500 --log-cli-level=INFO
>>> collect markers: -m=xlang_transforms
============================= test session starts ==============================
platform linux -- Python 3.6.8, pytest-4.6.11, py-1.10.0, pluggy-0.13.1
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.3.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[gw0] Python 3.6.8 (default, Dec 24 2018, 19:24:27) -- [GCC 5.4.0 20160609]
[gw1] Python 3.6.8 (default, Dec 24 2018, 19:24:27) -- [GCC 5.4.0 20160609]
[gw2] Python 3.6.8 (default, Dec 24 2018, 19:24:27) -- [GCC 5.4.0 20160609]
[gw4] Python 3.6.8 (default, Dec 24 2018, 19:24:27) -- [GCC 5.4.0 20160609]
[gw6] Python 3.6.8 (default, Dec 24 2018, 19:24:27) -- [GCC 5.4.0 20160609]
[gw3] Python 3.6.8 (default, Dec 24 2018, 19:24:27) -- [GCC 5.4.0 20160609]
[gw5] Python 3.6.8 (default, Dec 24 2018, 19:24:27) -- [GCC 5.4.0 20160609]
[gw7] Python 3.6.8 (default, Dec 24 2018, 19:24:27) -- [GCC 5.4.0 20160609]
gw0 [8] / gw1 [8] / gw2 [8] / gw3 [8] / gw4 [8] / gw5 [8] / gw6 [8] / gw7 [8]
scheduling tests via LoadScheduling
apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_multi_input_output_with_sideinput
apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_cogroup_by_key
apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_group_by_key
apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_prefix
apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_combine_globally
apache_beam/io/external/generate_sequence_test.py::XlangGenerateSequenceTest::test_generate_sequence
apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_partition
apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_combine_per_key
[gw6] PASSED apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_group_by_key
[gw4] PASSED apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_combine_per_key
[gw7] PASSED apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_prefix
[gw1] PASSED apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_cogroup_by_key
[gw3] PASSED apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_multi_input_output_with_sideinput
[gw0] PASSED apache_beam/io/external/generate_sequence_test.py::XlangGenerateSequenceTest::test_generate_sequence
[gw5] PASSED apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_partition
[gw2] PASSED apache_beam/transforms/validate_runner_xlang_test.py::ValidateRunnerXlangTest::test_combine_globally
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/pytest_xlangValidateRunner.xml> -
========================== 8 passed in 691.25 seconds ==========================
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 23573.
Stopping expansion service pid: 23576.
> Task :runners:google-cloud-dataflow-java:cleanUpDockerImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210811003317
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:85a03ab3cff2c7e09fc10c2487d8ef0351ea6073b5673427706b833aac37200a
Deleted: sha256:a054f932f621b25e33b643d52c5d634f9ab16aefa020bafb6f7fe0a3ea1fc68c
Deleted: sha256:f73a0e1ac28c29449a082d326d9c937044b420544437c96185ba0709611015c3
Deleted: sha256:a10d0136797870355a212c944ff8d402c21f37399af19c7bd1afbc40b35e954e
Deleted: sha256:4809bdf0222dfa0465e7cc121e00a60375775080a1170b3e84099480bfbc2b94
Deleted: sha256:a0a0485d223c576633ae0cdb42706a545742bd3a1d8179b54c15016bf4a62766
Deleted: sha256:1feff431db3c42c206193dee631d2a262aeddadbfef7da555cbddb3b90b09477
Deleted: sha256:108b098ed99c2c81ca736f3a522760d417f5d4ae0ec5216c5dfa2a5e0c78afd4
Deleted: sha256:404f1c041612540af6e641966b0ad3c8947181c374855a72e0a62488ce460629
Deleted: sha256:427f815746f31dfdb3e6b8471af507c906a2f5e8c80839e2ba63655840278e13
Deleted: sha256:a54c26a20fedf6f503454409e9165aaf4e2192706d194b76884a813f4bddfd9c
Deleted: sha256:5612b63e141ca5ec0d458c772881b7f8c1872ec1ec27dd229b8751ec3470ac83
Deleted: sha256:99f94a8a5033f343cd92b62f5a5ce799a49dc4826bd84c9addf7a0db3fffdeee
Deleted: sha256:9b0aafa7438ae6c7918267c8bfdc5103c811cab470c88d87c81dac563c988ff4
Deleted: sha256:5919db92cce431b73617f77744edad9eb0f2af3030c465c3e24ca089c3417199
Deleted: sha256:25d2cd4854ebd3e1f048af7894739395d364b8f211dd1db90de45b6fdab49ac5
Deleted: sha256:61091dc50749725fb555650c82572e84ac0ce0ec9ab43d283ab08b9f6b9f4cda
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210811003317]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:85a03ab3cff2c7e09fc10c2487d8ef0351ea6073b5673427706b833aac37200a]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210811003317] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:85a03ab3cff2c7e09fc10c2487d8ef0351ea6073b5673427706b833aac37200a])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:85a03ab3cff2c7e09fc10c2487d8ef0351ea6073b5673427706b833aac37200a
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:85a03ab3cff2c7e09fc10c2487d8ef0351ea6073b5673427706b833aac37200a
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:85a03ab3cff2c7e09fc10c2487d8ef0351ea6073b5673427706b833aac37200a].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:a4f0893131ad6f8c4e987111f041186a0523d19e09155f4eb71ea45515b3b156
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:a4f0893131ad6f8c4e987111f041186a0523d19e09155f4eb71ea45515b3b156
ERROR: (gcloud.container.images.delete) Not found: response: {'status': '404', 'content-length': '168', 'x-xss-protection': '0', 'transfer-encoding': 'chunked', 'server': 'Docker Registry', '-content-encoding': 'gzip', 'docker-distribution-api-version': 'registry/2.0', 'cache-control': 'private', 'date': 'Wed, 11 Aug 2021 00:52:16 GMT', 'x-frame-options': 'SAMEORIGIN', 'content-type': 'application/json'}
Failed to compute blob liveness for manifest: 'sha256:a4f0893131ad6f8c4e987111f041186a0523d19e09155f4eb71ea45515b3b156': None
> Task :runners:google-cloud-dataflow-java:cleanUpDockerImages FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/runners/google-cloud-dataflow-java/build.gradle'> line: 282
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:cleanUpDockerImages'.
> Process 'command './scripts/cleanup_untagged_gcr_images.sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 19m 2s
103 actionable tasks: 29 executed, 74 up-to-date
Publishing build scan...
https://gradle.com/s/jtpoipgy4anrs
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal : beam_PostCommit_XVR_Dataflow
#1058
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/1058/display/redirect>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org