You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2021/09/09 18:16:44 UTC
Build failed in Jenkins: beam_PostCommit_XVR_Dataflow #1176
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/1176/display/redirect?page=changes>
Changes:
[kawaigin] [BEAM-10708] Support streaming cache in beam_sql magic
------------------------------------------
[...truncated 61.97 KB...]
Using cached google_apitools-0.5.31-py3-none-any.whl
Collecting google-auth<3,>=1.18.0
Using cached google_auth-2.0.2-py2.py3-none-any.whl (152 kB)
Collecting google-cloud-datastore<2,>=1.8.0
Using cached google_cloud_datastore-1.15.3-py2.py3-none-any.whl (134 kB)
Collecting google-cloud-pubsub<2,>=0.39.0
Using cached google_cloud_pubsub-1.7.0-py2.py3-none-any.whl (144 kB)
Collecting google-cloud-bigquery<3,>=1.6.0
Using cached google_cloud_bigquery-2.26.0-py2.py3-none-any.whl (201 kB)
Collecting google-cloud-core<2,>=0.28.1
Using cached google_cloud_core-1.7.2-py2.py3-none-any.whl (28 kB)
Collecting google-cloud-bigtable<2,>=0.31.1
Using cached google_cloud_bigtable-1.7.0-py2.py3-none-any.whl (267 kB)
Collecting google-cloud-spanner<2,>=1.13.0
Using cached google_cloud_spanner-1.19.1-py2.py3-none-any.whl (255 kB)
Collecting grpcio-gcp<1,>=0.2.2
Using cached grpcio_gcp-0.2.2-py2.py3-none-any.whl (9.4 kB)
Collecting google-cloud-dlp<2,>=0.12.0
Using cached google_cloud_dlp-1.0.0-py2.py3-none-any.whl (169 kB)
Collecting google-cloud-language<2,>=1.3.0
Using cached google_cloud_language-1.3.0-py2.py3-none-any.whl (83 kB)
Collecting google-cloud-videointelligence<2,>=1.8.0
Using cached google_cloud_videointelligence-1.16.1-py2.py3-none-any.whl (183 kB)
Collecting google-cloud-vision<2,>=0.38.0
Using cached google_cloud_vision-1.0.0-py2.py3-none-any.whl (435 kB)
Collecting google-cloud-recommendations-ai<=0.2.0,>=0.1.0
Using cached google_cloud_recommendations_ai-0.2.0-py2.py3-none-any.whl (180 kB)
Collecting azure-storage-blob>=12.3.2
Using cached azure_storage_blob-12.8.1-py2.py3-none-any.whl (345 kB)
Collecting azure-core>=1.7.0
Using cached azure_core-1.18.0-py2.py3-none-any.whl (166 kB)
Collecting boto3>=1.9
Using cached boto3-1.18.38-py3-none-any.whl (131 kB)
Requirement already satisfied: six>=1.11.0 in <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages> (from azure-core>=1.7.0->apache-beam==2.34.0.dev0) (1.16.0)
Collecting msrest>=0.6.18
Using cached msrest-0.6.21-py2.py3-none-any.whl (85 kB)
Collecting cryptography>=2.1.4
Using cached cryptography-3.4.8-cp36-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.2 MB)
Collecting jmespath<1.0.0,>=0.7.1
Using cached jmespath-0.10.0-py2.py3-none-any.whl (24 kB)
Collecting s3transfer<0.6.0,>=0.5.0
Using cached s3transfer-0.5.0-py3-none-any.whl (79 kB)
Collecting botocore<1.22.0,>=1.21.38
Using cached botocore-1.21.38-py3-none-any.whl (7.9 MB)
Collecting urllib3<1.27,>=1.25.4
Using cached urllib3-1.26.6-py2.py3-none-any.whl (138 kB)
Collecting cffi>=1.12
Using cached cffi-1.14.6-cp36-cp36m-manylinux1_x86_64.whl (401 kB)
Collecting pycparser
Using cached pycparser-2.20-py2.py3-none-any.whl (112 kB)
Collecting fasteners>=0.14
Using cached fasteners-0.16.3-py2.py3-none-any.whl (28 kB)
Collecting pyasn1-modules>=0.2.1
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Requirement already satisfied: setuptools>=40.3.0 in <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages> (from google-auth<3,>=1.18.0->apache-beam==2.34.0.dev0) (58.0.4)
Collecting rsa<5,>=3.1.4
Using cached rsa-4.7.2-py3-none-any.whl (34 kB)
Collecting google-api-core[grpc]<3.0.0dev,>=1.29.0
Using cached google_api_core-2.0.1-py2.py3-none-any.whl (92 kB)
Requirement already satisfied: packaging>=14.3 in <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages> (from google-cloud-bigquery<3,>=1.6.0->apache-beam==2.34.0.dev0) (21.0)
Collecting proto-plus>=1.10.0
Using cached proto_plus-1.19.0-py3-none-any.whl (42 kB)
Collecting google-resumable-media<3.0dev,>=0.6.0
Using cached google_resumable_media-2.0.2-py2.py3-none-any.whl (75 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.53.0-py2.py3-none-any.whl (198 kB)
Collecting google-cloud-bigtable<2,>=0.31.1
Using cached google_cloud_bigtable-1.6.1-py2.py3-none-any.whl (267 kB)
Using cached google_cloud_bigtable-1.6.0-py2.py3-none-any.whl (267 kB)
Using cached google_cloud_bigtable-1.5.1-py2.py3-none-any.whl (266 kB)
Using cached google_cloud_bigtable-1.5.0-py2.py3-none-any.whl (266 kB)
Using cached google_cloud_bigtable-1.4.0-py2.py3-none-any.whl (265 kB)
Collecting grpc-google-iam-v1<0.13dev,>=0.12.3
Using cached grpc_google_iam_v1-0.12.3-py3-none-any.whl
Collecting google-cloud-bigtable<2,>=0.31.1
Using cached google_cloud_bigtable-1.3.0-py2.py3-none-any.whl (259 kB)
Using cached google_cloud_bigtable-1.2.1-py2.py3-none-any.whl (234 kB)
Using cached google_cloud_bigtable-1.2.0-py2.py3-none-any.whl (234 kB)
Using cached google_cloud_bigtable-1.1.0-py2.py3-none-any.whl (234 kB)
Using cached google_cloud_bigtable-1.0.0-py2.py3-none-any.whl (232 kB)
Using cached google_cloud_bigtable-0.34.0-py2.py3-none-any.whl (232 kB)
Using cached google_cloud_bigtable-0.33.0-py2.py3-none-any.whl (230 kB)
Using cached google_cloud_bigtable-0.32.2-py2.py3-none-any.whl (156 kB)
Using cached google_cloud_bigtable-0.32.1-py2.py3-none-any.whl (156 kB)
Using cached google_cloud_bigtable-0.32.0-py2.py3-none-any.whl (155 kB)
Using cached google_cloud_bigtable-0.31.1-py2.py3-none-any.whl (154 kB)
INFO: pip is looking at multiple versions of google-api-core[grpc] to determine which version is compatible with other requirements. This could take a while.
Collecting google-api-core[grpc]<3.0.0dev,>=1.29.0
Using cached google_api_core-2.0.0-py2.py3-none-any.whl (92 kB)
Using cached google_api_core-1.31.2-py2.py3-none-any.whl (93 kB)
Collecting google-auth<3,>=1.18.0
Using cached google_auth-1.35.0-py2.py3-none-any.whl (152 kB)
Collecting google-crc32c<=1.1.2,>=1.0
Using cached google_crc32c-1.1.2-cp36-cp36m-manylinux2014_x86_64.whl (38 kB)
Collecting docopt
Using cached docopt-0.6.2-py2.py3-none-any.whl
Requirement already satisfied: pyparsing<3,>=2.4.2 in <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages> (from httplib2<0.20.0,>=0.8->apache-beam==2.34.0.dev0) (2.4.7)
Collecting pbr>=0.11
Using cached pbr-5.6.0-py2.py3-none-any.whl (111 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2021.5.30-py2.py3-none-any.whl (145 kB)
Collecting isodate>=0.6.0
Using cached isodate-0.6.0-py2.py3-none-any.whl (45 kB)
Collecting requests-oauthlib>=0.5.0
Using cached requests_oauthlib-1.3.0-py2.py3-none-any.whl (23 kB)
Collecting pyasn1>=0.1.7
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting attrs>=17.4.0
Using cached attrs-21.2.0-py2.py3-none-any.whl (53 kB)
Requirement already satisfied: importlib-metadata>=0.12 in <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.34.0.dev0) (2.1.1)
Collecting wcwidth
Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB)
Requirement already satisfied: py>=1.5.0 in <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.34.0.dev0) (1.10.0)
Collecting atomicwrites>=1.0
Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB)
Collecting pluggy<1.0,>=0.12
Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting more-itertools>=4.0.0
Using cached more_itertools-8.9.0-py3-none-any.whl (51 kB)
Requirement already satisfied: zipp>=0.5 in <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages> (from importlib-metadata>=0.12->pytest<5.0,>=4.4.0->apache-beam==2.34.0.dev0) (3.5.0)
Collecting pytest-forked
Using cached pytest_forked-1.3.0-py2.py3-none-any.whl (4.7 kB)
Collecting execnet>=1.1
Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB)
Collecting idna<4,>=2.5
Using cached idna-3.2-py3-none-any.whl (59 kB)
Collecting charset-normalizer~=2.0.0
Using cached charset_normalizer-2.0.4-py3-none-any.whl (36 kB)
Collecting oauthlib>=3.0.0
Using cached oauthlib-3.1.1-py2.py3-none-any.whl (146 kB)
Collecting greenlet!=0.4.17
Using cached greenlet-1.1.1-cp36-cp36m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (140 kB)
Collecting wrapt
Using cached wrapt-1.12.1-cp36-cp36m-linux_x86_64.whl
Collecting docker
Using cached docker-5.0.2-py2.py3-none-any.whl (145 kB)
Collecting deprecation
Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB)
Collecting websocket-client>=0.32.0
Using cached websocket_client-1.2.1-py2.py3-none-any.whl (52 kB)
Building wheels for collected packages: apache-beam
Building wheel for apache-beam (setup.py): started
Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.34.0.dev0-py3-none-any.whl size=2539323 sha256=5a370dace5012b78cb8a0a20d10f1df17b5fae50e2d009c6a2edad8ac405cda5
Stored in directory: /home/jenkins/.cache/pip/wheels/ac/28/6e/20a1cb68f78721e12815f377be5bd7dc86dac3332b84355793
Successfully built apache-beam
Installing collected packages: pyasn1, urllib3, rsa, pycparser, pyasn1-modules, idna, charset-normalizer, certifi, cachetools, wcwidth, requests, pytz, python-dateutil, pluggy, oauthlib, more-itertools, jmespath, googleapis-common-protos, google-auth, cffi, attrs, atomicwrites, websocket-client, requests-oauthlib, pytest, numpy, isodate, httplib2, grpcio-gcp, google-crc32c, google-api-core, docopt, botocore, wrapt, typing-extensions, s3transfer, pytest-forked, pymongo, pydot, pyarrow, proto-plus, pbr, orjson, oauth2client, msrest, hdfs, grpc-google-iam-v1, greenlet, google-resumable-media, google-cloud-core, fasteners, fastavro, execnet, docker, dill, deprecation, dataclasses, cryptography, crcmod, azure-core, avro-python3, testcontainers, tenacity, sqlalchemy, requests-mock, pyyaml, pytest-xdist, pytest-timeout, pyhamcrest, psycopg2-binary, parameterized, pandas, mock, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery, google-apitools, freezegun, boto3, azure-storage-blob, apache-beam
Attempting uninstall: pluggy
Found existing installation: pluggy 1.0.0
Uninstalling pluggy-1.0.0:
Successfully uninstalled pluggy-1.0.0
> Task :release:go-licenses:java:dockerRun
+ go-licenses save github.com/apache/beam/sdks/java/container --save_path=/output/licenses
> Task :release:go-licenses:py:dockerRun
+ go-licenses save github.com/apache/beam/sdks/python/container --save_path=/output/licenses
> Task :sdks:python:installGcpTest
Successfully installed apache-beam-2.34.0.dev0 atomicwrites-1.4.0 attrs-21.2.0 avro-python3-1.9.2.1 azure-core-1.18.0 azure-storage-blob-12.8.1 boto3-1.18.38 botocore-1.21.38 cachetools-4.2.2 certifi-2021.5.30 cffi-1.14.6 charset-normalizer-2.0.4 crcmod-1.7 cryptography-3.4.8 dataclasses-0.8 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.2 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.4 fasteners-0.16.3 freezegun-1.1.0 google-api-core-1.31.2 google-apitools-0.5.31 google-auth-1.35.0 google-cloud-bigquery-2.26.0 google-cloud-bigtable-1.7.0 google-cloud-core-1.7.2 google-cloud-datastore-1.15.3 google-cloud-dlp-1.0.0 google-cloud-language-1.3.0 google-cloud-pubsub-1.7.0 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.1 google-cloud-videointelligence-1.16.1 google-cloud-vision-1.0.0 google-crc32c-1.1.2 google-resumable-media-2.0.2 googleapis-common-protos-1.53.0 greenlet-1.1.1 grpc-google-iam-v1-0.12.3 grpcio-gcp-0.2.2 hdfs-2.6.0 httplib2-0.19.1 idna-3.2 isodate-0.6.0 jmespath-0.10.0 mock-2.0.0 more-itertools-8.9.0 msrest-0.6.21 numpy-1.19.5 oauth2client-4.1.3 oauthlib-3.1.1 orjson-3.6.1 pandas-1.1.5 parameterized-0.7.5 pbr-5.6.0 pluggy-0.13.1 proto-plus-1.19.0 psycopg2-binary-2.9.1 pyarrow-4.0.1 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.20 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.0 pytest-4.6.11 pytest-forked-1.3.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2021.1 pyyaml-5.4.1 requests-2.26.0 requests-mock-1.9.3 requests-oauthlib-1.3.0 rsa-4.7.2 s3transfer-0.5.0 sqlalchemy-1.4.23 tenacity-5.1.5 testcontainers-3.4.2 typing-extensions-3.10.0.2 urllib3-1.26.6 wcwidth-0.2.5 websocket-client-1.2.1 wrapt-1.12.1
> Task :release:go-licenses:java:dockerRun
+ go-licenses csv github.com/apache/beam/sdks/java/container
+ tee /output/licenses/list.csv
golang.org/x/sys,https://go.googlesource.com/sys/+/refs/heads/master/LICENSE,BSD-3-Clause
github.com/apache/beam/sdks/java/container,https://github.com/apache/beam/blob/master/LICENSE,Apache-2.0
github.com/apache/beam/sdks/go/pkg/beam,https://github.com/apache/beam/blob/master/sdks/go/README.md,Apache-2.0
golang.org/x/net,https://go.googlesource.com/net/+/refs/heads/master/LICENSE,BSD-3-Clause
google.golang.org/genproto/googleapis/rpc/status,https://github.com/googleapis/go-genproto/blob/master/LICENSE,Apache-2.0
google.golang.org/grpc,https://github.com/grpc/grpc-go/blob/master/LICENSE,Apache-2.0
github.com/golang/protobuf,https://github.com/golang/protobuf/blob/master/LICENSE,BSD-3-Clause
google.golang.org/protobuf,https://go.googlesource.com/protobuf/+/refs/heads/master/LICENSE,BSD-3-Clause
golang.org/x/text,https://go.googlesource.com/text/+/refs/heads/master/LICENSE,BSD-3-Clause
+ chmod -R a+w /output/licenses
> Task :release:go-licenses:py:dockerRun
+ go-licenses csv github.com/apache/beam/sdks/python/container
+ tee /output/licenses/list.csv
github.com/golang/protobuf,https://github.com/golang/protobuf/blob/master/LICENSE,BSD-3-Clause
google.golang.org/genproto/googleapis/rpc/status,https://github.com/googleapis/go-genproto/blob/master/LICENSE,Apache-2.0
golang.org/x/text,https://go.googlesource.com/text/+/refs/heads/master/LICENSE,BSD-3-Clause
github.com/nightlyone/lockfile,https://github.com/nightlyone/lockfile/blob/master/LICENSE,MIT
github.com/apache/beam/sdks/python/container,https://github.com/apache/beam/blob/master/LICENSE,Apache-2.0
github.com/apache/beam/sdks/go/pkg/beam,https://github.com/apache/beam/blob/master/sdks/go/README.md,Apache-2.0
google.golang.org/grpc,https://github.com/grpc/grpc-go/blob/master/LICENSE,Apache-2.0
golang.org/x/net,https://go.googlesource.com/net/+/refs/heads/master/LICENSE,BSD-3-Clause
google.golang.org/protobuf,https://go.googlesource.com/protobuf/+/refs/heads/master/LICENSE,BSD-3-Clause
golang.org/x/sys,https://go.googlesource.com/sys/+/refs/heads/master/LICENSE,BSD-3-Clause
+ chmod -R a+w /output/licenses
> Task :release:go-licenses:java:createLicenses
> Task :sdks:java:container:java8:copyGolangLicenses
> Task :release:go-licenses:py:createLicenses
> Task :sdks:python:container:py36:copyGolangLicenses
> Task :sdks:python:container:py36:dockerPrepare
> Task :sdks:java:container:java8:dockerPrepare
> Task :sdks:java:container:java8:docker
> Task :runners:google-cloud-dataflow-java:buildAndPushDockerContainer
WARNING: `gcloud docker` will not be supported for Docker client versions above 18.03.
As an alternative, use `gcloud auth configure-docker` to configure `docker` to
use `gcloud` as a credential helper, then use `docker` as you would for non-GCR
registries, e.g. `docker pull gcr.io/project-id/my-image`. Add
`--verbosity=error` to silence this warning: `gcloud docker
--verbosity=error -- pull gcr.io/project-id/my-image`.
See: https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker
> Task :sdks:python:container:py36:docker
> Task :runners:google-cloud-dataflow-java:setupXVR
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerSetup
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerPythonUsingJava
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerPythonUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
> Task :runners:google-cloud-dataflow-java:cleanUpDockerImages
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210909180107]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:60c8de2df16d0629bac82f0612a5a2d7fa26a664f3a9744e78b128f8643fb7ff]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210909180107] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:60c8de2df16d0629bac82f0612a5a2d7fa26a664f3a9744e78b128f8643fb7ff])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:60c8de2df16d0629bac82f0612a5a2d7fa26a664f3a9744e78b128f8643fb7ff
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:60c8de2df16d0629bac82f0612a5a2d7fa26a664f3a9744e78b128f8643fb7ff].
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerPythonUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 16m 11s
105 actionable tasks: 76 executed, 25 from cache, 4 up-to-date
Publishing build scan...
https://gradle.com/s/i6uxftskolhpi
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal : beam_PostCommit_XVR_Dataflow
#1180
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/1180/display/redirect?page=changes>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Dataflow #1179
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/1179/display/redirect?page=changes>
Changes:
[noreply] Register MapCoder, some comments/cleanup. (#15471)
[noreply] [BEAM-12588] Multimap user state proto changes (#15473)
------------------------------------------
[...truncated 716.81 KB...]
apache_beam/testing/test_pipeline.py:112: in run
result = super(TestPipeline, self).run(
apache_beam/pipeline.py:566: in run
return self.runner.run_pipeline(self, self._options)
apache_beam/runners/dataflow/test_dataflow_runner.py:65: in run_pipeline
self.result.wait_until_finish(duration=wait_duration)
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
self = <DataflowPipelineResult <Job
clientRequestId: '20210910123712938350-9101'
createTime: '2021-09-10T12:37:19.073479Z'
...021-09-10T12:37:19.073479Z'
steps: []
tempFiles: []
type: TypeValueValuesEnum(JOB_TYPE_BATCH, 1)> at 0x7f0817706970>
duration = None
def wait_until_finish(self, duration=None):
if not self.is_in_terminal_state():
if not self.has_job:
raise IOError('Failed to get the Dataflow job id.')
thread = threading.Thread(
target=DataflowRunner.poll_for_job_completion,
args=(self._runner, self, duration))
# Mark the thread as a daemon thread so a keyboard interrupt on the main
# thread will terminate everything. This is also the reason we will not
# use thread.join() to wait for the polling thread.
thread.daemon = True
thread.start()
while thread.is_alive():
time.sleep(5.0)
# TODO: Merge the termination code in poll_for_job_completion and
# is_in_terminal_state.
terminated = self.is_in_terminal_state()
assert duration or terminated, (
'Job did not reach to a terminal state after waiting indefinitely.')
if terminated and self.state != PipelineState.DONE:
# TODO(BEAM-1290): Consider converting this to an error log based on
# theresolution of the issue.
> raise DataflowRuntimeException(
'Dataflow pipeline failed. State: %s, Error:\n%s' %
(self.state, getattr(self._runner, 'last_error_msg', None)),
self)
E apache_beam.runners.dataflow.dataflow_runner.DataflowRuntimeException: Dataflow pipeline failed. State: FAILED, Error:
E Workflow failed.
apache_beam/runners/dataflow/dataflow_runner.py:1632: DataflowRuntimeException
------------------------------ Captured log call -------------------------------
INFO apache_beam.runners.portability.stager:stager.py:300 Copying Beam SDK "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/build/apache-beam.tar.gz"> to staging location.
WARNING root:environments.py:371 Make sure that locally built Python SDK docker image has Python 3.8 interpreter.
INFO root:environments.py:380 Default Python SDK image for environment is apache/beam_python3.8_sdk:2.34.0.dev
INFO root:environments.py:295 Using provided Python SDK container image: gcr.io/cloud-dataflow/v1beta3/python38-fnapi:beam-master-20210809
INFO root:environments.py:302 Python SDK container image set to "gcr.io/cloud-dataflow/v1beta3/python38-fnapi:beam-master-20210809" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:650 ==================== <function pack_combiners at 0x7f07dc956e50> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:650 ==================== <function sort_stages at 0x7f07dc95a670> ====================
INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:452 Defaulting to the temp_location as staging_location: gs://dataflow-staging-us-central1-77b801c0838aee13391c0d1885860494
INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://dataflow-staging-us-central1-77b801c0838aee13391c0d1885860494/beamapp-jenkins-0910123712-936151.1631277432.936764/icedtea-sound-Bdoi2wYa757-fzq5vconCy4SSQ22ZaOq7yuC98fKPs8.jar...
INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://dataflow-staging-us-central1-77b801c0838aee13391c0d1885860494/beamapp-jenkins-0910123712-936151.1631277432.936764/icedtea-sound-Bdoi2wYa757-fzq5vconCy4SSQ22ZaOq7yuC98fKPs8.jar in 0 seconds.
INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://dataflow-staging-us-central1-77b801c0838aee13391c0d1885860494/beamapp-jenkins-0910123712-936151.1631277432.936764/jaccess-CMbK-IOdQPLKHEqCuDnE-yBk-VpbtVT-hgjbHRUGO78.jar...
INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://dataflow-staging-us-central1-77b801c0838aee13391c0d1885860494/beamapp-jenkins-0910123712-936151.1631277432.936764/jaccess-CMbK-IOdQPLKHEqCuDnE-yBk-VpbtVT-hgjbHRUGO78.jar in 0 seconds.
INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://dataflow-staging-us-central1-77b801c0838aee13391c0d1885860494/beamapp-jenkins-0910123712-936151.1631277432.936764/localedata-ae5Z0L6ak4922fztWeWy7ajiWXdG3ubNrwerJRFoFj0.jar...
INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://dataflow-staging-us-central1-77b801c0838aee13391c0d1885860494/beamapp-jenkins-0910123712-936151.1631277432.936764/localedata-ae5Z0L6ak4922fztWeWy7ajiWXdG3ubNrwerJRFoFj0.jar in 0 seconds.
INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://dataflow-staging-us-central1-77b801c0838aee13391c0d1885860494/beamapp-jenkins-0910123712-936151.1631277432.936764/nashorn-XHtz_UehGpYcLTOrATrTnMNVUgEVa_ttoWkPxnVfqTo.jar...
INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://dataflow-staging-us-central1-77b801c0838aee13391c0d1885860494/beamapp-jenkins-0910123712-936151.1631277432.936764/nashorn-XHtz_UehGpYcLTOrATrTnMNVUgEVa_ttoWkPxnVfqTo.jar in 0 seconds.
INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://dataflow-staging-us-central1-77b801c0838aee13391c0d1885860494/beamapp-jenkins-0910123712-936151.1631277432.936764/cldrdata-k07I6K9W3X5KTQbcDIEsqM0LXyM18f0eR6IaJw-P_xk.jar...
INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://dataflow-staging-us-central1-77b801c0838aee13391c0d1885860494/beamapp-jenkins-0910123712-936151.1631277432.936764/cldrdata-k07I6K9W3X5KTQbcDIEsqM0LXyM18f0eR6IaJw-P_xk.jar in 0 seconds.
INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://dataflow-staging-us-central1-77b801c0838aee13391c0d1885860494/beamapp-jenkins-0910123712-936151.1631277432.936764/dnsns-RGhCDg3GVOQVC2r6ka2N0hmI4eqQH6VobuoAnQ74MnE.jar...
INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://dataflow-staging-us-central1-77b801c0838aee13391c0d1885860494/beamapp-jenkins-0910123712-936151.1631277432.936764/dnsns-RGhCDg3GVOQVC2r6ka2N0hmI4eqQH6VobuoAnQ74MnE.jar in 0 seconds.
INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://dataflow-staging-us-central1-77b801c0838aee13391c0d1885860494/beamapp-jenkins-0910123712-936151.1631277432.936764/beam-sdks-java-testing-expansion-service-testExpansionService-2.34.0-SNAPSHOT-NGlHzUmCP1vJTQrCqB14AyQN4YDNio0H_h1Aw6NuE2A.jar...
INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://dataflow-staging-us-central1-77b801c0838aee13391c0d1885860494/beamapp-jenkins-0910123712-936151.1631277432.936764/beam-sdks-java-testing-expansion-service-testExpansionService-2.34.0-SNAPSHOT-NGlHzUmCP1vJTQrCqB14AyQN4YDNio0H_h1Aw6NuE2A.jar in 3 seconds.
INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://dataflow-staging-us-central1-77b801c0838aee13391c0d1885860494/beamapp-jenkins-0910123712-936151.1631277432.936764/dataflow_python_sdk.tar...
INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://dataflow-staging-us-central1-77b801c0838aee13391c0d1885860494/beamapp-jenkins-0910123712-936151.1631277432.936764/dataflow_python_sdk.tar in 0 seconds.
INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:639 Starting GCS upload to gs://dataflow-staging-us-central1-77b801c0838aee13391c0d1885860494/beamapp-jenkins-0910123712-936151.1631277432.936764/pipeline.pb...
INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:655 Completed GCS upload to gs://dataflow-staging-us-central1-77b801c0838aee13391c0d1885860494/beamapp-jenkins-0910123712-936151.1631277432.936764/pipeline.pb in 0 seconds.
INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:819 Create job: <Job
clientRequestId: '20210910123712938350-9101'
createTime: '2021-09-10T12:37:19.073479Z'
currentStateTime: '1970-01-01T00:00:00Z'
id: '2021-09-10_05_37_18-17202532670630972457'
location: 'us-central1'
name: 'beamapp-jenkins-0910123712-936151'
projectId: 'apache-beam-testing'
stageStates: []
startTime: '2021-09-10T12:37:19.073479Z'
steps: []
tempFiles: []
type: TypeValueValuesEnum(JOB_TYPE_BATCH, 1)>
INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:821 Created job with id: [2021-09-10_05_37_18-17202532670630972457]
INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:822 Submitted job: 2021-09-10_05_37_18-17202532670630972457
INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:823 To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobs/us-central1/2021-09-10_05_37_18-17202532670630972457?project=apache-beam-testing
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:191 Job 2021-09-10_05_37_18-17202532670630972457 is in state JOB_STATE_RUNNING
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T12:37:21.849Z: JOB_MESSAGE_DETAILED: Autoscaling is enabled for job 2021-09-10_05_37_18-17202532670630972457. The number of workers will be between 1 and 1000.
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T12:37:21.924Z: JOB_MESSAGE_DETAILED: Autoscaling was automatically enabled for job 2021-09-10_05_37_18-17202532670630972457.
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T12:37:23.594Z: JOB_MESSAGE_BASIC: Worker configuration: e2-standard-2 in us-central1-a.
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T12:37:24.163Z: JOB_MESSAGE_DETAILED: Expanding SplittableParDo operations into optimizable parts.
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T12:37:24.191Z: JOB_MESSAGE_DETAILED: Expanding CollectionToSingleton operations into optimizable parts.
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T12:37:24.255Z: JOB_MESSAGE_DETAILED: Expanding CoGroupByKey operations into optimizable parts.
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T12:37:24.289Z: JOB_MESSAGE_DEBUG: Combiner lifting skipped for step check_odd/Group/CoGroupByKeyImpl/GroupByKey: GroupByKey not followed by a combiner.
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T12:37:24.334Z: JOB_MESSAGE_DEBUG: Combiner lifting skipped for step check_even/Group/CoGroupByKeyImpl/GroupByKey: GroupByKey not followed by a combiner.
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T12:37:24.360Z: JOB_MESSAGE_DEBUG: Combiner lifting skipped for step Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey: GroupByKey not followed by a combiner.
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T12:37:24.391Z: JOB_MESSAGE_DETAILED: Expanding GroupByKey operations into optimizable parts.
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T12:37:24.422Z: JOB_MESSAGE_DEBUG: Annotating graph with Autotuner information.
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T12:37:24.471Z: JOB_MESSAGE_DETAILED: Fusing adjacent ParDo, Read, Write, and Flatten operations
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T12:37:24.492Z: JOB_MESSAGE_DEBUG: Inserted coder converter before flatten ref_AppliedPTransform_check_even-Group-CoGroupByKeyImpl-Flatten_27
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T12:37:24.523Z: JOB_MESSAGE_DEBUG: Inserted coder converter before flatten ref_AppliedPTransform_check_even-Group-CoGroupByKeyImpl-Flatten_27
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T12:37:24.556Z: JOB_MESSAGE_DEBUG: Inserted coder converter before flatten ref_AppliedPTransform_check_odd-Group-CoGroupByKeyImpl-Flatten_45
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T12:37:24.586Z: JOB_MESSAGE_DEBUG: Inserted coder converter before flatten ref_AppliedPTransform_check_odd-Group-CoGroupByKeyImpl-Flatten_45
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T12:37:24.660Z: JOB_MESSAGE_DETAILED: Unzipping flatten ref_AppliedPTransform_check_even-Group-CoGroupByKeyImpl-Flatten_27 for input ref_AppliedPTransform_check_even-Group-CoGroupByKeyImpl-Tag-0-_25.None-post21
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T12:37:24.714Z: JOB_MESSAGE_DETAILED: Fusing unzipped copy of check_even/Group/CoGroupByKeyImpl/GroupByKey/Write, through flatten check_even/Group/CoGroupByKeyImpl/Flatten, into producer check_even/Group/CoGroupByKeyImpl/Flatten/InputIdentity
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T12:37:24.756Z: JOB_MESSAGE_DETAILED: Fusing consumer check_even/Group/CoGroupByKeyImpl/MapTuple(collect_values) into check_even/Group/CoGroupByKeyImpl/GroupByKey/Read
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T12:37:24.789Z: JOB_MESSAGE_DETAILED: Fusing consumer check_even/Group/RestoreTags into check_even/Group/CoGroupByKeyImpl/MapTuple(collect_values)
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T12:37:24.826Z: JOB_MESSAGE_DETAILED: Fusing consumer check_even/Unkey into check_even/Group/RestoreTags
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T12:37:24.847Z: JOB_MESSAGE_DETAILED: Fusing consumer check_even/Match into check_even/Unkey
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T12:37:24.880Z: JOB_MESSAGE_DETAILED: Unzipping flatten ref_AppliedPTransform_check_odd-Group-CoGroupByKeyImpl-Flatten_45 for input ref_AppliedPTransform_check_odd-Group-CoGroupByKeyImpl-Tag-0-_43.None-post23
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T12:37:24.909Z: JOB_MESSAGE_DETAILED: Fusing unzipped copy of check_odd/Group/CoGroupByKeyImpl/GroupByKey/Write, through flatten check_odd/Group/CoGroupByKeyImpl/Flatten, into producer check_odd/Group/CoGroupByKeyImpl/Flatten/InputIdentity
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T12:37:24.943Z: JOB_MESSAGE_DETAILED: Fusing consumer check_odd/Group/CoGroupByKeyImpl/MapTuple(collect_values) into check_odd/Group/CoGroupByKeyImpl/GroupByKey/Read
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T12:37:24.968Z: JOB_MESSAGE_DETAILED: Fusing consumer check_odd/Group/RestoreTags into check_odd/Group/CoGroupByKeyImpl/MapTuple(collect_values)
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T12:37:25.001Z: JOB_MESSAGE_DETAILED: Fusing consumer check_odd/Unkey into check_odd/Group/RestoreTags
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T12:37:25.036Z: JOB_MESSAGE_DETAILED: Fusing consumer check_odd/Match into check_odd/Unkey
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T12:37:25.068Z: JOB_MESSAGE_DETAILED: Fusing consumer check_even/Group/CoGroupByKeyImpl/GroupByKey/Write into check_even/Group/CoGroupByKeyImpl/Flatten/InputIdentity
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T12:37:25.105Z: JOB_MESSAGE_DETAILED: Fusing consumer check_odd/Group/CoGroupByKeyImpl/GroupByKey/Write into check_odd/Group/CoGroupByKeyImpl/Flatten/InputIdentity
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T12:37:25.137Z: JOB_MESSAGE_DETAILED: Fusing consumer Create/FlatMap(<lambda at core.py:2965>) into Create/Impulse
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T12:37:25.171Z: JOB_MESSAGE_DETAILED: Fusing consumer Create/MaybeReshuffle/Reshuffle/AddRandomKeys into Create/FlatMap(<lambda at core.py:2965>)
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T12:37:25.204Z: JOB_MESSAGE_DETAILED: Fusing consumer Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/Map(reify_timestamps) into Create/MaybeReshuffle/Reshuffle/AddRandomKeys
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T12:37:25.238Z: JOB_MESSAGE_DETAILED: Fusing consumer Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Reify into Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/Map(reify_timestamps)
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T12:37:25.273Z: JOB_MESSAGE_DETAILED: Fusing consumer Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Write into Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Reify
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T12:37:25.323Z: JOB_MESSAGE_DETAILED: Fusing consumer Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/GroupByWindow into Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Read
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T12:37:25.351Z: JOB_MESSAGE_DETAILED: Fusing consumer Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/FlatMap(restore_timestamps) into Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/GroupByWindow
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T12:37:25.385Z: JOB_MESSAGE_DETAILED: Fusing consumer Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys into Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/FlatMap(restore_timestamps)
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T12:37:25.407Z: JOB_MESSAGE_DETAILED: Fusing consumer Create/Map(decode) into Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T12:37:25.433Z: JOB_MESSAGE_DETAILED: Fusing consumer ExternalTransform(beam:transforms:xlang:test:partition)/ParMultiDo(Partition) into Create/Map(decode)
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T12:37:25.462Z: JOB_MESSAGE_DETAILED: Fusing consumer check_even/WindowInto(WindowIntoFn) into ExternalTransform(beam:transforms:xlang:test:partition)/ParMultiDo(Partition)
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T12:37:25.496Z: JOB_MESSAGE_DETAILED: Fusing consumer check_odd/WindowInto(WindowIntoFn) into ExternalTransform(beam:transforms:xlang:test:partition)/ParMultiDo(Partition)
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T12:37:25.527Z: JOB_MESSAGE_DETAILED: Fusing consumer check_even/Create/FlatMap(<lambda at core.py:2965>) into check_even/Create/Impulse
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T12:37:25.551Z: JOB_MESSAGE_DETAILED: Fusing consumer check_even/Create/Map(decode) into check_even/Create/FlatMap(<lambda at core.py:2965>)
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T12:37:25.584Z: JOB_MESSAGE_DETAILED: Fusing consumer check_even/Group/CoGroupByKeyImpl/Tag[0] into check_even/Create/Map(decode)
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T12:37:25.640Z: JOB_MESSAGE_DETAILED: Fusing consumer check_even/Group/CoGroupByKeyImpl/Flatten/InputIdentity into check_even/Group/CoGroupByKeyImpl/Tag[0]
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T12:37:25.662Z: JOB_MESSAGE_DETAILED: Fusing consumer check_even/ToVoidKey into check_even/WindowInto(WindowIntoFn)
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T12:37:25.713Z: JOB_MESSAGE_DETAILED: Fusing consumer check_even/Group/CoGroupByKeyImpl/Tag[1] into check_even/ToVoidKey
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T12:37:25.761Z: JOB_MESSAGE_DETAILED: Fusing consumer check_even/Group/CoGroupByKeyImpl/Flatten/InputIdentity into check_even/Group/CoGroupByKeyImpl/Tag[1]
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T12:37:25.791Z: JOB_MESSAGE_DETAILED: Fusing consumer check_odd/Create/FlatMap(<lambda at core.py:2965>) into check_odd/Create/Impulse
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T12:37:25.826Z: JOB_MESSAGE_DETAILED: Fusing consumer check_odd/Create/Map(decode) into check_odd/Create/FlatMap(<lambda at core.py:2965>)
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T12:37:25.861Z: JOB_MESSAGE_DETAILED: Fusing consumer check_odd/Group/CoGroupByKeyImpl/Tag[0] into check_odd/Create/Map(decode)
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T12:37:25.884Z: JOB_MESSAGE_DETAILED: Fusing consumer check_odd/Group/CoGroupByKeyImpl/Flatten/InputIdentity into check_odd/Group/CoGroupByKeyImpl/Tag[0]
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T12:37:25.918Z: JOB_MESSAGE_DETAILED: Fusing consumer check_odd/ToVoidKey into check_odd/WindowInto(WindowIntoFn)
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T12:37:25.948Z: JOB_MESSAGE_DETAILED: Fusing consumer check_odd/Group/CoGroupByKeyImpl/Tag[1] into check_odd/ToVoidKey
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T12:37:25.980Z: JOB_MESSAGE_DETAILED: Fusing consumer check_odd/Group/CoGroupByKeyImpl/Flatten/InputIdentity into check_odd/Group/CoGroupByKeyImpl/Tag[1]
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T12:37:26.065Z: JOB_MESSAGE_DEBUG: Workflow config is missing a default resource spec.
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T12:37:26.126Z: JOB_MESSAGE_DEBUG: Adding StepResource setup and teardown to workflow graph.
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T12:37:26.187Z: JOB_MESSAGE_DEBUG: Adding workflow start and stop steps.
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T12:37:26.223Z: JOB_MESSAGE_DEBUG: Assigning stage ids.
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T12:37:26.374Z: JOB_MESSAGE_DEBUG: Executing wait step start39
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T12:37:26.439Z: JOB_MESSAGE_BASIC: Executing operation Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Create
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T12:37:26.469Z: JOB_MESSAGE_BASIC: Executing operation check_even/Group/CoGroupByKeyImpl/GroupByKey/Create
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T12:37:26.483Z: JOB_MESSAGE_DEBUG: Starting worker pool setup.
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T12:37:26.495Z: JOB_MESSAGE_BASIC: Executing operation check_odd/Group/CoGroupByKeyImpl/GroupByKey/Create
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T12:37:26.520Z: JOB_MESSAGE_BASIC: Starting 1 workers in us-central1-a...
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T12:37:26.554Z: JOB_MESSAGE_BASIC: Finished operation Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Create
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T12:37:26.568Z: JOB_MESSAGE_BASIC: Finished operation check_even/Group/CoGroupByKeyImpl/GroupByKey/Create
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T12:37:26.568Z: JOB_MESSAGE_BASIC: Finished operation check_odd/Group/CoGroupByKeyImpl/GroupByKey/Create
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T12:37:26.617Z: JOB_MESSAGE_DEBUG: Value "check_odd/Group/CoGroupByKeyImpl/GroupByKey/Session" materialized.
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T12:37:26.658Z: JOB_MESSAGE_DEBUG: Value "check_even/Group/CoGroupByKeyImpl/GroupByKey/Session" materialized.
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T12:37:26.707Z: JOB_MESSAGE_DEBUG: Value "Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Session" materialized.
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T12:37:26.750Z: JOB_MESSAGE_BASIC: Executing operation check_odd/Create/Impulse+check_odd/Create/FlatMap(<lambda at core.py:2965>)+check_odd/Create/Map(decode)+check_odd/Group/CoGroupByKeyImpl/Tag[0]+check_odd/Group/CoGroupByKeyImpl/Flatten/InputIdentity+check_odd/Group/CoGroupByKeyImpl/GroupByKey/Write
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T12:37:26.772Z: JOB_MESSAGE_BASIC: Executing operation check_even/Create/Impulse+check_even/Create/FlatMap(<lambda at core.py:2965>)+check_even/Create/Map(decode)+check_even/Group/CoGroupByKeyImpl/Tag[0]+check_even/Group/CoGroupByKeyImpl/Flatten/InputIdentity+check_even/Group/CoGroupByKeyImpl/GroupByKey/Write
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T12:37:26.804Z: JOB_MESSAGE_BASIC: Executing operation Create/Impulse+Create/FlatMap(<lambda at core.py:2965>)+Create/MaybeReshuffle/Reshuffle/AddRandomKeys+Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/Map(reify_timestamps)+Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Reify+Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Write
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T12:37:46.308Z: JOB_MESSAGE_BASIC: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T12:38:06.763Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-a failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'CPUS' exceeded. Limit: 2500.0 in region us-central1.
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T12:38:06.846Z: JOB_MESSAGE_ERROR: Workflow failed.
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T12:38:06.991Z: JOB_MESSAGE_BASIC: Finished operation check_odd/Create/Impulse+check_odd/Create/FlatMap(<lambda at core.py:2965>)+check_odd/Create/Map(decode)+check_odd/Group/CoGroupByKeyImpl/Tag[0]+check_odd/Group/CoGroupByKeyImpl/Flatten/InputIdentity+check_odd/Group/CoGroupByKeyImpl/GroupByKey/Write
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T12:38:06.991Z: JOB_MESSAGE_BASIC: Finished operation check_even/Create/Impulse+check_even/Create/FlatMap(<lambda at core.py:2965>)+check_even/Create/Map(decode)+check_even/Group/CoGroupByKeyImpl/Tag[0]+check_even/Group/CoGroupByKeyImpl/Flatten/InputIdentity+check_even/Group/CoGroupByKeyImpl/GroupByKey/Write
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T12:38:06.992Z: JOB_MESSAGE_BASIC: Finished operation Create/Impulse+Create/FlatMap(<lambda at core.py:2965>)+Create/MaybeReshuffle/Reshuffle/AddRandomKeys+Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/Map(reify_timestamps)+Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Reify+Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Write
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T12:38:07.070Z: JOB_MESSAGE_DETAILED: Cleaning up.
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T12:38:07.128Z: JOB_MESSAGE_DEBUG: Starting worker pool teardown.
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T12:38:07.160Z: JOB_MESSAGE_BASIC: Stopping worker pool...
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T12:38:30.289Z: JOB_MESSAGE_BASIC: Worker pool stopped.
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:236 2021-09-10T12:38:30.331Z: JOB_MESSAGE_DEBUG: Tearing down pending resources...
INFO apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:191 Job 2021-09-10_05_37_18-17202532670630972457 is in state JOB_STATE_FAILED
=============================== warnings summary ===============================
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/build/gradleenv/1922375555/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/python/pytest_xlangValidateRunner.xml> -
=================== 8 failed, 12 warnings in 142.68 seconds ====================
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerPythonUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 13287.
Stopping expansion service pid: 13290.
> Task :runners:google-cloud-dataflow-java:cleanUpDockerImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210910122937
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:8bebbee3f42be793b7b13acac87bc8b6e1628ed23984f1f9287e266d0ebaaceb
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210910122937]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:8bebbee3f42be793b7b13acac87bc8b6e1628ed23984f1f9287e266d0ebaaceb]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210910122937] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:8bebbee3f42be793b7b13acac87bc8b6e1628ed23984f1f9287e266d0ebaaceb])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:8bebbee3f42be793b7b13acac87bc8b6e1628ed23984f1f9287e266d0ebaaceb
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:8bebbee3f42be793b7b13acac87bc8b6e1628ed23984f1f9287e266d0ebaaceb
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:8bebbee3f42be793b7b13acac87bc8b6e1628ed23984f1f9287e266d0ebaaceb].
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerPythonUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 9m 39s
95 actionable tasks: 23 executed, 72 up-to-date
Publishing build scan...
https://gradle.com/s/zhdakch3dhtv2
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Dataflow #1178
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/1178/display/redirect?page=changes>
Changes:
[ruwan.lambrichts] Clarify additional_bq_parameters argument
[esert] Bump a throttling counter on BigQueryRead retries due to
[noreply] [BEAM-5097] Increment counter for "small words" in go SDK example
------------------------------------------
[...truncated 438.27 KB...]
[0m[91m adding 'apache_beam/utils/proto_utils.py'
[0m[91m adding 'apache_beam/utils/retry.py'
[0m[91m adding 'apache_beam/utils/retry_test.py'
[0m[91m adding 'apache_beam/utils/sentinel.py'
[0m[91m adding 'apache_beam/utils/sharded_key.py'
[0m[91m adding 'apache_beam/utils/shared.py'
[0m[91m adding 'apache_beam/utils/shared_test.py'
[0m[91m adding 'apache_beam/utils/subprocess_server.py'
[0m[91m adding 'apache_beam/utils/subprocess_server_test.py'
[0m[91m adding 'apache_beam/utils/thread_pool_executor.py'
[0m[91m adding 'apache_beam/utils/thread_pool_executor_test.py'
[0m[91m adding 'apache_beam/utils/timestamp.py'
[0m[91m adding 'apache_beam/utils/timestamp_test.py'
[0m[91m adding 'apache_beam/utils/urns.py'
[0m[91m adding 'apache_beam/utils/windowed_value.cpython-36m-x86_64-linux-gnu.so'
[0m[91m adding 'apache_beam/utils/windowed_value.pxd'
[0m[91m adding 'apache_beam/utils/windowed_value.py'
[0m[91m adding 'apache_beam/utils/windowed_value_test.py'
[0m[91m adding 'apache_beam-2.34.0.dev0.dist-info/METADATA'
[0m[91m adding 'apache_beam-2.34.0.dev0.dist-info/WHEEL'
[0m[91m adding 'apache_beam-2.34.0.dev0.dist-info/top_level.txt'
[0m[91m adding 'apache_beam-2.34.0.dev0.dist-info/RECORD'
[0m[91m removing build/bdist.linux-x86_64/wheel
[0m Building wheel for apache-beam (setup.py): finished with status 'done'
Created wheel for apache-beam: filename=apache_beam-2.34.0.dev0-cp36-cp36m-linux_x86_64.whl size=9817603 sha256=a6523d1f103976061711f2022af85ac5f58f2908ba04a74b19e9aed98e209170
Stored in directory: /root/.cache/pip/wheels/71/0a/9d/8434df5e361fe8c44220318cb21455c5dcaa3d25589894f9c8
Successfully built apache-beam
Installing collected packages: apache-beam
Successfully installed apache-beam-2.34.0.dev0
[91mWARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
[0mRemoving intermediate container b0b32801c5a4
---> 1377e0d9cc6e
Step 15/27 : COPY target/license_scripts /tmp/license_scripts/
---> 00ae5985c14f
Step 16/27 : COPY target/LICENSE target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/
---> 22d2e58b6b12
Step 17/27 : RUN rm /opt/apache/beam/third_party_licenses/golang/LICENSE
---> Running in 71e42ff5e714
Removing intermediate container 71e42ff5e714
---> 926fc470c5fe
Step 18/27 : COPY target/license_scripts /tmp/license_scripts/
---> 3482a839ec03
Step 19/27 : RUN if [ "$pull_licenses" = "true" ] ; then pip install 'pip-licenses<3.0.0;python_version>="3.5"' && pip install 'pip-licenses==1.18.0;python_version<="2.7"' && python /tmp/license_scripts/pull_licenses_py.py && pip uninstall -y pip-licenses && rm -rf /root/.cache/pip ; else rm -rf /opt/apache/beam/third_party_licenses ; fi
---> Running in 2c6804d7e5fa
Collecting pip-licenses<3.0.0
Downloading pip_licenses-2.3.0-py3-none-any.whl (14 kB)
Collecting PTable
Downloading PTable-0.9.2.tar.gz (31 kB)
Building wheels for collected packages: PTable
Building wheel for PTable (setup.py): started
Building wheel for PTable (setup.py): finished with status 'done'
Created wheel for PTable: filename=PTable-0.9.2-py3-none-any.whl size=22924 sha256=efc6b12c38d03d5244a93f1d6b7a547ae65dbbeebcc4b5a65e15811718f01e42
Stored in directory: /root/.cache/pip/wheels/f3/65/67/71f473ec87ea4554d1bdfb1b5128cfe1414c2b113b72a1ee8e
Successfully built PTable
Installing collected packages: PTable, pip-licenses
Successfully installed PTable-0.9.2 pip-licenses-2.3.0
[91mWARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
[0mIgnoring pip-licenses: markers 'python_version <= "2.7"' don't match your environment
[91mWARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
[0m[91mINFO:root:Successfully pulled licenses for 112 dependencies
[0mSkip pulling license for bs4
Found existing installation: pip-licenses 2.3.0
Uninstalling pip-licenses-2.3.0:
Successfully uninstalled pip-licenses-2.3.0
[91mWARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
[0mRemoving intermediate container 2c6804d7e5fa
---> aeb57e12c976
Step 20/27 : RUN rm -rf /tmp/license_scripts
---> Running in ad13bd567acc
Removing intermediate container ad13bd567acc
---> a67097b97ff0
Step 21/27 : RUN pip freeze --all
---> Running in a789f17ff0b9
absl-py==0.13.0
apache-beam @ file:///opt/apache/beam/tars/apache-beam.tar.gz
astunparse==1.6.3
atomicwrites==1.4.0
attrs==21.2.0
avro-python3==1.8.2
beautifulsoup4==4.9.1
bs4==0.0.1
cached-property==1.5.2
cachetools==3.1.1
certifi==2021.5.30
chardet==3.0.4
click==8.0.1
crcmod==1.7
Cython==0.29.21
dataclasses==0.8
dill==0.3.1.1
docopt==0.6.2
fastavro==1.0.0.post1
fasteners==0.16.3
flatbuffers==1.12
freezegun==0.3.15
future==0.18.2
gast==0.4.0
google-api-core==1.22.2
google-api-python-client==2.20.0
google-apitools==0.5.31
google-auth==1.31.0
google-auth-httplib2==0.1.0
google-auth-oauthlib==0.4.6
google-cloud-bigquery==1.26.1
google-cloud-bigtable==1.0.0
google-cloud-core==1.4.1
google-cloud-datastore==1.15.3
google-cloud-dlp==0.13.0
google-cloud-language==1.3.0
google-cloud-profiler==3.0.4
google-cloud-pubsub==1.0.2
google-cloud-recommendations-ai==0.2.0
google-cloud-spanner==1.13.0
google-cloud-videointelligence==1.13.0
google-cloud-vision==0.42.0
google-crc32c==1.1.5
google-pasta==0.2.0
google-python-cloud-debugger==2.15
google-resumable-media==1.3.3
googleapis-common-protos==1.53.0
grpc-google-iam-v1==0.12.3
grpcio==1.34.0
grpcio-gcp==0.2.2
guppy3==3.0.10
h5py==3.1.0
hdfs==2.5.8
httplib2==0.19.1
idna==2.10
importlib-metadata==4.8.1
joblib==1.0.1
keras-nightly==2.5.0.dev2021032900
Keras-Preprocessing==1.1.2
Markdown==3.3.4
mmh3==2.5.1
more-itertools==8.9.0
nltk==3.5
numpy==1.19.5
oauth2client==4.1.3
oauthlib==3.1.1
opt-einsum==3.3.0
orjson==3.6.1
packaging==21.0
pandas==1.1.5
Pillow==7.2.0
pip==21.2.4
pluggy==0.13.1
proto-plus==1.19.0
protobuf==3.12.2
protorpc==0.12.0
PTable==0.9.2
py==1.10.0
pyarrow==3.0.0
pyasn1==0.4.8
pyasn1-modules==0.2.8
pydot==1.4.1
PyHamcrest==1.10.1
pymongo==3.10.1
pyparsing==2.4.7
pytest==4.6.11
python-dateutil==2.8.1
python-gflags==3.1.2
python-snappy==0.5.4
pytz==2020.1
PyYAML==5.4
regex==2021.8.28
requests==2.24.0
requests-oauthlib==1.3.0
rsa==4.7.2
scikit-learn==0.24.1
scipy==1.4.1
setuptools==57.5.0
six==1.15.0
soupsieve==2.2.1
tenacity==8.0.1
tensorboard==2.6.0
tensorboard-data-server==0.6.1
tensorboard-plugin-wit==1.8.0
tensorflow==2.5.0
tensorflow-estimator==2.5.0
termcolor==1.1.0
threadpoolctl==2.2.0
tqdm==4.62.2
typing-extensions==3.7.4.3
uritemplate==3.0.1
urllib3==1.25.11
wcwidth==0.2.5
Werkzeug==2.0.1
wheel==0.37.0
wrapt==1.12.1
zipp==3.5.0
Removing intermediate container a789f17ff0b9
---> 19a6c18e9fd1
Step 22/27 : RUN pip check
---> Running in dcc935d9f518
No broken requirements found.
Removing intermediate container dcc935d9f518
---> 934cfbb49baa
Step 23/27 : COPY target/LICENSE /opt/apache/beam/
---> e74540da9dd3
Step 24/27 : COPY target/LICENSE.python /opt/apache/beam/
---> f4fcdcacb350
Step 25/27 : COPY target/NOTICE /opt/apache/beam/
---> 093317d9c99b
Step 26/27 : ADD target/launcher/linux_amd64/boot /opt/apache/beam/
---> c8bfdd4dd507
Step 27/27 : ENTRYPOINT ["/opt/apache/beam/boot"]
---> Running in 4bd63c653703
Removing intermediate container 4bd63c653703
---> 93de40276787
Successfully built 93de40276787
Successfully tagged apache/beam_python3.6_sdk:2.34.0.dev
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerSetup
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerPythonUsingJava
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerPythonUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
> Task :runners:google-cloud-dataflow-java:cleanUpDockerImages
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210910060324]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:069bd61c2b63d121b02a5f245bd96f589c14c06de1aa0936a42531307d3a7521]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210910060324] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:069bd61c2b63d121b02a5f245bd96f589c14c06de1aa0936a42531307d3a7521])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:069bd61c2b63d121b02a5f245bd96f589c14c06de1aa0936a42531307d3a7521
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:069bd61c2b63d121b02a5f245bd96f589c14c06de1aa0936a42531307d3a7521].
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerPythonUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 29m 6s
105 actionable tasks: 76 executed, 25 from cache, 4 up-to-date
Publishing build scan...
https://gradle.com/s/qzqpdwhwvm6ti
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Dataflow #1177
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/1177/display/redirect?page=changes>
Changes:
[noreply] Fix broken 'differences from pandas' link
[noreply] Added GroupBy row in Aggregation table.
[Luke Cwik] [BEAM-12769] Fix typo in test class name, CLass -> Class
[Etienne Chauchot] [BEAM-5172] Temporary ignore testSplit and testSizes tests waiting for a
[samuelw] [BEAM-12740] Remove matching to filter files when renaming gcs files in
[noreply] [BEAM-3304] Helper functions for triggers (#15430)
------------------------------------------
[...truncated 78.76 KB...]
Stored in directory: /root/.cache/pip/wheels/03/96/13/2f157e956ee2276c227533f279766e4e4ccf60c7036e7eecd3
Building wheel for python-gflags (setup.py): started
Building wheel for python-gflags (setup.py): finished with status 'done'
Created wheel for python-gflags: filename=python_gflags-3.1.2-py3-none-any.whl size=57387 sha256=feb2c8ae404ac440390871f7a904f75fc5a37bd2d209a8e89c80dc1135be26eb
Stored in directory: /root/.cache/pip/wheels/39/5f/9e/c32620d2f8898c726bb6dc8708616c457cf885d3890f4cb31d
Building wheel for nltk (setup.py): started
Building wheel for nltk (setup.py): finished with status 'done'
Created wheel for nltk: filename=nltk-3.5-py3-none-any.whl size=1434696 sha256=41c8a0564f4dcc4f00e3c0604a52e807d20f838d0db4598b26778a587c3a3cf4
Stored in directory: /root/.cache/pip/wheels/de/5e/42/64abaeca668161c3e2cecc24f864a8fc421e3d07a104fc8a51
Building wheel for grpc-google-iam-v1 (setup.py): started
Building wheel for grpc-google-iam-v1 (setup.py): finished with status 'done'
Created wheel for grpc-google-iam-v1: filename=grpc_google_iam_v1-0.12.3-py3-none-any.whl size=18515 sha256=248a8c27482040f08dd89722bbca8f16af20a247182858f2f991bddbae6ccef2
Stored in directory: /root/.cache/pip/wheels/76/65/cd/392da05e43270f143b6c5076ba88d39144abff586792593e7c
Building wheel for termcolor (setup.py): started
Building wheel for termcolor (setup.py): finished with status 'done'
Created wheel for termcolor: filename=termcolor-1.1.0-py3-none-any.whl size=4847 sha256=a4fd9a6bb54424204f0f0058f7d2ed48f58970c69939bb60c60c4f980aa96790
Stored in directory: /root/.cache/pip/wheels/93/2a/eb/e58dbcbc963549ee4f065ff80a59f274cc7210b6eab962acdc
Building wheel for wrapt (setup.py): started
Building wheel for wrapt (setup.py): finished with status 'done'
Created wheel for wrapt: filename=wrapt-1.12.1-cp36-cp36m-linux_x86_64.whl size=75260 sha256=904819aa1a9f95d491dacd23226a5d40cc06f88ceee93c16844493a2d7fd3f8f
Stored in directory: /root/.cache/pip/wheels/32/42/7f/23cae9ff6ef66798d00dc5d659088e57dbba01566f6c60db63
Building wheel for docopt (setup.py): started
Building wheel for docopt (setup.py): finished with status 'done'
Created wheel for docopt: filename=docopt-0.6.2-py2.py3-none-any.whl size=13724 sha256=9c3bbfbd977fc2708a46ee77ef27e03de435bbb0d1834a6fca6269f67c956859
Stored in directory: /root/.cache/pip/wheels/3f/2a/fa/4d7a888e69774d5e6e855d190a8a51b357d77cc05eb1c097c9
Successfully built avro-python3 crcmod dill future hdfs google-apitools google-cloud-profiler bs4 mmh3 python-snappy protorpc python-gflags nltk grpc-google-iam-v1 termcolor wrapt docopt
Installing collected packages: urllib3, six, pyasn1, idna, chardet, certifi, zipp, typing-extensions, rsa, requests, pyparsing, pyasn1-modules, protobuf, oauthlib, cachetools, requests-oauthlib, pytz, importlib-metadata, httplib2, grpcio, googleapis-common-protos, google-auth, dataclasses, werkzeug, uritemplate, tensorboard-plugin-wit, tensorboard-data-server, soupsieve, numpy, markdown, grpcio-gcp, google-crc32c, google-auth-oauthlib, google-auth-httplib2, google-api-core, cached-property, absl-py, wrapt, wcwidth, tqdm, threadpoolctl, termcolor, tensorflow-estimator, tensorboard, scipy, regex, pyyaml, python-dateutil, py, proto-plus, pluggy, packaging, opt-einsum, oauth2client, more-itertools, keras-preprocessing, keras-nightly, joblib, h5py, grpc-google-iam-v1, google-resumable-media, google-pasta, google-cloud-core, google-api-python-client, gast, flatbuffers, fasteners, docopt, click, beautifulsoup4, attrs, atomicwrites, astunparse, tensorflow, tenacity, scikit-learn, python-snappy, python-gflags, pytest, pymongo, pyhamcrest, pydot, pyarrow, protorpc, pillow, pandas, orjson, nltk, mmh3, hdfs, guppy3, google-python-cloud-debugger, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-profiler, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery, google-apitools, future, freezegun, fastavro, dill, cython, crcmod, bs4, avro-python3
Successfully installed absl-py-0.13.0 astunparse-1.6.3 atomicwrites-1.4.0 attrs-21.2.0 avro-python3-1.8.2 beautifulsoup4-4.9.1 bs4-0.0.1 cached-property-1.5.2 cachetools-3.1.1 certifi-2021.5.30 chardet-3.0.4 click-8.0.1 crcmod-1.7 cython-0.29.21 dataclasses-0.8 dill-0.3.1.1 docopt-0.6.2 fastavro-1.0.0.post1 fasteners-0.16.3 flatbuffers-1.12 freezegun-0.3.15 future-0.18.2 gast-0.4.0 google-api-core-1.22.2 google-api-python-client-2.20.0 google-apitools-0.5.31 google-auth-1.31.0 google-auth-httplib2-0.1.0 google-auth-oauthlib-0.4.6 google-cloud-bigquery-1.26.1 google-cloud-bigtable-1.0.0 google-cloud-core-1.4.1 google-cloud-datastore-1.15.3 google-cloud-dlp-0.13.0 google-cloud-language-1.3.0 google-cloud-profiler-3.0.4 google-cloud-pubsub-1.0.2 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.13.0 google-cloud-videointelligence-1.13.0 google-cloud-vision-0.42.0 google-crc32c-1.1.5 google-pasta-0.2.0 google-python-cloud-debugger-2.15 google-resumable-media-1.3.3 googleapis-common-protos-1.53.0 grpc-google-iam-v1-0.12.3 grpcio-1.34.0 grpcio-gcp-0.2.2 guppy3-3.0.10 h5py-3.1.0 hdfs-2.5.8 httplib2-0.19.1 idna-2.10 importlib-metadata-4.8.1 joblib-1.0.1 keras-nightly-2.5.0.dev2021032900 keras-preprocessing-1.1.2 markdown-3.3.4 mmh3-2.5.1 more-itertools-8.9.0 nltk-3.5 numpy-1.19.5 oauth2client-4.1.3 oauthlib-3.1.1 opt-einsum-3.3.0 orjson-3.6.1 packaging-21.0 pandas-1.1.5 pillow-7.2.0 pluggy-0.13.1 proto-plus-1.19.0 protobuf-3.12.2 protorpc-0.12.0 py-1.10.0 pyarrow-3.0.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pydot-1.4.1 pyhamcrest-1.10.1 pymongo-3.10.1 pyparsing-2.4.7 pytest-4.6.11 python-dateutil-2.8.1 python-gflags-3.1.2 python-snappy-0.5.4 pytz-2020.1 pyyaml-5.4 regex-2021.8.28 requests-2.24.0 requests-oauthlib-1.3.0 rsa-4.7.2 scikit-learn-0.24.1 scipy-1.4.1 six-1.15.0 soupsieve-2.2.1 tenacity-8.0.1 tensorboard-2.6.0 tensorboard-data-server-0.6.1 tensorboard-plugin-wit-1.8.0 tensorflow-2.5.0 tensorflow-estimator-2.5.0 termcolor-1.1.0 threadpoolctl-2.2.0 tqdm-4.62.2 typing-extensions-3.7.4.3 uritemplate-3.0.1 urllib3-1.25.11 wcwidth-0.2.5 werkzeug-2.0.1 wrapt-1.12.1 zipp-3.5.0
[91mWARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
[0m[91m[nltk_data] Downloading package stopwords to /root/nltk_data...
[nltk_data] Unzipping corpora/stopwords.zip.
[0mVerified fast protobuf used.
Removing intermediate container 287612f47824
---> 293202f37e71
Step 8/27 : ENV CLOUDSDK_CORE_DISABLE_PROMPTS yes
---> Running in 9e397f60d3b3
Removing intermediate container 9e397f60d3b3
---> 4a115c5c224e
Step 9/27 : ENV PATH $PATH:/usr/local/gcloud/google-cloud-sdk/bin
---> Running in dffae85e8e12
Removing intermediate container dffae85e8e12
---> db19f1ef80a3
Step 10/27 : RUN mkdir -p /usr/local/gcloud && cd /usr/local/gcloud && curl -s -O https://dl.google.com/dl/cloudsdk/release/google-cloud-sdk.tar.gz && tar -xf google-cloud-sdk.tar.gz && /usr/local/gcloud/google-cloud-sdk/install.sh && rm google-cloud-sdk.tar.gz
---> Running in 002e1d1fb20a
Welcome to the Google Cloud SDK!
WARNING: You appear to be running this script as root. This may cause
the installation to be inaccessible to users other than the root user.
[91mBeginning update. This process may take several minutes.
[0m[91m
[0m[91m
Your current Cloud SDK version is: 356.0.0
[0m[91mInstalling components from version: 356.0.0
[0m[91m
[0m[91m┌─────────────────────────────────────────────────────────────────────────────┐[0m[91m
[0m[91m│ These components will be installed. │[0m[91m
[0m[91m├─────────────────────────────────────────────────────┬────────────┬──────────┤[0m[91m
[0m[91m│ Name │ Version │ Size │[0m[91m
[0m[91m├─────────────────────────────────────────────────────┼────────────┼──────────┤[0m[91m
[0m[91m│ [0m[91mBigQuery Command Line Tool [0m[91m [0m[91m│ [0m[91m 2.0.71[0m[91m [0m[91m│ [0m[91m < 1 MiB[0m[91m [0m[91m│[0m[91m
[0m[91m│ [0m[91mBigQuery Command Line Tool (Platform Specific) [0m[91m [0m[91m│ [0m[91m 2.0.69[0m[91m [0m[91m│ [0m[91m < 1 MiB[0m[91m │[0m[91m
│ Cloud SDK Core Libraries (Platform Specific) [0m[91m │ [0m[91m2021.06.18[0m[91m │ [0m[91m < 1 MiB [0m[91m│[0m[91m
[0m[91m│ [0m[91mCloud Storage Command Line Tool [0m[91m [0m[91m│ [0m[91m 4.67[0m[91m [0m[91m│ [0m[91m 4.3 MiB[0m[91m [0m[91m│[0m[91m
[0m[91m│ [0m[91mCloud Storage Command Line Tool (Platform Specific)[0m[91m [0m[91m│ [0m[91m 4.63[0m[91m [0m[91m│ [0m[91m < 1 MiB[0m[91m [0m[91m│[0m[91m
[0m[91m│ [0m[91manthoscli [0m[91m [0m[91m│ [0m[91m 0.2.20[0m[91m [0m[91m│ [0m[91m47.0 MiB[0m[91m [0m[91m│[0m[91m
[0m[91m│ [0m[91mgcloud cli dependencies [0m[91m [0m[91m│ [0m[91m2021.04.16[0m[91m [0m[91m│ [0m[91m < 1 MiB[0m[91m [0m[91m│[0m[91m
[0m[91m└─────────────────────────────────────────────────────┴────────────┴──────────┘[0m[91m
[0m[91m
[0m[91mFor the latest full release notes, please visit:
https://cloud.google.com/sdk/release_notes
[0m[91m╔════════════════════════════════════════════════════════════╗
[0m[91m╠═ Creating update staging area ═╣
[0m[91m╚[0m[91m══════[0m[91m══════[0m[91m══════[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m╝
[0m[91m╔════════════════════════════════════════════════════════════╗
[0m[91m╠═ Installing: BigQuery Command Line Tool ═╣
╚[0m[91m══[0m[91m══[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m══[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═╝
[0m[91m╔════════════════════════════════════════════════════════════╗
╠═ Installing: BigQuery Command Line Tool (Platform Spec... ═╣
[0m[91m╚[0m[91m══════════════════════════════[0m[91m══════════════════════════════╝
[0m[91m╔════════════════════════════════════════════════════════════╗
╠═ Installing: Cloud SDK Core Libraries (Platform Specific) ═╣
[0m[91m╚[0m[91m══════════════════════════════[0m[91m═══════════════[0m[91m═══════════════[0m[91m╝
[0m[91m╔════════════════════════════════════════════════════════════╗
╠═ Installing: Cloud Storage Command Line Tool ═╣
[0m[91m╚[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m╝
[0m[91m╔════════════════════════════════════════════════════════════╗
[0m[91m╠═ Installing: Cloud Storage Command Line Tool (Platform... ═╣
╚[0m[91m══════════════════════════════[0m[91m══════════════════════════════╝
[0m[91m╔════════════════════════════════════════════════════════════╗
╠═ Installing: Default set of gcloud commands ═╣
[0m[91m╚[0m[91m════════════════════════════════════════════════════════════╝
[0m[91m╔════════════════════════════════════════════════════════════╗
╠═ Installing: anthoscli ═╣
[0m[91m╚[0m[91m════════════════════════════════════════════════════════════╝
[0m[91m╔════════════════════════════════════════════════════════════╗
╠═ Installing: anthoscli ═╣
[0m[91m╚[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m═[0m[91m══════════[0m[91m═════════[0m[91m═══════════╝
[0m[91m╔════════════════════════════════════════════════════════════╗
╠═ Installing: gcloud cli dependencies ═╣
[0m[91m╚[0m[91m══════════════════════════════[0m[91m══════════════════════════════╝
[0m[91m╔════════════════════════════════════════════════════════════╗
╠═ Creating backup and activating new installation ═╣
╚[0m[91m══════════════════════════════[0m[91m══════════════════════════════[0m[91m╝
[0m[91m
[0m[91mPerforming post processing steps...
.................................................................................done.
Update done!
[0m
To help improve the quality of this product, we collect anonymized usage data
and anonymized stacktraces when crashes are encountered; additional information
is available at <https://cloud.google.com/sdk/usage-statistics>. This data is
handled in accordance with our privacy policy
<https://cloud.google.com/terms/cloud-privacy-notice>. You may choose to opt in this
collection now (by choosing 'Y' at the below prompt), or at any time in the
future by running the following command:
gcloud config set disable_usage_reporting false
This will install all the core command line tools necessary for working with
the Google Cloud Platform.
[91m==> Source [/usr/local/gcloud/google-cloud-sdk/completion.bash.inc] in your profile to enable shell command completion for gcloud.
==> Source [/usr/local/gcloud/google-cloud-sdk/path.bash.inc] in your profile to add the Google Cloud SDK command line tools to your $PATH.
[0m
For more information on how to get started, please visit:
https://cloud.google.com/sdk/docs/quickstarts
> Task :sdks:java:core:compileJava
Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.
> Task :sdks:java:core:classes
> Task :sdks:java:core:shadowJar FROM-CACHE
> Task :sdks:java:io:hadoop-common:compileJava FROM-CACHE
> Task :sdks:java:io:hadoop-common:classes UP-TO-DATE
> Task :sdks:java:io:hadoop-common:jar
> Task :sdks:java:fn-execution:compileJava FROM-CACHE
> Task :sdks:java:fn-execution:classes UP-TO-DATE
> Task :sdks:java:io:parquet:compileJava FROM-CACHE
> Task :sdks:java:io:parquet:classes UP-TO-DATE
> Task :sdks:java:io:parquet:jar
> Task :sdks:java:fn-execution:jar
> Task :runners:core-construction-java:compileJava FROM-CACHE
> Task :runners:core-construction-java:classes UP-TO-DATE
> Task :runners:core-construction-java:jar
> Task :runners:core-java:compileJava FROM-CACHE
> Task :runners:core-java:classes UP-TO-DATE
> Task :runners:core-java:jar
> Task :sdks:java:extensions:google-cloud-platform-core:compileJava FROM-CACHE
> Task :sdks:java:extensions:google-cloud-platform-core:classes UP-TO-DATE
> Task :sdks:java:extensions:google-cloud-platform-core:jar
> Task :sdks:java:harness:compileJava FROM-CACHE
> Task :sdks:java:harness:classes UP-TO-DATE
> Task :sdks:java:harness:jar
> Task :sdks:java:harness:shadowJar FROM-CACHE
> Task :runners:java-fn-execution:compileJava
Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.
> Task :runners:java-fn-execution:classes
> Task :runners:java-fn-execution:jar
> Task :sdks:java:expansion-service:compileJava
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.
> Task :sdks:java:expansion-service:classes
> Task :sdks:java:expansion-service:jar
> Task :sdks:java:testing:expansion-service:compileTestJava
Note: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/java/testing/expansion-service/src/test/java/org/apache/beam/sdk/testing/expansion/TestExpansionService.java> uses or overrides a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Dataflow/ws/src/sdks/java/testing/expansion-service/src/test/java/org/apache/beam/sdk/testing/expansion/TestExpansionService.java> uses unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.
> Task :sdks:java:testing:expansion-service:testClasses
> Task :sdks:java:io:kafka:compileJava
> Task :sdks:java:testing:expansion-service:buildTestExpansionServiceJar
> Task :sdks:java:io:kafka:compileJava
Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.
> Task :sdks:java:io:kafka:classes
> Task :sdks:java:io:kafka:jar
> Task :sdks:java:container:java8:copyDockerfileDependencies
> Task :sdks:java:container:java8:dockerPrepare
> Task :sdks:java:container:java8:docker
> Task :runners:google-cloud-dataflow-java:buildAndPushDockerContainer
WARNING: `gcloud docker` will not be supported for Docker client versions above 18.03.
As an alternative, use `gcloud auth configure-docker` to configure `docker` to
use `gcloud` as a credential helper, then use `docker` as you would for non-GCR
registries, e.g. `docker pull gcr.io/project-id/my-image`. Add
`--verbosity=error` to silence this warning: `gcloud docker
--verbosity=error -- pull gcr.io/project-id/my-image`.
See: https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker
> Task :runners:google-cloud-dataflow-java:setupXVR
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerSetup
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerPythonUsingJava
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerPythonUsingJava FAILED
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
> Task :runners:google-cloud-dataflow-java:cleanUpDockerImages
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210910000430]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:8feb5f67b1ad3ba038dc3985139db41644d6960f841a171623dba15fcd1ad441]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210910000430] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:8feb5f67b1ad3ba038dc3985139db41644d6960f841a171623dba15fcd1ad441])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:8feb5f67b1ad3ba038dc3985139db41644d6960f841a171623dba15fcd1ad441
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:8feb5f67b1ad3ba038dc3985139db41644d6960f841a171623dba15fcd1ad441].
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerPythonUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 23m 2s
105 actionable tasks: 82 executed, 19 from cache, 4 up-to-date
Publishing build scan...
https://gradle.com/s/r7xmp4hqpnbxq
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org