You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2021/08/01 12:52:47 UTC
Build failed in Jenkins:
beam_LoadTests_Java_ParDo_Dataflow_V2_Streaming_Java11 #45
See <https://ci-beam.apache.org/job/beam_LoadTests_Java_ParDo_Dataflow_V2_Streaming_Java11/45/display/redirect?page=changes>
Changes:
[noreply] Merge pull request #15247: [BEAM-12686] Enable self-managed relative
------------------------------------------
[...truncated 97.13 KB...]
return self._call_chain(*args)
File "/usr/lib/python3.5/urllib/request.py", line 444, in _call_chain
result = func(*args)
File "/usr/lib/python3.5/urllib/request.py", line 590, in http_error_default
raise HTTPError(req.full_url, code, msg, hdrs, fp)
urllib.error.HTTPError: HTTP Error 404: Not Found
ERROR:root:Invalid url for junit-4.13.1: http://www.eclipse.org/legal/epl-v10.html. Retrying...
Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_LoadTests_Java_ParDo_Dataflow_V2_Streaming_Java11/ws/src/sdks/java/container/license_scripts/pull_licenses_java.py",> line 53, in pull_from_url
url_read = urlopen(url)
File "/usr/lib/python3.5/urllib/request.py", line 163, in urlopen
return opener.open(url, data, timeout)
File "/usr/lib/python3.5/urllib/request.py", line 472, in open
response = meth(req, response)
File "/usr/lib/python3.5/urllib/request.py", line 582, in http_response
'http', request, response, code, msg, hdrs)
File "/usr/lib/python3.5/urllib/request.py", line 510, in error
return self._call_chain(*args)
File "/usr/lib/python3.5/urllib/request.py", line 444, in _call_chain
result = func(*args)
File "/usr/lib/python3.5/urllib/request.py", line 590, in http_error_default
raise HTTPError(req.full_url, code, msg, hdrs, fp)
urllib.error.HTTPError: HTTP Error 404: Not Found
ERROR:root:Invalid url for org.jacoco.core-0.8.6: https://www.eclipse.org/legal/epl-2.0/. Retrying...
Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_LoadTests_Java_ParDo_Dataflow_V2_Streaming_Java11/ws/src/sdks/java/container/license_scripts/pull_licenses_java.py",> line 53, in pull_from_url
url_read = urlopen(url)
File "/usr/lib/python3.5/urllib/request.py", line 163, in urlopen
return opener.open(url, data, timeout)
File "/usr/lib/python3.5/urllib/request.py", line 472, in open
response = meth(req, response)
File "/usr/lib/python3.5/urllib/request.py", line 582, in http_response
'http', request, response, code, msg, hdrs)
File "/usr/lib/python3.5/urllib/request.py", line 510, in error
return self._call_chain(*args)
File "/usr/lib/python3.5/urllib/request.py", line 444, in _call_chain
result = func(*args)
File "/usr/lib/python3.5/urllib/request.py", line 590, in http_error_default
raise HTTPError(req.full_url, code, msg, hdrs, fp)
urllib.error.HTTPError: HTTP Error 404: Not Found
ERROR:root:Invalid url for org.jacoco.core-0.8.6: https://www.eclipse.org/legal/epl-2.0/. Retrying...
Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_LoadTests_Java_ParDo_Dataflow_V2_Streaming_Java11/ws/src/sdks/java/container/license_scripts/pull_licenses_java.py",> line 53, in pull_from_url
url_read = urlopen(url)
File "/usr/lib/python3.5/urllib/request.py", line 163, in urlopen
return opener.open(url, data, timeout)
File "/usr/lib/python3.5/urllib/request.py", line 472, in open
response = meth(req, response)
File "/usr/lib/python3.5/urllib/request.py", line 582, in http_response
'http', request, response, code, msg, hdrs)
File "/usr/lib/python3.5/urllib/request.py", line 510, in error
return self._call_chain(*args)
File "/usr/lib/python3.5/urllib/request.py", line 444, in _call_chain
result = func(*args)
File "/usr/lib/python3.5/urllib/request.py", line 590, in http_error_default
raise HTTPError(req.full_url, code, msg, hdrs, fp)
urllib.error.HTTPError: HTTP Error 404: Not Found
ERROR:root:Invalid url for org.jacoco.core-0.8.6: https://www.eclipse.org/legal/epl-2.0/. Retrying...
Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_LoadTests_Java_ParDo_Dataflow_V2_Streaming_Java11/ws/src/sdks/java/container/license_scripts/pull_licenses_java.py",> line 53, in pull_from_url
url_read = urlopen(url)
File "/usr/lib/python3.5/urllib/request.py", line 163, in urlopen
return opener.open(url, data, timeout)
File "/usr/lib/python3.5/urllib/request.py", line 472, in open
response = meth(req, response)
File "/usr/lib/python3.5/urllib/request.py", line 582, in http_response
'http', request, response, code, msg, hdrs)
File "/usr/lib/python3.5/urllib/request.py", line 510, in error
return self._call_chain(*args)
File "/usr/lib/python3.5/urllib/request.py", line 444, in _call_chain
result = func(*args)
File "/usr/lib/python3.5/urllib/request.py", line 590, in http_error_default
raise HTTPError(req.full_url, code, msg, hdrs, fp)
urllib.error.HTTPError: HTTP Error 404: Not Found
ERROR:root:Invalid url for org.jacoco.core-0.8.6: https://www.eclipse.org/legal/epl-2.0/. Retrying...
Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_LoadTests_Java_ParDo_Dataflow_V2_Streaming_Java11/ws/src/sdks/java/container/license_scripts/pull_licenses_java.py",> line 53, in pull_from_url
url_read = urlopen(url)
File "/usr/lib/python3.5/urllib/request.py", line 163, in urlopen
return opener.open(url, data, timeout)
File "/usr/lib/python3.5/urllib/request.py", line 472, in open
response = meth(req, response)
File "/usr/lib/python3.5/urllib/request.py", line 582, in http_response
'http', request, response, code, msg, hdrs)
File "/usr/lib/python3.5/urllib/request.py", line 510, in error
return self._call_chain(*args)
File "/usr/lib/python3.5/urllib/request.py", line 444, in _call_chain
result = func(*args)
File "/usr/lib/python3.5/urllib/request.py", line 590, in http_error_default
raise HTTPError(req.full_url, code, msg, hdrs, fp)
urllib.error.HTTPError: HTTP Error 404: Not Found
ERROR:root:Invalid url for org.jacoco.core-0.8.6: https://www.eclipse.org/legal/epl-2.0/ after 9 retries.
> Task :sdks:go:resolveBuildDependencies
Resolving google.golang.org/api: commit='0324d5e90dc7753607860272666845fad9ceb97e', urls=[https://code.googlesource.com/google-api-go-client]
Resolving google.golang.org/genproto: commit='4d944d34d83c502a5f761500a14d8842648415c3', urls=[https://github.com/google/go-genproto]
Resolving google.golang.org/grpc: commit='5e8f83304c0563d1ba74db05fee83d9c18ab9a58', urls=[https://github.com/grpc/grpc-go]
Resolving google.golang.org/protobuf: commit='d165be301fb1e13390ad453281ded24385fd8ebc', urls=[https://go.googlesource.com/protobuf]
Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, git@github.com:etcd-io/etcd.git]
Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, git@github.com:etcd-io/etcd.git]
> Task :sdks:go:installDependencies
> Task :sdks:go:buildLinuxAmd64
> Task :sdks:go:goBuild
> Task :sdks:java:container:pullLicenses
Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_LoadTests_Java_ParDo_Dataflow_V2_Streaming_Java11/ws/src/sdks/java/container/license_scripts/pull_licenses_java.py",> line 53, in pull_from_url
url_read = urlopen(url)
File "/usr/lib/python3.5/urllib/request.py", line 163, in urlopen
return opener.open(url, data, timeout)
File "/usr/lib/python3.5/urllib/request.py", line 472, in open
response = meth(req, response)
File "/usr/lib/python3.5/urllib/request.py", line 582, in http_response
'http', request, response, code, msg, hdrs)
File "/usr/lib/python3.5/urllib/request.py", line 510, in error
return self._call_chain(*args)
File "/usr/lib/python3.5/urllib/request.py", line 444, in _call_chain
result = func(*args)
File "/usr/lib/python3.5/urllib/request.py", line 590, in http_error_default
raise HTTPError(req.full_url, code, msg, hdrs, fp)
urllib.error.HTTPError: HTTP Error 404: Not Found
ERROR:root:Invalid url for junit-4.13.1: http://www.eclipse.org/legal/epl-v10.html. Retrying...
Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_LoadTests_Java_ParDo_Dataflow_V2_Streaming_Java11/ws/src/sdks/java/container/license_scripts/pull_licenses_java.py",> line 53, in pull_from_url
url_read = urlopen(url)
File "/usr/lib/python3.5/urllib/request.py", line 163, in urlopen
return opener.open(url, data, timeout)
File "/usr/lib/python3.5/urllib/request.py", line 472, in open
response = meth(req, response)
File "/usr/lib/python3.5/urllib/request.py", line 582, in http_response
'http', request, response, code, msg, hdrs)
File "/usr/lib/python3.5/urllib/request.py", line 510, in error
return self._call_chain(*args)
File "/usr/lib/python3.5/urllib/request.py", line 444, in _call_chain
result = func(*args)
File "/usr/lib/python3.5/urllib/request.py", line 590, in http_error_default
raise HTTPError(req.full_url, code, msg, hdrs, fp)
urllib.error.HTTPError: HTTP Error 404: Not Found
ERROR:root:Invalid url for junit-4.13.1: http://www.eclipse.org/legal/epl-v10.html. Retrying...
Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_LoadTests_Java_ParDo_Dataflow_V2_Streaming_Java11/ws/src/sdks/java/container/license_scripts/pull_licenses_java.py",> line 53, in pull_from_url
url_read = urlopen(url)
File "/usr/lib/python3.5/urllib/request.py", line 163, in urlopen
return opener.open(url, data, timeout)
File "/usr/lib/python3.5/urllib/request.py", line 472, in open
response = meth(req, response)
File "/usr/lib/python3.5/urllib/request.py", line 582, in http_response
'http', request, response, code, msg, hdrs)
File "/usr/lib/python3.5/urllib/request.py", line 510, in error
return self._call_chain(*args)
File "/usr/lib/python3.5/urllib/request.py", line 444, in _call_chain
result = func(*args)
File "/usr/lib/python3.5/urllib/request.py", line 590, in http_error_default
raise HTTPError(req.full_url, code, msg, hdrs, fp)
urllib.error.HTTPError: HTTP Error 404: Not Found
ERROR:root:Invalid url for junit-4.13.1: http://www.eclipse.org/legal/epl-v10.html. Retrying...
Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_LoadTests_Java_ParDo_Dataflow_V2_Streaming_Java11/ws/src/sdks/java/container/license_scripts/pull_licenses_java.py",> line 53, in pull_from_url
url_read = urlopen(url)
File "/usr/lib/python3.5/urllib/request.py", line 163, in urlopen
return opener.open(url, data, timeout)
File "/usr/lib/python3.5/urllib/request.py", line 472, in open
response = meth(req, response)
File "/usr/lib/python3.5/urllib/request.py", line 582, in http_response
'http', request, response, code, msg, hdrs)
File "/usr/lib/python3.5/urllib/request.py", line 510, in error
return self._call_chain(*args)
File "/usr/lib/python3.5/urllib/request.py", line 444, in _call_chain
result = func(*args)
File "/usr/lib/python3.5/urllib/request.py", line 590, in http_error_default
raise HTTPError(req.full_url, code, msg, hdrs, fp)
urllib.error.HTTPError: HTTP Error 404: Not Found
ERROR:root:Invalid url for junit-4.13.1: http://www.eclipse.org/legal/epl-v10.html. Retrying...
Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_LoadTests_Java_ParDo_Dataflow_V2_Streaming_Java11/ws/src/sdks/java/container/license_scripts/pull_licenses_java.py",> line 53, in pull_from_url
url_read = urlopen(url)
File "/usr/lib/python3.5/urllib/request.py", line 163, in urlopen
return opener.open(url, data, timeout)
File "/usr/lib/python3.5/urllib/request.py", line 472, in open
response = meth(req, response)
File "/usr/lib/python3.5/urllib/request.py", line 582, in http_response
'http', request, response, code, msg, hdrs)
File "/usr/lib/python3.5/urllib/request.py", line 510, in error
return self._call_chain(*args)
File "/usr/lib/python3.5/urllib/request.py", line 444, in _call_chain
result = func(*args)
File "/usr/lib/python3.5/urllib/request.py", line 590, in http_error_default
raise HTTPError(req.full_url, code, msg, hdrs, fp)
urllib.error.HTTPError: HTTP Error 404: Not Found
ERROR:root:Invalid url for junit-4.13.1: http://www.eclipse.org/legal/epl-v10.html. Retrying...
Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_LoadTests_Java_ParDo_Dataflow_V2_Streaming_Java11/ws/src/sdks/java/container/license_scripts/pull_licenses_java.py",> line 53, in pull_from_url
url_read = urlopen(url)
File "/usr/lib/python3.5/urllib/request.py", line 163, in urlopen
return opener.open(url, data, timeout)
File "/usr/lib/python3.5/urllib/request.py", line 472, in open
response = meth(req, response)
File "/usr/lib/python3.5/urllib/request.py", line 582, in http_response
'http', request, response, code, msg, hdrs)
File "/usr/lib/python3.5/urllib/request.py", line 510, in error
return self._call_chain(*args)
File "/usr/lib/python3.5/urllib/request.py", line 444, in _call_chain
result = func(*args)
File "/usr/lib/python3.5/urllib/request.py", line 590, in http_error_default
raise HTTPError(req.full_url, code, msg, hdrs, fp)
urllib.error.HTTPError: HTTP Error 404: Not Found
ERROR:root:Invalid url for junit-4.13.1: http://www.eclipse.org/legal/epl-v10.html after 9 retries.
ERROR:root:['org.jacoco.agent-0.8.6', 'org.jacoco.report-0.8.6', 'org.jacoco.ant-0.8.6', 'org.jacoco.core-0.8.6', 'junit-4.13.1']
ERROR:root:**************************************** Licenses were not able to be pulled automatically for some dependencies. Please search source code of the dependencies on the internet and add "license" and "notice" (if available) field to <https://ci-beam.apache.org/job/beam_LoadTests_Java_ParDo_Dataflow_V2_Streaming_Java11/ws/src/sdks/java/container/license_scripts/dep_urls_java.yaml> for each missing license. Dependency List: [junit-4.13.1,org.jacoco.agent-0.8.6,org.jacoco.ant-0.8.6,org.jacoco.core-0.8.6,org.jacoco.report-0.8.6]
INFO:root:pull_licenses_java.py failed. It took 878.227756 seconds with 16 threads.
Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_LoadTests_Java_ParDo_Dataflow_V2_Streaming_Java11/ws/src/sdks/java/container/license_scripts/pull_licenses_java.py",> line 315, in <module>
error_msg)
RuntimeError: ('1 error(s) occurred.', ['**************************************** Licenses were not able to be pulled automatically for some dependencies. Please search source code of the dependencies on the internet and add "license" and "notice" (if available) field to <https://ci-beam.apache.org/job/beam_LoadTests_Java_ParDo_Dataflow_V2_Streaming_Java11/ws/src/sdks/java/container/license_scripts/dep_urls_java.yaml> for each missing license. Dependency List: [junit-4.13.1,org.jacoco.agent-0.8.6,org.jacoco.ant-0.8.6,org.jacoco.core-0.8.6,org.jacoco.report-0.8.6]'])
> Task :sdks:java:container:pullLicenses FAILED
> Task :sdks:java:container:resolveBuildDependencies
Resolving ./github.com/apache/beam/sdks/go@<https://ci-beam.apache.org/job/beam_LoadTests_Java_ParDo_Dataflow_V2_Streaming_Java11/ws/src/sdks/go>
> Task :sdks:java:container:installDependencies
> Task :sdks:java:container:buildLinuxAmd64
> Task :sdks:java:container:goBuild
> Task :sdks:java:container:java11:copySdkHarnessLauncher
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:container:pullLicenses'.
> Process 'command './license_scripts/license_script.sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 15m 25s
102 actionable tasks: 74 executed, 26 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/7soyodjvodkee
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal :
beam_LoadTests_Java_ParDo_Dataflow_V2_Streaming_Java11 #61
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Java_ParDo_Dataflow_V2_Streaming_Java11/61/display/redirect?page=changes>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
beam_LoadTests_Java_ParDo_Dataflow_V2_Streaming_Java11 - Build # 60
- Aborted!
Posted by Apache Jenkins Server <je...@builds.apache.org>.
beam_LoadTests_Java_ParDo_Dataflow_V2_Streaming_Java11 - Build # 60 - Aborted:
Check console output at https://ci-beam.apache.org/job/beam_LoadTests_Java_ParDo_Dataflow_V2_Streaming_Java11/60/ to view the results.
Build failed in Jenkins:
beam_LoadTests_Java_ParDo_Dataflow_V2_Streaming_Java11 #59
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Java_ParDo_Dataflow_V2_Streaming_Java11/59/display/redirect>
Changes:
------------------------------------------
[...truncated 27.32 KB...]
> Task :sdks:java:core:classes
> Task :sdks:java:core:shadowJar FROM-CACHE
> Task :sdks:java:fn-execution:compileJava FAILED
> Task :sdks:java:extensions:arrow:compileJava FAILED
> Task :sdks:java:io:kinesis:compileJava FAILED
> Task :sdks:java:extensions:protobuf:extractIncludeProto FAILED
> Task :sdks:java:testing:test-utils:compileJava FAILED
> Task :sdks:java:io:synthetic:compileJava FAILED
> Task :sdks:java:container:generateLicenseReport FAILED
> Task :release:go-licenses:java:dockerRun
+ rm -rf '/output/*'
+ export GO111MODULE=off
+ GO111MODULE=off
+ go get github.com/apache/beam/sdks/java/container
> Task :sdks:go:resolveBuildDependencies
Resolving cloud.google.com/go: commit='03869a08dc16b35ad4968e92d34c5a2a2961b205', urls=[https://code.googlesource.com/gocloud]
Resolving github.com/Shopify/sarama: commit='541689b9f4212043471eb537fa72da507025d3ea', urls=[https://github.com/Shopify/sarama.git, git@github.com:Shopify/sarama.git]
Resolving github.com/armon/consul-api: commit='eb2c6b5be1b66bab83016e0b05f01b8d5496ffbd', urls=[https://github.com/armon/consul-api.git, git@github.com:armon/consul-api.git]
Resolving github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, git@github.com:etcd-io/etcd.git]
Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, git@github.com:etcd-io/etcd.git]
Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, git@github.com:etcd-io/etcd.git]
Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, git@github.com:etcd-io/etcd.git]
Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, git@github.com:etcd-io/etcd.git]
Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, git@github.com:etcd-io/etcd.git]
Resolving github.com/cpuguy83/go-md2man: commit='dc9f53734905c233adfc09fd4f063dce63ce3daf', urls=[https://github.com/cpuguy83/go-md2man.git, git@github.com:cpuguy83/go-md2man.git]
Resolving github.com/davecgh/go-spew: commit='87df7c60d5820d0f8ae11afede5aa52325c09717', urls=[https://github.com/davecgh/go-spew.git, git@github.com:davecgh/go-spew.git]
Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, git@github.com:etcd-io/etcd.git]
Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, git@github.com:etcd-io/etcd.git]
Resolving github.com/eapache/go-resiliency: commit='ef9aaa7ea8bd2448429af1a77cf41b2b3b34bdd6', urls=[https://github.com/eapache/go-resiliency.git, git@github.com:eapache/go-resiliency.git]
Resolving github.com/eapache/go-xerial-snappy: commit='bb955e01b9346ac19dc29eb16586c90ded99a98c', urls=[https://github.com/eapache/go-xerial-snappy.git, git@github.com:eapache/go-xerial-snappy.git]
Resolving github.com/eapache/queue: commit='44cc805cf13205b55f69e14bcb69867d1ae92f98', urls=[https://github.com/eapache/queue.git, git@github.com:eapache/queue.git]
Resolving github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, git@github.com:etcd-io/etcd.git]
Resolving github.com/fsnotify/fsnotify: commit='c2828203cd70a50dcccfb2761f8b1f8ceef9a8e9', urls=[https://github.com/fsnotify/fsnotify.git, git@github.com:fsnotify/fsnotify.git]
Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, git@github.com:etcd-io/etcd.git]
Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, git@github.com:etcd-io/etcd.git]
Resolving github.com/golang/glog: commit='23def4e6c14b4da8ac2ed8007337bc5eb5007998', urls=[https://github.com/golang/glog.git, git@github.com:golang/glog.git]
Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, git@github.com:etcd-io/etcd.git]
Resolving github.com/golang/mock: commit='b3e60bcdc577185fce3cf625fc96b62857ce5574', urls=[https://github.com/golang/mock.git, git@github.com:golang/mock.git]
Resolving github.com/golang/protobuf: commit='d04d7b157bb510b1e0c10132224b616ac0e26b17', urls=[https://github.com/golang/protobuf.git, git@github.com:golang/protobuf.git]
Resolving github.com/golang/snappy: commit='553a641470496b2327abcac10b36396bd98e45c9', urls=[https://github.com/golang/snappy.git, git@github.com:golang/snappy.git]
Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, git@github.com:etcd-io/etcd.git]
Resolving github.com/google/go-cmp: commit='9680bfaf28748393e28e00238d94070fb9972fd8', urls=[https://github.com/google/go-cmp.git, git@github.com:google/go-cmp.git]
Resolving github.com/google/pprof: commit='a8f279b7952b27edbcb72e5a6c69ee9be4c8ad93', urls=[https://github.com/google/pprof.git, git@github.com:google/pprof.git]
Resolving github.com/google/uuid: commit='bfb86fa49a73e4194d93bea18d7acfe3694438ce', urls=[https://github.com/google/uuid.git, git@github.com:google/uuid.git]
Resolving github.com/googleapis/gax-go: commit='bd5b16380fd03dc758d11cef74ba2e3bc8b0e8c2', urls=[https://github.com/googleapis/gax-go.git, git@github.com:googleapis/gax-go.git]
Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, git@github.com:etcd-io/etcd.git]
Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, git@github.com:etcd-io/etcd.git]
Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, git@github.com:etcd-io/etcd.git]
Resolving github.com/hashicorp/hcl: commit='23c074d0eceb2b8a5bfdbb271ab780cde70f05a8', urls=[https://github.com/hashicorp/hcl.git, git@github.com:hashicorp/hcl.git]
Resolving github.com/ianlancetaylor/demangle: commit='4883227f66371e02c4948937d3e2be1664d9be38', urls=[https://github.com/ianlancetaylor/demangle.git, git@github.com:ianlancetaylor/demangle.git]
Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, git@github.com:etcd-io/etcd.git]
Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, git@github.com:etcd-io/etcd.git]
Resolving github.com/kr/fs: commit='2788f0dbd16903de03cb8186e5c7d97b69ad387b', urls=[https://github.com/kr/fs.git, git@github.com:kr/fs.git]
Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, git@github.com:etcd-io/etcd.git]
Resolving github.com/linkedin/goavro: commit='94a7a9db615f35a39dd2b82089398b92fabad2ba', urls=[https://github.com/linkedin/goavro.git, git@github.com:linkedin/goavro.git]
Resolving github.com/magiconair/properties: commit='49d762b9817ba1c2e9d0c69183c2b4a8b8f1d934', urls=[https://github.com/magiconair/properties.git, git@github.com:magiconair/properties.git]
Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, git@github.com:etcd-io/etcd.git]
Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, git@github.com:etcd-io/etcd.git]
Resolving github.com/mitchellh/go-homedir: commit='b8bc1bf767474819792c23f32d8286a45736f1c6', urls=[https://github.com/mitchellh/go-homedir.git, git@github.com:mitchellh/go-homedir.git]
Resolving github.com/mitchellh/mapstructure: commit='a4e142e9c047c904fa2f1e144d9a84e6133024bc', urls=[https://github.com/mitchellh/mapstructure.git, git@github.com:mitchellh/mapstructure.git]
Resolving github.com/nightlyone/lockfile: commit='0ad87eef1443f64d3d8c50da647e2b1552851124', urls=[https://github.com/nightlyone/lockfile, git@github.com:nightlyone/lockfile.git]
Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, git@github.com:etcd-io/etcd.git]
Resolving github.com/openzipkin/zipkin-go: commit='3741243b287094fda649c7f0fa74bd51f37dc122', urls=[https://github.com/openzipkin/zipkin-go.git, git@github.com:openzipkin/zipkin-go.git]
Resolving github.com/pelletier/go-toml: commit='acdc4509485b587f5e675510c4f2c63e90ff68a8', urls=[https://github.com/pelletier/go-toml.git, git@github.com:pelletier/go-toml.git]
Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, git@github.com:etcd-io/etcd.git]
Resolving github.com/pierrec/lz4: commit='ed8d4cc3b461464e69798080a0092bd028910298', urls=[https://github.com/pierrec/lz4.git, git@github.com:pierrec/lz4.git]
Resolving github.com/pierrec/xxHash: commit='a0006b13c722f7f12368c00a3d3c2ae8a999a0c6', urls=[https://github.com/pierrec/xxHash.git, git@github.com:pierrec/xxHash.git]
Resolving github.com/pkg/errors: commit='30136e27e2ac8d167177e8a583aa4c3fea5be833', urls=[https://github.com/pkg/errors.git, git@github.com:pkg/errors.git]
Resolving github.com/pkg/sftp: commit='22e9c1ccc02fc1b9fa3264572e49109b68a86947', urls=[https://github.com/pkg/sftp.git, git@github.com:pkg/sftp.git]
Resolving github.com/prometheus/client_golang: commit='9bb6ab929dcbe1c8393cd9ef70387cb69811bd1c', urls=[https://github.com/prometheus/client_golang.git, git@github.com:prometheus/client_golang.git]
Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, git@github.com:etcd-io/etcd.git]
Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, git@github.com:etcd-io/etcd.git]
Resolving github.com/prometheus/procfs: commit='cb4147076ac75738c9a7d279075a253c0cc5acbd', urls=[https://github.com/prometheus/procfs.git, git@github.com:prometheus/procfs.git]
Resolving github.com/rcrowley/go-metrics: commit='8732c616f52954686704c8645fe1a9d59e9df7c1', urls=[https://github.com/rcrowley/go-metrics.git, git@github.com:rcrowley/go-metrics.git]
Resolving github.com/cpuguy83/go-md2man: commit='dc9f53734905c233adfc09fd4f063dce63ce3daf', urls=[https://github.com/cpuguy83/go-md2man.git, git@github.com:cpuguy83/go-md2man.git]
Resolving cached github.com/cpuguy83/go-md2man: commit='dc9f53734905c233adfc09fd4f063dce63ce3daf', urls=[https://github.com/cpuguy83/go-md2man.git, git@github.com:cpuguy83/go-md2man.git]
Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, git@github.com:etcd-io/etcd.git]
Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, git@github.com:etcd-io/etcd.git]
Resolving github.com/spf13/afero: commit='bb8f1927f2a9d3ab41c9340aa034f6b803f4359c', urls=[https://github.com/spf13/afero.git, git@github.com:spf13/afero.git]
Resolving github.com/spf13/cast: commit='acbeb36b902d72a7a4c18e8f3241075e7ab763e4', urls=[https://github.com/spf13/cast.git, git@github.com:spf13/cast.git]
Resolving github.com/spf13/cobra: commit='93959269ad99e80983c9ba742a7e01203a4c0e4f', urls=[https://github.com/spf13/cobra.git, git@github.com:spf13/cobra.git]
Resolving github.com/spf13/jwalterweatherman: commit='7c0cea34c8ece3fbeb2b27ab9b59511d360fb394', urls=[https://github.com/spf13/jwalterweatherman.git, git@github.com:spf13/jwalterweatherman.git]
Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, git@github.com:etcd-io/etcd.git]
Resolving github.com/spf13/viper: commit='aafc9e6bc7b7bb53ddaa75a5ef49a17d6e654be5', urls=[https://github.com/spf13/viper.git, git@github.com:spf13/viper.git]
Resolving github.com/stathat/go: commit='74669b9f388d9d788c97399a0824adbfee78400e', urls=[https://github.com/stathat/go.git, git@github.com:stathat/go.git]
Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, git@github.com:etcd-io/etcd.git]
Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, git@github.com:etcd-io/etcd.git]
Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, git@github.com:etcd-io/etcd.git]
Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, git@github.com:etcd-io/etcd.git]
Resolving github.com/xordataexchange/crypt: commit='b2862e3d0a775f18c7cfe02273500ae307b61218', urls=[https://github.com/xordataexchange/crypt.git, git@github.com:xordataexchange/crypt.git]
Resolving go.opencensus.io: commit='3fb168f674736c026e623310bfccb0691e6dec8a', urls=[https://github.com/census-instrumentation/opencensus-go]
Resolving golang.org/x/crypto: commit='d9133f5469342136e669e85192a26056b587f503', urls=[https://go.googlesource.com/crypto]
Resolving golang.org/x/debug: commit='95515998a8a4bd7448134b2cb5971dbeb12e0b77', urls=[https://go.googlesource.com/debug]
Resolving golang.org/x/net: commit='2fb46b16b8dda405028c50f7c7f0f9dd1fa6bfb1', urls=[https://go.googlesource.com/net]
Resolving golang.org/x/oauth2: commit='5d25da1a8d43b66f2898c444f899c7bcfd6a407e', urls=[https://go.googlesource.com/oauth2]
Resolving golang.org/x/sync: commit='fd80eb99c8f653c847d294a001bdf2a3a6f768f5', urls=[https://go.googlesource.com/sync]
Resolving golang.org/x/sys: commit='fde4db37ae7ad8191b03d30d27f258b5291ae4e3', urls=[https://go.googlesource.com/sys]
Resolving golang.org/x/text: commit='23ae387dee1f90d29a23c0e87ee0b46038fbed0e', urls=[https://go.googlesource.com/text]
Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, git@github.com:etcd-io/etcd.git]
> Task :release:go-licenses:java:dockerRun
+ go-licenses save github.com/apache/beam/sdks/java/container --save_path=/output/licenses
+ go-licenses csv github.com/apache/beam/sdks/java/container
+ tee /output/licenses/list.csv
golang.org/x/sys,https://go.googlesource.com/sys/+/refs/heads/master/LICENSE,BSD-3-Clause
github.com/golang/protobuf,https://github.com/golang/protobuf/blob/master/LICENSE,BSD-3-Clause
google.golang.org/protobuf,https://go.googlesource.com/protobuf/+/refs/heads/master/LICENSE,BSD-3-Clause
google.golang.org/grpc,https://github.com/grpc/grpc-go/blob/master/LICENSE,Apache-2.0
golang.org/x/net,https://go.googlesource.com/net/+/refs/heads/master/LICENSE,BSD-3-Clause
github.com/apache/beam/sdks/java/container,https://github.com/apache/beam/blob/master/LICENSE,Apache-2.0
github.com/apache/beam/sdks/go/pkg/beam,https://github.com/apache/beam/blob/master/sdks/go/README.md,Apache-2.0
google.golang.org/genproto/googleapis/rpc/status,https://github.com/googleapis/go-genproto/blob/master/LICENSE,Apache-2.0
golang.org/x/text,https://go.googlesource.com/text/+/refs/heads/master/LICENSE,BSD-3-Clause
+ chmod -R a+w /output/licenses
> Task :release:go-licenses:java:createLicenses
> Task :sdks:java:container:java11:copyGolangLicenses FAILED
> Task :sdks:go:resolveBuildDependencies
Resolving google.golang.org/api: commit='0324d5e90dc7753607860272666845fad9ceb97e', urls=[https://code.googlesource.com/google-api-go-client]
Resolving google.golang.org/genproto: commit='4d944d34d83c502a5f761500a14d8842648415c3', urls=[https://github.com/google/go-genproto]
Resolving google.golang.org/grpc: commit='5e8f83304c0563d1ba74db05fee83d9c18ab9a58', urls=[https://github.com/grpc/grpc-go]
Resolving google.golang.org/protobuf: commit='d165be301fb1e13390ad453281ded24385fd8ebc', urls=[https://go.googlesource.com/protobuf]
Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, git@github.com:etcd-io/etcd.git]
Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, git@github.com:etcd-io/etcd.git]
> Task :sdks:go:installDependencies
> Task :sdks:go:buildLinuxAmd64
> Task :sdks:go:goBuild
> Task :sdks:java:container:resolveBuildDependencies FAILED
> Task :sdks:java:container:installDependencies
FAILURE: Build completed with 9 failures.
1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:java:fn-execution:compileJava'.
> Could not create task ':runners:direct-java:clean'.
> java.util.ConcurrentModificationException (no error message)
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:java:extensions:arrow:compileJava'.
> Could not create task ':runners:direct-java:clean'.
> java.util.ConcurrentModificationException (no error message)
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
3: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:java:io:synthetic:compileJava'.
> Could not create task ':runners:direct-java:clean'.
> java.util.ConcurrentModificationException (no error message)
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
4: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:java:testing:test-utils:compileJava'.
> Could not create task ':runners:direct-java:clean'.
> java.util.ConcurrentModificationException (no error message)
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
5: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:java:extensions:protobuf:extractIncludeProto'.
> Could not create task ':runners:direct-java:clean'.
> java.util.ConcurrentModificationException (no error message)
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
6: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:java:io:kinesis:compileJava'.
> Could not create task ':runners:direct-java:clean'.
> java.util.ConcurrentModificationException (no error message)
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
7: Task failed with an exception.
-----------
* What went wrong:
A problem occurred evaluating project ':runners:direct-java'.
> Could not create task ':runners:direct-java:clean'.
> java.util.ConcurrentModificationException (no error message)
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
8: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:java:container:java11:copyGolangLicenses'.
> Could not create task ':runners:direct-java:clean'.
> java.util.ConcurrentModificationException (no error message)
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
9: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:java:container:resolveBuildDependencies'.
> Could not create task ':runners:direct-java:clean'.
> java.util.ConcurrentModificationException (no error message)
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 19s
69 actionable tasks: 55 executed, 12 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/6z2icpgd5foy2
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins:
beam_LoadTests_Java_ParDo_Dataflow_V2_Streaming_Java11 #58
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Java_ParDo_Dataflow_V2_Streaming_Java11/58/display/redirect?page=changes>
Changes:
[noreply] [BEAM-12757]: Remove call for Json Dag in Portable PipelineRunner as
[noreply] fix confusing function def (#15120)
------------------------------------------
[...truncated 65.44 KB...]
afa3e488a0ee: Preparing
f42aed5f7feb: Waiting
d94dbb9c31bd: Waiting
89819bafde36: Waiting
8d4f1f665859: Waiting
ac2a8a598938: Waiting
f3d5b8f65132: Waiting
bfb1ad453cf3: Waiting
fe715d60a279: Waiting
54254a970f5e: Waiting
afa3e488a0ee: Waiting
ad83f0aa5c0a: Waiting
5a9a65095453: Waiting
7f37b291c24c: Pushed
7ac8164e3586: Pushed
0b16fa087ab7: Pushed
999a513f50c3: Pushed
7590832c0955: Pushed
a51c5932a189: Pushed
ac2a8a598938: Pushed
fe715d60a279: Pushed
f42aed5f7feb: Layer already exists
89819bafde36: Layer already exists
f3d5b8f65132: Layer already exists
bfb1ad453cf3: Pushed
ad83f0aa5c0a: Layer already exists
5a9a65095453: Layer already exists
4b0edb23340c: Layer already exists
afa3e488a0ee: Layer already exists
8d4f1f665859: Pushed
d94dbb9c31bd: Pushed
54254a970f5e: Pushed
20210814123734: digest: sha256:d5b4fabd16a8e88473c78c330df6052f5e71bc329968cecdc130a073474d1277 size: 4310
> Task :sdks:java:testing:load-tests:run
Aug 14, 2021 12:42:11 PM org.apache.beam.runners.dataflow.options.DataflowPipelineOptions$StagingLocationFactory create
INFO: No stagingLocation provided, falling back to gcpTempLocation
Aug 14, 2021 12:42:12 PM org.apache.beam.runners.dataflow.DataflowRunner fromOptions
INFO: PipelineOptions.filesToStage was not specified. Defaulting to files from the classpath: will stage 191 files. Enable logging at DEBUG level to see which files will be staged.
Aug 14, 2021 12:42:12 PM org.apache.beam.sdk.Pipeline validate
WARNING: The following transforms do not have stable unique names: ParDo(TimeMonitor)
Aug 14, 2021 12:42:12 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Executing pipeline on the Dataflow Service, which will have billing implications related to Google Compute Engine usage and other Google Cloud Services.
Aug 14, 2021 12:42:15 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging portable pipeline proto to gs://temp-storage-for-perf-tests/loadtests/staging/
Aug 14, 2021 12:42:15 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <107841 bytes, hash 0bb124d1f9f15a41868cd48a391a8a1e9f60297a25f529e7aa3f439a1e5227dc> to gs://temp-storage-for-perf-tests/loadtests/staging/pipeline-C7Ek0fnxWkGGjNSKORqKHp9gKXol9Snnqj9Dmh5SJ9w.pb
Aug 14, 2021 12:42:16 PM org.apache.beam.runners.dataflow.util.PackageUtil stageClasspathElements
INFO: Uploading 191 files from PipelineOptions.filesToStage to staging location to prepare for execution.
Aug 14, 2021 12:42:17 PM org.apache.beam.runners.dataflow.util.PackageUtil stageClasspathElements
INFO: Staging files complete: 191 files cached, 0 files newly uploaded in 0 seconds
Aug 14, 2021 12:42:17 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Read input/DataflowRunner.StreamingUnboundedRead.ReadWithIds as step s1
Aug 14, 2021 12:42:17 PM org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource split
INFO: Split into 20 bundles of sizes: [org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@6342d610, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@dc4a691, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@784abd3e, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@36c2b646, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@434514d8, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@6b1dc20f, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@4613311f, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@6540cf1d, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@ec8f4b9, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@bc042d5, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@5484117b, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@37df14d1, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@7efb53af, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@7724704f, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@3dfa819, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@4ce94d2f, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@68ab0936, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@3cd9aa64, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@42b84286, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@443effcb]
Aug 14, 2021 12:42:17 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Read input/StripIds as step s2
Aug 14, 2021 12:42:17 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding ParDo(TimeMonitor) as step s3
Aug 14, 2021 12:42:17 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding ParDo(ByteMonitor) as step s4
Aug 14, 2021 12:42:17 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 0 as step s5
Aug 14, 2021 12:42:17 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 1 as step s6
Aug 14, 2021 12:42:17 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 2 as step s7
Aug 14, 2021 12:42:17 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 3 as step s8
Aug 14, 2021 12:42:17 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 4 as step s9
Aug 14, 2021 12:42:17 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 5 as step s10
Aug 14, 2021 12:42:17 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 6 as step s11
Aug 14, 2021 12:42:17 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 7 as step s12
Aug 14, 2021 12:42:17 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 8 as step s13
Aug 14, 2021 12:42:17 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 9 as step s14
Aug 14, 2021 12:42:17 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding ParDo(TimeMonitor)2 as step s15
Aug 14, 2021 12:42:17 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Dataflow SDK version: 2.33.0-SNAPSHOT
Aug 14, 2021 12:42:18 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobs/us-central1/2021-08-14_05_42_17-7708985462629290779?project=apache-beam-testing
Aug 14, 2021 12:42:18 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Submitted job: 2021-08-14_05_42_17-7708985462629290779
Aug 14, 2021 12:42:18 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2021-08-14_05_42_17-7708985462629290779
Aug 14, 2021 12:42:29 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-08-14T12:42:26.859Z: The workflow name is not a valid Cloud Label. Labels applied to Cloud resources (such as GCE Instances) for monitoring will be labeled with this modified job name: load0tests0java110dataflow0v20streaming0pardo01-jenkins-08-86vh. For the best monitoring experience, please name your job with a valid Cloud Label. For details, see: https://cloud.google.com/compute/docs/labeling-resources#restrictions
Aug 14, 2021 12:42:33 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-14T12:42:31.828Z: Worker configuration: e2-standard-2 in us-central1-a.
Aug 14, 2021 12:42:33 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-14T12:42:32.381Z: Expanding SplittableParDo operations into optimizable parts.
Aug 14, 2021 12:42:33 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-14T12:42:32.412Z: Expanding CollectionToSingleton operations into optimizable parts.
Aug 14, 2021 12:42:33 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-14T12:42:32.477Z: Expanding CoGroupByKey operations into optimizable parts.
Aug 14, 2021 12:42:33 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-14T12:42:32.515Z: Expanding SplittableProcessKeyed operations into optimizable parts.
Aug 14, 2021 12:42:33 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-14T12:42:32.535Z: Expanding GroupByKey operations into streaming Read/Write steps
Aug 14, 2021 12:42:33 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-14T12:42:32.558Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
Aug 14, 2021 12:42:33 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-14T12:42:32.620Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
Aug 14, 2021 12:42:33 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-14T12:42:32.652Z: Fusing consumer Read input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource) into Read input/Impulse
Aug 14, 2021 12:42:33 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-14T12:42:32.685Z: Fusing consumer Read-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/PairWithRestriction into Read input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource)
Aug 14, 2021 12:42:33 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-14T12:42:32.714Z: Fusing consumer Read-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/SplitWithSizing into Read-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/PairWithRestriction
Aug 14, 2021 12:42:33 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-14T12:42:32.740Z: Fusing consumer Read input/ParDo(StripIds)/ParMultiDo(StripIds) into Read-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/ProcessElementAndRestrictionWithSizing
Aug 14, 2021 12:42:33 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-14T12:42:32.776Z: Fusing consumer ParDo(TimeMonitor)/ParMultiDo(TimeMonitor) into Read input/ParDo(StripIds)/ParMultiDo(StripIds)
Aug 14, 2021 12:42:33 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-14T12:42:32.806Z: Fusing consumer ParDo(ByteMonitor)/ParMultiDo(ByteMonitor) into ParDo(TimeMonitor)/ParMultiDo(TimeMonitor)
Aug 14, 2021 12:42:33 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-14T12:42:32.829Z: Fusing consumer Step: 0/ParMultiDo(CounterOperation) into ParDo(ByteMonitor)/ParMultiDo(ByteMonitor)
Aug 14, 2021 12:42:33 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-14T12:42:32.850Z: Fusing consumer Step: 1/ParMultiDo(CounterOperation) into Step: 0/ParMultiDo(CounterOperation)
Aug 14, 2021 12:42:33 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-14T12:42:32.897Z: Fusing consumer Step: 2/ParMultiDo(CounterOperation) into Step: 1/ParMultiDo(CounterOperation)
Aug 14, 2021 12:42:33 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-14T12:42:32.920Z: Fusing consumer Step: 3/ParMultiDo(CounterOperation) into Step: 2/ParMultiDo(CounterOperation)
Aug 14, 2021 12:42:33 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-14T12:42:32.946Z: Fusing consumer Step: 4/ParMultiDo(CounterOperation) into Step: 3/ParMultiDo(CounterOperation)
Aug 14, 2021 12:42:33 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-14T12:42:32.969Z: Fusing consumer Step: 5/ParMultiDo(CounterOperation) into Step: 4/ParMultiDo(CounterOperation)
Aug 14, 2021 12:42:33 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-14T12:42:32.994Z: Fusing consumer Step: 6/ParMultiDo(CounterOperation) into Step: 5/ParMultiDo(CounterOperation)
Aug 14, 2021 12:42:33 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-14T12:42:33.019Z: Fusing consumer Step: 7/ParMultiDo(CounterOperation) into Step: 6/ParMultiDo(CounterOperation)
Aug 14, 2021 12:42:33 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-14T12:42:33.047Z: Fusing consumer Step: 8/ParMultiDo(CounterOperation) into Step: 7/ParMultiDo(CounterOperation)
Aug 14, 2021 12:42:33 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-14T12:42:33.078Z: Fusing consumer Step: 9/ParMultiDo(CounterOperation) into Step: 8/ParMultiDo(CounterOperation)
Aug 14, 2021 12:42:33 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-14T12:42:33.103Z: Fusing consumer ParDo(TimeMonitor)2/ParMultiDo(TimeMonitor) into Step: 9/ParMultiDo(CounterOperation)
Aug 14, 2021 12:42:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-14T12:42:33.369Z: Starting 5 ****s in us-central1-a...
Aug 14, 2021 12:42:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-14T12:42:59.093Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete
Aug 14, 2021 12:43:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-14T12:43:07.909Z: Autoscaling: Raised the number of ****s to 1 so that the pipeline can catch up with its backlog and keep up with its input rate.
Aug 14, 2021 12:43:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-14T12:43:07.960Z: Resized **** pool to 1, though goal was 5. This could be a quota issue.
Aug 14, 2021 12:43:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-14T12:43:18.256Z: Autoscaling: Raised the number of ****s to 5 so that the pipeline can catch up with its backlog and keep up with its input rate.
Aug 14, 2021 12:44:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-14T12:44:12.023Z: Workers have started successfully.
Aug 14, 2021 12:44:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-14T12:44:12.059Z: Workers have started successfully.
Aug 14, 2021 4:00:46 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-14T16:00:42.935Z: Cancel request is committed for workflow job: 2021-08-14_05_42_17-7708985462629290779.
Aug 14, 2021 4:00:46 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-14T16:00:43.032Z: Cleaning up.
Aug 14, 2021 4:00:46 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-14T16:00:43.098Z: Stopping **** pool...
Aug 14, 2021 4:00:46 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-14T16:00:43.147Z: Stopping **** pool...
Aug 14, 2021 4:03:02 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-14T16:03:01.049Z: Autoscaling: Reduced the number of ****s to 0 based on low average **** CPU utilization, and the pipeline having sufficiently low backlog and keeping up with input rate.
Aug 14, 2021 4:03:02 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-14T16:03:01.094Z: Worker pool stopped.
Aug 14, 2021 4:03:08 PM org.apache.beam.runners.dataflow.DataflowPipelineJob logTerminalState
INFO: Job 2021-08-14_05_42_17-7708985462629290779 finished with status CANCELLED.
Aug 14, 2021 4:03:08 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric totalBytes.count, from namespace pardo
Load test results for test (ID): 1cf12235-8714-443e-81d9-d895c939c42a and timestamp: 2021-08-14T12:42:12.519000000Z:
Metric: Value:
dataflow_v2_java11_runtime_sec 0.0
dataflow_v2_java11_total_bytes_count -1.0
Exception in thread "main" java.lang.RuntimeException: Invalid job state: CANCELLED.
at org.apache.beam.sdk.loadtests.JobFailure.handleFailure(JobFailure.java:55)
at org.apache.beam.sdk.loadtests.LoadTest.run(LoadTest.java:141)
at org.apache.beam.sdk.loadtests.ParDoLoadTest.run(ParDoLoadTest.java:53)
at org.apache.beam.sdk.loadtests.ParDoLoadTest.main(ParDoLoadTest.java:103)
> Task :sdks:java:testing:load-tests:run FAILED
> Task :runners:google-cloud-dataflow-java:cleanUpDockerImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210814123734
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:d5b4fabd16a8e88473c78c330df6052f5e71bc329968cecdc130a073474d1277
Deleted: sha256:0c3ee4f9cd2f42af33fc82e21ba52203ecab282c5f8d6f05c47a813574a785f2
Deleted: sha256:649aad392e64a5fbe1b1cd54b0e73fa352ea0d4f281c570e7ce56581b0dc4d16
Deleted: sha256:60ac02ecf96fdba9c59ab49438f7ce3ab8316e7f148e24542a7208cdec3a43a0
Deleted: sha256:1ced2ec6cf0d94cd9a474f9f4649709b8d9fb0c6c30151da7a0c3e951a021294
Deleted: sha256:fe001f7d7d076389a620d639459071bbc79dbb2a6e995188921a81cb2b0d38b2
Deleted: sha256:afa0c995458c54c67afb4a08fd36d0a8fca971915262a886fe5ab18677ff6a17
Deleted: sha256:bd2e54c015b0da2dbdf7266c5f91230aca94e7db8fb733e8065b399c2f7d9859
Deleted: sha256:660186a5f971f8e2c554fa46b9164c39ac5348235936f9bb5df959a331a3023a
Deleted: sha256:e32d2244dad5300fff51fe150cc93d7c45043cd0ef45260fc99f350722c9b72e
Deleted: sha256:7b32a68d7f2b15adf11602ff22bbf66f8b50d12947e2ae68adbbc22b26ce50ba
Deleted: sha256:16be4271d7346c0cca27b782e0c62727bb324f00835c7d8667216a6ea663d69f
Deleted: sha256:34fb323b94b0378c81ed2ee840f7dce8011d32101a2b87274f521e33914faeff
Deleted: sha256:40ed12613d66e7898e3c6ce01771aab7e133a0ee439c75166b2886f5a7c51576
Deleted: sha256:1876873fca85efb3841843e5534ce29e6a3c5869e6198815eb4dc404145f2eab
Deleted: sha256:250444fa8a92cf52e555a7a36b05c0b3c634f75410aeea90472005a479ad4ee8
Deleted: sha256:e7a9291ad08dfb0fb885df71297c1c28e03c4dea05b7886c778dcb34aaa2c34c
Deleted: sha256:3d17ddca987218b2296d5f6109776fd0a40581a7ff847abcd9d598b0f96fe72a
Deleted: sha256:be960dec02a5f5e1e2f4a3cad58efe9cf4f6749b6ed8d7d78fa44c8d5970e070
Deleted: sha256:647befce8c95c1bb2d9a392b41480deedaf130b6d0247207a3c679a9463e83b4
Deleted: sha256:774de80497265fc8a8a97d76b74164ec3bcc0dac96279f5e2451d1e5a1b91425
Deleted: sha256:251380b1e5fd86006dc75fa122394c535c66e7d47e49e62264576ff26cac4d6c
Deleted: sha256:cae3632b6da2145af7fed47724748aee464c35c95cf2e0b8da116816e4515a7a
Deleted: sha256:c95c70c52d9b261167f268745162d923a554dc2477f6e210165d14fbe5c4a98d
Deleted: sha256:5f937c208de8b16437216b2b4738bbb5732627a15f6dfda4e6ac777e14b1ccb2
Deleted: sha256:fd0a02187b347c305ec137050768c36f622a5261cee445ecafd582b52090e990
Deleted: sha256:bbde64604a44cc082f10e592eadca5eec66e9ec0b057dbab0dbeb523ee0bfd20
Deleted: sha256:fe1178153db1de7a2f76896c611910f489fe7257906ab32149f1f89f6a9a10a3
Deleted: sha256:e8059fb8cdb319e346428a88e908bcf8eced93d489b84d645c4c4d9fcb88eed3
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210814123734]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:d5b4fabd16a8e88473c78c330df6052f5e71bc329968cecdc130a073474d1277]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210814123734] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:d5b4fabd16a8e88473c78c330df6052f5e71bc329968cecdc130a073474d1277])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:d5b4fabd16a8e88473c78c330df6052f5e71bc329968cecdc130a073474d1277
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:d5b4fabd16a8e88473c78c330df6052f5e71bc329968cecdc130a073474d1277
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:d5b4fabd16a8e88473c78c330df6052f5e71bc329968cecdc130a073474d1277].
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:testing:load-tests:run'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 3h 25m 52s
107 actionable tasks: 76 executed, 29 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/ib5a3orpp3kda
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins:
beam_LoadTests_Java_ParDo_Dataflow_V2_Streaming_Java11 #57
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Java_ParDo_Dataflow_V2_Streaming_Java11/57/display/redirect?page=changes>
Changes:
[bsindhwani] Python Kata - Event Time Triggers
[bsindhwani] Python Kata - Event Time Triggers - Added license to task-info.yaml
[bsindhwani] Python Kata - Event Time Triggers - refactored the accumulation mode
[bsindhwani] Python Kata - Event Time Triggers - task description corrected to
[bsindhwani] Python Kata - Event Time Triggers - added streaming options
[bsindhwani] Python Kata - Event Time Triggers - add license text in task-info.yaml
[bsindhwani] Python Kata - Early Triggers
[bsindhwani] Python Kata - Event Time Triggers & Early Triggers - task.md - corrected
[bsindhwani] Python Kata - Window Accumulation Mode
[bsindhwani] Python Kata - Event Time Triggers - removed the external transform
[noreply] Loosen typing extensions requirement
[bsindhwani] Python Kata - added license to course-info.yaml
[Kyle Weaver] [BEAM-12719] ZetaSQL docs: replace out of date table with link to
[Robert Burke] [BEAM-11779] Remove appliance restriction.
[ryanthompson591] Add retry_gcs_file_copy when 500 errros happen from server
[noreply] [BEAM-6374] Emit PCollection metrics from GoSDK (#15289)
[noreply] Merge pull request #15165 from [BEAM-12593] Verify DataFrame API on
[noreply] Merge pull request #15265 from [BEAM-12545] Extend FileSink by
[noreply] [BEAM-12453]: Add interface to access I/O topic information for a Samza
[noreply] [BEAM-10212] Guard state caching with experiment (#15319)
------------------------------------------
[...truncated 64.48 KB...]
As an alternative, use `gcloud auth configure-docker` to configure `docker` to
use `gcloud` as a credential helper, then use `docker` as you would for non-GCR
registries, e.g. `docker pull gcr.io/project-id/my-image`. Add
`--verbosity=error` to silence this warning: `gcloud docker
--verbosity=error -- pull gcr.io/project-id/my-image`.
See: https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker
> Task :sdks:java:testing:load-tests:run
Aug 13, 2021 12:44:13 PM org.apache.beam.runners.dataflow.options.DataflowPipelineOptions$StagingLocationFactory create
INFO: No stagingLocation provided, falling back to gcpTempLocation
Aug 13, 2021 12:44:14 PM org.apache.beam.runners.dataflow.DataflowRunner fromOptions
INFO: PipelineOptions.filesToStage was not specified. Defaulting to files from the classpath: will stage 191 files. Enable logging at DEBUG level to see which files will be staged.
Aug 13, 2021 12:44:15 PM org.apache.beam.sdk.Pipeline validate
WARNING: The following transforms do not have stable unique names: ParDo(TimeMonitor)
Aug 13, 2021 12:44:15 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Executing pipeline on the Dataflow Service, which will have billing implications related to Google Compute Engine usage and other Google Cloud Services.
Aug 13, 2021 12:44:17 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging portable pipeline proto to gs://temp-storage-for-perf-tests/loadtests/staging/
Aug 13, 2021 12:44:17 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <107841 bytes, hash 2eb09da47b15d7cc943d9fba31e7a98a66a17aa7098686f4674910a75a4534a7> to gs://temp-storage-for-perf-tests/loadtests/staging/pipeline-LrCdpHsV18yUPZ-6MeepimaheqcJhob0Z0kQp1pFNKc.pb
Aug 13, 2021 12:44:18 PM org.apache.beam.runners.dataflow.util.PackageUtil stageClasspathElements
INFO: Uploading 191 files from PipelineOptions.filesToStage to staging location to prepare for execution.
Aug 13, 2021 12:44:19 PM org.apache.beam.runners.dataflow.util.PackageUtil stageClasspathElements
INFO: Staging files complete: 191 files cached, 0 files newly uploaded in 0 seconds
Aug 13, 2021 12:44:19 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Read input/DataflowRunner.StreamingUnboundedRead.ReadWithIds as step s1
Aug 13, 2021 12:44:19 PM org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource split
INFO: Split into 20 bundles of sizes: [org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@6342d610, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@dc4a691, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@784abd3e, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@36c2b646, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@434514d8, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@6b1dc20f, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@4613311f, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@6540cf1d, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@ec8f4b9, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@bc042d5, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@5484117b, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@37df14d1, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@7efb53af, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@7724704f, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@3dfa819, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@4ce94d2f, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@68ab0936, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@3cd9aa64, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@42b84286, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@443effcb]
Aug 13, 2021 12:44:19 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Read input/StripIds as step s2
Aug 13, 2021 12:44:19 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding ParDo(TimeMonitor) as step s3
Aug 13, 2021 12:44:19 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding ParDo(ByteMonitor) as step s4
Aug 13, 2021 12:44:19 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 0 as step s5
Aug 13, 2021 12:44:19 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 1 as step s6
Aug 13, 2021 12:44:19 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 2 as step s7
Aug 13, 2021 12:44:19 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 3 as step s8
Aug 13, 2021 12:44:19 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 4 as step s9
Aug 13, 2021 12:44:19 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 5 as step s10
Aug 13, 2021 12:44:19 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 6 as step s11
Aug 13, 2021 12:44:19 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 7 as step s12
Aug 13, 2021 12:44:19 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 8 as step s13
Aug 13, 2021 12:44:19 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 9 as step s14
Aug 13, 2021 12:44:19 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding ParDo(TimeMonitor)2 as step s15
Aug 13, 2021 12:44:19 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Dataflow SDK version: 2.33.0-SNAPSHOT
Aug 13, 2021 12:44:20 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobs/us-central1/2021-08-13_05_44_19-1711227200837009647?project=apache-beam-testing
Aug 13, 2021 12:44:20 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Submitted job: 2021-08-13_05_44_19-1711227200837009647
Aug 13, 2021 12:44:20 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2021-08-13_05_44_19-1711227200837009647
Aug 13, 2021 12:44:29 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-08-13T12:44:29.644Z: The workflow name is not a valid Cloud Label. Labels applied to Cloud resources (such as GCE Instances) for monitoring will be labeled with this modified job name: load0tests0java110dataflow0v20streaming0pardo01-jenkins-08-ijy5. For the best monitoring experience, please name your job with a valid Cloud Label. For details, see: https://cloud.google.com/compute/docs/labeling-resources#restrictions
Aug 13, 2021 12:44:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-13T12:44:34.534Z: Worker configuration: e2-standard-2 in us-central1-a.
Aug 13, 2021 12:44:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-13T12:44:35.364Z: Expanding SplittableParDo operations into optimizable parts.
Aug 13, 2021 12:44:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-13T12:44:35.391Z: Expanding CollectionToSingleton operations into optimizable parts.
Aug 13, 2021 12:44:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-13T12:44:35.449Z: Expanding CoGroupByKey operations into optimizable parts.
Aug 13, 2021 12:44:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-13T12:44:35.479Z: Expanding SplittableProcessKeyed operations into optimizable parts.
Aug 13, 2021 12:44:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-13T12:44:35.497Z: Expanding GroupByKey operations into streaming Read/Write steps
Aug 13, 2021 12:44:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-13T12:44:35.519Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
Aug 13, 2021 12:44:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-13T12:44:35.579Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
Aug 13, 2021 12:44:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-13T12:44:35.608Z: Fusing consumer Read input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource) into Read input/Impulse
Aug 13, 2021 12:44:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-13T12:44:35.637Z: Fusing consumer Read-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/PairWithRestriction into Read input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource)
Aug 13, 2021 12:44:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-13T12:44:35.665Z: Fusing consumer Read-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/SplitWithSizing into Read-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/PairWithRestriction
Aug 13, 2021 12:44:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-13T12:44:35.691Z: Fusing consumer Read input/ParDo(StripIds)/ParMultiDo(StripIds) into Read-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/ProcessElementAndRestrictionWithSizing
Aug 13, 2021 12:44:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-13T12:44:35.734Z: Fusing consumer ParDo(TimeMonitor)/ParMultiDo(TimeMonitor) into Read input/ParDo(StripIds)/ParMultiDo(StripIds)
Aug 13, 2021 12:44:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-13T12:44:35.768Z: Fusing consumer ParDo(ByteMonitor)/ParMultiDo(ByteMonitor) into ParDo(TimeMonitor)/ParMultiDo(TimeMonitor)
Aug 13, 2021 12:44:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-13T12:44:35.793Z: Fusing consumer Step: 0/ParMultiDo(CounterOperation) into ParDo(ByteMonitor)/ParMultiDo(ByteMonitor)
Aug 13, 2021 12:44:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-13T12:44:35.824Z: Fusing consumer Step: 1/ParMultiDo(CounterOperation) into Step: 0/ParMultiDo(CounterOperation)
Aug 13, 2021 12:44:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-13T12:44:35.853Z: Fusing consumer Step: 2/ParMultiDo(CounterOperation) into Step: 1/ParMultiDo(CounterOperation)
Aug 13, 2021 12:44:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-13T12:44:35.876Z: Fusing consumer Step: 3/ParMultiDo(CounterOperation) into Step: 2/ParMultiDo(CounterOperation)
Aug 13, 2021 12:44:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-13T12:44:35.902Z: Fusing consumer Step: 4/ParMultiDo(CounterOperation) into Step: 3/ParMultiDo(CounterOperation)
Aug 13, 2021 12:44:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-13T12:44:35.936Z: Fusing consumer Step: 5/ParMultiDo(CounterOperation) into Step: 4/ParMultiDo(CounterOperation)
Aug 13, 2021 12:44:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-13T12:44:36.009Z: Fusing consumer Step: 6/ParMultiDo(CounterOperation) into Step: 5/ParMultiDo(CounterOperation)
Aug 13, 2021 12:44:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-13T12:44:36.036Z: Fusing consumer Step: 7/ParMultiDo(CounterOperation) into Step: 6/ParMultiDo(CounterOperation)
Aug 13, 2021 12:44:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-13T12:44:36.058Z: Fusing consumer Step: 8/ParMultiDo(CounterOperation) into Step: 7/ParMultiDo(CounterOperation)
Aug 13, 2021 12:44:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-13T12:44:36.082Z: Fusing consumer Step: 9/ParMultiDo(CounterOperation) into Step: 8/ParMultiDo(CounterOperation)
Aug 13, 2021 12:44:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-13T12:44:36.115Z: Fusing consumer ParDo(TimeMonitor)2/ParMultiDo(TimeMonitor) into Step: 9/ParMultiDo(CounterOperation)
Aug 13, 2021 12:44:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-13T12:44:36.413Z: Starting 5 ****s in us-central1-a...
Aug 13, 2021 12:44:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-13T12:44:51.600Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete
Aug 13, 2021 12:45:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-13T12:45:26.820Z: Autoscaling: Raised the number of ****s to 5 so that the pipeline can catch up with its backlog and keep up with its input rate.
Aug 13, 2021 12:46:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-13T12:46:20.488Z: Workers have started successfully.
Aug 13, 2021 12:46:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-13T12:46:20.510Z: Workers have started successfully.
Aug 13, 2021 3:14:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-13T15:14:39.092Z: Staged package kafka-clients-2.4.1-or4Vrm01S3aXE64MuzGE8iWqFvyYIFseskr9n8KjYNk.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/kafka-clients-2.4.1-or4Vrm01S3aXE64MuzGE8iWqFvyYIFseskr9n8KjYNk.jar' is inaccessible.
Aug 13, 2021 3:14:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-13T15:14:39.212Z: Staged package lz4-java-1.6.0-0ilUWqKx1SA8h2YUvbz_yswwNpf0-PJvdk4dbB7S5BY.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/lz4-java-1.6.0-0ilUWqKx1SA8h2YUvbz_yswwNpf0-PJvdk4dbB7S5BY.jar' is inaccessible.
Aug 13, 2021 3:14:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-08-13T15:14:40.066Z: One or more access checks for temp location or staged files failed. Please refer to other error messages for details. For more information on security and permissions, please see https://cloud.google.com/dataflow/security-and-permissions.
Aug 13, 2021 3:17:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-08-13T15:17:40.538Z: One or more access checks for temp location or staged files failed. Please refer to other error messages for details. For more information on security and permissions, please see https://cloud.google.com/dataflow/security-and-permissions.
Aug 13, 2021 3:20:40 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-13T15:20:40.176Z: Staged package kafka-clients-2.4.1-or4Vrm01S3aXE64MuzGE8iWqFvyYIFseskr9n8KjYNk.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/kafka-clients-2.4.1-or4Vrm01S3aXE64MuzGE8iWqFvyYIFseskr9n8KjYNk.jar' is inaccessible.
Aug 13, 2021 3:20:40 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-13T15:20:40.320Z: Staged package lz4-java-1.6.0-0ilUWqKx1SA8h2YUvbz_yswwNpf0-PJvdk4dbB7S5BY.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/lz4-java-1.6.0-0ilUWqKx1SA8h2YUvbz_yswwNpf0-PJvdk4dbB7S5BY.jar' is inaccessible.
Aug 13, 2021 3:20:43 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-08-13T15:20:41.464Z: One or more access checks for temp location or staged files failed. Please refer to other error messages for details. For more information on security and permissions, please see https://cloud.google.com/dataflow/security-and-permissions.
Aug 13, 2021 3:23:43 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-08-13T15:23:40.989Z: One or more access checks for temp location or staged files failed. Please refer to other error messages for details. For more information on security and permissions, please see https://cloud.google.com/dataflow/security-and-permissions.
Aug 13, 2021 3:26:40 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-13T15:26:39.418Z: Staged package kafka-clients-2.4.1-or4Vrm01S3aXE64MuzGE8iWqFvyYIFseskr9n8KjYNk.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/kafka-clients-2.4.1-or4Vrm01S3aXE64MuzGE8iWqFvyYIFseskr9n8KjYNk.jar' is inaccessible.
Aug 13, 2021 3:26:40 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-13T15:26:39.567Z: Staged package lz4-java-1.6.0-0ilUWqKx1SA8h2YUvbz_yswwNpf0-PJvdk4dbB7S5BY.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/lz4-java-1.6.0-0ilUWqKx1SA8h2YUvbz_yswwNpf0-PJvdk4dbB7S5BY.jar' is inaccessible.
Aug 13, 2021 3:26:40 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-08-13T15:26:40.629Z: One or more access checks for temp location or staged files failed. Please refer to other error messages for details. For more information on security and permissions, please see https://cloud.google.com/dataflow/security-and-permissions.
Aug 13, 2021 3:29:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-08-13T15:29:41.939Z: One or more access checks for temp location or staged files failed. Please refer to other error messages for details. For more information on security and permissions, please see https://cloud.google.com/dataflow/security-and-permissions.
Aug 13, 2021 3:32:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-13T15:32:39.742Z: Staged package kafka-clients-2.4.1-or4Vrm01S3aXE64MuzGE8iWqFvyYIFseskr9n8KjYNk.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/kafka-clients-2.4.1-or4Vrm01S3aXE64MuzGE8iWqFvyYIFseskr9n8KjYNk.jar' is inaccessible.
Aug 13, 2021 3:32:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-13T15:32:39.837Z: Staged package lz4-java-1.6.0-0ilUWqKx1SA8h2YUvbz_yswwNpf0-PJvdk4dbB7S5BY.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/lz4-java-1.6.0-0ilUWqKx1SA8h2YUvbz_yswwNpf0-PJvdk4dbB7S5BY.jar' is inaccessible.
Aug 13, 2021 3:32:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-08-13T15:32:40.930Z: One or more access checks for temp location or staged files failed. Please refer to other error messages for details. For more information on security and permissions, please see https://cloud.google.com/dataflow/security-and-permissions.
Aug 13, 2021 3:35:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-08-13T15:35:41.160Z: One or more access checks for temp location or staged files failed. Please refer to other error messages for details. For more information on security and permissions, please see https://cloud.google.com/dataflow/security-and-permissions.
Aug 13, 2021 3:38:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-13T15:38:39.381Z: Staged package kafka-clients-2.4.1-or4Vrm01S3aXE64MuzGE8iWqFvyYIFseskr9n8KjYNk.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/kafka-clients-2.4.1-or4Vrm01S3aXE64MuzGE8iWqFvyYIFseskr9n8KjYNk.jar' is inaccessible.
Aug 13, 2021 3:38:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-13T15:38:39.468Z: Staged package lz4-java-1.6.0-0ilUWqKx1SA8h2YUvbz_yswwNpf0-PJvdk4dbB7S5BY.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/lz4-java-1.6.0-0ilUWqKx1SA8h2YUvbz_yswwNpf0-PJvdk4dbB7S5BY.jar' is inaccessible.
Aug 13, 2021 3:38:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-08-13T15:38:40.401Z: One or more access checks for temp location or staged files failed. Please refer to other error messages for details. For more information on security and permissions, please see https://cloud.google.com/dataflow/security-and-permissions.
Aug 13, 2021 3:41:43 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-08-13T15:41:41.174Z: One or more access checks for temp location or staged files failed. Please refer to other error messages for details. For more information on security and permissions, please see https://cloud.google.com/dataflow/security-and-permissions.
Aug 13, 2021 3:44:40 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-13T15:44:39.559Z: Staged package kafka-clients-2.4.1-or4Vrm01S3aXE64MuzGE8iWqFvyYIFseskr9n8KjYNk.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/kafka-clients-2.4.1-or4Vrm01S3aXE64MuzGE8iWqFvyYIFseskr9n8KjYNk.jar' is inaccessible.
Aug 13, 2021 3:44:40 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-13T15:44:39.658Z: Staged package lz4-java-1.6.0-0ilUWqKx1SA8h2YUvbz_yswwNpf0-PJvdk4dbB7S5BY.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/lz4-java-1.6.0-0ilUWqKx1SA8h2YUvbz_yswwNpf0-PJvdk4dbB7S5BY.jar' is inaccessible.
Aug 13, 2021 3:44:40 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-08-13T15:44:40.641Z: One or more access checks for temp location or staged files failed. Please refer to other error messages for details. For more information on security and permissions, please see https://cloud.google.com/dataflow/security-and-permissions.
Aug 13, 2021 3:47:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-08-13T15:47:40.650Z: One or more access checks for temp location or staged files failed. Please refer to other error messages for details. For more information on security and permissions, please see https://cloud.google.com/dataflow/security-and-permissions.
Aug 13, 2021 3:50:40 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-13T15:50:39.519Z: Staged package kafka-clients-2.4.1-or4Vrm01S3aXE64MuzGE8iWqFvyYIFseskr9n8KjYNk.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/kafka-clients-2.4.1-or4Vrm01S3aXE64MuzGE8iWqFvyYIFseskr9n8KjYNk.jar' is inaccessible.
Aug 13, 2021 3:50:40 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-13T15:50:39.807Z: Staged package lz4-java-1.6.0-0ilUWqKx1SA8h2YUvbz_yswwNpf0-PJvdk4dbB7S5BY.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/lz4-java-1.6.0-0ilUWqKx1SA8h2YUvbz_yswwNpf0-PJvdk4dbB7S5BY.jar' is inaccessible.
Aug 13, 2021 3:50:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-08-13T15:50:40.999Z: One or more access checks for temp location or staged files failed. Please refer to other error messages for details. For more information on security and permissions, please see https://cloud.google.com/dataflow/security-and-permissions.
Aug 13, 2021 3:53:40 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-08-13T15:53:40.705Z: One or more access checks for temp location or staged files failed. Please refer to other error messages for details. For more information on security and permissions, please see https://cloud.google.com/dataflow/security-and-permissions.
Aug 13, 2021 3:56:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-13T15:56:39.490Z: Staged package kafka-clients-2.4.1-or4Vrm01S3aXE64MuzGE8iWqFvyYIFseskr9n8KjYNk.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/kafka-clients-2.4.1-or4Vrm01S3aXE64MuzGE8iWqFvyYIFseskr9n8KjYNk.jar' is inaccessible.
Aug 13, 2021 3:56:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-13T15:56:39.585Z: Staged package lz4-java-1.6.0-0ilUWqKx1SA8h2YUvbz_yswwNpf0-PJvdk4dbB7S5BY.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/lz4-java-1.6.0-0ilUWqKx1SA8h2YUvbz_yswwNpf0-PJvdk4dbB7S5BY.jar' is inaccessible.
Aug 13, 2021 3:56:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-08-13T15:56:40.618Z: One or more access checks for temp location or staged files failed. Please refer to other error messages for details. For more information on security and permissions, please see https://cloud.google.com/dataflow/security-and-permissions.
Aug 13, 2021 3:59:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-08-13T15:59:40.779Z: One or more access checks for temp location or staged files failed. Please refer to other error messages for details. For more information on security and permissions, please see https://cloud.google.com/dataflow/security-and-permissions.
Aug 13, 2021 4:00:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-13T16:00:38.241Z: Cancel request is committed for workflow job: 2021-08-13_05_44_19-1711227200837009647.
Aug 13, 2021 4:00:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-13T16:00:38.382Z: Cleaning up.
Aug 13, 2021 4:00:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-13T16:00:38.741Z: Stopping **** pool...
Aug 13, 2021 4:00:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-13T16:00:38.877Z: Stopping **** pool...
Aug 13, 2021 4:03:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-13T16:02:59.920Z: Autoscaling: Reduced the number of ****s to 0 based on low average **** CPU utilization, and the pipeline having sufficiently low backlog and keeping up with input rate.
Aug 13, 2021 4:03:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-13T16:03:00.019Z: Worker pool stopped.
Aug 13, 2021 4:03:07 PM org.apache.beam.runners.dataflow.DataflowPipelineJob logTerminalState
INFO: Job 2021-08-13_05_44_19-1711227200837009647 finished with status CANCELLED.
Aug 13, 2021 4:03:07 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric totalBytes.count, from namespace pardo
Exception in thread "main" java.lang.RuntimeException: Invalid job state: CANCELLED.
at org.apache.beam.sdk.loadtests.JobFailure.handleFailure(JobFailure.java:55)
at org.apache.beam.sdk.loadtests.LoadTest.run(LoadTest.java:141)
at org.apache.beam.sdk.loadtests.ParDoLoadTest.run(ParDoLoadTest.java:53)
at org.apache.beam.sdk.loadtests.ParDoLoadTest.main(ParDoLoadTest.java:103)
> Task :sdks:java:testing:load-tests:run FAILED
> Task :runners:google-cloud-dataflow-java:cleanUpDockerImages
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210813123736]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:d1bc0cf8732771f6f93929932d1c16855bdf5a3d5adf8c4eadb089ab88939c03]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210813123736] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:d1bc0cf8732771f6f93929932d1c16855bdf5a3d5adf8c4eadb089ab88939c03])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:d1bc0cf8732771f6f93929932d1c16855bdf5a3d5adf8c4eadb089ab88939c03
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:d1bc0cf8732771f6f93929932d1c16855bdf5a3d5adf8c4eadb089ab88939c03].
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:testing:load-tests:run'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 3h 25m 50s
107 actionable tasks: 76 executed, 29 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/adnnir5yixwf6
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins:
beam_LoadTests_Java_ParDo_Dataflow_V2_Streaming_Java11 #56
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Java_ParDo_Dataflow_V2_Streaming_Java11/56/display/redirect?page=changes>
Changes:
[marwant] Move misplaced cloud healthcare update info line from template to
[Robert Burke] [BEAM-12738][GoSDK] Fix Dataflow Job URL
[eugene.nikolayev] Fix docs typos in contrib guide.
[noreply] Merge pull request #15126 from [BEAM-12665] Add option in ReadAll
[noreply] Update ptransform.py error message (#15286)
[noreply] [GoSDK Infra] Limit simultaneous tests binaries to 3. (#15321)
------------------------------------------
[...truncated 65.83 KB...]
008922c255cd: Waiting
4b0edb23340c: Preparing
afa3e488a0ee: Preparing
f3d5b8f65132: Waiting
f42aed5f7feb: Waiting
89819bafde36: Waiting
71504cda80c5: Waiting
ad83f0aa5c0a: Waiting
afa3e488a0ee: Waiting
4b0edb23340c: Waiting
5a9a65095453: Waiting
842116369cd6: Pushed
15b842bf1de0: Pushed
4323b1d63813: Pushed
cd7a039ad97e: Pushed
cbf9f95c5490: Pushed
f6e115dc6bf5: Pushed
008922c255cd: Pushed
1cba0d3e128c: Pushed
f42aed5f7feb: Layer already exists
89819bafde36: Layer already exists
f3d5b8f65132: Layer already exists
ad83f0aa5c0a: Layer already exists
5a9a65095453: Layer already exists
4b0edb23340c: Layer already exists
afa3e488a0ee: Layer already exists
c0a1967c1b4e: Pushed
97951656bb45: Pushed
71504cda80c5: Pushed
48133c4c16b9: Pushed
20210812123735: digest: sha256:4712c423ac762676f069194c763e83a30420ea4fcb363570c7692bea2079ab10 size: 4310
> Task :sdks:java:testing:load-tests:run
Aug 12, 2021 12:43:07 PM org.apache.beam.runners.dataflow.options.DataflowPipelineOptions$StagingLocationFactory create
INFO: No stagingLocation provided, falling back to gcpTempLocation
Aug 12, 2021 12:43:08 PM org.apache.beam.runners.dataflow.DataflowRunner fromOptions
INFO: PipelineOptions.filesToStage was not specified. Defaulting to files from the classpath: will stage 191 files. Enable logging at DEBUG level to see which files will be staged.
Aug 12, 2021 12:43:09 PM org.apache.beam.sdk.Pipeline validate
WARNING: The following transforms do not have stable unique names: ParDo(TimeMonitor)
Aug 12, 2021 12:43:09 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Executing pipeline on the Dataflow Service, which will have billing implications related to Google Compute Engine usage and other Google Cloud Services.
Aug 12, 2021 12:43:12 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging portable pipeline proto to gs://temp-storage-for-perf-tests/loadtests/staging/
Aug 12, 2021 12:43:12 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <107841 bytes, hash a38347c75ef79bab1db0f34dce3bf61cb614cca07bdb64d2a68224083ad6322d> to gs://temp-storage-for-perf-tests/loadtests/staging/pipeline-o4NHx173m6sdsPNNzjv2HLYUzKB722TSpoIkCDrWMi0.pb
Aug 12, 2021 12:43:13 PM org.apache.beam.runners.dataflow.util.PackageUtil stageClasspathElements
INFO: Uploading 191 files from PipelineOptions.filesToStage to staging location to prepare for execution.
Aug 12, 2021 12:43:14 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.m2/repository/org/apache/beam/beam-vendor-grpc-1_36_0/0.2/beam-vendor-grpc-1_36_0-0.2.jar to gs://temp-storage-for-perf-tests/loadtests/staging/beam-vendor-grpc-1_36_0-0.2-QDXCYeHsqkBGDv-Ml75SymJ1DE5cLzG9SsQs9d3GLOE.jar
Aug 12, 2021 12:43:15 PM org.apache.beam.runners.dataflow.util.PackageUtil stageClasspathElements
INFO: Staging files complete: 190 files cached, 1 files newly uploaded in 1 seconds
Aug 12, 2021 12:43:15 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Read input/DataflowRunner.StreamingUnboundedRead.ReadWithIds as step s1
Aug 12, 2021 12:43:15 PM org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource split
INFO: Split into 20 bundles of sizes: [org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@6342d610, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@dc4a691, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@784abd3e, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@36c2b646, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@434514d8, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@6b1dc20f, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@4613311f, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@6540cf1d, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@ec8f4b9, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@bc042d5, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@5484117b, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@37df14d1, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@7efb53af, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@7724704f, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@3dfa819, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@4ce94d2f, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@68ab0936, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@3cd9aa64, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@42b84286, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@443effcb]
Aug 12, 2021 12:43:15 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Read input/StripIds as step s2
Aug 12, 2021 12:43:15 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding ParDo(TimeMonitor) as step s3
Aug 12, 2021 12:43:15 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding ParDo(ByteMonitor) as step s4
Aug 12, 2021 12:43:15 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 0 as step s5
Aug 12, 2021 12:43:15 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 1 as step s6
Aug 12, 2021 12:43:15 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 2 as step s7
Aug 12, 2021 12:43:15 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 3 as step s8
Aug 12, 2021 12:43:15 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 4 as step s9
Aug 12, 2021 12:43:15 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 5 as step s10
Aug 12, 2021 12:43:15 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 6 as step s11
Aug 12, 2021 12:43:15 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 7 as step s12
Aug 12, 2021 12:43:15 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 8 as step s13
Aug 12, 2021 12:43:15 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 9 as step s14
Aug 12, 2021 12:43:15 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding ParDo(TimeMonitor)2 as step s15
Aug 12, 2021 12:43:15 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Dataflow SDK version: 2.33.0-SNAPSHOT
Aug 12, 2021 12:43:16 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobs/us-central1/2021-08-12_05_43_15-6974292229836451782?project=apache-beam-testing
Aug 12, 2021 12:43:16 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Submitted job: 2021-08-12_05_43_15-6974292229836451782
Aug 12, 2021 12:43:16 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2021-08-12_05_43_15-6974292229836451782
Aug 12, 2021 12:43:24 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-08-12T12:43:23.626Z: The workflow name is not a valid Cloud Label. Labels applied to Cloud resources (such as GCE Instances) for monitoring will be labeled with this modified job name: load0tests0java110dataflow0v20streaming0pardo01-jenkins-08-9867. For the best monitoring experience, please name your job with a valid Cloud Label. For details, see: https://cloud.google.com/compute/docs/labeling-resources#restrictions
Aug 12, 2021 12:43:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-12T12:43:28.220Z: Worker configuration: e2-standard-2 in us-central1-a.
Aug 12, 2021 12:43:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-12T12:43:28.936Z: Expanding SplittableParDo operations into optimizable parts.
Aug 12, 2021 12:43:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-12T12:43:28.974Z: Expanding CollectionToSingleton operations into optimizable parts.
Aug 12, 2021 12:43:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-12T12:43:29.033Z: Expanding CoGroupByKey operations into optimizable parts.
Aug 12, 2021 12:43:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-12T12:43:29.078Z: Expanding SplittableProcessKeyed operations into optimizable parts.
Aug 12, 2021 12:43:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-12T12:43:29.100Z: Expanding GroupByKey operations into streaming Read/Write steps
Aug 12, 2021 12:43:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-12T12:43:29.128Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
Aug 12, 2021 12:43:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-12T12:43:29.208Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
Aug 12, 2021 12:43:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-12T12:43:29.231Z: Fusing consumer Read input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource) into Read input/Impulse
Aug 12, 2021 12:43:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-12T12:43:29.268Z: Fusing consumer Read-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/PairWithRestriction into Read input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource)
Aug 12, 2021 12:43:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-12T12:43:29.293Z: Fusing consumer Read-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/SplitWithSizing into Read-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/PairWithRestriction
Aug 12, 2021 12:43:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-12T12:43:29.322Z: Fusing consumer Read input/ParDo(StripIds)/ParMultiDo(StripIds) into Read-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/ProcessElementAndRestrictionWithSizing
Aug 12, 2021 12:43:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-12T12:43:29.354Z: Fusing consumer ParDo(TimeMonitor)/ParMultiDo(TimeMonitor) into Read input/ParDo(StripIds)/ParMultiDo(StripIds)
Aug 12, 2021 12:43:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-12T12:43:29.382Z: Fusing consumer ParDo(ByteMonitor)/ParMultiDo(ByteMonitor) into ParDo(TimeMonitor)/ParMultiDo(TimeMonitor)
Aug 12, 2021 12:43:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-12T12:43:29.410Z: Fusing consumer Step: 0/ParMultiDo(CounterOperation) into ParDo(ByteMonitor)/ParMultiDo(ByteMonitor)
Aug 12, 2021 12:43:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-12T12:43:29.446Z: Fusing consumer Step: 1/ParMultiDo(CounterOperation) into Step: 0/ParMultiDo(CounterOperation)
Aug 12, 2021 12:43:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-12T12:43:29.477Z: Fusing consumer Step: 2/ParMultiDo(CounterOperation) into Step: 1/ParMultiDo(CounterOperation)
Aug 12, 2021 12:43:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-12T12:43:29.508Z: Fusing consumer Step: 3/ParMultiDo(CounterOperation) into Step: 2/ParMultiDo(CounterOperation)
Aug 12, 2021 12:43:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-12T12:43:29.542Z: Fusing consumer Step: 4/ParMultiDo(CounterOperation) into Step: 3/ParMultiDo(CounterOperation)
Aug 12, 2021 12:43:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-12T12:43:29.568Z: Fusing consumer Step: 5/ParMultiDo(CounterOperation) into Step: 4/ParMultiDo(CounterOperation)
Aug 12, 2021 12:43:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-12T12:43:29.602Z: Fusing consumer Step: 6/ParMultiDo(CounterOperation) into Step: 5/ParMultiDo(CounterOperation)
Aug 12, 2021 12:43:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-12T12:43:29.644Z: Fusing consumer Step: 7/ParMultiDo(CounterOperation) into Step: 6/ParMultiDo(CounterOperation)
Aug 12, 2021 12:43:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-12T12:43:29.672Z: Fusing consumer Step: 8/ParMultiDo(CounterOperation) into Step: 7/ParMultiDo(CounterOperation)
Aug 12, 2021 12:43:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-12T12:43:29.709Z: Fusing consumer Step: 9/ParMultiDo(CounterOperation) into Step: 8/ParMultiDo(CounterOperation)
Aug 12, 2021 12:43:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-12T12:43:29.731Z: Fusing consumer ParDo(TimeMonitor)2/ParMultiDo(TimeMonitor) into Step: 9/ParMultiDo(CounterOperation)
Aug 12, 2021 12:43:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-12T12:43:30.030Z: Starting 5 ****s in us-central1-a...
Aug 12, 2021 12:43:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-12T12:43:42.102Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete
Aug 12, 2021 12:44:15 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-12T12:44:15.016Z: Autoscaling: Raised the number of ****s to 5 so that the pipeline can catch up with its backlog and keep up with its input rate.
Aug 12, 2021 12:45:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-12T12:45:12.350Z: Workers have started successfully.
Aug 12, 2021 12:45:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-12T12:45:12.381Z: Workers have started successfully.
Aug 12, 2021 2:46:33 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-12T14:46:31.498Z: Staged package error_prone_annotations-2.3.4-uvfW6pfOYGxT4RtoVLpfLOfvXCTd3wr6GNEmC9JbACw.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/error_prone_annotations-2.3.4-uvfW6pfOYGxT4RtoVLpfLOfvXCTd3wr6GNEmC9JbACw.jar' is inaccessible.
Aug 12, 2021 2:46:35 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-08-12T14:46:34.704Z: One or more access checks for temp location or staged files failed. Please refer to other error messages for details. For more information on security and permissions, please see https://cloud.google.com/dataflow/security-and-permissions.
Aug 12, 2021 4:00:46 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-12T16:00:45.957Z: Cancel request is committed for workflow job: 2021-08-12_05_43_15-6974292229836451782.
Aug 12, 2021 4:00:46 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-12T16:00:45.997Z: Cleaning up.
Aug 12, 2021 4:00:46 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-12T16:00:46.066Z: Stopping **** pool...
Aug 12, 2021 4:00:46 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-12T16:00:46.107Z: Stopping **** pool...
Aug 12, 2021 4:03:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-12T16:03:13.176Z: Autoscaling: Reduced the number of ****s to 0 based on low average **** CPU utilization, and the pipeline having sufficiently low backlog and keeping up with input rate.
Aug 12, 2021 4:03:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-12T16:03:13.294Z: Worker pool stopped.
Aug 12, 2021 4:03:20 PM org.apache.beam.runners.dataflow.DataflowPipelineJob logTerminalState
INFO: Job 2021-08-12_05_43_15-6974292229836451782 finished with status CANCELLED.
Aug 12, 2021 4:03:20 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric totalBytes.count, from namespace pardo
Load test results for test (ID): 3bfb02c2-5de6-4ff3-bafc-8cd0a925f1bb and timestamp: 2021-08-12T12:43:08.695000000Z:
Metric: Value:
dataflow_v2_java11_runtime_sec 0.0
dataflow_v2_java11_total_bytes_count -1.0
Exception in thread "main" java.lang.RuntimeException: Invalid job state: CANCELLED.
at org.apache.beam.sdk.loadtests.JobFailure.handleFailure(JobFailure.java:55)
at org.apache.beam.sdk.loadtests.LoadTest.run(LoadTest.java:141)
at org.apache.beam.sdk.loadtests.ParDoLoadTest.run(ParDoLoadTest.java:53)
at org.apache.beam.sdk.loadtests.ParDoLoadTest.main(ParDoLoadTest.java:103)
> Task :sdks:java:testing:load-tests:run FAILED
> Task :runners:google-cloud-dataflow-java:cleanUpDockerImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210812123735
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:4712c423ac762676f069194c763e83a30420ea4fcb363570c7692bea2079ab10
Deleted: sha256:10da4a9f600a82ad3c9541e14c2c32039fcdcc04aa60bec6b66848fd58694631
Deleted: sha256:92b42e8c4277dbddc6cfb2c612351c36d51f195ae7532bd64498316559d23dde
Deleted: sha256:61b746048bf644e49690d42489ca8ce6408a5db55e927c1f671a82be6b14d087
Deleted: sha256:ca6b6e471b6133d8a4c9e62b7bd44e103bdd03bbfc83768b3d98bd169fea1f0b
Deleted: sha256:996fb0c971a457443afaee2f083962df5c88077cb660e7493b31c7fcfbe2da5f
Deleted: sha256:d7e688aed63580ea511e1f41f974a3c41c3217dd579649ffcb09ba034659750f
Deleted: sha256:d5f3ba1c18553abc9a76f2c392bbc4cd1b4e747e1e8074cf0419d9d243f52969
Deleted: sha256:551d82351b12f969f9822497d320e79724ff344324dcd7c83d001164104925eb
Deleted: sha256:b54f9e94e85cdc40acfc6bdf047103191e67307864223a78c0323aef89ac435f
Deleted: sha256:056fc42e3ae2328212de573b22ac50c74d25ae3f1de3f43a091a238beea0cef1
Deleted: sha256:c5cc93f6132514af240360fe9d17987b5f380fec4b9e85ecd264dd2cb083990a
Deleted: sha256:a69216f57b82e615d42a7a83a659a22ce6b167305744fa3b956502badd05f1af
Deleted: sha256:af1a7ac7e756c949ba4c87b2faf9c095fc5b1b9835747c23f17cac15219eb059
Deleted: sha256:0191e7dbfaf6f76af179bd1321158a23be3595bbbe80c1a1ed85d1eda9b5ac0b
Deleted: sha256:105451a729addb8003bfe00ad46e8d85a6b6e7a21097463194a733ede1ccdf94
Deleted: sha256:928a8dc0297fee39e12a820e557a99ebfb658d84740179097b983c2a9c21abb5
Deleted: sha256:caeaf7e6715af98450d38d5d744e101edfe950e4283e96d7802307c3582cdf2d
Deleted: sha256:16cf4bf5d78e2a8e0990f08df24b64476b7d011dde7d50ffa0350cee879f9b4d
Deleted: sha256:cbf15bf87d8c43f17f825542afc38925517f72479f8b74948f30c652df1fc5a6
Deleted: sha256:ebe5a62f4ea7f4c1341ce6633ede0cd2d7a1a5b6ba38f4370042ff6b26be526f
Deleted: sha256:6d11d2cbba3ebd27eaca779f4434e46c69b9840a3c9d19183f3f8643076bbac7
Deleted: sha256:7db1c508a5a915501b9410bd9d506f483c4905d02cb084ac94453b1681407075
Deleted: sha256:f73e04c3b7d11902ea881f657bfb1e195536b786d93a46ecf8768aba407ae5f3
Deleted: sha256:a5552412f960bb6145e72f744ed3e6c8ea4714f8c451041560d44c077326ad1e
Deleted: sha256:ba4b84a36da0ae9173ca57172cfd856a8245defb98459822fc78f549177bad91
Deleted: sha256:ece852423700cebdfb0758e13863622fc24785ff0f2d8ee785433c72bb203bba
Deleted: sha256:d9dfd0b91db4154b69220457cf0c6795926c186fc8da0840922d235ceaf411d3
Deleted: sha256:2a989a55e4fbed4c2c594c2cf3b498712528a04d31f7b7531a80c398be180f61
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210812123735]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:4712c423ac762676f069194c763e83a30420ea4fcb363570c7692bea2079ab10]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210812123735] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:4712c423ac762676f069194c763e83a30420ea4fcb363570c7692bea2079ab10])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:4712c423ac762676f069194c763e83a30420ea4fcb363570c7692bea2079ab10
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:4712c423ac762676f069194c763e83a30420ea4fcb363570c7692bea2079ab10
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:4712c423ac762676f069194c763e83a30420ea4fcb363570c7692bea2079ab10].
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:testing:load-tests:run'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 3h 26m 6s
107 actionable tasks: 76 executed, 29 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/ne5ysk3wcjq46
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins:
beam_LoadTests_Java_ParDo_Dataflow_V2_Streaming_Java11 #55
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Java_ParDo_Dataflow_V2_Streaming_Java11/55/display/redirect?page=changes>
Changes:
[andyxu] Add support for python sdk container to turn on google cloud profiler
[andyxu] format file
[marwant] Update Google Cloud Healthcare API version from v1beta1 to GA
[chamikaramj] Fix typo
[zyichi] Update beam dataflow python container versions.
[noreply] [BEAM-12403][BEAM-12348] Add User State Support for Portable SamzaRunner
------------------------------------------
[...truncated 68.75 KB...]
INFO: Executing pipeline on the Dataflow Service, which will have billing implications related to Google Compute Engine usage and other Google Cloud Services.
Aug 11, 2021 12:43:04 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging portable pipeline proto to gs://temp-storage-for-perf-tests/loadtests/staging/
Aug 11, 2021 12:43:04 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <107841 bytes, hash 01d84f7e5e8263bffe580e14fba687460077d953a582efe8ec6c696d40be7482> to gs://temp-storage-for-perf-tests/loadtests/staging/pipeline-AdhPfl6CY7_-WA4U-6aHRgB32VOlgu_o7GxpbUC-dII.pb
Aug 11, 2021 12:43:05 PM org.apache.beam.runners.dataflow.util.PackageUtil stageClasspathElements
INFO: Uploading 191 files from PipelineOptions.filesToStage to staging location to prepare for execution.
Aug 11, 2021 12:43:07 PM org.apache.beam.runners.dataflow.util.PackageUtil stageClasspathElements
INFO: Staging files complete: 191 files cached, 0 files newly uploaded in 2 seconds
Aug 11, 2021 12:43:07 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Read input/DataflowRunner.StreamingUnboundedRead.ReadWithIds as step s1
Aug 11, 2021 12:43:07 PM org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource split
INFO: Split into 20 bundles of sizes: [org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@6342d610, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@dc4a691, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@784abd3e, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@36c2b646, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@434514d8, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@6b1dc20f, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@4613311f, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@6540cf1d, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@ec8f4b9, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@bc042d5, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@5484117b, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@37df14d1, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@7efb53af, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@7724704f, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@3dfa819, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@4ce94d2f, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@68ab0936, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@3cd9aa64, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@42b84286, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@443effcb]
Aug 11, 2021 12:43:07 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Read input/StripIds as step s2
Aug 11, 2021 12:43:07 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding ParDo(TimeMonitor) as step s3
Aug 11, 2021 12:43:07 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding ParDo(ByteMonitor) as step s4
Aug 11, 2021 12:43:07 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 0 as step s5
Aug 11, 2021 12:43:07 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 1 as step s6
Aug 11, 2021 12:43:07 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 2 as step s7
Aug 11, 2021 12:43:07 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 3 as step s8
Aug 11, 2021 12:43:07 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 4 as step s9
Aug 11, 2021 12:43:07 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 5 as step s10
Aug 11, 2021 12:43:07 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 6 as step s11
Aug 11, 2021 12:43:07 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 7 as step s12
Aug 11, 2021 12:43:07 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 8 as step s13
Aug 11, 2021 12:43:07 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 9 as step s14
Aug 11, 2021 12:43:07 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding ParDo(TimeMonitor)2 as step s15
Aug 11, 2021 12:43:08 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Dataflow SDK version: 2.33.0-SNAPSHOT
Aug 11, 2021 12:43:08 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobs/us-central1/2021-08-11_05_43_08-16348139797564905653?project=apache-beam-testing
Aug 11, 2021 12:43:08 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Submitted job: 2021-08-11_05_43_08-16348139797564905653
Aug 11, 2021 12:43:08 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2021-08-11_05_43_08-16348139797564905653
Aug 11, 2021 12:43:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-08-11T12:43:16.997Z: The workflow name is not a valid Cloud Label. Labels applied to Cloud resources (such as GCE Instances) for monitoring will be labeled with this modified job name: load0tests0java110dataflow0v20streaming0pardo01-jenkins-08-yew8. For the best monitoring experience, please name your job with a valid Cloud Label. For details, see: https://cloud.google.com/compute/docs/labeling-resources#restrictions
Aug 11, 2021 12:43:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-11T12:43:22.531Z: Worker configuration: e2-standard-2 in us-central1-a.
Aug 11, 2021 12:43:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-11T12:43:23.329Z: Expanding SplittableParDo operations into optimizable parts.
Aug 11, 2021 12:43:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-11T12:43:23.359Z: Expanding CollectionToSingleton operations into optimizable parts.
Aug 11, 2021 12:43:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-11T12:43:23.412Z: Expanding CoGroupByKey operations into optimizable parts.
Aug 11, 2021 12:43:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-11T12:43:23.447Z: Expanding SplittableProcessKeyed operations into optimizable parts.
Aug 11, 2021 12:43:24 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-11T12:43:23.471Z: Expanding GroupByKey operations into streaming Read/Write steps
Aug 11, 2021 12:43:24 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-11T12:43:23.498Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
Aug 11, 2021 12:43:24 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-11T12:43:23.571Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
Aug 11, 2021 12:43:24 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-11T12:43:23.591Z: Fusing consumer Read input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource) into Read input/Impulse
Aug 11, 2021 12:43:24 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-11T12:43:23.614Z: Fusing consumer Read-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/PairWithRestriction into Read input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource)
Aug 11, 2021 12:43:24 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-11T12:43:23.638Z: Fusing consumer Read-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/SplitWithSizing into Read-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/PairWithRestriction
Aug 11, 2021 12:43:24 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-11T12:43:23.659Z: Fusing consumer Read input/ParDo(StripIds)/ParMultiDo(StripIds) into Read-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/ProcessElementAndRestrictionWithSizing
Aug 11, 2021 12:43:24 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-11T12:43:23.687Z: Fusing consumer ParDo(TimeMonitor)/ParMultiDo(TimeMonitor) into Read input/ParDo(StripIds)/ParMultiDo(StripIds)
Aug 11, 2021 12:43:24 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-11T12:43:23.718Z: Fusing consumer ParDo(ByteMonitor)/ParMultiDo(ByteMonitor) into ParDo(TimeMonitor)/ParMultiDo(TimeMonitor)
Aug 11, 2021 12:43:24 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-11T12:43:23.746Z: Fusing consumer Step: 0/ParMultiDo(CounterOperation) into ParDo(ByteMonitor)/ParMultiDo(ByteMonitor)
Aug 11, 2021 12:43:24 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-11T12:43:23.769Z: Fusing consumer Step: 1/ParMultiDo(CounterOperation) into Step: 0/ParMultiDo(CounterOperation)
Aug 11, 2021 12:43:24 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-11T12:43:23.790Z: Fusing consumer Step: 2/ParMultiDo(CounterOperation) into Step: 1/ParMultiDo(CounterOperation)
Aug 11, 2021 12:43:24 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-11T12:43:23.817Z: Fusing consumer Step: 3/ParMultiDo(CounterOperation) into Step: 2/ParMultiDo(CounterOperation)
Aug 11, 2021 12:43:24 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-11T12:43:23.839Z: Fusing consumer Step: 4/ParMultiDo(CounterOperation) into Step: 3/ParMultiDo(CounterOperation)
Aug 11, 2021 12:43:24 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-11T12:43:23.885Z: Fusing consumer Step: 5/ParMultiDo(CounterOperation) into Step: 4/ParMultiDo(CounterOperation)
Aug 11, 2021 12:43:24 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-11T12:43:23.912Z: Fusing consumer Step: 6/ParMultiDo(CounterOperation) into Step: 5/ParMultiDo(CounterOperation)
Aug 11, 2021 12:43:24 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-11T12:43:23.934Z: Fusing consumer Step: 7/ParMultiDo(CounterOperation) into Step: 6/ParMultiDo(CounterOperation)
Aug 11, 2021 12:43:24 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-11T12:43:23.968Z: Fusing consumer Step: 8/ParMultiDo(CounterOperation) into Step: 7/ParMultiDo(CounterOperation)
Aug 11, 2021 12:43:24 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-11T12:43:23.995Z: Fusing consumer Step: 9/ParMultiDo(CounterOperation) into Step: 8/ParMultiDo(CounterOperation)
Aug 11, 2021 12:43:24 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-11T12:43:24.017Z: Fusing consumer ParDo(TimeMonitor)2/ParMultiDo(TimeMonitor) into Step: 9/ParMultiDo(CounterOperation)
Aug 11, 2021 12:43:24 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-11T12:43:24.336Z: Starting 5 ****s in us-central1-a...
Aug 11, 2021 12:43:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-11T12:43:42.067Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete
Aug 11, 2021 12:44:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-11T12:44:11.577Z: Autoscaling: Raised the number of ****s to 5 so that the pipeline can catch up with its backlog and keep up with its input rate.
Aug 11, 2021 12:45:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-11T12:45:07.334Z: Workers have started successfully.
Aug 11, 2021 12:45:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-11T12:45:07.380Z: Workers have started successfully.
Aug 11, 2021 2:25:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-11T14:25:24.707Z: Staged package aws-java-sdk-cloudwatch-1.11.974-Ub2yicrz1p27ushPndFcVBigc3SuIZ4G-Yaq45B1iUo.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/aws-java-sdk-cloudwatch-1.11.974-Ub2yicrz1p27ushPndFcVBigc3SuIZ4G-Yaq45B1iUo.jar' is inaccessible.
Aug 11, 2021 2:25:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-11T14:25:24.799Z: Staged package aws-java-sdk-core-1.11.974-s3lPhICKsq1xExGOyj03VQHRqOsuX5YUc-UUlnhiA64.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/aws-java-sdk-core-1.11.974-s3lPhICKsq1xExGOyj03VQHRqOsuX5YUc-UUlnhiA64.jar' is inaccessible.
Aug 11, 2021 2:25:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-11T14:25:24.847Z: Staged package aws-java-sdk-dynamodb-1.11.974-RLvIDrX-TDIDN06gNnaHm9dQbuHCD_XSBesOuniSTk4.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/aws-java-sdk-dynamodb-1.11.974-RLvIDrX-TDIDN06gNnaHm9dQbuHCD_XSBesOuniSTk4.jar' is inaccessible.
Aug 11, 2021 2:25:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-11T14:25:24.890Z: Staged package aws-java-sdk-kinesis-1.11.974-kbU_CjbRpkrhhFeoyIMQA81nTYmniJY77w8Smd7PLpY.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/aws-java-sdk-kinesis-1.11.974-kbU_CjbRpkrhhFeoyIMQA81nTYmniJY77w8Smd7PLpY.jar' is inaccessible.
Aug 11, 2021 2:25:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-11T14:25:24.930Z: Staged package aws-java-sdk-kms-1.11.974-HWH_mHclw3Wv4_GJ56x62xFDHSPSkZWjeKAlx40XrTk.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/aws-java-sdk-kms-1.11.974-HWH_mHclw3Wv4_GJ56x62xFDHSPSkZWjeKAlx40XrTk.jar' is inaccessible.
Aug 11, 2021 2:25:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-11T14:25:24.983Z: Staged package aws-java-sdk-s3-1.11.974-Qgd0wgaOuI_uyxxQI4Ulljk9bZEq-3JZArQF0zU5yzA.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/aws-java-sdk-s3-1.11.974-Qgd0wgaOuI_uyxxQI4Ulljk9bZEq-3JZArQF0zU5yzA.jar' is inaccessible.
Aug 11, 2021 2:25:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-11T14:25:25.814Z: Staged package commons-io-2.6--HfTBGYKwqFC84ZbrfyXHex-1zx0fH-NXS9ROcpzZRM.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/commons-io-2.6--HfTBGYKwqFC84ZbrfyXHex-1zx0fH-NXS9ROcpzZRM.jar' is inaccessible.
Aug 11, 2021 2:25:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-11T14:25:25.854Z: Staged package commons-lang-2.6-UPEbCfh3wpTVbyRGP0fSj5Kc9QRPZIZhwPDPuumi9Jw.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/commons-lang-2.6-UPEbCfh3wpTVbyRGP0fSj5Kc9QRPZIZhwPDPuumi9Jw.jar' is inaccessible.
Aug 11, 2021 2:25:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-11T14:25:27.324Z: Staged package ion-java-1.0.2-DRJ7IFofzgq8KjdXoEF0hlG8ZsFc9MBZusWDOyfUcaU.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/ion-java-1.0.2-DRJ7IFofzgq8KjdXoEF0hlG8ZsFc9MBZusWDOyfUcaU.jar' is inaccessible.
Aug 11, 2021 2:25:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-11T14:25:27.575Z: Staged package jmespath-java-1.11.974-QaUt5Hnw6wd7ULTQ5Oj4j_zpRr-rnMCdfGwiwkSo8-0.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/jmespath-java-1.11.974-QaUt5Hnw6wd7ULTQ5Oj4j_zpRr-rnMCdfGwiwkSo8-0.jar' is inaccessible.
Aug 11, 2021 2:25:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-08-11T14:25:28.636Z: One or more access checks for temp location or staged files failed. Please refer to other error messages for details. For more information on security and permissions, please see https://cloud.google.com/dataflow/security-and-permissions.
Aug 11, 2021 2:28:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-08-11T14:28:28.544Z: One or more access checks for temp location or staged files failed. Please refer to other error messages for details. For more information on security and permissions, please see https://cloud.google.com/dataflow/security-and-permissions.
Aug 11, 2021 2:31:25 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-11T14:31:24.857Z: Staged package aws-java-sdk-cloudwatch-1.11.974-Ub2yicrz1p27ushPndFcVBigc3SuIZ4G-Yaq45B1iUo.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/aws-java-sdk-cloudwatch-1.11.974-Ub2yicrz1p27ushPndFcVBigc3SuIZ4G-Yaq45B1iUo.jar' is inaccessible.
Aug 11, 2021 2:31:25 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-11T14:31:24.934Z: Staged package aws-java-sdk-core-1.11.974-s3lPhICKsq1xExGOyj03VQHRqOsuX5YUc-UUlnhiA64.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/aws-java-sdk-core-1.11.974-s3lPhICKsq1xExGOyj03VQHRqOsuX5YUc-UUlnhiA64.jar' is inaccessible.
Aug 11, 2021 2:31:25 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-11T14:31:24.994Z: Staged package aws-java-sdk-dynamodb-1.11.974-RLvIDrX-TDIDN06gNnaHm9dQbuHCD_XSBesOuniSTk4.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/aws-java-sdk-dynamodb-1.11.974-RLvIDrX-TDIDN06gNnaHm9dQbuHCD_XSBesOuniSTk4.jar' is inaccessible.
Aug 11, 2021 2:31:25 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-11T14:31:25.061Z: Staged package aws-java-sdk-kinesis-1.11.974-kbU_CjbRpkrhhFeoyIMQA81nTYmniJY77w8Smd7PLpY.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/aws-java-sdk-kinesis-1.11.974-kbU_CjbRpkrhhFeoyIMQA81nTYmniJY77w8Smd7PLpY.jar' is inaccessible.
Aug 11, 2021 2:31:25 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-11T14:31:25.128Z: Staged package aws-java-sdk-kms-1.11.974-HWH_mHclw3Wv4_GJ56x62xFDHSPSkZWjeKAlx40XrTk.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/aws-java-sdk-kms-1.11.974-HWH_mHclw3Wv4_GJ56x62xFDHSPSkZWjeKAlx40XrTk.jar' is inaccessible.
Aug 11, 2021 2:31:25 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-11T14:31:25.183Z: Staged package aws-java-sdk-s3-1.11.974-Qgd0wgaOuI_uyxxQI4Ulljk9bZEq-3JZArQF0zU5yzA.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/aws-java-sdk-s3-1.11.974-Qgd0wgaOuI_uyxxQI4Ulljk9bZEq-3JZArQF0zU5yzA.jar' is inaccessible.
Aug 11, 2021 2:31:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-11T14:31:25.995Z: Staged package commons-io-2.6--HfTBGYKwqFC84ZbrfyXHex-1zx0fH-NXS9ROcpzZRM.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/commons-io-2.6--HfTBGYKwqFC84ZbrfyXHex-1zx0fH-NXS9ROcpzZRM.jar' is inaccessible.
Aug 11, 2021 2:31:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-11T14:31:26.041Z: Staged package commons-lang-2.6-UPEbCfh3wpTVbyRGP0fSj5Kc9QRPZIZhwPDPuumi9Jw.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/commons-lang-2.6-UPEbCfh3wpTVbyRGP0fSj5Kc9QRPZIZhwPDPuumi9Jw.jar' is inaccessible.
Aug 11, 2021 2:31:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-11T14:31:27.904Z: Staged package ion-java-1.0.2-DRJ7IFofzgq8KjdXoEF0hlG8ZsFc9MBZusWDOyfUcaU.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/ion-java-1.0.2-DRJ7IFofzgq8KjdXoEF0hlG8ZsFc9MBZusWDOyfUcaU.jar' is inaccessible.
Aug 11, 2021 2:31:29 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-11T14:31:28.207Z: Staged package jmespath-java-1.11.974-QaUt5Hnw6wd7ULTQ5Oj4j_zpRr-rnMCdfGwiwkSo8-0.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/jmespath-java-1.11.974-QaUt5Hnw6wd7ULTQ5Oj4j_zpRr-rnMCdfGwiwkSo8-0.jar' is inaccessible.
Aug 11, 2021 2:31:29 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-08-11T14:31:29.499Z: One or more access checks for temp location or staged files failed. Please refer to other error messages for details. For more information on security and permissions, please see https://cloud.google.com/dataflow/security-and-permissions.
Aug 11, 2021 4:00:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-11T16:00:44.128Z: Cancel request is committed for workflow job: 2021-08-11_05_43_08-16348139797564905653.
Aug 11, 2021 4:00:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-11T16:00:44.176Z: Cleaning up.
Aug 11, 2021 4:00:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-11T16:00:44.241Z: Stopping **** pool...
Aug 11, 2021 4:00:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-11T16:00:44.297Z: Stopping **** pool...
Aug 11, 2021 4:03:07 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-11T16:03:06.338Z: Autoscaling: Reduced the number of ****s to 0 based on low average **** CPU utilization, and the pipeline having sufficiently low backlog and keeping up with input rate.
Aug 11, 2021 4:03:07 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-11T16:03:06.381Z: Worker pool stopped.
Aug 11, 2021 4:03:13 PM org.apache.beam.runners.dataflow.DataflowPipelineJob logTerminalState
INFO: Job 2021-08-11_05_43_08-16348139797564905653 finished with status CANCELLED.
Aug 11, 2021 4:03:13 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric totalBytes.count, from namespace pardo
Load test results for test (ID): e44b22a8-573c-4b9c-bd48-a5a32b5c51f2 and timestamp: 2021-08-11T12:43:00.512000000Z:
Metric: Value:
dataflow_v2_java11_runtime_sec 0.0
dataflow_v2_java11_total_bytes_count -1.0
Exception in thread "main" java.lang.RuntimeException: Invalid job state: CANCELLED.
at org.apache.beam.sdk.loadtests.JobFailure.handleFailure(JobFailure.java:55)
at org.apache.beam.sdk.loadtests.LoadTest.run(LoadTest.java:141)
at org.apache.beam.sdk.loadtests.ParDoLoadTest.run(ParDoLoadTest.java:53)
at org.apache.beam.sdk.loadtests.ParDoLoadTest.main(ParDoLoadTest.java:103)
> Task :sdks:java:testing:load-tests:run FAILED
> Task :runners:google-cloud-dataflow-java:cleanUpDockerImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210811123735
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:b3e9b01b7e9f7a0a0103494426627606154ded3dcd26a926e87b1830cdf25981
Deleted: sha256:66c6627c55ba301e94ca741656548295090f3fab70862cc3b8273a54b39b7beb
Deleted: sha256:92c66b9ee7749f1a1c97d91cd75c4cde8cc374d5020c5346eb26f88cc2605736
Deleted: sha256:3a1b4e6dd5f7fee7577cdd4995e309a0b6cb6988e915f4488a99a72891f95085
Deleted: sha256:9b699c1e1347a4afa626171e3ff773054ecb6e2f8634229b50b48e0c12a9bbc0
Deleted: sha256:6382cd861933f91a82894c8273e68539c98e5fefeb55e96e4e942840a484f065
Deleted: sha256:808818194bff09d6e1d460f991cd9bb8778f7c75d594aa384e944ca8f6a8984b
Deleted: sha256:c408e9c6d281c78f9d30e0516031964427f60aaef3bda1c7cd35ab62e4c6269d
Deleted: sha256:6c424a318c0ab8cad53ab4b040d562b701ffc7b34d4c18499584fc62774db9cf
Deleted: sha256:2967bbc7b15237f9f5ceb133602bac796f8b89a2cffa2d1f7dad933d820f5bc4
Deleted: sha256:d58e51fc13b24ec8750d6c5dcb57a9c7a7f35438240dc15a8aaffed563890762
Deleted: sha256:262097195bd44f26da35efbc0849e6e0d21493c771efc83eb6607cf62591cd04
Deleted: sha256:0a12a61ed3617dcf12c911e6903ca04b384491f0aeca02bee9cc1be89472167c
Deleted: sha256:51e5632ec08fdfd276acc6ca217914694a1480a82bf21dad0b5c56eddee17543
Deleted: sha256:966114a541fde11dc31d3c2ef7893dad4a2b7e9bd394aac93743596e4287a687
Deleted: sha256:a5c70c5b0e5c7d83c6c93c8f1dc0a486a2be0547f92f3822c37f74d4e2695b77
Deleted: sha256:b148b2096c5b8d92bbdc192f0a0493d938c9d1e65812b68a966f1bc1fcb6c807
Deleted: sha256:b31f92e22d28bdcf3e408cb933f02d8c903f7ae6bfc140d8fbfeda03296a47dc
Deleted: sha256:f766133d23897123a9c1c0bbe581cbc6c9cb4c89333762a1800bfcb0a7d89b9e
Deleted: sha256:be0701f41c56bcd3febff41895bbeba2d5ede67a368a1cb98c8cd570a21b3f5d
Deleted: sha256:80449b2c23bf830bb82d363b235c3be963d8a6f609a6fc1d2ecd070f4536f155
Deleted: sha256:fdcda69db5af937de5f5d7de572ca6832d519bd36efaa60b76d93c1a05e1a9f5
Deleted: sha256:f8193691aea946fc19440044b90c8503d73aa52247a502002a0276e9c74e0e65
Deleted: sha256:cd0a4e67aaaa7e8715bc0e1d5defab74cdf59f382939937a099dc11297c238da
Deleted: sha256:8d5bb0b0fc1a195145301f8c99891db73836a9521c0f01f055ed6844c78cde56
Deleted: sha256:f24cfb0265722a048f7d2b2b06001bf842fa921c4112c6f51627841f149a1ea5
Deleted: sha256:ede3add900e115ab2f4d5dd4cb6fa8b54b9877c10881e5c5c99c4daaa0ea1c82
Deleted: sha256:88e3ee0ecc14dc594c337eb1c44ee0d66b030ec74f1d159dde2ec0d50347cceb
Deleted: sha256:03ac0b20c60f37fca69e5395104ec05650bc5edbe4560c5f548b0a000d32523d
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210811123735]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:b3e9b01b7e9f7a0a0103494426627606154ded3dcd26a926e87b1830cdf25981]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210811123735] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:b3e9b01b7e9f7a0a0103494426627606154ded3dcd26a926e87b1830cdf25981])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:b3e9b01b7e9f7a0a0103494426627606154ded3dcd26a926e87b1830cdf25981
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:b3e9b01b7e9f7a0a0103494426627606154ded3dcd26a926e87b1830cdf25981
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:b3e9b01b7e9f7a0a0103494426627606154ded3dcd26a926e87b1830cdf25981].
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:testing:load-tests:run'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 3h 25m 57s
107 actionable tasks: 79 executed, 26 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/ybvnmxrb6ausg
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins:
beam_LoadTests_Java_ParDo_Dataflow_V2_Streaming_Java11 #54
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Java_ParDo_Dataflow_V2_Streaming_Java11/54/display/redirect?page=changes>
Changes:
[heejong] [BEAM-12716] Update XLang Kafka taxi example to use BigQuery sink
[noreply] Merge pull request #15298 from [BEAM-12729] Suppress Avro Runtime
[heejong] add comment
[noreply] Refactor _RemoveDuplicates to use counter state (#15242)
------------------------------------------
[...truncated 67.40 KB...]
f3d5b8f65132: Preparing
ad83f0aa5c0a: Preparing
5a9a65095453: Preparing
4b0edb23340c: Preparing
afa3e488a0ee: Preparing
369f39df5c35: Waiting
6e843723294b: Waiting
f42aed5f7feb: Waiting
ad83f0aa5c0a: Waiting
46853327f1f4: Waiting
89819bafde36: Waiting
fbb29adc0725: Waiting
2b80fd633bcd: Waiting
5a9a65095453: Waiting
4b90654ecd31: Waiting
f3d5b8f65132: Waiting
afa3e488a0ee: Waiting
8bff3a95207a: Pushed
590dda0c6066: Pushed
f7e161b5fb4f: Pushed
11d21f68310d: Pushed
db7f7670f963: Pushed
fbb29adc0725: Pushed
6e843723294b: Pushed
369f39df5c35: Pushed
f42aed5f7feb: Layer already exists
89819bafde36: Layer already exists
f3d5b8f65132: Layer already exists
ad83f0aa5c0a: Layer already exists
5a9a65095453: Layer already exists
4b0edb23340c: Layer already exists
afa3e488a0ee: Layer already exists
46853327f1f4: Pushed
4b90654ecd31: Pushed
2b80fd633bcd: Pushed
091014b933eb: Pushed
20210810123753: digest: sha256:a1ad33643b5ff2505449bc7a019587a04f3a1c8bab6267ad3716f97a5c1bd046 size: 4310
> Task :sdks:java:testing:load-tests:run
Aug 10, 2021 12:42:58 PM org.apache.beam.runners.dataflow.options.DataflowPipelineOptions$StagingLocationFactory create
INFO: No stagingLocation provided, falling back to gcpTempLocation
Aug 10, 2021 12:42:58 PM org.apache.beam.runners.dataflow.DataflowRunner fromOptions
INFO: PipelineOptions.filesToStage was not specified. Defaulting to files from the classpath: will stage 191 files. Enable logging at DEBUG level to see which files will be staged.
Aug 10, 2021 12:42:59 PM org.apache.beam.sdk.Pipeline validate
WARNING: The following transforms do not have stable unique names: ParDo(TimeMonitor)
Aug 10, 2021 12:42:59 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Executing pipeline on the Dataflow Service, which will have billing implications related to Google Compute Engine usage and other Google Cloud Services.
Aug 10, 2021 12:43:02 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging portable pipeline proto to gs://temp-storage-for-perf-tests/loadtests/staging/
Aug 10, 2021 12:43:02 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <107856 bytes, hash 76a67524ac4571381af97fa16b159b5d4b152783cf8fed8c71e8ec61001e9eaa> to gs://temp-storage-for-perf-tests/loadtests/staging/pipeline-dqZ1JKxFcTga-X-haxWbXUsVJ4PPj-2McejsYQAenqo.pb
Aug 10, 2021 12:43:03 PM org.apache.beam.runners.dataflow.util.PackageUtil stageClasspathElements
INFO: Uploading 191 files from PipelineOptions.filesToStage to staging location to prepare for execution.
Aug 10, 2021 12:43:04 PM org.apache.beam.runners.dataflow.util.PackageUtil stageClasspathElements
INFO: Staging files complete: 191 files cached, 0 files newly uploaded in 0 seconds
Aug 10, 2021 12:43:04 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Read input/DataflowRunner.StreamingUnboundedRead.ReadWithIds as step s1
Aug 10, 2021 12:43:04 PM org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource split
INFO: Split into 20 bundles of sizes: [org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@118ffcfd, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@53f4c1e6, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@74174a23, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@6342d610, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@dc4a691, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@784abd3e, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@36c2b646, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@434514d8, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@6b1dc20f, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@4613311f, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@6540cf1d, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@ec8f4b9, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@bc042d5, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@5484117b, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@37df14d1, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@7efb53af, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@7724704f, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@3dfa819, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@4ce94d2f, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@68ab0936]
Aug 10, 2021 12:43:04 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Read input/StripIds as step s2
Aug 10, 2021 12:43:04 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding ParDo(TimeMonitor) as step s3
Aug 10, 2021 12:43:04 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding ParDo(ByteMonitor) as step s4
Aug 10, 2021 12:43:04 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 0 as step s5
Aug 10, 2021 12:43:04 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 1 as step s6
Aug 10, 2021 12:43:04 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 2 as step s7
Aug 10, 2021 12:43:04 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 3 as step s8
Aug 10, 2021 12:43:04 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 4 as step s9
Aug 10, 2021 12:43:04 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 5 as step s10
Aug 10, 2021 12:43:04 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 6 as step s11
Aug 10, 2021 12:43:04 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 7 as step s12
Aug 10, 2021 12:43:04 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 8 as step s13
Aug 10, 2021 12:43:04 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 9 as step s14
Aug 10, 2021 12:43:04 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding ParDo(TimeMonitor)2 as step s15
Aug 10, 2021 12:43:04 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Dataflow SDK version: 2.33.0-SNAPSHOT
Aug 10, 2021 12:43:05 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobs/us-central1/2021-08-10_05_43_04-7197560437598864118?project=apache-beam-testing
Aug 10, 2021 12:43:05 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Submitted job: 2021-08-10_05_43_04-7197560437598864118
Aug 10, 2021 12:43:05 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2021-08-10_05_43_04-7197560437598864118
Aug 10, 2021 12:43:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-08-10T12:43:11.585Z: The workflow name is not a valid Cloud Label. Labels applied to Cloud resources (such as GCE Instances) for monitoring will be labeled with this modified job name: load0tests0java110dataflow0v20streaming0pardo01-jenkins-08-gm5v. For the best monitoring experience, please name your job with a valid Cloud Label. For details, see: https://cloud.google.com/compute/docs/labeling-resources#restrictions
Aug 10, 2021 12:43:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-10T12:43:15.704Z: Worker configuration: e2-standard-2 in us-central1-a.
Aug 10, 2021 12:43:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-10T12:43:16.355Z: Expanding SplittableParDo operations into optimizable parts.
Aug 10, 2021 12:43:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-10T12:43:16.379Z: Expanding CollectionToSingleton operations into optimizable parts.
Aug 10, 2021 12:43:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-10T12:43:16.450Z: Expanding CoGroupByKey operations into optimizable parts.
Aug 10, 2021 12:43:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-10T12:43:16.487Z: Expanding SplittableProcessKeyed operations into optimizable parts.
Aug 10, 2021 12:43:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-10T12:43:16.523Z: Expanding GroupByKey operations into streaming Read/Write steps
Aug 10, 2021 12:43:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-10T12:43:16.546Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
Aug 10, 2021 12:43:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-10T12:43:16.599Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
Aug 10, 2021 12:43:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-10T12:43:16.631Z: Fusing consumer Read input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource) into Read input/Impulse
Aug 10, 2021 12:43:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-10T12:43:16.653Z: Fusing consumer Read-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/PairWithRestriction into Read input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource)
Aug 10, 2021 12:43:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-10T12:43:16.687Z: Fusing consumer Read-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/SplitWithSizing into Read-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/PairWithRestriction
Aug 10, 2021 12:43:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-10T12:43:16.736Z: Fusing consumer Read input/ParDo(StripIds)/ParMultiDo(StripIds) into Read-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/ProcessElementAndRestrictionWithSizing
Aug 10, 2021 12:43:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-10T12:43:16.777Z: Fusing consumer ParDo(TimeMonitor)/ParMultiDo(TimeMonitor) into Read input/ParDo(StripIds)/ParMultiDo(StripIds)
Aug 10, 2021 12:43:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-10T12:43:16.812Z: Fusing consumer ParDo(ByteMonitor)/ParMultiDo(ByteMonitor) into ParDo(TimeMonitor)/ParMultiDo(TimeMonitor)
Aug 10, 2021 12:43:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-10T12:43:16.837Z: Fusing consumer Step: 0/ParMultiDo(CounterOperation) into ParDo(ByteMonitor)/ParMultiDo(ByteMonitor)
Aug 10, 2021 12:43:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-10T12:43:16.858Z: Fusing consumer Step: 1/ParMultiDo(CounterOperation) into Step: 0/ParMultiDo(CounterOperation)
Aug 10, 2021 12:43:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-10T12:43:16.881Z: Fusing consumer Step: 2/ParMultiDo(CounterOperation) into Step: 1/ParMultiDo(CounterOperation)
Aug 10, 2021 12:43:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-10T12:43:16.907Z: Fusing consumer Step: 3/ParMultiDo(CounterOperation) into Step: 2/ParMultiDo(CounterOperation)
Aug 10, 2021 12:43:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-10T12:43:16.942Z: Fusing consumer Step: 4/ParMultiDo(CounterOperation) into Step: 3/ParMultiDo(CounterOperation)
Aug 10, 2021 12:43:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-10T12:43:16.977Z: Fusing consumer Step: 5/ParMultiDo(CounterOperation) into Step: 4/ParMultiDo(CounterOperation)
Aug 10, 2021 12:43:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-10T12:43:17.010Z: Fusing consumer Step: 6/ParMultiDo(CounterOperation) into Step: 5/ParMultiDo(CounterOperation)
Aug 10, 2021 12:43:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-10T12:43:17.043Z: Fusing consumer Step: 7/ParMultiDo(CounterOperation) into Step: 6/ParMultiDo(CounterOperation)
Aug 10, 2021 12:43:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-10T12:43:17.065Z: Fusing consumer Step: 8/ParMultiDo(CounterOperation) into Step: 7/ParMultiDo(CounterOperation)
Aug 10, 2021 12:43:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-10T12:43:17.097Z: Fusing consumer Step: 9/ParMultiDo(CounterOperation) into Step: 8/ParMultiDo(CounterOperation)
Aug 10, 2021 12:43:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-10T12:43:17.120Z: Fusing consumer ParDo(TimeMonitor)2/ParMultiDo(TimeMonitor) into Step: 9/ParMultiDo(CounterOperation)
Aug 10, 2021 12:43:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-10T12:43:17.440Z: Starting 5 ****s in us-central1-a...
Aug 10, 2021 12:43:40 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-10T12:43:40.460Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete
Aug 10, 2021 12:44:02 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-10T12:44:01.858Z: Autoscaling: Raised the number of ****s to 5 so that the pipeline can catch up with its backlog and keep up with its input rate.
Aug 10, 2021 12:44:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-10T12:44:52.715Z: Workers have started successfully.
Aug 10, 2021 12:44:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-10T12:44:52.746Z: Workers have started successfully.
Aug 10, 2021 4:01:02 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-10T16:01:02.726Z: Cancel request is committed for workflow job: 2021-08-10_05_43_04-7197560437598864118.
Aug 10, 2021 4:01:02 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-10T16:01:02.826Z: Cleaning up.
Aug 10, 2021 4:01:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-10T16:01:02.942Z: Stopping **** pool...
Aug 10, 2021 4:01:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-10T16:01:02.987Z: Stopping **** pool...
Aug 10, 2021 4:03:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-10T16:03:16.675Z: Autoscaling: Reduced the number of ****s to 0 based on low average **** CPU utilization, and the pipeline having sufficiently low backlog and keeping up with input rate.
Aug 10, 2021 4:03:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-10T16:03:16.716Z: Worker pool stopped.
Aug 10, 2021 4:03:22 PM org.apache.beam.runners.dataflow.DataflowPipelineJob logTerminalState
INFO: Job 2021-08-10_05_43_04-7197560437598864118 finished with status CANCELLED.
Aug 10, 2021 4:03:22 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
Load test results for test (ID): 32e7079f-fb50-4e1b-b7eb-e57a03da1f90 and timestamp: 2021-08-10T12:42:58.820000000Z:SEVERE: Failed to get metric totalBytes.count, from namespace pardo
Metric: Value:
dataflow_v2_java11_runtime_sec 0.0
dataflow_v2_java11_total_bytes_count -1.0
Exception in thread "main" java.lang.RuntimeException: Invalid job state: CANCELLED.
at org.apache.beam.sdk.loadtests.JobFailure.handleFailure(JobFailure.java:55)
at org.apache.beam.sdk.loadtests.LoadTest.run(LoadTest.java:141)
at org.apache.beam.sdk.loadtests.ParDoLoadTest.run(ParDoLoadTest.java:53)
at org.apache.beam.sdk.loadtests.ParDoLoadTest.main(ParDoLoadTest.java:103)
> Task :sdks:java:testing:load-tests:run FAILED
> Task :runners:google-cloud-dataflow-java:cleanUpDockerImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210810123753
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:a1ad33643b5ff2505449bc7a019587a04f3a1c8bab6267ad3716f97a5c1bd046
Deleted: sha256:61664275773c80b0544ecc83fa3a403a33e784ec22665483625acd17dc0eaf91
Deleted: sha256:1d226abbaed28c35ccec638a2b186bec5b7259051379380d84d229388508398d
Deleted: sha256:958f83a865666eb033a38bedff2f33b329a36e58b84ac9689c9592ea8ce1a7e8
Deleted: sha256:d050118454e5d4c2a788905f1faaee639d31fe620a5450c7f4c80352b1f2dbc9
Deleted: sha256:360912e7998e2949111b1b40f4f5d547e20a8ba490f0447734ff6a31e9c0fccc
Deleted: sha256:8161049358ddc2548caaa43e911e4d3d827f0d4e1cf880469154672206b69e1f
Deleted: sha256:6b85604d8b7038c55b380a5a6810945eb6a58ae09233ba934568d94a9ee80944
Deleted: sha256:384d304281c39ea372596b82301524d223d370ed03a15a20215c29145ca48bd7
Deleted: sha256:b4ed3b8c38dd01bea7d2192c1b7aefadc81d5233d3713643fa591c064e7f97e4
Deleted: sha256:06676dac0bce7a5a5196d3525a041314c8cccf03fde3cf3472e3aa02dce04ee8
Deleted: sha256:4dd289dab4f700f5e2eeb1ea325d0057221383c969a5cfe731a51cfc992b00ef
Deleted: sha256:7dcaef3fe25d50c9544a0463fe43a2382587ff397d5aa2b2adebe173d414a185
Deleted: sha256:f4c327788cf8188bfef72f4ea499de01cac0b0e866a23f5ec6b9b8e62f5acfca
Deleted: sha256:b71c8bb9ac64b5149eb15e780687cbb915116bd29c47eb6b962abd09be824776
Deleted: sha256:8681f22d312aa25f04f2567c0111c43158a001180977e7ec8bae96206edc2720
Deleted: sha256:79e99da927eab17e3c85b53e44c35814bee7ade796009497dd25726ca6ffc52c
Deleted: sha256:2326c70723a5ecf89ed0d409a851e97425cbc2ba98917eed634033221bc2e5b9
Deleted: sha256:790c102e5b55de2a9e6c1a878fcab2934ed70b6294d5592cc6237a6d57326361
Deleted: sha256:105753978202b95906bf01c475fecdff361b0951e56d58056ec56df814738049
Deleted: sha256:58d58e8a3ad3e2ffc2b4bab59563a278d4a755f9a835f7cc4c678862a0861457
Deleted: sha256:2954a556b6e3df09752fe2d24c1f693a620dbd1927cc8a1283783597c72b78d9
Deleted: sha256:a84eb5e814910fef3683dfc01f3ea26421dff4a7f39478b586e350b4134301ca
Deleted: sha256:97567100682dcb3689577572fc1be5ce27ed67dff2866c49644a273e4e37897b
Deleted: sha256:5f3fa5b7f8b0f5428eb80dbbdc532f07da905f51d0d6fa9efa016d8e52ea1150
Deleted: sha256:a5dddbb420c2a711376a84bc2b4d05bf5431512edde712758a22f95111b5d2f8
Deleted: sha256:158fecb7ebf22ccc43224e6da76272655b79a3607bd67fc218f2699bfca69646
Deleted: sha256:3c27c7bd278b5165633d0013f18585b84564cdefed620359fc322aa956568233
Deleted: sha256:daab8e0d22a2369e269426f462c5fa30aa0fd5a92e5a064892d207669453f3d0
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210810123753]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:a1ad33643b5ff2505449bc7a019587a04f3a1c8bab6267ad3716f97a5c1bd046]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210810123753] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:a1ad33643b5ff2505449bc7a019587a04f3a1c8bab6267ad3716f97a5c1bd046])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:a1ad33643b5ff2505449bc7a019587a04f3a1c8bab6267ad3716f97a5c1bd046
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:a1ad33643b5ff2505449bc7a019587a04f3a1c8bab6267ad3716f97a5c1bd046
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:a1ad33643b5ff2505449bc7a019587a04f3a1c8bab6267ad3716f97a5c1bd046].
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:testing:load-tests:run'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 3h 25m 47s
107 actionable tasks: 79 executed, 26 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/yltx6prwyj5tw
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins:
beam_LoadTests_Java_ParDo_Dataflow_V2_Streaming_Java11 #53
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Java_ParDo_Dataflow_V2_Streaming_Java11/53/display/redirect>
Changes:
------------------------------------------
[...truncated 66.17 KB...]
5a9a65095453: Waiting
e97f754600f3: Waiting
4b0edb23340c: Waiting
f42aed5f7feb: Waiting
3fa8ea9c690a: Waiting
aab834152b46: Waiting
afa3e488a0ee: Waiting
eeeeedd51646: Waiting
2aa2725a7b37: Waiting
ae78d3f706b6: Pushed
2f59d1c296f4: Pushed
dfd1c8392ecd: Pushed
8b3bf467bbb2: Pushed
5b85e63b5dee: Pushed
86c346641c11: Pushed
2aa2725a7b37: Pushed
e97f754600f3: Pushed
f42aed5f7feb: Layer already exists
89819bafde36: Layer already exists
f3d5b8f65132: Layer already exists
ad83f0aa5c0a: Layer already exists
d2d7d982dc26: Pushed
5a9a65095453: Layer already exists
afa3e488a0ee: Layer already exists
4b0edb23340c: Layer already exists
aab834152b46: Pushed
eeeeedd51646: Pushed
3fa8ea9c690a: Pushed
20210809123734: digest: sha256:024d0059b360c52683458d65ab1d79c6438a39ecee827b3ccfa797363df446d9 size: 4310
> Task :sdks:java:testing:load-tests:run
Aug 09, 2021 12:42:12 PM org.apache.beam.runners.dataflow.options.DataflowPipelineOptions$StagingLocationFactory create
INFO: No stagingLocation provided, falling back to gcpTempLocation
Aug 09, 2021 12:42:12 PM org.apache.beam.runners.dataflow.DataflowRunner fromOptions
INFO: PipelineOptions.filesToStage was not specified. Defaulting to files from the classpath: will stage 191 files. Enable logging at DEBUG level to see which files will be staged.
Aug 09, 2021 12:42:13 PM org.apache.beam.sdk.Pipeline validate
WARNING: The following transforms do not have stable unique names: ParDo(TimeMonitor)
Aug 09, 2021 12:42:13 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Executing pipeline on the Dataflow Service, which will have billing implications related to Google Compute Engine usage and other Google Cloud Services.
Aug 09, 2021 12:42:15 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging portable pipeline proto to gs://temp-storage-for-perf-tests/loadtests/staging/
Aug 09, 2021 12:42:15 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <107856 bytes, hash 468421f13ee361b40076ff5d8c0b92a1ed631abeae551740a0e4d198fb12d678> to gs://temp-storage-for-perf-tests/loadtests/staging/pipeline-RoQh8T7jYbQAdv9djAuSoe1jGr6uVRdAoOTRmPsS1ng.pb
Aug 09, 2021 12:42:17 PM org.apache.beam.runners.dataflow.util.PackageUtil stageClasspathElements
INFO: Uploading 191 files from PipelineOptions.filesToStage to staging location to prepare for execution.
Aug 09, 2021 12:42:17 PM org.apache.beam.runners.dataflow.util.PackageUtil stageClasspathElements
INFO: Staging files complete: 191 files cached, 0 files newly uploaded in 0 seconds
Aug 09, 2021 12:42:17 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Read input/DataflowRunner.StreamingUnboundedRead.ReadWithIds as step s1
Aug 09, 2021 12:42:17 PM org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource split
INFO: Split into 20 bundles of sizes: [org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@53f4c1e6, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@74174a23, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@6342d610, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@dc4a691, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@784abd3e, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@36c2b646, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@434514d8, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@6b1dc20f, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@4613311f, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@6540cf1d, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@ec8f4b9, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@bc042d5, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@5484117b, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@37df14d1, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@7efb53af, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@7724704f, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@3dfa819, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@4ce94d2f, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@68ab0936, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@3cd9aa64]
Aug 09, 2021 12:42:17 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Read input/StripIds as step s2
Aug 09, 2021 12:42:17 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding ParDo(TimeMonitor) as step s3
Aug 09, 2021 12:42:17 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding ParDo(ByteMonitor) as step s4
Aug 09, 2021 12:42:17 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 0 as step s5
Aug 09, 2021 12:42:17 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 1 as step s6
Aug 09, 2021 12:42:17 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 2 as step s7
Aug 09, 2021 12:42:17 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 3 as step s8
Aug 09, 2021 12:42:17 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 4 as step s9
Aug 09, 2021 12:42:17 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 5 as step s10
Aug 09, 2021 12:42:17 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 6 as step s11
Aug 09, 2021 12:42:17 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 7 as step s12
Aug 09, 2021 12:42:17 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 8 as step s13
Aug 09, 2021 12:42:17 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 9 as step s14
Aug 09, 2021 12:42:17 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding ParDo(TimeMonitor)2 as step s15
Aug 09, 2021 12:42:17 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Dataflow SDK version: 2.33.0-SNAPSHOT
Aug 09, 2021 12:42:18 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobs/us-central1/2021-08-09_05_42_17-12755499636561393476?project=apache-beam-testing
Aug 09, 2021 12:42:18 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Submitted job: 2021-08-09_05_42_17-12755499636561393476
Aug 09, 2021 12:42:18 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2021-08-09_05_42_17-12755499636561393476
Aug 09, 2021 12:42:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-08-09T12:42:25.377Z: The workflow name is not a valid Cloud Label. Labels applied to Cloud resources (such as GCE Instances) for monitoring will be labeled with this modified job name: load0tests0java110dataflow0v20streaming0pardo01-jenkins-08-rgyp. For the best monitoring experience, please name your job with a valid Cloud Label. For details, see: https://cloud.google.com/compute/docs/labeling-resources#restrictions
Aug 09, 2021 12:42:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-09T12:42:29.543Z: Worker configuration: e2-standard-2 in us-central1-a.
Aug 09, 2021 12:42:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-09T12:42:30.251Z: Expanding SplittableParDo operations into optimizable parts.
Aug 09, 2021 12:42:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-09T12:42:30.283Z: Expanding CollectionToSingleton operations into optimizable parts.
Aug 09, 2021 12:42:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-09T12:42:30.355Z: Expanding CoGroupByKey operations into optimizable parts.
Aug 09, 2021 12:42:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-09T12:42:30.396Z: Expanding SplittableProcessKeyed operations into optimizable parts.
Aug 09, 2021 12:42:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-09T12:42:30.421Z: Expanding GroupByKey operations into streaming Read/Write steps
Aug 09, 2021 12:42:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-09T12:42:30.456Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
Aug 09, 2021 12:42:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-09T12:42:30.533Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
Aug 09, 2021 12:42:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-09T12:42:30.550Z: Fusing consumer Read input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource) into Read input/Impulse
Aug 09, 2021 12:42:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-09T12:42:30.582Z: Fusing consumer Read-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/PairWithRestriction into Read input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource)
Aug 09, 2021 12:42:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-09T12:42:30.609Z: Fusing consumer Read-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/SplitWithSizing into Read-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/PairWithRestriction
Aug 09, 2021 12:42:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-09T12:42:30.633Z: Fusing consumer Read input/ParDo(StripIds)/ParMultiDo(StripIds) into Read-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/ProcessElementAndRestrictionWithSizing
Aug 09, 2021 12:42:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-09T12:42:30.657Z: Fusing consumer ParDo(TimeMonitor)/ParMultiDo(TimeMonitor) into Read input/ParDo(StripIds)/ParMultiDo(StripIds)
Aug 09, 2021 12:42:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-09T12:42:30.685Z: Fusing consumer ParDo(ByteMonitor)/ParMultiDo(ByteMonitor) into ParDo(TimeMonitor)/ParMultiDo(TimeMonitor)
Aug 09, 2021 12:42:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-09T12:42:30.714Z: Fusing consumer Step: 0/ParMultiDo(CounterOperation) into ParDo(ByteMonitor)/ParMultiDo(ByteMonitor)
Aug 09, 2021 12:42:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-09T12:42:30.748Z: Fusing consumer Step: 1/ParMultiDo(CounterOperation) into Step: 0/ParMultiDo(CounterOperation)
Aug 09, 2021 12:42:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-09T12:42:30.781Z: Fusing consumer Step: 2/ParMultiDo(CounterOperation) into Step: 1/ParMultiDo(CounterOperation)
Aug 09, 2021 12:42:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-09T12:42:30.811Z: Fusing consumer Step: 3/ParMultiDo(CounterOperation) into Step: 2/ParMultiDo(CounterOperation)
Aug 09, 2021 12:42:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-09T12:42:30.830Z: Fusing consumer Step: 4/ParMultiDo(CounterOperation) into Step: 3/ParMultiDo(CounterOperation)
Aug 09, 2021 12:42:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-09T12:42:30.856Z: Fusing consumer Step: 5/ParMultiDo(CounterOperation) into Step: 4/ParMultiDo(CounterOperation)
Aug 09, 2021 12:42:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-09T12:42:30.882Z: Fusing consumer Step: 6/ParMultiDo(CounterOperation) into Step: 5/ParMultiDo(CounterOperation)
Aug 09, 2021 12:42:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-09T12:42:30.907Z: Fusing consumer Step: 7/ParMultiDo(CounterOperation) into Step: 6/ParMultiDo(CounterOperation)
Aug 09, 2021 12:42:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-09T12:42:30.940Z: Fusing consumer Step: 8/ParMultiDo(CounterOperation) into Step: 7/ParMultiDo(CounterOperation)
Aug 09, 2021 12:42:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-09T12:42:30.972Z: Fusing consumer Step: 9/ParMultiDo(CounterOperation) into Step: 8/ParMultiDo(CounterOperation)
Aug 09, 2021 12:42:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-09T12:42:31.013Z: Fusing consumer ParDo(TimeMonitor)2/ParMultiDo(TimeMonitor) into Step: 9/ParMultiDo(CounterOperation)
Aug 09, 2021 12:42:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-09T12:42:31.366Z: Starting 5 ****s in us-central1-a...
Aug 09, 2021 12:42:57 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-09T12:42:55.403Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete
Aug 09, 2021 12:43:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-09T12:43:10.390Z: Autoscaling: Raised the number of ****s to 5 so that the pipeline can catch up with its backlog and keep up with its input rate.
Aug 09, 2021 12:44:06 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-09T12:44:06.012Z: Workers have started successfully.
Aug 09, 2021 12:44:06 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-09T12:44:06.064Z: Workers have started successfully.
Aug 09, 2021 3:45:33 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-09T15:45:31.513Z: Staged package amazon-kinesis-producer-0.14.1-5YYT_oyDFV17VWs8Of43O7N08sRfHu0SuJeqVSFCuLg.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/amazon-kinesis-producer-0.14.1-5YYT_oyDFV17VWs8Of43O7N08sRfHu0SuJeqVSFCuLg.jar' is inaccessible.
Aug 09, 2021 3:45:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-09T15:45:33.159Z: Staged package google-api-client-1.31.1-zAzs7d51UaRiAIkdNgZIN8hbV3QoubkFa6XKkxG5ZXQ.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/google-api-client-1.31.1-zAzs7d51UaRiAIkdNgZIN8hbV3QoubkFa6XKkxG5ZXQ.jar' is inaccessible.
Aug 09, 2021 3:45:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-09T15:45:33.219Z: Staged package google-api-client-jackson2-1.31.0-4P1Zf2ZwEY361HJ9G7BAkJFYtfoxvxwky7pQt8Nlgi8.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/google-api-client-jackson2-1.31.0-4P1Zf2ZwEY361HJ9G7BAkJFYtfoxvxwky7pQt8Nlgi8.jar' is inaccessible.
Aug 09, 2021 3:45:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-09T15:45:33.478Z: Staged package google-api-services-storage-v1-rev20210127-1.31.0-qwG3Ff_jgjMd1lU6mQjHSXDOU7A27GbAbi5U6zK8i7k.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/google-api-services-storage-v1-rev20210127-1.31.0-qwG3Ff_jgjMd1lU6mQjHSXDOU7A27GbAbi5U6zK8i7k.jar' is inaccessible.
Aug 09, 2021 3:45:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-08-09T15:45:35.853Z: One or more access checks for temp location or staged files failed. Please refer to other error messages for details. For more information on security and permissions, please see https://cloud.google.com/dataflow/security-and-permissions.
Aug 09, 2021 3:48:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-08-09T15:48:36.434Z: One or more access checks for temp location or staged files failed. Please refer to other error messages for details. For more information on security and permissions, please see https://cloud.google.com/dataflow/security-and-permissions.
Aug 09, 2021 3:51:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-09T15:51:31.540Z: Staged package amazon-kinesis-producer-0.14.1-5YYT_oyDFV17VWs8Of43O7N08sRfHu0SuJeqVSFCuLg.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/amazon-kinesis-producer-0.14.1-5YYT_oyDFV17VWs8Of43O7N08sRfHu0SuJeqVSFCuLg.jar' is inaccessible.
Aug 09, 2021 3:51:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-09T15:51:33.499Z: Staged package google-api-client-1.31.1-zAzs7d51UaRiAIkdNgZIN8hbV3QoubkFa6XKkxG5ZXQ.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/google-api-client-1.31.1-zAzs7d51UaRiAIkdNgZIN8hbV3QoubkFa6XKkxG5ZXQ.jar' is inaccessible.
Aug 09, 2021 3:51:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-09T15:51:33.543Z: Staged package google-api-client-jackson2-1.31.0-4P1Zf2ZwEY361HJ9G7BAkJFYtfoxvxwky7pQt8Nlgi8.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/google-api-client-jackson2-1.31.0-4P1Zf2ZwEY361HJ9G7BAkJFYtfoxvxwky7pQt8Nlgi8.jar' is inaccessible.
Aug 09, 2021 3:51:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-09T15:51:33.785Z: Staged package google-api-services-storage-v1-rev20210127-1.31.0-qwG3Ff_jgjMd1lU6mQjHSXDOU7A27GbAbi5U6zK8i7k.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/google-api-services-storage-v1-rev20210127-1.31.0-qwG3Ff_jgjMd1lU6mQjHSXDOU7A27GbAbi5U6zK8i7k.jar' is inaccessible.
Aug 09, 2021 3:51:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-08-09T15:51:36.946Z: One or more access checks for temp location or staged files failed. Please refer to other error messages for details. For more information on security and permissions, please see https://cloud.google.com/dataflow/security-and-permissions.
Aug 09, 2021 3:54:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-08-09T15:54:35.752Z: One or more access checks for temp location or staged files failed. Please refer to other error messages for details. For more information on security and permissions, please see https://cloud.google.com/dataflow/security-and-permissions.
Aug 09, 2021 3:57:32 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-09T15:57:31.519Z: Staged package amazon-kinesis-producer-0.14.1-5YYT_oyDFV17VWs8Of43O7N08sRfHu0SuJeqVSFCuLg.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/amazon-kinesis-producer-0.14.1-5YYT_oyDFV17VWs8Of43O7N08sRfHu0SuJeqVSFCuLg.jar' is inaccessible.
Aug 09, 2021 3:57:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-09T15:57:32.798Z: Staged package google-api-client-1.31.1-zAzs7d51UaRiAIkdNgZIN8hbV3QoubkFa6XKkxG5ZXQ.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/google-api-client-1.31.1-zAzs7d51UaRiAIkdNgZIN8hbV3QoubkFa6XKkxG5ZXQ.jar' is inaccessible.
Aug 09, 2021 3:57:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-09T15:57:32.829Z: Staged package google-api-client-jackson2-1.31.0-4P1Zf2ZwEY361HJ9G7BAkJFYtfoxvxwky7pQt8Nlgi8.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/google-api-client-jackson2-1.31.0-4P1Zf2ZwEY361HJ9G7BAkJFYtfoxvxwky7pQt8Nlgi8.jar' is inaccessible.
Aug 09, 2021 3:57:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-09T15:57:33.017Z: Staged package google-api-services-storage-v1-rev20210127-1.31.0-qwG3Ff_jgjMd1lU6mQjHSXDOU7A27GbAbi5U6zK8i7k.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/google-api-services-storage-v1-rev20210127-1.31.0-qwG3Ff_jgjMd1lU6mQjHSXDOU7A27GbAbi5U6zK8i7k.jar' is inaccessible.
Aug 09, 2021 3:57:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-08-09T15:57:35.569Z: One or more access checks for temp location or staged files failed. Please refer to other error messages for details. For more information on security and permissions, please see https://cloud.google.com/dataflow/security-and-permissions.
Aug 09, 2021 4:00:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-09T16:00:36.295Z: Cancel request is committed for workflow job: 2021-08-09_05_42_17-12755499636561393476.
Aug 09, 2021 4:00:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-08-09T16:00:36.466Z: One or more access checks for temp location or staged files failed. Please refer to other error messages for details. For more information on security and permissions, please see https://cloud.google.com/dataflow/security-and-permissions.
Aug 09, 2021 4:00:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-09T16:00:36.495Z: Cleaning up.
Aug 09, 2021 4:00:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-09T16:00:36.591Z: Stopping **** pool...
Aug 09, 2021 4:00:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-09T16:00:36.639Z: Stopping **** pool...
Aug 09, 2021 4:03:07 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-09T16:03:05.854Z: Autoscaling: Reduced the number of ****s to 0 based on low average **** CPU utilization, and the pipeline having sufficiently low backlog and keeping up with input rate.
Aug 09, 2021 4:03:07 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-09T16:03:05.883Z: Worker pool stopped.
Aug 09, 2021 4:03:12 PM org.apache.beam.runners.dataflow.DataflowPipelineJob logTerminalState
INFO: Job 2021-08-09_05_42_17-12755499636561393476 finished with status CANCELLED.
Aug 09, 2021 4:03:12 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric totalBytes.count, from namespace pardo
Load test results for test (ID): 5222d5ad-4617-4e0c-b5a9-bd6705547e0c and timestamp: 2021-08-09T12:42:12.861000000Z:
Metric: Value:
dataflow_v2_java11_runtime_sec 0.0
dataflow_v2_java11_total_bytes_count -1.0
Exception in thread "main" java.lang.RuntimeException: Invalid job state: CANCELLED.
at org.apache.beam.sdk.loadtests.JobFailure.handleFailure(JobFailure.java:55)
at org.apache.beam.sdk.loadtests.LoadTest.run(LoadTest.java:141)
at org.apache.beam.sdk.loadtests.ParDoLoadTest.run(ParDoLoadTest.java:53)
at org.apache.beam.sdk.loadtests.ParDoLoadTest.main(ParDoLoadTest.java:103)
> Task :sdks:java:testing:load-tests:run FAILED
> Task :runners:google-cloud-dataflow-java:cleanUpDockerImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210809123734
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:024d0059b360c52683458d65ab1d79c6438a39ecee827b3ccfa797363df446d9
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210809123734]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:024d0059b360c52683458d65ab1d79c6438a39ecee827b3ccfa797363df446d9]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210809123734] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:024d0059b360c52683458d65ab1d79c6438a39ecee827b3ccfa797363df446d9])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:024d0059b360c52683458d65ab1d79c6438a39ecee827b3ccfa797363df446d9
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:024d0059b360c52683458d65ab1d79c6438a39ecee827b3ccfa797363df446d9
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:024d0059b360c52683458d65ab1d79c6438a39ecee827b3ccfa797363df446d9].
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:testing:load-tests:run'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 3h 25m 56s
107 actionable tasks: 76 executed, 29 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/sfdvce7kr73w2
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins:
beam_LoadTests_Java_ParDo_Dataflow_V2_Streaming_Java11 #52
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Java_ParDo_Dataflow_V2_Streaming_Java11/52/display/redirect>
Changes:
------------------------------------------
[...truncated 163.17 KB...]
Aug 08, 2021 3:48:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-08T15:48:40.338Z: Staged package grpc-stub-1.37.0-S2e9fmu0Oryp12fLayrvYluHst0hbe2IeYM0Nw6n3Ew.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/grpc-stub-1.37.0-S2e9fmu0Oryp12fLayrvYluHst0hbe2IeYM0Nw6n3Ew.jar' is inaccessible.
Aug 08, 2021 3:48:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-08T15:48:40.392Z: Staged package guava-30.1-jre-5t0HL50_4CpGAGiDgL1CK9rBhMr2_iQYz90JNPCUMqo.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/guava-30.1-jre-5t0HL50_4CpGAGiDgL1CK9rBhMr2_iQYz90JNPCUMqo.jar' is inaccessible.
Aug 08, 2021 3:48:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-08T15:48:41.296Z: Staged package opencensus-contrib-grpc-util-0.28.0-uRaDRuavZZMwChvCfvdCVKofJAGYhZON2PuFK4d9VfA.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/opencensus-contrib-grpc-util-0.28.0-uRaDRuavZZMwChvCfvdCVKofJAGYhZON2PuFK4d9VfA.jar' is inaccessible.
Aug 08, 2021 3:48:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-08T15:48:41.414Z: Staged package proto-google-cloud-bigquerystorage-v1-1.17.0-95Kd13lib16MutfGTvzMCJqbS65ZQNT9VRHgBwWtNQE.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/proto-google-cloud-bigquerystorage-v1-1.17.0-95Kd13lib16MutfGTvzMCJqbS65ZQNT9VRHgBwWtNQE.jar' is inaccessible.
Aug 08, 2021 3:48:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-08T15:48:41.449Z: Staged package proto-google-cloud-bigquerystorage-v1beta1-0.117.0-pK3SZjZI7_R19YB-f6BAjzEvPBP51B8g0W3RCLvzipc.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/proto-google-cloud-bigquerystorage-v1beta1-0.117.0-pK3SZjZI7_R19YB-f6BAjzEvPBP51B8g0W3RCLvzipc.jar' is inaccessible.
Aug 08, 2021 3:48:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-08T15:48:41.485Z: Staged package proto-google-cloud-bigquerystorage-v1beta2-0.117.0-z1LoKma-K7JKLlprGXj2bIBy022pp9EfUhh25dTn0Ow.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/proto-google-cloud-bigquerystorage-v1beta2-0.117.0-z1LoKma-K7JKLlprGXj2bIBy022pp9EfUhh25dTn0Ow.jar' is inaccessible.
Aug 08, 2021 3:48:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-08T15:48:41.521Z: Staged package proto-google-cloud-bigtable-admin-v2-1.22.0-8bSazr-ySDSZJEkzlM5BFKebDGKoNY6i7jy3ITx48xg.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/proto-google-cloud-bigtable-admin-v2-1.22.0-8bSazr-ySDSZJEkzlM5BFKebDGKoNY6i7jy3ITx48xg.jar' is inaccessible.
Aug 08, 2021 3:48:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-08T15:48:41.565Z: Staged package proto-google-cloud-bigtable-v2-1.22.0-Ms5-Knu0K7tG_UgdRO_j6rJsVypzQswBWLLNwf5coic.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/proto-google-cloud-bigtable-v2-1.22.0-Ms5-Knu0K7tG_UgdRO_j6rJsVypzQswBWLLNwf5coic.jar' is inaccessible.
Aug 08, 2021 3:48:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-08T15:48:41.602Z: Staged package proto-google-cloud-datastore-v1-0.89.0-hkM_w8_zlqdrJoDOXo3TSJYS03GQI6BxuM9xOBX9rOw.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/proto-google-cloud-datastore-v1-0.89.0-hkM_w8_zlqdrJoDOXo3TSJYS03GQI6BxuM9xOBX9rOw.jar' is inaccessible.
Aug 08, 2021 3:48:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-08T15:48:41.683Z: Staged package proto-google-cloud-pubsub-v1-1.94.0-r1Ij-HGZWHgOZ9Qf0ZbMASV2fcefR39R02Xxw5hEEcI.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/proto-google-cloud-pubsub-v1-1.94.0-r1Ij-HGZWHgOZ9Qf0ZbMASV2fcefR39R02Xxw5hEEcI.jar' is inaccessible.
Aug 08, 2021 3:48:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-08T15:48:41.739Z: Staged package proto-google-cloud-spanner-admin-database-v1-6.2.0-he117VVIvCnVX4p-eO1rG76etOGpA8L4fOe05Te65Go.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/proto-google-cloud-spanner-admin-database-v1-6.2.0-he117VVIvCnVX4p-eO1rG76etOGpA8L4fOe05Te65Go.jar' is inaccessible.
Aug 08, 2021 3:48:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-08T15:48:41.792Z: Staged package proto-google-cloud-spanner-admin-instance-v1-6.2.0-RRwYnG2iuMNY7JFZjHiAi508xBCHBI7EytAorrVOcg0.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/proto-google-cloud-spanner-admin-instance-v1-6.2.0-RRwYnG2iuMNY7JFZjHiAi508xBCHBI7EytAorrVOcg0.jar' is inaccessible.
Aug 08, 2021 3:48:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-08T15:48:41.825Z: Staged package proto-google-cloud-spanner-v1-6.2.0-Om3nWCqO9bQz9PEbtHTtFGRgNhKs1W0z0FQRF1md-7c.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/proto-google-cloud-spanner-v1-6.2.0-Om3nWCqO9bQz9PEbtHTtFGRgNhKs1W0z0FQRF1md-7c.jar' is inaccessible.
Aug 08, 2021 3:48:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-08T15:48:41.861Z: Staged package proto-google-common-protos-2.1.0-IEtnIIZzW2vwQX0hGOmeXeZDXWKbBJQAu9cXzWHPsFY.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/proto-google-common-protos-2.1.0-IEtnIIZzW2vwQX0hGOmeXeZDXWKbBJQAu9cXzWHPsFY.jar' is inaccessible.
Aug 08, 2021 3:48:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-08T15:48:41.898Z: Staged package proto-google-iam-v1-1.0.12-3LMBbLCJKGCoBUkJYvX3mSwYkfgRW8MRFd89jtgSUWw.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/proto-google-iam-v1-1.0.12-3LMBbLCJKGCoBUkJYvX3mSwYkfgRW8MRFd89jtgSUWw.jar' is inaccessible.
Aug 08, 2021 3:48:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-08T15:48:41.926Z: Staged package protobuf-java-3.15.8-jQ4vmDT0_BoIOmUjmtxQfKg2gsdUon9MgOTyGZDv9oY.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/protobuf-java-3.15.8-jQ4vmDT0_BoIOmUjmtxQfKg2gsdUon9MgOTyGZDv9oY.jar' is inaccessible.
Aug 08, 2021 3:48:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-08T15:48:41.957Z: Staged package protobuf-java-util-3.15.8-fw4vEAG-VPmjJB-dnuwng5h3x2SzCFLgZNuRKM8oGQE.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/protobuf-java-util-3.15.8-fw4vEAG-VPmjJB-dnuwng5h3x2SzCFLgZNuRKM8oGQE.jar' is inaccessible.
Aug 08, 2021 3:48:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-08T15:48:42.148Z: Staged package zstd-jni-1.4.5-2-lzQxwUtNCahuI7cYQRb8rC2FUB60p0MPfRhczhr0YFA.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/zstd-jni-1.4.5-2-lzQxwUtNCahuI7cYQRb8rC2FUB60p0MPfRhczhr0YFA.jar' is inaccessible.
Aug 08, 2021 3:48:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-08-08T15:48:42.165Z: One or more access checks for temp location or staged files failed. Please refer to other error messages for details. For more information on security and permissions, please see https://cloud.google.com/dataflow/security-and-permissions.
Aug 08, 2021 3:51:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-08-08T15:51:40.270Z: One or more access checks for temp location or staged files failed. Please refer to other error messages for details. For more information on security and permissions, please see https://cloud.google.com/dataflow/security-and-permissions.
Aug 08, 2021 3:54:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-08T15:54:37.716Z: Staged package checker-qual-3.10.0-pNyILKaqxJbTM4Hl5esGBMRUg7AEvD6sk2jxuxfLJRI.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/checker-qual-3.10.0-pNyILKaqxJbTM4Hl5esGBMRUg7AEvD6sk2jxuxfLJRI.jar' is inaccessible.
Aug 08, 2021 3:54:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-08T15:54:38.071Z: Staged package gax-1.63.0-Cx6RlsmOjRvQWajIVLU1oC1w6hTF4cGHLxo4KPXiWiY.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/gax-1.63.0-Cx6RlsmOjRvQWajIVLU1oC1w6hTF4cGHLxo4KPXiWiY.jar' is inaccessible.
Aug 08, 2021 3:54:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-08T15:54:38.105Z: Staged package gax-grpc-1.63.0-hpi4LFdyjgrjmY_cjkhXaM-bpwd533b0CI4CBy1Qr2Q.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/gax-grpc-1.63.0-hpi4LFdyjgrjmY_cjkhXaM-bpwd533b0CI4CBy1Qr2Q.jar' is inaccessible.
Aug 08, 2021 3:54:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-08T15:54:38.140Z: Staged package gax-httpjson-0.80.0-mI65R2zr4_eFb9xmUsMDJ91-yYKsZyYjNvOVhVVCdgI.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/gax-httpjson-0.80.0-mI65R2zr4_eFb9xmUsMDJ91-yYKsZyYjNvOVhVVCdgI.jar' is inaccessible.
Aug 08, 2021 3:54:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-08T15:54:38.351Z: Staged package google-auth-library-credentials-0.25.2-MDcwcOTwXH22YrOH5hY87DYgG6pmBEUSA49EcX-9ZyU.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/google-auth-library-credentials-0.25.2-MDcwcOTwXH22YrOH5hY87DYgG6pmBEUSA49EcX-9ZyU.jar' is inaccessible.
Aug 08, 2021 3:54:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-08T15:54:38.394Z: Staged package google-auth-library-oauth2-http-0.25.2-lfJRTZaX0Q33YYsVOPWmcqjVVBoB0kcxG1cJdCR5EqQ.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/google-auth-library-oauth2-http-0.25.2-lfJRTZaX0Q33YYsVOPWmcqjVVBoB0kcxG1cJdCR5EqQ.jar' is inaccessible.
Aug 08, 2021 3:54:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-08T15:54:38.438Z: Staged package google-cloud-bigquery-1.127.12-zHVMhL11Zvn0CjPbB9GVrMtazggV0DFCHTOHeRjbf2U.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/google-cloud-bigquery-1.127.12-zHVMhL11Zvn0CjPbB9GVrMtazggV0DFCHTOHeRjbf2U.jar' is inaccessible.
Aug 08, 2021 3:54:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-08T15:54:38.521Z: Staged package google-cloud-bigtable-1.22.0--YGsRYoPCMZYXYA7jIAaClU6JarpUaM7eKZM7XpWpzo.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/google-cloud-bigtable-1.22.0--YGsRYoPCMZYXYA7jIAaClU6JarpUaM7eKZM7XpWpzo.jar' is inaccessible.
Aug 08, 2021 3:54:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-08T15:54:38.662Z: Staged package google-cloud-core-1.94.6-WO6HrayK0srg4GyQb_T3LWWuQFGiDH4f_spgB6D754Y.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/google-cloud-core-1.94.6-WO6HrayK0srg4GyQb_T3LWWuQFGiDH4f_spgB6D754Y.jar' is inaccessible.
Aug 08, 2021 3:54:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-08T15:54:38.719Z: Staged package google-cloud-core-grpc-1.94.6-1cDxCddwQniURuQPX-LiAV1uxmpw-oEXNvzJ7n3-bCo.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/google-cloud-core-grpc-1.94.6-1cDxCddwQniURuQPX-LiAV1uxmpw-oEXNvzJ7n3-bCo.jar' is inaccessible.
Aug 08, 2021 3:54:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-08T15:54:38.760Z: Staged package google-cloud-core-http-1.94.6-BrjPhre9CcmKC1AU1bFPQAk4zLeSRVy3Tr5l25xGHQw.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/google-cloud-core-http-1.94.6-BrjPhre9CcmKC1AU1bFPQAk4zLeSRVy3Tr5l25xGHQw.jar' is inaccessible.
Aug 08, 2021 3:54:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-08T15:54:38.817Z: Staged package google-cloud-pubsub-1.112.0-MMTQF5nNlW-TaBBe1xNbmTQghyjc-eYqdGNbjop0dc0.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/google-cloud-pubsub-1.112.0-MMTQF5nNlW-TaBBe1xNbmTQghyjc-eYqdGNbjop0dc0.jar' is inaccessible.
Aug 08, 2021 3:54:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-08T15:54:38.878Z: Staged package google-cloud-spanner-6.2.0-Tl9XPX3koTNmg42Dz5ebZpG_xpeINV6OfbVmLOQuH2g.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/google-cloud-spanner-6.2.0-Tl9XPX3koTNmg42Dz5ebZpG_xpeINV6OfbVmLOQuH2g.jar' is inaccessible.
Aug 08, 2021 3:54:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-08T15:54:38.941Z: Staged package google-http-client-1.39.2-arSWeGCSfwUd1_K1deS3qO8182fcLjQIBzqk3uMo4ic.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/google-http-client-1.39.2-arSWeGCSfwUd1_K1deS3qO8182fcLjQIBzqk3uMo4ic.jar' is inaccessible.
Aug 08, 2021 3:54:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-08T15:54:38.979Z: Staged package google-http-client-apache-v2-1.39.2-UtOSCfZav29XfhyrRmrbmfEtHNK6TpjYblAfddf4UM8.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/google-http-client-apache-v2-1.39.2-UtOSCfZav29XfhyrRmrbmfEtHNK6TpjYblAfddf4UM8.jar' is inaccessible.
Aug 08, 2021 3:54:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-08T15:54:39.013Z: Staged package google-http-client-appengine-1.39.2-9jINwNsDWv9uqy4odIVg2nGKtGX7w0gbZT6j8nqlysk.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/google-http-client-appengine-1.39.2-9jINwNsDWv9uqy4odIVg2nGKtGX7w0gbZT6j8nqlysk.jar' is inaccessible.
Aug 08, 2021 3:54:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-08T15:54:39.062Z: Staged package google-http-client-gson-1.39.2-z4GUT9Qf4NqoabkTvQqq7w5Nj-Z3ShlVQPRU7NPPULY.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/google-http-client-gson-1.39.2-z4GUT9Qf4NqoabkTvQqq7w5Nj-Z3ShlVQPRU7NPPULY.jar' is inaccessible.
Aug 08, 2021 3:54:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-08T15:54:39.100Z: Staged package google-http-client-jackson2-1.39.2-dKSTp7ol4d-z06Td9xMwbVo3htsAo0idWQYdyM_zIbE.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/google-http-client-jackson2-1.39.2-dKSTp7ol4d-z06Td9xMwbVo3htsAo0idWQYdyM_zIbE.jar' is inaccessible.
Aug 08, 2021 3:54:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-08T15:54:39.141Z: Staged package google-http-client-protobuf-1.39.2-48CRMH_IJ9gY8fZ3-5ANC0qF7rqbijaXD90xuQTMr5s.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/google-http-client-protobuf-1.39.2-48CRMH_IJ9gY8fZ3-5ANC0qF7rqbijaXD90xuQTMr5s.jar' is inaccessible.
Aug 08, 2021 3:54:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-08T15:54:39.188Z: Staged package grpc-alts-1.37.0-1pImhp1BwYeG32uYRxmeh0NZ9mjB6n37bBrYllOHP7s.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/grpc-alts-1.37.0-1pImhp1BwYeG32uYRxmeh0NZ9mjB6n37bBrYllOHP7s.jar' is inaccessible.
Aug 08, 2021 3:54:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-08T15:54:39.221Z: Staged package grpc-api-1.37.0-cwSURHkXII27hqdS5LctA5oWvU41MkWE_B68wNpz3v8.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/grpc-api-1.37.0-cwSURHkXII27hqdS5LctA5oWvU41MkWE_B68wNpz3v8.jar' is inaccessible.
Aug 08, 2021 3:54:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-08T15:54:39.260Z: Staged package grpc-auth-1.37.0-MnmZnsS7PY544IIITuiC1MDYLDnc6bGFYfHg2TYR_Ag.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/grpc-auth-1.37.0-MnmZnsS7PY544IIITuiC1MDYLDnc6bGFYfHg2TYR_Ag.jar' is inaccessible.
Aug 08, 2021 3:54:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-08T15:54:39.293Z: Staged package grpc-context-1.37.0-XOtiTb6T0PV5GY3NDBwbTA6AhtggIaU2y0YqhpBXjgM.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/grpc-context-1.37.0-XOtiTb6T0PV5GY3NDBwbTA6AhtggIaU2y0YqhpBXjgM.jar' is inaccessible.
Aug 08, 2021 3:54:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-08T15:54:39.327Z: Staged package grpc-core-1.37.0-FT_FqNdvB55GKsHljpOp3eJ99dajZRaFNyiXVb11t6w.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/grpc-core-1.37.0-FT_FqNdvB55GKsHljpOp3eJ99dajZRaFNyiXVb11t6w.jar' is inaccessible.
Aug 08, 2021 3:54:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-08T15:54:39.368Z: Staged package grpc-google-cloud-bigquerystorage-v1-1.17.0-02gx4b_vwwwBelFcFNwMP-XRHckCHFwMVTIlO8X4baA.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/grpc-google-cloud-bigquerystorage-v1-1.17.0-02gx4b_vwwwBelFcFNwMP-XRHckCHFwMVTIlO8X4baA.jar' is inaccessible.
Aug 08, 2021 3:54:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-08T15:54:39.409Z: Staged package grpc-google-cloud-bigquerystorage-v1beta1-0.117.0-ZB91IVdshSTiwsYGytbKB1XsNxKB9l1mSHOUfw0yWFw.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/grpc-google-cloud-bigquerystorage-v1beta1-0.117.0-ZB91IVdshSTiwsYGytbKB1XsNxKB9l1mSHOUfw0yWFw.jar' is inaccessible.
Aug 08, 2021 3:54:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-08T15:54:39.453Z: Staged package grpc-google-cloud-bigquerystorage-v1beta2-0.117.0-yh1Ffb1FlGQv3nd38pYh4V_o6axvSbIkGqFIz4vdX3g.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/grpc-google-cloud-bigquerystorage-v1beta2-0.117.0-yh1Ffb1FlGQv3nd38pYh4V_o6axvSbIkGqFIz4vdX3g.jar' is inaccessible.
Aug 08, 2021 3:54:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-08T15:54:39.494Z: Staged package grpc-google-cloud-bigtable-admin-v2-1.22.0-Ym7z3BEqasHVclRl5AAwCln9ujk53f9LlVXndOQdYLA.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/grpc-google-cloud-bigtable-admin-v2-1.22.0-Ym7z3BEqasHVclRl5AAwCln9ujk53f9LlVXndOQdYLA.jar' is inaccessible.
Aug 08, 2021 3:54:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-08T15:54:39.561Z: Staged package grpc-google-cloud-bigtable-v2-1.22.0-Y8qNsZoh7QdYSbNDZO11jjnU-kEFqMJokL-qHXXdYlE.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/grpc-google-cloud-bigtable-v2-1.22.0-Y8qNsZoh7QdYSbNDZO11jjnU-kEFqMJokL-qHXXdYlE.jar' is inaccessible.
Aug 08, 2021 3:54:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-08T15:54:39.594Z: Staged package grpc-google-cloud-pubsub-v1-1.94.0-YbRKfFIJ2b9i8zjI7rsveW9Nw7EbWMF8ftzN-NL0MJc.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/grpc-google-cloud-pubsub-v1-1.94.0-YbRKfFIJ2b9i8zjI7rsveW9Nw7EbWMF8ftzN-NL0MJc.jar' is inaccessible.
Aug 08, 2021 3:54:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-08T15:54:39.653Z: Staged package grpc-google-cloud-spanner-admin-database-v1-6.2.0-T4fJ1eGg_mnIce0nZ_P78rbzGe9ZXBqmpX7djS2hqPM.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/grpc-google-cloud-spanner-admin-database-v1-6.2.0-T4fJ1eGg_mnIce0nZ_P78rbzGe9ZXBqmpX7djS2hqPM.jar' is inaccessible.
Aug 08, 2021 3:54:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-08T15:54:39.690Z: Staged package grpc-google-cloud-spanner-admin-instance-v1-6.2.0-76Yv9jtfyiuxo7EnaE0TWOD8M9G1_JvteF2QXmu1NAE.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/grpc-google-cloud-spanner-admin-instance-v1-6.2.0-76Yv9jtfyiuxo7EnaE0TWOD8M9G1_JvteF2QXmu1NAE.jar' is inaccessible.
Aug 08, 2021 3:54:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-08T15:54:39.733Z: Staged package grpc-google-cloud-spanner-v1-6.2.0-PktAWd9OinuI641yk2u1cXb-LtabSSB0EY_c25jgxM0.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/grpc-google-cloud-spanner-v1-6.2.0-PktAWd9OinuI641yk2u1cXb-LtabSSB0EY_c25jgxM0.jar' is inaccessible.
Aug 08, 2021 3:54:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-08T15:54:39.767Z: Staged package grpc-google-common-protos-2.1.0--MiDqADro9lpRF4jeKEnVMFg8FWvgpM0r5u0RnmbMJ8.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/grpc-google-common-protos-2.1.0--MiDqADro9lpRF4jeKEnVMFg8FWvgpM0r5u0RnmbMJ8.jar' is inaccessible.
Aug 08, 2021 3:54:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-08T15:54:39.826Z: Staged package grpc-grpclb-1.37.0-k0VTMXlza0kKHWVsOBkRHhN1q06moj658_SOtph53cg.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/grpc-grpclb-1.37.0-k0VTMXlza0kKHWVsOBkRHhN1q06moj658_SOtph53cg.jar' is inaccessible.
Aug 08, 2021 3:54:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-08T15:54:39.857Z: Staged package grpc-netty-1.37.0-iBdn1lqsvQpQlDPYkofabzaUWFsEOT8QMiUXB0P_1Tc.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/grpc-netty-1.37.0-iBdn1lqsvQpQlDPYkofabzaUWFsEOT8QMiUXB0P_1Tc.jar' is inaccessible.
Aug 08, 2021 3:54:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-08T15:54:39.898Z: Staged package grpc-netty-shaded-1.37.0-R6JMgs-ax8p1eht0qdV9Hb5p6ayL1d9R93xz6mZ7bWg.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/grpc-netty-shaded-1.37.0-R6JMgs-ax8p1eht0qdV9Hb5p6ayL1d9R93xz6mZ7bWg.jar' is inaccessible.
Aug 08, 2021 3:54:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-08T15:54:39.935Z: Staged package grpc-protobuf-1.37.0-07c0poBIPfz_Fi63E6garGocKpEba5z-wjMikIcpIoc.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/grpc-protobuf-1.37.0-07c0poBIPfz_Fi63E6garGocKpEba5z-wjMikIcpIoc.jar' is inaccessible.
Aug 08, 2021 3:54:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-08T15:54:39.976Z: Staged package grpc-protobuf-lite-1.37.0-jPcqS6mhCpRAS8cb8InNj4NFiafjYzRe6W-En2Uqt9M.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/grpc-protobuf-lite-1.37.0-jPcqS6mhCpRAS8cb8InNj4NFiafjYzRe6W-En2Uqt9M.jar' is inaccessible.
Aug 08, 2021 3:54:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-08T15:54:40.012Z: Staged package grpc-stub-1.37.0-S2e9fmu0Oryp12fLayrvYluHst0hbe2IeYM0Nw6n3Ew.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/grpc-stub-1.37.0-S2e9fmu0Oryp12fLayrvYluHst0hbe2IeYM0Nw6n3Ew.jar' is inaccessible.
Aug 08, 2021 3:54:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-08T15:54:40.089Z: Staged package guava-30.1-jre-5t0HL50_4CpGAGiDgL1CK9rBhMr2_iQYz90JNPCUMqo.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/guava-30.1-jre-5t0HL50_4CpGAGiDgL1CK9rBhMr2_iQYz90JNPCUMqo.jar' is inaccessible.
Aug 08, 2021 3:54:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-08T15:54:40.808Z: Staged package opencensus-contrib-grpc-util-0.28.0-uRaDRuavZZMwChvCfvdCVKofJAGYhZON2PuFK4d9VfA.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/opencensus-contrib-grpc-util-0.28.0-uRaDRuavZZMwChvCfvdCVKofJAGYhZON2PuFK4d9VfA.jar' is inaccessible.
Aug 08, 2021 3:54:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-08T15:54:40.900Z: Staged package proto-google-cloud-bigquerystorage-v1-1.17.0-95Kd13lib16MutfGTvzMCJqbS65ZQNT9VRHgBwWtNQE.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/proto-google-cloud-bigquerystorage-v1-1.17.0-95Kd13lib16MutfGTvzMCJqbS65ZQNT9VRHgBwWtNQE.jar' is inaccessible.
Aug 08, 2021 3:54:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-08T15:54:40.934Z: Staged package proto-google-cloud-bigquerystorage-v1beta1-0.117.0-pK3SZjZI7_R19YB-f6BAjzEvPBP51B8g0W3RCLvzipc.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/proto-google-cloud-bigquerystorage-v1beta1-0.117.0-pK3SZjZI7_R19YB-f6BAjzEvPBP51B8g0W3RCLvzipc.jar' is inaccessible.
Aug 08, 2021 3:54:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-08T15:54:40.966Z: Staged package proto-google-cloud-bigquerystorage-v1beta2-0.117.0-z1LoKma-K7JKLlprGXj2bIBy022pp9EfUhh25dTn0Ow.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/proto-google-cloud-bigquerystorage-v1beta2-0.117.0-z1LoKma-K7JKLlprGXj2bIBy022pp9EfUhh25dTn0Ow.jar' is inaccessible.
Aug 08, 2021 3:54:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-08T15:54:41.001Z: Staged package proto-google-cloud-bigtable-admin-v2-1.22.0-8bSazr-ySDSZJEkzlM5BFKebDGKoNY6i7jy3ITx48xg.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/proto-google-cloud-bigtable-admin-v2-1.22.0-8bSazr-ySDSZJEkzlM5BFKebDGKoNY6i7jy3ITx48xg.jar' is inaccessible.
Aug 08, 2021 3:54:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-08T15:54:41.049Z: Staged package proto-google-cloud-bigtable-v2-1.22.0-Ms5-Knu0K7tG_UgdRO_j6rJsVypzQswBWLLNwf5coic.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/proto-google-cloud-bigtable-v2-1.22.0-Ms5-Knu0K7tG_UgdRO_j6rJsVypzQswBWLLNwf5coic.jar' is inaccessible.
Aug 08, 2021 3:54:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-08T15:54:41.099Z: Staged package proto-google-cloud-datastore-v1-0.89.0-hkM_w8_zlqdrJoDOXo3TSJYS03GQI6BxuM9xOBX9rOw.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/proto-google-cloud-datastore-v1-0.89.0-hkM_w8_zlqdrJoDOXo3TSJYS03GQI6BxuM9xOBX9rOw.jar' is inaccessible.
Aug 08, 2021 3:54:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-08T15:54:41.165Z: Staged package proto-google-cloud-pubsub-v1-1.94.0-r1Ij-HGZWHgOZ9Qf0ZbMASV2fcefR39R02Xxw5hEEcI.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/proto-google-cloud-pubsub-v1-1.94.0-r1Ij-HGZWHgOZ9Qf0ZbMASV2fcefR39R02Xxw5hEEcI.jar' is inaccessible.
Aug 08, 2021 3:54:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-08T15:54:41.258Z: Staged package proto-google-cloud-spanner-admin-database-v1-6.2.0-he117VVIvCnVX4p-eO1rG76etOGpA8L4fOe05Te65Go.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/proto-google-cloud-spanner-admin-database-v1-6.2.0-he117VVIvCnVX4p-eO1rG76etOGpA8L4fOe05Te65Go.jar' is inaccessible.
Aug 08, 2021 3:54:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-08T15:54:41.298Z: Staged package proto-google-cloud-spanner-admin-instance-v1-6.2.0-RRwYnG2iuMNY7JFZjHiAi508xBCHBI7EytAorrVOcg0.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/proto-google-cloud-spanner-admin-instance-v1-6.2.0-RRwYnG2iuMNY7JFZjHiAi508xBCHBI7EytAorrVOcg0.jar' is inaccessible.
Aug 08, 2021 3:54:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-08T15:54:41.339Z: Staged package proto-google-cloud-spanner-v1-6.2.0-Om3nWCqO9bQz9PEbtHTtFGRgNhKs1W0z0FQRF1md-7c.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/proto-google-cloud-spanner-v1-6.2.0-Om3nWCqO9bQz9PEbtHTtFGRgNhKs1W0z0FQRF1md-7c.jar' is inaccessible.
Aug 08, 2021 3:54:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-08T15:54:41.374Z: Staged package proto-google-common-protos-2.1.0-IEtnIIZzW2vwQX0hGOmeXeZDXWKbBJQAu9cXzWHPsFY.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/proto-google-common-protos-2.1.0-IEtnIIZzW2vwQX0hGOmeXeZDXWKbBJQAu9cXzWHPsFY.jar' is inaccessible.
Aug 08, 2021 3:54:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-08T15:54:41.412Z: Staged package proto-google-iam-v1-1.0.12-3LMBbLCJKGCoBUkJYvX3mSwYkfgRW8MRFd89jtgSUWw.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/proto-google-iam-v1-1.0.12-3LMBbLCJKGCoBUkJYvX3mSwYkfgRW8MRFd89jtgSUWw.jar' is inaccessible.
Aug 08, 2021 3:54:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-08T15:54:41.453Z: Staged package protobuf-java-3.15.8-jQ4vmDT0_BoIOmUjmtxQfKg2gsdUon9MgOTyGZDv9oY.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/protobuf-java-3.15.8-jQ4vmDT0_BoIOmUjmtxQfKg2gsdUon9MgOTyGZDv9oY.jar' is inaccessible.
Aug 08, 2021 3:54:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-08T15:54:41.486Z: Staged package protobuf-java-util-3.15.8-fw4vEAG-VPmjJB-dnuwng5h3x2SzCFLgZNuRKM8oGQE.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/protobuf-java-util-3.15.8-fw4vEAG-VPmjJB-dnuwng5h3x2SzCFLgZNuRKM8oGQE.jar' is inaccessible.
Aug 08, 2021 3:54:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-08T15:54:41.688Z: Staged package zstd-jni-1.4.5-2-lzQxwUtNCahuI7cYQRb8rC2FUB60p0MPfRhczhr0YFA.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/zstd-jni-1.4.5-2-lzQxwUtNCahuI7cYQRb8rC2FUB60p0MPfRhczhr0YFA.jar' is inaccessible.
Aug 08, 2021 3:54:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-08-08T15:54:41.707Z: One or more access checks for temp location or staged files failed. Please refer to other error messages for details. For more information on security and permissions, please see https://cloud.google.com/dataflow/security-and-permissions.
Aug 08, 2021 3:57:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-08-08T15:57:40.556Z: One or more access checks for temp location or staged files failed. Please refer to other error messages for details. For more information on security and permissions, please see https://cloud.google.com/dataflow/security-and-permissions.
Aug 08, 2021 4:00:35 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-08T16:00:35.347Z: Cancel request is committed for workflow job: 2021-08-08_05_42_24-10529978462652367556.
Aug 08, 2021 4:00:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-08T16:00:35.377Z: Cleaning up.
Aug 08, 2021 4:00:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-08T16:00:35.442Z: Stopping **** pool...
Aug 08, 2021 4:00:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-08T16:00:35.516Z: Stopping **** pool...
Aug 08, 2021 4:02:55 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-08T16:02:55.428Z: Autoscaling: Reduced the number of ****s to 0 based on low average **** CPU utilization, and the pipeline having sufficiently low backlog and keeping up with input rate.
Aug 08, 2021 4:02:55 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-08T16:02:55.498Z: Worker pool stopped.
Aug 08, 2021 4:03:03 PM org.apache.beam.runners.dataflow.DataflowPipelineJob logTerminalState
INFO: Job 2021-08-08_05_42_24-10529978462652367556 finished with status CANCELLED.
Aug 08, 2021 4:03:03 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric totalBytes.count, from namespace pardo
Load test results for test (ID): 8e7ace75-3b73-4b66-a513-e41a34a2b928 and timestamp: 2021-08-08T12:42:18.127000000Z:
Metric: Value:
dataflow_v2_java11_runtime_sec 0.0
dataflow_v2_java11_total_bytes_count -1.0
Exception in thread "main" java.lang.RuntimeException: Invalid job state: CANCELLED.
at org.apache.beam.sdk.loadtests.JobFailure.handleFailure(JobFailure.java:55)
at org.apache.beam.sdk.loadtests.LoadTest.run(LoadTest.java:141)
at org.apache.beam.sdk.loadtests.ParDoLoadTest.run(ParDoLoadTest.java:53)
at org.apache.beam.sdk.loadtests.ParDoLoadTest.main(ParDoLoadTest.java:103)
> Task :sdks:java:testing:load-tests:run FAILED
> Task :runners:google-cloud-dataflow-java:cleanUpDockerImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210808123735
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:8ec252428cf9a369c994cb1d7b3ed4d3346bb39f1e15bfea97303ce453c17724
Deleted: sha256:9c0ee0df8b66c4fbe2ec4d05f36072d0f16b1ccc069146f8f5ede8a7a9444d4d
Deleted: sha256:fb8de7d3a4753ec63e3a2d5aa3b65de748e695dc710745498eb359986969e5ca
Deleted: sha256:f2180ffb69e1d05f86b2e14de025bf5bf74408f6632d5b63e5ac036e4ab1b89a
Deleted: sha256:1790188c66ea7044782b0d784ef4fe8a3347e123f41a618018f22e8c2ec85ae6
Deleted: sha256:54ec6b53c9fd2c2607e50d8180afc229dab9479f5f3c57c291464d3e4fa1223a
Deleted: sha256:fb791d38fbf094b0c7cd894169bc6e625f46ec0e7f3807ff5b9673a8d2e174d6
Deleted: sha256:9a4b43280f1c27e19f9b8a0da06aac94d817481e7bd3a2f86fc25206bbef62a5
Deleted: sha256:d663a1a0d1b18882dbecb474a313495720849a2927ce6d80784af551c68e2dd7
Deleted: sha256:f86fb66238a607516c14cc13f518af897478e98af319d278d712014b269808fa
Deleted: sha256:0024501d532c864e0823f3105e91185e9e58d6e8371cd142221c5c24c3611afe
Deleted: sha256:3d7137ffbcb5dc24aeb6bae6afc0d4eac1c5260ffcafe28bcbdfcad3d70f9456
Deleted: sha256:3e247ae1839285e2dbfb4e28d21bb5bc88359e12d5e8e7075e2fd9930676d6fc
Deleted: sha256:a4c710e35bb0070434dcce768a93b36afd301c5bb2e3fed134f4105203d9e5e5
Deleted: sha256:731143548c65673501755a69045220da32a6d770e0791a2e3b3b86d4badff51f
Deleted: sha256:4a96831d626fa408701f860d375fab37527f00d594a3bfe327aad4fddb7a50a4
Deleted: sha256:3d03896595a724b9a692ac4bc87407777667c33e8c33026932e0cb13f78471b2
Deleted: sha256:ef5d4ec565bc6566ca5b2f31be60396e7c91f869f639dc9ed3b6d64be08073e0
Deleted: sha256:dc0e7ec905e039cfc6e1fd5c097a96310ac1ac6694d75672ee19f4e3f5d5994c
Deleted: sha256:f3d0e9b8fffd41e3a915f1fca22ee84f03b28ff1cfee4990e1463055e88a1356
Deleted: sha256:be18307110ca7a424f36325f1cab1ae01cedaaeda486897527e6ab148bf9507c
Deleted: sha256:05fcf605dfd7ba09d9ac47a8f86acc8ee312121237ec4cf43e24857ef7e5884d
Deleted: sha256:3213f1edc6a423a08c62c8c46d336b8e1d32ae5ea972306eecdd2ccab2caa68f
Deleted: sha256:6f1828b1117ca9136bc86668402e442449285bd559c1736c5009e8cdfd0dcd16
Deleted: sha256:a30d77d5051130bf94e4fac75edc6b7616531a30ffdc2336d28ad596f1219bdd
Deleted: sha256:cc28834295896075da9ca3697dd65c59472a6bf27801c22dfae7c111d5e557b1
Deleted: sha256:0f7024bc9a1ecb4f691cbac9ede159b436af4174eb2e6c0cb2bf22ab5ee07c57
Deleted: sha256:b776188c86c0db22a960c05800166b6bf7741210bd708242a3e7bb16903743ac
Deleted: sha256:e662739edc644ea3ccbb5b6c28ef858bbc7372c77c008f9dcfb9b19c1e4ecf6c
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210808123735]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:8ec252428cf9a369c994cb1d7b3ed4d3346bb39f1e15bfea97303ce453c17724]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210808123735] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:8ec252428cf9a369c994cb1d7b3ed4d3346bb39f1e15bfea97303ce453c17724])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:8ec252428cf9a369c994cb1d7b3ed4d3346bb39f1e15bfea97303ce453c17724
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:8ec252428cf9a369c994cb1d7b3ed4d3346bb39f1e15bfea97303ce453c17724
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:8ec252428cf9a369c994cb1d7b3ed4d3346bb39f1e15bfea97303ce453c17724].
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:testing:load-tests:run'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 3h 25m 47s
107 actionable tasks: 76 executed, 29 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/osadz544mwffk
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins:
beam_LoadTests_Java_ParDo_Dataflow_V2_Streaming_Java11 #51
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Java_ParDo_Dataflow_V2_Streaming_Java11/51/display/redirect?page=changes>
Changes:
[noreply] [BEAM-10212] Integrate caching client (#15214)
[noreply] Merge pull request #15249: [BEAM-12690] Fix GroupIntoBatches watermark
[noreply] Merge pull request #15246 from [BEAM-12685] Allow managed thread count
------------------------------------------
[...truncated 75.83 KB...]
Aug 07, 2021 12:42:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-07T12:42:33.769Z: Fusing consumer Read input/ParDo(StripIds)/ParMultiDo(StripIds) into Read-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/ProcessElementAndRestrictionWithSizing
Aug 07, 2021 12:42:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-07T12:42:33.799Z: Fusing consumer ParDo(TimeMonitor)/ParMultiDo(TimeMonitor) into Read input/ParDo(StripIds)/ParMultiDo(StripIds)
Aug 07, 2021 12:42:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-07T12:42:33.834Z: Fusing consumer ParDo(ByteMonitor)/ParMultiDo(ByteMonitor) into ParDo(TimeMonitor)/ParMultiDo(TimeMonitor)
Aug 07, 2021 12:42:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-07T12:42:33.871Z: Fusing consumer Step: 0/ParMultiDo(CounterOperation) into ParDo(ByteMonitor)/ParMultiDo(ByteMonitor)
Aug 07, 2021 12:42:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-07T12:42:33.903Z: Fusing consumer Step: 1/ParMultiDo(CounterOperation) into Step: 0/ParMultiDo(CounterOperation)
Aug 07, 2021 12:42:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-07T12:42:33.927Z: Fusing consumer Step: 2/ParMultiDo(CounterOperation) into Step: 1/ParMultiDo(CounterOperation)
Aug 07, 2021 12:42:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-07T12:42:33.951Z: Fusing consumer Step: 3/ParMultiDo(CounterOperation) into Step: 2/ParMultiDo(CounterOperation)
Aug 07, 2021 12:42:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-07T12:42:33.975Z: Fusing consumer Step: 4/ParMultiDo(CounterOperation) into Step: 3/ParMultiDo(CounterOperation)
Aug 07, 2021 12:42:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-07T12:42:34.003Z: Fusing consumer Step: 5/ParMultiDo(CounterOperation) into Step: 4/ParMultiDo(CounterOperation)
Aug 07, 2021 12:42:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-07T12:42:34.026Z: Fusing consumer Step: 6/ParMultiDo(CounterOperation) into Step: 5/ParMultiDo(CounterOperation)
Aug 07, 2021 12:42:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-07T12:42:34.061Z: Fusing consumer Step: 7/ParMultiDo(CounterOperation) into Step: 6/ParMultiDo(CounterOperation)
Aug 07, 2021 12:42:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-07T12:42:34.085Z: Fusing consumer Step: 8/ParMultiDo(CounterOperation) into Step: 7/ParMultiDo(CounterOperation)
Aug 07, 2021 12:42:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-07T12:42:34.116Z: Fusing consumer Step: 9/ParMultiDo(CounterOperation) into Step: 8/ParMultiDo(CounterOperation)
Aug 07, 2021 12:42:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-07T12:42:34.151Z: Fusing consumer ParDo(TimeMonitor)2/ParMultiDo(TimeMonitor) into Step: 9/ParMultiDo(CounterOperation)
Aug 07, 2021 12:42:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-07T12:42:34.581Z: Starting 5 ****s in us-central1-a...
Aug 07, 2021 12:42:54 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-07T12:42:54.220Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete
Aug 07, 2021 12:43:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-07T12:43:26.120Z: Autoscaling: Raised the number of ****s to 5 so that the pipeline can catch up with its backlog and keep up with its input rate.
Aug 07, 2021 12:44:22 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-07T12:44:21.803Z: Workers have started successfully.
Aug 07, 2021 12:44:22 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-07T12:44:21.842Z: Workers have started successfully.
Aug 07, 2021 3:33:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-07T15:33:35.484Z: Staged package beam-sdks-java-io-kinesis-2.33.0-SNAPSHOT-l-wlPwuqL3JoShJc8MdSNmXKDFI5maGcuJPHhyiddpA.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/beam-sdks-java-io-kinesis-2.33.0-SNAPSHOT-l-wlPwuqL3JoShJc8MdSNmXKDFI5maGcuJPHhyiddpA.jar' is inaccessible.
Aug 07, 2021 3:33:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-07T15:33:35.580Z: Staged package beam-sdks-java-load-tests-2.33.0-SNAPSHOT-V9yHrJQiSt9kiJZ7EuXMHFTsASG3sfXHAWinjagDbFA.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/beam-sdks-java-load-tests-2.33.0-SNAPSHOT-V9yHrJQiSt9kiJZ7EuXMHFTsASG3sfXHAWinjagDbFA.jar' is inaccessible.
Aug 07, 2021 3:33:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-07T15:33:35.673Z: Staged package beam-vendor-grpc-1_36_0-0.2-FOu94RegK8zFq2op7b1CeJprMEONKvFs2JFoeFWpqFU.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/beam-vendor-grpc-1_36_0-0.2-FOu94RegK8zFq2op7b1CeJprMEONKvFs2JFoeFWpqFU.jar' is inaccessible.
Aug 07, 2021 3:33:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-07T15:33:35.883Z: Staged package common-config-5.3.2-B_HQvj7POWJFHkM1OEwdiS2Y6zStZi7OXoiw-BJN7Nc.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/common-config-5.3.2-B_HQvj7POWJFHkM1OEwdiS2Y6zStZi7OXoiw-BJN7Nc.jar' is inaccessible.
Aug 07, 2021 3:33:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-07T15:33:35.955Z: Staged package common-utils-5.3.2-4Rm-xdfQw0Yp9EH6ym0CZyPloNIGMAJ4b5DO_bByg9c.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/common-utils-5.3.2-4Rm-xdfQw0Yp9EH6ym0CZyPloNIGMAJ4b5DO_bByg9c.jar' is inaccessible.
Aug 07, 2021 3:33:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-07T15:33:37.893Z: Staged package kafka-avro-serializer-5.3.2-7FAoV2nngjZLbCXD3IPBOus_R_2KrM_zffAaNlVOls4.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/kafka-avro-serializer-5.3.2-7FAoV2nngjZLbCXD3IPBOus_R_2KrM_zffAaNlVOls4.jar' is inaccessible.
Aug 07, 2021 3:33:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-07T15:33:37.956Z: Staged package kafka-schema-registry-client-5.3.2-0mGQmXEF1E2hwRsR-O-mddgC_DwcNIU4Ba9SQcw2hKY.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/kafka-schema-registry-client-5.3.2-0mGQmXEF1E2hwRsR-O-mddgC_DwcNIU4Ba9SQcw2hKY.jar' is inaccessible.
Aug 07, 2021 3:33:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-07T15:33:38.699Z: Staged package spring-core-4.3.18.RELEASE-qd-hKocv03STfOrJiihBIfzwVyBqE8q9UnPLPqutu2w.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/spring-core-4.3.18.RELEASE-qd-hKocv03STfOrJiihBIfzwVyBqE8q9UnPLPqutu2w.jar' is inaccessible.
Aug 07, 2021 3:33:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-07T15:33:38.744Z: Staged package spring-expression-4.3.18.RELEASE-aB3PS8pe5rtvJwR2BF3WrB6nO_rdEY2KpkFz7bel1_A.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/spring-expression-4.3.18.RELEASE-aB3PS8pe5rtvJwR2BF3WrB6nO_rdEY2KpkFz7bel1_A.jar' is inaccessible.
Aug 07, 2021 3:33:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-07T15:33:38.829Z: Staged package zkclient-0.10-JumIuLuoOMck_YNQszHui1_8WcOpwHTfEVxMOmyEOHg.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/zkclient-0.10-JumIuLuoOMck_YNQszHui1_8WcOpwHTfEVxMOmyEOHg.jar' is inaccessible.
Aug 07, 2021 3:33:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-08-07T15:33:38.869Z: One or more access checks for temp location or staged files failed. Please refer to other error messages for details. For more information on security and permissions, please see https://cloud.google.com/dataflow/security-and-permissions.
Aug 07, 2021 3:36:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-08-07T15:36:38.362Z: One or more access checks for temp location or staged files failed. Please refer to other error messages for details. For more information on security and permissions, please see https://cloud.google.com/dataflow/security-and-permissions.
Aug 07, 2021 3:39:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-07T15:39:35.476Z: Staged package beam-sdks-java-io-kinesis-2.33.0-SNAPSHOT-l-wlPwuqL3JoShJc8MdSNmXKDFI5maGcuJPHhyiddpA.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/beam-sdks-java-io-kinesis-2.33.0-SNAPSHOT-l-wlPwuqL3JoShJc8MdSNmXKDFI5maGcuJPHhyiddpA.jar' is inaccessible.
Aug 07, 2021 3:39:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-07T15:39:35.566Z: Staged package beam-sdks-java-load-tests-2.33.0-SNAPSHOT-V9yHrJQiSt9kiJZ7EuXMHFTsASG3sfXHAWinjagDbFA.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/beam-sdks-java-load-tests-2.33.0-SNAPSHOT-V9yHrJQiSt9kiJZ7EuXMHFTsASG3sfXHAWinjagDbFA.jar' is inaccessible.
Aug 07, 2021 3:39:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-07T15:39:35.654Z: Staged package beam-vendor-grpc-1_36_0-0.2-FOu94RegK8zFq2op7b1CeJprMEONKvFs2JFoeFWpqFU.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/beam-vendor-grpc-1_36_0-0.2-FOu94RegK8zFq2op7b1CeJprMEONKvFs2JFoeFWpqFU.jar' is inaccessible.
Aug 07, 2021 3:39:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-07T15:39:35.815Z: Staged package common-config-5.3.2-B_HQvj7POWJFHkM1OEwdiS2Y6zStZi7OXoiw-BJN7Nc.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/common-config-5.3.2-B_HQvj7POWJFHkM1OEwdiS2Y6zStZi7OXoiw-BJN7Nc.jar' is inaccessible.
Aug 07, 2021 3:39:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-07T15:39:35.855Z: Staged package common-utils-5.3.2-4Rm-xdfQw0Yp9EH6ym0CZyPloNIGMAJ4b5DO_bByg9c.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/common-utils-5.3.2-4Rm-xdfQw0Yp9EH6ym0CZyPloNIGMAJ4b5DO_bByg9c.jar' is inaccessible.
Aug 07, 2021 3:39:40 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-07T15:39:38.649Z: Staged package kafka-avro-serializer-5.3.2-7FAoV2nngjZLbCXD3IPBOus_R_2KrM_zffAaNlVOls4.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/kafka-avro-serializer-5.3.2-7FAoV2nngjZLbCXD3IPBOus_R_2KrM_zffAaNlVOls4.jar' is inaccessible.
Aug 07, 2021 3:39:40 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-07T15:39:38.734Z: Staged package kafka-schema-registry-client-5.3.2-0mGQmXEF1E2hwRsR-O-mddgC_DwcNIU4Ba9SQcw2hKY.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/kafka-schema-registry-client-5.3.2-0mGQmXEF1E2hwRsR-O-mddgC_DwcNIU4Ba9SQcw2hKY.jar' is inaccessible.
Aug 07, 2021 3:39:40 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-07T15:39:39.869Z: Staged package spring-core-4.3.18.RELEASE-qd-hKocv03STfOrJiihBIfzwVyBqE8q9UnPLPqutu2w.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/spring-core-4.3.18.RELEASE-qd-hKocv03STfOrJiihBIfzwVyBqE8q9UnPLPqutu2w.jar' is inaccessible.
Aug 07, 2021 3:39:40 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-07T15:39:39.916Z: Staged package spring-expression-4.3.18.RELEASE-aB3PS8pe5rtvJwR2BF3WrB6nO_rdEY2KpkFz7bel1_A.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/spring-expression-4.3.18.RELEASE-aB3PS8pe5rtvJwR2BF3WrB6nO_rdEY2KpkFz7bel1_A.jar' is inaccessible.
Aug 07, 2021 3:39:40 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-07T15:39:40.003Z: Staged package zkclient-0.10-JumIuLuoOMck_YNQszHui1_8WcOpwHTfEVxMOmyEOHg.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/zkclient-0.10-JumIuLuoOMck_YNQszHui1_8WcOpwHTfEVxMOmyEOHg.jar' is inaccessible.
Aug 07, 2021 3:39:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-08-07T15:39:40.039Z: One or more access checks for temp location or staged files failed. Please refer to other error messages for details. For more information on security and permissions, please see https://cloud.google.com/dataflow/security-and-permissions.
Aug 07, 2021 3:42:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-08-07T15:42:38.200Z: One or more access checks for temp location or staged files failed. Please refer to other error messages for details. For more information on security and permissions, please see https://cloud.google.com/dataflow/security-and-permissions.
Aug 07, 2021 3:45:35 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-07T15:45:35.290Z: Staged package beam-sdks-java-io-kinesis-2.33.0-SNAPSHOT-l-wlPwuqL3JoShJc8MdSNmXKDFI5maGcuJPHhyiddpA.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/beam-sdks-java-io-kinesis-2.33.0-SNAPSHOT-l-wlPwuqL3JoShJc8MdSNmXKDFI5maGcuJPHhyiddpA.jar' is inaccessible.
Aug 07, 2021 3:45:35 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-07T15:45:35.365Z: Staged package beam-sdks-java-load-tests-2.33.0-SNAPSHOT-V9yHrJQiSt9kiJZ7EuXMHFTsASG3sfXHAWinjagDbFA.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/beam-sdks-java-load-tests-2.33.0-SNAPSHOT-V9yHrJQiSt9kiJZ7EuXMHFTsASG3sfXHAWinjagDbFA.jar' is inaccessible.
Aug 07, 2021 3:45:35 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-07T15:45:35.436Z: Staged package beam-vendor-grpc-1_36_0-0.2-FOu94RegK8zFq2op7b1CeJprMEONKvFs2JFoeFWpqFU.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/beam-vendor-grpc-1_36_0-0.2-FOu94RegK8zFq2op7b1CeJprMEONKvFs2JFoeFWpqFU.jar' is inaccessible.
Aug 07, 2021 3:45:35 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-07T15:45:35.600Z: Staged package common-config-5.3.2-B_HQvj7POWJFHkM1OEwdiS2Y6zStZi7OXoiw-BJN7Nc.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/common-config-5.3.2-B_HQvj7POWJFHkM1OEwdiS2Y6zStZi7OXoiw-BJN7Nc.jar' is inaccessible.
Aug 07, 2021 3:45:35 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-07T15:45:35.642Z: Staged package common-utils-5.3.2-4Rm-xdfQw0Yp9EH6ym0CZyPloNIGMAJ4b5DO_bByg9c.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/common-utils-5.3.2-4Rm-xdfQw0Yp9EH6ym0CZyPloNIGMAJ4b5DO_bByg9c.jar' is inaccessible.
Aug 07, 2021 3:45:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-07T15:45:37.919Z: Staged package kafka-avro-serializer-5.3.2-7FAoV2nngjZLbCXD3IPBOus_R_2KrM_zffAaNlVOls4.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/kafka-avro-serializer-5.3.2-7FAoV2nngjZLbCXD3IPBOus_R_2KrM_zffAaNlVOls4.jar' is inaccessible.
Aug 07, 2021 3:45:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-07T15:45:37.981Z: Staged package kafka-schema-registry-client-5.3.2-0mGQmXEF1E2hwRsR-O-mddgC_DwcNIU4Ba9SQcw2hKY.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/kafka-schema-registry-client-5.3.2-0mGQmXEF1E2hwRsR-O-mddgC_DwcNIU4Ba9SQcw2hKY.jar' is inaccessible.
Aug 07, 2021 3:45:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-07T15:45:38.887Z: Staged package spring-core-4.3.18.RELEASE-qd-hKocv03STfOrJiihBIfzwVyBqE8q9UnPLPqutu2w.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/spring-core-4.3.18.RELEASE-qd-hKocv03STfOrJiihBIfzwVyBqE8q9UnPLPqutu2w.jar' is inaccessible.
Aug 07, 2021 3:45:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-07T15:45:38.953Z: Staged package spring-expression-4.3.18.RELEASE-aB3PS8pe5rtvJwR2BF3WrB6nO_rdEY2KpkFz7bel1_A.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/spring-expression-4.3.18.RELEASE-aB3PS8pe5rtvJwR2BF3WrB6nO_rdEY2KpkFz7bel1_A.jar' is inaccessible.
Aug 07, 2021 3:45:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-07T15:45:39.075Z: Staged package zkclient-0.10-JumIuLuoOMck_YNQszHui1_8WcOpwHTfEVxMOmyEOHg.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/zkclient-0.10-JumIuLuoOMck_YNQszHui1_8WcOpwHTfEVxMOmyEOHg.jar' is inaccessible.
Aug 07, 2021 3:45:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-08-07T15:45:39.123Z: One or more access checks for temp location or staged files failed. Please refer to other error messages for details. For more information on security and permissions, please see https://cloud.google.com/dataflow/security-and-permissions.
Aug 07, 2021 3:48:40 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-08-07T15:48:38.954Z: One or more access checks for temp location or staged files failed. Please refer to other error messages for details. For more information on security and permissions, please see https://cloud.google.com/dataflow/security-and-permissions.
Aug 07, 2021 3:51:35 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-07T15:51:35.325Z: Staged package beam-sdks-java-io-kinesis-2.33.0-SNAPSHOT-l-wlPwuqL3JoShJc8MdSNmXKDFI5maGcuJPHhyiddpA.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/beam-sdks-java-io-kinesis-2.33.0-SNAPSHOT-l-wlPwuqL3JoShJc8MdSNmXKDFI5maGcuJPHhyiddpA.jar' is inaccessible.
Aug 07, 2021 3:51:35 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-07T15:51:35.397Z: Staged package beam-sdks-java-load-tests-2.33.0-SNAPSHOT-V9yHrJQiSt9kiJZ7EuXMHFTsASG3sfXHAWinjagDbFA.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/beam-sdks-java-load-tests-2.33.0-SNAPSHOT-V9yHrJQiSt9kiJZ7EuXMHFTsASG3sfXHAWinjagDbFA.jar' is inaccessible.
Aug 07, 2021 3:51:35 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-07T15:51:35.506Z: Staged package beam-vendor-grpc-1_36_0-0.2-FOu94RegK8zFq2op7b1CeJprMEONKvFs2JFoeFWpqFU.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/beam-vendor-grpc-1_36_0-0.2-FOu94RegK8zFq2op7b1CeJprMEONKvFs2JFoeFWpqFU.jar' is inaccessible.
Aug 07, 2021 3:51:35 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-07T15:51:35.680Z: Staged package common-config-5.3.2-B_HQvj7POWJFHkM1OEwdiS2Y6zStZi7OXoiw-BJN7Nc.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/common-config-5.3.2-B_HQvj7POWJFHkM1OEwdiS2Y6zStZi7OXoiw-BJN7Nc.jar' is inaccessible.
Aug 07, 2021 3:51:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-07T15:51:35.726Z: Staged package common-utils-5.3.2-4Rm-xdfQw0Yp9EH6ym0CZyPloNIGMAJ4b5DO_bByg9c.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/common-utils-5.3.2-4Rm-xdfQw0Yp9EH6ym0CZyPloNIGMAJ4b5DO_bByg9c.jar' is inaccessible.
Aug 07, 2021 3:51:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-07T15:51:37.651Z: Staged package kafka-avro-serializer-5.3.2-7FAoV2nngjZLbCXD3IPBOus_R_2KrM_zffAaNlVOls4.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/kafka-avro-serializer-5.3.2-7FAoV2nngjZLbCXD3IPBOus_R_2KrM_zffAaNlVOls4.jar' is inaccessible.
Aug 07, 2021 3:51:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-07T15:51:37.717Z: Staged package kafka-schema-registry-client-5.3.2-0mGQmXEF1E2hwRsR-O-mddgC_DwcNIU4Ba9SQcw2hKY.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/kafka-schema-registry-client-5.3.2-0mGQmXEF1E2hwRsR-O-mddgC_DwcNIU4Ba9SQcw2hKY.jar' is inaccessible.
Aug 07, 2021 3:51:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-07T15:51:38.481Z: Staged package spring-core-4.3.18.RELEASE-qd-hKocv03STfOrJiihBIfzwVyBqE8q9UnPLPqutu2w.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/spring-core-4.3.18.RELEASE-qd-hKocv03STfOrJiihBIfzwVyBqE8q9UnPLPqutu2w.jar' is inaccessible.
Aug 07, 2021 3:51:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-07T15:51:38.525Z: Staged package spring-expression-4.3.18.RELEASE-aB3PS8pe5rtvJwR2BF3WrB6nO_rdEY2KpkFz7bel1_A.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/spring-expression-4.3.18.RELEASE-aB3PS8pe5rtvJwR2BF3WrB6nO_rdEY2KpkFz7bel1_A.jar' is inaccessible.
Aug 07, 2021 3:51:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-07T15:51:38.629Z: Staged package zkclient-0.10-JumIuLuoOMck_YNQszHui1_8WcOpwHTfEVxMOmyEOHg.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/zkclient-0.10-JumIuLuoOMck_YNQszHui1_8WcOpwHTfEVxMOmyEOHg.jar' is inaccessible.
Aug 07, 2021 3:51:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-08-07T15:51:38.662Z: One or more access checks for temp location or staged files failed. Please refer to other error messages for details. For more information on security and permissions, please see https://cloud.google.com/dataflow/security-and-permissions.
Aug 07, 2021 3:54:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-08-07T15:54:38.361Z: One or more access checks for temp location or staged files failed. Please refer to other error messages for details. For more information on security and permissions, please see https://cloud.google.com/dataflow/security-and-permissions.
Aug 07, 2021 3:57:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-07T15:57:35.286Z: Staged package beam-sdks-java-io-kinesis-2.33.0-SNAPSHOT-l-wlPwuqL3JoShJc8MdSNmXKDFI5maGcuJPHhyiddpA.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/beam-sdks-java-io-kinesis-2.33.0-SNAPSHOT-l-wlPwuqL3JoShJc8MdSNmXKDFI5maGcuJPHhyiddpA.jar' is inaccessible.
Aug 07, 2021 3:57:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-07T15:57:35.348Z: Staged package beam-sdks-java-load-tests-2.33.0-SNAPSHOT-V9yHrJQiSt9kiJZ7EuXMHFTsASG3sfXHAWinjagDbFA.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/beam-sdks-java-load-tests-2.33.0-SNAPSHOT-V9yHrJQiSt9kiJZ7EuXMHFTsASG3sfXHAWinjagDbFA.jar' is inaccessible.
Aug 07, 2021 3:57:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-07T15:57:35.449Z: Staged package beam-vendor-grpc-1_36_0-0.2-FOu94RegK8zFq2op7b1CeJprMEONKvFs2JFoeFWpqFU.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/beam-vendor-grpc-1_36_0-0.2-FOu94RegK8zFq2op7b1CeJprMEONKvFs2JFoeFWpqFU.jar' is inaccessible.
Aug 07, 2021 3:57:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-07T15:57:35.632Z: Staged package common-config-5.3.2-B_HQvj7POWJFHkM1OEwdiS2Y6zStZi7OXoiw-BJN7Nc.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/common-config-5.3.2-B_HQvj7POWJFHkM1OEwdiS2Y6zStZi7OXoiw-BJN7Nc.jar' is inaccessible.
Aug 07, 2021 3:57:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-07T15:57:35.673Z: Staged package common-utils-5.3.2-4Rm-xdfQw0Yp9EH6ym0CZyPloNIGMAJ4b5DO_bByg9c.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/common-utils-5.3.2-4Rm-xdfQw0Yp9EH6ym0CZyPloNIGMAJ4b5DO_bByg9c.jar' is inaccessible.
Aug 07, 2021 3:57:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-07T15:57:37.532Z: Staged package kafka-avro-serializer-5.3.2-7FAoV2nngjZLbCXD3IPBOus_R_2KrM_zffAaNlVOls4.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/kafka-avro-serializer-5.3.2-7FAoV2nngjZLbCXD3IPBOus_R_2KrM_zffAaNlVOls4.jar' is inaccessible.
Aug 07, 2021 3:57:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-07T15:57:37.594Z: Staged package kafka-schema-registry-client-5.3.2-0mGQmXEF1E2hwRsR-O-mddgC_DwcNIU4Ba9SQcw2hKY.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/kafka-schema-registry-client-5.3.2-0mGQmXEF1E2hwRsR-O-mddgC_DwcNIU4Ba9SQcw2hKY.jar' is inaccessible.
Aug 07, 2021 3:57:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-07T15:57:38.360Z: Staged package spring-core-4.3.18.RELEASE-qd-hKocv03STfOrJiihBIfzwVyBqE8q9UnPLPqutu2w.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/spring-core-4.3.18.RELEASE-qd-hKocv03STfOrJiihBIfzwVyBqE8q9UnPLPqutu2w.jar' is inaccessible.
Aug 07, 2021 3:57:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-07T15:57:38.402Z: Staged package spring-expression-4.3.18.RELEASE-aB3PS8pe5rtvJwR2BF3WrB6nO_rdEY2KpkFz7bel1_A.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/spring-expression-4.3.18.RELEASE-aB3PS8pe5rtvJwR2BF3WrB6nO_rdEY2KpkFz7bel1_A.jar' is inaccessible.
Aug 07, 2021 3:57:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-07T15:57:38.501Z: Staged package zkclient-0.10-JumIuLuoOMck_YNQszHui1_8WcOpwHTfEVxMOmyEOHg.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/zkclient-0.10-JumIuLuoOMck_YNQszHui1_8WcOpwHTfEVxMOmyEOHg.jar' is inaccessible.
Aug 07, 2021 3:57:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-08-07T15:57:38.563Z: One or more access checks for temp location or staged files failed. Please refer to other error messages for details. For more information on security and permissions, please see https://cloud.google.com/dataflow/security-and-permissions.
Aug 07, 2021 4:00:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-08-07T16:00:38.965Z: One or more access checks for temp location or staged files failed. Please refer to other error messages for details. For more information on security and permissions, please see https://cloud.google.com/dataflow/security-and-permissions.
Aug 07, 2021 4:00:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-07T16:00:51.204Z: Cancel request is committed for workflow job: 2021-08-07_05_42_22-4749340171415216659.
Aug 07, 2021 4:00:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-07T16:00:51.236Z: Cleaning up.
Aug 07, 2021 4:00:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-07T16:00:51.327Z: Stopping **** pool...
Aug 07, 2021 4:00:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-07T16:00:51.369Z: Stopping **** pool...
Aug 07, 2021 4:03:06 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-07T16:03:06.106Z: Autoscaling: Reduced the number of ****s to 0 based on low average **** CPU utilization, and the pipeline having sufficiently low backlog and keeping up with input rate.
Aug 07, 2021 4:03:06 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-07T16:03:06.138Z: Worker pool stopped.
Aug 07, 2021 4:03:12 PM org.apache.beam.runners.dataflow.DataflowPipelineJob logTerminalState
INFO: Job 2021-08-07_05_42_22-4749340171415216659 finished with status CANCELLED.
Aug 07, 2021 4:03:12 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric totalBytes.count, from namespace pardo
Load test results for test (ID): 7125aa17-2c1e-4703-ae48-ea84853cb7a3 and timestamp: 2021-08-07T12:42:17.347000000Z:
Metric: Value:
dataflow_v2_java11_runtime_sec 0.0
dataflow_v2_java11_total_bytes_count -1.0
Exception in thread "main" java.lang.RuntimeException: Invalid job state: CANCELLED.
at org.apache.beam.sdk.loadtests.JobFailure.handleFailure(JobFailure.java:55)
at org.apache.beam.sdk.loadtests.LoadTest.run(LoadTest.java:141)
at org.apache.beam.sdk.loadtests.ParDoLoadTest.run(ParDoLoadTest.java:53)
at org.apache.beam.sdk.loadtests.ParDoLoadTest.main(ParDoLoadTest.java:103)
> Task :sdks:java:testing:load-tests:run FAILED
> Task :runners:google-cloud-dataflow-java:cleanUpDockerImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210807123735
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:56a43e81ab3da8844f90333234e72125cb593df97a923e9769ab26bc54229cb9
Deleted: sha256:6a77f918a6f5254f633b157e7001897361367f7a8720206e7909ddd178969946
Deleted: sha256:1e1d53bc428c7c86d04a2075dc060265814a4216bd8e62dbb59f0b509e1a50f9
Deleted: sha256:e3cd5bc07c57592b01f27765c0ba6f2f7e15d835d9266579e7c17b71f38a706c
Deleted: sha256:4472e11506710185fa5e5ec979484d2886d4fd3a673550267a118e92c1b36fc0
Deleted: sha256:1e539af4ffb74aff13a69e14760255eedbea214625f38a2b1439de9fa4f8ed14
Deleted: sha256:43b79d22a9dc6ce0fa11745b5764db999cc60bc70b33ad34ae92dc1cc1a75579
Deleted: sha256:25924679e88ea687e952024f96cd8cfe6bb842f09ff1c2b45ac9cfa209680eae
Deleted: sha256:2bb451e68fd68e11694d066c0f5aaeb7490acda0fd61558d2ededf3f75ca583c
Deleted: sha256:575e5ac9d11bf9dc23165b7fb623d0b8eccf8e95cc6afc2d20a20540acec1a59
Deleted: sha256:5451211fb69f347fe5537e3e1027dd9997adcacdbacac21f5dba13a5b5dd361b
Deleted: sha256:75cfd4c5d447515bc465a96910100d06a9af499c8f719c9f98201886ee3ec5c5
Deleted: sha256:a77310a0c1f37432843d5ae38446fa1d2fda2c1c97ecec0471abf77e7cf964e8
Deleted: sha256:5aaf5d877bfe2d2018b804f9119f00829606376817b2e3801584e3bbdcf049ed
Deleted: sha256:27b1ba9154b7962b9962c161c5f7820ce796b5cc593672036afa22e5b4405596
Deleted: sha256:34b53eeaeaf41e677b2a7ae457ac470199d257eb75610f49c3a7745316920b2a
Deleted: sha256:f2ecf53a25eff314f9acfd9a95056a27051d59fcd28e1e47d44464dd5d7561dd
Deleted: sha256:c85816b3f846d835aa936d7804b0e29d522cd55db136471a05e68feebffd07cd
Deleted: sha256:fca7c06084f124b1d17c23f460d111d9edd11025c5b31714cb7de6d415837f7a
Deleted: sha256:4e8e784c9b74c0fa057cc657802f444640af528d6f1c6be4486cb89f8224de8c
Deleted: sha256:c8fad7149ce7ccf9fcb60fceede8b6a029ed0a35faaaed25517132fd1cff23d7
Deleted: sha256:49723a65319130508c9bc595d910debdc8efc030c89acf1dbcf084e992247b0c
Deleted: sha256:9607ea7e1c8f39285f800b45564c649628a8826b60342b63eb7a6a6911817133
Deleted: sha256:a7350e4ec88ccbd34d19dc351e56361487f6101366bcdd12f977f4204d4ba179
Deleted: sha256:154727b52ddc0ebf87f67d97b21f6c1ef191567ee494a54343e8f0aca0ba587e
Deleted: sha256:40e4228e5075b67c9deeaaa48074f5db9a0d5eaf4edee36906f9ef323adc4a9b
Deleted: sha256:4c52575b67cee416664dc3586da0d5ae1727031a57b3230d7ca28e66822c8dfa
Deleted: sha256:0b7a56cb92ffaa35e0a1533b810873fe9f12a5fd044216dc2c57f9d5652310fc
Deleted: sha256:ee0a33a1d14c04760dfca115bcedbb97593ac7ef22164544d375bbcd757025b4
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210807123735]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:56a43e81ab3da8844f90333234e72125cb593df97a923e9769ab26bc54229cb9]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210807123735] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:56a43e81ab3da8844f90333234e72125cb593df97a923e9769ab26bc54229cb9])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:56a43e81ab3da8844f90333234e72125cb593df97a923e9769ab26bc54229cb9
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:56a43e81ab3da8844f90333234e72125cb593df97a923e9769ab26bc54229cb9
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:56a43e81ab3da8844f90333234e72125cb593df97a923e9769ab26bc54229cb9].
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:testing:load-tests:run'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 3h 25m 54s
107 actionable tasks: 76 executed, 29 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/iwkl425yososa
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins:
beam_LoadTests_Java_ParDo_Dataflow_V2_Streaming_Java11 #50
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Java_ParDo_Dataflow_V2_Streaming_Java11/50/display/redirect?page=changes>
Changes:
[emilyye] bump FnAPI container
[noreply] [BEAM-12601] Add append-only option (#15257)
[noreply] Revert "[BEAM-11934] Remove Dataflow override of streaming WriteFiles
[andyxu] Add google cloud heap profiling support to beam java sdk container
[Ismaël MejÃa] [BEAM-12628] Add Avro reflect-based Coder option
------------------------------------------
[...truncated 63.74 KB...]
> Task :runners:google-cloud-dataflow-java:buildAndPushDockerContainer
WARNING: `gcloud docker` will not be supported for Docker client versions above 18.03.
As an alternative, use `gcloud auth configure-docker` to configure `docker` to
use `gcloud` as a credential helper, then use `docker` as you would for non-GCR
registries, e.g. `docker pull gcr.io/project-id/my-image`. Add
`--verbosity=error` to silence this warning: `gcloud docker
--verbosity=error -- pull gcr.io/project-id/my-image`.
See: https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker
The push refers to repository [us.gcr.io/apache-beam-testing/java-postcommit-it/java]
08341044b606: Preparing
903d95bdf484: Preparing
6f1e82fceb00: Preparing
427373174f4b: Preparing
8d8e574b2551: Preparing
d209d6e30c68: Preparing
a7aa8d4ca0c3: Preparing
6e042233be87: Preparing
cd68adf8437f: Preparing
e8231fd8e488: Preparing
5fca4478b51f: Preparing
94cf2581f595: Preparing
f42aed5f7feb: Preparing
89819bafde36: Preparing
f3d5b8f65132: Preparing
ad83f0aa5c0a: Preparing
5a9a65095453: Preparing
4b0edb23340c: Preparing
afa3e488a0ee: Preparing
d209d6e30c68: Waiting
a7aa8d4ca0c3: Waiting
4b0edb23340c: Waiting
6e042233be87: Waiting
afa3e488a0ee: Waiting
f3d5b8f65132: Waiting
cd68adf8437f: Waiting
5a9a65095453: Waiting
ad83f0aa5c0a: Waiting
e8231fd8e488: Waiting
89819bafde36: Waiting
5fca4478b51f: Waiting
94cf2581f595: Waiting
903d95bdf484: Pushed
6f1e82fceb00: Pushed
8d8e574b2551: Pushed
08341044b606: Pushed
d209d6e30c68: Pushed
427373174f4b: Pushed
6e042233be87: Pushed
cd68adf8437f: Pushed
f42aed5f7feb: Layer already exists
5fca4478b51f: Pushed
89819bafde36: Layer already exists
f3d5b8f65132: Layer already exists
ad83f0aa5c0a: Layer already exists
5a9a65095453: Layer already exists
4b0edb23340c: Layer already exists
afa3e488a0ee: Layer already exists
94cf2581f595: Pushed
a7aa8d4ca0c3: Pushed
e8231fd8e488: Pushed
20210806125014: digest: sha256:b8f27bcabc4f40fd4a2af5a1715c8e1a58ce2dfe129bb023f45b92647ba32a36 size: 4310
> Task :sdks:java:testing:load-tests:run
Aug 06, 2021 12:54:49 PM org.apache.beam.runners.dataflow.options.DataflowPipelineOptions$StagingLocationFactory create
INFO: No stagingLocation provided, falling back to gcpTempLocation
Aug 06, 2021 12:54:50 PM org.apache.beam.runners.dataflow.DataflowRunner fromOptions
INFO: PipelineOptions.filesToStage was not specified. Defaulting to files from the classpath: will stage 191 files. Enable logging at DEBUG level to see which files will be staged.
Aug 06, 2021 12:54:50 PM org.apache.beam.sdk.Pipeline validate
WARNING: The following transforms do not have stable unique names: ParDo(TimeMonitor)
Aug 06, 2021 12:54:50 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Executing pipeline on the Dataflow Service, which will have billing implications related to Google Compute Engine usage and other Google Cloud Services.
Aug 06, 2021 12:54:52 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging portable pipeline proto to gs://temp-storage-for-perf-tests/loadtests/staging/
Aug 06, 2021 12:54:52 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <107918 bytes, hash 20600528897a3f07b32e0466436a93dbc8ea7dfcf029676909534a6a03e33e85> to gs://temp-storage-for-perf-tests/loadtests/staging/pipeline-IGAFKIl6PwezLgRmQ2qT28jqffzwKWdpCVNKagPjPoU.pb
Aug 06, 2021 12:54:54 PM org.apache.beam.runners.dataflow.util.PackageUtil stageClasspathElements
INFO: Uploading 191 files from PipelineOptions.filesToStage to staging location to prepare for execution.
Aug 06, 2021 12:54:55 PM org.apache.beam.runners.dataflow.util.PackageUtil stageClasspathElements
INFO: Staging files complete: 191 files cached, 0 files newly uploaded in 0 seconds
Aug 06, 2021 12:54:55 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Read input/DataflowRunner.StreamingUnboundedRead.ReadWithIds as step s1
Aug 06, 2021 12:54:55 PM org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource split
INFO: Split into 20 bundles of sizes: [org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@6342d610, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@dc4a691, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@784abd3e, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@36c2b646, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@434514d8, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@6b1dc20f, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@4613311f, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@6540cf1d, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@ec8f4b9, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@bc042d5, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@5484117b, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@37df14d1, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@7efb53af, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@7724704f, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@3dfa819, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@4ce94d2f, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@68ab0936, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@3cd9aa64, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@42b84286, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@443effcb]
Aug 06, 2021 12:54:55 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Read input/StripIds as step s2
Aug 06, 2021 12:54:55 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding ParDo(TimeMonitor) as step s3
Aug 06, 2021 12:54:55 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding ParDo(ByteMonitor) as step s4
Aug 06, 2021 12:54:55 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 0 as step s5
Aug 06, 2021 12:54:55 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 1 as step s6
Aug 06, 2021 12:54:55 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 2 as step s7
Aug 06, 2021 12:54:55 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 3 as step s8
Aug 06, 2021 12:54:55 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 4 as step s9
Aug 06, 2021 12:54:55 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 5 as step s10
Aug 06, 2021 12:54:55 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 6 as step s11
Aug 06, 2021 12:54:55 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 7 as step s12
Aug 06, 2021 12:54:55 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 8 as step s13
Aug 06, 2021 12:54:55 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 9 as step s14
Aug 06, 2021 12:54:55 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding ParDo(TimeMonitor)2 as step s15
Aug 06, 2021 12:54:55 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Dataflow SDK version: 2.33.0-SNAPSHOT
Aug 06, 2021 12:54:56 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobs/us-central1/2021-08-06_05_54_55-9626435663495136389?project=apache-beam-testing
Aug 06, 2021 12:54:56 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Submitted job: 2021-08-06_05_54_55-9626435663495136389
Aug 06, 2021 12:54:56 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2021-08-06_05_54_55-9626435663495136389
Aug 06, 2021 12:55:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-08-06T12:55:02.129Z: The workflow name is not a valid Cloud Label. Labels applied to Cloud resources (such as GCE Instances) for monitoring will be labeled with this modified job name: load0tests0java110dataflow0v20streaming0pardo01-jenkins-08-31p7. For the best monitoring experience, please name your job with a valid Cloud Label. For details, see: https://cloud.google.com/compute/docs/labeling-resources#restrictions
Aug 06, 2021 12:55:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-06T12:55:07.763Z: Worker configuration: e2-standard-2 in us-central1-a.
Aug 06, 2021 12:55:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-06T12:55:08.396Z: Expanding SplittableParDo operations into optimizable parts.
Aug 06, 2021 12:55:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-06T12:55:08.425Z: Expanding CollectionToSingleton operations into optimizable parts.
Aug 06, 2021 12:55:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-06T12:55:08.497Z: Expanding CoGroupByKey operations into optimizable parts.
Aug 06, 2021 12:55:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-06T12:55:08.531Z: Expanding SplittableProcessKeyed operations into optimizable parts.
Aug 06, 2021 12:55:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-06T12:55:08.568Z: Expanding GroupByKey operations into streaming Read/Write steps
Aug 06, 2021 12:55:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-06T12:55:08.601Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
Aug 06, 2021 12:55:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-06T12:55:08.685Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
Aug 06, 2021 12:55:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-06T12:55:08.728Z: Fusing consumer Read input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource) into Read input/Impulse
Aug 06, 2021 12:55:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-06T12:55:08.773Z: Fusing consumer Read-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/PairWithRestriction into Read input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource)
Aug 06, 2021 12:55:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-06T12:55:08.811Z: Fusing consumer Read-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/SplitWithSizing into Read-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/PairWithRestriction
Aug 06, 2021 12:55:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-06T12:55:08.849Z: Fusing consumer Read input/ParDo(StripIds)/ParMultiDo(StripIds) into Read-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/ProcessElementAndRestrictionWithSizing
Aug 06, 2021 12:55:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-06T12:55:08.882Z: Fusing consumer ParDo(TimeMonitor)/ParMultiDo(TimeMonitor) into Read input/ParDo(StripIds)/ParMultiDo(StripIds)
Aug 06, 2021 12:55:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-06T12:55:08.920Z: Fusing consumer ParDo(ByteMonitor)/ParMultiDo(ByteMonitor) into ParDo(TimeMonitor)/ParMultiDo(TimeMonitor)
Aug 06, 2021 12:55:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-06T12:55:08.956Z: Fusing consumer Step: 0/ParMultiDo(CounterOperation) into ParDo(ByteMonitor)/ParMultiDo(ByteMonitor)
Aug 06, 2021 12:55:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-06T12:55:08.990Z: Fusing consumer Step: 1/ParMultiDo(CounterOperation) into Step: 0/ParMultiDo(CounterOperation)
Aug 06, 2021 12:55:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-06T12:55:09.023Z: Fusing consumer Step: 2/ParMultiDo(CounterOperation) into Step: 1/ParMultiDo(CounterOperation)
Aug 06, 2021 12:55:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-06T12:55:09.052Z: Fusing consumer Step: 3/ParMultiDo(CounterOperation) into Step: 2/ParMultiDo(CounterOperation)
Aug 06, 2021 12:55:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-06T12:55:09.081Z: Fusing consumer Step: 4/ParMultiDo(CounterOperation) into Step: 3/ParMultiDo(CounterOperation)
Aug 06, 2021 12:55:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-06T12:55:09.116Z: Fusing consumer Step: 5/ParMultiDo(CounterOperation) into Step: 4/ParMultiDo(CounterOperation)
Aug 06, 2021 12:55:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-06T12:55:09.149Z: Fusing consumer Step: 6/ParMultiDo(CounterOperation) into Step: 5/ParMultiDo(CounterOperation)
Aug 06, 2021 12:55:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-06T12:55:09.175Z: Fusing consumer Step: 7/ParMultiDo(CounterOperation) into Step: 6/ParMultiDo(CounterOperation)
Aug 06, 2021 12:55:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-06T12:55:09.220Z: Fusing consumer Step: 8/ParMultiDo(CounterOperation) into Step: 7/ParMultiDo(CounterOperation)
Aug 06, 2021 12:55:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-06T12:55:09.245Z: Fusing consumer Step: 9/ParMultiDo(CounterOperation) into Step: 8/ParMultiDo(CounterOperation)
Aug 06, 2021 12:55:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-06T12:55:09.279Z: Fusing consumer ParDo(TimeMonitor)2/ParMultiDo(TimeMonitor) into Step: 9/ParMultiDo(CounterOperation)
Aug 06, 2021 12:55:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-06T12:55:09.648Z: Starting 5 ****s in us-central1-a...
Aug 06, 2021 12:55:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-06T12:55:40.050Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete
Aug 06, 2021 12:55:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-06T12:55:53.010Z: Autoscaling: Raised the number of ****s to 5 so that the pipeline can catch up with its backlog and keep up with its input rate.
Aug 06, 2021 12:56:48 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-06T12:56:47.306Z: Workers have started successfully.
Aug 06, 2021 12:56:48 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-06T12:56:47.345Z: Workers have started successfully.
Aug 06, 2021 4:01:02 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-06T16:01:01.207Z: Cancel request is committed for workflow job: 2021-08-06_05_54_55-9626435663495136389.
Aug 06, 2021 4:01:02 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-06T16:01:02.093Z: Cleaning up.
Aug 06, 2021 4:01:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-06T16:01:02.219Z: Stopping **** pool...
Aug 06, 2021 4:01:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-06T16:01:02.299Z: Stopping **** pool...
Aug 06, 2021 4:03:15 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-06T16:03:13.125Z: Autoscaling: Reduced the number of ****s to 0 based on low average **** CPU utilization, and the pipeline having sufficiently low backlog and keeping up with input rate.
Aug 06, 2021 4:03:15 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-06T16:03:13.161Z: Worker pool stopped.
Aug 06, 2021 4:03:25 PM org.apache.beam.runners.dataflow.DataflowPipelineJob logTerminalState
INFO: Job 2021-08-06_05_54_55-9626435663495136389 finished with status CANCELLED.
Aug 06, 2021 4:03:25 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric totalBytes.count, from namespace pardo
Load test results for test (ID): c77872c6-21af-408f-adc5-1907c7363b2b and timestamp: 2021-08-06T12:54:50.547000000Z:
Metric: Value:
dataflow_v2_java11_runtime_sec 0.0
dataflow_v2_java11_total_bytes_count -1.0
Exception in thread "main" java.lang.RuntimeException: Invalid job state: CANCELLED.
at org.apache.beam.sdk.loadtests.JobFailure.handleFailure(JobFailure.java:55)
at org.apache.beam.sdk.loadtests.LoadTest.run(LoadTest.java:141)
at org.apache.beam.sdk.loadtests.ParDoLoadTest.run(ParDoLoadTest.java:53)
at org.apache.beam.sdk.loadtests.ParDoLoadTest.main(ParDoLoadTest.java:103)
> Task :sdks:java:testing:load-tests:run FAILED
> Task :runners:google-cloud-dataflow-java:cleanUpDockerImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210806125014
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:b8f27bcabc4f40fd4a2af5a1715c8e1a58ce2dfe129bb023f45b92647ba32a36
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210806125014]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:b8f27bcabc4f40fd4a2af5a1715c8e1a58ce2dfe129bb023f45b92647ba32a36]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210806125014] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:b8f27bcabc4f40fd4a2af5a1715c8e1a58ce2dfe129bb023f45b92647ba32a36])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:b8f27bcabc4f40fd4a2af5a1715c8e1a58ce2dfe129bb023f45b92647ba32a36
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:b8f27bcabc4f40fd4a2af5a1715c8e1a58ce2dfe129bb023f45b92647ba32a36
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:b8f27bcabc4f40fd4a2af5a1715c8e1a58ce2dfe129bb023f45b92647ba32a36].
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:testing:load-tests:run'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 3h 13m 28s
107 actionable tasks: 76 executed, 29 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/ezdjlijm56fiu
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins:
beam_LoadTests_Java_ParDo_Dataflow_V2_Streaming_Java11 #49
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Java_ParDo_Dataflow_V2_Streaming_Java11/49/display/redirect?page=changes>
Changes:
[Etienne Chauchot] [BEAM-12591] Put Spark Structured Streaming runner sources back to main
[Etienne Chauchot] [BEAM-12629] As spark DataSourceV2 is only available for spark 2,
[Etienne Chauchot] [BEAM-12627] Deal with spark Encoders braking change between spark 2 and
[Etienne Chauchot] [BEAM-12591] move SchemaHelpers to correct package
[Etienne Chauchot] [BEAM-8470] Disable wait for termination in a streaming pipeline because
[Etienne Chauchot] [BEAM-12630] Deal with breaking change in streaming pipelines start by
[Etienne Chauchot] [BEAM-12629] Make source tests spark version agnostic and move them back
[Etienne Chauchot] [BEAM-12629] Make a spark 3 source impl
[ajamato] [BEAM-12670] Relocate bq client exception imports to try block and
[Etienne Chauchot] [BEAM-12591] Fix checkstyle and spotless
[Etienne Chauchot] [BEAM-12629] Reduce serializable to only needed classes and Fix schema
[Etienne Chauchot] [BEAM-12591] Add checkstyle exceptions for version specific classes
[Etienne Chauchot] [BEAM-12629] Fix sources javadocs and improve impl
[dpires] [BEAM-12715] Use shard number specified by user in SnowflakeIO batch
[Etienne Chauchot] [BEAM-12591] Add spark 3 to structured streaming validates runner tests
[relax] fix GroupIntoBatches
[noreply] [BEAM-12703] Fix universal metrics. (#15260)
[noreply] [BEAM-12702] Pull step unique names from pipeline for metrics. (#15261)
[noreply] [BEAM-12678] Add dependency of java jars when running go VR on portable
[noreply] [BEAM-12671] Mark known composite transforms native (#15236)
[noreply] [BEAM-6516] Fixes race condition in RabbitMqIO causing duplicate acks
------------------------------------------
[...truncated 64.55 KB...]
As an alternative, use `gcloud auth configure-docker` to configure `docker` to
use `gcloud` as a credential helper, then use `docker` as you would for non-GCR
registries, e.g. `docker pull gcr.io/project-id/my-image`. Add
`--verbosity=error` to silence this warning: `gcloud docker
--verbosity=error -- pull gcr.io/project-id/my-image`.
See: https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker
The push refers to repository [us.gcr.io/apache-beam-testing/java-postcommit-it/java]
c1b22d63b1d6: Preparing
eb2ed638a95c: Preparing
b8af835c987f: Preparing
1038d0a5f564: Preparing
15b70b6541bd: Preparing
ae24e5b7352f: Preparing
63ffbb695edd: Preparing
0198ac86d565: Preparing
a4490444064f: Preparing
91801e337ad1: Preparing
f31bb4d2fc72: Preparing
0355e92d3c56: Preparing
f42aed5f7feb: Preparing
89819bafde36: Preparing
f3d5b8f65132: Preparing
ad83f0aa5c0a: Preparing
5a9a65095453: Preparing
4b0edb23340c: Preparing
afa3e488a0ee: Preparing
a4490444064f: Waiting
ae24e5b7352f: Waiting
91801e337ad1: Waiting
f31bb4d2fc72: Waiting
5a9a65095453: Waiting
63ffbb695edd: Waiting
4b0edb23340c: Waiting
0355e92d3c56: Waiting
ad83f0aa5c0a: Waiting
f3d5b8f65132: Waiting
89819bafde36: Waiting
0198ac86d565: Waiting
afa3e488a0ee: Waiting
15b70b6541bd: Pushed
eb2ed638a95c: Pushed
b8af835c987f: Pushed
c1b22d63b1d6: Pushed
ae24e5b7352f: Pushed
0198ac86d565: Pushed
1038d0a5f564: Pushed
a4490444064f: Pushed
f42aed5f7feb: Layer already exists
89819bafde36: Layer already exists
f3d5b8f65132: Layer already exists
ad83f0aa5c0a: Layer already exists
5a9a65095453: Layer already exists
4b0edb23340c: Layer already exists
afa3e488a0ee: Layer already exists
f31bb4d2fc72: Pushed
0355e92d3c56: Pushed
63ffbb695edd: Pushed
91801e337ad1: Pushed
20210805123737: digest: sha256:fa3174bce374b6fc640d79bcebecc861796e8b3f403885041ff95aee6be4769c size: 4310
> Task :sdks:java:testing:load-tests:run
Aug 05, 2021 12:42:59 PM org.apache.beam.runners.dataflow.options.DataflowPipelineOptions$StagingLocationFactory create
INFO: No stagingLocation provided, falling back to gcpTempLocation
Aug 05, 2021 12:42:59 PM org.apache.beam.runners.dataflow.DataflowRunner fromOptions
INFO: PipelineOptions.filesToStage was not specified. Defaulting to files from the classpath: will stage 191 files. Enable logging at DEBUG level to see which files will be staged.
Aug 05, 2021 12:43:00 PM org.apache.beam.sdk.Pipeline validate
WARNING: The following transforms do not have stable unique names: ParDo(TimeMonitor)
Aug 05, 2021 12:43:00 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Executing pipeline on the Dataflow Service, which will have billing implications related to Google Compute Engine usage and other Google Cloud Services.
Aug 05, 2021 12:43:02 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging portable pipeline proto to gs://temp-storage-for-perf-tests/loadtests/staging/
Aug 05, 2021 12:43:02 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <107918 bytes, hash b46e9426030b2d81fbf6b5fea25c26a302007745c90470a82f08d63f5813f8a5> to gs://temp-storage-for-perf-tests/loadtests/staging/pipeline-tG6UJgMLLYH79rX-olwmowIAd0XJBHCoLwjWP1gT-KU.pb
Aug 05, 2021 12:43:04 PM org.apache.beam.runners.dataflow.util.PackageUtil stageClasspathElements
INFO: Uploading 191 files from PipelineOptions.filesToStage to staging location to prepare for execution.
Aug 05, 2021 12:43:04 PM org.apache.beam.runners.dataflow.util.PackageUtil stageClasspathElements
INFO: Staging files complete: 191 files cached, 0 files newly uploaded in 0 seconds
Aug 05, 2021 12:43:04 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Read input/DataflowRunner.StreamingUnboundedRead.ReadWithIds as step s1
Aug 05, 2021 12:43:04 PM org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource split
INFO: Split into 20 bundles of sizes: [org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@4a163575, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@7e642b88, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@6b350309, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@7ecec90d, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@588f63c, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@5a6fa56e, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@1981d861, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@118ffcfd, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@53f4c1e6, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@74174a23, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@6342d610, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@dc4a691, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@784abd3e, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@36c2b646, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@434514d8, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@6b1dc20f, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@4613311f, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@6540cf1d, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@ec8f4b9, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@bc042d5]
Aug 05, 2021 12:43:04 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Read input/StripIds as step s2
Aug 05, 2021 12:43:04 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding ParDo(TimeMonitor) as step s3
Aug 05, 2021 12:43:04 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding ParDo(ByteMonitor) as step s4
Aug 05, 2021 12:43:04 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 0 as step s5
Aug 05, 2021 12:43:04 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 1 as step s6
Aug 05, 2021 12:43:04 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 2 as step s7
Aug 05, 2021 12:43:04 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 3 as step s8
Aug 05, 2021 12:43:04 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 4 as step s9
Aug 05, 2021 12:43:04 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 5 as step s10
Aug 05, 2021 12:43:04 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 6 as step s11
Aug 05, 2021 12:43:04 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 7 as step s12
Aug 05, 2021 12:43:04 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 8 as step s13
Aug 05, 2021 12:43:04 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 9 as step s14
Aug 05, 2021 12:43:04 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding ParDo(TimeMonitor)2 as step s15
Aug 05, 2021 12:43:05 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Dataflow SDK version: 2.33.0-SNAPSHOT
Aug 05, 2021 12:43:05 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobs/us-central1/2021-08-05_05_43_05-2328962013308260298?project=apache-beam-testing
Aug 05, 2021 12:43:06 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Submitted job: 2021-08-05_05_43_05-2328962013308260298
Aug 05, 2021 12:43:06 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2021-08-05_05_43_05-2328962013308260298
Aug 05, 2021 12:43:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-08-05T12:43:12.648Z: The workflow name is not a valid Cloud Label. Labels applied to Cloud resources (such as GCE Instances) for monitoring will be labeled with this modified job name: load0tests0java110dataflow0v20streaming0pardo01-jenkins-08-jh1w. For the best monitoring experience, please name your job with a valid Cloud Label. For details, see: https://cloud.google.com/compute/docs/labeling-resources#restrictions
Aug 05, 2021 12:43:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-05T12:43:16.737Z: Worker configuration: e2-standard-2 in us-central1-a.
Aug 05, 2021 12:43:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-05T12:43:17.370Z: Expanding SplittableParDo operations into optimizable parts.
Aug 05, 2021 12:43:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-05T12:43:17.404Z: Expanding CollectionToSingleton operations into optimizable parts.
Aug 05, 2021 12:43:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-05T12:43:17.478Z: Expanding CoGroupByKey operations into optimizable parts.
Aug 05, 2021 12:43:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-05T12:43:17.520Z: Expanding SplittableProcessKeyed operations into optimizable parts.
Aug 05, 2021 12:43:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-05T12:43:17.550Z: Expanding GroupByKey operations into streaming Read/Write steps
Aug 05, 2021 12:43:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-05T12:43:17.610Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
Aug 05, 2021 12:43:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-05T12:43:17.683Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
Aug 05, 2021 12:43:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-05T12:43:17.716Z: Fusing consumer Read input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource) into Read input/Impulse
Aug 05, 2021 12:43:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-05T12:43:17.746Z: Fusing consumer Read-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/PairWithRestriction into Read input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource)
Aug 05, 2021 12:43:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-05T12:43:17.782Z: Fusing consumer Read-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/SplitWithSizing into Read-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/PairWithRestriction
Aug 05, 2021 12:43:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-05T12:43:17.823Z: Fusing consumer Read input/ParDo(StripIds)/ParMultiDo(StripIds) into Read-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/ProcessElementAndRestrictionWithSizing
Aug 05, 2021 12:43:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-05T12:43:17.846Z: Fusing consumer ParDo(TimeMonitor)/ParMultiDo(TimeMonitor) into Read input/ParDo(StripIds)/ParMultiDo(StripIds)
Aug 05, 2021 12:43:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-05T12:43:17.900Z: Fusing consumer ParDo(ByteMonitor)/ParMultiDo(ByteMonitor) into ParDo(TimeMonitor)/ParMultiDo(TimeMonitor)
Aug 05, 2021 12:43:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-05T12:43:17.928Z: Fusing consumer Step: 0/ParMultiDo(CounterOperation) into ParDo(ByteMonitor)/ParMultiDo(ByteMonitor)
Aug 05, 2021 12:43:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-05T12:43:17.962Z: Fusing consumer Step: 1/ParMultiDo(CounterOperation) into Step: 0/ParMultiDo(CounterOperation)
Aug 05, 2021 12:43:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-05T12:43:17.998Z: Fusing consumer Step: 2/ParMultiDo(CounterOperation) into Step: 1/ParMultiDo(CounterOperation)
Aug 05, 2021 12:43:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-05T12:43:18.035Z: Fusing consumer Step: 3/ParMultiDo(CounterOperation) into Step: 2/ParMultiDo(CounterOperation)
Aug 05, 2021 12:43:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-05T12:43:18.060Z: Fusing consumer Step: 4/ParMultiDo(CounterOperation) into Step: 3/ParMultiDo(CounterOperation)
Aug 05, 2021 12:43:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-05T12:43:18.098Z: Fusing consumer Step: 5/ParMultiDo(CounterOperation) into Step: 4/ParMultiDo(CounterOperation)
Aug 05, 2021 12:43:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-05T12:43:18.129Z: Fusing consumer Step: 6/ParMultiDo(CounterOperation) into Step: 5/ParMultiDo(CounterOperation)
Aug 05, 2021 12:43:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-05T12:43:18.166Z: Fusing consumer Step: 7/ParMultiDo(CounterOperation) into Step: 6/ParMultiDo(CounterOperation)
Aug 05, 2021 12:43:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-05T12:43:18.203Z: Fusing consumer Step: 8/ParMultiDo(CounterOperation) into Step: 7/ParMultiDo(CounterOperation)
Aug 05, 2021 12:43:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-05T12:43:18.238Z: Fusing consumer Step: 9/ParMultiDo(CounterOperation) into Step: 8/ParMultiDo(CounterOperation)
Aug 05, 2021 12:43:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-05T12:43:18.264Z: Fusing consumer ParDo(TimeMonitor)2/ParMultiDo(TimeMonitor) into Step: 9/ParMultiDo(CounterOperation)
Aug 05, 2021 12:43:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-05T12:43:18.671Z: Starting 5 ****s in us-central1-a...
Aug 05, 2021 12:43:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-05T12:43:41.649Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete
Aug 05, 2021 12:44:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-05T12:44:04.442Z: Autoscaling: Raised the number of ****s to 5 so that the pipeline can catch up with its backlog and keep up with its input rate.
Aug 05, 2021 12:45:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-05T12:45:00.452Z: Workers have started successfully.
Aug 05, 2021 12:45:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-05T12:45:00.477Z: Workers have started successfully.
Aug 05, 2021 4:00:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-05T16:00:38.754Z: Cancel request is committed for workflow job: 2021-08-05_05_43_05-2328962013308260298.
Aug 05, 2021 4:00:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-05T16:00:38.832Z: Cleaning up.
Aug 05, 2021 4:00:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-05T16:00:38.884Z: Stopping **** pool...
Aug 05, 2021 4:00:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-05T16:00:38.937Z: Stopping **** pool...
Aug 05, 2021 4:03:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-05T16:03:11.185Z: Autoscaling: Reduced the number of ****s to 0 based on low average **** CPU utilization, and the pipeline having sufficiently low backlog and keeping up with input rate.
Aug 05, 2021 4:03:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-05T16:03:11.222Z: Worker pool stopped.
Aug 05, 2021 4:03:20 PM org.apache.beam.runners.dataflow.DataflowPipelineJob logTerminalState
INFO: Job 2021-08-05_05_43_05-2328962013308260298 finished with status CANCELLED.
Aug 05, 2021 4:03:20 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric totalBytes.count, from namespace pardo
Load test results for test (ID): b5ba59d8-299c-41b7-9797-ca2db86ea6e2 and timestamp: 2021-08-05T12:43:00.188000000Z:
Metric: Value:
dataflow_v2_java11_runtime_sec 0.0
dataflow_v2_java11_total_bytes_count -1.0
Exception in thread "main" java.lang.RuntimeException: Invalid job state: CANCELLED.
at org.apache.beam.sdk.loadtests.JobFailure.handleFailure(JobFailure.java:55)
at org.apache.beam.sdk.loadtests.LoadTest.run(LoadTest.java:141)
at org.apache.beam.sdk.loadtests.ParDoLoadTest.run(ParDoLoadTest.java:53)
at org.apache.beam.sdk.loadtests.ParDoLoadTest.main(ParDoLoadTest.java:103)
> Task :sdks:java:testing:load-tests:run FAILED
> Task :runners:google-cloud-dataflow-java:cleanUpDockerImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210805123737
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:fa3174bce374b6fc640d79bcebecc861796e8b3f403885041ff95aee6be4769c
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210805123737]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:fa3174bce374b6fc640d79bcebecc861796e8b3f403885041ff95aee6be4769c]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210805123737] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:fa3174bce374b6fc640d79bcebecc861796e8b3f403885041ff95aee6be4769c])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:4b4f7c2c2a48604c17b7891a918ab489f87579c330b10965aa7eb7bc63de073c
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:4b4f7c2c2a48604c17b7891a918ab489f87579c330b10965aa7eb7bc63de073c
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:4b4f7c2c2a48604c17b7891a918ab489f87579c330b10965aa7eb7bc63de073c].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:fa3174bce374b6fc640d79bcebecc861796e8b3f403885041ff95aee6be4769c
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:fa3174bce374b6fc640d79bcebecc861796e8b3f403885041ff95aee6be4769c
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:fa3174bce374b6fc640d79bcebecc861796e8b3f403885041ff95aee6be4769c].
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:testing:load-tests:run'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 3h 26m 3s
107 actionable tasks: 76 executed, 29 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/wd3b2namzzsti
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins:
beam_LoadTests_Java_ParDo_Dataflow_V2_Streaming_Java11 #48
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Java_ParDo_Dataflow_V2_Streaming_Java11/48/display/redirect?page=changes>
Changes:
[sayat.satybaldiyev] Fix issue with update schema source format
[noreply] [BEAM-12696] Update NewTaggedExternal to not require inputs (#15266)
[noreply] [BEAM-11088] Add TestStream package to Go SDK testing capabilities
[noreply] Merge pull request #15272:[BEAM-12712] Exclude runners that can't handle
------------------------------------------
[...truncated 72.92 KB...]
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2021-08-04_05_42_35-6895403065916388477
Aug 04, 2021 12:42:48 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-08-04T12:42:45.842Z: The workflow name is not a valid Cloud Label. Labels applied to Cloud resources (such as GCE Instances) for monitoring will be labeled with this modified job name: load0tests0java110dataflow0v20streaming0pardo01-jenkins-08-ooie. For the best monitoring experience, please name your job with a valid Cloud Label. For details, see: https://cloud.google.com/compute/docs/labeling-resources#restrictions
Aug 04, 2021 12:42:50 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-04T12:42:50.164Z: Worker configuration: e2-standard-2 in us-central1-a.
Aug 04, 2021 12:42:50 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-04T12:42:50.691Z: Expanding SplittableParDo operations into optimizable parts.
Aug 04, 2021 12:42:50 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-04T12:42:50.719Z: Expanding CollectionToSingleton operations into optimizable parts.
Aug 04, 2021 12:42:50 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-04T12:42:50.783Z: Expanding CoGroupByKey operations into optimizable parts.
Aug 04, 2021 12:42:50 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-04T12:42:50.848Z: Expanding SplittableProcessKeyed operations into optimizable parts.
Aug 04, 2021 12:42:50 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-04T12:42:50.880Z: Expanding GroupByKey operations into streaming Read/Write steps
Aug 04, 2021 12:42:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-04T12:42:50.941Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
Aug 04, 2021 12:42:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-04T12:42:51.020Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
Aug 04, 2021 12:42:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-04T12:42:51.055Z: Fusing consumer Read input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource) into Read input/Impulse
Aug 04, 2021 12:42:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-04T12:42:51.081Z: Fusing consumer Read-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/PairWithRestriction into Read input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource)
Aug 04, 2021 12:42:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-04T12:42:51.114Z: Fusing consumer Read-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/SplitWithSizing into Read-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/PairWithRestriction
Aug 04, 2021 12:42:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-04T12:42:51.147Z: Fusing consumer Read input/ParDo(StripIds)/ParMultiDo(StripIds) into Read-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/ProcessElementAndRestrictionWithSizing
Aug 04, 2021 12:42:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-04T12:42:51.184Z: Fusing consumer ParDo(TimeMonitor)/ParMultiDo(TimeMonitor) into Read input/ParDo(StripIds)/ParMultiDo(StripIds)
Aug 04, 2021 12:42:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-04T12:42:51.222Z: Fusing consumer ParDo(ByteMonitor)/ParMultiDo(ByteMonitor) into ParDo(TimeMonitor)/ParMultiDo(TimeMonitor)
Aug 04, 2021 12:42:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-04T12:42:51.250Z: Fusing consumer Step: 0/ParMultiDo(CounterOperation) into ParDo(ByteMonitor)/ParMultiDo(ByteMonitor)
Aug 04, 2021 12:42:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-04T12:42:51.276Z: Fusing consumer Step: 1/ParMultiDo(CounterOperation) into Step: 0/ParMultiDo(CounterOperation)
Aug 04, 2021 12:42:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-04T12:42:51.303Z: Fusing consumer Step: 2/ParMultiDo(CounterOperation) into Step: 1/ParMultiDo(CounterOperation)
Aug 04, 2021 12:42:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-04T12:42:51.339Z: Fusing consumer Step: 3/ParMultiDo(CounterOperation) into Step: 2/ParMultiDo(CounterOperation)
Aug 04, 2021 12:42:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-04T12:42:51.371Z: Fusing consumer Step: 4/ParMultiDo(CounterOperation) into Step: 3/ParMultiDo(CounterOperation)
Aug 04, 2021 12:42:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-04T12:42:51.407Z: Fusing consumer Step: 5/ParMultiDo(CounterOperation) into Step: 4/ParMultiDo(CounterOperation)
Aug 04, 2021 12:42:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-04T12:42:51.443Z: Fusing consumer Step: 6/ParMultiDo(CounterOperation) into Step: 5/ParMultiDo(CounterOperation)
Aug 04, 2021 12:42:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-04T12:42:51.477Z: Fusing consumer Step: 7/ParMultiDo(CounterOperation) into Step: 6/ParMultiDo(CounterOperation)
Aug 04, 2021 12:42:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-04T12:42:51.510Z: Fusing consumer Step: 8/ParMultiDo(CounterOperation) into Step: 7/ParMultiDo(CounterOperation)
Aug 04, 2021 12:42:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-04T12:42:51.536Z: Fusing consumer Step: 9/ParMultiDo(CounterOperation) into Step: 8/ParMultiDo(CounterOperation)
Aug 04, 2021 12:42:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-04T12:42:51.562Z: Fusing consumer ParDo(TimeMonitor)2/ParMultiDo(TimeMonitor) into Step: 9/ParMultiDo(CounterOperation)
Aug 04, 2021 12:42:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-04T12:42:51.955Z: Starting 5 ****s in us-central1-a...
Aug 04, 2021 12:43:02 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-04T12:43:01.707Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete
Aug 04, 2021 12:43:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-04T12:43:36.217Z: Autoscaling: Raised the number of ****s to 5 so that the pipeline can catch up with its backlog and keep up with its input rate.
Aug 04, 2021 12:44:32 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-04T12:44:30.328Z: Workers have started successfully.
Aug 04, 2021 12:44:32 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-04T12:44:30.348Z: Workers have started successfully.
Aug 04, 2021 3:51:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-04T15:51:52.153Z: Staged package annotations-4.1.1.4-unNOHoTAnWFa9qCdMwNLTwRC-Hct7BIO-zdthqVlrhU.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/annotations-4.1.1.4-unNOHoTAnWFa9qCdMwNLTwRC-Hct7BIO-zdthqVlrhU.jar' is inaccessible.
Aug 04, 2021 3:51:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-04T15:51:52.336Z: Staged package avro-1.8.2-91SggwzmelqfpnpU7BXRA-8V4chQ17Jvr3tkfu3cgtM.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/avro-1.8.2-91SggwzmelqfpnpU7BXRA-8V4chQ17Jvr3tkfu3cgtM.jar' is inaccessible.
Aug 04, 2021 3:51:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-04T15:51:52.948Z: Staged package beam-vendor-bytebuddy-1_11_0-0.1-SneHjzQgCpxxLkvyN8dugqO_sTzwXJ2995kqFu4l2i4.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/beam-vendor-bytebuddy-1_11_0-0.1-SneHjzQgCpxxLkvyN8dugqO_sTzwXJ2995kqFu4l2i4.jar' is inaccessible.
Aug 04, 2021 3:51:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-04T15:51:53.001Z: Staged package beam-vendor-guava-26_0-jre-0.1-8quizfXTrmcvJyOXi3zWDFtP5EofgqjksY5sIbsBqws.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/beam-vendor-guava-26_0-jre-0.1-8quizfXTrmcvJyOXi3zWDFtP5EofgqjksY5sIbsBqws.jar' is inaccessible.
Aug 04, 2021 3:51:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-04T15:51:53.110Z: Staged package checker-compat-qual-2.5.5-EdE0skXpysxHRRTS1mtbhhj4A5oUZc3FW7wLNOAAi3o.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/checker-compat-qual-2.5.5-EdE0skXpysxHRRTS1mtbhhj4A5oUZc3FW7wLNOAAi3o.jar' is inaccessible.
Aug 04, 2021 3:51:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-04T15:51:53.248Z: Staged package commons-codec-1.14-oSjk-T-r5Tgd7WTPKHMBngYDC3GOtDzurgsOXRetM-k.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/commons-codec-1.14-oSjk-T-r5Tgd7WTPKHMBngYDC3GOtDzurgsOXRetM-k.jar' is inaccessible.
Aug 04, 2021 3:51:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-04T15:51:53.295Z: Staged package commons-compress-1.20-CutiXJSMaX6nsgUVbhEjY7We1eJVEhLNTkYL23LHwG4.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/commons-compress-1.20-CutiXJSMaX6nsgUVbhEjY7We1eJVEhLNTkYL23LHwG4.jar' is inaccessible.
Aug 04, 2021 3:51:55 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-04T15:51:53.403Z: Staged package commons-lang3-3.9-3i4dzc8--ReozoWGYaBnJqmpRPKOM61_ngi-pE3DwjA.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/commons-lang3-3.9-3i4dzc8--ReozoWGYaBnJqmpRPKOM61_ngi-pE3DwjA.jar' is inaccessible.
Aug 04, 2021 3:51:55 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-04T15:51:53.444Z: Staged package commons-logging-1.2-2t3qHqC-D1aXirMAa4rJKDSv7vvZt-TmMW_KV98PpjY.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/commons-logging-1.2-2t3qHqC-D1aXirMAa4rJKDSv7vvZt-TmMW_KV98PpjY.jar' is inaccessible.
Aug 04, 2021 3:51:55 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-04T15:51:53.503Z: Staged package commons-math3-3.6.1-HlbXsFjSi2Wr0la4RY44hbZ0wdWI-kPNfRy7nH7yswg.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/commons-math3-3.6.1-HlbXsFjSi2Wr0la4RY44hbZ0wdWI-kPNfRy7nH7yswg.jar' is inaccessible.
Aug 04, 2021 3:51:55 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-04T15:51:53.579Z: Staged package datastore-v1-proto-client-1.6.3-8GhVpKiAAK6wztlpNJ48AH4jyyB1KYo-5qJLXiBC6cw.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/datastore-v1-proto-client-1.6.3-8GhVpKiAAK6wztlpNJ48AH4jyyB1KYo-5qJLXiBC6cw.jar' is inaccessible.
Aug 04, 2021 3:51:55 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-04T15:51:54.835Z: Staged package gson-2.8.6-yPtIOQVNKAswM_gA0fWpfeLwKOuLoutFitKH5Tbz8l8.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/gson-2.8.6-yPtIOQVNKAswM_gA0fWpfeLwKOuLoutFitKH5Tbz8l8.jar' is inaccessible.
Aug 04, 2021 3:51:55 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-04T15:51:54.901Z: Staged package hamcrest-2.1-upOy46ViMiukMvChtTrdzFXLGIJTMZoCDtd_gk5pIFA.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/hamcrest-2.1-upOy46ViMiukMvChtTrdzFXLGIJTMZoCDtd_gk5pIFA.jar' is inaccessible.
Aug 04, 2021 3:51:55 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-04T15:51:54.947Z: Staged package hamcrest-core-2.1-4JEJ5UoonYhQa5v-yYfd0Zn0IXyUZBMmaDUbmk8Avuk.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/hamcrest-core-2.1-4JEJ5UoonYhQa5v-yYfd0Zn0IXyUZBMmaDUbmk8Avuk.jar' is inaccessible.
Aug 04, 2021 3:51:55 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-04T15:51:55.065Z: Staged package j2objc-annotations-1.3-Ia8wySJnvWEiwOC00gzMtmQaN-r5VsZUDsRx1YTmSns.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/j2objc-annotations-1.3-Ia8wySJnvWEiwOC00gzMtmQaN-r5VsZUDsRx1YTmSns.jar' is inaccessible.
Aug 04, 2021 3:51:55 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-04T15:51:55.177Z: Staged package jackson-core-asl-1.9.13-RAqctcqVshX5U9OiCmsaENofCbUpqd3qX4pJBd2rT1o.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/jackson-core-asl-1.9.13-RAqctcqVshX5U9OiCmsaENofCbUpqd3qX4pJBd2rT1o.jar' is inaccessible.
Aug 04, 2021 3:51:55 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-04T15:51:55.231Z: Staged package jackson-dataformat-cbor-2.12.1-52d5rqlCfKc9f0B-X6gIoEBVeOwFZlOoZcJuTG8B1Cg.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/jackson-dataformat-cbor-2.12.1-52d5rqlCfKc9f0B-X6gIoEBVeOwFZlOoZcJuTG8B1Cg.jar' is inaccessible.
Aug 04, 2021 3:51:55 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-04T15:51:55.297Z: Staged package jackson-mapper-asl-1.9.13-dOegenby7breKTEqWi68z6AZEovAIezjhW12GX6b4MI.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/jackson-mapper-asl-1.9.13-dOegenby7breKTEqWi68z6AZEovAIezjhW12GX6b4MI.jar' is inaccessible.
Aug 04, 2021 3:51:55 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-04T15:51:55.371Z: Staged package javax.annotation-api-1.3.2-4EulGVvNVV3JVlD3zGFNFR5LzVLSmhC4qiGX86uJq5s.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/javax.annotation-api-1.3.2-4EulGVvNVV3JVlD3zGFNFR5LzVLSmhC4qiGX86uJq5s.jar' is inaccessible.
Aug 04, 2021 3:51:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-04T15:51:55.468Z: Staged package json-20200518-D_MObagvFa-vDna9bplqerVWaFEWaoP5c8ZKmg-UbS0.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/json-20200518-D_MObagvFa-vDna9bplqerVWaFEWaoP5c8ZKmg-UbS0.jar' is inaccessible.
Aug 04, 2021 3:51:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-04T15:51:55.526Z: Staged package jsr305-3.0.2-dmrSoHg_JoeWLIrXTO7MOKKLn3Ki0IXuQ4t4E-ko0Mc.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/jsr305-3.0.2-dmrSoHg_JoeWLIrXTO7MOKKLn3Ki0IXuQ4t4E-ko0Mc.jar' is inaccessible.
Aug 04, 2021 3:51:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-04T15:51:55.738Z: Staged package metrics-core-3.2.6-iRF0xSMEduGVCihhaWcgApeFYuvfXIXwGZ7K4b0DD58.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/metrics-core-3.2.6-iRF0xSMEduGVCihhaWcgApeFYuvfXIXwGZ7K4b0DD58.jar' is inaccessible.
Aug 04, 2021 3:51:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-08-04T15:51:56.694Z: One or more access checks for temp location or staged files failed. Please refer to other error messages for details. For more information on security and permissions, please see https://cloud.google.com/dataflow/security-and-permissions.
Aug 04, 2021 3:54:57 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-08-04T15:54:55.950Z: One or more access checks for temp location or staged files failed. Please refer to other error messages for details. For more information on security and permissions, please see https://cloud.google.com/dataflow/security-and-permissions.
Aug 04, 2021 3:57:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-04T15:57:52.177Z: Staged package annotations-4.1.1.4-unNOHoTAnWFa9qCdMwNLTwRC-Hct7BIO-zdthqVlrhU.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/annotations-4.1.1.4-unNOHoTAnWFa9qCdMwNLTwRC-Hct7BIO-zdthqVlrhU.jar' is inaccessible.
Aug 04, 2021 3:57:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-04T15:57:52.327Z: Staged package avro-1.8.2-91SggwzmelqfpnpU7BXRA-8V4chQ17Jvr3tkfu3cgtM.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/avro-1.8.2-91SggwzmelqfpnpU7BXRA-8V4chQ17Jvr3tkfu3cgtM.jar' is inaccessible.
Aug 04, 2021 3:57:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-04T15:57:52.936Z: Staged package beam-vendor-bytebuddy-1_11_0-0.1-SneHjzQgCpxxLkvyN8dugqO_sTzwXJ2995kqFu4l2i4.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/beam-vendor-bytebuddy-1_11_0-0.1-SneHjzQgCpxxLkvyN8dugqO_sTzwXJ2995kqFu4l2i4.jar' is inaccessible.
Aug 04, 2021 3:57:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-04T15:57:53.044Z: Staged package beam-vendor-guava-26_0-jre-0.1-8quizfXTrmcvJyOXi3zWDFtP5EofgqjksY5sIbsBqws.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/beam-vendor-guava-26_0-jre-0.1-8quizfXTrmcvJyOXi3zWDFtP5EofgqjksY5sIbsBqws.jar' is inaccessible.
Aug 04, 2021 3:57:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-04T15:57:53.111Z: Staged package checker-compat-qual-2.5.5-EdE0skXpysxHRRTS1mtbhhj4A5oUZc3FW7wLNOAAi3o.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/checker-compat-qual-2.5.5-EdE0skXpysxHRRTS1mtbhhj4A5oUZc3FW7wLNOAAi3o.jar' is inaccessible.
Aug 04, 2021 3:57:54 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-04T15:57:53.271Z: Staged package commons-codec-1.14-oSjk-T-r5Tgd7WTPKHMBngYDC3GOtDzurgsOXRetM-k.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/commons-codec-1.14-oSjk-T-r5Tgd7WTPKHMBngYDC3GOtDzurgsOXRetM-k.jar' is inaccessible.
Aug 04, 2021 3:57:54 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-04T15:57:53.319Z: Staged package commons-compress-1.20-CutiXJSMaX6nsgUVbhEjY7We1eJVEhLNTkYL23LHwG4.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/commons-compress-1.20-CutiXJSMaX6nsgUVbhEjY7We1eJVEhLNTkYL23LHwG4.jar' is inaccessible.
Aug 04, 2021 3:57:54 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-04T15:57:53.403Z: Staged package commons-lang3-3.9-3i4dzc8--ReozoWGYaBnJqmpRPKOM61_ngi-pE3DwjA.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/commons-lang3-3.9-3i4dzc8--ReozoWGYaBnJqmpRPKOM61_ngi-pE3DwjA.jar' is inaccessible.
Aug 04, 2021 3:57:54 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-04T15:57:53.443Z: Staged package commons-logging-1.2-2t3qHqC-D1aXirMAa4rJKDSv7vvZt-TmMW_KV98PpjY.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/commons-logging-1.2-2t3qHqC-D1aXirMAa4rJKDSv7vvZt-TmMW_KV98PpjY.jar' is inaccessible.
Aug 04, 2021 3:57:54 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-04T15:57:53.477Z: Staged package commons-math3-3.6.1-HlbXsFjSi2Wr0la4RY44hbZ0wdWI-kPNfRy7nH7yswg.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/commons-math3-3.6.1-HlbXsFjSi2Wr0la4RY44hbZ0wdWI-kPNfRy7nH7yswg.jar' is inaccessible.
Aug 04, 2021 3:57:54 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-04T15:57:53.542Z: Staged package datastore-v1-proto-client-1.6.3-8GhVpKiAAK6wztlpNJ48AH4jyyB1KYo-5qJLXiBC6cw.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/datastore-v1-proto-client-1.6.3-8GhVpKiAAK6wztlpNJ48AH4jyyB1KYo-5qJLXiBC6cw.jar' is inaccessible.
Aug 04, 2021 3:57:54 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-04T15:57:54.925Z: Staged package gson-2.8.6-yPtIOQVNKAswM_gA0fWpfeLwKOuLoutFitKH5Tbz8l8.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/gson-2.8.6-yPtIOQVNKAswM_gA0fWpfeLwKOuLoutFitKH5Tbz8l8.jar' is inaccessible.
Aug 04, 2021 3:57:57 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-04T15:57:54.997Z: Staged package hamcrest-2.1-upOy46ViMiukMvChtTrdzFXLGIJTMZoCDtd_gk5pIFA.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/hamcrest-2.1-upOy46ViMiukMvChtTrdzFXLGIJTMZoCDtd_gk5pIFA.jar' is inaccessible.
Aug 04, 2021 3:57:57 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-04T15:57:55.045Z: Staged package hamcrest-core-2.1-4JEJ5UoonYhQa5v-yYfd0Zn0IXyUZBMmaDUbmk8Avuk.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/hamcrest-core-2.1-4JEJ5UoonYhQa5v-yYfd0Zn0IXyUZBMmaDUbmk8Avuk.jar' is inaccessible.
Aug 04, 2021 3:57:57 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-04T15:57:55.173Z: Staged package j2objc-annotations-1.3-Ia8wySJnvWEiwOC00gzMtmQaN-r5VsZUDsRx1YTmSns.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/j2objc-annotations-1.3-Ia8wySJnvWEiwOC00gzMtmQaN-r5VsZUDsRx1YTmSns.jar' is inaccessible.
Aug 04, 2021 3:57:57 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-04T15:57:55.294Z: Staged package jackson-core-asl-1.9.13-RAqctcqVshX5U9OiCmsaENofCbUpqd3qX4pJBd2rT1o.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/jackson-core-asl-1.9.13-RAqctcqVshX5U9OiCmsaENofCbUpqd3qX4pJBd2rT1o.jar' is inaccessible.
Aug 04, 2021 3:57:57 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-04T15:57:55.362Z: Staged package jackson-dataformat-cbor-2.12.1-52d5rqlCfKc9f0B-X6gIoEBVeOwFZlOoZcJuTG8B1Cg.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/jackson-dataformat-cbor-2.12.1-52d5rqlCfKc9f0B-X6gIoEBVeOwFZlOoZcJuTG8B1Cg.jar' is inaccessible.
Aug 04, 2021 3:57:57 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-04T15:57:55.401Z: Staged package jackson-mapper-asl-1.9.13-dOegenby7breKTEqWi68z6AZEovAIezjhW12GX6b4MI.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/jackson-mapper-asl-1.9.13-dOegenby7breKTEqWi68z6AZEovAIezjhW12GX6b4MI.jar' is inaccessible.
Aug 04, 2021 3:57:57 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-04T15:57:55.517Z: Staged package javax.annotation-api-1.3.2-4EulGVvNVV3JVlD3zGFNFR5LzVLSmhC4qiGX86uJq5s.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/javax.annotation-api-1.3.2-4EulGVvNVV3JVlD3zGFNFR5LzVLSmhC4qiGX86uJq5s.jar' is inaccessible.
Aug 04, 2021 3:57:57 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-04T15:57:55.610Z: Staged package json-20200518-D_MObagvFa-vDna9bplqerVWaFEWaoP5c8ZKmg-UbS0.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/json-20200518-D_MObagvFa-vDna9bplqerVWaFEWaoP5c8ZKmg-UbS0.jar' is inaccessible.
Aug 04, 2021 3:57:57 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-04T15:57:55.653Z: Staged package jsr305-3.0.2-dmrSoHg_JoeWLIrXTO7MOKKLn3Ki0IXuQ4t4E-ko0Mc.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/jsr305-3.0.2-dmrSoHg_JoeWLIrXTO7MOKKLn3Ki0IXuQ4t4E-ko0Mc.jar' is inaccessible.
Aug 04, 2021 3:57:57 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-04T15:57:55.838Z: Staged package metrics-core-3.2.6-iRF0xSMEduGVCihhaWcgApeFYuvfXIXwGZ7K4b0DD58.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/metrics-core-3.2.6-iRF0xSMEduGVCihhaWcgApeFYuvfXIXwGZ7K4b0DD58.jar' is inaccessible.
Aug 04, 2021 3:57:57 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-08-04T15:57:56.805Z: One or more access checks for temp location or staged files failed. Please refer to other error messages for details. For more information on security and permissions, please see https://cloud.google.com/dataflow/security-and-permissions.
Aug 04, 2021 4:00:47 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-04T16:00:47.229Z: Cancel request is committed for workflow job: 2021-08-04_05_42_35-6895403065916388477.
Aug 04, 2021 4:00:48 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-04T16:00:47.265Z: Cleaning up.
Aug 04, 2021 4:00:48 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-04T16:00:47.345Z: Stopping **** pool...
Aug 04, 2021 4:00:48 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-04T16:00:47.389Z: Stopping **** pool...
Aug 04, 2021 4:03:06 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-04T16:03:04.298Z: Autoscaling: Reduced the number of ****s to 0 based on low average **** CPU utilization, and the pipeline having sufficiently low backlog and keeping up with input rate.
Aug 04, 2021 4:03:06 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-04T16:03:04.337Z: Worker pool stopped.
Aug 04, 2021 4:03:10 PM org.apache.beam.runners.dataflow.DataflowPipelineJob logTerminalState
INFO: Job 2021-08-04_05_42_35-6895403065916388477 finished with status CANCELLED.
Aug 04, 2021 4:03:10 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric totalBytes.count, from namespace pardo
Load test results for test (ID): 97ffde55-bb39-477d-9496-7e6e025c9a5b and timestamp: 2021-08-04T12:42:29.731000000Z:
Metric: Value:
dataflow_v2_java11_runtime_sec 0.0
dataflow_v2_java11_total_bytes_count -1.0
Exception in thread "main" java.lang.RuntimeException: Invalid job state: CANCELLED.
at org.apache.beam.sdk.loadtests.JobFailure.handleFailure(JobFailure.java:55)
at org.apache.beam.sdk.loadtests.LoadTest.run(LoadTest.java:141)
at org.apache.beam.sdk.loadtests.ParDoLoadTest.run(ParDoLoadTest.java:53)
at org.apache.beam.sdk.loadtests.ParDoLoadTest.main(ParDoLoadTest.java:103)
> Task :sdks:java:testing:load-tests:run FAILED
> Task :runners:google-cloud-dataflow-java:cleanUpDockerImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210804123738
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:464e1cacb22be0ad5dba573257a87ea4d324bdf1798b544ab6b76f2108e15aff
Deleted: sha256:318ffb6bae259d107758e7aca994e64948b49f69a01114537ac01af17b3b4e4e
Deleted: sha256:86318eaa1ad8de1b9c297d9d65e19277db0bc1952801e1da540119a6e08ef2d7
Deleted: sha256:80f33e80e1b541b84ba660210b7b0a88830e7f3ab48daccc15d3f7af629df964
Deleted: sha256:0e2efac14b6f0419ef237da5f66383bb819d99b01243a395c3d571561d7adda1
Deleted: sha256:832303596a118044c5af222c93895e8e3523f95dbf60f91dcfe497f27dbed330
Deleted: sha256:71601e0c0fc927270550adebb779aba649637b63770bbbc351985f15ffde406b
Deleted: sha256:153aa5a76859c1a84ce9887183a84e86fc44ad04c9d280ea9c7b8f2412733da0
Deleted: sha256:122b8b02e548770dc939a76d384e5b3625273aec4bcf49af846d9aeb70c43ff7
Deleted: sha256:d4139f449973feabe32f76d88e342affa4b3a0909b59ab67330442780ec87249
Deleted: sha256:4b7b09056fbb9cca1109718463270e8852c8589730a347edc3ad98a49aa91f9f
Deleted: sha256:72dfa3bf01684d94c19606c7324ca6f9711bbca3b8d54c7d66d870009ef6f9e6
Deleted: sha256:7cd135478c6486395d78a3d1b68e1a2985ba897fca619fa288634c5324e07322
Deleted: sha256:1a8ce3c6bc7a1c1b55a3583f1c53484e4289b09e573dbb013b46018d39f08695
Deleted: sha256:50f7a963e301faee8bab12f028f74397628702ffbf81d7a7a4ef31d7a837d99e
Deleted: sha256:508dbcdd588096315fda4983ae2c38db7827a849430be184dbb819f1efe9d108
Deleted: sha256:89bb6f0ae384cf97713211dd8d24f4abc809ca5d2e4aa4e5d576f03af39f7da1
Deleted: sha256:ba66cff2a8d2afeb394a02bc907e2472bb5a4b81efd39e59c72199f2953c87ae
Deleted: sha256:0e4718a72b42954b332cc6ac7988563bb38afaf0ee62697eb19f156a73892896
Deleted: sha256:644fe77df0209f178f510fe5141c35e8efa1e4dee9c1f14f9e4a3bc1c0de609c
Deleted: sha256:0c28b7b355f8c188495069b6fe49edd2d59826bb962b317496d1853b10ae366d
Deleted: sha256:6f09e4ea96fd2ed5b7d397a51ac739c2034a3c869ad1abc4419ee391848dc79f
Deleted: sha256:b6e085e90fb0acf738f61d76103771386617faaf39753f823616d6aaaa952d08
Deleted: sha256:2d1d92fd6d77b3377e1211de9b3b53604ae2adc965649ea47052801cb9eb0194
Deleted: sha256:d79421734c96c133d18649cfc2bef5d18f37f0d8d7bede75c320453b9b4b0a2b
Deleted: sha256:ec19dd2be1c378992567f8deda6b92e52dcdf1d21ddf61da10af472d076a1698
Deleted: sha256:e78967ea956e497a8ed11f82d282006d58631227e69e15af2957ad58da078759
Deleted: sha256:6a18f8e894e215acd50e3d463f29a446cb0f5242ba874b8a91aa0d7a10356b56
Deleted: sha256:b34f70db453d53d5f677c23c79b53b27ace6c78f911861b82aca63520e2db09c
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210804123738]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:464e1cacb22be0ad5dba573257a87ea4d324bdf1798b544ab6b76f2108e15aff]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210804123738] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:464e1cacb22be0ad5dba573257a87ea4d324bdf1798b544ab6b76f2108e15aff])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:464e1cacb22be0ad5dba573257a87ea4d324bdf1798b544ab6b76f2108e15aff
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:464e1cacb22be0ad5dba573257a87ea4d324bdf1798b544ab6b76f2108e15aff
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:464e1cacb22be0ad5dba573257a87ea4d324bdf1798b544ab6b76f2108e15aff].
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:testing:load-tests:run'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 3h 25m 51s
107 actionable tasks: 76 executed, 29 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/slz3h4tdwim7y
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins:
beam_LoadTests_Java_ParDo_Dataflow_V2_Streaming_Java11 #47
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Java_ParDo_Dataflow_V2_Streaming_Java11/47/display/redirect?page=changes>
Changes:
[relax] Ensure timer consistency in Dataflow and portable runners
------------------------------------------
[...truncated 68.51 KB...]
20210803123734: digest: sha256:32136a2c3d28115a489e2f5bab48378c7e7539ef21b403dacc55507be21ae8fa size: 4310
> Task :sdks:java:testing:load-tests:run
Aug 03, 2021 12:42:50 PM org.apache.beam.runners.dataflow.options.DataflowPipelineOptions$StagingLocationFactory create
INFO: No stagingLocation provided, falling back to gcpTempLocation
Aug 03, 2021 12:42:50 PM org.apache.beam.runners.dataflow.DataflowRunner fromOptions
INFO: PipelineOptions.filesToStage was not specified. Defaulting to files from the classpath: will stage 191 files. Enable logging at DEBUG level to see which files will be staged.
Aug 03, 2021 12:42:51 PM org.apache.beam.sdk.Pipeline validate
WARNING: The following transforms do not have stable unique names: ParDo(TimeMonitor)
Aug 03, 2021 12:42:51 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Executing pipeline on the Dataflow Service, which will have billing implications related to Google Compute Engine usage and other Google Cloud Services.
Aug 03, 2021 12:42:54 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging portable pipeline proto to gs://temp-storage-for-perf-tests/loadtests/staging/
Aug 03, 2021 12:42:54 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <107856 bytes, hash 4784098c6c7e8e6ed53a30e46f1a8f2c4f501a88f085f4c82ef0d8d215db76ca> to gs://temp-storage-for-perf-tests/loadtests/staging/pipeline-R4QJjGx-jm7VOjDkbxqPLE9QGojwhfTILvDY0hXbdso.pb
Aug 03, 2021 12:42:55 PM org.apache.beam.runners.dataflow.util.PackageUtil stageClasspathElements
INFO: Uploading 191 files from PipelineOptions.filesToStage to staging location to prepare for execution.
Aug 03, 2021 12:42:56 PM org.apache.beam.runners.dataflow.util.PackageUtil stageClasspathElements
INFO: Staging files complete: 191 files cached, 0 files newly uploaded in 0 seconds
Aug 03, 2021 12:42:56 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Read input/DataflowRunner.StreamingUnboundedRead.ReadWithIds as step s1
Aug 03, 2021 12:42:56 PM org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource split
INFO: Split into 20 bundles of sizes: [org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@12e0f1cb, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@4a163575, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@7e642b88, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@6b350309, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@7ecec90d, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@588f63c, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@5a6fa56e, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@1981d861, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@118ffcfd, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@53f4c1e6, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@74174a23, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@6342d610, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@dc4a691, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@784abd3e, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@36c2b646, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@434514d8, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@6b1dc20f, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@4613311f, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@6540cf1d, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@ec8f4b9]
Aug 03, 2021 12:42:56 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Read input/StripIds as step s2
Aug 03, 2021 12:42:56 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding ParDo(TimeMonitor) as step s3
Aug 03, 2021 12:42:56 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding ParDo(ByteMonitor) as step s4
Aug 03, 2021 12:42:56 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 0 as step s5
Aug 03, 2021 12:42:56 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 1 as step s6
Aug 03, 2021 12:42:56 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 2 as step s7
Aug 03, 2021 12:42:56 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 3 as step s8
Aug 03, 2021 12:42:56 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 4 as step s9
Aug 03, 2021 12:42:56 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 5 as step s10
Aug 03, 2021 12:42:56 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 6 as step s11
Aug 03, 2021 12:42:56 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 7 as step s12
Aug 03, 2021 12:42:56 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 8 as step s13
Aug 03, 2021 12:42:56 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 9 as step s14
Aug 03, 2021 12:42:56 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding ParDo(TimeMonitor)2 as step s15
Aug 03, 2021 12:42:56 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Dataflow SDK version: 2.33.0-SNAPSHOT
Aug 03, 2021 12:42:57 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobs/us-central1/2021-08-03_05_42_56-9271568491856649635?project=apache-beam-testing
Aug 03, 2021 12:42:57 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Submitted job: 2021-08-03_05_42_56-9271568491856649635
Aug 03, 2021 12:42:57 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2021-08-03_05_42_56-9271568491856649635
Aug 03, 2021 12:43:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-08-03T12:43:04.116Z: The workflow name is not a valid Cloud Label. Labels applied to Cloud resources (such as GCE Instances) for monitoring will be labeled with this modified job name: load0tests0java110dataflow0v20streaming0pardo01-jenkins-08-791h. For the best monitoring experience, please name your job with a valid Cloud Label. For details, see: https://cloud.google.com/compute/docs/labeling-resources#restrictions
Aug 03, 2021 12:43:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-03T12:43:08.460Z: Worker configuration: e2-standard-2 in us-central1-a.
Aug 03, 2021 12:43:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-03T12:43:08.974Z: Expanding SplittableParDo operations into optimizable parts.
Aug 03, 2021 12:43:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-03T12:43:09.004Z: Expanding CollectionToSingleton operations into optimizable parts.
Aug 03, 2021 12:43:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-03T12:43:09.071Z: Expanding CoGroupByKey operations into optimizable parts.
Aug 03, 2021 12:43:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-03T12:43:09.114Z: Expanding SplittableProcessKeyed operations into optimizable parts.
Aug 03, 2021 12:43:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-03T12:43:09.151Z: Expanding GroupByKey operations into streaming Read/Write steps
Aug 03, 2021 12:43:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-03T12:43:09.186Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
Aug 03, 2021 12:43:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-03T12:43:09.286Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
Aug 03, 2021 12:43:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-03T12:43:09.324Z: Fusing consumer Read input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource) into Read input/Impulse
Aug 03, 2021 12:43:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-03T12:43:09.359Z: Fusing consumer Read-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/PairWithRestriction into Read input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource)
Aug 03, 2021 12:43:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-03T12:43:09.408Z: Fusing consumer Read-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/SplitWithSizing into Read-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/PairWithRestriction
Aug 03, 2021 12:43:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-03T12:43:09.440Z: Fusing consumer Read input/ParDo(StripIds)/ParMultiDo(StripIds) into Read-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/ProcessElementAndRestrictionWithSizing
Aug 03, 2021 12:43:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-03T12:43:09.497Z: Fusing consumer ParDo(TimeMonitor)/ParMultiDo(TimeMonitor) into Read input/ParDo(StripIds)/ParMultiDo(StripIds)
Aug 03, 2021 12:43:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-03T12:43:09.532Z: Fusing consumer ParDo(ByteMonitor)/ParMultiDo(ByteMonitor) into ParDo(TimeMonitor)/ParMultiDo(TimeMonitor)
Aug 03, 2021 12:43:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-03T12:43:09.566Z: Fusing consumer Step: 0/ParMultiDo(CounterOperation) into ParDo(ByteMonitor)/ParMultiDo(ByteMonitor)
Aug 03, 2021 12:43:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-03T12:43:09.603Z: Fusing consumer Step: 1/ParMultiDo(CounterOperation) into Step: 0/ParMultiDo(CounterOperation)
Aug 03, 2021 12:43:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-03T12:43:09.634Z: Fusing consumer Step: 2/ParMultiDo(CounterOperation) into Step: 1/ParMultiDo(CounterOperation)
Aug 03, 2021 12:43:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-03T12:43:09.665Z: Fusing consumer Step: 3/ParMultiDo(CounterOperation) into Step: 2/ParMultiDo(CounterOperation)
Aug 03, 2021 12:43:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-03T12:43:09.710Z: Fusing consumer Step: 4/ParMultiDo(CounterOperation) into Step: 3/ParMultiDo(CounterOperation)
Aug 03, 2021 12:43:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-03T12:43:09.740Z: Fusing consumer Step: 5/ParMultiDo(CounterOperation) into Step: 4/ParMultiDo(CounterOperation)
Aug 03, 2021 12:43:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-03T12:43:09.772Z: Fusing consumer Step: 6/ParMultiDo(CounterOperation) into Step: 5/ParMultiDo(CounterOperation)
Aug 03, 2021 12:43:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-03T12:43:09.806Z: Fusing consumer Step: 7/ParMultiDo(CounterOperation) into Step: 6/ParMultiDo(CounterOperation)
Aug 03, 2021 12:43:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-03T12:43:09.845Z: Fusing consumer Step: 8/ParMultiDo(CounterOperation) into Step: 7/ParMultiDo(CounterOperation)
Aug 03, 2021 12:43:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-03T12:43:09.875Z: Fusing consumer Step: 9/ParMultiDo(CounterOperation) into Step: 8/ParMultiDo(CounterOperation)
Aug 03, 2021 12:43:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-03T12:43:09.898Z: Fusing consumer ParDo(TimeMonitor)2/ParMultiDo(TimeMonitor) into Step: 9/ParMultiDo(CounterOperation)
Aug 03, 2021 12:43:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-03T12:43:10.186Z: Starting 5 ****s in us-central1-a...
Aug 03, 2021 12:43:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-03T12:43:18.834Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete
Aug 03, 2021 12:43:56 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-03T12:43:53.122Z: Autoscaling: Raised the number of ****s to 5 so that the pipeline can catch up with its backlog and keep up with its input rate.
Aug 03, 2021 12:44:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-03T12:44:51.401Z: Workers have started successfully.
Aug 03, 2021 12:44:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-03T12:44:51.433Z: Workers have started successfully.
Aug 03, 2021 2:25:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-03T14:25:10.428Z: Staged package api-common-1.10.1-KgM_JLtiA4PtpECtMHy4B3z-wcfq3GhNZSFhI6G5YTo.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/api-common-1.10.1-KgM_JLtiA4PtpECtMHy4B3z-wcfq3GhNZSFhI6G5YTo.jar' is inaccessible.
Aug 03, 2021 2:25:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-03T14:25:11.618Z: Staged package auto-value-annotations-1.8.1-N-wJtH1-01qZ0Tkn21yG_JBx9iD5Q-rV11cURpgxCFI.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/auto-value-annotations-1.8.1-N-wJtH1-01qZ0Tkn21yG_JBx9iD5Q-rV11cURpgxCFI.jar' is inaccessible.
Aug 03, 2021 2:25:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-03T14:25:12.704Z: Staged package conscrypt-openjdk-uber-2.5.1-AfnHQstZKhUeLmK9U5eomAYoqWcAH82s1KpHRGeGhfM.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/conscrypt-openjdk-uber-2.5.1-AfnHQstZKhUeLmK9U5eomAYoqWcAH82s1KpHRGeGhfM.jar' is inaccessible.
Aug 03, 2021 2:25:15 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-03T14:25:15.162Z: Staged package netty-buffer-4.1.52.Final-QcoQNa7m4PgXdZfQp2EKWqLG5vrHRKyB_eTl5Y9jlnU.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/netty-buffer-4.1.52.Final-QcoQNa7m4PgXdZfQp2EKWqLG5vrHRKyB_eTl5Y9jlnU.jar' is inaccessible.
Aug 03, 2021 2:25:15 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-03T14:25:15.213Z: Staged package netty-codec-4.1.52.Final-PH543M5-NT2GrH26LCUatc3dTrhuqoic_kIpeCuCjlI.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/netty-codec-4.1.52.Final-PH543M5-NT2GrH26LCUatc3dTrhuqoic_kIpeCuCjlI.jar' is inaccessible.
Aug 03, 2021 2:25:15 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-03T14:25:15.276Z: Staged package netty-codec-http-4.1.52.Final-tdoo0OqHiwfTERrPXk-vQSiO8jArJkFBkP3Rp9lzyAw.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/netty-codec-http-4.1.52.Final-tdoo0OqHiwfTERrPXk-vQSiO8jArJkFBkP3Rp9lzyAw.jar' is inaccessible.
Aug 03, 2021 2:25:15 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-03T14:25:15.332Z: Staged package netty-codec-http2-4.1.52.Final-61J6QtIonRLe5tR1PKJxWXije7tBxxkVzk6VOcSfk6E.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/netty-codec-http2-4.1.52.Final-61J6QtIonRLe5tR1PKJxWXije7tBxxkVzk6VOcSfk6E.jar' is inaccessible.
Aug 03, 2021 2:25:15 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-03T14:25:15.369Z: Staged package netty-codec-socks-4.1.52.Final-_sxXfgu3ch1naM_BhG7hcpEdFquA372ZldllelUdTqc.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/netty-codec-socks-4.1.52.Final-_sxXfgu3ch1naM_BhG7hcpEdFquA372ZldllelUdTqc.jar' is inaccessible.
Aug 03, 2021 2:25:15 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-03T14:25:15.414Z: Staged package netty-common-4.1.52.Final-DR8QHk231TDtBNfKvVfZXAdQ8Fm7az-t_tDIDUc0xxc.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/netty-common-4.1.52.Final-DR8QHk231TDtBNfKvVfZXAdQ8Fm7az-t_tDIDUc0xxc.jar' is inaccessible.
Aug 03, 2021 2:25:15 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-03T14:25:15.452Z: Staged package netty-handler-4.1.52.Final-LNwh-_rgSUDIWSkDl3nJP1H2GPXvshYHkxnc_PMqVcE.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/netty-handler-4.1.52.Final-LNwh-_rgSUDIWSkDl3nJP1H2GPXvshYHkxnc_PMqVcE.jar' is inaccessible.
Aug 03, 2021 2:25:15 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-03T14:25:15.514Z: Staged package netty-handler-proxy-4.1.52.Final-6NB4Y860vUgG4lWh1TLIZQ8POy1NAGrW0hgS6UG0L9w.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/netty-handler-proxy-4.1.52.Final-6NB4Y860vUgG4lWh1TLIZQ8POy1NAGrW0hgS6UG0L9w.jar' is inaccessible.
Aug 03, 2021 2:25:15 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-03T14:25:15.600Z: Staged package netty-resolver-4.1.52.Final-butyojOXnLRbC01tRsWkEzLFfAz4qAOx78YNu-y6CaY.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/netty-resolver-4.1.52.Final-butyojOXnLRbC01tRsWkEzLFfAz4qAOx78YNu-y6CaY.jar' is inaccessible.
Aug 03, 2021 2:25:15 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-03T14:25:15.667Z: Staged package netty-transport-4.1.52.Final-mj5vjA5V3jY-seoQ_ngXl-yjlOYhht8q4LTrK84LRUE.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/netty-transport-4.1.52.Final-mj5vjA5V3jY-seoQ_ngXl-yjlOYhht8q4LTrK84LRUE.jar' is inaccessible.
Aug 03, 2021 2:25:15 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-03T14:25:15.715Z: Staged package opencensus-api-0.28.0-DBcj8_bTBhMjhFzouIs1_dpQCBLgp1uOtfzErYyHGpU.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/opencensus-api-0.28.0-DBcj8_bTBhMjhFzouIs1_dpQCBLgp1uOtfzErYyHGpU.jar' is inaccessible.
Aug 03, 2021 2:25:15 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-03T14:25:15.785Z: Staged package paranamer-2.8-aIyxGKYCHYGROOhVIIyVYDFoi-S0eiS7YVvsxjrO3wc.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/paranamer-2.8-aIyxGKYCHYGROOhVIIyVYDFoi-S0eiS7YVvsxjrO3wc.jar' is inaccessible.
Aug 03, 2021 2:25:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-03T14:25:15.958Z: Staged package perfmark-api-0.23.0-xwW1wQwY_zAyuegXQrwvaw5WB_am38DIrQz_ddSRMEI.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/perfmark-api-0.23.0-xwW1wQwY_zAyuegXQrwvaw5WB_am38DIrQz_ddSRMEI.jar' is inaccessible.
Aug 03, 2021 2:25:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-03T14:25:16.407Z: Staged package snappy-java-1.1.8.4-JMTR_B6J4HgzGrj0AamcrWhZm95KLkUWBCy1SMUbHD4.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/snappy-java-1.1.8.4-JMTR_B6J4HgzGrj0AamcrWhZm95KLkUWBCy1SMUbHD4.jar' is inaccessible.
Aug 03, 2021 2:25:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-08-03T14:25:16.604Z: One or more access checks for temp location or staged files failed. Please refer to other error messages for details. For more information on security and permissions, please see https://cloud.google.com/dataflow/security-and-permissions.
Aug 03, 2021 4:00:48 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-03T16:00:46.942Z: Cancel request is committed for workflow job: 2021-08-03_05_42_56-9271568491856649635.
Aug 03, 2021 4:00:48 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-03T16:00:46.989Z: Cleaning up.
Aug 03, 2021 4:00:48 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-03T16:00:47.068Z: Stopping **** pool...
Aug 03, 2021 4:00:48 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-03T16:00:47.145Z: Stopping **** pool...
Aug 03, 2021 4:03:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-03T16:03:03.576Z: Autoscaling: Reduced the number of ****s to 0 based on low average **** CPU utilization, and the pipeline having sufficiently low backlog and keeping up with input rate.
Aug 03, 2021 4:03:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-03T16:03:03.659Z: Worker pool stopped.
Aug 03, 2021 4:03:17 PM org.apache.beam.runners.dataflow.DataflowPipelineJob logTerminalState
INFO: Job 2021-08-03_05_42_56-9271568491856649635 finished with status CANCELLED.
Aug 03, 2021 4:03:17 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric totalBytes.count, from namespace pardo
Load test results for test (ID): 403e8b6c-7e6e-4539-b687-f2b1c9711d0f and timestamp: 2021-08-03T12:42:50.889000000Z:
Metric: Value:
dataflow_v2_java11_runtime_sec 0.0
dataflow_v2_java11_total_bytes_count -1.0
Exception in thread "main" java.lang.RuntimeException: Invalid job state: CANCELLED.
at org.apache.beam.sdk.loadtests.JobFailure.handleFailure(JobFailure.java:55)
at org.apache.beam.sdk.loadtests.LoadTest.run(LoadTest.java:141)
at org.apache.beam.sdk.loadtests.ParDoLoadTest.run(ParDoLoadTest.java:53)
at org.apache.beam.sdk.loadtests.ParDoLoadTest.main(ParDoLoadTest.java:103)
> Task :sdks:java:testing:load-tests:run FAILED
> Task :runners:google-cloud-dataflow-java:cleanUpDockerImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210803123734
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:32136a2c3d28115a489e2f5bab48378c7e7539ef21b403dacc55507be21ae8fa
Deleted: sha256:b0398a4e7feea97e64d6d0294547164a31fa71702ea084d81d0aa1d4bce76656
Deleted: sha256:db2c3cd146bec7ac2aceca853a50117a2582ffc4d18653a696e3071fee26a54a
Deleted: sha256:ac0034fc58af4081b6f1adb637db7ceb14ac7973f1afa4d545b169da7e8a0564
Deleted: sha256:65fe46f21d03771bcba7effe4da30548e7bf024fd85ff8874678be8f2fe9ae43
Deleted: sha256:0db6193cc2d36a148fede854222a929a0ef430a5f47d75f082bdedea840043ff
Deleted: sha256:3424ddbe59f6aca33f25ac5b9ffa4ebe9e1c73c185be904548a3d1af021d6a5c
Deleted: sha256:2fa314d38ff7cff250752877cbdb90e3d168ccbe5fae79d74ffc2d8db205e609
Deleted: sha256:fdc9c3105b00cf9cb9331a6cedd2fefe32e389189281b6ad743cd1bcc24931e4
Deleted: sha256:0ba037eea5b6dd4ea063ff4c50c6abd5899824725f5191e5bd49924b3a130fc6
Deleted: sha256:96f34b190a26739879492f3b42ec95c4b5a6f0a87551a0257d55abdd6ce379b4
Deleted: sha256:c677e1d674418b371aee35ca8f5cce9ad5219fe1af9555f050ccbdb59f332131
Deleted: sha256:4e0f6384fd82f09288927431d13db62af6cefe98a90ff1d0ff20c8b0f7ec165e
Deleted: sha256:241c424ed2d745d072d4518a328cd7c93ed71bae7f091d1120296e8fcbc5f3b0
Deleted: sha256:8cfc2acf0f75f71ba9649a6dd5afea27e8f5241335e926ecd04b1ce77089abcf
Deleted: sha256:78157cf2f84e688391935a290b9342c6481a8c63651f47854e1a151e2562ccb7
Deleted: sha256:6ae4c35535adec13f73d90c82acbc32798e1d6068b9d136ca7f2759c8544677b
Deleted: sha256:2a451a2015a919e496864101bcea2cb3fe929d0cd9cb017c9658000a3b888f4b
Deleted: sha256:f43c1b00839ed5d56596666e2cfe02652d0c21a2c43f5b88635495052e4bd5b5
Deleted: sha256:406b162fde37214d04f4bb7d2636320751932ddd1a4904ed6dab78d2fd22f2f8
Deleted: sha256:21fc2491b17c76e82875ed96d69f4dd3b62a8e022d0eb56d372505427618e448
Deleted: sha256:ead01c0e2db0a1a0818535430dd61dd68a0a50bab89c911c30830a5fa23cfda3
Deleted: sha256:b59bdaa47d9aa46b9c03d7c06335b1ee1e7a3498e8536ec00c3ba0066977460d
Deleted: sha256:00eb569b6dc99efd822d0c376ff5119907d76bff130d643cfb3f713c9d48de43
Deleted: sha256:5a8a18a6b12dab602733c144ea44cf852fb8547ef1e052bbe0c880ec821ad37b
Deleted: sha256:6b825d27c252a380952867a16962ef3047de30fb9278ce4c81a66bed507a62af
Deleted: sha256:9621407ad6da5d085c9d1ee765b1c2604306bba7fa1cef5a00bbc340852fa255
Deleted: sha256:97b9d50b17fcc474037f0f5b804b15a762c16916349b0edb3a9c13327a1f0f07
Deleted: sha256:df1d71e9a34939843f3d742a077a649d5e4d5aca16b025c1f47548130f2b803d
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210803123734]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:32136a2c3d28115a489e2f5bab48378c7e7539ef21b403dacc55507be21ae8fa]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210803123734] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:32136a2c3d28115a489e2f5bab48378c7e7539ef21b403dacc55507be21ae8fa])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:32136a2c3d28115a489e2f5bab48378c7e7539ef21b403dacc55507be21ae8fa
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:32136a2c3d28115a489e2f5bab48378c7e7539ef21b403dacc55507be21ae8fa
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:32136a2c3d28115a489e2f5bab48378c7e7539ef21b403dacc55507be21ae8fa].
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:testing:load-tests:run'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 3h 26m 1s
107 actionable tasks: 79 executed, 26 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/vk56z26ymfv2g
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins:
beam_LoadTests_Java_ParDo_Dataflow_V2_Streaming_Java11 #46
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Java_ParDo_Dataflow_V2_Streaming_Java11/46/display/redirect>
Changes:
------------------------------------------
[...truncated 66.30 KB...]
4b0edb23340c: Waiting
5a9a65095453: Waiting
02fdf1379dbd: Waiting
325b4c78a3e0: Pushed
b8ed08963548: Pushed
6d8c8338bae2: Pushed
02fdf1379dbd: Pushed
4c4152d6524a: Pushed
a5f1be17166d: Pushed
cb684f607ca3: Pushed
70bb5aa8bf79: Pushed
f42aed5f7feb: Layer already exists
236ee6562d53: Pushed
89819bafde36: Layer already exists
f3d5b8f65132: Layer already exists
ad83f0aa5c0a: Layer already exists
338f79297050: Pushed
5a9a65095453: Layer already exists
4b0edb23340c: Layer already exists
afa3e488a0ee: Layer already exists
4ac8e223a92a: Pushed
abea306a56dd: Pushed
20210802123737: digest: sha256:c03cf25a4b688aedd40ff127c40ba38836859fdfcc39ce08c2f580eae06ada7e size: 4310
> Task :sdks:java:testing:load-tests:run
Aug 02, 2021 12:42:11 PM org.apache.beam.runners.dataflow.options.DataflowPipelineOptions$StagingLocationFactory create
INFO: No stagingLocation provided, falling back to gcpTempLocation
Aug 02, 2021 12:42:12 PM org.apache.beam.runners.dataflow.DataflowRunner fromOptions
INFO: PipelineOptions.filesToStage was not specified. Defaulting to files from the classpath: will stage 191 files. Enable logging at DEBUG level to see which files will be staged.
Aug 02, 2021 12:42:12 PM org.apache.beam.sdk.Pipeline validate
WARNING: The following transforms do not have stable unique names: ParDo(TimeMonitor)
Aug 02, 2021 12:42:12 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Executing pipeline on the Dataflow Service, which will have billing implications related to Google Compute Engine usage and other Google Cloud Services.
Aug 02, 2021 12:42:14 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging portable pipeline proto to gs://temp-storage-for-perf-tests/loadtests/staging/
Aug 02, 2021 12:42:14 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <107856 bytes, hash 143f4a58e01b6493df31983321a6ab6f6b8e2960e92b96ffce1938acdbaa1346> to gs://temp-storage-for-perf-tests/loadtests/staging/pipeline-FD9KWOAbZJPfMZgzIaarb2uOKWDpK5b_zhk4rNuqE0Y.pb
Aug 02, 2021 12:42:16 PM org.apache.beam.runners.dataflow.util.PackageUtil stageClasspathElements
INFO: Uploading 191 files from PipelineOptions.filesToStage to staging location to prepare for execution.
Aug 02, 2021 12:42:17 PM org.apache.beam.runners.dataflow.util.PackageUtil stageClasspathElements
INFO: Staging files complete: 191 files cached, 0 files newly uploaded in 0 seconds
Aug 02, 2021 12:42:17 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Read input/DataflowRunner.StreamingUnboundedRead.ReadWithIds as step s1
Aug 02, 2021 12:42:17 PM org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource split
INFO: Split into 20 bundles of sizes: [org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@4a163575, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@7e642b88, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@6b350309, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@7ecec90d, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@588f63c, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@5a6fa56e, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@1981d861, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@118ffcfd, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@53f4c1e6, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@74174a23, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@6342d610, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@dc4a691, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@784abd3e, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@36c2b646, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@434514d8, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@6b1dc20f, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@4613311f, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@6540cf1d, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@ec8f4b9, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@bc042d5]
Aug 02, 2021 12:42:17 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Read input/StripIds as step s2
Aug 02, 2021 12:42:17 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding ParDo(TimeMonitor) as step s3
Aug 02, 2021 12:42:17 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding ParDo(ByteMonitor) as step s4
Aug 02, 2021 12:42:17 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 0 as step s5
Aug 02, 2021 12:42:17 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 1 as step s6
Aug 02, 2021 12:42:17 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 2 as step s7
Aug 02, 2021 12:42:17 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 3 as step s8
Aug 02, 2021 12:42:17 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 4 as step s9
Aug 02, 2021 12:42:17 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 5 as step s10
Aug 02, 2021 12:42:17 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 6 as step s11
Aug 02, 2021 12:42:17 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 7 as step s12
Aug 02, 2021 12:42:17 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 8 as step s13
Aug 02, 2021 12:42:17 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 9 as step s14
Aug 02, 2021 12:42:17 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding ParDo(TimeMonitor)2 as step s15
Aug 02, 2021 12:42:17 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Dataflow SDK version: 2.33.0-SNAPSHOT
Aug 02, 2021 12:42:19 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobs/us-central1/2021-08-02_05_42_17-1565585052688390351?project=apache-beam-testing
Aug 02, 2021 12:42:19 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Submitted job: 2021-08-02_05_42_17-1565585052688390351
Aug 02, 2021 12:42:19 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2021-08-02_05_42_17-1565585052688390351
Aug 02, 2021 12:42:25 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-08-02T12:42:25.314Z: The workflow name is not a valid Cloud Label. Labels applied to Cloud resources (such as GCE Instances) for monitoring will be labeled with this modified job name: load0tests0java110dataflow0v20streaming0pardo01-jenkins-08-x89y. For the best monitoring experience, please name your job with a valid Cloud Label. For details, see: https://cloud.google.com/compute/docs/labeling-resources#restrictions
Aug 02, 2021 12:42:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-02T12:42:28.455Z: Worker configuration: e2-standard-2 in us-central1-a.
Aug 02, 2021 12:42:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-02T12:42:28.981Z: Expanding SplittableParDo operations into optimizable parts.
Aug 02, 2021 12:42:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-02T12:42:29.009Z: Expanding CollectionToSingleton operations into optimizable parts.
Aug 02, 2021 12:42:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-02T12:42:29.058Z: Expanding CoGroupByKey operations into optimizable parts.
Aug 02, 2021 12:42:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-02T12:42:29.085Z: Expanding SplittableProcessKeyed operations into optimizable parts.
Aug 02, 2021 12:42:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-02T12:42:29.110Z: Expanding GroupByKey operations into streaming Read/Write steps
Aug 02, 2021 12:42:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-02T12:42:29.144Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
Aug 02, 2021 12:42:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-02T12:42:29.193Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
Aug 02, 2021 12:42:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-02T12:42:29.212Z: Fusing consumer Read input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource) into Read input/Impulse
Aug 02, 2021 12:42:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-02T12:42:29.233Z: Fusing consumer Read-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/PairWithRestriction into Read input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource)
Aug 02, 2021 12:42:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-02T12:42:29.260Z: Fusing consumer Read-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/SplitWithSizing into Read-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/PairWithRestriction
Aug 02, 2021 12:42:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-02T12:42:29.285Z: Fusing consumer Read input/ParDo(StripIds)/ParMultiDo(StripIds) into Read-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/ProcessElementAndRestrictionWithSizing
Aug 02, 2021 12:42:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-02T12:42:29.322Z: Fusing consumer ParDo(TimeMonitor)/ParMultiDo(TimeMonitor) into Read input/ParDo(StripIds)/ParMultiDo(StripIds)
Aug 02, 2021 12:42:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-02T12:42:29.354Z: Fusing consumer ParDo(ByteMonitor)/ParMultiDo(ByteMonitor) into ParDo(TimeMonitor)/ParMultiDo(TimeMonitor)
Aug 02, 2021 12:42:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-02T12:42:29.381Z: Fusing consumer Step: 0/ParMultiDo(CounterOperation) into ParDo(ByteMonitor)/ParMultiDo(ByteMonitor)
Aug 02, 2021 12:42:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-02T12:42:29.414Z: Fusing consumer Step: 1/ParMultiDo(CounterOperation) into Step: 0/ParMultiDo(CounterOperation)
Aug 02, 2021 12:42:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-02T12:42:29.442Z: Fusing consumer Step: 2/ParMultiDo(CounterOperation) into Step: 1/ParMultiDo(CounterOperation)
Aug 02, 2021 12:42:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-02T12:42:29.468Z: Fusing consumer Step: 3/ParMultiDo(CounterOperation) into Step: 2/ParMultiDo(CounterOperation)
Aug 02, 2021 12:42:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-02T12:42:29.493Z: Fusing consumer Step: 4/ParMultiDo(CounterOperation) into Step: 3/ParMultiDo(CounterOperation)
Aug 02, 2021 12:42:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-02T12:42:29.514Z: Fusing consumer Step: 5/ParMultiDo(CounterOperation) into Step: 4/ParMultiDo(CounterOperation)
Aug 02, 2021 12:42:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-02T12:42:29.536Z: Fusing consumer Step: 6/ParMultiDo(CounterOperation) into Step: 5/ParMultiDo(CounterOperation)
Aug 02, 2021 12:42:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-02T12:42:29.584Z: Fusing consumer Step: 7/ParMultiDo(CounterOperation) into Step: 6/ParMultiDo(CounterOperation)
Aug 02, 2021 12:42:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-02T12:42:29.612Z: Fusing consumer Step: 8/ParMultiDo(CounterOperation) into Step: 7/ParMultiDo(CounterOperation)
Aug 02, 2021 12:42:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-02T12:42:29.643Z: Fusing consumer Step: 9/ParMultiDo(CounterOperation) into Step: 8/ParMultiDo(CounterOperation)
Aug 02, 2021 12:42:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-02T12:42:29.675Z: Fusing consumer ParDo(TimeMonitor)2/ParMultiDo(TimeMonitor) into Step: 9/ParMultiDo(CounterOperation)
Aug 02, 2021 12:42:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-02T12:42:29.947Z: Starting 5 ****s in us-central1-a...
Aug 02, 2021 12:42:49 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-02T12:42:47.606Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete
Aug 02, 2021 12:43:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-02T12:43:04.984Z: Autoscaling: Raised the number of ****s to 3 so that the pipeline can catch up with its backlog and keep up with its input rate.
Aug 02, 2021 12:43:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-02T12:43:05.012Z: Resized **** pool to 3, though goal was 5. This could be a quota issue.
Aug 02, 2021 12:43:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-02T12:43:15.238Z: Autoscaling: Raised the number of ****s to 5 so that the pipeline can catch up with its backlog and keep up with its input rate.
Aug 02, 2021 12:44:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-02T12:44:08.092Z: Workers have started successfully.
Aug 02, 2021 12:44:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-02T12:44:08.127Z: Workers have started successfully.
Aug 02, 2021 4:01:06 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-02T16:01:04.010Z: Cancel request is committed for workflow job: 2021-08-02_05_42_17-1565585052688390351.
Aug 02, 2021 4:01:06 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-02T16:01:04.109Z: Cleaning up.
Aug 02, 2021 4:01:06 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-02T16:01:05.622Z: Stopping **** pool...
Aug 02, 2021 4:01:06 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-02T16:01:05.671Z: Stopping **** pool...
Aug 02, 2021 4:01:49 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-02T16:01:49.053Z: Cleaning up.
Aug 02, 2021 4:01:49 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-02T16:01:49.311Z: Stopping **** pool...
Aug 02, 2021 4:02:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-02T16:02:03.246Z: Workers have started successfully.
Aug 02, 2021 4:02:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-02T16:02:10.588Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete
Aug 02, 2021 4:03:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-02T16:03:16.035Z: Stopping **** pool...
Aug 02, 2021 4:03:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-02T16:03:44.943Z: Autoscaling: Reduced the number of ****s to 0 based on low average **** CPU utilization, and the pipeline having sufficiently low backlog and keeping up with input rate.
Aug 02, 2021 4:03:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-02T16:03:44.971Z: Worker pool stopped.
Aug 02, 2021 4:03:51 PM org.apache.beam.runners.dataflow.DataflowPipelineJob logTerminalState
INFO: Job 2021-08-02_05_42_17-1565585052688390351 finished with status CANCELLED.
Aug 02, 2021 4:03:51 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric totalBytes.count, from namespace pardo
Load test results for test (ID): 6ff174d6-7e25-4506-b663-64036447321f and timestamp: 2021-08-02T12:42:12.511000000Z:
Metric: Value:
dataflow_v2_java11_runtime_sec 0.0
dataflow_v2_java11_total_bytes_count -1.0
Exception in thread "main" java.lang.RuntimeException: Invalid job state: CANCELLED.
at org.apache.beam.sdk.loadtests.JobFailure.handleFailure(JobFailure.java:55)
at org.apache.beam.sdk.loadtests.LoadTest.run(LoadTest.java:141)
at org.apache.beam.sdk.loadtests.ParDoLoadTest.run(ParDoLoadTest.java:53)
at org.apache.beam.sdk.loadtests.ParDoLoadTest.main(ParDoLoadTest.java:103)
> Task :sdks:java:testing:load-tests:run FAILED
> Task :runners:google-cloud-dataflow-java:cleanUpDockerImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210802123737
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:c03cf25a4b688aedd40ff127c40ba38836859fdfcc39ce08c2f580eae06ada7e
Deleted: sha256:3d00567bfcb3274f50559752394aed9daa1201e8edb8624a711ce86ce87a7574
Deleted: sha256:6ee1477e6b68b4d8a0a09f83e3e45c8e1108bf66c7deddb9c76ebf0deb5e2ca4
Deleted: sha256:008b5368d43abd66900fde8253efbb402bd434fa733931a9c012a7dc95182542
Deleted: sha256:274866c976659c0e0a9390aa14ee8b5aed78fa23e393cb5a925adbabbcb6dec1
Deleted: sha256:2abe4822feb741773b44d12f74195f4c79eb4effe92663efa4fc67bf71aa5898
Deleted: sha256:4d37345c9ce946518934baf5b70afa4decbef4bb308eb23b6145562ac522752d
Deleted: sha256:3a64ad5398d708ef7fe6f8762d5ee3ccf02ee9b83c19e382a3c8ac48dd077e1a
Deleted: sha256:113915590cd06dbb3e53c6e908fc95c6384b846ed3db4e5b1df9a73d5079f29f
Deleted: sha256:d1cb50024813910db00cbd098d4736913e048302ee0ea037c81da65a77c89bde
Deleted: sha256:470f60a624201a0c7ba7d12331562adacab2579b81983110d7f5d6b482089174
Deleted: sha256:0c965427ff68b8d2faa8c8ddc5eff78d88cc32d41375d3a10454c939a69c70b1
Deleted: sha256:5a9ca6bd1eea2826de917cfc06b75f444720fdb2456a51f1f89fb2d707de9e66
Deleted: sha256:9d32c5508fabf92b4ebb970bd95bbe15add03111a7c2b06668a416d82c079d2b
Deleted: sha256:f69ba3cdab01883e529e39d2f1658bfeb105d71538e99e5e40afb9afb0bb4aa4
Deleted: sha256:e00a00b10c4486a2533f5b0e831d2ef604f73c43d29a6c1a4a22880464d1c51f
Deleted: sha256:4e16a7fea5dd735de9c32c1df83bc0697db7b26b01005f18823c1489a84bb766
Deleted: sha256:d6da9150d46ca011b5514770a4910917fcad09dadb56651042c37747dbbb3354
Deleted: sha256:30af725f2407be921a886985355115138f07eaec9abb9ef753adfdc0e79c9099
Deleted: sha256:6a9a69632d6727bafaa803b799f3a1685f18612392b3c3a4dfd5ca1aa07a0c80
Deleted: sha256:2e3197ef05a3ab8f8ae4c2c70baa468f2066b07ccc7e2aca835f0d67d59cfc81
Deleted: sha256:fffbce91463466af2759ba554ea66de451168177bf6a0530f744b2d521c15d57
Deleted: sha256:f328e09d027771b91b7fb7576d738e47a959f96679fb31a7bc35ba34dc243c10
Deleted: sha256:8540d07b40e443f948fdb0a0f8161396845f07c43434ac3fec8457511d506e99
Deleted: sha256:fab0b743ad56467d97de47207c33f971be8a62557ca1f5e92b26f55f960d8ab5
Deleted: sha256:992151a406cef7866881b3ea7a98801dfc833fa04b0dde84d4337b60c11dec9c
Deleted: sha256:747e5d766091aee2b2fca0a6ec5ea2fa828630c9fb06dcde39292e3f8ac974ad
Deleted: sha256:b9d7df5fd5701b8b591603a9d1202fccd073ff488090e4872f49b9b55401fbca
Deleted: sha256:cbfbc06b60b54393b3f2172c2b0c8af9807caa6f215f55de5aba53650a30ce05
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210802123737]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:c03cf25a4b688aedd40ff127c40ba38836859fdfcc39ce08c2f580eae06ada7e]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210802123737] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:c03cf25a4b688aedd40ff127c40ba38836859fdfcc39ce08c2f580eae06ada7e])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:c03cf25a4b688aedd40ff127c40ba38836859fdfcc39ce08c2f580eae06ada7e
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:c03cf25a4b688aedd40ff127c40ba38836859fdfcc39ce08c2f580eae06ada7e
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:c03cf25a4b688aedd40ff127c40ba38836859fdfcc39ce08c2f580eae06ada7e].
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:testing:load-tests:run'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 3h 26m 34s
107 actionable tasks: 76 executed, 29 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/ihtj5gu7vha3o
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org