You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2021/09/11 12:40:21 UTC
Build failed in Jenkins:
beam_LoadTests_Java_ParDo_Dataflow_V2_Streaming_Java11 #86
See <https://ci-beam.apache.org/job/beam_LoadTests_Java_ParDo_Dataflow_V2_Streaming_Java11/86/display/redirect?page=changes>
Changes:
[noreply] Added type annotations to some combiners missing it. (#15414)
[noreply] [BEAM-12634] JmsIO auto scaling feature (#15464)
[noreply] [BEAM-12662] Get Flink version from cluster. (#15223)
[noreply] Port changes from Pub/Sub Lite to beam (#15418)
[heejong] [BEAM-12805] Fix XLang CombinePerKey test by explicitly assigning the
[BenWhitehead] [BEAM-8376] Google Cloud Firestore Connector - Add handling for
[noreply] Decreasing peak memory usage for beam.TupleCombineFn (#15494)
[noreply] [BEAM-12802] Add support for prefetch through data layers down through
[noreply] [BEAM-11097] Add implementation of side input cache (#15483)
------------------------------------------
[...truncated 39.90 KB...]
> Task :runners:google-cloud-dataflow-java:compileJava FROM-CACHE
> Task :runners:google-cloud-dataflow-java:classes
> Task :sdks:java:testing:load-tests:jar
> Task :runners:google-cloud-dataflow-java:jar
> Task :sdks:java:container:java11:copyDockerfileDependencies
> Task :sdks:java:container:buildLinuxAmd64
> Task :sdks:java:container:goBuild
> Task :sdks:java:container:java11:copySdkHarnessLauncher
> Task :sdks:java:container:generateLicenseReport
> Task :sdks:java:container:pullLicenses
Copying already-fetched licenses from <https://ci-beam.apache.org/job/beam_LoadTests_Java_ParDo_Dataflow_V2_Streaming_Java11/ws/src/sdks/java/container/build/reports/dependency-license> to <https://ci-beam.apache.org/job/beam_LoadTests_Java_ParDo_Dataflow_V2_Streaming_Java11/ws/src/sdks/java/container/build/target/java_third_party_licenses>
Already using interpreter /usr/bin/python3
Using base prefix '/usr'
New python executable in <https://ci-beam.apache.org/job/beam_LoadTests_Java_ParDo_Dataflow_V2_Streaming_Java11/ws/src/sdks/java/container/build/virtualenv/bin/python3>
Also creating executable in <https://ci-beam.apache.org/job/beam_LoadTests_Java_ParDo_Dataflow_V2_Streaming_Java11/ws/src/sdks/java/container/build/virtualenv/bin/python>
Installing setuptools, pip, wheel...
done.
DEPRECATION: Python 3.5 reached the end of its life on September 13th, 2020. Please upgrade your Python as Python 3.5 is no longer maintained. pip 21.0 will drop support for Python 3.5 in January 2021. pip 21.0 will remove support for this functionality.
Collecting beautifulsoup4<5.0,>=4.9.0
Using cached beautifulsoup4-4.10.0-py3-none-any.whl (97 kB)
Collecting future<1.0.0,>=0.16.0
Using cached future-0.18.2-py3-none-any.whl
Collecting pyyaml<6.0.0,>=3.12
Using cached PyYAML-5.3.1-cp35-cp35m-linux_x86_64.whl
Collecting tenacity<6.0,>=5.0.2
Using cached tenacity-5.1.5-py2.py3-none-any.whl (34 kB)
Collecting soupsieve>1.2
Using cached soupsieve-2.1-py3-none-any.whl (32 kB)
Collecting six>=1.9.0
Using cached six-1.16.0-py2.py3-none-any.whl (11 kB)
Installing collected packages: soupsieve, six, tenacity, pyyaml, future, beautifulsoup4
Successfully installed beautifulsoup4-4.10.0 future-0.18.2 pyyaml-5.3.1 six-1.16.0 soupsieve-2.1 tenacity-5.1.5
Executing <https://ci-beam.apache.org/job/beam_LoadTests_Java_ParDo_Dataflow_V2_Streaming_Java11/ws/src/sdks/java/container/build/virtualenv/bin/python> <https://ci-beam.apache.org/job/beam_LoadTests_Java_ParDo_Dataflow_V2_Streaming_Java11/ws/src/sdks/java/container/license_scripts/pull_licenses_java.py> --license_index=<https://ci-beam.apache.org/job/beam_LoadTests_Java_ParDo_Dataflow_V2_Streaming_Java11/ws/src/sdks/java/container/build/reports/dependency-license/index.json> --output_dir=<https://ci-beam.apache.org/job/beam_LoadTests_Java_ParDo_Dataflow_V2_Streaming_Java11/ws/src/sdks/java/container/build/target/java_third_party_licenses> --dep_url_yaml=<https://ci-beam.apache.org/job/beam_LoadTests_Java_ParDo_Dataflow_V2_Streaming_Java11/ws/src/sdks/java/container/license_scripts/dep_urls_java.yaml>
INFO:root:Pulling license for 207 dependencies using 16 threads.
INFO:root:pull_licenses_java.py succeed. It took 6.890495 seconds with 16 threads.
Copying licenses from <https://ci-beam.apache.org/job/beam_LoadTests_Java_ParDo_Dataflow_V2_Streaming_Java11/ws/src/sdks/java/container/build/target/java_third_party_licenses> to <https://ci-beam.apache.org/job/beam_LoadTests_Java_ParDo_Dataflow_V2_Streaming_Java11/ws/src/sdks/java/container/build/target/third_party_licenses.>
Finished license_scripts.sh
> Task :sdks:java:container:java11:copyJavaThirdPartyLicenses
> Task :release:go-licenses:java:dockerRun
+ go-licenses save github.com/apache/beam/sdks/java/container --save_path=/output/licenses
+ go-licenses csv github.com/apache/beam/sdks/java/container
+ tee /output/licenses/list.csv
golang.org/x/net,https://go.googlesource.com/net/+/refs/heads/master/LICENSE,BSD-3-Clause
google.golang.org/protobuf,https://go.googlesource.com/protobuf/+/refs/heads/master/LICENSE,BSD-3-Clause
github.com/apache/beam/sdks/java/container,https://github.com/apache/beam/blob/master/LICENSE,Apache-2.0
github.com/apache/beam/sdks/go/pkg/beam,https://github.com/apache/beam/blob/master/sdks/go/README.md,Apache-2.0
google.golang.org/grpc,https://github.com/grpc/grpc-go/blob/master/LICENSE,Apache-2.0
github.com/golang/protobuf,https://github.com/golang/protobuf/blob/master/LICENSE,BSD-3-Clause
google.golang.org/genproto/googleapis/rpc/status,https://github.com/googleapis/go-genproto/blob/master/LICENSE,Apache-2.0
golang.org/x/sys,https://go.googlesource.com/sys/+/refs/heads/master/LICENSE,BSD-3-Clause
golang.org/x/text,https://go.googlesource.com/text/+/refs/heads/master/LICENSE,BSD-3-Clause
+ chmod -R a+w /output/licenses
> Task :release:go-licenses:java:createLicenses
> Task :sdks:java:container:java11:copyGolangLicenses
> Task :sdks:java:container:java11:dockerPrepare
> Task :sdks:java:container:java11:docker
> Task :runners:google-cloud-dataflow-java:buildAndPushDockerContainer
WARNING: `gcloud docker` will not be supported for Docker client versions above 18.03.
As an alternative, use `gcloud auth configure-docker` to configure `docker` to
use `gcloud` as a credential helper, then use `docker` as you would for non-GCR
registries, e.g. `docker pull gcr.io/project-id/my-image`. Add
`--verbosity=error` to silence this warning: `gcloud docker
--verbosity=error -- pull gcr.io/project-id/my-image`.
See: https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker
The push refers to repository [us.gcr.io/apache-beam-testing/java-postcommit-it/java]
bacccb8dc3b9: Preparing
90a801896bef: Preparing
1b824d8084a6: Preparing
0de64e33071a: Preparing
2239121ea8e8: Preparing
1e0959c18523: Preparing
2e2f4fa21b6b: Preparing
3ccf719ce0df: Preparing
b3b6279cdfe9: Preparing
3f18abaedcea: Preparing
85502f24c699: Preparing
44b09cfdf1e4: Preparing
3891808a925b: Preparing
d402f4f1b906: Preparing
00ef5416d927: Preparing
8555e663f65b: Preparing
d00da3cd7763: Preparing
4e61e63529c2: Preparing
799760671c38: Preparing
1e0959c18523: Waiting
3ccf719ce0df: Waiting
b3b6279cdfe9: Waiting
d00da3cd7763: Waiting
2e2f4fa21b6b: Waiting
d402f4f1b906: Waiting
8555e663f65b: Waiting
3f18abaedcea: Waiting
44b09cfdf1e4: Waiting
00ef5416d927: Waiting
85502f24c699: Waiting
3891808a925b: Waiting
799760671c38: Waiting
1b824d8084a6: Pushed
90a801896bef: Pushed
2239121ea8e8: Pushed
bacccb8dc3b9: Pushed
1e0959c18523: Pushed
3ccf719ce0df: Pushed
b3b6279cdfe9: Pushed
85502f24c699: Pushed
2e2f4fa21b6b: Pushed
3891808a925b: Layer already exists
00ef5416d927: Layer already exists
d402f4f1b906: Layer already exists
8555e663f65b: Layer already exists
d00da3cd7763: Layer already exists
4e61e63529c2: Layer already exists
799760671c38: Layer already exists
44b09cfdf1e4: Pushed
0de64e33071a: Pushed
3f18abaedcea: Pushed
20210911123737: digest: sha256:ebea30ef5e981afc666736c87863885d0b82a022c701397e481aca9242345c15 size: 4311
> Task :sdks:java:testing:load-tests:run
Sep 11, 2021 12:39:46 PM org.apache.beam.runners.dataflow.options.DataflowPipelineOptions$StagingLocationFactory create
INFO: No stagingLocation provided, falling back to gcpTempLocation
Sep 11, 2021 12:39:47 PM org.apache.beam.runners.dataflow.DataflowRunner fromOptions
INFO: PipelineOptions.filesToStage was not specified. Defaulting to files from the classpath: will stage 195 files. Enable logging at DEBUG level to see which files will be staged.
Sep 11, 2021 12:39:47 PM org.apache.beam.sdk.Pipeline validate
WARNING: The following transforms do not have stable unique names: ParDo(TimeMonitor)
Sep 11, 2021 12:39:47 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Executing pipeline on the Dataflow Service, which will have billing implications related to Google Compute Engine usage and other Google Cloud Services.
Sep 11, 2021 12:39:50 PM org.apache.beam.runners.dataflow.util.PackageUtil stageClasspathElements
INFO: Uploading 195 files from PipelineOptions.filesToStage to staging location to prepare for execution.
Sep 11, 2021 12:39:51 PM org.apache.beam.runners.dataflow.util.PackageUtil stageClasspathElements
INFO: Staging files complete: 195 files cached, 0 files newly uploaded in 0 seconds
Sep 11, 2021 12:39:51 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging portable pipeline proto to gs://temp-storage-for-perf-tests/loadtests/staging/
Sep 11, 2021 12:39:51 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <101788 bytes, hash 06cfb733691a17b9a9609dd112eb63a6ffb8bdc8e1ff5c203dafa13c392a35ab> to gs://temp-storage-for-perf-tests/loadtests/staging/pipeline-Bs-3M2kaF7mpYJ3REutjpv-4vcjh_1wgPa-hPDkqNas.pb
Sep 11, 2021 12:39:52 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Read input/DataflowRunner.StreamingUnboundedRead.ReadWithIds as step s1
Sep 11, 2021 12:39:53 PM org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource split
INFO: Split into 20 bundles of sizes: [org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@291373d3, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@372ca2d6, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@3204e238, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@38ed139b, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@a5272be, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@58ba5b30, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@4dba773d, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@1d9bd4da, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@4c58255, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@eac3a26, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@10b1a751, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@53cf9c99, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@7b306b9f, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@142213d5, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@934b52f, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@2630dbc4, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@5ea4300e, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@5a1c3cb4, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@76ad6715, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@56637cff]
Sep 11, 2021 12:39:53 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Read input/StripIds as step s2
Sep 11, 2021 12:39:53 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding ParDo(TimeMonitor) as step s3
Sep 11, 2021 12:39:53 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding ParDo(ByteMonitor) as step s4
Sep 11, 2021 12:39:53 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 0 as step s5
Sep 11, 2021 12:39:53 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 1 as step s6
Sep 11, 2021 12:39:53 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 2 as step s7
Sep 11, 2021 12:39:53 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 3 as step s8
Sep 11, 2021 12:39:53 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 4 as step s9
Sep 11, 2021 12:39:53 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 5 as step s10
Sep 11, 2021 12:39:53 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 6 as step s11
Sep 11, 2021 12:39:53 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 7 as step s12
Sep 11, 2021 12:39:53 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 8 as step s13
Sep 11, 2021 12:39:53 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 9 as step s14
Sep 11, 2021 12:39:53 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding ParDo(TimeMonitor)2 as step s15
Sep 11, 2021 12:39:53 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Dataflow SDK version: 2.34.0-SNAPSHOT
Sep 11, 2021 12:39:54 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobs/us-central1/2021-09-11_05_39_53-14409334658374730752?project=apache-beam-testing
Sep 11, 2021 12:39:54 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Submitted job: 2021-09-11_05_39_53-14409334658374730752
Sep 11, 2021 12:39:54 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2021-09-11_05_39_53-14409334658374730752
Sep 11, 2021 12:40:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-09-11T12:40:01.531Z: The workflow name is not a valid Cloud Label. Labels applied to Cloud resources (such as GCE Instances) for monitoring will be labeled with this modified job name: load0tests0java110dataflow0v20streaming0pardo01-jenkins-09-49kp. For the best monitoring experience, please name your job with a valid Cloud Label. For details, see: https://cloud.google.com/compute/docs/labeling-resources#restrictions
Sep 11, 2021 12:40:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-11T12:40:08.907Z: Worker configuration: e2-standard-2 in us-central1-a.
Sep 11, 2021 12:40:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-09-11T12:40:09.479Z: Workflow failed. Causes: Project apache-beam-testing has insufficient quota(s) to execute this workflow with 1 instances in region us-central1. Quota summary (required/available): 1/24358 instances, 2/0 CPUs, 30/179806 disk GB, 0/2397 SSD disk GB, 1/228 instance groups, 1/231 managed instance groups, 1/455 instance templates, 1/587 in-use IP addresses.
Please see https://cloud.google.com/compute/docs/resource-quotas about requesting more quota.
Sep 11, 2021 12:40:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-11T12:40:09.517Z: Cleaning up.
Sep 11, 2021 12:40:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-11T12:40:09.578Z: Worker pool stopped.
Sep 11, 2021 12:40:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-11T12:40:10.727Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete
Sep 11, 2021 12:40:14 PM org.apache.beam.runners.dataflow.DataflowPipelineJob logTerminalState
INFO: Job 2021-09-11_05_39_53-14409334658374730752 failed with status FAILED.
Sep 11, 2021 12:40:14 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric totalBytes.count, from namespace pardo
Load test results for test (ID): f5aaf62c-b731-4f12-80ad-5fcac1c54fad and timestamp: 2021-09-11T12:39:47.531000000Z:
Metric: Value:
dataflow_v2_java11_runtime_sec 0.0
dataflow_v2_java11_total_bytes_count -1.0
Exception in thread "main" java.lang.RuntimeException: Invalid job state: FAILED.
at org.apache.beam.sdk.loadtests.JobFailure.handleFailure(JobFailure.java:55)
at org.apache.beam.sdk.loadtests.LoadTest.run(LoadTest.java:141)
at org.apache.beam.sdk.loadtests.ParDoLoadTest.run(ParDoLoadTest.java:53)
at org.apache.beam.sdk.loadtests.ParDoLoadTest.main(ParDoLoadTest.java:103)
> Task :sdks:java:testing:load-tests:run FAILED
> Task :runners:google-cloud-dataflow-java:cleanUpDockerImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210911123737
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:ebea30ef5e981afc666736c87863885d0b82a022c701397e481aca9242345c15
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210911123737]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:ebea30ef5e981afc666736c87863885d0b82a022c701397e481aca9242345c15]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210911123737] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:ebea30ef5e981afc666736c87863885d0b82a022c701397e481aca9242345c15])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:ebea30ef5e981afc666736c87863885d0b82a022c701397e481aca9242345c15
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:ebea30ef5e981afc666736c87863885d0b82a022c701397e481aca9242345c15
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:ebea30ef5e981afc666736c87863885d0b82a022c701397e481aca9242345c15].
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:testing:load-tests:run'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2m 58s
101 actionable tasks: 70 executed, 29 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/fnipp7tyorfec
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal :
beam_LoadTests_Java_ParDo_Dataflow_V2_Streaming_Java11 #89
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Java_ParDo_Dataflow_V2_Streaming_Java11/89/display/redirect?page=changes>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins:
beam_LoadTests_Java_ParDo_Dataflow_V2_Streaming_Java11 #88
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Java_ParDo_Dataflow_V2_Streaming_Java11/88/display/redirect>
Changes:
------------------------------------------
[...truncated 199.62 KB...]
Sep 13, 2021 1:16:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-09-13T13:16:18.848Z: Project apache-beam-testing has insufficient quota(s) to execute this workflow with 1 instances in region us-central1. Quota summary (required/available): 1/24386 instances, 2/0 CPUs, 30/183701 disk GB, 0/2397 SSD disk GB, 1/288 instance groups, 1/291 managed instance groups, 1/517 instance templates, 1/615 in-use IP addresses.
Please see https://cloud.google.com/compute/docs/resource-quotas about requesting more quota.
Sep 13, 2021 1:19:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-09-13T13:19:18.834Z: Project apache-beam-testing has insufficient quota(s) to execute this workflow with 1 instances in region us-central1. Quota summary (required/available): 1/24386 instances, 2/0 CPUs, 30/183701 disk GB, 0/2397 SSD disk GB, 1/288 instance groups, 1/291 managed instance groups, 1/517 instance templates, 1/615 in-use IP addresses.
Please see https://cloud.google.com/compute/docs/resource-quotas about requesting more quota.
Sep 13, 2021 1:22:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-09-13T13:22:18.350Z: Project apache-beam-testing has insufficient quota(s) to execute this workflow with 1 instances in region us-central1. Quota summary (required/available): 1/24386 instances, 2/0 CPUs, 30/183701 disk GB, 0/2397 SSD disk GB, 1/288 instance groups, 1/291 managed instance groups, 1/517 instance templates, 1/615 in-use IP addresses.
Please see https://cloud.google.com/compute/docs/resource-quotas about requesting more quota.
Sep 13, 2021 1:25:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-09-13T13:25:18.236Z: Project apache-beam-testing has insufficient quota(s) to execute this workflow with 1 instances in region us-central1. Quota summary (required/available): 1/24386 instances, 2/0 CPUs, 30/183701 disk GB, 0/2397 SSD disk GB, 1/288 instance groups, 1/291 managed instance groups, 1/517 instance templates, 1/615 in-use IP addresses.
Please see https://cloud.google.com/compute/docs/resource-quotas about requesting more quota.
Sep 13, 2021 1:28:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-09-13T13:28:18.323Z: Project apache-beam-testing has insufficient quota(s) to execute this workflow with 1 instances in region us-central1. Quota summary (required/available): 1/24385 instances, 2/0 CPUs, 30/183671 disk GB, 0/2397 SSD disk GB, 1/288 instance groups, 1/291 managed instance groups, 1/517 instance templates, 1/614 in-use IP addresses.
Please see https://cloud.google.com/compute/docs/resource-quotas about requesting more quota.
Sep 13, 2021 1:31:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-09-13T13:31:18.285Z: Project apache-beam-testing has insufficient quota(s) to execute this workflow with 1 instances in region us-central1. Quota summary (required/available): 1/24386 instances, 2/0 CPUs, 30/183701 disk GB, 0/2397 SSD disk GB, 1/288 instance groups, 1/291 managed instance groups, 1/517 instance templates, 1/615 in-use IP addresses.
Please see https://cloud.google.com/compute/docs/resource-quotas about requesting more quota.
Sep 13, 2021 1:34:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-09-13T13:34:18.148Z: Project apache-beam-testing has insufficient quota(s) to execute this workflow with 1 instances in region us-central1. Quota summary (required/available): 1/24385 instances, 2/0 CPUs, 30/183671 disk GB, 0/2397 SSD disk GB, 1/288 instance groups, 1/291 managed instance groups, 1/517 instance templates, 1/614 in-use IP addresses.
Please see https://cloud.google.com/compute/docs/resource-quotas about requesting more quota.
Sep 13, 2021 1:37:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-09-13T13:37:17.821Z: Project apache-beam-testing has insufficient quota(s) to execute this workflow with 1 instances in region us-central1. Quota summary (required/available): 1/24386 instances, 2/0 CPUs, 30/183701 disk GB, 0/2397 SSD disk GB, 1/288 instance groups, 1/291 managed instance groups, 1/517 instance templates, 1/615 in-use IP addresses.
Please see https://cloud.google.com/compute/docs/resource-quotas about requesting more quota.
Sep 13, 2021 1:40:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-09-13T13:40:17.984Z: Project apache-beam-testing has insufficient quota(s) to execute this workflow with 1 instances in region us-central1. Quota summary (required/available): 1/24386 instances, 2/0 CPUs, 30/183701 disk GB, 0/2397 SSD disk GB, 1/288 instance groups, 1/291 managed instance groups, 1/517 instance templates, 1/615 in-use IP addresses.
Please see https://cloud.google.com/compute/docs/resource-quotas about requesting more quota.
Sep 13, 2021 1:43:21 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-09-13T13:43:18.960Z: The quota check has failed. Causes: Requested quota metric CPUs is currently unavailable.
Sep 13, 2021 1:46:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-09-13T13:46:18.355Z: The quota check has failed. Causes: Requested quota metric CPUs is currently unavailable.
Sep 13, 2021 1:49:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-09-13T13:49:18.056Z: The quota check has failed. Causes: Requested quota metric CPUs is currently unavailable.
Sep 13, 2021 1:52:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-09-13T13:52:18.220Z: The quota check has failed. Causes: Requested quota metric CPUs is currently unavailable.
Sep 13, 2021 1:55:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-09-13T13:55:18.444Z: The quota check has failed. Causes: Requested quota metric CPUs is currently unavailable.
Sep 13, 2021 1:58:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-09-13T13:58:18.272Z: The quota check has failed. Causes: Requested quota metric CPUs is currently unavailable.
Sep 13, 2021 2:01:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-09-13T14:01:18.462Z: The quota check has failed. Causes: Requested quota metric CPUs is currently unavailable.
Sep 13, 2021 2:04:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-09-13T14:04:18.801Z: The quota check has failed. Causes: Requested quota metric CPUs is currently unavailable.
Sep 13, 2021 2:07:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-09-13T14:07:18.773Z: The quota check has failed. Causes: Requested quota metric CPUs is currently unavailable.
Sep 13, 2021 2:10:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-09-13T14:10:18.715Z: The quota check has failed. Causes: Requested quota metric CPUs is currently unavailable.
Sep 13, 2021 2:13:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-09-13T14:13:17.923Z: The quota check has failed. Causes: Requested quota metric CPUs is currently unavailable.
Sep 13, 2021 2:16:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-09-13T14:16:17.921Z: The quota check has failed. Causes: Requested quota metric CPUs is currently unavailable.
Sep 13, 2021 2:19:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-09-13T14:19:18.072Z: The quota check has failed. Causes: Requested quota metric CPUs is currently unavailable.
Sep 13, 2021 2:22:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-09-13T14:22:18.233Z: The quota check has failed. Causes: Requested quota metric CPUs is currently unavailable.
Sep 13, 2021 2:25:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-09-13T14:25:18.361Z: The quota check has failed. Causes: Requested quota metric CPUs is currently unavailable.
Sep 13, 2021 2:28:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-09-13T14:28:18.815Z: The quota check has failed. Causes: Requested quota metric CPUs is currently unavailable.
Sep 13, 2021 2:31:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-09-13T14:31:19.373Z: The quota check has failed. Causes: Requested quota metric CPUs is currently unavailable.
Sep 13, 2021 2:34:21 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-09-13T14:34:19.977Z: The quota check has failed. Causes: Requested quota metric CPUs is currently unavailable.
Sep 13, 2021 2:37:21 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-09-13T14:37:19.574Z: The quota check has failed. Causes: Requested quota metric CPUs is currently unavailable.
Sep 13, 2021 2:40:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-09-13T14:40:18.036Z: The quota check has failed. Causes: Requested quota metric CPUs is currently unavailable.
Sep 13, 2021 2:43:21 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-09-13T14:43:18.409Z: The quota check has failed. Causes: Requested quota metric CPUs is currently unavailable.
Sep 13, 2021 2:46:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-09-13T14:46:18.685Z: The quota check has failed. Causes: Requested quota metric CPUs is currently unavailable.
Sep 13, 2021 2:49:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-09-13T14:49:18.181Z: The quota check has failed. Causes: Requested quota metric CPUs is currently unavailable.
Sep 13, 2021 2:52:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-09-13T14:52:18.403Z: The quota check has failed. Causes: Requested quota metric CPUs is currently unavailable.
Sep 13, 2021 2:55:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-09-13T14:55:18.303Z: The quota check has failed. Causes: Requested quota metric CPUs is currently unavailable.
Sep 13, 2021 2:58:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-09-13T14:58:17.896Z: The quota check has failed. Causes: Requested quota metric CPUs is currently unavailable.
Sep 13, 2021 3:01:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-09-13T15:01:18.205Z: The quota check has failed. Causes: Requested quota metric CPUs is currently unavailable.
Sep 13, 2021 3:04:22 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-09-13T15:04:22.550Z: The quota check has failed. Causes: Requested quota metric CPUs is currently unavailable.
Sep 13, 2021 3:07:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-09-13T15:07:19.686Z: The quota check has failed. Causes: Requested quota metric CPUs is currently unavailable.
Sep 13, 2021 3:10:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-09-13T15:10:18.966Z: The quota check has failed. Causes: Requested quota metric CPUs is currently unavailable.
Sep 13, 2021 3:13:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-09-13T15:13:18.455Z: Project apache-beam-testing has insufficient quota(s) to execute this workflow with 1 instances in region us-central1. Quota summary (required/available): 1/24386 instances, 2/0 CPUs, 30/183701 disk GB, 0/2397 SSD disk GB, 1/288 instance groups, 1/291 managed instance groups, 1/517 instance templates, 1/615 in-use IP addresses.
Please see https://cloud.google.com/compute/docs/resource-quotas about requesting more quota.
Sep 13, 2021 3:16:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-09-13T15:16:18.588Z: Project apache-beam-testing has insufficient quota(s) to execute this workflow with 1 instances in region us-central1. Quota summary (required/available): 1/24386 instances, 2/0 CPUs, 30/183701 disk GB, 0/2397 SSD disk GB, 1/288 instance groups, 1/291 managed instance groups, 1/517 instance templates, 1/615 in-use IP addresses.
Please see https://cloud.google.com/compute/docs/resource-quotas about requesting more quota.
Sep 13, 2021 3:19:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-09-13T15:19:19.011Z: Project apache-beam-testing has insufficient quota(s) to execute this workflow with 1 instances in region us-central1. Quota summary (required/available): 1/24386 instances, 2/0 CPUs, 30/183701 disk GB, 0/2397 SSD disk GB, 1/288 instance groups, 1/291 managed instance groups, 1/517 instance templates, 1/615 in-use IP addresses.
Please see https://cloud.google.com/compute/docs/resource-quotas about requesting more quota.
Sep 13, 2021 3:22:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-09-13T15:22:18.349Z: Project apache-beam-testing has insufficient quota(s) to execute this workflow with 1 instances in region us-central1. Quota summary (required/available): 1/24385 instances, 2/0 CPUs, 30/183671 disk GB, 0/2397 SSD disk GB, 1/288 instance groups, 1/291 managed instance groups, 1/517 instance templates, 1/614 in-use IP addresses.
Please see https://cloud.google.com/compute/docs/resource-quotas about requesting more quota.
Sep 13, 2021 3:25:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-09-13T15:25:18.160Z: Project apache-beam-testing has insufficient quota(s) to execute this workflow with 1 instances in region us-central1. Quota summary (required/available): 1/24385 instances, 2/0 CPUs, 30/183671 disk GB, 0/2397 SSD disk GB, 1/288 instance groups, 1/291 managed instance groups, 1/517 instance templates, 1/614 in-use IP addresses.
Please see https://cloud.google.com/compute/docs/resource-quotas about requesting more quota.
Sep 13, 2021 3:28:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-09-13T15:28:18.239Z: Project apache-beam-testing has insufficient quota(s) to execute this workflow with 1 instances in region us-central1. Quota summary (required/available): 1/24385 instances, 2/0 CPUs, 30/183671 disk GB, 0/2397 SSD disk GB, 1/288 instance groups, 1/291 managed instance groups, 1/517 instance templates, 1/614 in-use IP addresses.
Please see https://cloud.google.com/compute/docs/resource-quotas about requesting more quota.
Sep 13, 2021 3:31:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-09-13T15:31:17.972Z: Project apache-beam-testing has insufficient quota(s) to execute this workflow with 1 instances in region us-central1. Quota summary (required/available): 1/24386 instances, 2/0 CPUs, 30/183701 disk GB, 0/2397 SSD disk GB, 1/288 instance groups, 1/291 managed instance groups, 1/517 instance templates, 1/615 in-use IP addresses.
Please see https://cloud.google.com/compute/docs/resource-quotas about requesting more quota.
Sep 13, 2021 3:34:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-09-13T15:34:19.979Z: Project apache-beam-testing has insufficient quota(s) to execute this workflow with 1 instances in region us-central1. Quota summary (required/available): 1/24386 instances, 2/0 CPUs, 30/183701 disk GB, 0/2397 SSD disk GB, 1/288 instance groups, 1/291 managed instance groups, 1/517 instance templates, 1/615 in-use IP addresses.
Please see https://cloud.google.com/compute/docs/resource-quotas about requesting more quota.
Sep 13, 2021 3:37:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-09-13T15:37:17.852Z: Project apache-beam-testing has insufficient quota(s) to execute this workflow with 1 instances in region us-central1. Quota summary (required/available): 1/24385 instances, 2/0 CPUs, 30/183671 disk GB, 0/2397 SSD disk GB, 1/288 instance groups, 1/291 managed instance groups, 1/517 instance templates, 1/614 in-use IP addresses.
Please see https://cloud.google.com/compute/docs/resource-quotas about requesting more quota.
Sep 13, 2021 3:40:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-09-13T15:40:19.102Z: Project apache-beam-testing has insufficient quota(s) to execute this workflow with 1 instances in region us-central1. Quota summary (required/available): 1/24385 instances, 2/0 CPUs, 30/183671 disk GB, 0/2397 SSD disk GB, 1/288 instance groups, 1/291 managed instance groups, 1/517 instance templates, 1/614 in-use IP addresses.
Please see https://cloud.google.com/compute/docs/resource-quotas about requesting more quota.
Sep 13, 2021 3:43:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-09-13T15:43:18.085Z: Project apache-beam-testing has insufficient quota(s) to execute this workflow with 1 instances in region us-central1. Quota summary (required/available): 1/24386 instances, 2/0 CPUs, 30/183701 disk GB, 0/2397 SSD disk GB, 1/288 instance groups, 1/291 managed instance groups, 1/517 instance templates, 1/615 in-use IP addresses.
Please see https://cloud.google.com/compute/docs/resource-quotas about requesting more quota.
Sep 13, 2021 3:46:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-09-13T15:46:18.420Z: Project apache-beam-testing has insufficient quota(s) to execute this workflow with 1 instances in region us-central1. Quota summary (required/available): 1/24385 instances, 2/0 CPUs, 30/183671 disk GB, 0/2397 SSD disk GB, 1/288 instance groups, 1/291 managed instance groups, 1/517 instance templates, 1/614 in-use IP addresses.
Please see https://cloud.google.com/compute/docs/resource-quotas about requesting more quota.
Sep 13, 2021 3:49:21 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-09-13T15:49:19.651Z: Project apache-beam-testing has insufficient quota(s) to execute this workflow with 1 instances in region us-central1. Quota summary (required/available): 1/24386 instances, 2/0 CPUs, 30/183701 disk GB, 0/2397 SSD disk GB, 1/288 instance groups, 1/291 managed instance groups, 1/517 instance templates, 1/615 in-use IP addresses.
Please see https://cloud.google.com/compute/docs/resource-quotas about requesting more quota.
Sep 13, 2021 3:52:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-09-13T15:52:18.077Z: Project apache-beam-testing has insufficient quota(s) to execute this workflow with 1 instances in region us-central1. Quota summary (required/available): 1/24386 instances, 2/0 CPUs, 30/183701 disk GB, 0/2397 SSD disk GB, 1/288 instance groups, 1/291 managed instance groups, 1/517 instance templates, 1/615 in-use IP addresses.
Please see https://cloud.google.com/compute/docs/resource-quotas about requesting more quota.
Sep 13, 2021 3:55:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-09-13T15:55:19.035Z: Project apache-beam-testing has insufficient quota(s) to execute this workflow with 1 instances in region us-central1. Quota summary (required/available): 1/24385 instances, 2/0 CPUs, 30/183671 disk GB, 0/2397 SSD disk GB, 1/288 instance groups, 1/291 managed instance groups, 1/517 instance templates, 1/614 in-use IP addresses.
Please see https://cloud.google.com/compute/docs/resource-quotas about requesting more quota.
Sep 13, 2021 3:58:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-09-13T15:58:17.918Z: Project apache-beam-testing has insufficient quota(s) to execute this workflow with 1 instances in region us-central1. Quota summary (required/available): 1/24385 instances, 2/0 CPUs, 30/183671 disk GB, 0/2397 SSD disk GB, 1/288 instance groups, 1/291 managed instance groups, 1/517 instance templates, 1/614 in-use IP addresses.
Please see https://cloud.google.com/compute/docs/resource-quotas about requesting more quota.
Sep 13, 2021 4:00:33 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-13T16:00:33.455Z: Cancel request is committed for workflow job: 2021-09-13_05_51_46-1064919619404627690.
Sep 13, 2021 4:00:33 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-13T16:00:33.489Z: Cleaning up.
Sep 13, 2021 4:00:33 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-13T16:00:33.554Z: Stopping **** pool...
Sep 13, 2021 4:00:33 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-13T16:00:33.596Z: Stopping **** pool...
Sep 13, 2021 4:03:21 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-13T16:03:20.035Z: Autoscaling: Reduced the number of ****s to 0 based on low average **** CPU utilization, and the pipeline having sufficiently low backlog and keeping up with input rate.
Sep 13, 2021 4:03:21 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-13T16:03:20.077Z: Worker pool stopped.
Sep 13, 2021 4:03:29 PM org.apache.beam.runners.dataflow.DataflowPipelineJob logTerminalState
INFO: Job 2021-09-13_05_51_46-1064919619404627690 finished with status CANCELLED.
Load test results for test (ID): 04fd4bc4-6352-4cb8-88ce-a2e85f4d32cb and timestamp: 2021-09-13T12:51:39.269000000Z:
Metric: Value:
dataflow_v2_java11_runtime_sec 11173.033
dataflow_v2_java11_total_bytes_count 6.45898397E10
Exception in thread "main" java.lang.RuntimeException: Invalid job state: CANCELLED.
at org.apache.beam.sdk.loadtests.JobFailure.handleFailure(JobFailure.java:55)
at org.apache.beam.sdk.loadtests.LoadTest.run(LoadTest.java:141)
at org.apache.beam.sdk.loadtests.ParDoLoadTest.run(ParDoLoadTest.java:53)
at org.apache.beam.sdk.loadtests.ParDoLoadTest.main(ParDoLoadTest.java:103)
> Task :sdks:java:testing:load-tests:run FAILED
> Task :runners:google-cloud-dataflow-java:cleanUpDockerImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210913125101
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:cb6a74da9dc273f6bd0d0d26cee1d8852cbaff44ae36c0281f7229e6d2ab7893
Deleted: sha256:e27fc88070ae0ad3499b70745b09e882a8453460eca09ec17b2c9de9a3cb3905
Deleted: sha256:f35efbd7480769982629fdb3b26d68bfa6cc7d1093a3a7534ef93bffe415c896
Deleted: sha256:d8fad9b496977b3d7999fee03912ce2a9b1044f9dcdac18d041a75b4845e5ad4
Deleted: sha256:c085c4a34398bf3fef7e8fef057b9218393e54c158c28e3ba1b0ec724869d2d2
Deleted: sha256:bb9621523170caa456b7911234fc57a12eb230ef035b208447f4412ce39f2326
Deleted: sha256:26ad7b34dc7642f19e3845aabfbac050b059c61d2ec5033087b8908d5c1d74d0
Deleted: sha256:24994039b8b45073331d4aa538c81e2ec08603e066923d5351aee63eebdd606e
Deleted: sha256:d10232acd8fa4742d6ff6fb3ec4b82e9400e8416824aec86f4d7e14c06ceb38d
Deleted: sha256:f341aa0051b87a6caa403b0cc61086bb0002160fc144f4df36e95ce7c1d7ddc1
Deleted: sha256:e4f4158bb3aeb41236c25866f4fa18b8c3eec36b5b453c8398def5e8aa45e243
Deleted: sha256:81e5199fca739d416008613c12791963447a83cae2f995712a687772415aa9c6
Deleted: sha256:02adc86e25f57fff3668e5d3539ce818e9467df15a363292e7fc56de46cbb926
Deleted: sha256:b30925f155700b1bf54be3ad378cf3e95b60b82cfccd9fe74dad5039e9b96899
Deleted: sha256:ddc799af666ab3bab93a622e9bec56f41b4a24f8560548e424a19ba0e8af6d31
Deleted: sha256:0067e516b62f98c362bb54b5735a9287ba38943b8637fe3efc8a0bbc97730361
Deleted: sha256:836abc74d9857c850f47e6ff6d40ef287e2987ad18d9cc149178ca80e14fc661
Deleted: sha256:65733d39bd2328fed6e9fa8ba0e3cb9953c2ba4771d8d6c0c54a02f4f7b38409
Deleted: sha256:b3063c89d88faee33ec2798f10b3d25bd8f7425c3457d64fa45e96fbb81e4a15
Deleted: sha256:3e0f42e5a981246cb12c89a9024c099794324ae74edb5d550c4ad12938abbb29
Deleted: sha256:dc7c477fd55763b30bd82bde48468b4e1d18b1e886017f0d9e2c7c00a56b6179
Deleted: sha256:3136958e3792219e5135c509e0edc564b3e6845f4185f6de916642d7a4a7babc
Deleted: sha256:b8568ca87ae9fd7376fa3f543fa03158f3a84deffb94b693d15f64ae991b3fba
Deleted: sha256:f82f95a82f01db3cf659220512d0a1a05d502be9dacd65029ca942d538cfd919
Deleted: sha256:fed8aa269551c2042e0e09299ed527ee1c66e7d962eb00d4e6f0543529ed30c0
Deleted: sha256:0f8b96f235ee57602ff5e03eddaa13f07928e9b6809d431321386e69e04597f5
Deleted: sha256:cb97b4237b61dfdc7ff524a82c1e43942af33f2849817722799acde6b512a212
Deleted: sha256:c75b6482120af40166af5d4b400b0da48de2ddfcd4e485a2bbca87af42df9a6a
Deleted: sha256:a43b1f80190ceac01dbaa652e4809f7273a4786c6f23437b8a896cfd38c0c82b
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210913125101]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:cb6a74da9dc273f6bd0d0d26cee1d8852cbaff44ae36c0281f7229e6d2ab7893]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210913125101] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:cb6a74da9dc273f6bd0d0d26cee1d8852cbaff44ae36c0281f7229e6d2ab7893])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:cb6a74da9dc273f6bd0d0d26cee1d8852cbaff44ae36c0281f7229e6d2ab7893
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:cb6a74da9dc273f6bd0d0d26cee1d8852cbaff44ae36c0281f7229e6d2ab7893
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:cb6a74da9dc273f6bd0d0d26cee1d8852cbaff44ae36c0281f7229e6d2ab7893].
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:testing:load-tests:run'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 3h 12m 34s
96 actionable tasks: 9 executed, 87 up-to-date
Publishing build scan...
https://gradle.com/s/25tbx6mriw6c2
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins:
beam_LoadTests_Java_ParDo_Dataflow_V2_Streaming_Java11 #87
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Java_ParDo_Dataflow_V2_Streaming_Java11/87/display/redirect>
Changes:
------------------------------------------
[...truncated 39.92 KB...]
> Task :sdks:java:io:google-cloud-platform:jar
> Task :sdks:java:testing:load-tests:compileJava FROM-CACHE
> Task :sdks:java:testing:load-tests:classes UP-TO-DATE
> Task :sdks:java:testing:load-tests:jar
> Task :runners:google-cloud-dataflow-java:compileJava FROM-CACHE
> Task :runners:google-cloud-dataflow-java:classes
> Task :runners:google-cloud-dataflow-java:jar
> Task :sdks:java:container:java11:copyDockerfileDependencies
> Task :sdks:java:container:generateLicenseReport
> Task :sdks:java:container:pullLicenses
Copying already-fetched licenses from <https://ci-beam.apache.org/job/beam_LoadTests_Java_ParDo_Dataflow_V2_Streaming_Java11/ws/src/sdks/java/container/build/reports/dependency-license> to <https://ci-beam.apache.org/job/beam_LoadTests_Java_ParDo_Dataflow_V2_Streaming_Java11/ws/src/sdks/java/container/build/target/java_third_party_licenses>
Already using interpreter /usr/bin/python3
Using base prefix '/usr'
New python executable in <https://ci-beam.apache.org/job/beam_LoadTests_Java_ParDo_Dataflow_V2_Streaming_Java11/ws/src/sdks/java/container/build/virtualenv/bin/python3>
Also creating executable in <https://ci-beam.apache.org/job/beam_LoadTests_Java_ParDo_Dataflow_V2_Streaming_Java11/ws/src/sdks/java/container/build/virtualenv/bin/python>
Installing setuptools, pip, wheel...
done.
DEPRECATION: Python 3.5 reached the end of its life on September 13th, 2020. Please upgrade your Python as Python 3.5 is no longer maintained. pip 21.0 will drop support for Python 3.5 in January 2021. pip 21.0 will remove support for this functionality.
Collecting beautifulsoup4<5.0,>=4.9.0
Using cached beautifulsoup4-4.10.0-py3-none-any.whl (97 kB)
Collecting future<1.0.0,>=0.16.0
Using cached future-0.18.2-py3-none-any.whl
Collecting pyyaml<6.0.0,>=3.12
Using cached PyYAML-5.3.1-cp35-cp35m-linux_x86_64.whl
Collecting tenacity<6.0,>=5.0.2
Using cached tenacity-5.1.5-py2.py3-none-any.whl (34 kB)
Collecting soupsieve>1.2
Using cached soupsieve-2.1-py3-none-any.whl (32 kB)
Collecting six>=1.9.0
Using cached six-1.16.0-py2.py3-none-any.whl (11 kB)
Installing collected packages: soupsieve, six, tenacity, pyyaml, future, beautifulsoup4
Successfully installed beautifulsoup4-4.10.0 future-0.18.2 pyyaml-5.3.1 six-1.16.0 soupsieve-2.1 tenacity-5.1.5
Executing <https://ci-beam.apache.org/job/beam_LoadTests_Java_ParDo_Dataflow_V2_Streaming_Java11/ws/src/sdks/java/container/build/virtualenv/bin/python> <https://ci-beam.apache.org/job/beam_LoadTests_Java_ParDo_Dataflow_V2_Streaming_Java11/ws/src/sdks/java/container/license_scripts/pull_licenses_java.py> --license_index=<https://ci-beam.apache.org/job/beam_LoadTests_Java_ParDo_Dataflow_V2_Streaming_Java11/ws/src/sdks/java/container/build/reports/dependency-license/index.json> --output_dir=<https://ci-beam.apache.org/job/beam_LoadTests_Java_ParDo_Dataflow_V2_Streaming_Java11/ws/src/sdks/java/container/build/target/java_third_party_licenses> --dep_url_yaml=<https://ci-beam.apache.org/job/beam_LoadTests_Java_ParDo_Dataflow_V2_Streaming_Java11/ws/src/sdks/java/container/license_scripts/dep_urls_java.yaml>
INFO:root:Pulling license for 207 dependencies using 16 threads.
INFO:root:pull_licenses_java.py succeed. It took 2.213777 seconds with 16 threads.
Copying licenses from <https://ci-beam.apache.org/job/beam_LoadTests_Java_ParDo_Dataflow_V2_Streaming_Java11/ws/src/sdks/java/container/build/target/java_third_party_licenses> to <https://ci-beam.apache.org/job/beam_LoadTests_Java_ParDo_Dataflow_V2_Streaming_Java11/ws/src/sdks/java/container/build/target/third_party_licenses.>
Finished license_scripts.sh
> Task :sdks:java:container:java11:copyJavaThirdPartyLicenses
> Task :release:go-licenses:java:dockerRun
+ go-licenses save github.com/apache/beam/sdks/java/container --save_path=/output/licenses
+ go-licenses csv github.com/apache/beam/sdks/java/container
+ tee /output/licenses/list.csv
golang.org/x/net,https://go.googlesource.com/net/+/refs/heads/master/LICENSE,BSD-3-Clause
github.com/golang/protobuf,https://github.com/golang/protobuf/blob/master/LICENSE,BSD-3-Clause
google.golang.org/genproto/googleapis/rpc/status,https://github.com/googleapis/go-genproto/blob/master/LICENSE,Apache-2.0
golang.org/x/sys,https://go.googlesource.com/sys/+/refs/heads/master/LICENSE,BSD-3-Clause
github.com/apache/beam/sdks/java/container,https://github.com/apache/beam/blob/master/LICENSE,Apache-2.0
github.com/apache/beam/sdks/go/pkg/beam,https://github.com/apache/beam/blob/master/sdks/go/README.md,Apache-2.0
google.golang.org/grpc,https://github.com/grpc/grpc-go/blob/master/LICENSE,Apache-2.0
google.golang.org/protobuf,https://go.googlesource.com/protobuf/+/refs/heads/master/LICENSE,BSD-3-Clause
golang.org/x/text,https://go.googlesource.com/text/+/refs/heads/master/LICENSE,BSD-3-Clause
+ chmod -R a+w /output/licenses
> Task :release:go-licenses:java:createLicenses
> Task :sdks:java:container:java11:copyGolangLicenses
> Task :sdks:java:container:java11:dockerPrepare
> Task :sdks:java:container:java11:docker
> Task :runners:google-cloud-dataflow-java:buildAndPushDockerContainer
WARNING: `gcloud docker` will not be supported for Docker client versions above 18.03.
As an alternative, use `gcloud auth configure-docker` to configure `docker` to
use `gcloud` as a credential helper, then use `docker` as you would for non-GCR
registries, e.g. `docker pull gcr.io/project-id/my-image`. Add
`--verbosity=error` to silence this warning: `gcloud docker
--verbosity=error -- pull gcr.io/project-id/my-image`.
See: https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker
The push refers to repository [us.gcr.io/apache-beam-testing/java-postcommit-it/java]
88b2a674b1cb: Preparing
94616a3ac86c: Preparing
cd9ae89b52ce: Preparing
5be348f6ede0: Preparing
15a678a51300: Preparing
8588921e24f8: Preparing
892bb470a9d8: Preparing
e024f3d10ea8: Preparing
e847979838e9: Preparing
4efc8d54cbfe: Preparing
dba809b136c6: Preparing
41854e89e8a3: Preparing
3891808a925b: Preparing
d402f4f1b906: Preparing
00ef5416d927: Preparing
8555e663f65b: Preparing
d00da3cd7763: Preparing
4e61e63529c2: Preparing
799760671c38: Preparing
4efc8d54cbfe: Waiting
3891808a925b: Waiting
d402f4f1b906: Waiting
dba809b136c6: Waiting
41854e89e8a3: Waiting
8588921e24f8: Waiting
00ef5416d927: Waiting
8555e663f65b: Waiting
892bb470a9d8: Waiting
d00da3cd7763: Waiting
e024f3d10ea8: Waiting
799760671c38: Waiting
e847979838e9: Waiting
cd9ae89b52ce: Pushed
94616a3ac86c: Pushed
15a678a51300: Pushed
8588921e24f8: Pushed
88b2a674b1cb: Pushed
5be348f6ede0: Pushed
e024f3d10ea8: Pushed
e847979838e9: Pushed
3891808a925b: Layer already exists
d402f4f1b906: Layer already exists
dba809b136c6: Pushed
00ef5416d927: Layer already exists
41854e89e8a3: Pushed
892bb470a9d8: Pushed
8555e663f65b: Layer already exists
d00da3cd7763: Layer already exists
4e61e63529c2: Layer already exists
799760671c38: Layer already exists
4efc8d54cbfe: Pushed
20210912123752: digest: sha256:2be8dd4d067015352e3d07e79fe1a9dca506491bd7e3291240a36d73403794d5 size: 4311
> Task :sdks:java:testing:load-tests:run
Sep 12, 2021 12:40:15 PM org.apache.beam.runners.dataflow.options.DataflowPipelineOptions$StagingLocationFactory create
INFO: No stagingLocation provided, falling back to gcpTempLocation
Sep 12, 2021 12:40:15 PM org.apache.beam.runners.dataflow.DataflowRunner fromOptions
INFO: PipelineOptions.filesToStage was not specified. Defaulting to files from the classpath: will stage 195 files. Enable logging at DEBUG level to see which files will be staged.
Sep 12, 2021 12:40:16 PM org.apache.beam.sdk.Pipeline validate
WARNING: The following transforms do not have stable unique names: ParDo(TimeMonitor)
Sep 12, 2021 12:40:16 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Executing pipeline on the Dataflow Service, which will have billing implications related to Google Compute Engine usage and other Google Cloud Services.
Sep 12, 2021 12:40:22 PM org.apache.beam.runners.dataflow.util.PackageUtil stageClasspathElements
INFO: Uploading 195 files from PipelineOptions.filesToStage to staging location to prepare for execution.
Sep 12, 2021 12:40:22 PM org.apache.beam.runners.dataflow.util.PackageUtil stageClasspathElements
INFO: Staging files complete: 195 files cached, 0 files newly uploaded in 0 seconds
Sep 12, 2021 12:40:23 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging portable pipeline proto to gs://temp-storage-for-perf-tests/loadtests/staging/
Sep 12, 2021 12:40:23 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <101788 bytes, hash d34f0453dcbb233211249c9b54eb059e289ee181c06ad3e1601ccfe3d3ad9263> to gs://temp-storage-for-perf-tests/loadtests/staging/pipeline-008EU9y7IzIRJJybVOsFniie4YHAatPhYBzP49OtkmM.pb
Sep 12, 2021 12:40:24 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Read input/DataflowRunner.StreamingUnboundedRead.ReadWithIds as step s1
Sep 12, 2021 12:40:24 PM org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource split
INFO: Split into 20 bundles of sizes: [org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@291373d3, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@372ca2d6, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@3204e238, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@38ed139b, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@a5272be, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@58ba5b30, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@4dba773d, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@1d9bd4da, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@4c58255, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@eac3a26, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@10b1a751, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@53cf9c99, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@7b306b9f, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@142213d5, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@934b52f, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@2630dbc4, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@5ea4300e, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@5a1c3cb4, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@76ad6715, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@56637cff]
Sep 12, 2021 12:40:24 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Read input/StripIds as step s2
Sep 12, 2021 12:40:24 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding ParDo(TimeMonitor) as step s3
Sep 12, 2021 12:40:24 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding ParDo(ByteMonitor) as step s4
Sep 12, 2021 12:40:24 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 0 as step s5
Sep 12, 2021 12:40:24 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 1 as step s6
Sep 12, 2021 12:40:24 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 2 as step s7
Sep 12, 2021 12:40:24 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 3 as step s8
Sep 12, 2021 12:40:24 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 4 as step s9
Sep 12, 2021 12:40:24 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 5 as step s10
Sep 12, 2021 12:40:24 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 6 as step s11
Sep 12, 2021 12:40:24 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 7 as step s12
Sep 12, 2021 12:40:24 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 8 as step s13
Sep 12, 2021 12:40:24 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 9 as step s14
Sep 12, 2021 12:40:24 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding ParDo(TimeMonitor)2 as step s15
Sep 12, 2021 12:40:24 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Dataflow SDK version: 2.34.0-SNAPSHOT
Sep 12, 2021 12:40:25 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobs/us-central1/2021-09-12_05_40_24-10635049069975718521?project=apache-beam-testing
Sep 12, 2021 12:40:25 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Submitted job: 2021-09-12_05_40_24-10635049069975718521
Sep 12, 2021 12:40:25 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2021-09-12_05_40_24-10635049069975718521
Sep 12, 2021 12:40:32 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-09-12T12:40:31.305Z: The workflow name is not a valid Cloud Label. Labels applied to Cloud resources (such as GCE Instances) for monitoring will be labeled with this modified job name: load0tests0java110dataflow0v20streaming0pardo01-jenkins-09-1wcm. For the best monitoring experience, please name your job with a valid Cloud Label. For details, see: https://cloud.google.com/compute/docs/labeling-resources#restrictions
Sep 12, 2021 12:40:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-12T12:40:35.921Z: Worker configuration: e2-standard-2 in us-central1-a.
Sep 12, 2021 12:40:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-09-12T12:40:36.780Z: Workflow failed. Causes: Project apache-beam-testing has insufficient quota(s) to execute this workflow with 1 instances in region us-central1. Quota summary (required/available): 1/24379 instances, 2/0 CPUs, 30/186406 disk GB, 0/2397 SSD disk GB, 1/280 instance groups, 1/283 managed instance groups, 1/509 instance templates, 1/608 in-use IP addresses.
Please see https://cloud.google.com/compute/docs/resource-quotas about requesting more quota.
Sep 12, 2021 12:40:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-12T12:40:36.841Z: Cleaning up.
Sep 12, 2021 12:40:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-12T12:40:36.915Z: Worker pool stopped.
Sep 12, 2021 12:40:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-12T12:40:38.093Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete
Sep 12, 2021 12:40:42 PM org.apache.beam.runners.dataflow.DataflowPipelineJob logTerminalState
INFO: Job 2021-09-12_05_40_24-10635049069975718521 failed with status FAILED.
Sep 12, 2021 12:40:42 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric totalBytes.count, from namespace pardo
Load test results for test (ID): 71b7da4c-3196-477b-acac-c336aa4a91e3 and timestamp: 2021-09-12T12:40:16.422000000Z:
Metric: Value:
dataflow_v2_java11_runtime_sec 0.0
dataflow_v2_java11_total_bytes_count -1.0
Exception in thread "main" java.lang.RuntimeException: Invalid job state: FAILED.
at org.apache.beam.sdk.loadtests.JobFailure.handleFailure(JobFailure.java:55)
at org.apache.beam.sdk.loadtests.LoadTest.run(LoadTest.java:141)
at org.apache.beam.sdk.loadtests.ParDoLoadTest.run(ParDoLoadTest.java:53)
at org.apache.beam.sdk.loadtests.ParDoLoadTest.main(ParDoLoadTest.java:103)
> Task :sdks:java:testing:load-tests:run FAILED
> Task :runners:google-cloud-dataflow-java:cleanUpDockerImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210912123752
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:2be8dd4d067015352e3d07e79fe1a9dca506491bd7e3291240a36d73403794d5
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210912123752]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:2be8dd4d067015352e3d07e79fe1a9dca506491bd7e3291240a36d73403794d5]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210912123752] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:2be8dd4d067015352e3d07e79fe1a9dca506491bd7e3291240a36d73403794d5])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:2be8dd4d067015352e3d07e79fe1a9dca506491bd7e3291240a36d73403794d5
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:2be8dd4d067015352e3d07e79fe1a9dca506491bd7e3291240a36d73403794d5
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:2be8dd4d067015352e3d07e79fe1a9dca506491bd7e3291240a36d73403794d5].
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:testing:load-tests:run'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 3m 17s
101 actionable tasks: 70 executed, 29 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/olwlsut5ue6xw
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org