Build failed in Jenkins: beam_LoadTests_Java_GBK_Dataflow_V2_Streaming_Java17 #298

[Apache Jenkins Server <je...@builds.apache.org>]

See <https://ci-beam.apache.org/job/beam_LoadTests_Java_GBK_Dataflow_V2_Streaming_Java17/298/display/redirect?page=changes>

Changes:

[Moritz Mack] Minor improvements to the tpcds gradle build for Spark

[Moritz Mack] Fix SparkSessionFactory to not fail when using Spark master local[*]

[Moritz Mack] [Spark dataset runner] Add direct translation of Reshuffle and

[noreply] Make GCP OAuth scopes configurable via pipeline options. (#23644)

[noreply] Update BQIO to a single scheduled executor service reduce threads


------------------------------------------
[...truncated 230.88 KB...]
The push refers to repository [us.gcr.io/apache-beam-testing/java-postcommit-it/java]
3dd911ea8144: Preparing
1bbfc9cdba84: Preparing
62e287afdbac: Preparing
4ecb5b3853a0: Preparing
0a41c2226cb2: Preparing
6f6cdd597d3d: Preparing
c2662b30ffe9: Preparing
9fdba41d9e65: Preparing
47be6be076bc: Preparing
8319e13b2cbf: Preparing
0e0f6f0695d8: Preparing
9ee45cdcbfc8: Preparing
5b178bdaef06: Preparing
394fe048ed52: Preparing
a743f5a68057: Preparing
3bc383470c05: Preparing
e93827457889: Preparing
08fa02ce37eb: Preparing
a037458de4e0: Preparing
9fdba41d9e65: Waiting
bafdbe68e4ae: Preparing
a13c519c6361: Preparing
6f6cdd597d3d: Waiting
c2662b30ffe9: Waiting
47be6be076bc: Waiting
8319e13b2cbf: Waiting
3bc383470c05: Waiting
a037458de4e0: Waiting
e93827457889: Waiting
394fe048ed52: Waiting
0e0f6f0695d8: Waiting
a743f5a68057: Waiting
08fa02ce37eb: Waiting
9ee45cdcbfc8: Waiting
bafdbe68e4ae: Waiting
5b178bdaef06: Waiting
a13c519c6361: Waiting
0a41c2226cb2: Pushed
62e287afdbac: Pushed
4ecb5b3853a0: Pushed
1bbfc9cdba84: Pushed
3dd911ea8144: Pushed
c2662b30ffe9: Pushed
9fdba41d9e65: Pushed
8319e13b2cbf: Pushed
6f6cdd597d3d: Pushed
9ee45cdcbfc8: Pushed
0e0f6f0695d8: Pushed
47be6be076bc: Pushed
3bc383470c05: Layer already exists
e93827457889: Layer already exists
08fa02ce37eb: Layer already exists
a037458de4e0: Layer already exists
a13c519c6361: Layer already exists
bafdbe68e4ae: Layer already exists
394fe048ed52: Pushed
a743f5a68057: Pushed
5b178bdaef06: Pushed
20221015143229: digest: sha256:1b9640769b97303c0a6674828081dd2dbd2e547b7d8b5d943661758cbfc1bd42 size: 4729

> Task :sdks:java:testing:load-tests:run
Oct 15, 2022 2:33:01 PM org.apache.beam.runners.dataflow.options.DataflowPipelineOptions$StagingLocationFactory create
INFO: No stagingLocation provided, falling back to gcpTempLocation
Oct 15, 2022 2:33:02 PM org.apache.beam.runners.dataflow.DataflowRunner fromOptions
INFO: PipelineOptions.filesToStage was not specified. Defaulting to files from the classpath: will stage 229 files. Enable logging at DEBUG level to see which files will be staged.
Oct 15, 2022 2:33:02 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Executing pipeline on the Dataflow Service, which will have billing implications related to Google Compute Engine usage and other Google Cloud Services.
Oct 15, 2022 2:33:04 PM org.apache.beam.runners.dataflow.util.PackageUtil stageClasspathElements
INFO: Uploading 229 files from PipelineOptions.filesToStage to staging location to prepare for execution.
Oct 15, 2022 2:33:05 PM org.apache.beam.runners.dataflow.util.PackageUtil stageClasspathElements
INFO: Staging files complete: 229 files cached, 0 files newly uploaded in 0 seconds
Oct 15, 2022 2:33:05 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging portable pipeline proto to gs://temp-storage-for-perf-tests/loadtests/staging/
Oct 15, 2022 2:33:05 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <114502 bytes, hash c5ea9b1b8a3f98eb9244caddd2d7932d31aedf85ec3f1eb96354b250f1e9a212> to gs://temp-storage-for-perf-tests/loadtests/staging/pipeline-xeqbG4o_mOuSRMrd0teTLTGu34XsPx65Y1SyUPHpohI.pb
Oct 15, 2022 2:33:07 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Read input/DataflowRunner.StreamingUnboundedRead.ReadWithIds as step s1
Oct 15, 2022 2:33:07 PM org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource split
INFO: Split into 64 bundles: [SyntheticUnboundedSource{startOffset=0, endOffset=78125}, SyntheticUnboundedSource{startOffset=78125, endOffset=156250}, SyntheticUnboundedSource{startOffset=156250, endOffset=234375}, SyntheticUnboundedSource{startOffset=234375, endOffset=312500}, SyntheticUnboundedSource{startOffset=312500, endOffset=390625}, SyntheticUnboundedSource{startOffset=390625, endOffset=468750}, SyntheticUnboundedSource{startOffset=468750, endOffset=546875}, SyntheticUnboundedSource{startOffset=546875, endOffset=625000}, SyntheticUnboundedSource{startOffset=625000, endOffset=703125}, SyntheticUnboundedSource{startOffset=703125, endOffset=781250}, SyntheticUnboundedSource{startOffset=781250, endOffset=859375}, SyntheticUnboundedSource{startOffset=859375, endOffset=937500}, SyntheticUnboundedSource{startOffset=937500, endOffset=1015625}, SyntheticUnboundedSource{startOffset=1015625, endOffset=1093750}, SyntheticUnboundedSource{startOffset=1093750, endOffset=1171875}, SyntheticUnboundedSource{startOffset=1171875, endOffset=1250000}, SyntheticUnboundedSource{startOffset=1250000, endOffset=1328125}, SyntheticUnboundedSource{startOffset=1328125, endOffset=1406250}, SyntheticUnboundedSource{startOffset=1406250, endOffset=1484375}, SyntheticUnboundedSource{startOffset=1484375, endOffset=1562500}, SyntheticUnboundedSource{startOffset=1562500, endOffset=1640625}, SyntheticUnboundedSource{startOffset=1640625, endOffset=1718750}, SyntheticUnboundedSource{startOffset=1718750, endOffset=1796875}, SyntheticUnboundedSource{startOffset=1796875, endOffset=1875000}, SyntheticUnboundedSource{startOffset=1875000, endOffset=1953125}, SyntheticUnboundedSource{startOffset=1953125, endOffset=2031250}, SyntheticUnboundedSource{startOffset=2031250, endOffset=2109375}, SyntheticUnboundedSource{startOffset=2109375, endOffset=2187500}, SyntheticUnboundedSource{startOffset=2187500, endOffset=2265625}, SyntheticUnboundedSource{startOffset=2265625, endOffset=2343750}, SyntheticUnboundedSource{startOffset=2343750, endOffset=2421875}, SyntheticUnboundedSource{startOffset=2421875, endOffset=2500000}, SyntheticUnboundedSource{startOffset=2500000, endOffset=2578125}, SyntheticUnboundedSource{startOffset=2578125, endOffset=2656250}, SyntheticUnboundedSource{startOffset=2656250, endOffset=2734375}, SyntheticUnboundedSource{startOffset=2734375, endOffset=2812500}, SyntheticUnboundedSource{startOffset=2812500, endOffset=2890625}, SyntheticUnboundedSource{startOffset=2890625, endOffset=2968750}, SyntheticUnboundedSource{startOffset=2968750, endOffset=3046875}, SyntheticUnboundedSource{startOffset=3046875, endOffset=3125000}, SyntheticUnboundedSource{startOffset=3125000, endOffset=3203125}, SyntheticUnboundedSource{startOffset=3203125, endOffset=3281250}, SyntheticUnboundedSource{startOffset=3281250, endOffset=3359375}, SyntheticUnboundedSource{startOffset=3359375, endOffset=3437500}, SyntheticUnboundedSource{startOffset=3437500, endOffset=3515625}, SyntheticUnboundedSource{startOffset=3515625, endOffset=3593750}, SyntheticUnboundedSource{startOffset=3593750, endOffset=3671875}, SyntheticUnboundedSource{startOffset=3671875, endOffset=3750000}, SyntheticUnboundedSource{startOffset=3750000, endOffset=3828125}, SyntheticUnboundedSource{startOffset=3828125, endOffset=3906250}, SyntheticUnboundedSource{startOffset=3906250, endOffset=3984375}, SyntheticUnboundedSource{startOffset=3984375, endOffset=4062500}, SyntheticUnboundedSource{startOffset=4062500, endOffset=4140625}, SyntheticUnboundedSource{startOffset=4140625, endOffset=4218750}, SyntheticUnboundedSource{startOffset=4218750, endOffset=4296875}, SyntheticUnboundedSource{startOffset=4296875, endOffset=4375000}, SyntheticUnboundedSource{startOffset=4375000, endOffset=4453125}, SyntheticUnboundedSource{startOffset=4453125, endOffset=4531250}, SyntheticUnboundedSource{startOffset=4531250, endOffset=4609375}, SyntheticUnboundedSource{startOffset=4609375, endOffset=4687500}, SyntheticUnboundedSource{startOffset=4687500, endOffset=4765625}, SyntheticUnboundedSource{startOffset=4765625, endOffset=4843750}, SyntheticUnboundedSource{startOffset=4843750, endOffset=4921875}, SyntheticUnboundedSource{startOffset=4921875, endOffset=5000000}]
Oct 15, 2022 2:33:07 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Read input/StripIds as step s2
Oct 15, 2022 2:33:07 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Collect start time metrics as step s3
Oct 15, 2022 2:33:07 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Total bytes monitor as step s4
Oct 15, 2022 2:33:07 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Window.Into()/Window.Assign as step s5
Oct 15, 2022 2:33:07 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Group by key (0) as step s6
Oct 15, 2022 2:33:07 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Ungroup and reiterate (0) as step s7
Oct 15, 2022 2:33:07 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Collect end time metrics (0) as step s8
Oct 15, 2022 2:33:07 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Group by key (1) as step s9
Oct 15, 2022 2:33:07 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Ungroup and reiterate (1) as step s10
Oct 15, 2022 2:33:07 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Collect end time metrics (1) as step s11
Oct 15, 2022 2:33:07 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Group by key (2) as step s12
Oct 15, 2022 2:33:07 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Ungroup and reiterate (2) as step s13
Oct 15, 2022 2:33:07 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Collect end time metrics (2) as step s14
Oct 15, 2022 2:33:07 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Group by key (3) as step s15
Oct 15, 2022 2:33:07 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Ungroup and reiterate (3) as step s16
Oct 15, 2022 2:33:07 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Collect end time metrics (3) as step s17
Oct 15, 2022 2:33:07 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Dataflow SDK version: 2.43.0-SNAPSHOT
Oct 15, 2022 2:33:08 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobs/us-central1/2022-10-15_07_33_07-11365052534099981491?project=apache-beam-testing
Oct 15, 2022 2:33:08 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Submitted job: 2022-10-15_07_33_07-11365052534099981491
Oct 15, 2022 2:33:08 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2022-10-15_07_33_07-11365052534099981491
Oct 15, 2022 2:33:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2022-10-15T14:33:19.376Z: The workflow name is not a valid Cloud Label. Labels applied to Cloud resources (such as GCE Instances) for monitoring will be labeled with this modified job name: load0tests0java170dataflow0v20streaming0gbk04-jenkins-1015-3ek7. For the best monitoring experience, please name your job with a valid Cloud Label. For details, see: https://cloud.google.com/compute/docs/labeling-resources#restrictions
Oct 15, 2022 2:33:32 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-15T14:33:31.456Z: Worker configuration: e2-standard-2 in us-central1-b.
Oct 15, 2022 2:33:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-15T14:33:33.180Z: Expanding SplittableParDo operations into optimizable parts.
Oct 15, 2022 2:33:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-15T14:33:33.226Z: Expanding CollectionToSingleton operations into optimizable parts.
Oct 15, 2022 2:33:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-15T14:33:33.314Z: Expanding CoGroupByKey operations into optimizable parts.
Oct 15, 2022 2:33:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-15T14:33:33.458Z: Expanding SplittableProcessKeyed operations into optimizable parts.
Oct 15, 2022 2:33:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-15T14:33:33.495Z: Expanding GroupByKey operations into streaming Read/Write steps
Oct 15, 2022 2:33:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-15T14:33:33.667Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
Oct 15, 2022 2:33:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-15T14:33:33.873Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
Oct 15, 2022 2:33:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-15T14:33:33.905Z: Fusing consumer Group by key (0)/WriteStream into Window.Into()/Window.Assign
Oct 15, 2022 2:33:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-15T14:33:33.938Z: Fusing consumer Group by key (1)/WriteStream into Window.Into()/Window.Assign
Oct 15, 2022 2:33:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-15T14:33:33.970Z: Fusing consumer Group by key (2)/WriteStream into Window.Into()/Window.Assign
Oct 15, 2022 2:33:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-15T14:33:34.004Z: Fusing consumer Group by key (3)/WriteStream into Window.Into()/Window.Assign
Oct 15, 2022 2:33:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-15T14:33:34.036Z: Fusing consumer Read input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource) into Read input/Impulse
Oct 15, 2022 2:33:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-15T14:33:34.059Z: Fusing consumer Read-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/PairWithRestriction into Read input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource)
Oct 15, 2022 2:33:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-15T14:33:34.083Z: Fusing consumer Read-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/SplitWithSizing into Read-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/PairWithRestriction
Oct 15, 2022 2:33:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-15T14:33:34.121Z: Fusing consumer Read input/ParDo(StripIds)/ParMultiDo(StripIds) into Read-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/ProcessElementAndRestrictionWithSizing
Oct 15, 2022 2:33:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-15T14:33:34.155Z: Fusing consumer Collect start time metrics/ParMultiDo(TimeMonitor) into Read input/ParDo(StripIds)/ParMultiDo(StripIds)
Oct 15, 2022 2:33:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-15T14:33:34.191Z: Fusing consumer Total bytes monitor/ParMultiDo(ByteMonitor) into Collect start time metrics/ParMultiDo(TimeMonitor)
Oct 15, 2022 2:33:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-15T14:33:34.225Z: Fusing consumer Window.Into()/Window.Assign into Total bytes monitor/ParMultiDo(ByteMonitor)
Oct 15, 2022 2:33:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-15T14:33:34.270Z: Fusing consumer Group by key (0)/MergeBuckets into Group by key (0)/ReadStream
Oct 15, 2022 2:33:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-15T14:33:34.305Z: Fusing consumer Ungroup and reiterate (0)/ParMultiDo(UngroupAndReiterate) into Group by key (0)/MergeBuckets
Oct 15, 2022 2:33:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-15T14:33:34.338Z: Fusing consumer Collect end time metrics (0)/ParMultiDo(TimeMonitor) into Ungroup and reiterate (0)/ParMultiDo(UngroupAndReiterate)
Oct 15, 2022 2:33:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-15T14:33:34.363Z: Fusing consumer Group by key (1)/MergeBuckets into Group by key (1)/ReadStream
Oct 15, 2022 2:33:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-15T14:33:34.390Z: Fusing consumer Ungroup and reiterate (1)/ParMultiDo(UngroupAndReiterate) into Group by key (1)/MergeBuckets
Oct 15, 2022 2:33:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-15T14:33:34.434Z: Fusing consumer Collect end time metrics (1)/ParMultiDo(TimeMonitor) into Ungroup and reiterate (1)/ParMultiDo(UngroupAndReiterate)
Oct 15, 2022 2:33:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-15T14:33:34.475Z: Fusing consumer Group by key (2)/MergeBuckets into Group by key (2)/ReadStream
Oct 15, 2022 2:33:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-15T14:33:34.511Z: Fusing consumer Ungroup and reiterate (2)/ParMultiDo(UngroupAndReiterate) into Group by key (2)/MergeBuckets
Oct 15, 2022 2:33:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-15T14:33:34.550Z: Fusing consumer Collect end time metrics (2)/ParMultiDo(TimeMonitor) into Ungroup and reiterate (2)/ParMultiDo(UngroupAndReiterate)
Oct 15, 2022 2:33:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-15T14:33:34.582Z: Fusing consumer Group by key (3)/MergeBuckets into Group by key (3)/ReadStream
Oct 15, 2022 2:33:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-15T14:33:34.617Z: Fusing consumer Ungroup and reiterate (3)/ParMultiDo(UngroupAndReiterate) into Group by key (3)/MergeBuckets
Oct 15, 2022 2:33:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-15T14:33:34.651Z: Fusing consumer Collect end time metrics (3)/ParMultiDo(TimeMonitor) into Ungroup and reiterate (3)/ParMultiDo(UngroupAndReiterate)
Oct 15, 2022 2:33:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-15T14:33:34.756Z: Running job using Streaming Engine
Oct 15, 2022 2:33:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-15T14:33:34.988Z: Starting 16 ****s in us-central1-b...
Oct 15, 2022 2:33:47 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-15T14:33:45.500Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete
Oct 15, 2022 2:34:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-15T14:34:16.832Z: Autoscaling: Raised the number of ****s to 16 so that the pipeline can catch up with its backlog and keep up with its input rate.
Oct 15, 2022 2:35:21 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-15T14:35:20.933Z: Workers have started successfully.
Oct 15, 2022 2:48:06 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-15T14:48:04.566Z: Cleaning up.
Oct 15, 2022 2:48:06 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-15T14:48:04.666Z: Stopping **** pool...
Oct 15, 2022 2:48:06 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-15T14:48:04.712Z: Stopping **** pool...
Oct 15, 2022 2:50:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-15T14:50:22.134Z: Autoscaling: Reduced the number of ****s to 0 based on low average **** CPU utilization, and the pipeline having sufficiently low backlog and keeping up with input rate.
Oct 15, 2022 2:50:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-10-15T14:50:22.184Z: Worker pool stopped.
Oct 15, 2022 2:50:31 PM org.apache.beam.runners.dataflow.DataflowPipelineJob logTerminalState
INFO: Job 2022-10-15_07_33_07-11365052534099981491 finished with status DONE.
Load test results for test (ID): 2341b8a7-aeba-4667-9164-df7010f012c7 and timestamp: 2022-10-15T14:33:02.439000000Z:
                 Metric:                    Value:
dataflow_v2_java17_runtime_sec                   629.366
dataflow_v2_java17_total_bytes_count                 4.99998E8

> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages FAILED
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20221015143229
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:1b9640769b97303c0a6674828081dd2dbd2e547b7d8b5d943661758cbfc1bd42
ERROR: (gcloud.container.images.untag) Image could not be found: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20221015143229]

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Java_GBK_Dataflow_V2_Streaming_Java17/ws/src/runners/google-cloud-dataflow-java/build.gradle'> line: 301

* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:cleanUpDockerJavaImages'.
> Process 'command 'gcloud'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.

BUILD FAILED in 18m 5s
108 actionable tasks: 9 executed, 99 up-to-date

Publishing build scan...
https://gradle.com/s/dosx55cwgzvue

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org

Jenkins build is back to normal : beam_LoadTests_Java_GBK_Dataflow_V2_Streaming_Java17 #299

[Apache Jenkins Server <je...@builds.apache.org>]

See <https://ci-beam.apache.org/job/beam_LoadTests_Java_GBK_Dataflow_V2_Streaming_Java17/299/display/redirect?page=changes>


---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org