You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2022/06/30 14:41:33 UTC

Build failed in Jenkins: beam_LoadTests_Java_GBK_Dataflow_V2_Streaming_Java17 #191

See <https://ci-beam.apache.org/job/beam_LoadTests_Java_GBK_Dataflow_V2_Streaming_Java17/191/display/redirect?page=changes>

Changes:

[alexey.inkin] Add an abstract layer for analytics, fix logging change of snippet, fix

[damondouglas] Implement PubsubSchemaTransformMessageToFactory

[bulat.safiullin] [Website] add scroll-spy to body in case-studies/baseof.html

[noreply] Update issue bot to javascript and add label management (#22067)

[noreply] Clean up issue management doc page

[noreply] [BEAM-13015, #21250, fixes #22053] Improve PCollectionConsumerRegistry

[noreply] sharding GCP IO tests from the javaPostCommit task (#21800)

[noreply] Bump cloud.google.com/go/storage from 1.22.1 to 1.23.0 in /sdks (#22038)

[noreply] Followup sharding javaPostCommit (#22081)

[noreply] remove mention of dill in release notes as it's not relevant. (#22087)

[noreply] [#21634] Add comments on FieldValueGetter. (#21982)

[noreply] Bump google.golang.org/api from 0.85.0 to 0.86.0 in /sdks (#22092)

[noreply] [BEAM-6597] Replace ProgressRequestCallback with BundleProgressReporter

[noreply] [Go SDK] Go Lint fixes  (#21967)

[noreply] Fix #21869: Close GRPC connections on cancel (#21874)

[noreply] Add FlatMap(<builtin>) known issue to 2.40.0 blog (#22101)

[noreply] [BEAM-14347] Update docs to prefer generic registration functions

[Andrew Pilloud] Projection Pushdown optimizer on by default

[noreply] Merge pull request #21752 from Feature/beam 13852 reimplement with

[noreply] Change wording of Pytorch LM example (#22099)

[noreply] Fix missing model_params in Pytorch docstring  (#22100)

[noreply] Test and fix FlatMap(<builtin>) issue (#22104)

[noreply] Fix InputStream on platform with 4 bytie long (#22107)


------------------------------------------
[...truncated 225.89 KB...]
3992d8e14da2: Preparing
2447abd7a417: Preparing
78b083ffa32e: Preparing
d5aded882ed3: Preparing
8d9705a70d63: Preparing
3bc383470c05: Preparing
e93827457889: Preparing
08fa02ce37eb: Preparing
a037458de4e0: Preparing
bafdbe68e4ae: Preparing
a13c519c6361: Preparing
a7dd9b5740b3: Waiting
e93827457889: Waiting
6feacf6b32c2: Waiting
3992d8e14da2: Waiting
08fa02ce37eb: Waiting
a037458de4e0: Waiting
8d9705a70d63: Waiting
2447abd7a417: Waiting
3bc383470c05: Waiting
78b083ffa32e: Waiting
9a6fec6f05b0: Waiting
bafdbe68e4ae: Waiting
d5aded882ed3: Waiting
a8a6dc770ec4: Waiting
a13c519c6361: Waiting
f042979e4956: Waiting
55597193eb99: Pushed
7bb0b766a5a7: Pushed
10d9e5a0271d: Pushed
e9ea71cb3b74: Pushed
f042979e4956: Pushed
91f59171056e: Pushed
a8a6dc770ec4: Pushed
a7dd9b5740b3: Pushed
9a6fec6f05b0: Pushed
2447abd7a417: Pushed
6feacf6b32c2: Pushed
3bc383470c05: Layer already exists
3992d8e14da2: Pushed
e93827457889: Layer already exists
08fa02ce37eb: Layer already exists
a037458de4e0: Layer already exists
bafdbe68e4ae: Layer already exists
a13c519c6361: Layer already exists
d5aded882ed3: Pushed
8d9705a70d63: Pushed
78b083ffa32e: Pushed
20220630142516: digest: sha256:5a7ecefcaa60d17e99c11f18e7deaf8e3b58e1b64b9cc30aa9fa40216832ba3c size: 4729

> Task :sdks:java:testing:load-tests:run
Jun 30, 2022 2:25:53 PM org.apache.beam.runners.dataflow.options.DataflowPipelineOptions$StagingLocationFactory create
INFO: No stagingLocation provided, falling back to gcpTempLocation
Jun 30, 2022 2:25:53 PM org.apache.beam.runners.dataflow.DataflowRunner fromOptions
INFO: PipelineOptions.filesToStage was not specified. Defaulting to files from the classpath: will stage 222 files. Enable logging at DEBUG level to see which files will be staged.
Jun 30, 2022 2:25:54 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Executing pipeline on the Dataflow Service, which will have billing implications related to Google Compute Engine usage and other Google Cloud Services.
Jun 30, 2022 2:25:56 PM org.apache.beam.runners.dataflow.util.PackageUtil stageClasspathElements
INFO: Uploading 222 files from PipelineOptions.filesToStage to staging location to prepare for execution.
Jun 30, 2022 2:25:57 PM org.apache.beam.runners.dataflow.util.PackageUtil stageClasspathElements
INFO: Staging files complete: 222 files cached, 0 files newly uploaded in 0 seconds
Jun 30, 2022 2:25:57 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging portable pipeline proto to gs://temp-storage-for-perf-tests/loadtests/staging/
Jun 30, 2022 2:25:57 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <112190 bytes, hash e52a4d95dc46581293cac9c3968d9b92aa8e2056df079f62690fa87a2a8375df> to gs://temp-storage-for-perf-tests/loadtests/staging/pipeline-5SpNldxGWBKTysnDlo2bkqqOIFbfB59iaQ-oeiqDdd8.pb
Jun 30, 2022 2:25:59 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Read input/DataflowRunner.StreamingUnboundedRead.ReadWithIds as step s1
Jun 30, 2022 2:25:59 PM org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource split
INFO: Split into 64 bundles: [SyntheticUnboundedSource{startOffset=0, endOffset=78125}, SyntheticUnboundedSource{startOffset=78125, endOffset=156250}, SyntheticUnboundedSource{startOffset=156250, endOffset=234375}, SyntheticUnboundedSource{startOffset=234375, endOffset=312500}, SyntheticUnboundedSource{startOffset=312500, endOffset=390625}, SyntheticUnboundedSource{startOffset=390625, endOffset=468750}, SyntheticUnboundedSource{startOffset=468750, endOffset=546875}, SyntheticUnboundedSource{startOffset=546875, endOffset=625000}, SyntheticUnboundedSource{startOffset=625000, endOffset=703125}, SyntheticUnboundedSource{startOffset=703125, endOffset=781250}, SyntheticUnboundedSource{startOffset=781250, endOffset=859375}, SyntheticUnboundedSource{startOffset=859375, endOffset=937500}, SyntheticUnboundedSource{startOffset=937500, endOffset=1015625}, SyntheticUnboundedSource{startOffset=1015625, endOffset=1093750}, SyntheticUnboundedSource{startOffset=1093750, endOffset=1171875}, SyntheticUnboundedSource{startOffset=1171875, endOffset=1250000}, SyntheticUnboundedSource{startOffset=1250000, endOffset=1328125}, SyntheticUnboundedSource{startOffset=1328125, endOffset=1406250}, SyntheticUnboundedSource{startOffset=1406250, endOffset=1484375}, SyntheticUnboundedSource{startOffset=1484375, endOffset=1562500}, SyntheticUnboundedSource{startOffset=1562500, endOffset=1640625}, SyntheticUnboundedSource{startOffset=1640625, endOffset=1718750}, SyntheticUnboundedSource{startOffset=1718750, endOffset=1796875}, SyntheticUnboundedSource{startOffset=1796875, endOffset=1875000}, SyntheticUnboundedSource{startOffset=1875000, endOffset=1953125}, SyntheticUnboundedSource{startOffset=1953125, endOffset=2031250}, SyntheticUnboundedSource{startOffset=2031250, endOffset=2109375}, SyntheticUnboundedSource{startOffset=2109375, endOffset=2187500}, SyntheticUnboundedSource{startOffset=2187500, endOffset=2265625}, SyntheticUnboundedSource{startOffset=2265625, endOffset=2343750}, SyntheticUnboundedSource{startOffset=2343750, endOffset=2421875}, SyntheticUnboundedSource{startOffset=2421875, endOffset=2500000}, SyntheticUnboundedSource{startOffset=2500000, endOffset=2578125}, SyntheticUnboundedSource{startOffset=2578125, endOffset=2656250}, SyntheticUnboundedSource{startOffset=2656250, endOffset=2734375}, SyntheticUnboundedSource{startOffset=2734375, endOffset=2812500}, SyntheticUnboundedSource{startOffset=2812500, endOffset=2890625}, SyntheticUnboundedSource{startOffset=2890625, endOffset=2968750}, SyntheticUnboundedSource{startOffset=2968750, endOffset=3046875}, SyntheticUnboundedSource{startOffset=3046875, endOffset=3125000}, SyntheticUnboundedSource{startOffset=3125000, endOffset=3203125}, SyntheticUnboundedSource{startOffset=3203125, endOffset=3281250}, SyntheticUnboundedSource{startOffset=3281250, endOffset=3359375}, SyntheticUnboundedSource{startOffset=3359375, endOffset=3437500}, SyntheticUnboundedSource{startOffset=3437500, endOffset=3515625}, SyntheticUnboundedSource{startOffset=3515625, endOffset=3593750}, SyntheticUnboundedSource{startOffset=3593750, endOffset=3671875}, SyntheticUnboundedSource{startOffset=3671875, endOffset=3750000}, SyntheticUnboundedSource{startOffset=3750000, endOffset=3828125}, SyntheticUnboundedSource{startOffset=3828125, endOffset=3906250}, SyntheticUnboundedSource{startOffset=3906250, endOffset=3984375}, SyntheticUnboundedSource{startOffset=3984375, endOffset=4062500}, SyntheticUnboundedSource{startOffset=4062500, endOffset=4140625}, SyntheticUnboundedSource{startOffset=4140625, endOffset=4218750}, SyntheticUnboundedSource{startOffset=4218750, endOffset=4296875}, SyntheticUnboundedSource{startOffset=4296875, endOffset=4375000}, SyntheticUnboundedSource{startOffset=4375000, endOffset=4453125}, SyntheticUnboundedSource{startOffset=4453125, endOffset=4531250}, SyntheticUnboundedSource{startOffset=4531250, endOffset=4609375}, SyntheticUnboundedSource{startOffset=4609375, endOffset=4687500}, SyntheticUnboundedSource{startOffset=4687500, endOffset=4765625}, SyntheticUnboundedSource{startOffset=4765625, endOffset=4843750}, SyntheticUnboundedSource{startOffset=4843750, endOffset=4921875}, SyntheticUnboundedSource{startOffset=4921875, endOffset=5000000}]
Jun 30, 2022 2:25:59 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Read input/StripIds as step s2
Jun 30, 2022 2:25:59 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Collect start time metrics as step s3
Jun 30, 2022 2:25:59 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Total bytes monitor as step s4
Jun 30, 2022 2:25:59 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Window.Into()/Window.Assign as step s5
Jun 30, 2022 2:25:59 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Group by key (0) as step s6
Jun 30, 2022 2:25:59 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Ungroup and reiterate (0) as step s7
Jun 30, 2022 2:25:59 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Collect end time metrics (0) as step s8
Jun 30, 2022 2:25:59 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Group by key (1) as step s9
Jun 30, 2022 2:25:59 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Ungroup and reiterate (1) as step s10
Jun 30, 2022 2:25:59 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Collect end time metrics (1) as step s11
Jun 30, 2022 2:25:59 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Group by key (2) as step s12
Jun 30, 2022 2:25:59 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Ungroup and reiterate (2) as step s13
Jun 30, 2022 2:25:59 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Collect end time metrics (2) as step s14
Jun 30, 2022 2:25:59 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Group by key (3) as step s15
Jun 30, 2022 2:25:59 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Ungroup and reiterate (3) as step s16
Jun 30, 2022 2:25:59 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Collect end time metrics (3) as step s17
Jun 30, 2022 2:25:59 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Dataflow SDK version: 2.41.0-SNAPSHOT
Jun 30, 2022 2:26:00 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobs/us-central1/2022-06-30_07_25_59-9111762635122043688?project=apache-beam-testing
Jun 30, 2022 2:26:00 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Submitted job: 2022-06-30_07_25_59-9111762635122043688
Jun 30, 2022 2:26:00 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2022-06-30_07_25_59-9111762635122043688
Jun 30, 2022 2:26:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2022-06-30T14:26:05.677Z: The workflow name is not a valid Cloud Label. Labels applied to Cloud resources (such as GCE Instances) for monitoring will be labeled with this modified job name: load0tests0java170dataflow0v20streaming0gbk04-jenkins-0630-x85i. For the best monitoring experience, please name your job with a valid Cloud Label. For details, see: https://cloud.google.com/compute/docs/labeling-resources#restrictions
Jun 30, 2022 2:26:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-06-30T14:26:15.865Z: Worker configuration: e2-standard-2 in us-central1-b.
Jun 30, 2022 2:26:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-06-30T14:26:17.236Z: Expanding SplittableParDo operations into optimizable parts.
Jun 30, 2022 2:26:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-06-30T14:26:17.322Z: Expanding CollectionToSingleton operations into optimizable parts.
Jun 30, 2022 2:26:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-06-30T14:26:17.419Z: Expanding CoGroupByKey operations into optimizable parts.
Jun 30, 2022 2:26:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-06-30T14:26:17.670Z: Expanding SplittableProcessKeyed operations into optimizable parts.
Jun 30, 2022 2:26:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-06-30T14:26:17.694Z: Expanding GroupByKey operations into streaming Read/Write steps
Jun 30, 2022 2:26:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-06-30T14:26:17.855Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
Jun 30, 2022 2:26:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-06-30T14:26:18.091Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
Jun 30, 2022 2:26:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-06-30T14:26:18.125Z: Fusing consumer Group by key (0)/WriteStream into Window.Into()/Window.Assign
Jun 30, 2022 2:26:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-06-30T14:26:18.159Z: Fusing consumer Group by key (1)/WriteStream into Window.Into()/Window.Assign
Jun 30, 2022 2:26:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-06-30T14:26:18.192Z: Fusing consumer Group by key (2)/WriteStream into Window.Into()/Window.Assign
Jun 30, 2022 2:26:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-06-30T14:26:18.225Z: Fusing consumer Group by key (3)/WriteStream into Window.Into()/Window.Assign
Jun 30, 2022 2:26:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-06-30T14:26:18.258Z: Fusing consumer Read input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource) into Read input/Impulse
Jun 30, 2022 2:26:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-06-30T14:26:18.294Z: Fusing consumer Read-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/PairWithRestriction into Read input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource)
Jun 30, 2022 2:26:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-06-30T14:26:18.328Z: Fusing consumer Read-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/SplitWithSizing into Read-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/PairWithRestriction
Jun 30, 2022 2:26:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-06-30T14:26:18.351Z: Fusing consumer Read input/ParDo(StripIds)/ParMultiDo(StripIds) into Read-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/ProcessElementAndRestrictionWithSizing
Jun 30, 2022 2:26:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-06-30T14:26:18.385Z: Fusing consumer Collect start time metrics/ParMultiDo(TimeMonitor) into Read input/ParDo(StripIds)/ParMultiDo(StripIds)
Jun 30, 2022 2:26:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-06-30T14:26:18.409Z: Fusing consumer Total bytes monitor/ParMultiDo(ByteMonitor) into Collect start time metrics/ParMultiDo(TimeMonitor)
Jun 30, 2022 2:26:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-06-30T14:26:18.430Z: Fusing consumer Window.Into()/Window.Assign into Total bytes monitor/ParMultiDo(ByteMonitor)
Jun 30, 2022 2:26:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-06-30T14:26:18.462Z: Fusing consumer Group by key (0)/MergeBuckets into Group by key (0)/ReadStream
Jun 30, 2022 2:26:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-06-30T14:26:18.493Z: Fusing consumer Ungroup and reiterate (0)/ParMultiDo(UngroupAndReiterate) into Group by key (0)/MergeBuckets
Jun 30, 2022 2:26:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-06-30T14:26:18.525Z: Fusing consumer Collect end time metrics (0)/ParMultiDo(TimeMonitor) into Ungroup and reiterate (0)/ParMultiDo(UngroupAndReiterate)
Jun 30, 2022 2:26:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-06-30T14:26:18.561Z: Fusing consumer Group by key (1)/MergeBuckets into Group by key (1)/ReadStream
Jun 30, 2022 2:26:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-06-30T14:26:18.593Z: Fusing consumer Ungroup and reiterate (1)/ParMultiDo(UngroupAndReiterate) into Group by key (1)/MergeBuckets
Jun 30, 2022 2:26:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-06-30T14:26:18.627Z: Fusing consumer Collect end time metrics (1)/ParMultiDo(TimeMonitor) into Ungroup and reiterate (1)/ParMultiDo(UngroupAndReiterate)
Jun 30, 2022 2:26:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-06-30T14:26:18.674Z: Fusing consumer Group by key (2)/MergeBuckets into Group by key (2)/ReadStream
Jun 30, 2022 2:26:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-06-30T14:26:18.699Z: Fusing consumer Ungroup and reiterate (2)/ParMultiDo(UngroupAndReiterate) into Group by key (2)/MergeBuckets
Jun 30, 2022 2:26:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-06-30T14:26:18.747Z: Fusing consumer Collect end time metrics (2)/ParMultiDo(TimeMonitor) into Ungroup and reiterate (2)/ParMultiDo(UngroupAndReiterate)
Jun 30, 2022 2:26:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-06-30T14:26:18.771Z: Fusing consumer Group by key (3)/MergeBuckets into Group by key (3)/ReadStream
Jun 30, 2022 2:26:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-06-30T14:26:18.806Z: Fusing consumer Ungroup and reiterate (3)/ParMultiDo(UngroupAndReiterate) into Group by key (3)/MergeBuckets
Jun 30, 2022 2:26:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-06-30T14:26:18.834Z: Fusing consumer Collect end time metrics (3)/ParMultiDo(TimeMonitor) into Ungroup and reiterate (3)/ParMultiDo(UngroupAndReiterate)
Jun 30, 2022 2:26:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-06-30T14:26:18.955Z: Running job using Streaming Engine
Jun 30, 2022 2:26:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-06-30T14:26:19.120Z: Starting 16 ****s in us-central1-b...
Jun 30, 2022 2:26:35 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-06-30T14:26:35.036Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete
Jun 30, 2022 2:27:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-06-30T14:27:00.306Z: Autoscaling: Raised the number of ****s to 16 so that the pipeline can catch up with its backlog and keep up with its input rate.
Jun 30, 2022 2:27:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-06-30T14:27:51.302Z: Workers have started successfully.
Jun 30, 2022 2:40:35 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-06-30T14:40:35.535Z: Cleaning up.
Jun 30, 2022 2:40:35 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-06-30T14:40:35.627Z: Stopping **** pool...
Jun 30, 2022 2:40:35 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-06-30T14:40:35.717Z: Stopping **** pool...
Jun 30, 2022 2:41:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-06-30T14:41:15.960Z: Autoscaling: Reduced the number of ****s to 0 based on low average **** CPU utilization, and the pipeline having sufficiently low backlog and keeping up with input rate.
Jun 30, 2022 2:41:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-06-30T14:41:16.007Z: Worker pool stopped.
Jun 30, 2022 2:41:25 PM org.apache.beam.runners.dataflow.DataflowPipelineJob logTerminalState
INFO: Job 2022-06-30_07_25_59-9111762635122043688 finished with status DONE.
Load test results for test (ID): 455c850e-7282-4cb1-8762-bd2d03bd5c4a and timestamp: 2022-06-30T14:25:54.297000000Z:
                 Metric:                    Value:
dataflow_v2_java17_runtime_sec                   663.833
dataflow_v2_java17_total_bytes_count                 4.99998E8

> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220630142516
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:5a7ecefcaa60d17e99c11f18e7deaf8e3b58e1b64b9cc30aa9fa40216832ba3c
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220630142516]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:5a7ecefcaa60d17e99c11f18e7deaf8e3b58e1b64b9cc30aa9fa40216832ba3c]

Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220630142516] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:5a7ecefcaa60d17e99c11f18e7deaf8e3b58e1b64b9cc30aa9fa40216832ba3c])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:5a7ecefcaa60d17e99c11f18e7deaf8e3b58e1b64b9cc30aa9fa40216832ba3c
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:5a7ecefcaa60d17e99c11f18e7deaf8e3b58e1b64b9cc30aa9fa40216832ba3c
ERROR: (gcloud.container.images.delete) Not found: response: {'docker-distribution-api-version': 'registry/2.0', 'content-type': 'application/json', 'date': 'Thu, 30 Jun 2022 14:41:32 GMT', 'server': 'Docker Registry', 'cache-control': 'private', 'x-xss-protection': '0', 'x-frame-options': 'SAMEORIGIN', 'transfer-encoding': 'chunked', 'status': '404', 'content-length': '168', '-content-encoding': 'gzip'}
Failed to compute blob liveness for manifest: 'sha256:5a7ecefcaa60d17e99c11f18e7deaf8e3b58e1b64b9cc30aa9fa40216832ba3c': None

> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Java_GBK_Dataflow_V2_Streaming_Java17/ws/src/runners/google-cloud-dataflow-java/build.gradle'> line: 298

* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:cleanUpDockerJavaImages'.
> Process 'command './scripts/cleanup_untagged_gcr_images.sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.4/userguide/command_line_interface.html#sec:command_line_warnings

Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.

BUILD FAILED in 16m 17s
105 actionable tasks: 8 executed, 97 up-to-date

Publishing build scan...
https://gradle.com/s/hpxltc6qpq37c

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Jenkins build is back to normal : beam_LoadTests_Java_GBK_Dataflow_V2_Streaming_Java17 #192

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Java_GBK_Dataflow_V2_Streaming_Java17/192/display/redirect?page=changes>


---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org