You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2023/04/05 14:32:01 UTC
Build failed in Jenkins: beam_LoadTests_Java_GBK_Dataflow_V2_Batch_Java11 #654
See <https://ci-beam.apache.org/job/beam_LoadTests_Java_GBK_Dataflow_V2_Batch_Java11/654/display/redirect>
Changes:
------------------------------------------
[...truncated 390.96 KB...]
INFO: Adding Ungroup and reiterate (3) as step s15
Apr 05, 2023 2:29:08 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Collect end time metrics (3) as step s16
Apr 05, 2023 2:29:08 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Group by key (4) as step s17
Apr 05, 2023 2:29:08 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Ungroup and reiterate (4) as step s18
Apr 05, 2023 2:29:08 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Collect end time metrics (4) as step s19
Apr 05, 2023 2:29:08 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Group by key (5) as step s20
Apr 05, 2023 2:29:08 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Ungroup and reiterate (5) as step s21
Apr 05, 2023 2:29:08 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Collect end time metrics (5) as step s22
Apr 05, 2023 2:29:08 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Group by key (6) as step s23
Apr 05, 2023 2:29:08 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Ungroup and reiterate (6) as step s24
Apr 05, 2023 2:29:08 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Collect end time metrics (6) as step s25
Apr 05, 2023 2:29:08 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Group by key (7) as step s26
Apr 05, 2023 2:29:08 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Ungroup and reiterate (7) as step s27
Apr 05, 2023 2:29:08 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Collect end time metrics (7) as step s28
Apr 05, 2023 2:29:08 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Dataflow SDK version: 2.47.0-SNAPSHOT
Apr 05, 2023 2:29:12 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobs/us-central1/2023-04-05_07_29_09-16464821902998276382?project=apache-beam-testing
Apr 05, 2023 2:29:12 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Submitted job: 2023-04-05_07_29_09-16464821902998276382
Apr 05, 2023 2:29:12 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2023-04-05_07_29_09-16464821902998276382
Apr 05, 2023 2:29:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2023-04-05T14:29:15.882Z: The workflow name is not a valid Cloud Label. Labels applied to Cloud resources (such as GCE Instances) for monitoring will be labeled with this modified job name: load0tests0java110dataflow0v20batch0gbk05-jenkins-04051429-990p. For the best monitoring experience, please name your job with a valid Cloud Label. For details, see: https://cloud.google.com/compute/docs/labeling-resources#restrictions
Apr 05, 2023 2:29:25 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-04-05T14:29:24.277Z: Worker configuration: e2-standard-2 in us-central1-a.
Apr 05, 2023 2:29:25 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-04-05T14:29:25.332Z: Expanding SplittableParDo operations into optimizable parts.
Apr 05, 2023 2:29:25 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-04-05T14:29:25.369Z: Expanding CollectionToSingleton operations into optimizable parts.
Apr 05, 2023 2:29:25 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-04-05T14:29:25.460Z: Expanding CoGroupByKey operations into optimizable parts.
Apr 05, 2023 2:29:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-04-05T14:29:25.818Z: Expanding GroupByKey operations into optimizable parts.
Apr 05, 2023 2:29:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-04-05T14:29:25.898Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
Apr 05, 2023 2:29:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-04-05T14:29:25.928Z: Fusing consumer Group by key (1)/Write into Window.Into()/Window.Assign
Apr 05, 2023 2:29:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-04-05T14:29:25.957Z: Fusing consumer Group by key (2)/Write into Window.Into()/Window.Assign
Apr 05, 2023 2:29:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-04-05T14:29:25.989Z: Fusing consumer Group by key (3)/Write into Window.Into()/Window.Assign
Apr 05, 2023 2:29:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-04-05T14:29:26.024Z: Fusing consumer Group by key (4)/Write into Window.Into()/Window.Assign
Apr 05, 2023 2:29:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-04-05T14:29:26.061Z: Fusing consumer Group by key (5)/Write into Window.Into()/Window.Assign
Apr 05, 2023 2:29:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-04-05T14:29:26.083Z: Fusing consumer Group by key (6)/Write into Window.Into()/Window.Assign
Apr 05, 2023 2:29:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-04-05T14:29:26.109Z: Fusing consumer Group by key (7)/Write into Window.Into()/Window.Assign
Apr 05, 2023 2:29:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-04-05T14:29:26.137Z: Fusing consumer Group by key (0)/Write into Window.Into()/Window.Assign
Apr 05, 2023 2:29:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-04-05T14:29:26.166Z: Fusing consumer Read input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource) into Read input/Impulse
Apr 05, 2023 2:29:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-04-05T14:29:26.198Z: Fusing consumer Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction into Read input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource)
Apr 05, 2023 2:29:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-04-05T14:29:26.231Z: Fusing consumer Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/SplitWithSizing into Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction
Apr 05, 2023 2:29:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-04-05T14:29:26.266Z: Fusing consumer Collect start time metrics/ParMultiDo(TimeMonitor) into Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/ProcessElementAndRestrictionWithSizing
Apr 05, 2023 2:29:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-04-05T14:29:26.293Z: Fusing consumer Total bytes monitor/ParMultiDo(ByteMonitor) into Collect start time metrics/ParMultiDo(TimeMonitor)
Apr 05, 2023 2:29:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-04-05T14:29:26.327Z: Fusing consumer Window.Into()/Window.Assign into Total bytes monitor/ParMultiDo(ByteMonitor)
Apr 05, 2023 2:29:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-04-05T14:29:26.361Z: Fusing consumer Ungroup and reiterate (0)/ParMultiDo(UngroupAndReiterate) into Group by key (0)/Read
Apr 05, 2023 2:29:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-04-05T14:29:26.392Z: Fusing consumer Collect end time metrics (0)/ParMultiDo(TimeMonitor) into Ungroup and reiterate (0)/ParMultiDo(UngroupAndReiterate)
Apr 05, 2023 2:29:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-04-05T14:29:26.426Z: Fusing consumer Ungroup and reiterate (1)/ParMultiDo(UngroupAndReiterate) into Group by key (1)/Read
Apr 05, 2023 2:29:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-04-05T14:29:26.458Z: Fusing consumer Collect end time metrics (1)/ParMultiDo(TimeMonitor) into Ungroup and reiterate (1)/ParMultiDo(UngroupAndReiterate)
Apr 05, 2023 2:29:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-04-05T14:29:26.494Z: Fusing consumer Ungroup and reiterate (2)/ParMultiDo(UngroupAndReiterate) into Group by key (2)/Read
Apr 05, 2023 2:29:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-04-05T14:29:26.530Z: Fusing consumer Collect end time metrics (2)/ParMultiDo(TimeMonitor) into Ungroup and reiterate (2)/ParMultiDo(UngroupAndReiterate)
Apr 05, 2023 2:29:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-04-05T14:29:26.560Z: Fusing consumer Ungroup and reiterate (3)/ParMultiDo(UngroupAndReiterate) into Group by key (3)/Read
Apr 05, 2023 2:29:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-04-05T14:29:26.580Z: Fusing consumer Collect end time metrics (3)/ParMultiDo(TimeMonitor) into Ungroup and reiterate (3)/ParMultiDo(UngroupAndReiterate)
Apr 05, 2023 2:29:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-04-05T14:29:26.601Z: Fusing consumer Ungroup and reiterate (4)/ParMultiDo(UngroupAndReiterate) into Group by key (4)/Read
Apr 05, 2023 2:29:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-04-05T14:29:26.629Z: Fusing consumer Collect end time metrics (4)/ParMultiDo(TimeMonitor) into Ungroup and reiterate (4)/ParMultiDo(UngroupAndReiterate)
Apr 05, 2023 2:29:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-04-05T14:29:26.663Z: Fusing consumer Ungroup and reiterate (5)/ParMultiDo(UngroupAndReiterate) into Group by key (5)/Read
Apr 05, 2023 2:29:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-04-05T14:29:26.721Z: Fusing consumer Collect end time metrics (5)/ParMultiDo(TimeMonitor) into Ungroup and reiterate (5)/ParMultiDo(UngroupAndReiterate)
Apr 05, 2023 2:29:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-04-05T14:29:26.765Z: Fusing consumer Ungroup and reiterate (6)/ParMultiDo(UngroupAndReiterate) into Group by key (6)/Read
Apr 05, 2023 2:29:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-04-05T14:29:26.800Z: Fusing consumer Collect end time metrics (6)/ParMultiDo(TimeMonitor) into Ungroup and reiterate (6)/ParMultiDo(UngroupAndReiterate)
Apr 05, 2023 2:29:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-04-05T14:29:26.835Z: Fusing consumer Ungroup and reiterate (7)/ParMultiDo(UngroupAndReiterate) into Group by key (7)/Read
Apr 05, 2023 2:29:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-04-05T14:29:26.880Z: Fusing consumer Collect end time metrics (7)/ParMultiDo(TimeMonitor) into Ungroup and reiterate (7)/ParMultiDo(UngroupAndReiterate)
Apr 05, 2023 2:29:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-04-05T14:29:27.295Z: Executing operation Read input/Impulse+Read input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource)+Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction+Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/SplitWithSizing
Apr 05, 2023 2:29:29 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-04-05T14:29:27.370Z: Starting 16 ****s in us-central1-a...
Apr 05, 2023 2:29:57 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-04-05T14:29:57.043Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete
Apr 05, 2023 2:30:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-04-05T14:30:17.674Z: Autoscaling: Raised the number of ****s to 16 based on the rate of progress in the currently running stage(s).
Apr 05, 2023 2:31:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-04-05T14:31:06.545Z: Workers have started successfully.
Apr 05, 2023 2:31:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-04-05T14:31:17.130Z: All ****s have finished the startup processes and began to receive work requests.
Apr 05, 2023 2:31:22 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-04-05T14:31:21.532Z: Finished operation Read input/Impulse+Read input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource)+Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction+Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/SplitWithSizing
Apr 05, 2023 2:31:22 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-04-05T14:31:21.692Z: Executing operation Group by key (7)/Create
Apr 05, 2023 2:31:22 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-04-05T14:31:21.719Z: Executing operation Group by key (1)/Create
Apr 05, 2023 2:31:22 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-04-05T14:31:21.766Z: Executing operation Group by key (2)/Create
Apr 05, 2023 2:31:22 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-04-05T14:31:21.794Z: Executing operation Group by key (3)/Create
Apr 05, 2023 2:31:22 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-04-05T14:31:21.836Z: Executing operation Group by key (4)/Create
Apr 05, 2023 2:31:22 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-04-05T14:31:21.870Z: Executing operation Group by key (5)/Create
Apr 05, 2023 2:31:22 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-04-05T14:31:21.904Z: Executing operation Group by key (6)/Create
Apr 05, 2023 2:31:22 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-04-05T14:31:21.940Z: Executing operation Group by key (0)/Create
Apr 05, 2023 2:31:24 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-04-05T14:31:23.150Z: Finished operation Group by key (7)/Create
Apr 05, 2023 2:31:24 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-04-05T14:31:23.150Z: Finished operation Group by key (1)/Create
Apr 05, 2023 2:31:24 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-04-05T14:31:23.234Z: Finished operation Group by key (2)/Create
Apr 05, 2023 2:31:24 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-04-05T14:31:24.381Z: Finished operation Group by key (3)/Create
Apr 05, 2023 2:31:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-04-05T14:31:25.167Z: Finished operation Group by key (6)/Create
Apr 05, 2023 2:31:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-04-05T14:31:25.280Z: Finished operation Group by key (0)/Create
Apr 05, 2023 2:31:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-04-05T14:31:26.086Z: Finished operation Group by key (4)/Create
Apr 05, 2023 2:31:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-04-05T14:31:26.120Z: Finished operation Group by key (5)/Create
Apr 05, 2023 2:31:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-04-05T14:31:26.286Z: Executing operation Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/ProcessElementAndRestrictionWithSizing+Collect start time metrics/ParMultiDo(TimeMonitor)+Total bytes monitor/ParMultiDo(ByteMonitor)+Window.Into()/Window.Assign+Group by key (1)/Write+Group by key (2)/Write+Group by key (3)/Write+Group by key (4)/Write+Group by key (5)/Write+Group by key (6)/Write+Group by key (7)/Write+Group by key (0)/Write
Apr 05, 2023 2:31:49 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-04-05T14:31:48.116Z: Finished operation Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/ProcessElementAndRestrictionWithSizing+Collect start time metrics/ParMultiDo(TimeMonitor)+Total bytes monitor/ParMultiDo(ByteMonitor)+Window.Into()/Window.Assign+Group by key (1)/Write+Group by key (2)/Write+Group by key (3)/Write+Group by key (4)/Write+Group by key (5)/Write+Group by key (6)/Write+Group by key (7)/Write+Group by key (0)/Write
Apr 05, 2023 2:31:49 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-04-05T14:31:48.199Z: Executing operation Group by key (2)/Close
Apr 05, 2023 2:31:49 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-04-05T14:31:48.238Z: Executing operation Group by key (3)/Close
Apr 05, 2023 2:31:49 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-04-05T14:31:48.273Z: Executing operation Group by key (4)/Close
Apr 05, 2023 2:31:49 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-04-05T14:31:48.308Z: Executing operation Group by key (5)/Close
Apr 05, 2023 2:31:49 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-04-05T14:31:48.345Z: Executing operation Group by key (6)/Close
Apr 05, 2023 2:31:49 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-04-05T14:31:48.384Z: Executing operation Group by key (7)/Close
Apr 05, 2023 2:31:49 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-04-05T14:31:48.420Z: Executing operation Group by key (1)/Close
Apr 05, 2023 2:31:49 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-04-05T14:31:48.449Z: Finished operation Group by key (3)/Close
Apr 05, 2023 2:31:49 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-04-05T14:31:48.449Z: Finished operation Group by key (7)/Close
Apr 05, 2023 2:31:49 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-04-05T14:31:48.458Z: Executing operation Group by key (0)/Close
Apr 05, 2023 2:31:49 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-04-05T14:31:48.470Z: Finished operation Group by key (2)/Close
Apr 05, 2023 2:31:49 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-04-05T14:31:48.491Z: Finished operation Group by key (1)/Close
Apr 05, 2023 2:31:49 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-04-05T14:31:48.491Z: Finished operation Group by key (5)/Close
Apr 05, 2023 2:31:49 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-04-05T14:31:48.514Z: Executing operation Group by key (7)/Read+Ungroup and reiterate (7)/ParMultiDo(UngroupAndReiterate)+Collect end time metrics (7)/ParMultiDo(TimeMonitor)
Apr 05, 2023 2:31:49 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-04-05T14:31:48.518Z: Finished operation Group by key (0)/Close
Apr 05, 2023 2:31:49 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-04-05T14:31:48.551Z: Executing operation Group by key (3)/Read+Ungroup and reiterate (3)/ParMultiDo(UngroupAndReiterate)+Collect end time metrics (3)/ParMultiDo(TimeMonitor)
Apr 05, 2023 2:31:49 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-04-05T14:31:48.602Z: Executing operation Group by key (2)/Read+Ungroup and reiterate (2)/ParMultiDo(UngroupAndReiterate)+Collect end time metrics (2)/ParMultiDo(TimeMonitor)
Apr 05, 2023 2:31:49 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-04-05T14:31:48.651Z: Executing operation Group by key (1)/Read+Ungroup and reiterate (1)/ParMultiDo(UngroupAndReiterate)+Collect end time metrics (1)/ParMultiDo(TimeMonitor)
Apr 05, 2023 2:31:49 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-04-05T14:31:48.686Z: Executing operation Group by key (5)/Read+Ungroup and reiterate (5)/ParMultiDo(UngroupAndReiterate)+Collect end time metrics (5)/ParMultiDo(TimeMonitor)
Apr 05, 2023 2:31:49 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-04-05T14:31:48.688Z: Finished operation Group by key (4)/Close
Apr 05, 2023 2:31:49 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-04-05T14:31:48.731Z: Executing operation Group by key (0)/Read+Ungroup and reiterate (0)/ParMultiDo(UngroupAndReiterate)+Collect end time metrics (0)/ParMultiDo(TimeMonitor)
Apr 05, 2023 2:31:49 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-04-05T14:31:48.751Z: Finished operation Group by key (6)/Close
Apr 05, 2023 2:31:49 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-04-05T14:31:48.770Z: Executing operation Group by key (4)/Read+Ungroup and reiterate (4)/ParMultiDo(UngroupAndReiterate)+Collect end time metrics (4)/ParMultiDo(TimeMonitor)
Apr 05, 2023 2:31:49 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-04-05T14:31:48.842Z: Executing operation Group by key (6)/Read+Ungroup and reiterate (6)/ParMultiDo(UngroupAndReiterate)+Collect end time metrics (6)/ParMultiDo(TimeMonitor)
Apr 05, 2023 2:31:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-04-05T14:31:52.777Z: Finished operation Group by key (7)/Read+Ungroup and reiterate (7)/ParMultiDo(UngroupAndReiterate)+Collect end time metrics (7)/ParMultiDo(TimeMonitor)
Apr 05, 2023 2:31:56 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-04-05T14:31:54.361Z: Finished operation Group by key (3)/Read+Ungroup and reiterate (3)/ParMultiDo(UngroupAndReiterate)+Collect end time metrics (3)/ParMultiDo(TimeMonitor)
Apr 05, 2023 2:31:56 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-04-05T14:31:55.100Z: Finished operation Group by key (2)/Read+Ungroup and reiterate (2)/ParMultiDo(UngroupAndReiterate)+Collect end time metrics (2)/ParMultiDo(TimeMonitor)
Apr 05, 2023 2:31:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-04-05T14:31:57.026Z: Finished operation Group by key (5)/Read+Ungroup and reiterate (5)/ParMultiDo(UngroupAndReiterate)+Collect end time metrics (5)/ParMultiDo(TimeMonitor)
FATAL: command execution failed
java.io.IOException: Backing channel 'apache-beam-jenkins-8' is disconnected.
at hudson.remoting.RemoteInvocationHandler.channelOrFail(RemoteInvocationHandler.java:215)
at hudson.remoting.RemoteInvocationHandler.invoke(RemoteInvocationHandler.java:285)
at com.sun.proxy.$Proxy142.isAlive(Unknown Source)
at hudson.Launcher$RemoteLauncher$ProcImpl.isAlive(Launcher.java:1215)
at hudson.Launcher$RemoteLauncher$ProcImpl.join(Launcher.java:1207)
at hudson.Launcher$ProcStarter.join(Launcher.java:524)
at hudson.plugins.gradle.Gradle.perform(Gradle.java:317)
at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20)
at hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:814)
at hudson.model.Build$BuildExecution.build(Build.java:199)
at hudson.model.Build$BuildExecution.doRun(Build.java:164)
at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:522)
at hudson.model.Run.execute(Run.java:1896)
at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:44)
at hudson.model.ResourceController.execute(ResourceController.java:101)
at hudson.model.Executor.run(Executor.java:442)
Caused by: hudson.remoting.Channel$OrderlyShutdown: Command Close created at
at hudson.remoting.Channel$CloseCommand.execute(Channel.java:1313)
at hudson.remoting.Channel$1.handle(Channel.java:606)
at hudson.remoting.SynchronousCommandTransport$ReaderThread.run(SynchronousCommandTransport.java:81)
Caused by: Command Close created at
at hudson.remoting.Command.<init>(Command.java:70)
at hudson.remoting.Channel$CloseCommand.<init>(Channel.java:1306)
at hudson.remoting.Channel$CloseCommand.<init>(Channel.java:1304)
at hudson.remoting.Channel.close(Channel.java:1480)
at hudson.remoting.Channel.close(Channel.java:1447)
at hudson.remoting.Channel$CloseCommand.execute(Channel.java:1312)
... 2 more
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
ERROR: apache-beam-jenkins-8 is offline; cannot locate jdk_1.8_latest
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal : beam_LoadTests_Java_GBK_Dataflow_V2_Batch_Java11 #656
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Java_GBK_Dataflow_V2_Batch_Java11/656/display/redirect>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Java_GBK_Dataflow_V2_Batch_Java11 #655
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Java_GBK_Dataflow_V2_Batch_Java11/655/display/redirect>
Changes:
------------------------------------------
[...truncated 555.74 KB...]
#21 [17/18] RUN if [ "true" = "false" ] ; then rm -rf /opt/apache/beam/third_party_licenses ; fi
#21 DONE 0.5s
#22 [18/18] COPY target/profiler/* /opt/google_cloud_profiler/
#22 DONE 0.1s
#23 exporting to image
#23 exporting layers
#23 exporting layers 0.4s done
#23 writing image sha256:ad87b2180492f66a6267f532f207cb2a92bf8628ea2ea93ba9751d97b8616742 done
#23 naming to docker.io/apache/beam_java11_sdk:2.48.0.dev done
#23 DONE 0.4s
> Task :runners:google-cloud-dataflow-java:buildAndPushDockerJavaContainer
WARNING: `gcloud docker` will not be supported for Docker client versions above 18.03.
As an alternative, use `gcloud auth configure-docker` to configure `docker` to
use `gcloud` as a credential helper, then use `docker` as you would for non-GCR
registries, e.g. `docker pull gcr.io/project-id/my-image`. Add
`--verbosity=error` to silence this warning: `gcloud docker
--verbosity=error -- pull gcr.io/project-id/my-image`.
See: https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker
The push refers to repository [us.gcr.io/apache-beam-testing/java-postcommit-it/java]
f25ae2e2c39a: Preparing
5f70bf18a086: Preparing
21677c76a4e0: Preparing
8d4ac2cc07e9: Preparing
8e96484b0950: Preparing
5cee3d636099: Preparing
695fdaeeba55: Preparing
33f95f8cce9c: Preparing
8fedc8b99b73: Preparing
fefbcf4151fc: Preparing
e2f365cadf94: Preparing
fec17aaee9e5: Preparing
57de428cba15: Preparing
85db5c6d076d: Preparing
d126e65fc1d2: Preparing
0ecdb9604b03: Preparing
8f9b7fe9f891: Preparing
749d6cfaa5eb: Preparing
5cee3d636099: Waiting
8ac55e7a3c46: Preparing
695fdaeeba55: Waiting
04d1dcab20cb: Preparing
b93c1bd012ab: Preparing
33f95f8cce9c: Waiting
8fedc8b99b73: Waiting
0ecdb9604b03: Waiting
fefbcf4151fc: Waiting
57de428cba15: Waiting
8f9b7fe9f891: Waiting
e2f365cadf94: Waiting
85db5c6d076d: Waiting
749d6cfaa5eb: Waiting
fec17aaee9e5: Waiting
8ac55e7a3c46: Waiting
d126e65fc1d2: Waiting
b93c1bd012ab: Waiting
04d1dcab20cb: Waiting
5f70bf18a086: Layer already exists
21677c76a4e0: Pushed
8d4ac2cc07e9: Pushed
8e96484b0950: Pushed
5cee3d636099: Pushed
8fedc8b99b73: Pushed
33f95f8cce9c: Pushed
f25ae2e2c39a: Pushed
695fdaeeba55: Pushed
e2f365cadf94: Pushed
fefbcf4151fc: Pushed
57de428cba15: Pushed
fec17aaee9e5: Pushed
749d6cfaa5eb: Layer already exists
8ac55e7a3c46: Layer already exists
04d1dcab20cb: Layer already exists
b93c1bd012ab: Layer already exists
85db5c6d076d: Pushed
d126e65fc1d2: Pushed
0ecdb9604b03: Pushed
8f9b7fe9f891: Pushed
20230406144207: digest: sha256:7773439fc5d3bf6c484010c06bbb12fbfad55833e760c28ba1e03361eca60c6e size: 4712
> Task :sdks:java:testing:load-tests:run
Apr 06, 2023 2:42:40 PM org.apache.beam.runners.dataflow.options.DataflowPipelineOptions$StagingLocationFactory create
INFO: No stagingLocation provided, falling back to gcpTempLocation
Apr 06, 2023 2:42:41 PM org.apache.beam.runners.dataflow.DataflowRunner fromOptions
INFO: PipelineOptions.filesToStage was not specified. Defaulting to files from the classpath: will stage 230 files. Enable logging at DEBUG level to see which files will be staged.
Apr 06, 2023 2:42:42 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Executing pipeline on the Dataflow Service, which will have billing implications related to Google Compute Engine usage and other Google Cloud Services.
Apr 06, 2023 2:42:44 PM org.apache.beam.runners.dataflow.util.PackageUtil stageClasspathElements
INFO: Uploading 230 files from PipelineOptions.filesToStage to staging location to prepare for execution.
Apr 06, 2023 2:42:44 PM org.apache.beam.runners.dataflow.util.PackageUtil stageClasspathElements
INFO: Staging files complete: 230 files cached, 0 files newly uploaded in 0 seconds
Apr 06, 2023 2:42:44 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging portable pipeline proto to gs://temp-storage-for-perf-tests/loadtests/staging/
Apr 06, 2023 2:42:44 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <97872 bytes, hash 1a76b75763377b113b258c4c4974d61e9dbaf116228ef2c9e1ce694d34c70297> to gs://temp-storage-for-perf-tests/loadtests/staging/pipeline-Gna3V2M3exE7JYxMSXTWHp268RYijvLJ4c5pTTTHApc.pb
Apr 06, 2023 2:42:46 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Read input as step s1
Apr 06, 2023 2:42:46 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Collect start time metrics as step s2
Apr 06, 2023 2:42:46 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Total bytes monitor as step s3
Apr 06, 2023 2:42:46 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Window.Into()/Window.Assign as step s4
Apr 06, 2023 2:42:46 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Group by key (0) as step s5
Apr 06, 2023 2:42:46 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Ungroup and reiterate (0) as step s6
Apr 06, 2023 2:42:46 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Collect end time metrics (0) as step s7
Apr 06, 2023 2:42:46 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Dataflow SDK version: 2.48.0-SNAPSHOT
Apr 06, 2023 2:42:47 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobs/us-central1/2023-04-06_07_42_46-9622236791162493580?project=apache-beam-testing
Apr 06, 2023 2:42:47 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Submitted job: 2023-04-06_07_42_46-9622236791162493580
Apr 06, 2023 2:42:47 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2023-04-06_07_42_46-9622236791162493580
Apr 06, 2023 2:42:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2023-04-06T14:42:50.619Z: The workflow name is not a valid Cloud Label. Labels applied to Cloud resources (such as GCE Instances) for monitoring will be labeled with this modified job name: load0tests0java110dataflow0v20batch0gbk07-jenkins-04061442-qnt. For the best monitoring experience, please name your job with a valid Cloud Label. For details, see: https://cloud.google.com/compute/docs/labeling-resources#restrictions
Apr 06, 2023 2:42:57 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-04-06T14:42:56.807Z: Worker configuration: e2-standard-2 in us-central1-f.
Apr 06, 2023 2:42:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-04-06T14:42:58.010Z: Expanding SplittableParDo operations into optimizable parts.
Apr 06, 2023 2:42:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-04-06T14:42:58.041Z: Expanding CollectionToSingleton operations into optimizable parts.
Apr 06, 2023 2:42:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-04-06T14:42:58.094Z: Expanding CoGroupByKey operations into optimizable parts.
Apr 06, 2023 2:42:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-04-06T14:42:58.179Z: Expanding GroupByKey operations into optimizable parts.
Apr 06, 2023 2:42:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-04-06T14:42:58.262Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
Apr 06, 2023 2:42:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-04-06T14:42:58.299Z: Fusing consumer Read input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource) into Read input/Impulse
Apr 06, 2023 2:42:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-04-06T14:42:58.325Z: Fusing consumer Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction into Read input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource)
Apr 06, 2023 2:42:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-04-06T14:42:58.359Z: Fusing consumer Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/SplitWithSizing into Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction
Apr 06, 2023 2:42:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-04-06T14:42:58.381Z: Fusing consumer Collect start time metrics/ParMultiDo(TimeMonitor) into Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/ProcessElementAndRestrictionWithSizing
Apr 06, 2023 2:42:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-04-06T14:42:58.421Z: Fusing consumer Total bytes monitor/ParMultiDo(ByteMonitor) into Collect start time metrics/ParMultiDo(TimeMonitor)
Apr 06, 2023 2:42:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-04-06T14:42:58.447Z: Fusing consumer Window.Into()/Window.Assign into Total bytes monitor/ParMultiDo(ByteMonitor)
Apr 06, 2023 2:42:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-04-06T14:42:58.475Z: Fusing consumer Group by key (0)/Write into Window.Into()/Window.Assign
Apr 06, 2023 2:42:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-04-06T14:42:58.511Z: Fusing consumer Ungroup and reiterate (0)/ParMultiDo(UngroupAndReiterate) into Group by key (0)/Read
Apr 06, 2023 2:42:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-04-06T14:42:58.544Z: Fusing consumer Collect end time metrics (0)/ParMultiDo(TimeMonitor) into Ungroup and reiterate (0)/ParMultiDo(UngroupAndReiterate)
Apr 06, 2023 2:42:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-04-06T14:42:58.885Z: Executing operation Read input/Impulse+Read input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource)+Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction+Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/SplitWithSizing
Apr 06, 2023 2:42:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-04-06T14:42:58.953Z: Starting 5 ****s in us-central1-f...
Apr 06, 2023 2:43:25 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-04-06T14:43:23.256Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete
Apr 06, 2023 2:43:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-04-06T14:43:41.390Z: Autoscaling: Raised the number of ****s to 5 based on the rate of progress in the currently running stage(s).
Apr 06, 2023 2:44:40 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-04-06T14:44:39.886Z: Workers have started successfully.
Apr 06, 2023 2:44:56 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-04-06T14:44:55.063Z: All ****s have finished the startup processes and began to receive work requests.
Apr 06, 2023 2:45:03 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-04-06T14:45:00.791Z: Finished operation Read input/Impulse+Read input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource)+Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction+Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/SplitWithSizing
Apr 06, 2023 2:45:03 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-04-06T14:45:00.934Z: Executing operation Group by key (0)/Create
Apr 06, 2023 2:45:03 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-04-06T14:45:02.309Z: Finished operation Group by key (0)/Create
Apr 06, 2023 2:45:03 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-04-06T14:45:02.551Z: Executing operation Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/ProcessElementAndRestrictionWithSizing+Collect start time metrics/ParMultiDo(TimeMonitor)+Total bytes monitor/ParMultiDo(ByteMonitor)+Window.Into()/Window.Assign+Group by key (0)/Write
Apr 06, 2023 2:45:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-04-06T14:45:22.468Z: Finished operation Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/ProcessElementAndRestrictionWithSizing+Collect start time metrics/ParMultiDo(TimeMonitor)+Total bytes monitor/ParMultiDo(ByteMonitor)+Window.Into()/Window.Assign+Group by key (0)/Write
Apr 06, 2023 2:45:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-04-06T14:45:22.552Z: Executing operation Group by key (0)/Close
Apr 06, 2023 2:45:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-04-06T14:45:22.602Z: Finished operation Group by key (0)/Close
Apr 06, 2023 2:45:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-04-06T14:45:22.686Z: Executing operation Group by key (0)/Read+Ungroup and reiterate (0)/ParMultiDo(UngroupAndReiterate)+Collect end time metrics (0)/ParMultiDo(TimeMonitor)
Apr 06, 2023 2:45:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-04-06T14:45:45.149Z: Finished operation Group by key (0)/Read+Ungroup and reiterate (0)/ParMultiDo(UngroupAndReiterate)+Collect end time metrics (0)/ParMultiDo(TimeMonitor)
Apr 06, 2023 2:45:48 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-04-06T14:45:45.327Z: Cleaning up.
Apr 06, 2023 2:45:48 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-04-06T14:45:45.404Z: Stopping **** pool...
Apr 06, 2023 2:48:03 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-04-06T14:48:02.769Z: Autoscaling: Resized **** pool from 5 to 0.
Apr 06, 2023 2:48:03 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2023-04-06T14:48:02.836Z: Worker pool stopped.
Apr 06, 2023 2:48:08 PM org.apache.beam.runners.dataflow.DataflowPipelineJob logTerminalState
INFO: Job 2023-04-06_07_42_46-9622236791162493580 finished with status DONE.
Load test results for test (ID): 5a1b9345-c2b1-40c5-bf8a-40ec12f870fd and timestamp: 2023-04-06T14:42:41.618000000Z:
Metric: Value:
dataflow_v2_java11_runtime_sec 37.451
dataflow_v2_java11_total_bytes_count 2.0E9
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230406144207
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:7773439fc5d3bf6c484010c06bbb12fbfad55833e760c28ba1e03361eca60c6e
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230406144207]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:7773439fc5d3bf6c484010c06bbb12fbfad55833e760c28ba1e03361eca60c6e]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20230406144207] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:7773439fc5d3bf6c484010c06bbb12fbfad55833e760c28ba1e03361eca60c6e])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:7773439fc5d3bf6c484010c06bbb12fbfad55833e760c28ba1e03361eca60c6e
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:7773439fc5d3bf6c484010c06bbb12fbfad55833e760c28ba1e03361eca60c6e
ERROR: (gcloud.container.images.delete) Not found: response: {'docker-distribution-api-version': 'registry/2.0', 'content-type': 'application/json', 'content-encoding': 'gzip', 'date': 'Thu, 06 Apr 2023 14:48:15 GMT', 'server': 'Docker Registry', 'cache-control': 'private', 'x-xss-protection': '0', 'x-frame-options': 'SAMEORIGIN', 'transfer-encoding': 'chunked', 'status': 404}
Failed to compute blob liveness for manifest: 'sha256:7773439fc5d3bf6c484010c06bbb12fbfad55833e760c28ba1e03361eca60c6e': None
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Java_GBK_Dataflow_V2_Batch_Java11/ws/src/runners/google-cloud-dataflow-java/build.gradle'> line: 306
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:cleanUpDockerJavaImages'.
> Process 'command './scripts/cleanup_untagged_gcr_images.sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 6m 53s
112 actionable tasks: 9 executed, 103 up-to-date
Publishing build scan...
https://gradle.com/s/fm7ownknpl4na
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org