You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2021/09/18 16:17:28 UTC
Build failed in Jenkins:
beam_LoadTests_Java_CoGBK_Dataflow_V2_Batch_Java11 #93
See <https://ci-beam.apache.org/job/beam_LoadTests_Java_CoGBK_Dataflow_V2_Batch_Java11/93/display/redirect?page=changes>
Changes:
[samuelw] [BEAM-12740] Add option to CreateOptions to avoid GetObjectMetadata for
[noreply] Minor: Prune docker volumes in Inventory job(#15532)
------------------------------------------
[...truncated 239.76 KB...]
INFO: Staging files complete: 195 files cached, 0 files newly uploaded in 0 seconds
Sep 18, 2021 3:13:52 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging portable pipeline proto to gs://temp-storage-for-perf-tests/loadtests/staging/
Sep 18, 2021 3:13:52 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <101498 bytes, hash 0b045b154172cf984522945009523d3fe3e31aeec7cf88f345af3e2c4a77f191> to gs://temp-storage-for-perf-tests/loadtests/staging/pipeline-CwRbFUFyz5hFIpRQCVI9P-PjGu7Hz4jzRa8-LEp38ZE.pb
Sep 18, 2021 3:13:54 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Read input as step s1
Sep 18, 2021 3:13:54 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Collect start time metrics (input) as step s2
Sep 18, 2021 3:13:54 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Window.Into()/Window.Assign as step s3
Sep 18, 2021 3:13:54 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Read co-input as step s4
Sep 18, 2021 3:13:54 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Collect start time metrics (co-input) as step s5
Sep 18, 2021 3:13:54 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Window.Into()2/Window.Assign as step s6
Sep 18, 2021 3:13:54 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding CoGroupByKey/MakeUnionTable0 as step s7
Sep 18, 2021 3:13:54 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding CoGroupByKey/MakeUnionTable1 as step s8
Sep 18, 2021 3:13:54 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding CoGroupByKey/Flatten as step s9
Sep 18, 2021 3:13:54 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding CoGroupByKey/GBK as step s10
Sep 18, 2021 3:13:54 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding CoGroupByKey/ConstructCoGbkResultFn as step s11
Sep 18, 2021 3:13:54 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Ungroup and reiterate as step s12
Sep 18, 2021 3:13:54 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Collect total bytes as step s13
Sep 18, 2021 3:13:54 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Collect end time metrics as step s14
Sep 18, 2021 3:13:54 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Dataflow SDK version: 2.34.0-SNAPSHOT
Sep 18, 2021 3:13:55 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobs/us-central1/2021-09-18_08_13_54-2851594673609526406?project=apache-beam-testing
Sep 18, 2021 3:13:55 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Submitted job: 2021-09-18_08_13_54-2851594673609526406
Sep 18, 2021 3:13:55 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2021-09-18_08_13_54-2851594673609526406
Sep 18, 2021 3:14:02 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-09-18T15:14:01.131Z: The workflow name is not a valid Cloud Label. Labels applied to Cloud resources (such as GCE Instances) for monitoring will be labeled with this modified job name: load0tests0java110dataflow0v20batch0cogbk04-jenkins-091815-ka80. For the best monitoring experience, please name your job with a valid Cloud Label. For details, see: https://cloud.google.com/compute/docs/labeling-resources#restrictions
Sep 18, 2021 3:14:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-18T15:14:07.185Z: Worker configuration: e2-standard-2 in us-central1-c.
Sep 18, 2021 3:14:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-18T15:14:07.952Z: Expanding SplittableParDo operations into optimizable parts.
Sep 18, 2021 3:14:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-18T15:14:07.980Z: Expanding CollectionToSingleton operations into optimizable parts.
Sep 18, 2021 3:14:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-18T15:14:08.048Z: Expanding CoGroupByKey operations into optimizable parts.
Sep 18, 2021 3:14:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-18T15:14:08.127Z: Expanding GroupByKey operations into optimizable parts.
Sep 18, 2021 3:14:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-18T15:14:08.213Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
Sep 18, 2021 3:14:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-18T15:14:08.247Z: Unzipping flatten CoGroupByKey-Flatten for input CoGroupByKey-MakeUnionTable0-ParMultiDo-ConstructUnionTable-.output
Sep 18, 2021 3:14:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-18T15:14:08.279Z: Fusing unzipped copy of CoGroupByKey/GBK/Write, through flatten CoGroupByKey/Flatten, into producer CoGroupByKey/MakeUnionTable0/ParMultiDo(ConstructUnionTable)
Sep 18, 2021 3:14:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-18T15:14:08.313Z: Fusing consumer CoGroupByKey/ConstructCoGbkResultFn/ParMultiDo(ConstructCoGbkResult) into CoGroupByKey/GBK/Read
Sep 18, 2021 3:14:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-18T15:14:08.347Z: Fusing consumer Ungroup and reiterate/ParMultiDo(UngroupAndReiterate) into CoGroupByKey/ConstructCoGbkResultFn/ParMultiDo(ConstructCoGbkResult)
Sep 18, 2021 3:14:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-18T15:14:08.382Z: Fusing consumer Collect total bytes/ParMultiDo(ByteMonitor) into Ungroup and reiterate/ParMultiDo(UngroupAndReiterate)
Sep 18, 2021 3:14:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-18T15:14:08.415Z: Fusing consumer Collect end time metrics/ParMultiDo(TimeMonitor) into Collect total bytes/ParMultiDo(ByteMonitor)
Sep 18, 2021 3:14:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-18T15:14:08.452Z: Fusing consumer CoGroupByKey/GBK/Write into CoGroupByKey/MakeUnionTable1/ParMultiDo(ConstructUnionTable)
Sep 18, 2021 3:14:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-18T15:14:08.484Z: Fusing consumer Read input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource) into Read input/Impulse
Sep 18, 2021 3:14:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-18T15:14:08.511Z: Fusing consumer Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction into Read input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource)
Sep 18, 2021 3:14:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-18T15:14:08.534Z: Fusing consumer Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/SplitWithSizing into Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction
Sep 18, 2021 3:14:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-18T15:14:08.570Z: Fusing consumer Collect start time metrics (input)/ParMultiDo(TimeMonitor) into Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/ProcessElementAndRestrictionWithSizing
Sep 18, 2021 3:14:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-18T15:14:08.605Z: Fusing consumer Window.Into()/Window.Assign into Collect start time metrics (input)/ParMultiDo(TimeMonitor)
Sep 18, 2021 3:14:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-18T15:14:08.627Z: Fusing consumer CoGroupByKey/MakeUnionTable0/ParMultiDo(ConstructUnionTable) into Window.Into()/Window.Assign
Sep 18, 2021 3:14:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-18T15:14:08.659Z: Fusing consumer Read co-input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource) into Read co-input/Impulse
Sep 18, 2021 3:14:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-18T15:14:08.696Z: Fusing consumer Read-co-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction into Read co-input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource)
Sep 18, 2021 3:14:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-18T15:14:08.728Z: Fusing consumer Read-co-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/SplitWithSizing into Read-co-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction
Sep 18, 2021 3:14:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-18T15:14:08.763Z: Fusing consumer Collect start time metrics (co-input)/ParMultiDo(TimeMonitor) into Read-co-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/ProcessElementAndRestrictionWithSizing
Sep 18, 2021 3:14:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-18T15:14:08.794Z: Fusing consumer Window.Into()2/Window.Assign into Collect start time metrics (co-input)/ParMultiDo(TimeMonitor)
Sep 18, 2021 3:14:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-18T15:14:08.822Z: Fusing consumer CoGroupByKey/MakeUnionTable1/ParMultiDo(ConstructUnionTable) into Window.Into()2/Window.Assign
Sep 18, 2021 3:14:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-18T15:14:09.184Z: Executing operation Read co-input/Impulse+Read co-input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource)+Read-co-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction+Read-co-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/SplitWithSizing
Sep 18, 2021 3:14:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-18T15:14:09.217Z: Executing operation Read input/Impulse+Read input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource)+Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction+Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/SplitWithSizing
Sep 18, 2021 3:14:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-18T15:14:09.258Z: Starting 5 ****s in us-central1-c...
Sep 18, 2021 3:14:32 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-18T15:14:31.538Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete
Sep 18, 2021 3:14:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-18T15:14:49.515Z: Autoscaling: Raised the number of ****s to 1 based on the rate of progress in the currently running stage(s).
Sep 18, 2021 3:14:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-18T15:14:49.552Z: Resized **** pool to 1, though goal was 5. This could be a quota issue.
Sep 18, 2021 3:15:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-18T15:14:59.836Z: Autoscaling: Raised the number of ****s to 5 based on the rate of progress in the currently running stage(s).
Sep 18, 2021 3:15:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-18T15:15:52.692Z: Workers have started successfully.
Sep 18, 2021 3:15:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-18T15:15:52.743Z: Workers have started successfully.
Sep 18, 2021 3:17:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-09-18T15:17:15.525Z: Staged package beam-vendor-grpc-1_36_0-0.2-2X-EhRNYA0GgyvffOgWohko1OyyyPyTMuiHHvaPG9es.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/beam-vendor-grpc-1_36_0-0.2-2X-EhRNYA0GgyvffOgWohko1OyyyPyTMuiHHvaPG9es.jar' is inaccessible.
Sep 18, 2021 3:17:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-09-18T15:17:19.584Z: One or more access checks for temp location or staged files failed. Please refer to other error messages for details. For more information on security and permissions, please see https://cloud.google.com/dataflow/security-and-permissions.
Sep 18, 2021 3:20:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-09-18T15:20:12.330Z: One or more access checks for temp location or staged files failed. Please refer to other error messages for details. For more information on security and permissions, please see https://cloud.google.com/dataflow/security-and-permissions.
Sep 18, 2021 3:23:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-09-18T15:23:09.979Z: Staged package beam-vendor-grpc-1_36_0-0.2-2X-EhRNYA0GgyvffOgWohko1OyyyPyTMuiHHvaPG9es.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/beam-vendor-grpc-1_36_0-0.2-2X-EhRNYA0GgyvffOgWohko1OyyyPyTMuiHHvaPG9es.jar' is inaccessible.
Sep 18, 2021 3:23:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-09-18T15:23:12.915Z: One or more access checks for temp location or staged files failed. Please refer to other error messages for details. For more information on security and permissions, please see https://cloud.google.com/dataflow/security-and-permissions.
Sep 18, 2021 3:26:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-09-18T15:26:15.366Z: One or more access checks for temp location or staged files failed. Please refer to other error messages for details. For more information on security and permissions, please see https://cloud.google.com/dataflow/security-and-permissions.
Sep 18, 2021 3:29:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-09-18T15:29:10.045Z: Staged package beam-vendor-grpc-1_36_0-0.2-2X-EhRNYA0GgyvffOgWohko1OyyyPyTMuiHHvaPG9es.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/beam-vendor-grpc-1_36_0-0.2-2X-EhRNYA0GgyvffOgWohko1OyyyPyTMuiHHvaPG9es.jar' is inaccessible.
Sep 18, 2021 3:29:15 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-09-18T15:29:13.775Z: One or more access checks for temp location or staged files failed. Please refer to other error messages for details. For more information on security and permissions, please see https://cloud.google.com/dataflow/security-and-permissions.
Sep 18, 2021 3:32:15 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-09-18T15:32:12.953Z: One or more access checks for temp location or staged files failed. Please refer to other error messages for details. For more information on security and permissions, please see https://cloud.google.com/dataflow/security-and-permissions.
Sep 18, 2021 3:35:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-09-18T15:35:09.856Z: Staged package beam-vendor-grpc-1_36_0-0.2-2X-EhRNYA0GgyvffOgWohko1OyyyPyTMuiHHvaPG9es.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/beam-vendor-grpc-1_36_0-0.2-2X-EhRNYA0GgyvffOgWohko1OyyyPyTMuiHHvaPG9es.jar' is inaccessible.
Sep 18, 2021 3:35:15 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-09-18T15:35:12.735Z: One or more access checks for temp location or staged files failed. Please refer to other error messages for details. For more information on security and permissions, please see https://cloud.google.com/dataflow/security-and-permissions.
Sep 18, 2021 3:38:15 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-09-18T15:38:13.577Z: One or more access checks for temp location or staged files failed. Please refer to other error messages for details. For more information on security and permissions, please see https://cloud.google.com/dataflow/security-and-permissions.
Sep 18, 2021 3:41:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-09-18T15:41:09.914Z: Staged package beam-vendor-grpc-1_36_0-0.2-2X-EhRNYA0GgyvffOgWohko1OyyyPyTMuiHHvaPG9es.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/beam-vendor-grpc-1_36_0-0.2-2X-EhRNYA0GgyvffOgWohko1OyyyPyTMuiHHvaPG9es.jar' is inaccessible.
Sep 18, 2021 3:41:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-09-18T15:41:12.654Z: One or more access checks for temp location or staged files failed. Please refer to other error messages for details. For more information on security and permissions, please see https://cloud.google.com/dataflow/security-and-permissions.
Sep 18, 2021 3:44:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-09-18T15:44:16.866Z: One or more access checks for temp location or staged files failed. Please refer to other error messages for details. For more information on security and permissions, please see https://cloud.google.com/dataflow/security-and-permissions.
Sep 18, 2021 3:47:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-09-18T15:47:10.046Z: Staged package beam-vendor-grpc-1_36_0-0.2-2X-EhRNYA0GgyvffOgWohko1OyyyPyTMuiHHvaPG9es.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/beam-vendor-grpc-1_36_0-0.2-2X-EhRNYA0GgyvffOgWohko1OyyyPyTMuiHHvaPG9es.jar' is inaccessible.
Sep 18, 2021 3:47:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-09-18T15:47:13.363Z: One or more access checks for temp location or staged files failed. Please refer to other error messages for details. For more information on security and permissions, please see https://cloud.google.com/dataflow/security-and-permissions.
Sep 18, 2021 3:50:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-09-18T15:50:12.965Z: One or more access checks for temp location or staged files failed. Please refer to other error messages for details. For more information on security and permissions, please see https://cloud.google.com/dataflow/security-and-permissions.
Sep 18, 2021 3:53:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-09-18T15:53:10.503Z: Staged package beam-vendor-grpc-1_36_0-0.2-2X-EhRNYA0GgyvffOgWohko1OyyyPyTMuiHHvaPG9es.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/beam-vendor-grpc-1_36_0-0.2-2X-EhRNYA0GgyvffOgWohko1OyyyPyTMuiHHvaPG9es.jar' is inaccessible.
Sep 18, 2021 3:53:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-09-18T15:53:14.054Z: One or more access checks for temp location or staged files failed. Please refer to other error messages for details. For more information on security and permissions, please see https://cloud.google.com/dataflow/security-and-permissions.
Sep 18, 2021 3:56:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-09-18T15:56:12.962Z: One or more access checks for temp location or staged files failed. Please refer to other error messages for details. For more information on security and permissions, please see https://cloud.google.com/dataflow/security-and-permissions.
Sep 18, 2021 3:59:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-09-18T15:59:10.204Z: Staged package beam-vendor-grpc-1_36_0-0.2-2X-EhRNYA0GgyvffOgWohko1OyyyPyTMuiHHvaPG9es.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/beam-vendor-grpc-1_36_0-0.2-2X-EhRNYA0GgyvffOgWohko1OyyyPyTMuiHHvaPG9es.jar' is inaccessible.
Sep 18, 2021 3:59:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-09-18T15:59:13.497Z: One or more access checks for temp location or staged files failed. Please refer to other error messages for details. For more information on security and permissions, please see https://cloud.google.com/dataflow/security-and-permissions.
Sep 18, 2021 4:02:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-09-18T16:02:13.783Z: One or more access checks for temp location or staged files failed. Please refer to other error messages for details. For more information on security and permissions, please see https://cloud.google.com/dataflow/security-and-permissions.
Sep 18, 2021 4:05:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-09-18T16:05:09.921Z: Staged package beam-vendor-grpc-1_36_0-0.2-2X-EhRNYA0GgyvffOgWohko1OyyyPyTMuiHHvaPG9es.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/beam-vendor-grpc-1_36_0-0.2-2X-EhRNYA0GgyvffOgWohko1OyyyPyTMuiHHvaPG9es.jar' is inaccessible.
Sep 18, 2021 4:05:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-09-18T16:05:12.849Z: One or more access checks for temp location or staged files failed. Please refer to other error messages for details. For more information on security and permissions, please see https://cloud.google.com/dataflow/security-and-permissions.
Sep 18, 2021 4:08:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-09-18T16:08:12.964Z: One or more access checks for temp location or staged files failed. Please refer to other error messages for details. For more information on security and permissions, please see https://cloud.google.com/dataflow/security-and-permissions.
Sep 18, 2021 4:11:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-09-18T16:11:10.220Z: Staged package beam-vendor-grpc-1_36_0-0.2-2X-EhRNYA0GgyvffOgWohko1OyyyPyTMuiHHvaPG9es.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/beam-vendor-grpc-1_36_0-0.2-2X-EhRNYA0GgyvffOgWohko1OyyyPyTMuiHHvaPG9es.jar' is inaccessible.
Sep 18, 2021 4:11:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-09-18T16:11:12.946Z: One or more access checks for temp location or staged files failed. Please refer to other error messages for details. For more information on security and permissions, please see https://cloud.google.com/dataflow/security-and-permissions.
Sep 18, 2021 4:14:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-09-18T16:14:09.719Z: Workflow failed. Causes: The Dataflow job appears to be stuck because no **** activity has been seen in the last 1h. Please check the **** logs in Stackdriver Logging. You can also get help with Cloud Dataflow at https://cloud.google.com/dataflow/support.
Sep 18, 2021 4:14:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-18T16:14:09.743Z: Cancel request is committed for workflow job: 2021-09-18_08_13_54-2851594673609526406.
Sep 18, 2021 4:14:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-09-18T16:14:09.764Z: The Dataflow job appears to be stuck because no **** activity has been seen in the last 1h. Please check the **** logs in Stackdriver Logging. You can also get help with Cloud Dataflow at https://cloud.google.com/dataflow/support.
Sep 18, 2021 4:14:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-09-18T16:14:09.813Z: Unable to delete temp files: "gs://temp-storage-for-perf-tests/loadtests/dax-tmp-2021-09-18_08_13_54-2851594673609526406-S02-0-937913a485d8a869/tmp-937913a485d8a270@DAX.sdfmeta."
Sep 18, 2021 4:14:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-09-18T16:14:09.829Z: S02:Read input/Impulse+Read input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource)+Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction+Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/SplitWithSizing failed.
Sep 18, 2021 4:14:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-09-18T16:14:09.837Z: Unable to delete temp files: "gs://temp-storage-for-perf-tests/loadtests/dax-tmp-2021-09-18_08_13_54-2851594673609526406-S01-0-d67017e7e62950f9/tmp-d67017e7e6295a94@DAX.sdfmeta."
Sep 18, 2021 4:14:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-18T16:14:09.845Z: Finished operation Read input/Impulse+Read input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource)+Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction+Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/SplitWithSizing
Sep 18, 2021 4:14:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-09-18T16:14:09.865Z: S01:Read co-input/Impulse+Read co-input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource)+Read-co-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction+Read-co-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/SplitWithSizing failed.
Sep 18, 2021 4:14:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-18T16:14:09.890Z: Finished operation Read co-input/Impulse+Read co-input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource)+Read-co-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction+Read-co-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/SplitWithSizing
Sep 18, 2021 4:14:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-09-18T16:14:12.693Z: One or more access checks for temp location or staged files failed. Please refer to other error messages for details. For more information on security and permissions, please see https://cloud.google.com/dataflow/security-and-permissions.
Sep 18, 2021 4:14:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-18T16:14:12.719Z: Cleaning up.
Sep 18, 2021 4:14:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-18T16:14:12.791Z: Stopping **** pool...
Sep 18, 2021 4:16:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-18T16:16:35.195Z: Autoscaling: Resized **** pool from 5 to 0.
Sep 18, 2021 4:16:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-09-18T16:16:35.232Z: Worker pool stopped.
Sep 18, 2021 4:17:23 PM org.apache.beam.runners.dataflow.DataflowPipelineJob logTerminalState
INFO: Job 2021-09-18_08_13_54-2851594673609526406 failed with status FAILED.
Sep 18, 2021 4:17:23 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric totalBytes.count, from namespace co_gbk
Load test results for test (ID): 62edb5ed-6f56-4251-ab5c-353828545e3f and timestamp: 2021-09-18T15:13:49.649000000Z:
Metric: Value:
dataflow_v2_java11_runtime_sec 0.0
dataflow_v2_java11_total_bytes_count -1.0
Exception in thread "main" java.lang.RuntimeException: Invalid job state: FAILED.
at org.apache.beam.sdk.loadtests.JobFailure.handleFailure(JobFailure.java:55)
at org.apache.beam.sdk.loadtests.LoadTest.run(LoadTest.java:141)
at org.apache.beam.sdk.loadtests.CoGroupByKeyLoadTest.run(CoGroupByKeyLoadTest.java:62)
at org.apache.beam.sdk.loadtests.CoGroupByKeyLoadTest.main(CoGroupByKeyLoadTest.java:157)
> Task :sdks:java:testing:load-tests:run FAILED
> Task :runners:google-cloud-dataflow-java:cleanUpDockerImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210918151319
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:5b85133c4b5c444eb44d402a5cf4dbb28bab5814edc2abbfe6314081a3e2674b
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210918151319]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:5b85133c4b5c444eb44d402a5cf4dbb28bab5814edc2abbfe6314081a3e2674b]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210918151319] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:5b85133c4b5c444eb44d402a5cf4dbb28bab5814edc2abbfe6314081a3e2674b])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:5b85133c4b5c444eb44d402a5cf4dbb28bab5814edc2abbfe6314081a3e2674b
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:5b85133c4b5c444eb44d402a5cf4dbb28bab5814edc2abbfe6314081a3e2674b
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:5b85133c4b5c444eb44d402a5cf4dbb28bab5814edc2abbfe6314081a3e2674b].
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:testing:load-tests:run'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1h 4m 8s
96 actionable tasks: 8 executed, 88 up-to-date
Publishing build scan...
https://gradle.com/s/vjj25dhhadyxe
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal :
beam_LoadTests_Java_CoGBK_Dataflow_V2_Batch_Java11 #94
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Java_CoGBK_Dataflow_V2_Batch_Java11/94/display/redirect>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org