You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2021/08/10 16:03:28 UTC
Build failed in Jenkins:
beam_LoadTests_Java_ParDo_Dataflow_V2_Streaming_Java11 #54
See <https://ci-beam.apache.org/job/beam_LoadTests_Java_ParDo_Dataflow_V2_Streaming_Java11/54/display/redirect?page=changes>
Changes:
[heejong] [BEAM-12716] Update XLang Kafka taxi example to use BigQuery sink
[noreply] Merge pull request #15298 from [BEAM-12729] Suppress Avro Runtime
[heejong] add comment
[noreply] Refactor _RemoveDuplicates to use counter state (#15242)
------------------------------------------
[...truncated 67.40 KB...]
f3d5b8f65132: Preparing
ad83f0aa5c0a: Preparing
5a9a65095453: Preparing
4b0edb23340c: Preparing
afa3e488a0ee: Preparing
369f39df5c35: Waiting
6e843723294b: Waiting
f42aed5f7feb: Waiting
ad83f0aa5c0a: Waiting
46853327f1f4: Waiting
89819bafde36: Waiting
fbb29adc0725: Waiting
2b80fd633bcd: Waiting
5a9a65095453: Waiting
4b90654ecd31: Waiting
f3d5b8f65132: Waiting
afa3e488a0ee: Waiting
8bff3a95207a: Pushed
590dda0c6066: Pushed
f7e161b5fb4f: Pushed
11d21f68310d: Pushed
db7f7670f963: Pushed
fbb29adc0725: Pushed
6e843723294b: Pushed
369f39df5c35: Pushed
f42aed5f7feb: Layer already exists
89819bafde36: Layer already exists
f3d5b8f65132: Layer already exists
ad83f0aa5c0a: Layer already exists
5a9a65095453: Layer already exists
4b0edb23340c: Layer already exists
afa3e488a0ee: Layer already exists
46853327f1f4: Pushed
4b90654ecd31: Pushed
2b80fd633bcd: Pushed
091014b933eb: Pushed
20210810123753: digest: sha256:a1ad33643b5ff2505449bc7a019587a04f3a1c8bab6267ad3716f97a5c1bd046 size: 4310
> Task :sdks:java:testing:load-tests:run
Aug 10, 2021 12:42:58 PM org.apache.beam.runners.dataflow.options.DataflowPipelineOptions$StagingLocationFactory create
INFO: No stagingLocation provided, falling back to gcpTempLocation
Aug 10, 2021 12:42:58 PM org.apache.beam.runners.dataflow.DataflowRunner fromOptions
INFO: PipelineOptions.filesToStage was not specified. Defaulting to files from the classpath: will stage 191 files. Enable logging at DEBUG level to see which files will be staged.
Aug 10, 2021 12:42:59 PM org.apache.beam.sdk.Pipeline validate
WARNING: The following transforms do not have stable unique names: ParDo(TimeMonitor)
Aug 10, 2021 12:42:59 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Executing pipeline on the Dataflow Service, which will have billing implications related to Google Compute Engine usage and other Google Cloud Services.
Aug 10, 2021 12:43:02 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging portable pipeline proto to gs://temp-storage-for-perf-tests/loadtests/staging/
Aug 10, 2021 12:43:02 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <107856 bytes, hash 76a67524ac4571381af97fa16b159b5d4b152783cf8fed8c71e8ec61001e9eaa> to gs://temp-storage-for-perf-tests/loadtests/staging/pipeline-dqZ1JKxFcTga-X-haxWbXUsVJ4PPj-2McejsYQAenqo.pb
Aug 10, 2021 12:43:03 PM org.apache.beam.runners.dataflow.util.PackageUtil stageClasspathElements
INFO: Uploading 191 files from PipelineOptions.filesToStage to staging location to prepare for execution.
Aug 10, 2021 12:43:04 PM org.apache.beam.runners.dataflow.util.PackageUtil stageClasspathElements
INFO: Staging files complete: 191 files cached, 0 files newly uploaded in 0 seconds
Aug 10, 2021 12:43:04 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Read input/DataflowRunner.StreamingUnboundedRead.ReadWithIds as step s1
Aug 10, 2021 12:43:04 PM org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource split
INFO: Split into 20 bundles of sizes: [org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@118ffcfd, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@53f4c1e6, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@74174a23, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@6342d610, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@dc4a691, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@784abd3e, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@36c2b646, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@434514d8, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@6b1dc20f, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@4613311f, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@6540cf1d, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@ec8f4b9, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@bc042d5, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@5484117b, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@37df14d1, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@7efb53af, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@7724704f, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@3dfa819, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@4ce94d2f, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@68ab0936]
Aug 10, 2021 12:43:04 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Read input/StripIds as step s2
Aug 10, 2021 12:43:04 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding ParDo(TimeMonitor) as step s3
Aug 10, 2021 12:43:04 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding ParDo(ByteMonitor) as step s4
Aug 10, 2021 12:43:04 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 0 as step s5
Aug 10, 2021 12:43:04 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 1 as step s6
Aug 10, 2021 12:43:04 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 2 as step s7
Aug 10, 2021 12:43:04 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 3 as step s8
Aug 10, 2021 12:43:04 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 4 as step s9
Aug 10, 2021 12:43:04 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 5 as step s10
Aug 10, 2021 12:43:04 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 6 as step s11
Aug 10, 2021 12:43:04 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 7 as step s12
Aug 10, 2021 12:43:04 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 8 as step s13
Aug 10, 2021 12:43:04 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 9 as step s14
Aug 10, 2021 12:43:04 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding ParDo(TimeMonitor)2 as step s15
Aug 10, 2021 12:43:04 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Dataflow SDK version: 2.33.0-SNAPSHOT
Aug 10, 2021 12:43:05 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobs/us-central1/2021-08-10_05_43_04-7197560437598864118?project=apache-beam-testing
Aug 10, 2021 12:43:05 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Submitted job: 2021-08-10_05_43_04-7197560437598864118
Aug 10, 2021 12:43:05 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2021-08-10_05_43_04-7197560437598864118
Aug 10, 2021 12:43:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-08-10T12:43:11.585Z: The workflow name is not a valid Cloud Label. Labels applied to Cloud resources (such as GCE Instances) for monitoring will be labeled with this modified job name: load0tests0java110dataflow0v20streaming0pardo01-jenkins-08-gm5v. For the best monitoring experience, please name your job with a valid Cloud Label. For details, see: https://cloud.google.com/compute/docs/labeling-resources#restrictions
Aug 10, 2021 12:43:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-10T12:43:15.704Z: Worker configuration: e2-standard-2 in us-central1-a.
Aug 10, 2021 12:43:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-10T12:43:16.355Z: Expanding SplittableParDo operations into optimizable parts.
Aug 10, 2021 12:43:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-10T12:43:16.379Z: Expanding CollectionToSingleton operations into optimizable parts.
Aug 10, 2021 12:43:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-10T12:43:16.450Z: Expanding CoGroupByKey operations into optimizable parts.
Aug 10, 2021 12:43:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-10T12:43:16.487Z: Expanding SplittableProcessKeyed operations into optimizable parts.
Aug 10, 2021 12:43:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-10T12:43:16.523Z: Expanding GroupByKey operations into streaming Read/Write steps
Aug 10, 2021 12:43:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-10T12:43:16.546Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
Aug 10, 2021 12:43:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-10T12:43:16.599Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
Aug 10, 2021 12:43:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-10T12:43:16.631Z: Fusing consumer Read input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource) into Read input/Impulse
Aug 10, 2021 12:43:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-10T12:43:16.653Z: Fusing consumer Read-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/PairWithRestriction into Read input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource)
Aug 10, 2021 12:43:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-10T12:43:16.687Z: Fusing consumer Read-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/SplitWithSizing into Read-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/PairWithRestriction
Aug 10, 2021 12:43:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-10T12:43:16.736Z: Fusing consumer Read input/ParDo(StripIds)/ParMultiDo(StripIds) into Read-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/ProcessElementAndRestrictionWithSizing
Aug 10, 2021 12:43:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-10T12:43:16.777Z: Fusing consumer ParDo(TimeMonitor)/ParMultiDo(TimeMonitor) into Read input/ParDo(StripIds)/ParMultiDo(StripIds)
Aug 10, 2021 12:43:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-10T12:43:16.812Z: Fusing consumer ParDo(ByteMonitor)/ParMultiDo(ByteMonitor) into ParDo(TimeMonitor)/ParMultiDo(TimeMonitor)
Aug 10, 2021 12:43:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-10T12:43:16.837Z: Fusing consumer Step: 0/ParMultiDo(CounterOperation) into ParDo(ByteMonitor)/ParMultiDo(ByteMonitor)
Aug 10, 2021 12:43:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-10T12:43:16.858Z: Fusing consumer Step: 1/ParMultiDo(CounterOperation) into Step: 0/ParMultiDo(CounterOperation)
Aug 10, 2021 12:43:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-10T12:43:16.881Z: Fusing consumer Step: 2/ParMultiDo(CounterOperation) into Step: 1/ParMultiDo(CounterOperation)
Aug 10, 2021 12:43:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-10T12:43:16.907Z: Fusing consumer Step: 3/ParMultiDo(CounterOperation) into Step: 2/ParMultiDo(CounterOperation)
Aug 10, 2021 12:43:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-10T12:43:16.942Z: Fusing consumer Step: 4/ParMultiDo(CounterOperation) into Step: 3/ParMultiDo(CounterOperation)
Aug 10, 2021 12:43:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-10T12:43:16.977Z: Fusing consumer Step: 5/ParMultiDo(CounterOperation) into Step: 4/ParMultiDo(CounterOperation)
Aug 10, 2021 12:43:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-10T12:43:17.010Z: Fusing consumer Step: 6/ParMultiDo(CounterOperation) into Step: 5/ParMultiDo(CounterOperation)
Aug 10, 2021 12:43:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-10T12:43:17.043Z: Fusing consumer Step: 7/ParMultiDo(CounterOperation) into Step: 6/ParMultiDo(CounterOperation)
Aug 10, 2021 12:43:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-10T12:43:17.065Z: Fusing consumer Step: 8/ParMultiDo(CounterOperation) into Step: 7/ParMultiDo(CounterOperation)
Aug 10, 2021 12:43:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-10T12:43:17.097Z: Fusing consumer Step: 9/ParMultiDo(CounterOperation) into Step: 8/ParMultiDo(CounterOperation)
Aug 10, 2021 12:43:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-10T12:43:17.120Z: Fusing consumer ParDo(TimeMonitor)2/ParMultiDo(TimeMonitor) into Step: 9/ParMultiDo(CounterOperation)
Aug 10, 2021 12:43:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-10T12:43:17.440Z: Starting 5 ****s in us-central1-a...
Aug 10, 2021 12:43:40 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-10T12:43:40.460Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete
Aug 10, 2021 12:44:02 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-10T12:44:01.858Z: Autoscaling: Raised the number of ****s to 5 so that the pipeline can catch up with its backlog and keep up with its input rate.
Aug 10, 2021 12:44:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-10T12:44:52.715Z: Workers have started successfully.
Aug 10, 2021 12:44:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-10T12:44:52.746Z: Workers have started successfully.
Aug 10, 2021 4:01:02 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-10T16:01:02.726Z: Cancel request is committed for workflow job: 2021-08-10_05_43_04-7197560437598864118.
Aug 10, 2021 4:01:02 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-10T16:01:02.826Z: Cleaning up.
Aug 10, 2021 4:01:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-10T16:01:02.942Z: Stopping **** pool...
Aug 10, 2021 4:01:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-10T16:01:02.987Z: Stopping **** pool...
Aug 10, 2021 4:03:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-10T16:03:16.675Z: Autoscaling: Reduced the number of ****s to 0 based on low average **** CPU utilization, and the pipeline having sufficiently low backlog and keeping up with input rate.
Aug 10, 2021 4:03:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-10T16:03:16.716Z: Worker pool stopped.
Aug 10, 2021 4:03:22 PM org.apache.beam.runners.dataflow.DataflowPipelineJob logTerminalState
INFO: Job 2021-08-10_05_43_04-7197560437598864118 finished with status CANCELLED.
Aug 10, 2021 4:03:22 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
Load test results for test (ID): 32e7079f-fb50-4e1b-b7eb-e57a03da1f90 and timestamp: 2021-08-10T12:42:58.820000000Z:SEVERE: Failed to get metric totalBytes.count, from namespace pardo
Metric: Value:
dataflow_v2_java11_runtime_sec 0.0
dataflow_v2_java11_total_bytes_count -1.0
Exception in thread "main" java.lang.RuntimeException: Invalid job state: CANCELLED.
at org.apache.beam.sdk.loadtests.JobFailure.handleFailure(JobFailure.java:55)
at org.apache.beam.sdk.loadtests.LoadTest.run(LoadTest.java:141)
at org.apache.beam.sdk.loadtests.ParDoLoadTest.run(ParDoLoadTest.java:53)
at org.apache.beam.sdk.loadtests.ParDoLoadTest.main(ParDoLoadTest.java:103)
> Task :sdks:java:testing:load-tests:run FAILED
> Task :runners:google-cloud-dataflow-java:cleanUpDockerImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210810123753
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:a1ad33643b5ff2505449bc7a019587a04f3a1c8bab6267ad3716f97a5c1bd046
Deleted: sha256:61664275773c80b0544ecc83fa3a403a33e784ec22665483625acd17dc0eaf91
Deleted: sha256:1d226abbaed28c35ccec638a2b186bec5b7259051379380d84d229388508398d
Deleted: sha256:958f83a865666eb033a38bedff2f33b329a36e58b84ac9689c9592ea8ce1a7e8
Deleted: sha256:d050118454e5d4c2a788905f1faaee639d31fe620a5450c7f4c80352b1f2dbc9
Deleted: sha256:360912e7998e2949111b1b40f4f5d547e20a8ba490f0447734ff6a31e9c0fccc
Deleted: sha256:8161049358ddc2548caaa43e911e4d3d827f0d4e1cf880469154672206b69e1f
Deleted: sha256:6b85604d8b7038c55b380a5a6810945eb6a58ae09233ba934568d94a9ee80944
Deleted: sha256:384d304281c39ea372596b82301524d223d370ed03a15a20215c29145ca48bd7
Deleted: sha256:b4ed3b8c38dd01bea7d2192c1b7aefadc81d5233d3713643fa591c064e7f97e4
Deleted: sha256:06676dac0bce7a5a5196d3525a041314c8cccf03fde3cf3472e3aa02dce04ee8
Deleted: sha256:4dd289dab4f700f5e2eeb1ea325d0057221383c969a5cfe731a51cfc992b00ef
Deleted: sha256:7dcaef3fe25d50c9544a0463fe43a2382587ff397d5aa2b2adebe173d414a185
Deleted: sha256:f4c327788cf8188bfef72f4ea499de01cac0b0e866a23f5ec6b9b8e62f5acfca
Deleted: sha256:b71c8bb9ac64b5149eb15e780687cbb915116bd29c47eb6b962abd09be824776
Deleted: sha256:8681f22d312aa25f04f2567c0111c43158a001180977e7ec8bae96206edc2720
Deleted: sha256:79e99da927eab17e3c85b53e44c35814bee7ade796009497dd25726ca6ffc52c
Deleted: sha256:2326c70723a5ecf89ed0d409a851e97425cbc2ba98917eed634033221bc2e5b9
Deleted: sha256:790c102e5b55de2a9e6c1a878fcab2934ed70b6294d5592cc6237a6d57326361
Deleted: sha256:105753978202b95906bf01c475fecdff361b0951e56d58056ec56df814738049
Deleted: sha256:58d58e8a3ad3e2ffc2b4bab59563a278d4a755f9a835f7cc4c678862a0861457
Deleted: sha256:2954a556b6e3df09752fe2d24c1f693a620dbd1927cc8a1283783597c72b78d9
Deleted: sha256:a84eb5e814910fef3683dfc01f3ea26421dff4a7f39478b586e350b4134301ca
Deleted: sha256:97567100682dcb3689577572fc1be5ce27ed67dff2866c49644a273e4e37897b
Deleted: sha256:5f3fa5b7f8b0f5428eb80dbbdc532f07da905f51d0d6fa9efa016d8e52ea1150
Deleted: sha256:a5dddbb420c2a711376a84bc2b4d05bf5431512edde712758a22f95111b5d2f8
Deleted: sha256:158fecb7ebf22ccc43224e6da76272655b79a3607bd67fc218f2699bfca69646
Deleted: sha256:3c27c7bd278b5165633d0013f18585b84564cdefed620359fc322aa956568233
Deleted: sha256:daab8e0d22a2369e269426f462c5fa30aa0fd5a92e5a064892d207669453f3d0
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210810123753]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:a1ad33643b5ff2505449bc7a019587a04f3a1c8bab6267ad3716f97a5c1bd046]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210810123753] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:a1ad33643b5ff2505449bc7a019587a04f3a1c8bab6267ad3716f97a5c1bd046])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:a1ad33643b5ff2505449bc7a019587a04f3a1c8bab6267ad3716f97a5c1bd046
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:a1ad33643b5ff2505449bc7a019587a04f3a1c8bab6267ad3716f97a5c1bd046
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:a1ad33643b5ff2505449bc7a019587a04f3a1c8bab6267ad3716f97a5c1bd046].
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:testing:load-tests:run'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 3h 25m 47s
107 actionable tasks: 79 executed, 26 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/yltx6prwyj5tw
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal :
beam_LoadTests_Java_ParDo_Dataflow_V2_Streaming_Java11 #61
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Java_ParDo_Dataflow_V2_Streaming_Java11/61/display/redirect?page=changes>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
beam_LoadTests_Java_ParDo_Dataflow_V2_Streaming_Java11 - Build # 60
- Aborted!
Posted by Apache Jenkins Server <je...@builds.apache.org>.
beam_LoadTests_Java_ParDo_Dataflow_V2_Streaming_Java11 - Build # 60 - Aborted:
Check console output at https://ci-beam.apache.org/job/beam_LoadTests_Java_ParDo_Dataflow_V2_Streaming_Java11/60/ to view the results.
Build failed in Jenkins:
beam_LoadTests_Java_ParDo_Dataflow_V2_Streaming_Java11 #59
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Java_ParDo_Dataflow_V2_Streaming_Java11/59/display/redirect>
Changes:
------------------------------------------
[...truncated 27.32 KB...]
> Task :sdks:java:core:classes
> Task :sdks:java:core:shadowJar FROM-CACHE
> Task :sdks:java:fn-execution:compileJava FAILED
> Task :sdks:java:extensions:arrow:compileJava FAILED
> Task :sdks:java:io:kinesis:compileJava FAILED
> Task :sdks:java:extensions:protobuf:extractIncludeProto FAILED
> Task :sdks:java:testing:test-utils:compileJava FAILED
> Task :sdks:java:io:synthetic:compileJava FAILED
> Task :sdks:java:container:generateLicenseReport FAILED
> Task :release:go-licenses:java:dockerRun
+ rm -rf '/output/*'
+ export GO111MODULE=off
+ GO111MODULE=off
+ go get github.com/apache/beam/sdks/java/container
> Task :sdks:go:resolveBuildDependencies
Resolving cloud.google.com/go: commit='03869a08dc16b35ad4968e92d34c5a2a2961b205', urls=[https://code.googlesource.com/gocloud]
Resolving github.com/Shopify/sarama: commit='541689b9f4212043471eb537fa72da507025d3ea', urls=[https://github.com/Shopify/sarama.git, git@github.com:Shopify/sarama.git]
Resolving github.com/armon/consul-api: commit='eb2c6b5be1b66bab83016e0b05f01b8d5496ffbd', urls=[https://github.com/armon/consul-api.git, git@github.com:armon/consul-api.git]
Resolving github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, git@github.com:etcd-io/etcd.git]
Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, git@github.com:etcd-io/etcd.git]
Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, git@github.com:etcd-io/etcd.git]
Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, git@github.com:etcd-io/etcd.git]
Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, git@github.com:etcd-io/etcd.git]
Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, git@github.com:etcd-io/etcd.git]
Resolving github.com/cpuguy83/go-md2man: commit='dc9f53734905c233adfc09fd4f063dce63ce3daf', urls=[https://github.com/cpuguy83/go-md2man.git, git@github.com:cpuguy83/go-md2man.git]
Resolving github.com/davecgh/go-spew: commit='87df7c60d5820d0f8ae11afede5aa52325c09717', urls=[https://github.com/davecgh/go-spew.git, git@github.com:davecgh/go-spew.git]
Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, git@github.com:etcd-io/etcd.git]
Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, git@github.com:etcd-io/etcd.git]
Resolving github.com/eapache/go-resiliency: commit='ef9aaa7ea8bd2448429af1a77cf41b2b3b34bdd6', urls=[https://github.com/eapache/go-resiliency.git, git@github.com:eapache/go-resiliency.git]
Resolving github.com/eapache/go-xerial-snappy: commit='bb955e01b9346ac19dc29eb16586c90ded99a98c', urls=[https://github.com/eapache/go-xerial-snappy.git, git@github.com:eapache/go-xerial-snappy.git]
Resolving github.com/eapache/queue: commit='44cc805cf13205b55f69e14bcb69867d1ae92f98', urls=[https://github.com/eapache/queue.git, git@github.com:eapache/queue.git]
Resolving github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, git@github.com:etcd-io/etcd.git]
Resolving github.com/fsnotify/fsnotify: commit='c2828203cd70a50dcccfb2761f8b1f8ceef9a8e9', urls=[https://github.com/fsnotify/fsnotify.git, git@github.com:fsnotify/fsnotify.git]
Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, git@github.com:etcd-io/etcd.git]
Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, git@github.com:etcd-io/etcd.git]
Resolving github.com/golang/glog: commit='23def4e6c14b4da8ac2ed8007337bc5eb5007998', urls=[https://github.com/golang/glog.git, git@github.com:golang/glog.git]
Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, git@github.com:etcd-io/etcd.git]
Resolving github.com/golang/mock: commit='b3e60bcdc577185fce3cf625fc96b62857ce5574', urls=[https://github.com/golang/mock.git, git@github.com:golang/mock.git]
Resolving github.com/golang/protobuf: commit='d04d7b157bb510b1e0c10132224b616ac0e26b17', urls=[https://github.com/golang/protobuf.git, git@github.com:golang/protobuf.git]
Resolving github.com/golang/snappy: commit='553a641470496b2327abcac10b36396bd98e45c9', urls=[https://github.com/golang/snappy.git, git@github.com:golang/snappy.git]
Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, git@github.com:etcd-io/etcd.git]
Resolving github.com/google/go-cmp: commit='9680bfaf28748393e28e00238d94070fb9972fd8', urls=[https://github.com/google/go-cmp.git, git@github.com:google/go-cmp.git]
Resolving github.com/google/pprof: commit='a8f279b7952b27edbcb72e5a6c69ee9be4c8ad93', urls=[https://github.com/google/pprof.git, git@github.com:google/pprof.git]
Resolving github.com/google/uuid: commit='bfb86fa49a73e4194d93bea18d7acfe3694438ce', urls=[https://github.com/google/uuid.git, git@github.com:google/uuid.git]
Resolving github.com/googleapis/gax-go: commit='bd5b16380fd03dc758d11cef74ba2e3bc8b0e8c2', urls=[https://github.com/googleapis/gax-go.git, git@github.com:googleapis/gax-go.git]
Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, git@github.com:etcd-io/etcd.git]
Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, git@github.com:etcd-io/etcd.git]
Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, git@github.com:etcd-io/etcd.git]
Resolving github.com/hashicorp/hcl: commit='23c074d0eceb2b8a5bfdbb271ab780cde70f05a8', urls=[https://github.com/hashicorp/hcl.git, git@github.com:hashicorp/hcl.git]
Resolving github.com/ianlancetaylor/demangle: commit='4883227f66371e02c4948937d3e2be1664d9be38', urls=[https://github.com/ianlancetaylor/demangle.git, git@github.com:ianlancetaylor/demangle.git]
Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, git@github.com:etcd-io/etcd.git]
Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, git@github.com:etcd-io/etcd.git]
Resolving github.com/kr/fs: commit='2788f0dbd16903de03cb8186e5c7d97b69ad387b', urls=[https://github.com/kr/fs.git, git@github.com:kr/fs.git]
Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, git@github.com:etcd-io/etcd.git]
Resolving github.com/linkedin/goavro: commit='94a7a9db615f35a39dd2b82089398b92fabad2ba', urls=[https://github.com/linkedin/goavro.git, git@github.com:linkedin/goavro.git]
Resolving github.com/magiconair/properties: commit='49d762b9817ba1c2e9d0c69183c2b4a8b8f1d934', urls=[https://github.com/magiconair/properties.git, git@github.com:magiconair/properties.git]
Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, git@github.com:etcd-io/etcd.git]
Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, git@github.com:etcd-io/etcd.git]
Resolving github.com/mitchellh/go-homedir: commit='b8bc1bf767474819792c23f32d8286a45736f1c6', urls=[https://github.com/mitchellh/go-homedir.git, git@github.com:mitchellh/go-homedir.git]
Resolving github.com/mitchellh/mapstructure: commit='a4e142e9c047c904fa2f1e144d9a84e6133024bc', urls=[https://github.com/mitchellh/mapstructure.git, git@github.com:mitchellh/mapstructure.git]
Resolving github.com/nightlyone/lockfile: commit='0ad87eef1443f64d3d8c50da647e2b1552851124', urls=[https://github.com/nightlyone/lockfile, git@github.com:nightlyone/lockfile.git]
Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, git@github.com:etcd-io/etcd.git]
Resolving github.com/openzipkin/zipkin-go: commit='3741243b287094fda649c7f0fa74bd51f37dc122', urls=[https://github.com/openzipkin/zipkin-go.git, git@github.com:openzipkin/zipkin-go.git]
Resolving github.com/pelletier/go-toml: commit='acdc4509485b587f5e675510c4f2c63e90ff68a8', urls=[https://github.com/pelletier/go-toml.git, git@github.com:pelletier/go-toml.git]
Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, git@github.com:etcd-io/etcd.git]
Resolving github.com/pierrec/lz4: commit='ed8d4cc3b461464e69798080a0092bd028910298', urls=[https://github.com/pierrec/lz4.git, git@github.com:pierrec/lz4.git]
Resolving github.com/pierrec/xxHash: commit='a0006b13c722f7f12368c00a3d3c2ae8a999a0c6', urls=[https://github.com/pierrec/xxHash.git, git@github.com:pierrec/xxHash.git]
Resolving github.com/pkg/errors: commit='30136e27e2ac8d167177e8a583aa4c3fea5be833', urls=[https://github.com/pkg/errors.git, git@github.com:pkg/errors.git]
Resolving github.com/pkg/sftp: commit='22e9c1ccc02fc1b9fa3264572e49109b68a86947', urls=[https://github.com/pkg/sftp.git, git@github.com:pkg/sftp.git]
Resolving github.com/prometheus/client_golang: commit='9bb6ab929dcbe1c8393cd9ef70387cb69811bd1c', urls=[https://github.com/prometheus/client_golang.git, git@github.com:prometheus/client_golang.git]
Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, git@github.com:etcd-io/etcd.git]
Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, git@github.com:etcd-io/etcd.git]
Resolving github.com/prometheus/procfs: commit='cb4147076ac75738c9a7d279075a253c0cc5acbd', urls=[https://github.com/prometheus/procfs.git, git@github.com:prometheus/procfs.git]
Resolving github.com/rcrowley/go-metrics: commit='8732c616f52954686704c8645fe1a9d59e9df7c1', urls=[https://github.com/rcrowley/go-metrics.git, git@github.com:rcrowley/go-metrics.git]
Resolving github.com/cpuguy83/go-md2man: commit='dc9f53734905c233adfc09fd4f063dce63ce3daf', urls=[https://github.com/cpuguy83/go-md2man.git, git@github.com:cpuguy83/go-md2man.git]
Resolving cached github.com/cpuguy83/go-md2man: commit='dc9f53734905c233adfc09fd4f063dce63ce3daf', urls=[https://github.com/cpuguy83/go-md2man.git, git@github.com:cpuguy83/go-md2man.git]
Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, git@github.com:etcd-io/etcd.git]
Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, git@github.com:etcd-io/etcd.git]
Resolving github.com/spf13/afero: commit='bb8f1927f2a9d3ab41c9340aa034f6b803f4359c', urls=[https://github.com/spf13/afero.git, git@github.com:spf13/afero.git]
Resolving github.com/spf13/cast: commit='acbeb36b902d72a7a4c18e8f3241075e7ab763e4', urls=[https://github.com/spf13/cast.git, git@github.com:spf13/cast.git]
Resolving github.com/spf13/cobra: commit='93959269ad99e80983c9ba742a7e01203a4c0e4f', urls=[https://github.com/spf13/cobra.git, git@github.com:spf13/cobra.git]
Resolving github.com/spf13/jwalterweatherman: commit='7c0cea34c8ece3fbeb2b27ab9b59511d360fb394', urls=[https://github.com/spf13/jwalterweatherman.git, git@github.com:spf13/jwalterweatherman.git]
Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, git@github.com:etcd-io/etcd.git]
Resolving github.com/spf13/viper: commit='aafc9e6bc7b7bb53ddaa75a5ef49a17d6e654be5', urls=[https://github.com/spf13/viper.git, git@github.com:spf13/viper.git]
Resolving github.com/stathat/go: commit='74669b9f388d9d788c97399a0824adbfee78400e', urls=[https://github.com/stathat/go.git, git@github.com:stathat/go.git]
Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, git@github.com:etcd-io/etcd.git]
Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, git@github.com:etcd-io/etcd.git]
Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, git@github.com:etcd-io/etcd.git]
Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, git@github.com:etcd-io/etcd.git]
Resolving github.com/xordataexchange/crypt: commit='b2862e3d0a775f18c7cfe02273500ae307b61218', urls=[https://github.com/xordataexchange/crypt.git, git@github.com:xordataexchange/crypt.git]
Resolving go.opencensus.io: commit='3fb168f674736c026e623310bfccb0691e6dec8a', urls=[https://github.com/census-instrumentation/opencensus-go]
Resolving golang.org/x/crypto: commit='d9133f5469342136e669e85192a26056b587f503', urls=[https://go.googlesource.com/crypto]
Resolving golang.org/x/debug: commit='95515998a8a4bd7448134b2cb5971dbeb12e0b77', urls=[https://go.googlesource.com/debug]
Resolving golang.org/x/net: commit='2fb46b16b8dda405028c50f7c7f0f9dd1fa6bfb1', urls=[https://go.googlesource.com/net]
Resolving golang.org/x/oauth2: commit='5d25da1a8d43b66f2898c444f899c7bcfd6a407e', urls=[https://go.googlesource.com/oauth2]
Resolving golang.org/x/sync: commit='fd80eb99c8f653c847d294a001bdf2a3a6f768f5', urls=[https://go.googlesource.com/sync]
Resolving golang.org/x/sys: commit='fde4db37ae7ad8191b03d30d27f258b5291ae4e3', urls=[https://go.googlesource.com/sys]
Resolving golang.org/x/text: commit='23ae387dee1f90d29a23c0e87ee0b46038fbed0e', urls=[https://go.googlesource.com/text]
Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, git@github.com:etcd-io/etcd.git]
> Task :release:go-licenses:java:dockerRun
+ go-licenses save github.com/apache/beam/sdks/java/container --save_path=/output/licenses
+ go-licenses csv github.com/apache/beam/sdks/java/container
+ tee /output/licenses/list.csv
golang.org/x/sys,https://go.googlesource.com/sys/+/refs/heads/master/LICENSE,BSD-3-Clause
github.com/golang/protobuf,https://github.com/golang/protobuf/blob/master/LICENSE,BSD-3-Clause
google.golang.org/protobuf,https://go.googlesource.com/protobuf/+/refs/heads/master/LICENSE,BSD-3-Clause
google.golang.org/grpc,https://github.com/grpc/grpc-go/blob/master/LICENSE,Apache-2.0
golang.org/x/net,https://go.googlesource.com/net/+/refs/heads/master/LICENSE,BSD-3-Clause
github.com/apache/beam/sdks/java/container,https://github.com/apache/beam/blob/master/LICENSE,Apache-2.0
github.com/apache/beam/sdks/go/pkg/beam,https://github.com/apache/beam/blob/master/sdks/go/README.md,Apache-2.0
google.golang.org/genproto/googleapis/rpc/status,https://github.com/googleapis/go-genproto/blob/master/LICENSE,Apache-2.0
golang.org/x/text,https://go.googlesource.com/text/+/refs/heads/master/LICENSE,BSD-3-Clause
+ chmod -R a+w /output/licenses
> Task :release:go-licenses:java:createLicenses
> Task :sdks:java:container:java11:copyGolangLicenses FAILED
> Task :sdks:go:resolveBuildDependencies
Resolving google.golang.org/api: commit='0324d5e90dc7753607860272666845fad9ceb97e', urls=[https://code.googlesource.com/google-api-go-client]
Resolving google.golang.org/genproto: commit='4d944d34d83c502a5f761500a14d8842648415c3', urls=[https://github.com/google/go-genproto]
Resolving google.golang.org/grpc: commit='5e8f83304c0563d1ba74db05fee83d9c18ab9a58', urls=[https://github.com/grpc/grpc-go]
Resolving google.golang.org/protobuf: commit='d165be301fb1e13390ad453281ded24385fd8ebc', urls=[https://go.googlesource.com/protobuf]
Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, git@github.com:etcd-io/etcd.git]
Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, git@github.com:etcd-io/etcd.git]
> Task :sdks:go:installDependencies
> Task :sdks:go:buildLinuxAmd64
> Task :sdks:go:goBuild
> Task :sdks:java:container:resolveBuildDependencies FAILED
> Task :sdks:java:container:installDependencies
FAILURE: Build completed with 9 failures.
1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:java:fn-execution:compileJava'.
> Could not create task ':runners:direct-java:clean'.
> java.util.ConcurrentModificationException (no error message)
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:java:extensions:arrow:compileJava'.
> Could not create task ':runners:direct-java:clean'.
> java.util.ConcurrentModificationException (no error message)
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
3: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:java:io:synthetic:compileJava'.
> Could not create task ':runners:direct-java:clean'.
> java.util.ConcurrentModificationException (no error message)
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
4: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:java:testing:test-utils:compileJava'.
> Could not create task ':runners:direct-java:clean'.
> java.util.ConcurrentModificationException (no error message)
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
5: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:java:extensions:protobuf:extractIncludeProto'.
> Could not create task ':runners:direct-java:clean'.
> java.util.ConcurrentModificationException (no error message)
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
6: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:java:io:kinesis:compileJava'.
> Could not create task ':runners:direct-java:clean'.
> java.util.ConcurrentModificationException (no error message)
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
7: Task failed with an exception.
-----------
* What went wrong:
A problem occurred evaluating project ':runners:direct-java'.
> Could not create task ':runners:direct-java:clean'.
> java.util.ConcurrentModificationException (no error message)
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
8: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:java:container:java11:copyGolangLicenses'.
> Could not create task ':runners:direct-java:clean'.
> java.util.ConcurrentModificationException (no error message)
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
9: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:java:container:resolveBuildDependencies'.
> Could not create task ':runners:direct-java:clean'.
> java.util.ConcurrentModificationException (no error message)
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 19s
69 actionable tasks: 55 executed, 12 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/6z2icpgd5foy2
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins:
beam_LoadTests_Java_ParDo_Dataflow_V2_Streaming_Java11 #58
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Java_ParDo_Dataflow_V2_Streaming_Java11/58/display/redirect?page=changes>
Changes:
[noreply] [BEAM-12757]: Remove call for Json Dag in Portable PipelineRunner as
[noreply] fix confusing function def (#15120)
------------------------------------------
[...truncated 65.44 KB...]
afa3e488a0ee: Preparing
f42aed5f7feb: Waiting
d94dbb9c31bd: Waiting
89819bafde36: Waiting
8d4f1f665859: Waiting
ac2a8a598938: Waiting
f3d5b8f65132: Waiting
bfb1ad453cf3: Waiting
fe715d60a279: Waiting
54254a970f5e: Waiting
afa3e488a0ee: Waiting
ad83f0aa5c0a: Waiting
5a9a65095453: Waiting
7f37b291c24c: Pushed
7ac8164e3586: Pushed
0b16fa087ab7: Pushed
999a513f50c3: Pushed
7590832c0955: Pushed
a51c5932a189: Pushed
ac2a8a598938: Pushed
fe715d60a279: Pushed
f42aed5f7feb: Layer already exists
89819bafde36: Layer already exists
f3d5b8f65132: Layer already exists
bfb1ad453cf3: Pushed
ad83f0aa5c0a: Layer already exists
5a9a65095453: Layer already exists
4b0edb23340c: Layer already exists
afa3e488a0ee: Layer already exists
8d4f1f665859: Pushed
d94dbb9c31bd: Pushed
54254a970f5e: Pushed
20210814123734: digest: sha256:d5b4fabd16a8e88473c78c330df6052f5e71bc329968cecdc130a073474d1277 size: 4310
> Task :sdks:java:testing:load-tests:run
Aug 14, 2021 12:42:11 PM org.apache.beam.runners.dataflow.options.DataflowPipelineOptions$StagingLocationFactory create
INFO: No stagingLocation provided, falling back to gcpTempLocation
Aug 14, 2021 12:42:12 PM org.apache.beam.runners.dataflow.DataflowRunner fromOptions
INFO: PipelineOptions.filesToStage was not specified. Defaulting to files from the classpath: will stage 191 files. Enable logging at DEBUG level to see which files will be staged.
Aug 14, 2021 12:42:12 PM org.apache.beam.sdk.Pipeline validate
WARNING: The following transforms do not have stable unique names: ParDo(TimeMonitor)
Aug 14, 2021 12:42:12 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Executing pipeline on the Dataflow Service, which will have billing implications related to Google Compute Engine usage and other Google Cloud Services.
Aug 14, 2021 12:42:15 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging portable pipeline proto to gs://temp-storage-for-perf-tests/loadtests/staging/
Aug 14, 2021 12:42:15 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <107841 bytes, hash 0bb124d1f9f15a41868cd48a391a8a1e9f60297a25f529e7aa3f439a1e5227dc> to gs://temp-storage-for-perf-tests/loadtests/staging/pipeline-C7Ek0fnxWkGGjNSKORqKHp9gKXol9Snnqj9Dmh5SJ9w.pb
Aug 14, 2021 12:42:16 PM org.apache.beam.runners.dataflow.util.PackageUtil stageClasspathElements
INFO: Uploading 191 files from PipelineOptions.filesToStage to staging location to prepare for execution.
Aug 14, 2021 12:42:17 PM org.apache.beam.runners.dataflow.util.PackageUtil stageClasspathElements
INFO: Staging files complete: 191 files cached, 0 files newly uploaded in 0 seconds
Aug 14, 2021 12:42:17 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Read input/DataflowRunner.StreamingUnboundedRead.ReadWithIds as step s1
Aug 14, 2021 12:42:17 PM org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource split
INFO: Split into 20 bundles of sizes: [org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@6342d610, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@dc4a691, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@784abd3e, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@36c2b646, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@434514d8, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@6b1dc20f, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@4613311f, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@6540cf1d, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@ec8f4b9, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@bc042d5, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@5484117b, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@37df14d1, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@7efb53af, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@7724704f, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@3dfa819, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@4ce94d2f, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@68ab0936, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@3cd9aa64, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@42b84286, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@443effcb]
Aug 14, 2021 12:42:17 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Read input/StripIds as step s2
Aug 14, 2021 12:42:17 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding ParDo(TimeMonitor) as step s3
Aug 14, 2021 12:42:17 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding ParDo(ByteMonitor) as step s4
Aug 14, 2021 12:42:17 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 0 as step s5
Aug 14, 2021 12:42:17 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 1 as step s6
Aug 14, 2021 12:42:17 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 2 as step s7
Aug 14, 2021 12:42:17 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 3 as step s8
Aug 14, 2021 12:42:17 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 4 as step s9
Aug 14, 2021 12:42:17 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 5 as step s10
Aug 14, 2021 12:42:17 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 6 as step s11
Aug 14, 2021 12:42:17 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 7 as step s12
Aug 14, 2021 12:42:17 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 8 as step s13
Aug 14, 2021 12:42:17 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 9 as step s14
Aug 14, 2021 12:42:17 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding ParDo(TimeMonitor)2 as step s15
Aug 14, 2021 12:42:17 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Dataflow SDK version: 2.33.0-SNAPSHOT
Aug 14, 2021 12:42:18 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobs/us-central1/2021-08-14_05_42_17-7708985462629290779?project=apache-beam-testing
Aug 14, 2021 12:42:18 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Submitted job: 2021-08-14_05_42_17-7708985462629290779
Aug 14, 2021 12:42:18 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2021-08-14_05_42_17-7708985462629290779
Aug 14, 2021 12:42:29 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-08-14T12:42:26.859Z: The workflow name is not a valid Cloud Label. Labels applied to Cloud resources (such as GCE Instances) for monitoring will be labeled with this modified job name: load0tests0java110dataflow0v20streaming0pardo01-jenkins-08-86vh. For the best monitoring experience, please name your job with a valid Cloud Label. For details, see: https://cloud.google.com/compute/docs/labeling-resources#restrictions
Aug 14, 2021 12:42:33 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-14T12:42:31.828Z: Worker configuration: e2-standard-2 in us-central1-a.
Aug 14, 2021 12:42:33 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-14T12:42:32.381Z: Expanding SplittableParDo operations into optimizable parts.
Aug 14, 2021 12:42:33 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-14T12:42:32.412Z: Expanding CollectionToSingleton operations into optimizable parts.
Aug 14, 2021 12:42:33 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-14T12:42:32.477Z: Expanding CoGroupByKey operations into optimizable parts.
Aug 14, 2021 12:42:33 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-14T12:42:32.515Z: Expanding SplittableProcessKeyed operations into optimizable parts.
Aug 14, 2021 12:42:33 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-14T12:42:32.535Z: Expanding GroupByKey operations into streaming Read/Write steps
Aug 14, 2021 12:42:33 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-14T12:42:32.558Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
Aug 14, 2021 12:42:33 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-14T12:42:32.620Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
Aug 14, 2021 12:42:33 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-14T12:42:32.652Z: Fusing consumer Read input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource) into Read input/Impulse
Aug 14, 2021 12:42:33 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-14T12:42:32.685Z: Fusing consumer Read-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/PairWithRestriction into Read input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource)
Aug 14, 2021 12:42:33 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-14T12:42:32.714Z: Fusing consumer Read-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/SplitWithSizing into Read-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/PairWithRestriction
Aug 14, 2021 12:42:33 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-14T12:42:32.740Z: Fusing consumer Read input/ParDo(StripIds)/ParMultiDo(StripIds) into Read-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/ProcessElementAndRestrictionWithSizing
Aug 14, 2021 12:42:33 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-14T12:42:32.776Z: Fusing consumer ParDo(TimeMonitor)/ParMultiDo(TimeMonitor) into Read input/ParDo(StripIds)/ParMultiDo(StripIds)
Aug 14, 2021 12:42:33 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-14T12:42:32.806Z: Fusing consumer ParDo(ByteMonitor)/ParMultiDo(ByteMonitor) into ParDo(TimeMonitor)/ParMultiDo(TimeMonitor)
Aug 14, 2021 12:42:33 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-14T12:42:32.829Z: Fusing consumer Step: 0/ParMultiDo(CounterOperation) into ParDo(ByteMonitor)/ParMultiDo(ByteMonitor)
Aug 14, 2021 12:42:33 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-14T12:42:32.850Z: Fusing consumer Step: 1/ParMultiDo(CounterOperation) into Step: 0/ParMultiDo(CounterOperation)
Aug 14, 2021 12:42:33 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-14T12:42:32.897Z: Fusing consumer Step: 2/ParMultiDo(CounterOperation) into Step: 1/ParMultiDo(CounterOperation)
Aug 14, 2021 12:42:33 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-14T12:42:32.920Z: Fusing consumer Step: 3/ParMultiDo(CounterOperation) into Step: 2/ParMultiDo(CounterOperation)
Aug 14, 2021 12:42:33 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-14T12:42:32.946Z: Fusing consumer Step: 4/ParMultiDo(CounterOperation) into Step: 3/ParMultiDo(CounterOperation)
Aug 14, 2021 12:42:33 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-14T12:42:32.969Z: Fusing consumer Step: 5/ParMultiDo(CounterOperation) into Step: 4/ParMultiDo(CounterOperation)
Aug 14, 2021 12:42:33 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-14T12:42:32.994Z: Fusing consumer Step: 6/ParMultiDo(CounterOperation) into Step: 5/ParMultiDo(CounterOperation)
Aug 14, 2021 12:42:33 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-14T12:42:33.019Z: Fusing consumer Step: 7/ParMultiDo(CounterOperation) into Step: 6/ParMultiDo(CounterOperation)
Aug 14, 2021 12:42:33 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-14T12:42:33.047Z: Fusing consumer Step: 8/ParMultiDo(CounterOperation) into Step: 7/ParMultiDo(CounterOperation)
Aug 14, 2021 12:42:33 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-14T12:42:33.078Z: Fusing consumer Step: 9/ParMultiDo(CounterOperation) into Step: 8/ParMultiDo(CounterOperation)
Aug 14, 2021 12:42:33 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-14T12:42:33.103Z: Fusing consumer ParDo(TimeMonitor)2/ParMultiDo(TimeMonitor) into Step: 9/ParMultiDo(CounterOperation)
Aug 14, 2021 12:42:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-14T12:42:33.369Z: Starting 5 ****s in us-central1-a...
Aug 14, 2021 12:42:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-14T12:42:59.093Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete
Aug 14, 2021 12:43:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-14T12:43:07.909Z: Autoscaling: Raised the number of ****s to 1 so that the pipeline can catch up with its backlog and keep up with its input rate.
Aug 14, 2021 12:43:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-14T12:43:07.960Z: Resized **** pool to 1, though goal was 5. This could be a quota issue.
Aug 14, 2021 12:43:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-14T12:43:18.256Z: Autoscaling: Raised the number of ****s to 5 so that the pipeline can catch up with its backlog and keep up with its input rate.
Aug 14, 2021 12:44:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-14T12:44:12.023Z: Workers have started successfully.
Aug 14, 2021 12:44:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-14T12:44:12.059Z: Workers have started successfully.
Aug 14, 2021 4:00:46 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-14T16:00:42.935Z: Cancel request is committed for workflow job: 2021-08-14_05_42_17-7708985462629290779.
Aug 14, 2021 4:00:46 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-14T16:00:43.032Z: Cleaning up.
Aug 14, 2021 4:00:46 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-14T16:00:43.098Z: Stopping **** pool...
Aug 14, 2021 4:00:46 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-14T16:00:43.147Z: Stopping **** pool...
Aug 14, 2021 4:03:02 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-14T16:03:01.049Z: Autoscaling: Reduced the number of ****s to 0 based on low average **** CPU utilization, and the pipeline having sufficiently low backlog and keeping up with input rate.
Aug 14, 2021 4:03:02 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-14T16:03:01.094Z: Worker pool stopped.
Aug 14, 2021 4:03:08 PM org.apache.beam.runners.dataflow.DataflowPipelineJob logTerminalState
INFO: Job 2021-08-14_05_42_17-7708985462629290779 finished with status CANCELLED.
Aug 14, 2021 4:03:08 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric totalBytes.count, from namespace pardo
Load test results for test (ID): 1cf12235-8714-443e-81d9-d895c939c42a and timestamp: 2021-08-14T12:42:12.519000000Z:
Metric: Value:
dataflow_v2_java11_runtime_sec 0.0
dataflow_v2_java11_total_bytes_count -1.0
Exception in thread "main" java.lang.RuntimeException: Invalid job state: CANCELLED.
at org.apache.beam.sdk.loadtests.JobFailure.handleFailure(JobFailure.java:55)
at org.apache.beam.sdk.loadtests.LoadTest.run(LoadTest.java:141)
at org.apache.beam.sdk.loadtests.ParDoLoadTest.run(ParDoLoadTest.java:53)
at org.apache.beam.sdk.loadtests.ParDoLoadTest.main(ParDoLoadTest.java:103)
> Task :sdks:java:testing:load-tests:run FAILED
> Task :runners:google-cloud-dataflow-java:cleanUpDockerImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210814123734
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:d5b4fabd16a8e88473c78c330df6052f5e71bc329968cecdc130a073474d1277
Deleted: sha256:0c3ee4f9cd2f42af33fc82e21ba52203ecab282c5f8d6f05c47a813574a785f2
Deleted: sha256:649aad392e64a5fbe1b1cd54b0e73fa352ea0d4f281c570e7ce56581b0dc4d16
Deleted: sha256:60ac02ecf96fdba9c59ab49438f7ce3ab8316e7f148e24542a7208cdec3a43a0
Deleted: sha256:1ced2ec6cf0d94cd9a474f9f4649709b8d9fb0c6c30151da7a0c3e951a021294
Deleted: sha256:fe001f7d7d076389a620d639459071bbc79dbb2a6e995188921a81cb2b0d38b2
Deleted: sha256:afa0c995458c54c67afb4a08fd36d0a8fca971915262a886fe5ab18677ff6a17
Deleted: sha256:bd2e54c015b0da2dbdf7266c5f91230aca94e7db8fb733e8065b399c2f7d9859
Deleted: sha256:660186a5f971f8e2c554fa46b9164c39ac5348235936f9bb5df959a331a3023a
Deleted: sha256:e32d2244dad5300fff51fe150cc93d7c45043cd0ef45260fc99f350722c9b72e
Deleted: sha256:7b32a68d7f2b15adf11602ff22bbf66f8b50d12947e2ae68adbbc22b26ce50ba
Deleted: sha256:16be4271d7346c0cca27b782e0c62727bb324f00835c7d8667216a6ea663d69f
Deleted: sha256:34fb323b94b0378c81ed2ee840f7dce8011d32101a2b87274f521e33914faeff
Deleted: sha256:40ed12613d66e7898e3c6ce01771aab7e133a0ee439c75166b2886f5a7c51576
Deleted: sha256:1876873fca85efb3841843e5534ce29e6a3c5869e6198815eb4dc404145f2eab
Deleted: sha256:250444fa8a92cf52e555a7a36b05c0b3c634f75410aeea90472005a479ad4ee8
Deleted: sha256:e7a9291ad08dfb0fb885df71297c1c28e03c4dea05b7886c778dcb34aaa2c34c
Deleted: sha256:3d17ddca987218b2296d5f6109776fd0a40581a7ff847abcd9d598b0f96fe72a
Deleted: sha256:be960dec02a5f5e1e2f4a3cad58efe9cf4f6749b6ed8d7d78fa44c8d5970e070
Deleted: sha256:647befce8c95c1bb2d9a392b41480deedaf130b6d0247207a3c679a9463e83b4
Deleted: sha256:774de80497265fc8a8a97d76b74164ec3bcc0dac96279f5e2451d1e5a1b91425
Deleted: sha256:251380b1e5fd86006dc75fa122394c535c66e7d47e49e62264576ff26cac4d6c
Deleted: sha256:cae3632b6da2145af7fed47724748aee464c35c95cf2e0b8da116816e4515a7a
Deleted: sha256:c95c70c52d9b261167f268745162d923a554dc2477f6e210165d14fbe5c4a98d
Deleted: sha256:5f937c208de8b16437216b2b4738bbb5732627a15f6dfda4e6ac777e14b1ccb2
Deleted: sha256:fd0a02187b347c305ec137050768c36f622a5261cee445ecafd582b52090e990
Deleted: sha256:bbde64604a44cc082f10e592eadca5eec66e9ec0b057dbab0dbeb523ee0bfd20
Deleted: sha256:fe1178153db1de7a2f76896c611910f489fe7257906ab32149f1f89f6a9a10a3
Deleted: sha256:e8059fb8cdb319e346428a88e908bcf8eced93d489b84d645c4c4d9fcb88eed3
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210814123734]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:d5b4fabd16a8e88473c78c330df6052f5e71bc329968cecdc130a073474d1277]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210814123734] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:d5b4fabd16a8e88473c78c330df6052f5e71bc329968cecdc130a073474d1277])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:d5b4fabd16a8e88473c78c330df6052f5e71bc329968cecdc130a073474d1277
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:d5b4fabd16a8e88473c78c330df6052f5e71bc329968cecdc130a073474d1277
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:d5b4fabd16a8e88473c78c330df6052f5e71bc329968cecdc130a073474d1277].
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:testing:load-tests:run'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 3h 25m 52s
107 actionable tasks: 76 executed, 29 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/ib5a3orpp3kda
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins:
beam_LoadTests_Java_ParDo_Dataflow_V2_Streaming_Java11 #57
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Java_ParDo_Dataflow_V2_Streaming_Java11/57/display/redirect?page=changes>
Changes:
[bsindhwani] Python Kata - Event Time Triggers
[bsindhwani] Python Kata - Event Time Triggers - Added license to task-info.yaml
[bsindhwani] Python Kata - Event Time Triggers - refactored the accumulation mode
[bsindhwani] Python Kata - Event Time Triggers - task description corrected to
[bsindhwani] Python Kata - Event Time Triggers - added streaming options
[bsindhwani] Python Kata - Event Time Triggers - add license text in task-info.yaml
[bsindhwani] Python Kata - Early Triggers
[bsindhwani] Python Kata - Event Time Triggers & Early Triggers - task.md - corrected
[bsindhwani] Python Kata - Window Accumulation Mode
[bsindhwani] Python Kata - Event Time Triggers - removed the external transform
[noreply] Loosen typing extensions requirement
[bsindhwani] Python Kata - added license to course-info.yaml
[Kyle Weaver] [BEAM-12719] ZetaSQL docs: replace out of date table with link to
[Robert Burke] [BEAM-11779] Remove appliance restriction.
[ryanthompson591] Add retry_gcs_file_copy when 500 errros happen from server
[noreply] [BEAM-6374] Emit PCollection metrics from GoSDK (#15289)
[noreply] Merge pull request #15165 from [BEAM-12593] Verify DataFrame API on
[noreply] Merge pull request #15265 from [BEAM-12545] Extend FileSink by
[noreply] [BEAM-12453]: Add interface to access I/O topic information for a Samza
[noreply] [BEAM-10212] Guard state caching with experiment (#15319)
------------------------------------------
[...truncated 64.48 KB...]
As an alternative, use `gcloud auth configure-docker` to configure `docker` to
use `gcloud` as a credential helper, then use `docker` as you would for non-GCR
registries, e.g. `docker pull gcr.io/project-id/my-image`. Add
`--verbosity=error` to silence this warning: `gcloud docker
--verbosity=error -- pull gcr.io/project-id/my-image`.
See: https://cloud.google.com/container-registry/docs/support/deprecation-notices#gcloud-docker
> Task :sdks:java:testing:load-tests:run
Aug 13, 2021 12:44:13 PM org.apache.beam.runners.dataflow.options.DataflowPipelineOptions$StagingLocationFactory create
INFO: No stagingLocation provided, falling back to gcpTempLocation
Aug 13, 2021 12:44:14 PM org.apache.beam.runners.dataflow.DataflowRunner fromOptions
INFO: PipelineOptions.filesToStage was not specified. Defaulting to files from the classpath: will stage 191 files. Enable logging at DEBUG level to see which files will be staged.
Aug 13, 2021 12:44:15 PM org.apache.beam.sdk.Pipeline validate
WARNING: The following transforms do not have stable unique names: ParDo(TimeMonitor)
Aug 13, 2021 12:44:15 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Executing pipeline on the Dataflow Service, which will have billing implications related to Google Compute Engine usage and other Google Cloud Services.
Aug 13, 2021 12:44:17 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging portable pipeline proto to gs://temp-storage-for-perf-tests/loadtests/staging/
Aug 13, 2021 12:44:17 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <107841 bytes, hash 2eb09da47b15d7cc943d9fba31e7a98a66a17aa7098686f4674910a75a4534a7> to gs://temp-storage-for-perf-tests/loadtests/staging/pipeline-LrCdpHsV18yUPZ-6MeepimaheqcJhob0Z0kQp1pFNKc.pb
Aug 13, 2021 12:44:18 PM org.apache.beam.runners.dataflow.util.PackageUtil stageClasspathElements
INFO: Uploading 191 files from PipelineOptions.filesToStage to staging location to prepare for execution.
Aug 13, 2021 12:44:19 PM org.apache.beam.runners.dataflow.util.PackageUtil stageClasspathElements
INFO: Staging files complete: 191 files cached, 0 files newly uploaded in 0 seconds
Aug 13, 2021 12:44:19 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Read input/DataflowRunner.StreamingUnboundedRead.ReadWithIds as step s1
Aug 13, 2021 12:44:19 PM org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource split
INFO: Split into 20 bundles of sizes: [org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@6342d610, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@dc4a691, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@784abd3e, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@36c2b646, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@434514d8, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@6b1dc20f, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@4613311f, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@6540cf1d, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@ec8f4b9, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@bc042d5, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@5484117b, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@37df14d1, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@7efb53af, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@7724704f, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@3dfa819, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@4ce94d2f, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@68ab0936, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@3cd9aa64, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@42b84286, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@443effcb]
Aug 13, 2021 12:44:19 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Read input/StripIds as step s2
Aug 13, 2021 12:44:19 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding ParDo(TimeMonitor) as step s3
Aug 13, 2021 12:44:19 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding ParDo(ByteMonitor) as step s4
Aug 13, 2021 12:44:19 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 0 as step s5
Aug 13, 2021 12:44:19 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 1 as step s6
Aug 13, 2021 12:44:19 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 2 as step s7
Aug 13, 2021 12:44:19 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 3 as step s8
Aug 13, 2021 12:44:19 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 4 as step s9
Aug 13, 2021 12:44:19 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 5 as step s10
Aug 13, 2021 12:44:19 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 6 as step s11
Aug 13, 2021 12:44:19 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 7 as step s12
Aug 13, 2021 12:44:19 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 8 as step s13
Aug 13, 2021 12:44:19 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 9 as step s14
Aug 13, 2021 12:44:19 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding ParDo(TimeMonitor)2 as step s15
Aug 13, 2021 12:44:19 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Dataflow SDK version: 2.33.0-SNAPSHOT
Aug 13, 2021 12:44:20 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobs/us-central1/2021-08-13_05_44_19-1711227200837009647?project=apache-beam-testing
Aug 13, 2021 12:44:20 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Submitted job: 2021-08-13_05_44_19-1711227200837009647
Aug 13, 2021 12:44:20 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2021-08-13_05_44_19-1711227200837009647
Aug 13, 2021 12:44:29 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-08-13T12:44:29.644Z: The workflow name is not a valid Cloud Label. Labels applied to Cloud resources (such as GCE Instances) for monitoring will be labeled with this modified job name: load0tests0java110dataflow0v20streaming0pardo01-jenkins-08-ijy5. For the best monitoring experience, please name your job with a valid Cloud Label. For details, see: https://cloud.google.com/compute/docs/labeling-resources#restrictions
Aug 13, 2021 12:44:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-13T12:44:34.534Z: Worker configuration: e2-standard-2 in us-central1-a.
Aug 13, 2021 12:44:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-13T12:44:35.364Z: Expanding SplittableParDo operations into optimizable parts.
Aug 13, 2021 12:44:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-13T12:44:35.391Z: Expanding CollectionToSingleton operations into optimizable parts.
Aug 13, 2021 12:44:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-13T12:44:35.449Z: Expanding CoGroupByKey operations into optimizable parts.
Aug 13, 2021 12:44:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-13T12:44:35.479Z: Expanding SplittableProcessKeyed operations into optimizable parts.
Aug 13, 2021 12:44:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-13T12:44:35.497Z: Expanding GroupByKey operations into streaming Read/Write steps
Aug 13, 2021 12:44:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-13T12:44:35.519Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
Aug 13, 2021 12:44:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-13T12:44:35.579Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
Aug 13, 2021 12:44:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-13T12:44:35.608Z: Fusing consumer Read input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource) into Read input/Impulse
Aug 13, 2021 12:44:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-13T12:44:35.637Z: Fusing consumer Read-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/PairWithRestriction into Read input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource)
Aug 13, 2021 12:44:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-13T12:44:35.665Z: Fusing consumer Read-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/SplitWithSizing into Read-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/PairWithRestriction
Aug 13, 2021 12:44:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-13T12:44:35.691Z: Fusing consumer Read input/ParDo(StripIds)/ParMultiDo(StripIds) into Read-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/ProcessElementAndRestrictionWithSizing
Aug 13, 2021 12:44:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-13T12:44:35.734Z: Fusing consumer ParDo(TimeMonitor)/ParMultiDo(TimeMonitor) into Read input/ParDo(StripIds)/ParMultiDo(StripIds)
Aug 13, 2021 12:44:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-13T12:44:35.768Z: Fusing consumer ParDo(ByteMonitor)/ParMultiDo(ByteMonitor) into ParDo(TimeMonitor)/ParMultiDo(TimeMonitor)
Aug 13, 2021 12:44:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-13T12:44:35.793Z: Fusing consumer Step: 0/ParMultiDo(CounterOperation) into ParDo(ByteMonitor)/ParMultiDo(ByteMonitor)
Aug 13, 2021 12:44:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-13T12:44:35.824Z: Fusing consumer Step: 1/ParMultiDo(CounterOperation) into Step: 0/ParMultiDo(CounterOperation)
Aug 13, 2021 12:44:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-13T12:44:35.853Z: Fusing consumer Step: 2/ParMultiDo(CounterOperation) into Step: 1/ParMultiDo(CounterOperation)
Aug 13, 2021 12:44:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-13T12:44:35.876Z: Fusing consumer Step: 3/ParMultiDo(CounterOperation) into Step: 2/ParMultiDo(CounterOperation)
Aug 13, 2021 12:44:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-13T12:44:35.902Z: Fusing consumer Step: 4/ParMultiDo(CounterOperation) into Step: 3/ParMultiDo(CounterOperation)
Aug 13, 2021 12:44:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-13T12:44:35.936Z: Fusing consumer Step: 5/ParMultiDo(CounterOperation) into Step: 4/ParMultiDo(CounterOperation)
Aug 13, 2021 12:44:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-13T12:44:36.009Z: Fusing consumer Step: 6/ParMultiDo(CounterOperation) into Step: 5/ParMultiDo(CounterOperation)
Aug 13, 2021 12:44:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-13T12:44:36.036Z: Fusing consumer Step: 7/ParMultiDo(CounterOperation) into Step: 6/ParMultiDo(CounterOperation)
Aug 13, 2021 12:44:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-13T12:44:36.058Z: Fusing consumer Step: 8/ParMultiDo(CounterOperation) into Step: 7/ParMultiDo(CounterOperation)
Aug 13, 2021 12:44:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-13T12:44:36.082Z: Fusing consumer Step: 9/ParMultiDo(CounterOperation) into Step: 8/ParMultiDo(CounterOperation)
Aug 13, 2021 12:44:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-13T12:44:36.115Z: Fusing consumer ParDo(TimeMonitor)2/ParMultiDo(TimeMonitor) into Step: 9/ParMultiDo(CounterOperation)
Aug 13, 2021 12:44:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-13T12:44:36.413Z: Starting 5 ****s in us-central1-a...
Aug 13, 2021 12:44:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-13T12:44:51.600Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete
Aug 13, 2021 12:45:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-13T12:45:26.820Z: Autoscaling: Raised the number of ****s to 5 so that the pipeline can catch up with its backlog and keep up with its input rate.
Aug 13, 2021 12:46:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-13T12:46:20.488Z: Workers have started successfully.
Aug 13, 2021 12:46:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-13T12:46:20.510Z: Workers have started successfully.
Aug 13, 2021 3:14:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-13T15:14:39.092Z: Staged package kafka-clients-2.4.1-or4Vrm01S3aXE64MuzGE8iWqFvyYIFseskr9n8KjYNk.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/kafka-clients-2.4.1-or4Vrm01S3aXE64MuzGE8iWqFvyYIFseskr9n8KjYNk.jar' is inaccessible.
Aug 13, 2021 3:14:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-13T15:14:39.212Z: Staged package lz4-java-1.6.0-0ilUWqKx1SA8h2YUvbz_yswwNpf0-PJvdk4dbB7S5BY.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/lz4-java-1.6.0-0ilUWqKx1SA8h2YUvbz_yswwNpf0-PJvdk4dbB7S5BY.jar' is inaccessible.
Aug 13, 2021 3:14:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-08-13T15:14:40.066Z: One or more access checks for temp location or staged files failed. Please refer to other error messages for details. For more information on security and permissions, please see https://cloud.google.com/dataflow/security-and-permissions.
Aug 13, 2021 3:17:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-08-13T15:17:40.538Z: One or more access checks for temp location or staged files failed. Please refer to other error messages for details. For more information on security and permissions, please see https://cloud.google.com/dataflow/security-and-permissions.
Aug 13, 2021 3:20:40 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-13T15:20:40.176Z: Staged package kafka-clients-2.4.1-or4Vrm01S3aXE64MuzGE8iWqFvyYIFseskr9n8KjYNk.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/kafka-clients-2.4.1-or4Vrm01S3aXE64MuzGE8iWqFvyYIFseskr9n8KjYNk.jar' is inaccessible.
Aug 13, 2021 3:20:40 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-13T15:20:40.320Z: Staged package lz4-java-1.6.0-0ilUWqKx1SA8h2YUvbz_yswwNpf0-PJvdk4dbB7S5BY.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/lz4-java-1.6.0-0ilUWqKx1SA8h2YUvbz_yswwNpf0-PJvdk4dbB7S5BY.jar' is inaccessible.
Aug 13, 2021 3:20:43 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-08-13T15:20:41.464Z: One or more access checks for temp location or staged files failed. Please refer to other error messages for details. For more information on security and permissions, please see https://cloud.google.com/dataflow/security-and-permissions.
Aug 13, 2021 3:23:43 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-08-13T15:23:40.989Z: One or more access checks for temp location or staged files failed. Please refer to other error messages for details. For more information on security and permissions, please see https://cloud.google.com/dataflow/security-and-permissions.
Aug 13, 2021 3:26:40 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-13T15:26:39.418Z: Staged package kafka-clients-2.4.1-or4Vrm01S3aXE64MuzGE8iWqFvyYIFseskr9n8KjYNk.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/kafka-clients-2.4.1-or4Vrm01S3aXE64MuzGE8iWqFvyYIFseskr9n8KjYNk.jar' is inaccessible.
Aug 13, 2021 3:26:40 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-13T15:26:39.567Z: Staged package lz4-java-1.6.0-0ilUWqKx1SA8h2YUvbz_yswwNpf0-PJvdk4dbB7S5BY.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/lz4-java-1.6.0-0ilUWqKx1SA8h2YUvbz_yswwNpf0-PJvdk4dbB7S5BY.jar' is inaccessible.
Aug 13, 2021 3:26:40 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-08-13T15:26:40.629Z: One or more access checks for temp location or staged files failed. Please refer to other error messages for details. For more information on security and permissions, please see https://cloud.google.com/dataflow/security-and-permissions.
Aug 13, 2021 3:29:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-08-13T15:29:41.939Z: One or more access checks for temp location or staged files failed. Please refer to other error messages for details. For more information on security and permissions, please see https://cloud.google.com/dataflow/security-and-permissions.
Aug 13, 2021 3:32:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-13T15:32:39.742Z: Staged package kafka-clients-2.4.1-or4Vrm01S3aXE64MuzGE8iWqFvyYIFseskr9n8KjYNk.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/kafka-clients-2.4.1-or4Vrm01S3aXE64MuzGE8iWqFvyYIFseskr9n8KjYNk.jar' is inaccessible.
Aug 13, 2021 3:32:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-13T15:32:39.837Z: Staged package lz4-java-1.6.0-0ilUWqKx1SA8h2YUvbz_yswwNpf0-PJvdk4dbB7S5BY.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/lz4-java-1.6.0-0ilUWqKx1SA8h2YUvbz_yswwNpf0-PJvdk4dbB7S5BY.jar' is inaccessible.
Aug 13, 2021 3:32:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-08-13T15:32:40.930Z: One or more access checks for temp location or staged files failed. Please refer to other error messages for details. For more information on security and permissions, please see https://cloud.google.com/dataflow/security-and-permissions.
Aug 13, 2021 3:35:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-08-13T15:35:41.160Z: One or more access checks for temp location or staged files failed. Please refer to other error messages for details. For more information on security and permissions, please see https://cloud.google.com/dataflow/security-and-permissions.
Aug 13, 2021 3:38:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-13T15:38:39.381Z: Staged package kafka-clients-2.4.1-or4Vrm01S3aXE64MuzGE8iWqFvyYIFseskr9n8KjYNk.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/kafka-clients-2.4.1-or4Vrm01S3aXE64MuzGE8iWqFvyYIFseskr9n8KjYNk.jar' is inaccessible.
Aug 13, 2021 3:38:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-13T15:38:39.468Z: Staged package lz4-java-1.6.0-0ilUWqKx1SA8h2YUvbz_yswwNpf0-PJvdk4dbB7S5BY.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/lz4-java-1.6.0-0ilUWqKx1SA8h2YUvbz_yswwNpf0-PJvdk4dbB7S5BY.jar' is inaccessible.
Aug 13, 2021 3:38:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-08-13T15:38:40.401Z: One or more access checks for temp location or staged files failed. Please refer to other error messages for details. For more information on security and permissions, please see https://cloud.google.com/dataflow/security-and-permissions.
Aug 13, 2021 3:41:43 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-08-13T15:41:41.174Z: One or more access checks for temp location or staged files failed. Please refer to other error messages for details. For more information on security and permissions, please see https://cloud.google.com/dataflow/security-and-permissions.
Aug 13, 2021 3:44:40 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-13T15:44:39.559Z: Staged package kafka-clients-2.4.1-or4Vrm01S3aXE64MuzGE8iWqFvyYIFseskr9n8KjYNk.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/kafka-clients-2.4.1-or4Vrm01S3aXE64MuzGE8iWqFvyYIFseskr9n8KjYNk.jar' is inaccessible.
Aug 13, 2021 3:44:40 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-13T15:44:39.658Z: Staged package lz4-java-1.6.0-0ilUWqKx1SA8h2YUvbz_yswwNpf0-PJvdk4dbB7S5BY.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/lz4-java-1.6.0-0ilUWqKx1SA8h2YUvbz_yswwNpf0-PJvdk4dbB7S5BY.jar' is inaccessible.
Aug 13, 2021 3:44:40 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-08-13T15:44:40.641Z: One or more access checks for temp location or staged files failed. Please refer to other error messages for details. For more information on security and permissions, please see https://cloud.google.com/dataflow/security-and-permissions.
Aug 13, 2021 3:47:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-08-13T15:47:40.650Z: One or more access checks for temp location or staged files failed. Please refer to other error messages for details. For more information on security and permissions, please see https://cloud.google.com/dataflow/security-and-permissions.
Aug 13, 2021 3:50:40 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-13T15:50:39.519Z: Staged package kafka-clients-2.4.1-or4Vrm01S3aXE64MuzGE8iWqFvyYIFseskr9n8KjYNk.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/kafka-clients-2.4.1-or4Vrm01S3aXE64MuzGE8iWqFvyYIFseskr9n8KjYNk.jar' is inaccessible.
Aug 13, 2021 3:50:40 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-13T15:50:39.807Z: Staged package lz4-java-1.6.0-0ilUWqKx1SA8h2YUvbz_yswwNpf0-PJvdk4dbB7S5BY.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/lz4-java-1.6.0-0ilUWqKx1SA8h2YUvbz_yswwNpf0-PJvdk4dbB7S5BY.jar' is inaccessible.
Aug 13, 2021 3:50:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-08-13T15:50:40.999Z: One or more access checks for temp location or staged files failed. Please refer to other error messages for details. For more information on security and permissions, please see https://cloud.google.com/dataflow/security-and-permissions.
Aug 13, 2021 3:53:40 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-08-13T15:53:40.705Z: One or more access checks for temp location or staged files failed. Please refer to other error messages for details. For more information on security and permissions, please see https://cloud.google.com/dataflow/security-and-permissions.
Aug 13, 2021 3:56:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-13T15:56:39.490Z: Staged package kafka-clients-2.4.1-or4Vrm01S3aXE64MuzGE8iWqFvyYIFseskr9n8KjYNk.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/kafka-clients-2.4.1-or4Vrm01S3aXE64MuzGE8iWqFvyYIFseskr9n8KjYNk.jar' is inaccessible.
Aug 13, 2021 3:56:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-13T15:56:39.585Z: Staged package lz4-java-1.6.0-0ilUWqKx1SA8h2YUvbz_yswwNpf0-PJvdk4dbB7S5BY.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/lz4-java-1.6.0-0ilUWqKx1SA8h2YUvbz_yswwNpf0-PJvdk4dbB7S5BY.jar' is inaccessible.
Aug 13, 2021 3:56:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-08-13T15:56:40.618Z: One or more access checks for temp location or staged files failed. Please refer to other error messages for details. For more information on security and permissions, please see https://cloud.google.com/dataflow/security-and-permissions.
Aug 13, 2021 3:59:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-08-13T15:59:40.779Z: One or more access checks for temp location or staged files failed. Please refer to other error messages for details. For more information on security and permissions, please see https://cloud.google.com/dataflow/security-and-permissions.
Aug 13, 2021 4:00:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-13T16:00:38.241Z: Cancel request is committed for workflow job: 2021-08-13_05_44_19-1711227200837009647.
Aug 13, 2021 4:00:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-13T16:00:38.382Z: Cleaning up.
Aug 13, 2021 4:00:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-13T16:00:38.741Z: Stopping **** pool...
Aug 13, 2021 4:00:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-13T16:00:38.877Z: Stopping **** pool...
Aug 13, 2021 4:03:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-13T16:02:59.920Z: Autoscaling: Reduced the number of ****s to 0 based on low average **** CPU utilization, and the pipeline having sufficiently low backlog and keeping up with input rate.
Aug 13, 2021 4:03:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-13T16:03:00.019Z: Worker pool stopped.
Aug 13, 2021 4:03:07 PM org.apache.beam.runners.dataflow.DataflowPipelineJob logTerminalState
INFO: Job 2021-08-13_05_44_19-1711227200837009647 finished with status CANCELLED.
Aug 13, 2021 4:03:07 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric totalBytes.count, from namespace pardo
Exception in thread "main" java.lang.RuntimeException: Invalid job state: CANCELLED.
at org.apache.beam.sdk.loadtests.JobFailure.handleFailure(JobFailure.java:55)
at org.apache.beam.sdk.loadtests.LoadTest.run(LoadTest.java:141)
at org.apache.beam.sdk.loadtests.ParDoLoadTest.run(ParDoLoadTest.java:53)
at org.apache.beam.sdk.loadtests.ParDoLoadTest.main(ParDoLoadTest.java:103)
> Task :sdks:java:testing:load-tests:run FAILED
> Task :runners:google-cloud-dataflow-java:cleanUpDockerImages
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210813123736]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:d1bc0cf8732771f6f93929932d1c16855bdf5a3d5adf8c4eadb089ab88939c03]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210813123736] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:d1bc0cf8732771f6f93929932d1c16855bdf5a3d5adf8c4eadb089ab88939c03])].
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:d1bc0cf8732771f6f93929932d1c16855bdf5a3d5adf8c4eadb089ab88939c03
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:d1bc0cf8732771f6f93929932d1c16855bdf5a3d5adf8c4eadb089ab88939c03].
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:testing:load-tests:run'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 3h 25m 50s
107 actionable tasks: 76 executed, 29 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/adnnir5yixwf6
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins:
beam_LoadTests_Java_ParDo_Dataflow_V2_Streaming_Java11 #56
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Java_ParDo_Dataflow_V2_Streaming_Java11/56/display/redirect?page=changes>
Changes:
[marwant] Move misplaced cloud healthcare update info line from template to
[Robert Burke] [BEAM-12738][GoSDK] Fix Dataflow Job URL
[eugene.nikolayev] Fix docs typos in contrib guide.
[noreply] Merge pull request #15126 from [BEAM-12665] Add option in ReadAll
[noreply] Update ptransform.py error message (#15286)
[noreply] [GoSDK Infra] Limit simultaneous tests binaries to 3. (#15321)
------------------------------------------
[...truncated 65.83 KB...]
008922c255cd: Waiting
4b0edb23340c: Preparing
afa3e488a0ee: Preparing
f3d5b8f65132: Waiting
f42aed5f7feb: Waiting
89819bafde36: Waiting
71504cda80c5: Waiting
ad83f0aa5c0a: Waiting
afa3e488a0ee: Waiting
4b0edb23340c: Waiting
5a9a65095453: Waiting
842116369cd6: Pushed
15b842bf1de0: Pushed
4323b1d63813: Pushed
cd7a039ad97e: Pushed
cbf9f95c5490: Pushed
f6e115dc6bf5: Pushed
008922c255cd: Pushed
1cba0d3e128c: Pushed
f42aed5f7feb: Layer already exists
89819bafde36: Layer already exists
f3d5b8f65132: Layer already exists
ad83f0aa5c0a: Layer already exists
5a9a65095453: Layer already exists
4b0edb23340c: Layer already exists
afa3e488a0ee: Layer already exists
c0a1967c1b4e: Pushed
97951656bb45: Pushed
71504cda80c5: Pushed
48133c4c16b9: Pushed
20210812123735: digest: sha256:4712c423ac762676f069194c763e83a30420ea4fcb363570c7692bea2079ab10 size: 4310
> Task :sdks:java:testing:load-tests:run
Aug 12, 2021 12:43:07 PM org.apache.beam.runners.dataflow.options.DataflowPipelineOptions$StagingLocationFactory create
INFO: No stagingLocation provided, falling back to gcpTempLocation
Aug 12, 2021 12:43:08 PM org.apache.beam.runners.dataflow.DataflowRunner fromOptions
INFO: PipelineOptions.filesToStage was not specified. Defaulting to files from the classpath: will stage 191 files. Enable logging at DEBUG level to see which files will be staged.
Aug 12, 2021 12:43:09 PM org.apache.beam.sdk.Pipeline validate
WARNING: The following transforms do not have stable unique names: ParDo(TimeMonitor)
Aug 12, 2021 12:43:09 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Executing pipeline on the Dataflow Service, which will have billing implications related to Google Compute Engine usage and other Google Cloud Services.
Aug 12, 2021 12:43:12 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging portable pipeline proto to gs://temp-storage-for-perf-tests/loadtests/staging/
Aug 12, 2021 12:43:12 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <107841 bytes, hash a38347c75ef79bab1db0f34dce3bf61cb614cca07bdb64d2a68224083ad6322d> to gs://temp-storage-for-perf-tests/loadtests/staging/pipeline-o4NHx173m6sdsPNNzjv2HLYUzKB722TSpoIkCDrWMi0.pb
Aug 12, 2021 12:43:13 PM org.apache.beam.runners.dataflow.util.PackageUtil stageClasspathElements
INFO: Uploading 191 files from PipelineOptions.filesToStage to staging location to prepare for execution.
Aug 12, 2021 12:43:14 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.m2/repository/org/apache/beam/beam-vendor-grpc-1_36_0/0.2/beam-vendor-grpc-1_36_0-0.2.jar to gs://temp-storage-for-perf-tests/loadtests/staging/beam-vendor-grpc-1_36_0-0.2-QDXCYeHsqkBGDv-Ml75SymJ1DE5cLzG9SsQs9d3GLOE.jar
Aug 12, 2021 12:43:15 PM org.apache.beam.runners.dataflow.util.PackageUtil stageClasspathElements
INFO: Staging files complete: 190 files cached, 1 files newly uploaded in 1 seconds
Aug 12, 2021 12:43:15 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Read input/DataflowRunner.StreamingUnboundedRead.ReadWithIds as step s1
Aug 12, 2021 12:43:15 PM org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource split
INFO: Split into 20 bundles of sizes: [org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@6342d610, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@dc4a691, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@784abd3e, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@36c2b646, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@434514d8, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@6b1dc20f, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@4613311f, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@6540cf1d, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@ec8f4b9, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@bc042d5, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@5484117b, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@37df14d1, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@7efb53af, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@7724704f, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@3dfa819, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@4ce94d2f, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@68ab0936, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@3cd9aa64, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@42b84286, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@443effcb]
Aug 12, 2021 12:43:15 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Read input/StripIds as step s2
Aug 12, 2021 12:43:15 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding ParDo(TimeMonitor) as step s3
Aug 12, 2021 12:43:15 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding ParDo(ByteMonitor) as step s4
Aug 12, 2021 12:43:15 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 0 as step s5
Aug 12, 2021 12:43:15 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 1 as step s6
Aug 12, 2021 12:43:15 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 2 as step s7
Aug 12, 2021 12:43:15 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 3 as step s8
Aug 12, 2021 12:43:15 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 4 as step s9
Aug 12, 2021 12:43:15 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 5 as step s10
Aug 12, 2021 12:43:15 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 6 as step s11
Aug 12, 2021 12:43:15 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 7 as step s12
Aug 12, 2021 12:43:15 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 8 as step s13
Aug 12, 2021 12:43:15 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 9 as step s14
Aug 12, 2021 12:43:15 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding ParDo(TimeMonitor)2 as step s15
Aug 12, 2021 12:43:15 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Dataflow SDK version: 2.33.0-SNAPSHOT
Aug 12, 2021 12:43:16 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobs/us-central1/2021-08-12_05_43_15-6974292229836451782?project=apache-beam-testing
Aug 12, 2021 12:43:16 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Submitted job: 2021-08-12_05_43_15-6974292229836451782
Aug 12, 2021 12:43:16 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2021-08-12_05_43_15-6974292229836451782
Aug 12, 2021 12:43:24 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-08-12T12:43:23.626Z: The workflow name is not a valid Cloud Label. Labels applied to Cloud resources (such as GCE Instances) for monitoring will be labeled with this modified job name: load0tests0java110dataflow0v20streaming0pardo01-jenkins-08-9867. For the best monitoring experience, please name your job with a valid Cloud Label. For details, see: https://cloud.google.com/compute/docs/labeling-resources#restrictions
Aug 12, 2021 12:43:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-12T12:43:28.220Z: Worker configuration: e2-standard-2 in us-central1-a.
Aug 12, 2021 12:43:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-12T12:43:28.936Z: Expanding SplittableParDo operations into optimizable parts.
Aug 12, 2021 12:43:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-12T12:43:28.974Z: Expanding CollectionToSingleton operations into optimizable parts.
Aug 12, 2021 12:43:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-12T12:43:29.033Z: Expanding CoGroupByKey operations into optimizable parts.
Aug 12, 2021 12:43:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-12T12:43:29.078Z: Expanding SplittableProcessKeyed operations into optimizable parts.
Aug 12, 2021 12:43:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-12T12:43:29.100Z: Expanding GroupByKey operations into streaming Read/Write steps
Aug 12, 2021 12:43:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-12T12:43:29.128Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
Aug 12, 2021 12:43:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-12T12:43:29.208Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
Aug 12, 2021 12:43:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-12T12:43:29.231Z: Fusing consumer Read input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource) into Read input/Impulse
Aug 12, 2021 12:43:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-12T12:43:29.268Z: Fusing consumer Read-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/PairWithRestriction into Read input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource)
Aug 12, 2021 12:43:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-12T12:43:29.293Z: Fusing consumer Read-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/SplitWithSizing into Read-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/PairWithRestriction
Aug 12, 2021 12:43:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-12T12:43:29.322Z: Fusing consumer Read input/ParDo(StripIds)/ParMultiDo(StripIds) into Read-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/ProcessElementAndRestrictionWithSizing
Aug 12, 2021 12:43:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-12T12:43:29.354Z: Fusing consumer ParDo(TimeMonitor)/ParMultiDo(TimeMonitor) into Read input/ParDo(StripIds)/ParMultiDo(StripIds)
Aug 12, 2021 12:43:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-12T12:43:29.382Z: Fusing consumer ParDo(ByteMonitor)/ParMultiDo(ByteMonitor) into ParDo(TimeMonitor)/ParMultiDo(TimeMonitor)
Aug 12, 2021 12:43:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-12T12:43:29.410Z: Fusing consumer Step: 0/ParMultiDo(CounterOperation) into ParDo(ByteMonitor)/ParMultiDo(ByteMonitor)
Aug 12, 2021 12:43:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-12T12:43:29.446Z: Fusing consumer Step: 1/ParMultiDo(CounterOperation) into Step: 0/ParMultiDo(CounterOperation)
Aug 12, 2021 12:43:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-12T12:43:29.477Z: Fusing consumer Step: 2/ParMultiDo(CounterOperation) into Step: 1/ParMultiDo(CounterOperation)
Aug 12, 2021 12:43:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-12T12:43:29.508Z: Fusing consumer Step: 3/ParMultiDo(CounterOperation) into Step: 2/ParMultiDo(CounterOperation)
Aug 12, 2021 12:43:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-12T12:43:29.542Z: Fusing consumer Step: 4/ParMultiDo(CounterOperation) into Step: 3/ParMultiDo(CounterOperation)
Aug 12, 2021 12:43:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-12T12:43:29.568Z: Fusing consumer Step: 5/ParMultiDo(CounterOperation) into Step: 4/ParMultiDo(CounterOperation)
Aug 12, 2021 12:43:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-12T12:43:29.602Z: Fusing consumer Step: 6/ParMultiDo(CounterOperation) into Step: 5/ParMultiDo(CounterOperation)
Aug 12, 2021 12:43:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-12T12:43:29.644Z: Fusing consumer Step: 7/ParMultiDo(CounterOperation) into Step: 6/ParMultiDo(CounterOperation)
Aug 12, 2021 12:43:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-12T12:43:29.672Z: Fusing consumer Step: 8/ParMultiDo(CounterOperation) into Step: 7/ParMultiDo(CounterOperation)
Aug 12, 2021 12:43:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-12T12:43:29.709Z: Fusing consumer Step: 9/ParMultiDo(CounterOperation) into Step: 8/ParMultiDo(CounterOperation)
Aug 12, 2021 12:43:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-12T12:43:29.731Z: Fusing consumer ParDo(TimeMonitor)2/ParMultiDo(TimeMonitor) into Step: 9/ParMultiDo(CounterOperation)
Aug 12, 2021 12:43:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-12T12:43:30.030Z: Starting 5 ****s in us-central1-a...
Aug 12, 2021 12:43:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-12T12:43:42.102Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete
Aug 12, 2021 12:44:15 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-12T12:44:15.016Z: Autoscaling: Raised the number of ****s to 5 so that the pipeline can catch up with its backlog and keep up with its input rate.
Aug 12, 2021 12:45:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-12T12:45:12.350Z: Workers have started successfully.
Aug 12, 2021 12:45:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-12T12:45:12.381Z: Workers have started successfully.
Aug 12, 2021 2:46:33 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-12T14:46:31.498Z: Staged package error_prone_annotations-2.3.4-uvfW6pfOYGxT4RtoVLpfLOfvXCTd3wr6GNEmC9JbACw.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/error_prone_annotations-2.3.4-uvfW6pfOYGxT4RtoVLpfLOfvXCTd3wr6GNEmC9JbACw.jar' is inaccessible.
Aug 12, 2021 2:46:35 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-08-12T14:46:34.704Z: One or more access checks for temp location or staged files failed. Please refer to other error messages for details. For more information on security and permissions, please see https://cloud.google.com/dataflow/security-and-permissions.
Aug 12, 2021 4:00:46 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-12T16:00:45.957Z: Cancel request is committed for workflow job: 2021-08-12_05_43_15-6974292229836451782.
Aug 12, 2021 4:00:46 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-12T16:00:45.997Z: Cleaning up.
Aug 12, 2021 4:00:46 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-12T16:00:46.066Z: Stopping **** pool...
Aug 12, 2021 4:00:46 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-12T16:00:46.107Z: Stopping **** pool...
Aug 12, 2021 4:03:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-12T16:03:13.176Z: Autoscaling: Reduced the number of ****s to 0 based on low average **** CPU utilization, and the pipeline having sufficiently low backlog and keeping up with input rate.
Aug 12, 2021 4:03:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-12T16:03:13.294Z: Worker pool stopped.
Aug 12, 2021 4:03:20 PM org.apache.beam.runners.dataflow.DataflowPipelineJob logTerminalState
INFO: Job 2021-08-12_05_43_15-6974292229836451782 finished with status CANCELLED.
Aug 12, 2021 4:03:20 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric totalBytes.count, from namespace pardo
Load test results for test (ID): 3bfb02c2-5de6-4ff3-bafc-8cd0a925f1bb and timestamp: 2021-08-12T12:43:08.695000000Z:
Metric: Value:
dataflow_v2_java11_runtime_sec 0.0
dataflow_v2_java11_total_bytes_count -1.0
Exception in thread "main" java.lang.RuntimeException: Invalid job state: CANCELLED.
at org.apache.beam.sdk.loadtests.JobFailure.handleFailure(JobFailure.java:55)
at org.apache.beam.sdk.loadtests.LoadTest.run(LoadTest.java:141)
at org.apache.beam.sdk.loadtests.ParDoLoadTest.run(ParDoLoadTest.java:53)
at org.apache.beam.sdk.loadtests.ParDoLoadTest.main(ParDoLoadTest.java:103)
> Task :sdks:java:testing:load-tests:run FAILED
> Task :runners:google-cloud-dataflow-java:cleanUpDockerImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210812123735
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:4712c423ac762676f069194c763e83a30420ea4fcb363570c7692bea2079ab10
Deleted: sha256:10da4a9f600a82ad3c9541e14c2c32039fcdcc04aa60bec6b66848fd58694631
Deleted: sha256:92b42e8c4277dbddc6cfb2c612351c36d51f195ae7532bd64498316559d23dde
Deleted: sha256:61b746048bf644e49690d42489ca8ce6408a5db55e927c1f671a82be6b14d087
Deleted: sha256:ca6b6e471b6133d8a4c9e62b7bd44e103bdd03bbfc83768b3d98bd169fea1f0b
Deleted: sha256:996fb0c971a457443afaee2f083962df5c88077cb660e7493b31c7fcfbe2da5f
Deleted: sha256:d7e688aed63580ea511e1f41f974a3c41c3217dd579649ffcb09ba034659750f
Deleted: sha256:d5f3ba1c18553abc9a76f2c392bbc4cd1b4e747e1e8074cf0419d9d243f52969
Deleted: sha256:551d82351b12f969f9822497d320e79724ff344324dcd7c83d001164104925eb
Deleted: sha256:b54f9e94e85cdc40acfc6bdf047103191e67307864223a78c0323aef89ac435f
Deleted: sha256:056fc42e3ae2328212de573b22ac50c74d25ae3f1de3f43a091a238beea0cef1
Deleted: sha256:c5cc93f6132514af240360fe9d17987b5f380fec4b9e85ecd264dd2cb083990a
Deleted: sha256:a69216f57b82e615d42a7a83a659a22ce6b167305744fa3b956502badd05f1af
Deleted: sha256:af1a7ac7e756c949ba4c87b2faf9c095fc5b1b9835747c23f17cac15219eb059
Deleted: sha256:0191e7dbfaf6f76af179bd1321158a23be3595bbbe80c1a1ed85d1eda9b5ac0b
Deleted: sha256:105451a729addb8003bfe00ad46e8d85a6b6e7a21097463194a733ede1ccdf94
Deleted: sha256:928a8dc0297fee39e12a820e557a99ebfb658d84740179097b983c2a9c21abb5
Deleted: sha256:caeaf7e6715af98450d38d5d744e101edfe950e4283e96d7802307c3582cdf2d
Deleted: sha256:16cf4bf5d78e2a8e0990f08df24b64476b7d011dde7d50ffa0350cee879f9b4d
Deleted: sha256:cbf15bf87d8c43f17f825542afc38925517f72479f8b74948f30c652df1fc5a6
Deleted: sha256:ebe5a62f4ea7f4c1341ce6633ede0cd2d7a1a5b6ba38f4370042ff6b26be526f
Deleted: sha256:6d11d2cbba3ebd27eaca779f4434e46c69b9840a3c9d19183f3f8643076bbac7
Deleted: sha256:7db1c508a5a915501b9410bd9d506f483c4905d02cb084ac94453b1681407075
Deleted: sha256:f73e04c3b7d11902ea881f657bfb1e195536b786d93a46ecf8768aba407ae5f3
Deleted: sha256:a5552412f960bb6145e72f744ed3e6c8ea4714f8c451041560d44c077326ad1e
Deleted: sha256:ba4b84a36da0ae9173ca57172cfd856a8245defb98459822fc78f549177bad91
Deleted: sha256:ece852423700cebdfb0758e13863622fc24785ff0f2d8ee785433c72bb203bba
Deleted: sha256:d9dfd0b91db4154b69220457cf0c6795926c186fc8da0840922d235ceaf411d3
Deleted: sha256:2a989a55e4fbed4c2c594c2cf3b498712528a04d31f7b7531a80c398be180f61
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210812123735]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:4712c423ac762676f069194c763e83a30420ea4fcb363570c7692bea2079ab10]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210812123735] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:4712c423ac762676f069194c763e83a30420ea4fcb363570c7692bea2079ab10])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:4712c423ac762676f069194c763e83a30420ea4fcb363570c7692bea2079ab10
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:4712c423ac762676f069194c763e83a30420ea4fcb363570c7692bea2079ab10
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:4712c423ac762676f069194c763e83a30420ea4fcb363570c7692bea2079ab10].
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:testing:load-tests:run'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 3h 26m 6s
107 actionable tasks: 76 executed, 29 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/ne5ysk3wcjq46
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins:
beam_LoadTests_Java_ParDo_Dataflow_V2_Streaming_Java11 #55
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Java_ParDo_Dataflow_V2_Streaming_Java11/55/display/redirect?page=changes>
Changes:
[andyxu] Add support for python sdk container to turn on google cloud profiler
[andyxu] format file
[marwant] Update Google Cloud Healthcare API version from v1beta1 to GA
[chamikaramj] Fix typo
[zyichi] Update beam dataflow python container versions.
[noreply] [BEAM-12403][BEAM-12348] Add User State Support for Portable SamzaRunner
------------------------------------------
[...truncated 68.75 KB...]
INFO: Executing pipeline on the Dataflow Service, which will have billing implications related to Google Compute Engine usage and other Google Cloud Services.
Aug 11, 2021 12:43:04 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging portable pipeline proto to gs://temp-storage-for-perf-tests/loadtests/staging/
Aug 11, 2021 12:43:04 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <107841 bytes, hash 01d84f7e5e8263bffe580e14fba687460077d953a582efe8ec6c696d40be7482> to gs://temp-storage-for-perf-tests/loadtests/staging/pipeline-AdhPfl6CY7_-WA4U-6aHRgB32VOlgu_o7GxpbUC-dII.pb
Aug 11, 2021 12:43:05 PM org.apache.beam.runners.dataflow.util.PackageUtil stageClasspathElements
INFO: Uploading 191 files from PipelineOptions.filesToStage to staging location to prepare for execution.
Aug 11, 2021 12:43:07 PM org.apache.beam.runners.dataflow.util.PackageUtil stageClasspathElements
INFO: Staging files complete: 191 files cached, 0 files newly uploaded in 2 seconds
Aug 11, 2021 12:43:07 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Read input/DataflowRunner.StreamingUnboundedRead.ReadWithIds as step s1
Aug 11, 2021 12:43:07 PM org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource split
INFO: Split into 20 bundles of sizes: [org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@6342d610, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@dc4a691, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@784abd3e, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@36c2b646, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@434514d8, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@6b1dc20f, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@4613311f, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@6540cf1d, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@ec8f4b9, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@bc042d5, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@5484117b, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@37df14d1, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@7efb53af, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@7724704f, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@3dfa819, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@4ce94d2f, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@68ab0936, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@3cd9aa64, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@42b84286, org.apache.beam.sdk.io.synthetic.SyntheticUnboundedSource@443effcb]
Aug 11, 2021 12:43:07 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Read input/StripIds as step s2
Aug 11, 2021 12:43:07 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding ParDo(TimeMonitor) as step s3
Aug 11, 2021 12:43:07 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding ParDo(ByteMonitor) as step s4
Aug 11, 2021 12:43:07 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 0 as step s5
Aug 11, 2021 12:43:07 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 1 as step s6
Aug 11, 2021 12:43:07 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 2 as step s7
Aug 11, 2021 12:43:07 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 3 as step s8
Aug 11, 2021 12:43:07 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 4 as step s9
Aug 11, 2021 12:43:07 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 5 as step s10
Aug 11, 2021 12:43:07 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 6 as step s11
Aug 11, 2021 12:43:07 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 7 as step s12
Aug 11, 2021 12:43:07 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 8 as step s13
Aug 11, 2021 12:43:07 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 9 as step s14
Aug 11, 2021 12:43:07 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding ParDo(TimeMonitor)2 as step s15
Aug 11, 2021 12:43:08 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Dataflow SDK version: 2.33.0-SNAPSHOT
Aug 11, 2021 12:43:08 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobs/us-central1/2021-08-11_05_43_08-16348139797564905653?project=apache-beam-testing
Aug 11, 2021 12:43:08 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Submitted job: 2021-08-11_05_43_08-16348139797564905653
Aug 11, 2021 12:43:08 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2021-08-11_05_43_08-16348139797564905653
Aug 11, 2021 12:43:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-08-11T12:43:16.997Z: The workflow name is not a valid Cloud Label. Labels applied to Cloud resources (such as GCE Instances) for monitoring will be labeled with this modified job name: load0tests0java110dataflow0v20streaming0pardo01-jenkins-08-yew8. For the best monitoring experience, please name your job with a valid Cloud Label. For details, see: https://cloud.google.com/compute/docs/labeling-resources#restrictions
Aug 11, 2021 12:43:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-11T12:43:22.531Z: Worker configuration: e2-standard-2 in us-central1-a.
Aug 11, 2021 12:43:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-11T12:43:23.329Z: Expanding SplittableParDo operations into optimizable parts.
Aug 11, 2021 12:43:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-11T12:43:23.359Z: Expanding CollectionToSingleton operations into optimizable parts.
Aug 11, 2021 12:43:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-11T12:43:23.412Z: Expanding CoGroupByKey operations into optimizable parts.
Aug 11, 2021 12:43:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-11T12:43:23.447Z: Expanding SplittableProcessKeyed operations into optimizable parts.
Aug 11, 2021 12:43:24 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-11T12:43:23.471Z: Expanding GroupByKey operations into streaming Read/Write steps
Aug 11, 2021 12:43:24 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-11T12:43:23.498Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
Aug 11, 2021 12:43:24 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-11T12:43:23.571Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
Aug 11, 2021 12:43:24 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-11T12:43:23.591Z: Fusing consumer Read input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource) into Read input/Impulse
Aug 11, 2021 12:43:24 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-11T12:43:23.614Z: Fusing consumer Read-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/PairWithRestriction into Read input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource)
Aug 11, 2021 12:43:24 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-11T12:43:23.638Z: Fusing consumer Read-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/SplitWithSizing into Read-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/PairWithRestriction
Aug 11, 2021 12:43:24 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-11T12:43:23.659Z: Fusing consumer Read input/ParDo(StripIds)/ParMultiDo(StripIds) into Read-input-ParDo-UnboundedSourceAsSDFWrapper--ParMultiDo-UnboundedSourceAsSDFWrapper-/ProcessElementAndRestrictionWithSizing
Aug 11, 2021 12:43:24 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-11T12:43:23.687Z: Fusing consumer ParDo(TimeMonitor)/ParMultiDo(TimeMonitor) into Read input/ParDo(StripIds)/ParMultiDo(StripIds)
Aug 11, 2021 12:43:24 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-11T12:43:23.718Z: Fusing consumer ParDo(ByteMonitor)/ParMultiDo(ByteMonitor) into ParDo(TimeMonitor)/ParMultiDo(TimeMonitor)
Aug 11, 2021 12:43:24 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-11T12:43:23.746Z: Fusing consumer Step: 0/ParMultiDo(CounterOperation) into ParDo(ByteMonitor)/ParMultiDo(ByteMonitor)
Aug 11, 2021 12:43:24 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-11T12:43:23.769Z: Fusing consumer Step: 1/ParMultiDo(CounterOperation) into Step: 0/ParMultiDo(CounterOperation)
Aug 11, 2021 12:43:24 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-11T12:43:23.790Z: Fusing consumer Step: 2/ParMultiDo(CounterOperation) into Step: 1/ParMultiDo(CounterOperation)
Aug 11, 2021 12:43:24 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-11T12:43:23.817Z: Fusing consumer Step: 3/ParMultiDo(CounterOperation) into Step: 2/ParMultiDo(CounterOperation)
Aug 11, 2021 12:43:24 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-11T12:43:23.839Z: Fusing consumer Step: 4/ParMultiDo(CounterOperation) into Step: 3/ParMultiDo(CounterOperation)
Aug 11, 2021 12:43:24 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-11T12:43:23.885Z: Fusing consumer Step: 5/ParMultiDo(CounterOperation) into Step: 4/ParMultiDo(CounterOperation)
Aug 11, 2021 12:43:24 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-11T12:43:23.912Z: Fusing consumer Step: 6/ParMultiDo(CounterOperation) into Step: 5/ParMultiDo(CounterOperation)
Aug 11, 2021 12:43:24 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-11T12:43:23.934Z: Fusing consumer Step: 7/ParMultiDo(CounterOperation) into Step: 6/ParMultiDo(CounterOperation)
Aug 11, 2021 12:43:24 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-11T12:43:23.968Z: Fusing consumer Step: 8/ParMultiDo(CounterOperation) into Step: 7/ParMultiDo(CounterOperation)
Aug 11, 2021 12:43:24 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-11T12:43:23.995Z: Fusing consumer Step: 9/ParMultiDo(CounterOperation) into Step: 8/ParMultiDo(CounterOperation)
Aug 11, 2021 12:43:24 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-11T12:43:24.017Z: Fusing consumer ParDo(TimeMonitor)2/ParMultiDo(TimeMonitor) into Step: 9/ParMultiDo(CounterOperation)
Aug 11, 2021 12:43:24 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-11T12:43:24.336Z: Starting 5 ****s in us-central1-a...
Aug 11, 2021 12:43:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-11T12:43:42.067Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete
Aug 11, 2021 12:44:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-11T12:44:11.577Z: Autoscaling: Raised the number of ****s to 5 so that the pipeline can catch up with its backlog and keep up with its input rate.
Aug 11, 2021 12:45:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-11T12:45:07.334Z: Workers have started successfully.
Aug 11, 2021 12:45:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-11T12:45:07.380Z: Workers have started successfully.
Aug 11, 2021 2:25:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-11T14:25:24.707Z: Staged package aws-java-sdk-cloudwatch-1.11.974-Ub2yicrz1p27ushPndFcVBigc3SuIZ4G-Yaq45B1iUo.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/aws-java-sdk-cloudwatch-1.11.974-Ub2yicrz1p27ushPndFcVBigc3SuIZ4G-Yaq45B1iUo.jar' is inaccessible.
Aug 11, 2021 2:25:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-11T14:25:24.799Z: Staged package aws-java-sdk-core-1.11.974-s3lPhICKsq1xExGOyj03VQHRqOsuX5YUc-UUlnhiA64.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/aws-java-sdk-core-1.11.974-s3lPhICKsq1xExGOyj03VQHRqOsuX5YUc-UUlnhiA64.jar' is inaccessible.
Aug 11, 2021 2:25:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-11T14:25:24.847Z: Staged package aws-java-sdk-dynamodb-1.11.974-RLvIDrX-TDIDN06gNnaHm9dQbuHCD_XSBesOuniSTk4.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/aws-java-sdk-dynamodb-1.11.974-RLvIDrX-TDIDN06gNnaHm9dQbuHCD_XSBesOuniSTk4.jar' is inaccessible.
Aug 11, 2021 2:25:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-11T14:25:24.890Z: Staged package aws-java-sdk-kinesis-1.11.974-kbU_CjbRpkrhhFeoyIMQA81nTYmniJY77w8Smd7PLpY.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/aws-java-sdk-kinesis-1.11.974-kbU_CjbRpkrhhFeoyIMQA81nTYmniJY77w8Smd7PLpY.jar' is inaccessible.
Aug 11, 2021 2:25:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-11T14:25:24.930Z: Staged package aws-java-sdk-kms-1.11.974-HWH_mHclw3Wv4_GJ56x62xFDHSPSkZWjeKAlx40XrTk.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/aws-java-sdk-kms-1.11.974-HWH_mHclw3Wv4_GJ56x62xFDHSPSkZWjeKAlx40XrTk.jar' is inaccessible.
Aug 11, 2021 2:25:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-11T14:25:24.983Z: Staged package aws-java-sdk-s3-1.11.974-Qgd0wgaOuI_uyxxQI4Ulljk9bZEq-3JZArQF0zU5yzA.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/aws-java-sdk-s3-1.11.974-Qgd0wgaOuI_uyxxQI4Ulljk9bZEq-3JZArQF0zU5yzA.jar' is inaccessible.
Aug 11, 2021 2:25:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-11T14:25:25.814Z: Staged package commons-io-2.6--HfTBGYKwqFC84ZbrfyXHex-1zx0fH-NXS9ROcpzZRM.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/commons-io-2.6--HfTBGYKwqFC84ZbrfyXHex-1zx0fH-NXS9ROcpzZRM.jar' is inaccessible.
Aug 11, 2021 2:25:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-11T14:25:25.854Z: Staged package commons-lang-2.6-UPEbCfh3wpTVbyRGP0fSj5Kc9QRPZIZhwPDPuumi9Jw.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/commons-lang-2.6-UPEbCfh3wpTVbyRGP0fSj5Kc9QRPZIZhwPDPuumi9Jw.jar' is inaccessible.
Aug 11, 2021 2:25:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-11T14:25:27.324Z: Staged package ion-java-1.0.2-DRJ7IFofzgq8KjdXoEF0hlG8ZsFc9MBZusWDOyfUcaU.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/ion-java-1.0.2-DRJ7IFofzgq8KjdXoEF0hlG8ZsFc9MBZusWDOyfUcaU.jar' is inaccessible.
Aug 11, 2021 2:25:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-11T14:25:27.575Z: Staged package jmespath-java-1.11.974-QaUt5Hnw6wd7ULTQ5Oj4j_zpRr-rnMCdfGwiwkSo8-0.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/jmespath-java-1.11.974-QaUt5Hnw6wd7ULTQ5Oj4j_zpRr-rnMCdfGwiwkSo8-0.jar' is inaccessible.
Aug 11, 2021 2:25:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-08-11T14:25:28.636Z: One or more access checks for temp location or staged files failed. Please refer to other error messages for details. For more information on security and permissions, please see https://cloud.google.com/dataflow/security-and-permissions.
Aug 11, 2021 2:28:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-08-11T14:28:28.544Z: One or more access checks for temp location or staged files failed. Please refer to other error messages for details. For more information on security and permissions, please see https://cloud.google.com/dataflow/security-and-permissions.
Aug 11, 2021 2:31:25 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-11T14:31:24.857Z: Staged package aws-java-sdk-cloudwatch-1.11.974-Ub2yicrz1p27ushPndFcVBigc3SuIZ4G-Yaq45B1iUo.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/aws-java-sdk-cloudwatch-1.11.974-Ub2yicrz1p27ushPndFcVBigc3SuIZ4G-Yaq45B1iUo.jar' is inaccessible.
Aug 11, 2021 2:31:25 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-11T14:31:24.934Z: Staged package aws-java-sdk-core-1.11.974-s3lPhICKsq1xExGOyj03VQHRqOsuX5YUc-UUlnhiA64.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/aws-java-sdk-core-1.11.974-s3lPhICKsq1xExGOyj03VQHRqOsuX5YUc-UUlnhiA64.jar' is inaccessible.
Aug 11, 2021 2:31:25 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-11T14:31:24.994Z: Staged package aws-java-sdk-dynamodb-1.11.974-RLvIDrX-TDIDN06gNnaHm9dQbuHCD_XSBesOuniSTk4.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/aws-java-sdk-dynamodb-1.11.974-RLvIDrX-TDIDN06gNnaHm9dQbuHCD_XSBesOuniSTk4.jar' is inaccessible.
Aug 11, 2021 2:31:25 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-11T14:31:25.061Z: Staged package aws-java-sdk-kinesis-1.11.974-kbU_CjbRpkrhhFeoyIMQA81nTYmniJY77w8Smd7PLpY.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/aws-java-sdk-kinesis-1.11.974-kbU_CjbRpkrhhFeoyIMQA81nTYmniJY77w8Smd7PLpY.jar' is inaccessible.
Aug 11, 2021 2:31:25 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-11T14:31:25.128Z: Staged package aws-java-sdk-kms-1.11.974-HWH_mHclw3Wv4_GJ56x62xFDHSPSkZWjeKAlx40XrTk.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/aws-java-sdk-kms-1.11.974-HWH_mHclw3Wv4_GJ56x62xFDHSPSkZWjeKAlx40XrTk.jar' is inaccessible.
Aug 11, 2021 2:31:25 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-11T14:31:25.183Z: Staged package aws-java-sdk-s3-1.11.974-Qgd0wgaOuI_uyxxQI4Ulljk9bZEq-3JZArQF0zU5yzA.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/aws-java-sdk-s3-1.11.974-Qgd0wgaOuI_uyxxQI4Ulljk9bZEq-3JZArQF0zU5yzA.jar' is inaccessible.
Aug 11, 2021 2:31:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-11T14:31:25.995Z: Staged package commons-io-2.6--HfTBGYKwqFC84ZbrfyXHex-1zx0fH-NXS9ROcpzZRM.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/commons-io-2.6--HfTBGYKwqFC84ZbrfyXHex-1zx0fH-NXS9ROcpzZRM.jar' is inaccessible.
Aug 11, 2021 2:31:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-11T14:31:26.041Z: Staged package commons-lang-2.6-UPEbCfh3wpTVbyRGP0fSj5Kc9QRPZIZhwPDPuumi9Jw.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/commons-lang-2.6-UPEbCfh3wpTVbyRGP0fSj5Kc9QRPZIZhwPDPuumi9Jw.jar' is inaccessible.
Aug 11, 2021 2:31:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-11T14:31:27.904Z: Staged package ion-java-1.0.2-DRJ7IFofzgq8KjdXoEF0hlG8ZsFc9MBZusWDOyfUcaU.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/ion-java-1.0.2-DRJ7IFofzgq8KjdXoEF0hlG8ZsFc9MBZusWDOyfUcaU.jar' is inaccessible.
Aug 11, 2021 2:31:29 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-08-11T14:31:28.207Z: Staged package jmespath-java-1.11.974-QaUt5Hnw6wd7ULTQ5Oj4j_zpRr-rnMCdfGwiwkSo8-0.jar at location 'gs://temp-storage-for-perf-tests/loadtests/staging/jmespath-java-1.11.974-QaUt5Hnw6wd7ULTQ5Oj4j_zpRr-rnMCdfGwiwkSo8-0.jar' is inaccessible.
Aug 11, 2021 2:31:29 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2021-08-11T14:31:29.499Z: One or more access checks for temp location or staged files failed. Please refer to other error messages for details. For more information on security and permissions, please see https://cloud.google.com/dataflow/security-and-permissions.
Aug 11, 2021 4:00:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-11T16:00:44.128Z: Cancel request is committed for workflow job: 2021-08-11_05_43_08-16348139797564905653.
Aug 11, 2021 4:00:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-11T16:00:44.176Z: Cleaning up.
Aug 11, 2021 4:00:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-11T16:00:44.241Z: Stopping **** pool...
Aug 11, 2021 4:00:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-11T16:00:44.297Z: Stopping **** pool...
Aug 11, 2021 4:03:07 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-11T16:03:06.338Z: Autoscaling: Reduced the number of ****s to 0 based on low average **** CPU utilization, and the pipeline having sufficiently low backlog and keeping up with input rate.
Aug 11, 2021 4:03:07 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-08-11T16:03:06.381Z: Worker pool stopped.
Aug 11, 2021 4:03:13 PM org.apache.beam.runners.dataflow.DataflowPipelineJob logTerminalState
INFO: Job 2021-08-11_05_43_08-16348139797564905653 finished with status CANCELLED.
Aug 11, 2021 4:03:13 PM org.apache.beam.sdk.testutils.metrics.MetricsReader getCounterMetric
SEVERE: Failed to get metric totalBytes.count, from namespace pardo
Load test results for test (ID): e44b22a8-573c-4b9c-bd48-a5a32b5c51f2 and timestamp: 2021-08-11T12:43:00.512000000Z:
Metric: Value:
dataflow_v2_java11_runtime_sec 0.0
dataflow_v2_java11_total_bytes_count -1.0
Exception in thread "main" java.lang.RuntimeException: Invalid job state: CANCELLED.
at org.apache.beam.sdk.loadtests.JobFailure.handleFailure(JobFailure.java:55)
at org.apache.beam.sdk.loadtests.LoadTest.run(LoadTest.java:141)
at org.apache.beam.sdk.loadtests.ParDoLoadTest.run(ParDoLoadTest.java:53)
at org.apache.beam.sdk.loadtests.ParDoLoadTest.main(ParDoLoadTest.java:103)
> Task :sdks:java:testing:load-tests:run FAILED
> Task :runners:google-cloud-dataflow-java:cleanUpDockerImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210811123735
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:b3e9b01b7e9f7a0a0103494426627606154ded3dcd26a926e87b1830cdf25981
Deleted: sha256:66c6627c55ba301e94ca741656548295090f3fab70862cc3b8273a54b39b7beb
Deleted: sha256:92c66b9ee7749f1a1c97d91cd75c4cde8cc374d5020c5346eb26f88cc2605736
Deleted: sha256:3a1b4e6dd5f7fee7577cdd4995e309a0b6cb6988e915f4488a99a72891f95085
Deleted: sha256:9b699c1e1347a4afa626171e3ff773054ecb6e2f8634229b50b48e0c12a9bbc0
Deleted: sha256:6382cd861933f91a82894c8273e68539c98e5fefeb55e96e4e942840a484f065
Deleted: sha256:808818194bff09d6e1d460f991cd9bb8778f7c75d594aa384e944ca8f6a8984b
Deleted: sha256:c408e9c6d281c78f9d30e0516031964427f60aaef3bda1c7cd35ab62e4c6269d
Deleted: sha256:6c424a318c0ab8cad53ab4b040d562b701ffc7b34d4c18499584fc62774db9cf
Deleted: sha256:2967bbc7b15237f9f5ceb133602bac796f8b89a2cffa2d1f7dad933d820f5bc4
Deleted: sha256:d58e51fc13b24ec8750d6c5dcb57a9c7a7f35438240dc15a8aaffed563890762
Deleted: sha256:262097195bd44f26da35efbc0849e6e0d21493c771efc83eb6607cf62591cd04
Deleted: sha256:0a12a61ed3617dcf12c911e6903ca04b384491f0aeca02bee9cc1be89472167c
Deleted: sha256:51e5632ec08fdfd276acc6ca217914694a1480a82bf21dad0b5c56eddee17543
Deleted: sha256:966114a541fde11dc31d3c2ef7893dad4a2b7e9bd394aac93743596e4287a687
Deleted: sha256:a5c70c5b0e5c7d83c6c93c8f1dc0a486a2be0547f92f3822c37f74d4e2695b77
Deleted: sha256:b148b2096c5b8d92bbdc192f0a0493d938c9d1e65812b68a966f1bc1fcb6c807
Deleted: sha256:b31f92e22d28bdcf3e408cb933f02d8c903f7ae6bfc140d8fbfeda03296a47dc
Deleted: sha256:f766133d23897123a9c1c0bbe581cbc6c9cb4c89333762a1800bfcb0a7d89b9e
Deleted: sha256:be0701f41c56bcd3febff41895bbeba2d5ede67a368a1cb98c8cd570a21b3f5d
Deleted: sha256:80449b2c23bf830bb82d363b235c3be963d8a6f609a6fc1d2ecd070f4536f155
Deleted: sha256:fdcda69db5af937de5f5d7de572ca6832d519bd36efaa60b76d93c1a05e1a9f5
Deleted: sha256:f8193691aea946fc19440044b90c8503d73aa52247a502002a0276e9c74e0e65
Deleted: sha256:cd0a4e67aaaa7e8715bc0e1d5defab74cdf59f382939937a099dc11297c238da
Deleted: sha256:8d5bb0b0fc1a195145301f8c99891db73836a9521c0f01f055ed6844c78cde56
Deleted: sha256:f24cfb0265722a048f7d2b2b06001bf842fa921c4112c6f51627841f149a1ea5
Deleted: sha256:ede3add900e115ab2f4d5dd4cb6fa8b54b9877c10881e5c5c99c4daaa0ea1c82
Deleted: sha256:88e3ee0ecc14dc594c337eb1c44ee0d66b030ec74f1d159dde2ec0d50347cceb
Deleted: sha256:03ac0b20c60f37fca69e5395104ec05650bc5edbe4560c5f548b0a000d32523d
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210811123735]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:b3e9b01b7e9f7a0a0103494426627606154ded3dcd26a926e87b1830cdf25981]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210811123735] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:b3e9b01b7e9f7a0a0103494426627606154ded3dcd26a926e87b1830cdf25981])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:b3e9b01b7e9f7a0a0103494426627606154ded3dcd26a926e87b1830cdf25981
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:b3e9b01b7e9f7a0a0103494426627606154ded3dcd26a926e87b1830cdf25981
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:b3e9b01b7e9f7a0a0103494426627606154ded3dcd26a926e87b1830cdf25981].
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:testing:load-tests:run'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 3h 25m 57s
107 actionable tasks: 79 executed, 26 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/ybvnmxrb6ausg
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org