You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2020/12/18 11:24:06 UTC
Build failed in Jenkins: beam_PostRelease_NightlySnapshot #1213
See <https://ci-beam.apache.org/job/beam_PostRelease_NightlySnapshot/1213/display/redirect?page=changes>
Changes:
[samuelw] [BEAM-11300] Improve Nexmark performance:
[Pablo Estrada] Cleanup directory with SVN repo for PMC members
[Pablo Estrada] Adding combiner packing optimization for Portable Runner
[noreply] [Beam-11002] Fixes BufferOverflowException in XMLReader (#13513)
[Pablo Estrada] fix formatting
[Udi Meiri] [BEAM-10658] Update website to recommend the right version
[noreply] Rewrite container docs for custom containers (#13420)
[noreply] [BEAM-11458] Upgrade SamzRunner to Samza 1.5 (#13550)
[noreply] Add DataFrame Preview announcment blog post (#13561)
[noreply] Dataframe docs (#13560)
------------------------------------------
[...truncated 3.87 MB...]
Waiting on bqjob_r911ec1bc2cfa88c_000001767595efb9_1 ... (12s) Current status: PENDING
Waiting on bqjob_r911ec1bc2cfa88c_000001767595efb9_1 ... (13s) Current status: PENDING
Waiting on bqjob_r911ec1bc2cfa88c_000001767595efb9_1 ... (14s) Current status: PENDING
Waiting on bqjob_r911ec1bc2cfa88c_000001767595efb9_1 ... (15s) Current status: PENDING
Waiting on bqjob_r911ec1bc2cfa88c_000001767595efb9_1 ... (16s) Current status: PENDING
Waiting on bqjob_r911ec1bc2cfa88c_000001767595efb9_1 ... (17s) Current status: PENDING
Waiting on bqjob_r911ec1bc2cfa88c_000001767595efb9_1 ... (18s) Current status: PENDING
Waiting on bqjob_r911ec1bc2cfa88c_000001767595efb9_1 ... (19s) Current status: PENDING
Waiting on bqjob_r911ec1bc2cfa88c_000001767595efb9_1 ... (20s) Current status: PENDING
Waiting on bqjob_r911ec1bc2cfa88c_000001767595efb9_1 ... (21s) Current status: PENDING
Waiting on bqjob_r911ec1bc2cfa88c_000001767595efb9_1 ... (22s) Current status: PENDING
Waiting on bqjob_r911ec1bc2cfa88c_000001767595efb9_1 ... (23s) Current status: PENDING
Waiting on bqjob_r911ec1bc2cfa88c_000001767595efb9_1 ... (24s) Current status: PENDING
Waiting on bqjob_r911ec1bc2cfa88c_000001767595efb9_1 ... (25s) Current status: PENDING
Waiting on bqjob_r911ec1bc2cfa88c_000001767595efb9_1 ... (26s) Current status: PENDING
Waiting on bqjob_r911ec1bc2cfa88c_000001767595efb9_1 ... (27s) Current status: PENDING
Waiting on bqjob_r911ec1bc2cfa88c_000001767595efb9_1 ... (28s) Current status: PENDING
Waiting on bqjob_r911ec1bc2cfa88c_000001767595efb9_1 ... (29s) Current status: PENDING
Waiting on bqjob_r911ec1bc2cfa88c_000001767595efb9_1 ... (30s) Current status: PENDING
Waiting on bqjob_r911ec1bc2cfa88c_000001767595efb9_1 ... (31s) Current status: PENDING
Dec 18, 2020 11:22:43 AM org.apache.beam.sdk.io.gcp.bigquery.StreamingWriteFn logPercentiles
INFO: Total number of streaming insert requests: 3, P99: 159ms, P90: 154ms, P50: 50ms
Dec 18, 2020 11:22:43 AM org.apache.beam.sdk.io.gcp.bigquery.StreamingWriteFn logPercentiles
INFO: Total number of streaming insert requests: 2, P99: 160ms, P90: 156ms, P50: 80ms
Dec 18, 2020 11:22:43 AM org.apache.beam.sdk.io.gcp.bigquery.StreamingWriteFn logPercentiles
INFO: Total number of streaming insert requests: 3, P99: 139ms, P90: 134ms, P50: 90ms
Waiting on bqjob_r911ec1bc2cfa88c_000001767595efb9_1 ... (32s) Current status: PENDING
Waiting on bqjob_r911ec1bc2cfa88c_000001767595efb9_1 ... (33s) Current status: PENDING
Waiting on bqjob_r911ec1bc2cfa88c_000001767595efb9_1 ... (34s) Current status: PENDING
Waiting on bqjob_r911ec1bc2cfa88c_000001767595efb9_1 ... (35s) Current status: PENDING
Waiting on bqjob_r911ec1bc2cfa88c_000001767595efb9_1 ... (36s) Current status: PENDING
Dec 18, 2020 11:22:49 AM org.apache.beam.sdk.io.gcp.bigquery.StreamingWriteFn logPercentiles
INFO: Total number of streaming insert requests: 3, P99: 159ms, P90: 154ms, P50: 70ms
Waiting on bqjob_r911ec1bc2cfa88c_000001767595efb9_1 ... (37s) Current status: PENDING
Waiting on bqjob_r911ec1bc2cfa88c_000001767595efb9_1 ... (38s) Current status: PENDING
Waiting on bqjob_r911ec1bc2cfa88c_000001767595efb9_1 ... (39s) Current status: PENDING
Waiting on bqjob_r911ec1bc2cfa88c_000001767595efb9_1 ... (40s) Current status: PENDING
Waiting on bqjob_r911ec1bc2cfa88c_000001767595efb9_1 ... (41s) Current status: PENDING
Waiting on bqjob_r911ec1bc2cfa88c_000001767595efb9_1 ... (42s) Current status: PENDING
Waiting on bqjob_r911ec1bc2cfa88c_000001767595efb9_1 ... (43s) Current status: PENDING
Waiting on bqjob_r911ec1bc2cfa88c_000001767595efb9_1 ... (44s) Current status: PENDING
Waiting on bqjob_r911ec1bc2cfa88c_000001767595efb9_1 ... (45s) Current status: PENDING
Waiting on bqjob_r911ec1bc2cfa88c_000001767595efb9_1 ... (46s) Current status: PENDING
Waiting on bqjob_r911ec1bc2cfa88c_000001767595efb9_1 ... (47s) Current status: PENDING
Waiting on bqjob_r911ec1bc2cfa88c_000001767595efb9_1 ... (49s) Current status: PENDING
Waiting on bqjob_r911ec1bc2cfa88c_000001767595efb9_1 ... (50s) Current status: PENDING
Waiting on bqjob_r911ec1bc2cfa88c_000001767595efb9_1 ... (51s) Current status: PENDING
Waiting on bqjob_r911ec1bc2cfa88c_000001767595efb9_1 ... (52s) Current status: PENDING
Waiting on bqjob_r911ec1bc2cfa88c_000001767595efb9_1 ... (53s) Current status: PENDING
Waiting on bqjob_r911ec1bc2cfa88c_000001767595efb9_1 ... (54s) Current status: PENDING
Waiting on bqjob_r911ec1bc2cfa88c_000001767595efb9_1 ... (55s) Current status: PENDING
Waiting on bqjob_r911ec1bc2cfa88c_000001767595efb9_1 ... (56s) Current status: PENDING
Waiting on bqjob_r911ec1bc2cfa88c_000001767595efb9_1 ... (57s) Current status: PENDING
Waiting on bqjob_r911ec1bc2cfa88c_000001767595efb9_1 ... (58s) Current status: PENDING
Waiting on bqjob_r911ec1bc2cfa88c_000001767595efb9_1 ... (59s) Current status: PENDING
Waiting on bqjob_r911ec1bc2cfa88c_000001767595efb9_1 ... (60s) Current status: PENDING
Waiting on bqjob_r911ec1bc2cfa88c_000001767595efb9_1 ... (61s) Current status: PENDING
Waiting on bqjob_r911ec1bc2cfa88c_000001767595efb9_1 ... (62s) Current status: PENDING
Waiting on bqjob_r911ec1bc2cfa88c_000001767595efb9_1 ... (63s) Current status: PENDING
Waiting on bqjob_r911ec1bc2cfa88c_000001767595efb9_1 ... (64s) Current status: PENDING
Waiting on bqjob_r911ec1bc2cfa88c_000001767595efb9_1 ... (65s) Current status: PENDING
Waiting on bqjob_r911ec1bc2cfa88c_000001767595efb9_1 ... (66s) Current status: PENDING
Waiting on bqjob_r911ec1bc2cfa88c_000001767595efb9_1 ... (67s) Current status: PENDING
Waiting on bqjob_r911ec1bc2cfa88c_000001767595efb9_1 ... (68s) Current status: PENDING
Waiting on bqjob_r911ec1bc2cfa88c_000001767595efb9_1 ... (69s) Current status: PENDING
Waiting on bqjob_r911ec1bc2cfa88c_000001767595efb9_1 ... (70s) Current status: PENDING
Waiting on bqjob_r911ec1bc2cfa88c_000001767595efb9_1 ... (71s) Current status: PENDING
Waiting on bqjob_r911ec1bc2cfa88c_000001767595efb9_1 ... (72s) Current status: PENDING
Waiting on bqjob_r911ec1bc2cfa88c_000001767595efb9_1 ... (73s) Current status: PENDING
Waiting on bqjob_r911ec1bc2cfa88c_000001767595efb9_1 ... (74s) Current status: PENDING
............................................................................................................................................................................................................................................................................................................................................................DELAY(483525, 1)
{timestamp_ms=1608290123000}
late data for: user13_AliceBlueQuokka,AliceBlueQuokka,8,1608290123000,2020-12-18 03:23:26.758
Waiting on bqjob_r911ec1bc2cfa88c_000001767595efb9_1 ... (75s) Current status: PENDING
Waiting on bqjob_r911ec1bc2cfa88c_000001767595efb9_1 ... (76s) Current status: PENDING
Waiting on bqjob_r911ec1bc2cfa88c_000001767595efb9_1 ... (77s) Current status: PENDING
Waiting on bqjob_r911ec1bc2cfa88c_000001767595efb9_1 ... (78s) Current status: PENDING
Waiting on bqjob_r911ec1bc2cfa88c_000001767595efb9_1 ... (79s) Current status: PENDING
Waiting on bqjob_r911ec1bc2cfa88c_000001767595efb9_1 ... (80s) Current status: PENDING
Waiting on bqjob_r911ec1bc2cfa88c_000001767595efb9_1 ... (81s) Current status: PENDING
Waiting on bqjob_r911ec1bc2cfa88c_000001767595efb9_1 ... (82s) Current status: PENDING
Waiting on bqjob_r911ec1bc2cfa88c_000001767595efb9_1 ... (83s) Current status: PENDING
Waiting on bqjob_r911ec1bc2cfa88c_000001767595efb9_1 ... (84s) Current status: PENDING
Waiting on bqjob_r911ec1bc2cfa88c_000001767595efb9_1 ... (85s) Current status: PENDING
Waiting on bqjob_r911ec1bc2cfa88c_000001767595efb9_1 ... (86s) Current status: PENDING
Waiting on bqjob_r911ec1bc2cfa88c_000001767595efb9_1 ... (87s) Current status: PENDING
Waiting on bqjob_r911ec1bc2cfa88c_000001767595efb9_1 ... (88s) Current status: PENDING
Waiting on bqjob_r911ec1bc2cfa88c_000001767595efb9_1 ... (89s) Current status: PENDING
Waiting on bqjob_r911ec1bc2cfa88c_000001767595efb9_1 ... (90s) Current status: PENDING
Waiting on bqjob_r911ec1bc2cfa88c_000001767595efb9_1 ... (91s) Current status: PENDING
Waiting on bqjob_r911ec1bc2cfa88c_000001767595efb9_1 ... (92s) Current status: PENDING
Waiting on bqjob_r911ec1bc2cfa88c_000001767595efb9_1 ... (93s) Current status: PENDING
Waiting on bqjob_r911ec1bc2cfa88c_000001767595efb9_1 ... (94s) Current status: PENDING
Waiting on bqjob_r911ec1bc2cfa88c_000001767595efb9_1 ... (95s) Current status: PENDING
Waiting on bqjob_r911ec1bc2cfa88c_000001767595efb9_1 ... (96s) Current status: PENDING
Waiting on bqjob_r911ec1bc2cfa88c_000001767595efb9_1 ... (97s) Current status: PENDING
Waiting on bqjob_r911ec1bc2cfa88c_000001767595efb9_1 ... (98s) Current status: PENDING
Waiting on bqjob_r911ec1bc2cfa88c_000001767595efb9_1 ... (99s) Current status: PENDING
Waiting on bqjob_r911ec1bc2cfa88c_000001767595efb9_1 ... (100s) Current status: PENDING
Waiting on bqjob_r911ec1bc2cfa88c_000001767595efb9_1 ... (101s) Current status: PENDING
Waiting on bqjob_r911ec1bc2cfa88c_000001767595efb9_1 ... (102s) Current status: PENDING
Waiting on bqjob_r911ec1bc2cfa88c_000001767595efb9_1 ... (103s) Current status: PENDING
Waiting on bqjob_r911ec1bc2cfa88c_000001767595efb9_1 ... (104s) Current status: PENDING
Waiting on bqjob_r911ec1bc2cfa88c_000001767595efb9_1 ... (105s) Current status: PENDING
Waiting on bqjob_r911ec1bc2cfa88c_000001767595efb9_1 ... (106s) Current status: PENDING
Waiting on bqjob_r911ec1bc2cfa88c_000001767595efb9_1 ... (107s) Current status: PENDING
Waiting on bqjob_r911ec1bc2cfa88c_000001767595efb9_1 ... (108s) Current status: PENDING
Waiting on bqjob_r911ec1bc2cfa88c_000001767595efb9_1 ... (108s) Current status: DONE
+--------------------------+
| user |
+--------------------------+
| user1_RubyNumbat |
| user1_BeigePlatypus |
| user9_AuburnEmu |
| user1_AquaNumbat |
| user1_AliceBlueKangaroo |
| user7_ArmyGreenMarmot |
| user3_AquaNumbat |
| user11_AquaNumbat |
| user3_AppleGreenCaneToad |
| user8_BeigePlatypus |
+--------------------------+
Verified AliceBlue
**************************************
* SUCCESS: LeaderBoard successfully run on DirectRunner.
**************************************
[SUCCESS]
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:runMobileGamingJavaDataflow'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 23m 42s
8 actionable tasks: 7 executed, 1 from cache
Publishing build scan...
https://gradle.com/s/icwn6uknxctzq
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal : beam_PostRelease_NightlySnapshot
#1215
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostRelease_NightlySnapshot/1215/display/redirect>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostRelease_NightlySnapshot #1214
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostRelease_NightlySnapshot/1214/display/redirect?page=changes>
Changes:
[Kyle Weaver] [BEAM-10925] Create ZetaSQL-specific subclass of ScalarFunctionImpl that
[Kyle Weaver] Make createUd(a)fOperator methods package-private.
[je.ik] [BEAM-11481] emit output watermark on watermark hold change
[Kyle Weaver] [BEAM-10925] SQL AggregateFn: Separate mutable accumulator from
[noreply] [BEAM-11329]:HDFS not deduplicating identical configuration paths
------------------------------------------
[...truncated 3.99 MB...]
Dec 19, 2020 11:42:58 AM org.apache.beam.runners.dataflow.DataflowRunner fromOptions
INFO: PipelineOptions.filesToStage was not specified. Defaulting to files from the classpath: will stage 216 files. Enable logging at DEBUG level to see which files will be staged.
Dec 19, 2020 11:43:00 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Executing pipeline on the Dataflow Service, which will have billing implications related to Google Compute Engine usage and other Google Cloud Services.
Dec 19, 2020 11:43:02 AM org.apache.beam.runners.dataflow.util.PackageUtil stageClasspathElements
INFO: Uploading 216 files from PipelineOptions.filesToStage to staging location to prepare for execution.
Dec 19, 2020 11:43:03 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /tmp/classes4414957115386405805.zip to gs://temp-storage-for-release-validation-tests/nightly-snapshot-validation/tmp/staging/classes-sAGHshJVr1CJmf1PXVGLhGuoVYvGaYcxeQoMRdLfkag.jar
Dec 19, 2020 11:43:04 AM org.apache.beam.runners.dataflow.util.PackageUtil stageClasspathElements
INFO: Staging files complete: 215 files cached, 1 files newly uploaded in 1 seconds
Dec 19, 2020 11:43:04 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding ReadLines/Read as step s1
Dec 19, 2020 11:43:04 AM org.apache.beam.sdk.io.FileBasedSource getEstimatedSizeBytes
INFO: Filepattern gs://apache-beam-samples/shakespeare/* matched 44 files with total size 5443510
Dec 19, 2020 11:43:04 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding WordCount.CountWords/ParDo(ExtractWords) as step s2
Dec 19, 2020 11:43:04 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding WordCount.CountWords/Count.PerElement/Init/Map as step s3
Dec 19, 2020 11:43:04 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding WordCount.CountWords/Count.PerElement/Combine.perKey(Count)/GroupByKey as step s4
Dec 19, 2020 11:43:04 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding WordCount.CountWords/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues as step s5
Dec 19, 2020 11:43:05 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding MapElements/Map as step s6
Dec 19, 2020 11:43:05 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding WriteCounts/WriteFiles/RewindowIntoGlobal/Window.Assign as step s7
Dec 19, 2020 11:43:05 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding WriteCounts/WriteFiles/WriteUnshardedBundlesToTempFiles/WriteUnshardedBundles as step s8
Dec 19, 2020 11:43:05 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding WriteCounts/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten as step s9
Dec 19, 2020 11:43:05 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding WriteCounts/WriteFiles/WriteUnshardedBundlesToTempFiles/WriteUnwritten as step s10
Dec 19, 2020 11:43:05 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding WriteCounts/WriteFiles/WriteUnshardedBundlesToTempFiles/DropShardNum as step s11
Dec 19, 2020 11:43:05 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding WriteCounts/WriteFiles/WriteUnshardedBundlesToTempFiles/Flatten.PCollections as step s12
Dec 19, 2020 11:43:05 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding WriteCounts/WriteFiles/GatherTempFileResults/View.AsList/ParDo(ToIsmRecordForGlobalWindow) as step s13
Dec 19, 2020 11:43:05 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding WriteCounts/WriteFiles/GatherTempFileResults/View.AsList/CreateDataflowView as step s14
Dec 19, 2020 11:43:05 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding WriteCounts/WriteFiles/GatherTempFileResults/Reify.ReifyViewInGlobalWindow/Create.Values/Read(CreateSource) as step s15
Dec 19, 2020 11:43:05 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding WriteCounts/WriteFiles/GatherTempFileResults/Reify.ReifyViewInGlobalWindow/Reify.ReifyView/ParDo(Anonymous) as step s16
Dec 19, 2020 11:43:05 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding WriteCounts/WriteFiles/GatherTempFileResults/Reify.ReifyViewInGlobalWindow/Values/Values/Map as step s17
Dec 19, 2020 11:43:05 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding WriteCounts/WriteFiles/FinalizeTempFileBundles/Finalize as step s18
Dec 19, 2020 11:43:05 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding WriteCounts/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Pair with random key as step s19
Dec 19, 2020 11:43:05 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding WriteCounts/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign as step s20
Dec 19, 2020 11:43:05 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding WriteCounts/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey as step s21
Dec 19, 2020 11:43:05 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding WriteCounts/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable as step s22
Dec 19, 2020 11:43:05 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding WriteCounts/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Values/Values/Map as step s23
Dec 19, 2020 11:43:05 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-release-validation-tests/nightly-snapshot-validation/tmp/staging/
Dec 19, 2020 11:43:05 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <143067 bytes, hash fb3f555ac1c4c7b0133ca761289a4364a307dc583e2ea5fb339264f4a0099d97> to gs://temp-storage-for-release-validation-tests/nightly-snapshot-validation/tmp/staging/pipeline--z9VWsHEx7ATPKdhKJpDZKMH3Fg-LqX7M5Jk9KAJnZc.pb
Dec 19, 2020 11:43:05 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Dataflow SDK version: 2.28.0-SNAPSHOT
Dec 19, 2020 11:43:07 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobs/us-central1/2020-12-19_03_43_05-12032114968691242538?project=apache-beam-testing
Dec 19, 2020 11:43:07 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Submitted job: 2020-12-19_03_43_05-12032114968691242538
Dec 19, 2020 11:43:07 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2020-12-19_03_43_05-12032114968691242538
Dec 19, 2020 11:43:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-12-19T11:43:05.615Z: Autoscaling was automatically enabled for job 2020-12-19_03_43_05-12032114968691242538.
Dec 19, 2020 11:43:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-12-19T11:43:05.615Z: Autoscaling is enabled for job 2020-12-19_03_43_05-12032114968691242538. The number of workers will be between 1 and 1000.
Dec 19, 2020 11:43:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-12-19T11:43:14.669Z: Worker configuration: n1-standard-1 in us-central1-f.
Dec 19, 2020 11:43:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-12-19T11:43:15.366Z: Expanding CoGroupByKey operations into optimizable parts.
Dec 19, 2020 11:43:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-12-19T11:43:15.465Z: Expanding GroupByKey operations into optimizable parts.
Dec 19, 2020 11:43:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-12-19T11:43:15.483Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
Dec 19, 2020 11:43:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-12-19T11:43:15.658Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
Dec 19, 2020 11:43:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-12-19T11:43:15.688Z: Fusing consumer WriteCounts/WriteFiles/GatherTempFileResults/Reify.ReifyViewInGlobalWindow/Reify.ReifyView/ParDo(Anonymous) into WriteCounts/WriteFiles/GatherTempFileResults/Reify.ReifyViewInGlobalWindow/Create.Values/Read(CreateSource)
Dec 19, 2020 11:43:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-12-19T11:43:15.707Z: Fusing consumer WriteCounts/WriteFiles/GatherTempFileResults/Reify.ReifyViewInGlobalWindow/Values/Values/Map into WriteCounts/WriteFiles/GatherTempFileResults/Reify.ReifyViewInGlobalWindow/Reify.ReifyView/ParDo(Anonymous)
Dec 19, 2020 11:43:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-12-19T11:43:15.730Z: Fusing consumer WriteCounts/WriteFiles/FinalizeTempFileBundles/Finalize into WriteCounts/WriteFiles/GatherTempFileResults/Reify.ReifyViewInGlobalWindow/Values/Values/Map
Dec 19, 2020 11:43:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-12-19T11:43:15.752Z: Fusing consumer WriteCounts/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Pair with random key into WriteCounts/WriteFiles/FinalizeTempFileBundles/Finalize
Dec 19, 2020 11:43:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-12-19T11:43:15.777Z: Fusing consumer WriteCounts/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign into WriteCounts/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Pair with random key
Dec 19, 2020 11:43:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-12-19T11:43:15.805Z: Fusing consumer WriteCounts/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify into WriteCounts/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign
Dec 19, 2020 11:43:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-12-19T11:43:15.827Z: Fusing consumer WriteCounts/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write into WriteCounts/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify
Dec 19, 2020 11:43:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-12-19T11:43:15.851Z: Fusing consumer WriteCounts/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow into WriteCounts/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read
Dec 19, 2020 11:43:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-12-19T11:43:15.874Z: Fusing consumer WriteCounts/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable into WriteCounts/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow
Dec 19, 2020 11:43:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-12-19T11:43:15.898Z: Fusing consumer WriteCounts/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Values/Values/Map into WriteCounts/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable
Dec 19, 2020 11:43:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-12-19T11:43:15.923Z: Unzipping flatten s12 for input s11.org.apache.beam.sdk.values.PCollection.<init>:402#5f2ef1f005ae0b4
Dec 19, 2020 11:43:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-12-19T11:43:15.948Z: Fusing unzipped copy of WriteCounts/WriteFiles/GatherTempFileResults/View.AsList/ParDo(ToIsmRecordForGlobalWindow), through flatten WriteCounts/WriteFiles/WriteUnshardedBundlesToTempFiles/Flatten.PCollections, into producer WriteCounts/WriteFiles/WriteUnshardedBundlesToTempFiles/DropShardNum
Dec 19, 2020 11:43:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-12-19T11:43:15.967Z: Fusing consumer WriteCounts/WriteFiles/GatherTempFileResults/View.AsList/ParDo(ToIsmRecordForGlobalWindow) into WriteCounts/WriteFiles/WriteUnshardedBundlesToTempFiles/WriteUnshardedBundles
Dec 19, 2020 11:43:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-12-19T11:43:15.995Z: Fusing consumer WordCount.CountWords/ParDo(ExtractWords) into ReadLines/Read
Dec 19, 2020 11:43:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-12-19T11:43:16.025Z: Fusing consumer WordCount.CountWords/Count.PerElement/Init/Map into WordCount.CountWords/ParDo(ExtractWords)
Dec 19, 2020 11:43:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-12-19T11:43:16.050Z: Fusing consumer WordCount.CountWords/Count.PerElement/Combine.perKey(Count)/GroupByKey+WordCount.CountWords/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues/Partial into WordCount.CountWords/Count.PerElement/Init/Map
Dec 19, 2020 11:43:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-12-19T11:43:16.075Z: Fusing consumer WordCount.CountWords/Count.PerElement/Combine.perKey(Count)/GroupByKey/Reify into WordCount.CountWords/Count.PerElement/Combine.perKey(Count)/GroupByKey+WordCount.CountWords/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues/Partial
Dec 19, 2020 11:43:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-12-19T11:43:16.098Z: Fusing consumer WordCount.CountWords/Count.PerElement/Combine.perKey(Count)/GroupByKey/Write into WordCount.CountWords/Count.PerElement/Combine.perKey(Count)/GroupByKey/Reify
Dec 19, 2020 11:43:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-12-19T11:43:16.124Z: Fusing consumer WordCount.CountWords/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues into WordCount.CountWords/Count.PerElement/Combine.perKey(Count)/GroupByKey/Read
Dec 19, 2020 11:43:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-12-19T11:43:16.147Z: Fusing consumer WordCount.CountWords/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues/Extract into WordCount.CountWords/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues
Dec 19, 2020 11:43:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-12-19T11:43:16.168Z: Fusing consumer MapElements/Map into WordCount.CountWords/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues/Extract
Dec 19, 2020 11:43:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-12-19T11:43:16.195Z: Fusing consumer WriteCounts/WriteFiles/RewindowIntoGlobal/Window.Assign into MapElements/Map
Dec 19, 2020 11:43:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-12-19T11:43:16.223Z: Fusing consumer WriteCounts/WriteFiles/WriteUnshardedBundlesToTempFiles/WriteUnshardedBundles into WriteCounts/WriteFiles/RewindowIntoGlobal/Window.Assign
Dec 19, 2020 11:43:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-12-19T11:43:16.255Z: Fusing consumer WriteCounts/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten/Reify into WriteCounts/WriteFiles/WriteUnshardedBundlesToTempFiles/WriteUnshardedBundles
Dec 19, 2020 11:43:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-12-19T11:43:16.281Z: Fusing consumer WriteCounts/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten/Write into WriteCounts/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten/Reify
Dec 19, 2020 11:43:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-12-19T11:43:16.306Z: Fusing consumer WriteCounts/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten/GroupByWindow into WriteCounts/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten/Read
Dec 19, 2020 11:43:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-12-19T11:43:16.331Z: Fusing consumer WriteCounts/WriteFiles/WriteUnshardedBundlesToTempFiles/WriteUnwritten into WriteCounts/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten/GroupByWindow
Dec 19, 2020 11:43:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-12-19T11:43:16.361Z: Fusing consumer WriteCounts/WriteFiles/WriteUnshardedBundlesToTempFiles/DropShardNum into WriteCounts/WriteFiles/WriteUnshardedBundlesToTempFiles/WriteUnwritten
Dec 19, 2020 11:43:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-12-19T11:43:16.846Z: Executing operation WriteCounts/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Create
Dec 19, 2020 11:43:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-12-19T11:43:16.871Z: Executing operation WordCount.CountWords/Count.PerElement/Combine.perKey(Count)/GroupByKey/Create
Dec 19, 2020 11:43:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-12-19T11:43:16.896Z: Executing operation WriteCounts/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten/Create
Dec 19, 2020 11:43:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-12-19T11:43:16.907Z: Starting 1 workers in us-central1-f...
Dec 19, 2020 11:43:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-12-19T11:43:16.955Z: Finished operation WriteCounts/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Create
Dec 19, 2020 11:43:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-12-19T11:43:16.970Z: Finished operation WriteCounts/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten/Create
Dec 19, 2020 11:43:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-12-19T11:43:16.971Z: Finished operation WordCount.CountWords/Count.PerElement/Combine.perKey(Count)/GroupByKey/Create
Dec 19, 2020 11:43:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-12-19T11:43:17.132Z: Executing operation ReadLines/Read+WordCount.CountWords/ParDo(ExtractWords)+WordCount.CountWords/Count.PerElement/Init/Map+WordCount.CountWords/Count.PerElement/Combine.perKey(Count)/GroupByKey+WordCount.CountWords/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues/Partial+WordCount.CountWords/Count.PerElement/Combine.perKey(Count)/GroupByKey/Reify+WordCount.CountWords/Count.PerElement/Combine.perKey(Count)/GroupByKey/Write
Dec 19, 2020 11:43:22 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-12-19T11:43:21.015Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete
Dec 19, 2020 11:43:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-12-19T11:43:49.161Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running stage(s).
Dec 19, 2020 11:44:31 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-12-19T11:44:29.376Z: Workers have started successfully.
Dec 19, 2020 11:44:31 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-12-19T11:44:29.408Z: Workers have started successfully.
Dec 19, 2020 11:46:18 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-12-19T11:46:18.109Z: Finished operation ReadLines/Read+WordCount.CountWords/ParDo(ExtractWords)+WordCount.CountWords/Count.PerElement/Init/Map+WordCount.CountWords/Count.PerElement/Combine.perKey(Count)/GroupByKey+WordCount.CountWords/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues/Partial+WordCount.CountWords/Count.PerElement/Combine.perKey(Count)/GroupByKey/Reify+WordCount.CountWords/Count.PerElement/Combine.perKey(Count)/GroupByKey/Write
Dec 19, 2020 11:46:18 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-12-19T11:46:18.183Z: Executing operation WordCount.CountWords/Count.PerElement/Combine.perKey(Count)/GroupByKey/Close
Dec 19, 2020 11:46:18 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-12-19T11:46:18.237Z: Finished operation WordCount.CountWords/Count.PerElement/Combine.perKey(Count)/GroupByKey/Close
Dec 19, 2020 11:46:18 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-12-19T11:46:18.312Z: Executing operation WordCount.CountWords/Count.PerElement/Combine.perKey(Count)/GroupByKey/Read+WordCount.CountWords/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues+WordCount.CountWords/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues/Extract+MapElements/Map+WriteCounts/WriteFiles/RewindowIntoGlobal/Window.Assign+WriteCounts/WriteFiles/WriteUnshardedBundlesToTempFiles/WriteUnshardedBundles+WriteCounts/WriteFiles/GatherTempFileResults/View.AsList/ParDo(ToIsmRecordForGlobalWindow)+WriteCounts/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten/Reify+WriteCounts/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten/Write
Dec 19, 2020 11:46:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-12-19T11:46:25.380Z: Finished operation WordCount.CountWords/Count.PerElement/Combine.perKey(Count)/GroupByKey/Read+WordCount.CountWords/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues+WordCount.CountWords/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues/Extract+MapElements/Map+WriteCounts/WriteFiles/RewindowIntoGlobal/Window.Assign+WriteCounts/WriteFiles/WriteUnshardedBundlesToTempFiles/WriteUnshardedBundles+WriteCounts/WriteFiles/GatherTempFileResults/View.AsList/ParDo(ToIsmRecordForGlobalWindow)+WriteCounts/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten/Reify+WriteCounts/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten/Write
Dec 19, 2020 11:46:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-12-19T11:46:25.490Z: Executing operation WriteCounts/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten/Close
Dec 19, 2020 11:46:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-12-19T11:46:25.532Z: Finished operation WriteCounts/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten/Close
Dec 19, 2020 11:46:26 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-12-19T11:46:25.603Z: Executing operation WriteCounts/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten/Read+WriteCounts/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten/GroupByWindow+WriteCounts/WriteFiles/WriteUnshardedBundlesToTempFiles/WriteUnwritten+WriteCounts/WriteFiles/WriteUnshardedBundlesToTempFiles/DropShardNum+WriteCounts/WriteFiles/GatherTempFileResults/View.AsList/ParDo(ToIsmRecordForGlobalWindow)
Dec 19, 2020 11:46:29 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-12-19T11:46:27.736Z: Finished operation WriteCounts/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten/Read+WriteCounts/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten/GroupByWindow+WriteCounts/WriteFiles/WriteUnshardedBundlesToTempFiles/WriteUnwritten+WriteCounts/WriteFiles/WriteUnshardedBundlesToTempFiles/DropShardNum+WriteCounts/WriteFiles/GatherTempFileResults/View.AsList/ParDo(ToIsmRecordForGlobalWindow)
Dec 19, 2020 11:46:29 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-12-19T11:46:27.870Z: Executing operation WriteCounts/WriteFiles/WriteUnshardedBundlesToTempFiles/Flatten.PCollections/Unzipped-1
Dec 19, 2020 11:46:29 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-12-19T11:46:27.940Z: Finished operation WriteCounts/WriteFiles/WriteUnshardedBundlesToTempFiles/Flatten.PCollections/Unzipped-1
Dec 19, 2020 11:46:29 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-12-19T11:46:28.077Z: Executing operation WriteCounts/WriteFiles/GatherTempFileResults/View.AsList/CreateDataflowView
Dec 19, 2020 11:46:29 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-12-19T11:46:28.136Z: Finished operation WriteCounts/WriteFiles/GatherTempFileResults/View.AsList/CreateDataflowView
Dec 19, 2020 11:46:29 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-12-19T11:46:28.291Z: Executing operation WriteCounts/WriteFiles/GatherTempFileResults/Reify.ReifyViewInGlobalWindow/Create.Values/Read(CreateSource)+WriteCounts/WriteFiles/GatherTempFileResults/Reify.ReifyViewInGlobalWindow/Reify.ReifyView/ParDo(Anonymous)+WriteCounts/WriteFiles/GatherTempFileResults/Reify.ReifyViewInGlobalWindow/Values/Values/Map+WriteCounts/WriteFiles/FinalizeTempFileBundles/Finalize+WriteCounts/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Pair with random key+WriteCounts/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign+WriteCounts/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify+WriteCounts/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write
Dec 19, 2020 11:46:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-12-19T11:46:32.524Z: Finished operation WriteCounts/WriteFiles/GatherTempFileResults/Reify.ReifyViewInGlobalWindow/Create.Values/Read(CreateSource)+WriteCounts/WriteFiles/GatherTempFileResults/Reify.ReifyViewInGlobalWindow/Reify.ReifyView/ParDo(Anonymous)+WriteCounts/WriteFiles/GatherTempFileResults/Reify.ReifyViewInGlobalWindow/Values/Values/Map+WriteCounts/WriteFiles/FinalizeTempFileBundles/Finalize+WriteCounts/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Pair with random key+WriteCounts/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign+WriteCounts/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify+WriteCounts/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write
Dec 19, 2020 11:46:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-12-19T11:46:32.600Z: Executing operation WriteCounts/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Close
Dec 19, 2020 11:46:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-12-19T11:46:32.657Z: Finished operation WriteCounts/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Close
Dec 19, 2020 11:46:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-12-19T11:46:32.743Z: Executing operation WriteCounts/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read+WriteCounts/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow+WriteCounts/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable+WriteCounts/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Values/Values/Map
Dec 19, 2020 11:46:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-12-19T11:46:35.777Z: Finished operation WriteCounts/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read+WriteCounts/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow+WriteCounts/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable+WriteCounts/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Values/Values/Map
Dec 19, 2020 11:46:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-12-19T11:46:35.898Z: Cleaning up.
Dec 19, 2020 11:46:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-12-19T11:46:35.967Z: Stopping worker pool...
Dec 19, 2020 11:47:19 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-12-19T11:47:18.613Z: Autoscaling: Resized worker pool from 1 to 0.
Dec 19, 2020 11:47:19 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2020-12-19T11:47:18.654Z: Worker pool stopped.
Dec 19, 2020 11:47:25 AM org.apache.beam.runners.dataflow.DataflowPipelineJob logTerminalState
INFO: Job 2020-12-19_03_43_05-12032114968691242538 finished with status DONE.
gsutil cat gs://temp-storage-for-release-validation-tests/nightly-snapshot-validation/count* | grep Montague:
Montague: 47
Verified Montague: 47
gsutil rm gs://temp-storage-for-release-validation-tests/nightly-snapshot-validation/count*
Removing gs://temp-storage-for-release-validation-tests/nightly-snapshot-validation/counts-00000-of-00003...
/ [1 objects]
Removing gs://temp-storage-for-release-validation-tests/nightly-snapshot-validation/counts-00001-of-00003...
/ [2 objects]
Removing gs://temp-storage-for-release-validation-tests/nightly-snapshot-validation/counts-00002-of-00003...
/ [3 objects]
Operation completed over 3 objects.
[SUCCESS]
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':runners:spark:runQuickstartJavaSpark'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 47m 11s
8 actionable tasks: 7 executed, 1 from cache
Publishing build scan...
https://gradle.com/s/tcqkkzv7okl3w
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org