You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2018/05/22 23:35:49 UTC
Build failed in Jenkins:
beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #322
See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/322/display/redirect?page=changes>
Changes:
[sidhom] Require explicit IdGenerator for all DockerEnvironmentFactory
[sidhom] [BEAM-4148] Add pluggable UrlFactory to ServerFactory
[sidhom] [BEAM-4267] Docker-based JobBundleFactory
[timrobertson100] [BEAM-4348] Enforce ErrorProne analysis in kinesis IO
[timrobertson100] [BEAM-4349] Enforce ErrorProne analysis in mongodb IO
[timrobertson100] [BEAM-4351] Enforce ErrorProne analysis in mqtt IO
[timrobertson100] [BEAM-4348] Removes double-checked locking to aid readability
------------------------------------------
[...truncated 19.45 MB...]
May 22, 2018 11:32:39 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding OutputSideInputs as step s11
May 22, 2018 11:32:39 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Window.Into()/Window.Assign as step s12
May 22, 2018 11:32:39 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) as step s13
May 22, 2018 11:32:39 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map as step s14
May 22, 2018 11:32:39 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign as step s15
May 22, 2018 11:32:39 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey as step s16
May 22, 2018 11:32:39 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map as step s17
May 22, 2018 11:32:39 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RewindowActuals/Window.Assign as step s18
May 22, 2018 11:32:39 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map as step s19
May 22, 2018 11:32:39 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveActualsTriggering/Flatten.PCollections as step s20
May 22, 2018 11:32:39 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Create.Values/Read(CreateSource) as step s21
May 22, 2018 11:32:39 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign as step s22
May 22, 2018 11:32:39 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveDummyTriggering/Flatten.PCollections as step s23
May 22, 2018 11:32:39 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/FlattenDummyAndContents as step s24
May 22, 2018 11:32:39 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/NeverTrigger/Flatten.PCollections as step s25
May 22, 2018 11:32:39 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GroupDummyAndContents as step s26
May 22, 2018 11:32:39 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Values/Values/Map as step s27
May 22, 2018 11:32:39 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/ParDo(Concat) as step s28
May 22, 2018 11:32:39 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GetPane/Map as step s29
May 22, 2018 11:32:39 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/RunChecks as step s30
May 22, 2018 11:32:39 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/VerifyAssertions/ParDo(DefaultConclude) as step s31
May 22, 2018 11:32:39 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0522233233-7aa9d27f/output/results/staging/
May 22, 2018 11:32:39 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <71120 bytes, hash lLKRxfrznrIjG28KJYJSJw> to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0522233233-7aa9d27f/output/results/staging/pipeline-lLKRxfrznrIjG28KJYJSJw.pb
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 22, 2018 11:32:40 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-05-22_16_32_39-797419170543423692?project=apache-beam-testing
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Submitted job: 2018-05-22_16_32_39-797419170543423692
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 22, 2018 11:32:40 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-05-22_16_32_39-797419170543423692
May 22, 2018 11:32:40 PM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-05-22_16_32_39-797419170543423692 with 1 expected assertions.
May 22, 2018 11:33:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-22T23:32:39.858Z: Autoscaling is enabled for job 2018-05-22_16_32_39-797419170543423692. The number of workers will be between 1 and 1000.
May 22, 2018 11:33:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-22T23:32:39.899Z: Autoscaling was automatically enabled for job 2018-05-22_16_32_39-797419170543423692.
May 22, 2018 11:33:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-22T23:32:42.399Z: Checking required Cloud APIs are enabled.
May 22, 2018 11:33:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-22T23:32:42.520Z: Checking permissions granted to controller Service Account.
May 22, 2018 11:33:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-22T23:32:48.163Z: Worker configuration: n1-standard-1 in us-central1-b.
May 22, 2018 11:33:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-22T23:32:48.537Z: Expanding CoGroupByKey operations into optimizable parts.
May 22, 2018 11:33:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-22T23:32:48.709Z: Expanding GroupByKey operations into optimizable parts.
May 22, 2018 11:33:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-22T23:32:48.750Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
May 22, 2018 11:33:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-22T23:32:49.014Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
May 22, 2018 11:33:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-22T23:32:49.049Z: Elided trivial flatten
May 22, 2018 11:33:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-22T23:32:49.097Z: Elided trivial flatten
May 22, 2018 11:33:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-22T23:32:49.133Z: Elided trivial flatten
May 22, 2018 11:33:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-22T23:32:49.178Z: Unzipping flatten s24 for input s19.org.apache.beam.sdk.values.PCollection.<init>:329#8fd0f908e3ea90e3
May 22, 2018 11:33:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-22T23:32:49.263Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Reify, through flatten PAssert$33/GroupGlobally/FlattenDummyAndContents, into producer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map
May 22, 2018 11:33:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-22T23:32:49.309Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow into PAssert$33/GroupGlobally/GroupDummyAndContents/Read
May 22, 2018 11:33:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-22T23:32:49.356Z: Fusing consumer PAssert$33/GroupGlobally/ParDo(Concat) into PAssert$33/GroupGlobally/Values/Values/Map
May 22, 2018 11:33:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-22T23:32:49.396Z: Fusing consumer PAssert$33/GetPane/Map into PAssert$33/GroupGlobally/ParDo(Concat)
May 22, 2018 11:33:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-22T23:32:49.438Z: Fusing consumer PAssert$33/GroupGlobally/Values/Values/Map into PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow
May 22, 2018 11:33:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-22T23:32:49.480Z: Fusing consumer PAssert$33/RunChecks into PAssert$33/GetPane/Map
May 22, 2018 11:33:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-22T23:32:49.525Z: Fusing consumer PAssert$33/VerifyAssertions/ParDo(DefaultConclude) into PAssert$33/RunChecks
May 22, 2018 11:33:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-22T23:32:49.569Z: Unzipping flatten s24-u45 for input s26-reify-value18-c43
May 22, 2018 11:33:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-22T23:32:49.612Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Write, through flatten s24-u45, into producer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 22, 2018 11:33:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-22T23:32:49.639Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify into PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
May 22, 2018 11:33:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-22T23:32:49.674Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Write into PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 22, 2018 11:33:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-22T23:32:49.708Z: Fusing consumer PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)
May 22, 2018 11:33:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-22T23:32:49.747Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
May 22, 2018 11:33:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-22T23:32:49.794Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
May 22, 2018 11:33:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-22T23:32:49.836Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into PAssert$33/GroupGlobally/Window.Into()/Window.Assign
May 22, 2018 11:33:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-22T23:32:49.879Z: Fusing consumer OutputSideInputs into Create123/Read(CreateSource)
May 22, 2018 11:33:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-22T23:32:49.916Z: Fusing consumer PAssert$33/GroupGlobally/Window.Into()/Window.Assign into OutputSideInputs
May 22, 2018 11:33:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-22T23:32:49.964Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
May 22, 2018 11:33:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-22T23:32:50.005Z: Fusing consumer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map into PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
May 22, 2018 11:33:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-22T23:32:50.046Z: Fusing consumer PAssert$33/GroupGlobally/RewindowActuals/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map
May 22, 2018 11:33:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-22T23:32:50.097Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read
May 22, 2018 11:33:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-22T23:32:50.145Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
May 22, 2018 11:33:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-22T23:32:50.187Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
May 22, 2018 11:33:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-22T23:32:50.237Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
May 22, 2018 11:33:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-22T23:32:50.270Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
May 22, 2018 11:33:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-22T23:32:50.312Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
May 22, 2018 11:33:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-22T23:32:50.359Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into Create47/Read(CreateSource)
May 22, 2018 11:33:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-22T23:32:50.398Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
May 22, 2018 11:33:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-22T23:32:50.444Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
May 22, 2018 11:33:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-22T23:32:50.489Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
May 22, 2018 11:33:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-22T23:32:50.527Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
May 22, 2018 11:33:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-22T23:32:50.570Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
May 22, 2018 11:33:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-22T23:32:50.617Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
May 22, 2018 11:33:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-22T23:32:51.103Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Create
May 22, 2018 11:33:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-22T23:32:51.149Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Create
May 22, 2018 11:33:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-22T23:32:51.185Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
May 22, 2018 11:33:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-22T23:32:51.205Z: Starting 1 workers in us-central1-b...
May 22, 2018 11:33:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-22T23:32:51.230Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
May 22, 2018 11:33:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-22T23:32:51.488Z: Executing operation PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 22, 2018 11:33:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-22T23:32:51.537Z: Executing operation Create47/Read(CreateSource)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
May 22, 2018 11:33:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-22T23:32:59.164Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
May 22, 2018 11:33:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-22T23:33:09.621Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
May 22, 2018 11:33:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-22T23:33:09.670Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 22, 2018 11:33:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-22T23:33:31.409Z: Workers have started successfully.
May 22, 2018 11:33:47 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-22T23:33:46.966Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
May 22, 2018 11:33:47 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-22T23:33:47.043Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
May 22, 2018 11:33:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-22T23:33:52.612Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
May 22, 2018 11:33:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-22T23:33:52.707Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
May 22, 2018 11:34:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-22T23:34:05.664Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
May 22, 2018 11:34:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-22T23:34:05.864Z: Executing operation Create123/Read(CreateSource)+OutputSideInputs+PAssert$33/GroupGlobally/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write
May 22, 2018 11:34:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-22T23:34:09.435Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Close
May 22, 2018 11:34:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-22T23:34:09.530Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$33/GroupGlobally/RewindowActuals/Window.Assign+PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 22, 2018 11:34:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-22T23:34:12.217Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Close
May 22, 2018 11:34:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-22T23:34:12.310Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Read+PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$33/GroupGlobally/Values/Values/Map+PAssert$33/GroupGlobally/ParDo(Concat)+PAssert$33/GetPane/Map+PAssert$33/RunChecks+PAssert$33/VerifyAssertions/ParDo(DefaultConclude)
May 22, 2018 11:34:15 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-22T23:34:15.198Z: Cleaning up.
May 22, 2018 11:34:15 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-22T23:34:15.298Z: Stopping worker pool...
May 22, 2018 11:35:35 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-22T23:35:34.387Z: Autoscaling: Resized worker pool from 1 to 0.
May 22, 2018 11:35:35 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-22T23:35:34.437Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 22, 2018 11:35:43 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-05-22_16_32_39-797419170543423692 finished with status DONE.
May 22, 2018 11:35:43 PM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-05-22_16_32_39-797419170543423692. Found 1 success, 0 failures out of 1 expected assertions.
Gradle Test Executor 38 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest FAILED
209 tests completed, 34 failed, 2 skipped
Finished generating test XML results (0.534 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerTest>
Generating HTML test report...
Finished generating test html results (0.43 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest>
:beam-runners-google-cloud-dataflow-java:validatesRunnerTest (Thread[Task worker for ':' Thread 23,5,main]) completed. Took 2 hrs 14 mins 7.845 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:validatesRunnerTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 15m 13s
38 actionable tasks: 34 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/vflsmxaseceum
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user sidhom@google.com
Jenkins build is back to normal :
beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #402
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/402/display/redirect>
Build failed in Jenkins:
beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #401
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/401/display/redirect>
------------------------------------------
[...truncated 18.16 MB...]
INFO: Adding PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map as step s19
Jun 02, 2018 3:15:12 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveActualsTriggering/Flatten.PCollections as step s20
Jun 02, 2018 3:15:12 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Create.Values/Read(CreateSource) as step s21
Jun 02, 2018 3:15:12 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign as step s22
Jun 02, 2018 3:15:12 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveDummyTriggering/Flatten.PCollections as step s23
Jun 02, 2018 3:15:12 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/FlattenDummyAndContents as step s24
Jun 02, 2018 3:15:12 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/NeverTrigger/Flatten.PCollections as step s25
Jun 02, 2018 3:15:12 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GroupDummyAndContents as step s26
Jun 02, 2018 3:15:12 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Values/Values/Map as step s27
Jun 02, 2018 3:15:12 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/ParDo(Concat) as step s28
Jun 02, 2018 3:15:12 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GetPane/Map as step s29
Jun 02, 2018 3:15:12 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/RunChecks as step s30
Jun 02, 2018 3:15:12 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/VerifyAssertions/ParDo(DefaultConclude) as step s31
Jun 02, 2018 3:15:12 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0602031509-a3bf8230/output/results/staging/
Jun 02, 2018 3:15:12 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <71120 bytes, hash 0Oo6soJlZd7y3BFqxBih7A> to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0602031509-a3bf8230/output/results/staging/pipeline-0Oo6soJlZd7y3BFqxBih7A.pb
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
Jun 02, 2018 3:15:13 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-06-01_20_15_13-13771455054867111793?project=apache-beam-testing
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Submitted job: 2018-06-01_20_15_13-13771455054867111793
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
Jun 02, 2018 3:15:13 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-06-01_20_15_13-13771455054867111793
Jun 02, 2018 3:15:13 AM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-06-01_20_15_13-13771455054867111793 with 1 expected assertions.
Jun 02, 2018 3:15:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:15:13.139Z: Autoscaling is enabled for job 2018-06-01_20_15_13-13771455054867111793. The number of workers will be between 1 and 1000.
Jun 02, 2018 3:15:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:15:13.180Z: Autoscaling was automatically enabled for job 2018-06-01_20_15_13-13771455054867111793.
Jun 02, 2018 3:15:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:15:15.764Z: Checking required Cloud APIs are enabled.
Jun 02, 2018 3:15:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:15:16.085Z: Checking permissions granted to controller Service Account.
Jun 02, 2018 3:15:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:15:22.190Z: Worker configuration: n1-standard-1 in us-central1-b.
Jun 02, 2018 3:15:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:15:22.561Z: Expanding CoGroupByKey operations into optimizable parts.
Jun 02, 2018 3:15:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:15:22.700Z: Expanding GroupByKey operations into optimizable parts.
Jun 02, 2018 3:15:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:15:22.732Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
Jun 02, 2018 3:15:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:15:22.905Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
Jun 02, 2018 3:15:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:15:22.941Z: Elided trivial flatten
Jun 02, 2018 3:15:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:15:22.961Z: Elided trivial flatten
Jun 02, 2018 3:15:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:15:22.994Z: Elided trivial flatten
Jun 02, 2018 3:15:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:15:23.029Z: Unzipping flatten s24 for input s19.org.apache.beam.sdk.values.PCollection.<init>:329#8fd0f908e3ea90e3
Jun 02, 2018 3:15:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:15:23.063Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Reify, through flatten PAssert$33/GroupGlobally/FlattenDummyAndContents, into producer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map
Jun 02, 2018 3:15:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:15:23.095Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow into PAssert$33/GroupGlobally/GroupDummyAndContents/Read
Jun 02, 2018 3:15:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:15:23.117Z: Fusing consumer PAssert$33/GroupGlobally/ParDo(Concat) into PAssert$33/GroupGlobally/Values/Values/Map
Jun 02, 2018 3:15:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:15:23.155Z: Fusing consumer PAssert$33/GetPane/Map into PAssert$33/GroupGlobally/ParDo(Concat)
Jun 02, 2018 3:15:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:15:23.186Z: Fusing consumer PAssert$33/GroupGlobally/Values/Values/Map into PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow
Jun 02, 2018 3:15:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:15:23.217Z: Fusing consumer PAssert$33/RunChecks into PAssert$33/GetPane/Map
Jun 02, 2018 3:15:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:15:23.280Z: Fusing consumer PAssert$33/VerifyAssertions/ParDo(DefaultConclude) into PAssert$33/RunChecks
Jun 02, 2018 3:15:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:15:23.309Z: Unzipping flatten s24-u45 for input s26-reify-value18-c43
Jun 02, 2018 3:15:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:15:23.355Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Write, through flatten s24-u45, into producer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
Jun 02, 2018 3:15:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:15:23.384Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify into PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
Jun 02, 2018 3:15:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:15:23.417Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Write into PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
Jun 02, 2018 3:15:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:15:23.447Z: Fusing consumer PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)
Jun 02, 2018 3:15:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:15:23.484Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
Jun 02, 2018 3:15:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:15:23.517Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
Jun 02, 2018 3:15:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:15:23.551Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into PAssert$33/GroupGlobally/Window.Into()/Window.Assign
Jun 02, 2018 3:15:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:15:23.586Z: Fusing consumer OutputSideInputs into Create123/Read(CreateSource)
Jun 02, 2018 3:15:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:15:23.621Z: Fusing consumer PAssert$33/GroupGlobally/Window.Into()/Window.Assign into OutputSideInputs
Jun 02, 2018 3:15:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:15:23.656Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
Jun 02, 2018 3:15:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:15:23.693Z: Fusing consumer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map into PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
Jun 02, 2018 3:15:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:15:23.724Z: Fusing consumer PAssert$33/GroupGlobally/RewindowActuals/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map
Jun 02, 2018 3:15:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:15:23.759Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read
Jun 02, 2018 3:15:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:15:23.793Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
Jun 02, 2018 3:15:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:15:23.819Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
Jun 02, 2018 3:15:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:15:23.857Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
Jun 02, 2018 3:15:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:15:23.894Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
Jun 02, 2018 3:15:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:15:23.926Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
Jun 02, 2018 3:15:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:15:23.953Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into Create47/Read(CreateSource)
Jun 02, 2018 3:15:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:15:23.988Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
Jun 02, 2018 3:15:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:15:24.022Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
Jun 02, 2018 3:15:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:15:24.056Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
Jun 02, 2018 3:15:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:15:24.091Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
Jun 02, 2018 3:15:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:15:24.127Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
Jun 02, 2018 3:15:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:15:24.166Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
Jun 02, 2018 3:15:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:15:24.499Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Create
Jun 02, 2018 3:15:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:15:24.521Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Create
Jun 02, 2018 3:15:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:15:24.555Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
Jun 02, 2018 3:15:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:15:24.592Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
Jun 02, 2018 3:15:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:15:24.602Z: Starting 1 workers in us-central1-b...
Jun 02, 2018 3:15:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:15:24.851Z: Executing operation PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
Jun 02, 2018 3:15:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:15:24.882Z: Executing operation Create47/Read(CreateSource)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
Jun 02, 2018 3:15:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:15:34.501Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
Jun 02, 2018 3:15:47 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:15:45.255Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
Jun 02, 2018 3:15:47 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:15:45.294Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
Jun 02, 2018 3:16:00 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:16:00.602Z: Workers have started successfully.
Jun 02, 2018 3:16:29 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:16:28.118Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
Jun 02, 2018 3:16:29 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:16:28.204Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
Jun 02, 2018 3:16:41 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:16:39.230Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
Jun 02, 2018 3:16:41 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:16:39.312Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
Jun 02, 2018 3:16:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:16:52.142Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
Jun 02, 2018 3:16:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:16:52.310Z: Executing operation Create123/Read(CreateSource)+OutputSideInputs+PAssert$33/GroupGlobally/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write
Jun 02, 2018 3:16:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:16:57.641Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Close
Jun 02, 2018 3:16:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:16:57.744Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$33/GroupGlobally/RewindowActuals/Window.Assign+PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
Jun 02, 2018 3:17:01 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:17:01.542Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Close
Jun 02, 2018 3:17:02 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:17:01.658Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Read+PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$33/GroupGlobally/Values/Values/Map+PAssert$33/GroupGlobally/ParDo(Concat)+PAssert$33/GetPane/Map+PAssert$33/RunChecks+PAssert$33/VerifyAssertions/ParDo(DefaultConclude)
Jun 02, 2018 3:17:06 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:17:05.664Z: Cleaning up.
Jun 02, 2018 3:17:06 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:17:05.786Z: Stopping worker pool...
Jun 02, 2018 3:18:54 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:18:54.134Z: Autoscaling: Resized worker pool from 1 to 0.
Jun 02, 2018 3:18:54 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:18:54.173Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
Jun 02, 2018 3:18:54 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:18:54.217Z: Worker pool stopped.
Jun 02, 2018 3:19:02 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-06-01_20_15_13-13771455054867111793 finished with status DONE.
Jun 02, 2018 3:19:02 AM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-06-01_20_15_13-13771455054867111793. Found 1 success, 0 failures out of 1 expected assertions.
Gradle Test Executor 42 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest
209 tests completed, 34 failed, 2 skipped
Finished generating test XML results (0.727 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerTest>
Generating HTML test report...
Finished generating test html results (0.471 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest>
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest FAILED
:beam-runners-google-cloud-dataflow-java:validatesRunnerTest (Thread[Task worker for ':' Thread 39,5,main]) completed. Took 2 hrs 9 mins 0.989 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:validatesRunnerTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 9m 55s
38 actionable tasks: 34 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/qoqzo3yg43ney
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user katarzyna.kucharczyk@polidea.com
Not sending mail to unregistered user robbe.sneyders@ml6.eu
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user schroederc@google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user sidhom@google.com
Not sending mail to unregistered user aromanenko.dev@gmail.com
Not sending mail to unregistered user cademarkegard@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ammons@google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user kedin@google.com
Build failed in Jenkins:
beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #400
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/400/display/redirect?page=changes>
Changes:
[cademarkegard] [BEAM-4303] Enforce ErrorProne analysis in examples project
[aromanenko.dev] [BEAM-4421] Fix for issue with reading s3 files using ParquetIO
------------------------------------------
[...truncated 18.15 MB...]
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map as step s17
Jun 02, 2018 1:05:20 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RewindowActuals/Window.Assign as step s18
Jun 02, 2018 1:05:20 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map as step s19
Jun 02, 2018 1:05:20 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveActualsTriggering/Flatten.PCollections as step s20
Jun 02, 2018 1:05:20 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Create.Values/Read(CreateSource) as step s21
Jun 02, 2018 1:05:20 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign as step s22
Jun 02, 2018 1:05:20 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveDummyTriggering/Flatten.PCollections as step s23
Jun 02, 2018 1:05:20 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/FlattenDummyAndContents as step s24
Jun 02, 2018 1:05:20 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/NeverTrigger/Flatten.PCollections as step s25
Jun 02, 2018 1:05:20 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GroupDummyAndContents as step s26
Jun 02, 2018 1:05:20 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Values/Values/Map as step s27
Jun 02, 2018 1:05:20 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/ParDo(Concat) as step s28
Jun 02, 2018 1:05:20 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GetPane/Map as step s29
Jun 02, 2018 1:05:20 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/RunChecks as step s30
Jun 02, 2018 1:05:20 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/VerifyAssertions/ParDo(DefaultConclude) as step s31
Jun 02, 2018 1:05:20 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0602010515-aaecd3c4/output/results/staging/
Jun 02, 2018 1:05:20 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <71120 bytes, hash YktyUgaU5DbTByIaIZKT5A> to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0602010515-aaecd3c4/output/results/staging/pipeline-YktyUgaU5DbTByIaIZKT5A.pb
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
Jun 02, 2018 1:05:22 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-06-01_18_05_21-12746651185546532388?project=apache-beam-testing
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Submitted job: 2018-06-01_18_05_21-12746651185546532388
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
Jun 02, 2018 1:05:22 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-06-01_18_05_21-12746651185546532388
Jun 02, 2018 1:05:22 AM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-06-01_18_05_21-12746651185546532388 with 1 expected assertions.
Jun 02, 2018 1:05:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:05:21.108Z: Autoscaling is enabled for job 2018-06-01_18_05_21-12746651185546532388. The number of workers will be between 1 and 1000.
Jun 02, 2018 1:05:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:05:21.147Z: Autoscaling was automatically enabled for job 2018-06-01_18_05_21-12746651185546532388.
Jun 02, 2018 1:05:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:05:23.865Z: Checking required Cloud APIs are enabled.
Jun 02, 2018 1:05:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:05:23.981Z: Checking permissions granted to controller Service Account.
Jun 02, 2018 1:05:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:05:29.065Z: Worker configuration: n1-standard-1 in us-central1-b.
Jun 02, 2018 1:05:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:05:29.622Z: Expanding CoGroupByKey operations into optimizable parts.
Jun 02, 2018 1:05:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:05:29.797Z: Expanding GroupByKey operations into optimizable parts.
Jun 02, 2018 1:05:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:05:29.840Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
Jun 02, 2018 1:05:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:05:30.066Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
Jun 02, 2018 1:05:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:05:30.096Z: Elided trivial flatten
Jun 02, 2018 1:05:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:05:30.143Z: Elided trivial flatten
Jun 02, 2018 1:05:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:05:30.187Z: Elided trivial flatten
Jun 02, 2018 1:05:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:05:30.216Z: Unzipping flatten s24 for input s19.org.apache.beam.sdk.values.PCollection.<init>:329#8fd0f908e3ea90e3
Jun 02, 2018 1:05:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:05:30.251Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Reify, through flatten PAssert$33/GroupGlobally/FlattenDummyAndContents, into producer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map
Jun 02, 2018 1:05:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:05:30.291Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow into PAssert$33/GroupGlobally/GroupDummyAndContents/Read
Jun 02, 2018 1:05:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:05:30.331Z: Fusing consumer PAssert$33/GroupGlobally/ParDo(Concat) into PAssert$33/GroupGlobally/Values/Values/Map
Jun 02, 2018 1:05:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:05:30.369Z: Fusing consumer PAssert$33/GetPane/Map into PAssert$33/GroupGlobally/ParDo(Concat)
Jun 02, 2018 1:05:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:05:30.404Z: Fusing consumer PAssert$33/GroupGlobally/Values/Values/Map into PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow
Jun 02, 2018 1:05:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:05:30.444Z: Fusing consumer PAssert$33/RunChecks into PAssert$33/GetPane/Map
Jun 02, 2018 1:05:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:05:30.488Z: Fusing consumer PAssert$33/VerifyAssertions/ParDo(DefaultConclude) into PAssert$33/RunChecks
Jun 02, 2018 1:05:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:05:30.528Z: Unzipping flatten s24-u45 for input s26-reify-value18-c43
Jun 02, 2018 1:05:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:05:30.564Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Write, through flatten s24-u45, into producer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
Jun 02, 2018 1:05:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:05:30.610Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify into PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
Jun 02, 2018 1:05:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:05:30.662Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Write into PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
Jun 02, 2018 1:05:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:05:30.701Z: Fusing consumer PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)
Jun 02, 2018 1:05:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:05:30.747Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
Jun 02, 2018 1:05:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:05:30.788Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
Jun 02, 2018 1:05:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:05:30.827Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into PAssert$33/GroupGlobally/Window.Into()/Window.Assign
Jun 02, 2018 1:05:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:05:30.869Z: Fusing consumer OutputSideInputs into Create123/Read(CreateSource)
Jun 02, 2018 1:05:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:05:30.913Z: Fusing consumer PAssert$33/GroupGlobally/Window.Into()/Window.Assign into OutputSideInputs
Jun 02, 2018 1:05:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:05:30.951Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
Jun 02, 2018 1:05:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:05:30.996Z: Fusing consumer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map into PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
Jun 02, 2018 1:05:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:05:31.042Z: Fusing consumer PAssert$33/GroupGlobally/RewindowActuals/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map
Jun 02, 2018 1:05:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:05:31.090Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read
Jun 02, 2018 1:05:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:05:31.137Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
Jun 02, 2018 1:05:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:05:31.183Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
Jun 02, 2018 1:05:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:05:31.222Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
Jun 02, 2018 1:05:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:05:31.268Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
Jun 02, 2018 1:05:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:05:31.312Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
Jun 02, 2018 1:05:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:05:31.357Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into Create47/Read(CreateSource)
Jun 02, 2018 1:05:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:05:31.398Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
Jun 02, 2018 1:05:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:05:31.438Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
Jun 02, 2018 1:05:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:05:31.484Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
Jun 02, 2018 1:05:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:05:31.522Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
Jun 02, 2018 1:05:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:05:31.562Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
Jun 02, 2018 1:05:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:05:31.602Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
Jun 02, 2018 1:05:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:05:32.022Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Create
Jun 02, 2018 1:05:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:05:32.098Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Create
Jun 02, 2018 1:05:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:05:32.146Z: Starting 1 workers in us-central1-b...
Jun 02, 2018 1:05:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:05:32.146Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
Jun 02, 2018 1:05:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:05:32.186Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
Jun 02, 2018 1:05:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:05:32.390Z: Executing operation PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
Jun 02, 2018 1:05:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:05:32.435Z: Executing operation Create47/Read(CreateSource)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
Jun 02, 2018 1:05:44 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:05:42.056Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
Jun 02, 2018 1:05:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:05:52.635Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
Jun 02, 2018 1:05:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:05:52.675Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
Jun 02, 2018 1:06:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:06:10.213Z: Workers have started successfully.
Jun 02, 2018 1:06:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:06:35.350Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
Jun 02, 2018 1:06:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:06:35.437Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
Jun 02, 2018 1:06:43 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:06:40.974Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
Jun 02, 2018 1:06:43 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:06:41.071Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
Jun 02, 2018 1:06:50 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:06:50.396Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
Jun 02, 2018 1:06:50 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:06:50.598Z: Executing operation Create123/Read(CreateSource)+OutputSideInputs+PAssert$33/GroupGlobally/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write
Jun 02, 2018 1:06:57 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:06:55.669Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Close
Jun 02, 2018 1:06:57 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:06:55.766Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$33/GroupGlobally/RewindowActuals/Window.Assign+PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
Jun 02, 2018 1:06:59 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:06:58.084Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Close
Jun 02, 2018 1:06:59 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:06:58.174Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Read+PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$33/GroupGlobally/Values/Values/Map+PAssert$33/GroupGlobally/ParDo(Concat)+PAssert$33/GetPane/Map+PAssert$33/RunChecks+PAssert$33/VerifyAssertions/ParDo(DefaultConclude)
Jun 02, 2018 1:07:02 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:07:02.048Z: Cleaning up.
Jun 02, 2018 1:07:02 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:07:02.149Z: Stopping worker pool...
Jun 02, 2018 1:08:43 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:08:42.078Z: Autoscaling: Resized worker pool from 1 to 0.
Jun 02, 2018 1:08:43 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:08:42.123Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
Jun 02, 2018 1:08:52 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-06-01_18_05_21-12746651185546532388 finished with status DONE.
Jun 02, 2018 1:08:52 AM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-06-01_18_05_21-12746651185546532388. Found 1 success, 0 failures out of 1 expected assertions.
Gradle Test Executor 38 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest FAILED
209 tests completed, 34 failed, 2 skipped
Finished generating test XML results (0.611 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerTest>
Generating HTML test report...
Finished generating test html results (0.449 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest>
:beam-runners-google-cloud-dataflow-java:validatesRunnerTest (Thread[Task worker for ':' Thread 40,5,main]) completed. Took 2 hrs 10 mins 41.41 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:validatesRunnerTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 11m 33s
38 actionable tasks: 34 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/penehpisajvfe
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user katarzyna.kucharczyk@polidea.com
Not sending mail to unregistered user robbe.sneyders@ml6.eu
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user schroederc@google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user sidhom@google.com
Not sending mail to unregistered user cademarkegard@gmail.com
Not sending mail to unregistered user aromanenko.dev@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ammons@google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user kedin@google.com
Build failed in Jenkins:
beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #399
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/399/display/redirect?page=changes>
Changes:
[tgroh] Add an abstraction for State and Timers
[tgroh] DirectRunner Cleanups
[tgroh] Link up the Portable DirectRunner
[tgroh] Reuse ID Generators across Environments
------------------------------------------
[...truncated 18.23 MB...]
Jun 01, 2018 10:53:04 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RewindowActuals/Window.Assign as step s18
Jun 01, 2018 10:53:04 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map as step s19
Jun 01, 2018 10:53:04 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveActualsTriggering/Flatten.PCollections as step s20
Jun 01, 2018 10:53:04 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Create.Values/Read(CreateSource) as step s21
Jun 01, 2018 10:53:04 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign as step s22
Jun 01, 2018 10:53:04 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveDummyTriggering/Flatten.PCollections as step s23
Jun 01, 2018 10:53:04 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/FlattenDummyAndContents as step s24
Jun 01, 2018 10:53:04 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/NeverTrigger/Flatten.PCollections as step s25
Jun 01, 2018 10:53:04 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GroupDummyAndContents as step s26
Jun 01, 2018 10:53:04 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Values/Values/Map as step s27
Jun 01, 2018 10:53:04 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/ParDo(Concat) as step s28
Jun 01, 2018 10:53:04 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GetPane/Map as step s29
Jun 01, 2018 10:53:04 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/RunChecks as step s30
Jun 01, 2018 10:53:04 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/VerifyAssertions/ParDo(DefaultConclude) as step s31
Jun 01, 2018 10:53:04 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0601225300-148a29ea/output/results/staging/
Jun 01, 2018 10:53:04 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <71120 bytes, hash _joS0SriPgJ7W-VfhEQe3w> to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0601225300-148a29ea/output/results/staging/pipeline-_joS0SriPgJ7W-VfhEQe3w.pb
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
Jun 01, 2018 10:53:05 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-06-01_15_53_04-17341074202606167799?project=apache-beam-testing
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Submitted job: 2018-06-01_15_53_04-17341074202606167799
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
Jun 01, 2018 10:53:05 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-06-01_15_53_04-17341074202606167799
Jun 01, 2018 10:53:05 PM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-06-01_15_53_04-17341074202606167799 with 1 expected assertions.
Jun 01, 2018 10:53:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:53:04.813Z: Autoscaling is enabled for job 2018-06-01_15_53_04-17341074202606167799. The number of workers will be between 1 and 1000.
Jun 01, 2018 10:53:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:53:04.839Z: Autoscaling was automatically enabled for job 2018-06-01_15_53_04-17341074202606167799.
Jun 01, 2018 10:53:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:53:07.611Z: Checking required Cloud APIs are enabled.
Jun 01, 2018 10:53:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:53:07.921Z: Checking permissions granted to controller Service Account.
Jun 01, 2018 10:53:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:53:13.421Z: Worker configuration: n1-standard-1 in us-central1-b.
Jun 01, 2018 10:53:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:53:13.810Z: Expanding CoGroupByKey operations into optimizable parts.
Jun 01, 2018 10:53:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:53:13.964Z: Expanding GroupByKey operations into optimizable parts.
Jun 01, 2018 10:53:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:53:14.002Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
Jun 01, 2018 10:53:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:53:14.185Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
Jun 01, 2018 10:53:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:53:14.218Z: Elided trivial flatten
Jun 01, 2018 10:53:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:53:14.249Z: Elided trivial flatten
Jun 01, 2018 10:53:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:53:14.291Z: Elided trivial flatten
Jun 01, 2018 10:53:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:53:14.325Z: Unzipping flatten s24 for input s19.org.apache.beam.sdk.values.PCollection.<init>:329#8fd0f908e3ea90e3
Jun 01, 2018 10:53:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:53:14.363Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Reify, through flatten PAssert$33/GroupGlobally/FlattenDummyAndContents, into producer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map
Jun 01, 2018 10:53:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:53:14.399Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow into PAssert$33/GroupGlobally/GroupDummyAndContents/Read
Jun 01, 2018 10:53:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:53:14.428Z: Fusing consumer PAssert$33/GroupGlobally/ParDo(Concat) into PAssert$33/GroupGlobally/Values/Values/Map
Jun 01, 2018 10:53:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:53:14.462Z: Fusing consumer PAssert$33/GetPane/Map into PAssert$33/GroupGlobally/ParDo(Concat)
Jun 01, 2018 10:53:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:53:14.497Z: Fusing consumer PAssert$33/GroupGlobally/Values/Values/Map into PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow
Jun 01, 2018 10:53:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:53:14.536Z: Fusing consumer PAssert$33/RunChecks into PAssert$33/GetPane/Map
Jun 01, 2018 10:53:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:53:14.572Z: Fusing consumer PAssert$33/VerifyAssertions/ParDo(DefaultConclude) into PAssert$33/RunChecks
Jun 01, 2018 10:53:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:53:14.610Z: Unzipping flatten s24-u45 for input s26-reify-value18-c43
Jun 01, 2018 10:53:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:53:14.642Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Write, through flatten s24-u45, into producer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
Jun 01, 2018 10:53:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:53:14.674Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify into PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
Jun 01, 2018 10:53:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:53:14.711Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Write into PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
Jun 01, 2018 10:53:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:53:14.753Z: Fusing consumer PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)
Jun 01, 2018 10:53:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:53:14.785Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
Jun 01, 2018 10:53:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:53:14.823Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
Jun 01, 2018 10:53:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:53:14.855Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into PAssert$33/GroupGlobally/Window.Into()/Window.Assign
Jun 01, 2018 10:53:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:53:14.886Z: Fusing consumer OutputSideInputs into Create123/Read(CreateSource)
Jun 01, 2018 10:53:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:53:14.912Z: Fusing consumer PAssert$33/GroupGlobally/Window.Into()/Window.Assign into OutputSideInputs
Jun 01, 2018 10:53:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:53:14.950Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
Jun 01, 2018 10:53:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:53:14.983Z: Fusing consumer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map into PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
Jun 01, 2018 10:53:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:53:15.012Z: Fusing consumer PAssert$33/GroupGlobally/RewindowActuals/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map
Jun 01, 2018 10:53:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:53:15.041Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read
Jun 01, 2018 10:53:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:53:15.077Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
Jun 01, 2018 10:53:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:53:15.113Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
Jun 01, 2018 10:53:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:53:15.148Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
Jun 01, 2018 10:53:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:53:15.191Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
Jun 01, 2018 10:53:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:53:15.220Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
Jun 01, 2018 10:53:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:53:15.255Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into Create47/Read(CreateSource)
Jun 01, 2018 10:53:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:53:15.286Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
Jun 01, 2018 10:53:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:53:15.314Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
Jun 01, 2018 10:53:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:53:15.350Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
Jun 01, 2018 10:53:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:53:15.388Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
Jun 01, 2018 10:53:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:53:15.423Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
Jun 01, 2018 10:53:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:53:15.454Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
Jun 01, 2018 10:53:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:53:15.804Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Create
Jun 01, 2018 10:53:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:53:15.832Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Create
Jun 01, 2018 10:53:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:53:15.858Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
Jun 01, 2018 10:53:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:53:15.872Z: Starting 1 workers in us-central1-b...
Jun 01, 2018 10:53:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:53:15.880Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
Jun 01, 2018 10:53:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:53:16.059Z: Executing operation Create47/Read(CreateSource)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
Jun 01, 2018 10:53:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:53:16.095Z: Executing operation PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
Jun 01, 2018 10:53:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:53:26.884Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
Jun 01, 2018 10:53:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:53:43.075Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
Jun 01, 2018 10:53:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:53:43.096Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
Jun 01, 2018 10:54:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:53:59.966Z: Workers have started successfully.
Jun 01, 2018 10:54:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:54:29.400Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
Jun 01, 2018 10:54:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:54:29.474Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
Jun 01, 2018 10:54:40 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:54:39.275Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
Jun 01, 2018 10:54:40 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:54:39.381Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
Jun 01, 2018 10:54:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:54:51.830Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
Jun 01, 2018 10:54:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:54:51.993Z: Executing operation Create123/Read(CreateSource)+OutputSideInputs+PAssert$33/GroupGlobally/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write
Jun 01, 2018 10:54:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:54:58.563Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Close
Jun 01, 2018 10:54:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:54:58.634Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$33/GroupGlobally/RewindowActuals/Window.Assign+PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
Jun 01, 2018 10:55:02 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:55:01.422Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Close
Jun 01, 2018 10:55:02 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:55:01.490Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Read+PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$33/GroupGlobally/Values/Values/Map+PAssert$33/GroupGlobally/ParDo(Concat)+PAssert$33/GetPane/Map+PAssert$33/RunChecks+PAssert$33/VerifyAssertions/ParDo(DefaultConclude)
Jun 01, 2018 10:55:06 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:55:05.530Z: Cleaning up.
Jun 01, 2018 10:55:06 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:55:05.621Z: Stopping worker pool...
Jun 01, 2018 10:56:56 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:56:53.883Z: Autoscaling: Resized worker pool from 1 to 0.
Jun 01, 2018 10:56:56 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:56:53.904Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
Jun 01, 2018 10:56:56 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:56:53.937Z: Worker pool stopped.
Jun 01, 2018 10:57:02 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-06-01_15_53_04-17341074202606167799 finished with status DONE.
Jun 01, 2018 10:57:02 PM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-06-01_15_53_04-17341074202606167799. Found 1 success, 0 failures out of 1 expected assertions.
Gradle Test Executor 36 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest FAILED
209 tests completed, 34 failed, 2 skipped
Finished generating test XML results (0.476 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerTest>
Generating HTML test report...
Finished generating test html results (0.476 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest>
:beam-runners-google-cloud-dataflow-java:validatesRunnerTest (Thread[Task worker for ':' Thread 7,5,main]) completed. Took 2 hrs 9 mins 26.326 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:validatesRunnerTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 10m 19s
38 actionable tasks: 34 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/5fiea6rlyu6nw
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user katarzyna.kucharczyk@polidea.com
Not sending mail to unregistered user robbe.sneyders@ml6.eu
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user schroederc@google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user sidhom@google.com
Not sending mail to unregistered user cademarkegard@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ammons@google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user kedin@google.com
Build failed in Jenkins:
beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #398
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/398/display/redirect?page=changes>
Changes:
[boyuanz] Address BEAM-4328: :beam-sdks-java-io-google-cloud-platform:test failure
------------------------------------------
[...truncated 18.15 MB...]
Jun 01, 2018 8:42:37 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map as step s17
Jun 01, 2018 8:42:37 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RewindowActuals/Window.Assign as step s18
Jun 01, 2018 8:42:37 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map as step s19
Jun 01, 2018 8:42:37 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveActualsTriggering/Flatten.PCollections as step s20
Jun 01, 2018 8:42:37 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Create.Values/Read(CreateSource) as step s21
Jun 01, 2018 8:42:37 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign as step s22
Jun 01, 2018 8:42:37 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveDummyTriggering/Flatten.PCollections as step s23
Jun 01, 2018 8:42:37 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/FlattenDummyAndContents as step s24
Jun 01, 2018 8:42:37 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/NeverTrigger/Flatten.PCollections as step s25
Jun 01, 2018 8:42:37 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GroupDummyAndContents as step s26
Jun 01, 2018 8:42:37 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Values/Values/Map as step s27
Jun 01, 2018 8:42:37 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/ParDo(Concat) as step s28
Jun 01, 2018 8:42:37 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GetPane/Map as step s29
Jun 01, 2018 8:42:37 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/RunChecks as step s30
Jun 01, 2018 8:42:37 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/VerifyAssertions/ParDo(DefaultConclude) as step s31
Jun 01, 2018 8:42:37 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0601204233-797de8fc/output/results/staging/
Jun 01, 2018 8:42:37 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <71120 bytes, hash WJ74_K4nTbzQBDBXyDS5Dw> to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0601204233-797de8fc/output/results/staging/pipeline-WJ74_K4nTbzQBDBXyDS5Dw.pb
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
Jun 01, 2018 8:42:38 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-06-01_13_42_37-458591976342178231?project=apache-beam-testing
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Submitted job: 2018-06-01_13_42_37-458591976342178231
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
Jun 01, 2018 8:42:38 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-06-01_13_42_37-458591976342178231
Jun 01, 2018 8:42:38 PM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-06-01_13_42_37-458591976342178231 with 1 expected assertions.
Jun 01, 2018 8:42:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:42:37.959Z: Autoscaling is enabled for job 2018-06-01_13_42_37-458591976342178231. The number of workers will be between 1 and 1000.
Jun 01, 2018 8:42:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:42:38.008Z: Autoscaling was automatically enabled for job 2018-06-01_13_42_37-458591976342178231.
Jun 01, 2018 8:42:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:42:40.656Z: Checking required Cloud APIs are enabled.
Jun 01, 2018 8:42:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:42:40.972Z: Checking permissions granted to controller Service Account.
Jun 01, 2018 8:42:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:42:48.526Z: Worker configuration: n1-standard-1 in us-central1-b.
Jun 01, 2018 8:42:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:42:49.025Z: Expanding CoGroupByKey operations into optimizable parts.
Jun 01, 2018 8:42:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:42:49.188Z: Expanding GroupByKey operations into optimizable parts.
Jun 01, 2018 8:42:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:42:49.239Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
Jun 01, 2018 8:42:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:42:49.498Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
Jun 01, 2018 8:42:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:42:49.542Z: Elided trivial flatten
Jun 01, 2018 8:42:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:42:49.594Z: Elided trivial flatten
Jun 01, 2018 8:42:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:42:49.646Z: Elided trivial flatten
Jun 01, 2018 8:42:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:42:49.682Z: Unzipping flatten s24 for input s19.org.apache.beam.sdk.values.PCollection.<init>:329#8fd0f908e3ea90e3
Jun 01, 2018 8:42:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:42:49.724Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Reify, through flatten PAssert$33/GroupGlobally/FlattenDummyAndContents, into producer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map
Jun 01, 2018 8:42:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:42:49.772Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow into PAssert$33/GroupGlobally/GroupDummyAndContents/Read
Jun 01, 2018 8:42:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:42:49.813Z: Fusing consumer PAssert$33/GroupGlobally/ParDo(Concat) into PAssert$33/GroupGlobally/Values/Values/Map
Jun 01, 2018 8:42:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:42:49.849Z: Fusing consumer PAssert$33/GetPane/Map into PAssert$33/GroupGlobally/ParDo(Concat)
Jun 01, 2018 8:42:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:42:49.892Z: Fusing consumer PAssert$33/GroupGlobally/Values/Values/Map into PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow
Jun 01, 2018 8:42:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:42:49.934Z: Fusing consumer PAssert$33/RunChecks into PAssert$33/GetPane/Map
Jun 01, 2018 8:42:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:42:49.978Z: Fusing consumer PAssert$33/VerifyAssertions/ParDo(DefaultConclude) into PAssert$33/RunChecks
Jun 01, 2018 8:42:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:42:50.025Z: Unzipping flatten s24-u45 for input s26-reify-value18-c43
Jun 01, 2018 8:42:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:42:50.071Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Write, through flatten s24-u45, into producer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
Jun 01, 2018 8:42:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:42:50.109Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify into PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
Jun 01, 2018 8:42:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:42:50.146Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Write into PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
Jun 01, 2018 8:42:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:42:50.185Z: Fusing consumer PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)
Jun 01, 2018 8:42:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:42:50.227Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
Jun 01, 2018 8:42:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:42:50.260Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
Jun 01, 2018 8:42:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:42:50.294Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into PAssert$33/GroupGlobally/Window.Into()/Window.Assign
Jun 01, 2018 8:42:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:42:50.331Z: Fusing consumer OutputSideInputs into Create123/Read(CreateSource)
Jun 01, 2018 8:42:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:42:50.380Z: Fusing consumer PAssert$33/GroupGlobally/Window.Into()/Window.Assign into OutputSideInputs
Jun 01, 2018 8:42:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:42:50.429Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
Jun 01, 2018 8:42:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:42:50.474Z: Fusing consumer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map into PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
Jun 01, 2018 8:42:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:42:50.503Z: Fusing consumer PAssert$33/GroupGlobally/RewindowActuals/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map
Jun 01, 2018 8:42:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:42:50.540Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read
Jun 01, 2018 8:42:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:42:50.581Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
Jun 01, 2018 8:42:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:42:50.628Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
Jun 01, 2018 8:42:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:42:50.672Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
Jun 01, 2018 8:42:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:42:50.721Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
Jun 01, 2018 8:42:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:42:50.774Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
Jun 01, 2018 8:42:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:42:50.809Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into Create47/Read(CreateSource)
Jun 01, 2018 8:42:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:42:50.854Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
Jun 01, 2018 8:42:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:42:50.904Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
Jun 01, 2018 8:42:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:42:50.952Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
Jun 01, 2018 8:42:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:42:51.004Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
Jun 01, 2018 8:42:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:42:51.050Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
Jun 01, 2018 8:42:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:42:51.078Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
Jun 01, 2018 8:42:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:42:51.568Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Create
Jun 01, 2018 8:42:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:42:51.601Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Create
Jun 01, 2018 8:42:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:42:51.640Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
Jun 01, 2018 8:42:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:42:51.663Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
Jun 01, 2018 8:42:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:42:51.663Z: Starting 1 workers in us-central1-b...
Jun 01, 2018 8:42:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:42:51.908Z: Executing operation PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
Jun 01, 2018 8:42:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:42:51.958Z: Executing operation Create47/Read(CreateSource)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
Jun 01, 2018 8:43:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:43:01.357Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
Jun 01, 2018 8:43:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:43:12.060Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
Jun 01, 2018 8:43:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:43:12.113Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
Jun 01, 2018 8:43:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:43:29.677Z: Workers have started successfully.
Jun 01, 2018 8:43:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:43:58.259Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
Jun 01, 2018 8:43:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:43:58.354Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
Jun 01, 2018 8:44:07 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:44:05.653Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
Jun 01, 2018 8:44:07 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:44:05.755Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
Jun 01, 2018 8:44:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:44:17.983Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
Jun 01, 2018 8:44:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:44:18.158Z: Executing operation Create123/Read(CreateSource)+OutputSideInputs+PAssert$33/GroupGlobally/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write
Jun 01, 2018 8:44:24 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:44:23.750Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Close
Jun 01, 2018 8:44:24 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:44:23.812Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$33/GroupGlobally/RewindowActuals/Window.Assign+PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
Jun 01, 2018 8:44:29 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:44:28.544Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Close
Jun 01, 2018 8:44:29 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:44:28.602Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Read+PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$33/GroupGlobally/Values/Values/Map+PAssert$33/GroupGlobally/ParDo(Concat)+PAssert$33/GetPane/Map+PAssert$33/RunChecks+PAssert$33/VerifyAssertions/ParDo(DefaultConclude)
Jun 01, 2018 8:44:32 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:44:31.597Z: Cleaning up.
Jun 01, 2018 8:44:32 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:44:31.672Z: Stopping worker pool...
Jun 01, 2018 8:46:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:46:19.617Z: Autoscaling: Resized worker pool from 1 to 0.
Jun 01, 2018 8:46:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:46:19.669Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
Jun 01, 2018 8:46:29 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-06-01_13_42_37-458591976342178231 finished with status DONE.
Jun 01, 2018 8:46:29 PM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-06-01_13_42_37-458591976342178231. Found 1 success, 0 failures out of 1 expected assertions.
Gradle Test Executor 38 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest FAILED
209 tests completed, 34 failed, 2 skipped
Finished generating test XML results (0.592 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerTest>
Generating HTML test report...
Finished generating test html results (0.422 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest>
:beam-runners-google-cloud-dataflow-java:validatesRunnerTest (Thread[Task worker for ':' Thread 29,5,main]) completed. Took 2 hrs 18 mins 31.196 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:validatesRunnerTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 19m 22s
38 actionable tasks: 34 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/w2ko2bvgjjuxw
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user katarzyna.kucharczyk@polidea.com
Not sending mail to unregistered user robbe.sneyders@ml6.eu
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user schroederc@google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user sidhom@google.com
Not sending mail to unregistered user cademarkegard@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ammons@google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user kedin@google.com
Build failed in Jenkins:
beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #397
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/397/display/redirect?page=changes>
Changes:
[github] Undefined names: import MetricKey, MetricName
------------------------------------------
[...truncated 18.18 MB...]
Jun 01, 2018 6:23:17 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RewindowActuals/Window.Assign as step s18
Jun 01, 2018 6:23:17 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map as step s19
Jun 01, 2018 6:23:17 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveActualsTriggering/Flatten.PCollections as step s20
Jun 01, 2018 6:23:17 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Create.Values/Read(CreateSource) as step s21
Jun 01, 2018 6:23:17 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign as step s22
Jun 01, 2018 6:23:17 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveDummyTriggering/Flatten.PCollections as step s23
Jun 01, 2018 6:23:17 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/FlattenDummyAndContents as step s24
Jun 01, 2018 6:23:17 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/NeverTrigger/Flatten.PCollections as step s25
Jun 01, 2018 6:23:17 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GroupDummyAndContents as step s26
Jun 01, 2018 6:23:17 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Values/Values/Map as step s27
Jun 01, 2018 6:23:17 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/ParDo(Concat) as step s28
Jun 01, 2018 6:23:17 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GetPane/Map as step s29
Jun 01, 2018 6:23:17 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/RunChecks as step s30
Jun 01, 2018 6:23:17 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/VerifyAssertions/ParDo(DefaultConclude) as step s31
Jun 01, 2018 6:23:17 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0601182303-3032c7a9/output/results/staging/
Jun 01, 2018 6:23:17 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <71120 bytes, hash fPqOJ_a3RkUlyoG4jFwK6w> to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0601182303-3032c7a9/output/results/staging/pipeline-fPqOJ_a3RkUlyoG4jFwK6w.pb
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
Jun 01, 2018 6:23:18 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-06-01_11_23_17-6039041211300200157?project=apache-beam-testing
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Submitted job: 2018-06-01_11_23_17-6039041211300200157
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
Jun 01, 2018 6:23:18 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-06-01_11_23_17-6039041211300200157
Jun 01, 2018 6:23:18 PM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-06-01_11_23_17-6039041211300200157 with 1 expected assertions.
Jun 01, 2018 6:23:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:23:17.943Z: Autoscaling is enabled for job 2018-06-01_11_23_17-6039041211300200157. The number of workers will be between 1 and 1000.
Jun 01, 2018 6:23:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:23:17.982Z: Autoscaling was automatically enabled for job 2018-06-01_11_23_17-6039041211300200157.
Jun 01, 2018 6:23:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:23:20.920Z: Checking required Cloud APIs are enabled.
Jun 01, 2018 6:23:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:23:21.246Z: Checking permissions granted to controller Service Account.
Jun 01, 2018 6:23:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:23:27.329Z: Worker configuration: n1-standard-1 in us-central1-b.
Jun 01, 2018 6:23:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:23:27.767Z: Expanding CoGroupByKey operations into optimizable parts.
Jun 01, 2018 6:23:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:23:27.952Z: Expanding GroupByKey operations into optimizable parts.
Jun 01, 2018 6:23:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:23:27.990Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
Jun 01, 2018 6:23:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:23:28.224Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
Jun 01, 2018 6:23:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:23:28.270Z: Elided trivial flatten
Jun 01, 2018 6:23:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:23:28.306Z: Elided trivial flatten
Jun 01, 2018 6:23:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:23:28.340Z: Elided trivial flatten
Jun 01, 2018 6:23:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:23:28.379Z: Unzipping flatten s24 for input s19.org.apache.beam.sdk.values.PCollection.<init>:329#8fd0f908e3ea90e3
Jun 01, 2018 6:23:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:23:28.424Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Reify, through flatten PAssert$33/GroupGlobally/FlattenDummyAndContents, into producer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map
Jun 01, 2018 6:23:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:23:28.460Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow into PAssert$33/GroupGlobally/GroupDummyAndContents/Read
Jun 01, 2018 6:23:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:23:28.504Z: Fusing consumer PAssert$33/GroupGlobally/ParDo(Concat) into PAssert$33/GroupGlobally/Values/Values/Map
Jun 01, 2018 6:23:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:23:28.550Z: Fusing consumer PAssert$33/GetPane/Map into PAssert$33/GroupGlobally/ParDo(Concat)
Jun 01, 2018 6:23:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:23:28.584Z: Fusing consumer PAssert$33/GroupGlobally/Values/Values/Map into PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow
Jun 01, 2018 6:23:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:23:28.630Z: Fusing consumer PAssert$33/RunChecks into PAssert$33/GetPane/Map
Jun 01, 2018 6:23:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:23:28.677Z: Fusing consumer PAssert$33/VerifyAssertions/ParDo(DefaultConclude) into PAssert$33/RunChecks
Jun 01, 2018 6:23:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:23:28.721Z: Unzipping flatten s24-u45 for input s26-reify-value18-c43
Jun 01, 2018 6:23:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:23:28.768Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Write, through flatten s24-u45, into producer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
Jun 01, 2018 6:23:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:23:28.815Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify into PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
Jun 01, 2018 6:23:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:23:28.853Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Write into PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
Jun 01, 2018 6:23:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:23:28.902Z: Fusing consumer PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)
Jun 01, 2018 6:23:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:23:28.949Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
Jun 01, 2018 6:23:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:23:28.998Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
Jun 01, 2018 6:23:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:23:29.048Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into PAssert$33/GroupGlobally/Window.Into()/Window.Assign
Jun 01, 2018 6:23:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:23:29.088Z: Fusing consumer OutputSideInputs into Create123/Read(CreateSource)
Jun 01, 2018 6:23:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:23:29.124Z: Fusing consumer PAssert$33/GroupGlobally/Window.Into()/Window.Assign into OutputSideInputs
Jun 01, 2018 6:23:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:23:29.163Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
Jun 01, 2018 6:23:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:23:29.209Z: Fusing consumer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map into PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
Jun 01, 2018 6:23:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:23:29.255Z: Fusing consumer PAssert$33/GroupGlobally/RewindowActuals/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map
Jun 01, 2018 6:23:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:23:29.304Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read
Jun 01, 2018 6:23:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:23:29.349Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
Jun 01, 2018 6:23:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:23:29.393Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
Jun 01, 2018 6:23:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:23:29.433Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
Jun 01, 2018 6:23:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:23:29.478Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
Jun 01, 2018 6:23:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:23:29.528Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
Jun 01, 2018 6:23:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:23:29.563Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into Create47/Read(CreateSource)
Jun 01, 2018 6:23:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:23:29.615Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
Jun 01, 2018 6:23:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:23:29.663Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
Jun 01, 2018 6:23:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:23:29.710Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
Jun 01, 2018 6:23:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:23:29.756Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
Jun 01, 2018 6:23:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:23:29.803Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
Jun 01, 2018 6:23:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:23:29.846Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
Jun 01, 2018 6:23:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:23:30.431Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Create
Jun 01, 2018 6:23:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:23:30.467Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Create
Jun 01, 2018 6:23:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:23:30.515Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
Jun 01, 2018 6:23:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:23:30.525Z: Starting 1 workers in us-central1-b...
Jun 01, 2018 6:23:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:23:30.561Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
Jun 01, 2018 6:23:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:23:30.815Z: Executing operation PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
Jun 01, 2018 6:23:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:23:30.861Z: Executing operation Create47/Read(CreateSource)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
Jun 01, 2018 6:23:40 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:23:40.519Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
Jun 01, 2018 6:23:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:23:51.246Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
Jun 01, 2018 6:23:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:23:51.275Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
Jun 01, 2018 6:24:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:24:07.301Z: Workers have started successfully.
Jun 01, 2018 6:24:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:24:38.218Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
Jun 01, 2018 6:24:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:24:38.308Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
Jun 01, 2018 6:24:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:24:44.730Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
Jun 01, 2018 6:24:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:24:44.823Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
Jun 01, 2018 6:24:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:24:57.677Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
Jun 01, 2018 6:24:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:24:57.867Z: Executing operation Create123/Read(CreateSource)+OutputSideInputs+PAssert$33/GroupGlobally/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write
Jun 01, 2018 6:25:03 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:25:01.799Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Close
Jun 01, 2018 6:25:03 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:25:01.911Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$33/GroupGlobally/RewindowActuals/Window.Assign+PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
Jun 01, 2018 6:25:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:25:07.740Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Close
Jun 01, 2018 6:25:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:25:07.859Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Read+PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$33/GroupGlobally/Values/Values/Map+PAssert$33/GroupGlobally/ParDo(Concat)+PAssert$33/GetPane/Map+PAssert$33/RunChecks+PAssert$33/VerifyAssertions/ParDo(DefaultConclude)
Jun 01, 2018 6:25:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:25:11.928Z: Cleaning up.
Jun 01, 2018 6:25:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:25:12.049Z: Stopping worker pool...
Jun 01, 2018 6:26:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:26:41.198Z: Autoscaling: Resized worker pool from 1 to 0.
Jun 01, 2018 6:26:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:26:41.237Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
Jun 01, 2018 6:26:50 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-06-01_11_23_17-6039041211300200157 finished with status DONE.
Jun 01, 2018 6:26:50 PM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-06-01_11_23_17-6039041211300200157. Found 1 success, 0 failures out of 1 expected assertions.
Gradle Test Executor 39 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest
209 tests completed, 34 failed, 2 skipped
Finished generating test XML results (0.812 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerTest>
Generating HTML test report...
Finished generating test html results (0.883 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest>
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest FAILED
:beam-runners-google-cloud-dataflow-java:validatesRunnerTest (Thread[Task worker for ':' Thread 46,5,main]) completed. Took 2 hrs 19 mins 16.805 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:validatesRunnerTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 20m 13s
38 actionable tasks: 34 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/4ar4jrxgtukha
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user katarzyna.kucharczyk@polidea.com
Not sending mail to unregistered user robbe.sneyders@ml6.eu
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user schroederc@google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user sidhom@google.com
Not sending mail to unregistered user cademarkegard@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ammons@google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user kedin@google.com
Build failed in Jenkins:
beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #396
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/396/display/redirect>
------------------------------------------
[...truncated 18.18 MB...]
Jun 01, 2018 3:50:56 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RewindowActuals/Window.Assign as step s18
Jun 01, 2018 3:50:56 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map as step s19
Jun 01, 2018 3:50:56 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveActualsTriggering/Flatten.PCollections as step s20
Jun 01, 2018 3:50:56 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Create.Values/Read(CreateSource) as step s21
Jun 01, 2018 3:50:56 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign as step s22
Jun 01, 2018 3:50:56 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveDummyTriggering/Flatten.PCollections as step s23
Jun 01, 2018 3:50:56 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/FlattenDummyAndContents as step s24
Jun 01, 2018 3:50:56 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/NeverTrigger/Flatten.PCollections as step s25
Jun 01, 2018 3:50:56 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GroupDummyAndContents as step s26
Jun 01, 2018 3:50:56 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Values/Values/Map as step s27
Jun 01, 2018 3:50:56 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/ParDo(Concat) as step s28
Jun 01, 2018 3:50:56 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GetPane/Map as step s29
Jun 01, 2018 3:50:56 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/RunChecks as step s30
Jun 01, 2018 3:50:56 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/VerifyAssertions/ParDo(DefaultConclude) as step s31
Jun 01, 2018 3:50:56 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0601155050-64af26cc/output/results/staging/
Jun 01, 2018 3:50:56 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <71120 bytes, hash 1yQc7RGPzIWzi7NspfUpQQ> to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0601155050-64af26cc/output/results/staging/pipeline-1yQc7RGPzIWzi7NspfUpQQ.pb
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
Jun 01, 2018 3:50:57 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-06-01_08_50_57-10907534992205857506?project=apache-beam-testing
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Submitted job: 2018-06-01_08_50_57-10907534992205857506
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
Jun 01, 2018 3:50:57 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-06-01_08_50_57-10907534992205857506
Jun 01, 2018 3:50:57 PM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-06-01_08_50_57-10907534992205857506 with 1 expected assertions.
Jun 01, 2018 3:51:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:50:57.188Z: Autoscaling is enabled for job 2018-06-01_08_50_57-10907534992205857506. The number of workers will be between 1 and 1000.
Jun 01, 2018 3:51:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:50:57.229Z: Autoscaling was automatically enabled for job 2018-06-01_08_50_57-10907534992205857506.
Jun 01, 2018 3:51:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:50:59.595Z: Checking required Cloud APIs are enabled.
Jun 01, 2018 3:51:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:50:59.909Z: Checking permissions granted to controller Service Account.
Jun 01, 2018 3:51:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:51:03.834Z: Worker configuration: n1-standard-1 in us-central1-b.
Jun 01, 2018 3:51:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:51:04.334Z: Expanding CoGroupByKey operations into optimizable parts.
Jun 01, 2018 3:51:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:51:04.518Z: Expanding GroupByKey operations into optimizable parts.
Jun 01, 2018 3:51:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:51:04.558Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
Jun 01, 2018 3:51:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:51:04.777Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
Jun 01, 2018 3:51:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:51:04.824Z: Elided trivial flatten
Jun 01, 2018 3:51:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:51:04.873Z: Elided trivial flatten
Jun 01, 2018 3:51:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:51:04.918Z: Elided trivial flatten
Jun 01, 2018 3:51:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:51:04.966Z: Unzipping flatten s24 for input s19.org.apache.beam.sdk.values.PCollection.<init>:329#8fd0f908e3ea90e3
Jun 01, 2018 3:51:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:51:05.012Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Reify, through flatten PAssert$33/GroupGlobally/FlattenDummyAndContents, into producer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map
Jun 01, 2018 3:51:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:51:05.058Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow into PAssert$33/GroupGlobally/GroupDummyAndContents/Read
Jun 01, 2018 3:51:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:51:05.093Z: Fusing consumer PAssert$33/GroupGlobally/ParDo(Concat) into PAssert$33/GroupGlobally/Values/Values/Map
Jun 01, 2018 3:51:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:51:05.121Z: Fusing consumer PAssert$33/GetPane/Map into PAssert$33/GroupGlobally/ParDo(Concat)
Jun 01, 2018 3:51:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:51:05.162Z: Fusing consumer PAssert$33/GroupGlobally/Values/Values/Map into PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow
Jun 01, 2018 3:51:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:51:05.195Z: Fusing consumer PAssert$33/RunChecks into PAssert$33/GetPane/Map
Jun 01, 2018 3:51:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:51:05.234Z: Fusing consumer PAssert$33/VerifyAssertions/ParDo(DefaultConclude) into PAssert$33/RunChecks
Jun 01, 2018 3:51:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:51:05.277Z: Unzipping flatten s24-u45 for input s26-reify-value18-c43
Jun 01, 2018 3:51:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:51:05.305Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Write, through flatten s24-u45, into producer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
Jun 01, 2018 3:51:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:51:05.352Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify into PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
Jun 01, 2018 3:51:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:51:05.390Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Write into PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
Jun 01, 2018 3:51:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:51:05.435Z: Fusing consumer PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)
Jun 01, 2018 3:51:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:51:05.472Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
Jun 01, 2018 3:51:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:51:05.510Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
Jun 01, 2018 3:51:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:51:05.555Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into PAssert$33/GroupGlobally/Window.Into()/Window.Assign
Jun 01, 2018 3:51:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:51:05.604Z: Fusing consumer OutputSideInputs into Create123/Read(CreateSource)
Jun 01, 2018 3:51:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:51:05.650Z: Fusing consumer PAssert$33/GroupGlobally/Window.Into()/Window.Assign into OutputSideInputs
Jun 01, 2018 3:51:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:51:05.680Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
Jun 01, 2018 3:51:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:51:05.723Z: Fusing consumer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map into PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
Jun 01, 2018 3:51:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:51:05.767Z: Fusing consumer PAssert$33/GroupGlobally/RewindowActuals/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map
Jun 01, 2018 3:51:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:51:05.810Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read
Jun 01, 2018 3:51:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:51:05.836Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
Jun 01, 2018 3:51:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:51:05.873Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
Jun 01, 2018 3:51:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:51:05.907Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
Jun 01, 2018 3:51:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:51:05.942Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
Jun 01, 2018 3:51:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:51:05.988Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
Jun 01, 2018 3:51:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:51:06.034Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into Create47/Read(CreateSource)
Jun 01, 2018 3:51:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:51:06.071Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
Jun 01, 2018 3:51:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:51:06.110Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
Jun 01, 2018 3:51:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:51:06.146Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
Jun 01, 2018 3:51:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:51:06.188Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
Jun 01, 2018 3:51:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:51:06.225Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
Jun 01, 2018 3:51:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:51:06.272Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
Jun 01, 2018 3:51:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:51:06.703Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Create
Jun 01, 2018 3:51:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:51:06.748Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Create
Jun 01, 2018 3:51:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:51:06.795Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
Jun 01, 2018 3:51:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:51:06.804Z: Starting 1 workers in us-central1-b...
Jun 01, 2018 3:51:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:51:06.835Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
Jun 01, 2018 3:51:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:51:07.074Z: Executing operation PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
Jun 01, 2018 3:51:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:51:07.121Z: Executing operation Create47/Read(CreateSource)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
Jun 01, 2018 3:51:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:51:17.550Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
Jun 01, 2018 3:51:29 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:51:28.229Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
Jun 01, 2018 3:51:29 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:51:28.267Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
Jun 01, 2018 3:51:50 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:51:49.753Z: Workers have started successfully.
Jun 01, 2018 3:52:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:52:11.978Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
Jun 01, 2018 3:52:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:52:12.072Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
Jun 01, 2018 3:52:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:52:22.122Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
Jun 01, 2018 3:52:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:52:22.211Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
Jun 01, 2018 3:52:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:52:35.363Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
Jun 01, 2018 3:52:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:52:35.572Z: Executing operation Create123/Read(CreateSource)+OutputSideInputs+PAssert$33/GroupGlobally/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write
Jun 01, 2018 3:52:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:52:43.395Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Close
Jun 01, 2018 3:52:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:52:43.492Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$33/GroupGlobally/RewindowActuals/Window.Assign+PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
Jun 01, 2018 3:52:48 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:52:48.643Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Close
Jun 01, 2018 3:52:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:52:48.719Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Read+PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$33/GroupGlobally/Values/Values/Map+PAssert$33/GroupGlobally/ParDo(Concat)+PAssert$33/GetPane/Map+PAssert$33/RunChecks+PAssert$33/VerifyAssertions/ParDo(DefaultConclude)
Jun 01, 2018 3:52:54 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:52:53.373Z: Cleaning up.
Jun 01, 2018 3:52:54 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:52:53.466Z: Stopping worker pool...
Jun 01, 2018 3:54:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:54:43.179Z: Autoscaling: Resized worker pool from 1 to 0.
Jun 01, 2018 3:54:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:54:43.213Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
Jun 01, 2018 3:54:53 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-06-01_08_50_57-10907534992205857506 finished with status DONE.
Jun 01, 2018 3:54:53 PM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-06-01_08_50_57-10907534992205857506. Found 1 success, 0 failures out of 1 expected assertions.
Gradle Test Executor 40 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest
209 tests completed, 34 failed, 2 skipped
Finished generating test XML results (0.684 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerTest>
Generating HTML test report...
Finished generating test html results (0.494 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest>
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest FAILED
:beam-runners-google-cloud-dataflow-java:validatesRunnerTest (Thread[Task worker for ':' Thread 7,5,main]) completed. Took 2 hrs 14 mins 51.964 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:validatesRunnerTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 15m 46s
38 actionable tasks: 34 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/ohfgtdzyae2ks
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user katarzyna.kucharczyk@polidea.com
Not sending mail to unregistered user robbe.sneyders@ml6.eu
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user schroederc@google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user sidhom@google.com
Not sending mail to unregistered user cademarkegard@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ammons@google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user kedin@google.com
Build failed in Jenkins:
beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #395
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/395/display/redirect?page=changes>
Changes:
[coheigea] Fixing some ErrorProne warnings
------------------------------------------
[...truncated 18.17 MB...]
Jun 01, 2018 1:35:09 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RewindowActuals/Window.Assign as step s18
Jun 01, 2018 1:35:09 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map as step s19
Jun 01, 2018 1:35:09 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveActualsTriggering/Flatten.PCollections as step s20
Jun 01, 2018 1:35:09 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Create.Values/Read(CreateSource) as step s21
Jun 01, 2018 1:35:09 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign as step s22
Jun 01, 2018 1:35:09 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveDummyTriggering/Flatten.PCollections as step s23
Jun 01, 2018 1:35:09 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/FlattenDummyAndContents as step s24
Jun 01, 2018 1:35:09 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/NeverTrigger/Flatten.PCollections as step s25
Jun 01, 2018 1:35:09 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GroupDummyAndContents as step s26
Jun 01, 2018 1:35:09 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Values/Values/Map as step s27
Jun 01, 2018 1:35:09 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/ParDo(Concat) as step s28
Jun 01, 2018 1:35:09 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GetPane/Map as step s29
Jun 01, 2018 1:35:09 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/RunChecks as step s30
Jun 01, 2018 1:35:09 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/VerifyAssertions/ParDo(DefaultConclude) as step s31
Jun 01, 2018 1:35:09 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0601133506-a6eed56e/output/results/staging/
Jun 01, 2018 1:35:09 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <71120 bytes, hash OC6DR4GCfkEHwmB7IqIMKw> to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0601133506-a6eed56e/output/results/staging/pipeline-OC6DR4GCfkEHwmB7IqIMKw.pb
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
Jun 01, 2018 1:35:10 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-06-01_06_35_09-2386285786239066800?project=apache-beam-testing
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Submitted job: 2018-06-01_06_35_09-2386285786239066800
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
Jun 01, 2018 1:35:10 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-06-01_06_35_09-2386285786239066800
Jun 01, 2018 1:35:10 PM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-06-01_06_35_09-2386285786239066800 with 1 expected assertions.
Jun 01, 2018 1:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:35:09.892Z: Autoscaling is enabled for job 2018-06-01_06_35_09-2386285786239066800. The number of workers will be between 1 and 1000.
Jun 01, 2018 1:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:35:09.929Z: Autoscaling was automatically enabled for job 2018-06-01_06_35_09-2386285786239066800.
Jun 01, 2018 1:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:35:13.015Z: Checking required Cloud APIs are enabled.
Jun 01, 2018 1:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:35:13.358Z: Checking permissions granted to controller Service Account.
Jun 01, 2018 1:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:35:18.276Z: Worker configuration: n1-standard-1 in us-central1-b.
Jun 01, 2018 1:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:35:18.762Z: Expanding CoGroupByKey operations into optimizable parts.
Jun 01, 2018 1:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:35:18.918Z: Expanding GroupByKey operations into optimizable parts.
Jun 01, 2018 1:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:35:18.965Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
Jun 01, 2018 1:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:35:19.222Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
Jun 01, 2018 1:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:35:19.265Z: Elided trivial flatten
Jun 01, 2018 1:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:35:19.305Z: Elided trivial flatten
Jun 01, 2018 1:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:35:19.351Z: Elided trivial flatten
Jun 01, 2018 1:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:35:19.393Z: Unzipping flatten s24 for input s19.org.apache.beam.sdk.values.PCollection.<init>:329#8fd0f908e3ea90e3
Jun 01, 2018 1:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:35:19.439Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Reify, through flatten PAssert$33/GroupGlobally/FlattenDummyAndContents, into producer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map
Jun 01, 2018 1:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:35:19.487Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow into PAssert$33/GroupGlobally/GroupDummyAndContents/Read
Jun 01, 2018 1:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:35:19.533Z: Fusing consumer PAssert$33/GroupGlobally/ParDo(Concat) into PAssert$33/GroupGlobally/Values/Values/Map
Jun 01, 2018 1:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:35:19.578Z: Fusing consumer PAssert$33/GetPane/Map into PAssert$33/GroupGlobally/ParDo(Concat)
Jun 01, 2018 1:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:35:19.623Z: Fusing consumer PAssert$33/GroupGlobally/Values/Values/Map into PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow
Jun 01, 2018 1:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:35:19.669Z: Fusing consumer PAssert$33/RunChecks into PAssert$33/GetPane/Map
Jun 01, 2018 1:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:35:19.712Z: Fusing consumer PAssert$33/VerifyAssertions/ParDo(DefaultConclude) into PAssert$33/RunChecks
Jun 01, 2018 1:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:35:19.758Z: Unzipping flatten s24-u45 for input s26-reify-value18-c43
Jun 01, 2018 1:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:35:19.796Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Write, through flatten s24-u45, into producer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
Jun 01, 2018 1:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:35:19.840Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify into PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
Jun 01, 2018 1:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:35:19.888Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Write into PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
Jun 01, 2018 1:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:35:19.948Z: Fusing consumer PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)
Jun 01, 2018 1:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:35:20.003Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
Jun 01, 2018 1:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:35:20.061Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
Jun 01, 2018 1:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:35:20.099Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into PAssert$33/GroupGlobally/Window.Into()/Window.Assign
Jun 01, 2018 1:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:35:20.150Z: Fusing consumer OutputSideInputs into Create123/Read(CreateSource)
Jun 01, 2018 1:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:35:20.190Z: Fusing consumer PAssert$33/GroupGlobally/Window.Into()/Window.Assign into OutputSideInputs
Jun 01, 2018 1:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:35:20.231Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
Jun 01, 2018 1:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:35:20.277Z: Fusing consumer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map into PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
Jun 01, 2018 1:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:35:20.317Z: Fusing consumer PAssert$33/GroupGlobally/RewindowActuals/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map
Jun 01, 2018 1:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:35:20.355Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read
Jun 01, 2018 1:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:35:20.405Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
Jun 01, 2018 1:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:35:20.449Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
Jun 01, 2018 1:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:35:20.488Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
Jun 01, 2018 1:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:35:20.535Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
Jun 01, 2018 1:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:35:20.580Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
Jun 01, 2018 1:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:35:20.618Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into Create47/Read(CreateSource)
Jun 01, 2018 1:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:35:20.666Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
Jun 01, 2018 1:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:35:20.715Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
Jun 01, 2018 1:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:35:20.755Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
Jun 01, 2018 1:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:35:20.794Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
Jun 01, 2018 1:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:35:20.833Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
Jun 01, 2018 1:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:35:20.874Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
Jun 01, 2018 1:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:35:21.350Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Create
Jun 01, 2018 1:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:35:21.398Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Create
Jun 01, 2018 1:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:35:21.443Z: Starting 1 workers in us-central1-b...
Jun 01, 2018 1:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:35:21.443Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
Jun 01, 2018 1:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:35:21.481Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
Jun 01, 2018 1:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:35:21.741Z: Executing operation PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
Jun 01, 2018 1:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:35:21.789Z: Executing operation Create47/Read(CreateSource)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
Jun 01, 2018 1:35:33 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:35:32.497Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
Jun 01, 2018 1:35:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:35:43.562Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
Jun 01, 2018 1:35:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:35:43.609Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
Jun 01, 2018 1:36:07 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:36:05.473Z: Workers have started successfully.
Jun 01, 2018 1:36:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:36:26.680Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
Jun 01, 2018 1:36:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:36:26.771Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
Jun 01, 2018 1:36:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:36:33.856Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
Jun 01, 2018 1:36:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:36:33.944Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
Jun 01, 2018 1:36:49 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:36:47.160Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
Jun 01, 2018 1:36:49 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:36:47.348Z: Executing operation Create123/Read(CreateSource)+OutputSideInputs+PAssert$33/GroupGlobally/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write
Jun 01, 2018 1:36:54 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:36:52.889Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Close
Jun 01, 2018 1:36:54 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:36:52.976Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$33/GroupGlobally/RewindowActuals/Window.Assign+PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
Jun 01, 2018 1:36:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:36:56.910Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Close
Jun 01, 2018 1:36:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:36:56.999Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Read+PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$33/GroupGlobally/Values/Values/Map+PAssert$33/GroupGlobally/ParDo(Concat)+PAssert$33/GetPane/Map+PAssert$33/RunChecks+PAssert$33/VerifyAssertions/ParDo(DefaultConclude)
Jun 01, 2018 1:37:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:37:01.165Z: Cleaning up.
Jun 01, 2018 1:37:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:37:01.287Z: Stopping worker pool...
Jun 01, 2018 1:38:46 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:38:44.673Z: Autoscaling: Resized worker pool from 1 to 0.
Jun 01, 2018 1:38:46 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:38:44.715Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
Jun 01, 2018 1:38:53 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-06-01_06_35_09-2386285786239066800 finished with status DONE.
Jun 01, 2018 1:38:53 PM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-06-01_06_35_09-2386285786239066800. Found 1 success, 0 failures out of 1 expected assertions.
Gradle Test Executor 39 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest
209 tests completed, 34 failed, 2 skipped
Finished generating test XML results (0.65 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerTest>
Generating HTML test report...
Finished generating test html results (0.495 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest>
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest FAILED
:beam-runners-google-cloud-dataflow-java:validatesRunnerTest (Thread[Task worker for ':' Thread 47,5,main]) completed. Took 2 hrs 13 mins 20.465 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:validatesRunnerTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 14m 10s
38 actionable tasks: 34 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/rbz5g4rhk4vdc
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user katarzyna.kucharczyk@polidea.com
Not sending mail to unregistered user robbe.sneyders@ml6.eu
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user schroederc@google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user sidhom@google.com
Not sending mail to unregistered user cademarkegard@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ammons@google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user kedin@google.com
Build failed in Jenkins:
beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #394
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/394/display/redirect?page=changes>
Changes:
[coheigea] Fixing ErrorProne MissingOverrides warnings
------------------------------------------
[...truncated 18.20 MB...]
Jun 01, 2018 11:20:49 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map as step s17
Jun 01, 2018 11:20:49 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RewindowActuals/Window.Assign as step s18
Jun 01, 2018 11:20:49 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map as step s19
Jun 01, 2018 11:20:49 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveActualsTriggering/Flatten.PCollections as step s20
Jun 01, 2018 11:20:49 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Create.Values/Read(CreateSource) as step s21
Jun 01, 2018 11:20:49 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign as step s22
Jun 01, 2018 11:20:49 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveDummyTriggering/Flatten.PCollections as step s23
Jun 01, 2018 11:20:49 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/FlattenDummyAndContents as step s24
Jun 01, 2018 11:20:49 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/NeverTrigger/Flatten.PCollections as step s25
Jun 01, 2018 11:20:49 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GroupDummyAndContents as step s26
Jun 01, 2018 11:20:49 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Values/Values/Map as step s27
Jun 01, 2018 11:20:49 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/ParDo(Concat) as step s28
Jun 01, 2018 11:20:49 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GetPane/Map as step s29
Jun 01, 2018 11:20:49 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/RunChecks as step s30
Jun 01, 2018 11:20:49 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/VerifyAssertions/ParDo(DefaultConclude) as step s31
Jun 01, 2018 11:20:49 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0601112045-a463d04/output/results/staging/
Jun 01, 2018 11:20:49 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <71120 bytes, hash ZMxlsdTjx4dzCPAu2ck6WQ> to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0601112045-a463d04/output/results/staging/pipeline-ZMxlsdTjx4dzCPAu2ck6WQ.pb
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
Jun 01, 2018 11:20:50 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-06-01_04_20_50-14078549324319580279?project=apache-beam-testing
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Submitted job: 2018-06-01_04_20_50-14078549324319580279
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
Jun 01, 2018 11:20:50 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-06-01_04_20_50-14078549324319580279
Jun 01, 2018 11:20:50 AM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-06-01_04_20_50-14078549324319580279 with 1 expected assertions.
Jun 01, 2018 11:21:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:20:50.141Z: Autoscaling is enabled for job 2018-06-01_04_20_50-14078549324319580279. The number of workers will be between 1 and 1000.
Jun 01, 2018 11:21:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:20:50.181Z: Autoscaling was automatically enabled for job 2018-06-01_04_20_50-14078549324319580279.
Jun 01, 2018 11:21:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:20:52.418Z: Checking required Cloud APIs are enabled.
Jun 01, 2018 11:21:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:20:52.609Z: Checking permissions granted to controller Service Account.
Jun 01, 2018 11:21:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:20:57.525Z: Worker configuration: n1-standard-1 in us-central1-b.
Jun 01, 2018 11:21:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:20:57.964Z: Expanding CoGroupByKey operations into optimizable parts.
Jun 01, 2018 11:21:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:20:58.113Z: Expanding GroupByKey operations into optimizable parts.
Jun 01, 2018 11:21:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:20:58.159Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
Jun 01, 2018 11:21:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:20:58.387Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
Jun 01, 2018 11:21:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:20:58.430Z: Elided trivial flatten
Jun 01, 2018 11:21:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:20:58.475Z: Elided trivial flatten
Jun 01, 2018 11:21:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:20:58.522Z: Elided trivial flatten
Jun 01, 2018 11:21:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:20:58.566Z: Unzipping flatten s24 for input s19.org.apache.beam.sdk.values.PCollection.<init>:329#8fd0f908e3ea90e3
Jun 01, 2018 11:21:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:20:58.609Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Reify, through flatten PAssert$33/GroupGlobally/FlattenDummyAndContents, into producer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map
Jun 01, 2018 11:21:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:20:58.649Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow into PAssert$33/GroupGlobally/GroupDummyAndContents/Read
Jun 01, 2018 11:21:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:20:58.692Z: Fusing consumer PAssert$33/GroupGlobally/ParDo(Concat) into PAssert$33/GroupGlobally/Values/Values/Map
Jun 01, 2018 11:21:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:20:58.729Z: Fusing consumer PAssert$33/GetPane/Map into PAssert$33/GroupGlobally/ParDo(Concat)
Jun 01, 2018 11:21:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:20:58.773Z: Fusing consumer PAssert$33/GroupGlobally/Values/Values/Map into PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow
Jun 01, 2018 11:21:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:20:58.813Z: Fusing consumer PAssert$33/RunChecks into PAssert$33/GetPane/Map
Jun 01, 2018 11:21:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:20:58.855Z: Fusing consumer PAssert$33/VerifyAssertions/ParDo(DefaultConclude) into PAssert$33/RunChecks
Jun 01, 2018 11:21:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:20:58.900Z: Unzipping flatten s24-u45 for input s26-reify-value18-c43
Jun 01, 2018 11:21:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:20:58.943Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Write, through flatten s24-u45, into producer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
Jun 01, 2018 11:21:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:20:58.982Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify into PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
Jun 01, 2018 11:21:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:20:59.027Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Write into PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
Jun 01, 2018 11:21:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:20:59.071Z: Fusing consumer PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)
Jun 01, 2018 11:21:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:20:59.109Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
Jun 01, 2018 11:21:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:20:59.152Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
Jun 01, 2018 11:21:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:20:59.197Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into PAssert$33/GroupGlobally/Window.Into()/Window.Assign
Jun 01, 2018 11:21:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:20:59.237Z: Fusing consumer OutputSideInputs into Create123/Read(CreateSource)
Jun 01, 2018 11:21:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:20:59.283Z: Fusing consumer PAssert$33/GroupGlobally/Window.Into()/Window.Assign into OutputSideInputs
Jun 01, 2018 11:21:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:20:59.322Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
Jun 01, 2018 11:21:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:20:59.354Z: Fusing consumer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map into PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
Jun 01, 2018 11:21:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:20:59.399Z: Fusing consumer PAssert$33/GroupGlobally/RewindowActuals/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map
Jun 01, 2018 11:21:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:20:59.444Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read
Jun 01, 2018 11:21:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:20:59.490Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
Jun 01, 2018 11:21:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:20:59.534Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
Jun 01, 2018 11:21:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:20:59.569Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
Jun 01, 2018 11:21:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:20:59.600Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
Jun 01, 2018 11:21:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:20:59.646Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
Jun 01, 2018 11:21:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:20:59.689Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into Create47/Read(CreateSource)
Jun 01, 2018 11:21:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:20:59.728Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
Jun 01, 2018 11:21:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:20:59.770Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
Jun 01, 2018 11:21:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:20:59.814Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
Jun 01, 2018 11:21:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:20:59.851Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
Jun 01, 2018 11:21:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:20:59.881Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
Jun 01, 2018 11:21:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:20:59.918Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
Jun 01, 2018 11:21:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:21:00.349Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Create
Jun 01, 2018 11:21:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:21:00.395Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Create
Jun 01, 2018 11:21:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:21:00.429Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
Jun 01, 2018 11:21:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:21:00.442Z: Starting 1 workers in us-central1-b...
Jun 01, 2018 11:21:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:21:00.468Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
Jun 01, 2018 11:21:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:21:00.697Z: Executing operation PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
Jun 01, 2018 11:21:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:21:00.732Z: Executing operation Create47/Read(CreateSource)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
Jun 01, 2018 11:21:12 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:21:10.442Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
Jun 01, 2018 11:21:23 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:21:21.310Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
Jun 01, 2018 11:21:23 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:21:21.353Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
Jun 01, 2018 11:21:44 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:21:43.578Z: Workers have started successfully.
Jun 01, 2018 11:22:06 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:22:05.566Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
Jun 01, 2018 11:22:06 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:22:05.647Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
Jun 01, 2018 11:22:15 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:22:14.641Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
Jun 01, 2018 11:22:15 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:22:14.728Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
Jun 01, 2018 11:22:27 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:22:26.552Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
Jun 01, 2018 11:22:27 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:22:26.754Z: Executing operation Create123/Read(CreateSource)+OutputSideInputs+PAssert$33/GroupGlobally/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write
Jun 01, 2018 11:22:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:22:32.150Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Close
Jun 01, 2018 11:22:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:22:32.236Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$33/GroupGlobally/RewindowActuals/Window.Assign+PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
Jun 01, 2018 11:22:39 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:22:38.965Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Close
Jun 01, 2018 11:22:39 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:22:39.055Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Read+PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$33/GroupGlobally/Values/Values/Map+PAssert$33/GroupGlobally/ParDo(Concat)+PAssert$33/GetPane/Map+PAssert$33/RunChecks+PAssert$33/VerifyAssertions/ParDo(DefaultConclude)
Jun 01, 2018 11:22:43 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:22:43.180Z: Cleaning up.
Jun 01, 2018 11:22:44 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:22:43.286Z: Stopping worker pool...
Jun 01, 2018 11:24:22 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:24:21.166Z: Autoscaling: Resized worker pool from 1 to 0.
Jun 01, 2018 11:24:22 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:24:21.212Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
Jun 01, 2018 11:24:28 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-06-01_04_20_50-14078549324319580279 finished with status DONE.
Jun 01, 2018 11:24:28 AM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-06-01_04_20_50-14078549324319580279. Found 1 success, 0 failures out of 1 expected assertions.
Gradle Test Executor 36 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest FAILED
209 tests completed, 34 failed, 2 skipped
Finished generating test XML results (0.235 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerTest>
Generating HTML test report...
Finished generating test html results (0.372 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest>
:beam-runners-google-cloud-dataflow-java:validatesRunnerTest (Thread[Task worker for ':' Thread 45,5,main]) completed. Took 2 hrs 9 mins 32.796 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:validatesRunnerTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 10m 22s
38 actionable tasks: 34 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/t4irh5y2d533k
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user katarzyna.kucharczyk@polidea.com
Not sending mail to unregistered user robbe.sneyders@ml6.eu
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user schroederc@google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user sidhom@google.com
Not sending mail to unregistered user cademarkegard@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ammons@google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user kedin@google.com
Build failed in Jenkins:
beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #393
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/393/display/redirect>
------------------------------------------
[...truncated 18.13 MB...]
Jun 01, 2018 8:12:45 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map as step s19
Jun 01, 2018 8:12:45 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveActualsTriggering/Flatten.PCollections as step s20
Jun 01, 2018 8:12:45 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Create.Values/Read(CreateSource) as step s21
Jun 01, 2018 8:12:45 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign as step s22
Jun 01, 2018 8:12:45 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveDummyTriggering/Flatten.PCollections as step s23
Jun 01, 2018 8:12:45 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/FlattenDummyAndContents as step s24
Jun 01, 2018 8:12:45 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/NeverTrigger/Flatten.PCollections as step s25
Jun 01, 2018 8:12:45 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GroupDummyAndContents as step s26
Jun 01, 2018 8:12:45 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Values/Values/Map as step s27
Jun 01, 2018 8:12:45 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/ParDo(Concat) as step s28
Jun 01, 2018 8:12:45 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GetPane/Map as step s29
Jun 01, 2018 8:12:45 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/RunChecks as step s30
Jun 01, 2018 8:12:45 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/VerifyAssertions/ParDo(DefaultConclude) as step s31
Jun 01, 2018 8:12:45 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0601081241-1b91a412/output/results/staging/
Jun 01, 2018 8:12:46 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <71120 bytes, hash lhS34R3CrevOB3whdH4pMw> to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0601081241-1b91a412/output/results/staging/pipeline-lhS34R3CrevOB3whdH4pMw.pb
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
Jun 01, 2018 8:12:47 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-06-01_01_12_46-6178573666444420630?project=apache-beam-testing
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Submitted job: 2018-06-01_01_12_46-6178573666444420630
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
Jun 01, 2018 8:12:47 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-06-01_01_12_46-6178573666444420630
Jun 01, 2018 8:12:47 AM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-06-01_01_12_46-6178573666444420630 with 1 expected assertions.
Jun 01, 2018 8:12:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:12:46.557Z: Autoscaling is enabled for job 2018-06-01_01_12_46-6178573666444420630. The number of workers will be between 1 and 1000.
Jun 01, 2018 8:12:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:12:46.603Z: Autoscaling was automatically enabled for job 2018-06-01_01_12_46-6178573666444420630.
Jun 01, 2018 8:12:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:12:49.446Z: Checking required Cloud APIs are enabled.
Jun 01, 2018 8:12:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:12:49.647Z: Checking permissions granted to controller Service Account.
Jun 01, 2018 8:12:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:12:55.495Z: Worker configuration: n1-standard-1 in us-central1-b.
Jun 01, 2018 8:12:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:12:55.887Z: Expanding CoGroupByKey operations into optimizable parts.
Jun 01, 2018 8:12:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:12:56.057Z: Expanding GroupByKey operations into optimizable parts.
Jun 01, 2018 8:12:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:12:56.098Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
Jun 01, 2018 8:12:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:12:56.329Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
Jun 01, 2018 8:12:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:12:56.377Z: Elided trivial flatten
Jun 01, 2018 8:12:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:12:56.420Z: Elided trivial flatten
Jun 01, 2018 8:12:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:12:56.463Z: Elided trivial flatten
Jun 01, 2018 8:12:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:12:56.511Z: Unzipping flatten s24 for input s19.org.apache.beam.sdk.values.PCollection.<init>:329#8fd0f908e3ea90e3
Jun 01, 2018 8:12:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:12:56.552Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Reify, through flatten PAssert$33/GroupGlobally/FlattenDummyAndContents, into producer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map
Jun 01, 2018 8:12:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:12:56.597Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow into PAssert$33/GroupGlobally/GroupDummyAndContents/Read
Jun 01, 2018 8:12:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:12:56.640Z: Fusing consumer PAssert$33/GroupGlobally/ParDo(Concat) into PAssert$33/GroupGlobally/Values/Values/Map
Jun 01, 2018 8:12:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:12:56.680Z: Fusing consumer PAssert$33/GetPane/Map into PAssert$33/GroupGlobally/ParDo(Concat)
Jun 01, 2018 8:12:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:12:56.727Z: Fusing consumer PAssert$33/GroupGlobally/Values/Values/Map into PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow
Jun 01, 2018 8:12:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:12:56.765Z: Fusing consumer PAssert$33/RunChecks into PAssert$33/GetPane/Map
Jun 01, 2018 8:12:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:12:56.810Z: Fusing consumer PAssert$33/VerifyAssertions/ParDo(DefaultConclude) into PAssert$33/RunChecks
Jun 01, 2018 8:12:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:12:56.851Z: Unzipping flatten s24-u45 for input s26-reify-value18-c43
Jun 01, 2018 8:12:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:12:56.897Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Write, through flatten s24-u45, into producer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
Jun 01, 2018 8:12:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:12:56.938Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify into PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
Jun 01, 2018 8:12:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:12:56.977Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Write into PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
Jun 01, 2018 8:12:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:12:57.013Z: Fusing consumer PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)
Jun 01, 2018 8:12:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:12:57.051Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
Jun 01, 2018 8:12:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:12:57.098Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
Jun 01, 2018 8:12:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:12:57.144Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into PAssert$33/GroupGlobally/Window.Into()/Window.Assign
Jun 01, 2018 8:12:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:12:57.190Z: Fusing consumer OutputSideInputs into Create123/Read(CreateSource)
Jun 01, 2018 8:12:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:12:57.233Z: Fusing consumer PAssert$33/GroupGlobally/Window.Into()/Window.Assign into OutputSideInputs
Jun 01, 2018 8:12:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:12:57.276Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
Jun 01, 2018 8:12:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:12:57.320Z: Fusing consumer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map into PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
Jun 01, 2018 8:12:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:12:57.363Z: Fusing consumer PAssert$33/GroupGlobally/RewindowActuals/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map
Jun 01, 2018 8:12:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:12:57.402Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read
Jun 01, 2018 8:12:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:12:57.447Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
Jun 01, 2018 8:12:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:12:57.496Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
Jun 01, 2018 8:12:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:12:57.539Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
Jun 01, 2018 8:12:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:12:57.575Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
Jun 01, 2018 8:12:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:12:57.609Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
Jun 01, 2018 8:12:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:12:57.651Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into Create47/Read(CreateSource)
Jun 01, 2018 8:12:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:12:57.707Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
Jun 01, 2018 8:12:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:12:57.743Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
Jun 01, 2018 8:12:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:12:57.790Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
Jun 01, 2018 8:12:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:12:57.825Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
Jun 01, 2018 8:12:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:12:57.862Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
Jun 01, 2018 8:12:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:12:57.904Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
Jun 01, 2018 8:12:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:12:58.363Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Create
Jun 01, 2018 8:12:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:12:58.409Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Create
Jun 01, 2018 8:12:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:12:58.455Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
Jun 01, 2018 8:12:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:12:58.467Z: Starting 1 workers in us-central1-b...
Jun 01, 2018 8:12:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:12:58.498Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
Jun 01, 2018 8:13:01 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:12:58.742Z: Executing operation PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
Jun 01, 2018 8:13:01 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:12:58.782Z: Executing operation Create47/Read(CreateSource)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
Jun 01, 2018 8:13:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:13:08.187Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
Jun 01, 2018 8:13:24 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:13:24.166Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
Jun 01, 2018 8:13:24 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:13:24.204Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
Jun 01, 2018 8:13:47 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:13:45.287Z: Workers have started successfully.
Jun 01, 2018 8:14:05 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:14:04.814Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
Jun 01, 2018 8:14:05 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:14:04.920Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
Jun 01, 2018 8:14:12 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:14:11.248Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
Jun 01, 2018 8:14:12 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:14:11.343Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
Jun 01, 2018 8:14:23 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:14:23.784Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
Jun 01, 2018 8:14:26 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:14:23.969Z: Executing operation Create123/Read(CreateSource)+OutputSideInputs+PAssert$33/GroupGlobally/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write
Jun 01, 2018 8:14:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:14:27.367Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Close
Jun 01, 2018 8:14:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:14:27.461Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$33/GroupGlobally/RewindowActuals/Window.Assign+PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
Jun 01, 2018 8:14:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:14:30.778Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Close
Jun 01, 2018 8:14:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:14:30.861Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Read+PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$33/GroupGlobally/Values/Values/Map+PAssert$33/GroupGlobally/ParDo(Concat)+PAssert$33/GetPane/Map+PAssert$33/RunChecks+PAssert$33/VerifyAssertions/ParDo(DefaultConclude)
Jun 01, 2018 8:14:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:14:35.776Z: Cleaning up.
Jun 01, 2018 8:14:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:14:35.878Z: Stopping worker pool...
Jun 01, 2018 8:16:19 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:16:19.698Z: Autoscaling: Resized worker pool from 1 to 0.
Jun 01, 2018 8:16:19 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:16:19.737Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
Jun 01, 2018 8:16:22 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:16:19.786Z: Worker pool stopped.
Jun 01, 2018 8:16:29 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-06-01_01_12_46-6178573666444420630 finished with status DONE.
Jun 01, 2018 8:16:29 AM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-06-01_01_12_46-6178573666444420630. Found 1 success, 0 failures out of 1 expected assertions.
Gradle Test Executor 18 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest
209 tests completed, 34 failed, 2 skipped
Finished generating test XML results (0.823 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerTest>
Generating HTML test report...
Finished generating test html results (0.387 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest>
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest FAILED
:beam-runners-google-cloud-dataflow-java:validatesRunnerTest (Thread[Task worker for ':' Thread 9,5,main]) completed. Took 2 hrs 14 mins 1.943 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:validatesRunnerTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 15m 23s
38 actionable tasks: 34 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/4mwf4cw2c4wkm
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user katarzyna.kucharczyk@polidea.com
Not sending mail to unregistered user robbe.sneyders@ml6.eu
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user schroederc@google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user sidhom@google.com
Not sending mail to unregistered user cademarkegard@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ammons@google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user kedin@google.com
Build failed in Jenkins:
beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #392
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/392/display/redirect>
------------------------------------------
[...truncated 18.17 MB...]
Jun 01, 2018 3:54:34 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RewindowActuals/Window.Assign as step s18
Jun 01, 2018 3:54:34 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map as step s19
Jun 01, 2018 3:54:34 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveActualsTriggering/Flatten.PCollections as step s20
Jun 01, 2018 3:54:34 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Create.Values/Read(CreateSource) as step s21
Jun 01, 2018 3:54:34 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign as step s22
Jun 01, 2018 3:54:34 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveDummyTriggering/Flatten.PCollections as step s23
Jun 01, 2018 3:54:34 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/FlattenDummyAndContents as step s24
Jun 01, 2018 3:54:34 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/NeverTrigger/Flatten.PCollections as step s25
Jun 01, 2018 3:54:34 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GroupDummyAndContents as step s26
Jun 01, 2018 3:54:34 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Values/Values/Map as step s27
Jun 01, 2018 3:54:34 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/ParDo(Concat) as step s28
Jun 01, 2018 3:54:34 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GetPane/Map as step s29
Jun 01, 2018 3:54:34 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/RunChecks as step s30
Jun 01, 2018 3:54:34 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/VerifyAssertions/ParDo(DefaultConclude) as step s31
Jun 01, 2018 3:54:34 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0601035416-e9485c2a/output/results/staging/
Jun 01, 2018 3:54:34 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <71120 bytes, hash CZ-qdMFMtAb5RBSf0QUBtw> to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0601035416-e9485c2a/output/results/staging/pipeline-CZ-qdMFMtAb5RBSf0QUBtw.pb
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
Jun 01, 2018 3:54:35 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-05-31_20_54_34-12575141298163203447?project=apache-beam-testing
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Submitted job: 2018-05-31_20_54_34-12575141298163203447
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
Jun 01, 2018 3:54:35 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-05-31_20_54_34-12575141298163203447
Jun 01, 2018 3:54:35 AM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-05-31_20_54_34-12575141298163203447 with 1 expected assertions.
Jun 01, 2018 3:54:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:54:34.853Z: Autoscaling is enabled for job 2018-05-31_20_54_34-12575141298163203447. The number of workers will be between 1 and 1000.
Jun 01, 2018 3:54:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:54:34.897Z: Autoscaling was automatically enabled for job 2018-05-31_20_54_34-12575141298163203447.
Jun 01, 2018 3:54:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:54:37.816Z: Checking required Cloud APIs are enabled.
Jun 01, 2018 3:54:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:54:38.172Z: Checking permissions granted to controller Service Account.
Jun 01, 2018 3:54:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:54:46.750Z: Worker configuration: n1-standard-1 in us-central1-b.
Jun 01, 2018 3:54:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:54:47.218Z: Expanding CoGroupByKey operations into optimizable parts.
Jun 01, 2018 3:54:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:54:47.385Z: Expanding GroupByKey operations into optimizable parts.
Jun 01, 2018 3:54:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:54:47.425Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
Jun 01, 2018 3:54:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:54:47.629Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
Jun 01, 2018 3:54:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:54:47.675Z: Elided trivial flatten
Jun 01, 2018 3:54:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:54:47.719Z: Elided trivial flatten
Jun 01, 2018 3:54:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:54:47.764Z: Elided trivial flatten
Jun 01, 2018 3:54:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:54:47.809Z: Unzipping flatten s24 for input s19.org.apache.beam.sdk.values.PCollection.<init>:329#8fd0f908e3ea90e3
Jun 01, 2018 3:54:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:54:47.851Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Reify, through flatten PAssert$33/GroupGlobally/FlattenDummyAndContents, into producer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map
Jun 01, 2018 3:54:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:54:47.880Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow into PAssert$33/GroupGlobally/GroupDummyAndContents/Read
Jun 01, 2018 3:54:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:54:47.919Z: Fusing consumer PAssert$33/GroupGlobally/ParDo(Concat) into PAssert$33/GroupGlobally/Values/Values/Map
Jun 01, 2018 3:54:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:54:47.956Z: Fusing consumer PAssert$33/GetPane/Map into PAssert$33/GroupGlobally/ParDo(Concat)
Jun 01, 2018 3:54:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:54:47.999Z: Fusing consumer PAssert$33/GroupGlobally/Values/Values/Map into PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow
Jun 01, 2018 3:54:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:54:48.043Z: Fusing consumer PAssert$33/RunChecks into PAssert$33/GetPane/Map
Jun 01, 2018 3:54:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:54:48.084Z: Fusing consumer PAssert$33/VerifyAssertions/ParDo(DefaultConclude) into PAssert$33/RunChecks
Jun 01, 2018 3:54:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:54:48.129Z: Unzipping flatten s24-u45 for input s26-reify-value18-c43
Jun 01, 2018 3:54:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:54:48.164Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Write, through flatten s24-u45, into producer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
Jun 01, 2018 3:54:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:54:48.208Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify into PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
Jun 01, 2018 3:54:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:54:48.245Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Write into PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
Jun 01, 2018 3:54:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:54:48.268Z: Fusing consumer PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)
Jun 01, 2018 3:54:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:54:48.312Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
Jun 01, 2018 3:54:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:54:48.345Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
Jun 01, 2018 3:54:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:54:48.382Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into PAssert$33/GroupGlobally/Window.Into()/Window.Assign
Jun 01, 2018 3:54:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:54:48.427Z: Fusing consumer OutputSideInputs into Create123/Read(CreateSource)
Jun 01, 2018 3:54:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:54:48.467Z: Fusing consumer PAssert$33/GroupGlobally/Window.Into()/Window.Assign into OutputSideInputs
Jun 01, 2018 3:54:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:54:48.510Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
Jun 01, 2018 3:54:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:54:48.556Z: Fusing consumer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map into PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
Jun 01, 2018 3:54:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:54:48.595Z: Fusing consumer PAssert$33/GroupGlobally/RewindowActuals/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map
Jun 01, 2018 3:54:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:54:48.621Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read
Jun 01, 2018 3:54:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:54:48.658Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
Jun 01, 2018 3:54:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:54:48.703Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
Jun 01, 2018 3:54:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:54:48.740Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
Jun 01, 2018 3:54:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:54:48.784Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
Jun 01, 2018 3:54:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:54:48.831Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
Jun 01, 2018 3:54:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:54:48.866Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into Create47/Read(CreateSource)
Jun 01, 2018 3:54:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:54:48.902Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
Jun 01, 2018 3:54:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:54:48.938Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
Jun 01, 2018 3:54:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:54:48.982Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
Jun 01, 2018 3:54:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:54:49.017Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
Jun 01, 2018 3:54:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:54:49.061Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
Jun 01, 2018 3:54:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:54:49.098Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
Jun 01, 2018 3:54:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:54:49.499Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Create
Jun 01, 2018 3:54:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:54:49.529Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Create
Jun 01, 2018 3:54:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:54:49.559Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
Jun 01, 2018 3:54:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:54:49.587Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
Jun 01, 2018 3:54:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:54:49.587Z: Starting 1 workers in us-central1-b...
Jun 01, 2018 3:54:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:54:49.818Z: Executing operation PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
Jun 01, 2018 3:54:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:54:49.852Z: Executing operation Create47/Read(CreateSource)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
Jun 01, 2018 3:54:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:54:57.668Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
Jun 01, 2018 3:55:09 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:55:08.257Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
Jun 01, 2018 3:55:09 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:55:08.281Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
Jun 01, 2018 3:55:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:55:33.259Z: Workers have started successfully.
Jun 01, 2018 3:55:57 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:55:55.983Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
Jun 01, 2018 3:55:57 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:55:56.051Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
Jun 01, 2018 3:56:06 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:56:06.224Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
Jun 01, 2018 3:56:06 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:56:06.267Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
Jun 01, 2018 3:56:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:56:19.582Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
Jun 01, 2018 3:56:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:56:19.738Z: Executing operation Create123/Read(CreateSource)+OutputSideInputs+PAssert$33/GroupGlobally/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write
Jun 01, 2018 3:56:24 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:56:24.315Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Close
Jun 01, 2018 3:56:24 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:56:24.391Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$33/GroupGlobally/RewindowActuals/Window.Assign+PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
Jun 01, 2018 3:56:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:56:31.177Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Close
Jun 01, 2018 3:56:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:56:31.248Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Read+PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$33/GroupGlobally/Values/Values/Map+PAssert$33/GroupGlobally/ParDo(Concat)+PAssert$33/GetPane/Map+PAssert$33/RunChecks+PAssert$33/VerifyAssertions/ParDo(DefaultConclude)
Jun 01, 2018 3:56:39 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:56:38.664Z: Cleaning up.
Jun 01, 2018 3:56:39 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:56:38.791Z: Stopping worker pool...
Jun 01, 2018 3:58:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:58:36.560Z: Autoscaling: Resized worker pool from 1 to 0.
Jun 01, 2018 3:58:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:58:36.593Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
Jun 01, 2018 3:58:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:58:36.634Z: Worker pool stopped.
Jun 01, 2018 3:58:45 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-05-31_20_54_34-12575141298163203447 finished with status DONE.
Jun 01, 2018 3:58:45 AM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-05-31_20_54_34-12575141298163203447. Found 1 success, 0 failures out of 1 expected assertions.
Gradle Test Executor 35 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest FAILED
209 tests completed, 34 failed, 2 skipped
Finished generating test XML results (0.509 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerTest>
Generating HTML test report...
Finished generating test html results (0.361 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest>
:beam-runners-google-cloud-dataflow-java:validatesRunnerTest (Thread[Task worker for ':' Thread 7,5,main]) completed. Took 2 hrs 18 mins 15.533 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:validatesRunnerTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 19m 6s
38 actionable tasks: 34 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/dglb6qddb5qzy
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user katarzyna.kucharczyk@polidea.com
Not sending mail to unregistered user robbe.sneyders@ml6.eu
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user schroederc@google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user sidhom@google.com
Not sending mail to unregistered user cademarkegard@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ammons@google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user kedin@google.com
Build failed in Jenkins:
beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #391
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/391/display/redirect?page=changes>
Changes:
[Pablo] clean generated files prior to lint
------------------------------------------
[...truncated 18.14 MB...]
Jun 01, 2018 1:35:30 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map as step s17
Jun 01, 2018 1:35:30 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RewindowActuals/Window.Assign as step s18
Jun 01, 2018 1:35:30 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map as step s19
Jun 01, 2018 1:35:30 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveActualsTriggering/Flatten.PCollections as step s20
Jun 01, 2018 1:35:30 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Create.Values/Read(CreateSource) as step s21
Jun 01, 2018 1:35:30 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign as step s22
Jun 01, 2018 1:35:30 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveDummyTriggering/Flatten.PCollections as step s23
Jun 01, 2018 1:35:30 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/FlattenDummyAndContents as step s24
Jun 01, 2018 1:35:30 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/NeverTrigger/Flatten.PCollections as step s25
Jun 01, 2018 1:35:30 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GroupDummyAndContents as step s26
Jun 01, 2018 1:35:30 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Values/Values/Map as step s27
Jun 01, 2018 1:35:30 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/ParDo(Concat) as step s28
Jun 01, 2018 1:35:30 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GetPane/Map as step s29
Jun 01, 2018 1:35:30 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/RunChecks as step s30
Jun 01, 2018 1:35:30 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/VerifyAssertions/ParDo(DefaultConclude) as step s31
Jun 01, 2018 1:35:30 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0601013523-66353730/output/results/staging/
Jun 01, 2018 1:35:30 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <71120 bytes, hash SnP71h8kBSh_iSqVgbqgIA> to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0601013523-66353730/output/results/staging/pipeline-SnP71h8kBSh_iSqVgbqgIA.pb
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
Jun 01, 2018 1:35:31 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-05-31_18_35_30-5508884847801583730?project=apache-beam-testing
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Submitted job: 2018-05-31_18_35_30-5508884847801583730
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
Jun 01, 2018 1:35:31 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-05-31_18_35_30-5508884847801583730
Jun 01, 2018 1:35:31 AM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-05-31_18_35_30-5508884847801583730 with 1 expected assertions.
Jun 01, 2018 1:35:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:35:30.745Z: Autoscaling is enabled for job 2018-05-31_18_35_30-5508884847801583730. The number of workers will be between 1 and 1000.
Jun 01, 2018 1:35:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:35:30.798Z: Autoscaling was automatically enabled for job 2018-05-31_18_35_30-5508884847801583730.
Jun 01, 2018 1:35:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:35:33.718Z: Checking required Cloud APIs are enabled.
Jun 01, 2018 1:35:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:35:33.884Z: Checking permissions granted to controller Service Account.
Jun 01, 2018 1:35:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:35:39.949Z: Worker configuration: n1-standard-1 in us-central1-b.
Jun 01, 2018 1:35:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:35:40.442Z: Expanding CoGroupByKey operations into optimizable parts.
Jun 01, 2018 1:35:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:35:40.623Z: Expanding GroupByKey operations into optimizable parts.
Jun 01, 2018 1:35:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:35:40.665Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
Jun 01, 2018 1:35:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:35:40.901Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
Jun 01, 2018 1:35:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:35:40.948Z: Elided trivial flatten
Jun 01, 2018 1:35:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:35:40.991Z: Elided trivial flatten
Jun 01, 2018 1:35:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:35:41.039Z: Elided trivial flatten
Jun 01, 2018 1:35:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:35:41.082Z: Unzipping flatten s24 for input s19.org.apache.beam.sdk.values.PCollection.<init>:329#8fd0f908e3ea90e3
Jun 01, 2018 1:35:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:35:41.127Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Reify, through flatten PAssert$33/GroupGlobally/FlattenDummyAndContents, into producer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map
Jun 01, 2018 1:35:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:35:41.175Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow into PAssert$33/GroupGlobally/GroupDummyAndContents/Read
Jun 01, 2018 1:35:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:35:41.207Z: Fusing consumer PAssert$33/GroupGlobally/ParDo(Concat) into PAssert$33/GroupGlobally/Values/Values/Map
Jun 01, 2018 1:35:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:35:41.251Z: Fusing consumer PAssert$33/GetPane/Map into PAssert$33/GroupGlobally/ParDo(Concat)
Jun 01, 2018 1:35:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:35:41.299Z: Fusing consumer PAssert$33/GroupGlobally/Values/Values/Map into PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow
Jun 01, 2018 1:35:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:35:41.343Z: Fusing consumer PAssert$33/RunChecks into PAssert$33/GetPane/Map
Jun 01, 2018 1:35:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:35:41.393Z: Fusing consumer PAssert$33/VerifyAssertions/ParDo(DefaultConclude) into PAssert$33/RunChecks
Jun 01, 2018 1:35:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:35:41.429Z: Unzipping flatten s24-u45 for input s26-reify-value18-c43
Jun 01, 2018 1:35:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:35:41.465Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Write, through flatten s24-u45, into producer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
Jun 01, 2018 1:35:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:35:41.505Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify into PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
Jun 01, 2018 1:35:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:35:41.542Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Write into PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
Jun 01, 2018 1:35:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:35:41.576Z: Fusing consumer PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)
Jun 01, 2018 1:35:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:35:41.610Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
Jun 01, 2018 1:35:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:35:41.632Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
Jun 01, 2018 1:35:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:35:41.667Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into PAssert$33/GroupGlobally/Window.Into()/Window.Assign
Jun 01, 2018 1:35:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:35:41.704Z: Fusing consumer OutputSideInputs into Create123/Read(CreateSource)
Jun 01, 2018 1:35:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:35:41.738Z: Fusing consumer PAssert$33/GroupGlobally/Window.Into()/Window.Assign into OutputSideInputs
Jun 01, 2018 1:35:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:35:41.780Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
Jun 01, 2018 1:35:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:35:41.816Z: Fusing consumer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map into PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
Jun 01, 2018 1:35:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:35:41.844Z: Fusing consumer PAssert$33/GroupGlobally/RewindowActuals/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map
Jun 01, 2018 1:35:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:35:41.868Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read
Jun 01, 2018 1:35:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:35:41.902Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
Jun 01, 2018 1:35:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:35:41.937Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
Jun 01, 2018 1:35:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:35:41.981Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
Jun 01, 2018 1:35:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:35:42.023Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
Jun 01, 2018 1:35:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:35:42.068Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
Jun 01, 2018 1:35:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:35:42.113Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into Create47/Read(CreateSource)
Jun 01, 2018 1:35:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:35:42.154Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
Jun 01, 2018 1:35:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:35:42.188Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
Jun 01, 2018 1:35:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:35:42.230Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
Jun 01, 2018 1:35:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:35:42.278Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
Jun 01, 2018 1:35:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:35:42.323Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
Jun 01, 2018 1:35:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:35:42.368Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
Jun 01, 2018 1:35:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:35:42.801Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Create
Jun 01, 2018 1:35:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:35:42.843Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Create
Jun 01, 2018 1:35:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:35:42.909Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
Jun 01, 2018 1:35:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:35:42.946Z: Starting 1 workers in us-central1-b...
Jun 01, 2018 1:35:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:35:42.958Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
Jun 01, 2018 1:35:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:35:43.226Z: Executing operation PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
Jun 01, 2018 1:35:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:35:43.274Z: Executing operation Create47/Read(CreateSource)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
Jun 01, 2018 1:35:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:35:51.723Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
Jun 01, 2018 1:36:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:36:02.240Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
Jun 01, 2018 1:36:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:36:02.284Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
Jun 01, 2018 1:36:26 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:36:25.363Z: Workers have started successfully.
Jun 01, 2018 1:36:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:36:49.977Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
Jun 01, 2018 1:36:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:36:50.076Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
Jun 01, 2018 1:37:00 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:37:00.003Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
Jun 01, 2018 1:37:00 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:37:00.095Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
Jun 01, 2018 1:37:12 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:37:11.961Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
Jun 01, 2018 1:37:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:37:12.148Z: Executing operation Create123/Read(CreateSource)+OutputSideInputs+PAssert$33/GroupGlobally/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write
Jun 01, 2018 1:37:20 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:37:19.926Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Close
Jun 01, 2018 1:37:20 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:37:20.012Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$33/GroupGlobally/RewindowActuals/Window.Assign+PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
Jun 01, 2018 1:37:23 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:37:22.641Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Close
Jun 01, 2018 1:37:23 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:37:22.729Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Read+PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$33/GroupGlobally/Values/Values/Map+PAssert$33/GroupGlobally/ParDo(Concat)+PAssert$33/GetPane/Map+PAssert$33/RunChecks+PAssert$33/VerifyAssertions/ParDo(DefaultConclude)
Jun 01, 2018 1:37:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:37:27.819Z: Cleaning up.
Jun 01, 2018 1:37:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:37:27.940Z: Stopping worker pool...
Jun 01, 2018 1:39:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:39:16.206Z: Autoscaling: Resized worker pool from 1 to 0.
Jun 01, 2018 1:39:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:39:16.252Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
Jun 01, 2018 1:39:24 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-05-31_18_35_30-5508884847801583730 finished with status DONE.
Jun 01, 2018 1:39:25 AM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-05-31_18_35_30-5508884847801583730. Found 1 success, 0 failures out of 1 expected assertions.
Gradle Test Executor 37 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest FAILED
209 tests completed, 34 failed, 2 skipped
Finished generating test XML results (0.405 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerTest>
Generating HTML test report...
Finished generating test html results (0.376 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest>
:beam-runners-google-cloud-dataflow-java:validatesRunnerTest (Thread[Task worker for ':' Thread 15,5,main]) completed. Took 2 hrs 22 mins 36.523 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:validatesRunnerTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 23m 31s
38 actionable tasks: 34 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/zp5luhwb5jwkk
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user katarzyna.kucharczyk@polidea.com
Not sending mail to unregistered user robbe.sneyders@ml6.eu
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user schroederc@google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user sidhom@google.com
Not sending mail to unregistered user cademarkegard@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ammons@google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user kedin@google.com
Build failed in Jenkins:
beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #390
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/390/display/redirect?page=changes>
Changes:
[kedin] [SQL] Fix PubsubsJsonIT
------------------------------------------
[...truncated 18.15 MB...]
May 31, 2018 11:11:52 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RewindowActuals/Window.Assign as step s18
May 31, 2018 11:11:52 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map as step s19
May 31, 2018 11:11:52 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveActualsTriggering/Flatten.PCollections as step s20
May 31, 2018 11:11:52 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Create.Values/Read(CreateSource) as step s21
May 31, 2018 11:11:52 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign as step s22
May 31, 2018 11:11:52 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveDummyTriggering/Flatten.PCollections as step s23
May 31, 2018 11:11:52 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/FlattenDummyAndContents as step s24
May 31, 2018 11:11:52 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/NeverTrigger/Flatten.PCollections as step s25
May 31, 2018 11:11:52 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GroupDummyAndContents as step s26
May 31, 2018 11:11:52 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Values/Values/Map as step s27
May 31, 2018 11:11:52 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/ParDo(Concat) as step s28
May 31, 2018 11:11:52 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GetPane/Map as step s29
May 31, 2018 11:11:52 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/RunChecks as step s30
May 31, 2018 11:11:52 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/VerifyAssertions/ParDo(DefaultConclude) as step s31
May 31, 2018 11:11:52 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0531231148-b98d9aef/output/results/staging/
May 31, 2018 11:11:52 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <71120 bytes, hash b0YayfVxt1YtO4aF2pH0Mg> to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0531231148-b98d9aef/output/results/staging/pipeline-b0YayfVxt1YtO4aF2pH0Mg.pb
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 31, 2018 11:11:54 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-05-31_16_11_53-17521423508217518915?project=apache-beam-testing
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Submitted job: 2018-05-31_16_11_53-17521423508217518915
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 31, 2018 11:11:54 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-05-31_16_11_53-17521423508217518915
May 31, 2018 11:11:54 PM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-05-31_16_11_53-17521423508217518915 with 1 expected assertions.
May 31, 2018 11:12:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:11:53.105Z: Autoscaling is enabled for job 2018-05-31_16_11_53-17521423508217518915. The number of workers will be between 1 and 1000.
May 31, 2018 11:12:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:11:53.165Z: Autoscaling was automatically enabled for job 2018-05-31_16_11_53-17521423508217518915.
May 31, 2018 11:12:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:11:56.257Z: Checking required Cloud APIs are enabled.
May 31, 2018 11:12:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:11:56.623Z: Checking permissions granted to controller Service Account.
May 31, 2018 11:12:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:12:03.761Z: Worker configuration: n1-standard-1 in us-central1-b.
May 31, 2018 11:12:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:12:04.161Z: Expanding CoGroupByKey operations into optimizable parts.
May 31, 2018 11:12:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:12:04.341Z: Expanding GroupByKey operations into optimizable parts.
May 31, 2018 11:12:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:12:04.398Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
May 31, 2018 11:12:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:12:04.672Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
May 31, 2018 11:12:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:12:04.721Z: Elided trivial flatten
May 31, 2018 11:12:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:12:04.771Z: Elided trivial flatten
May 31, 2018 11:12:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:12:04.825Z: Elided trivial flatten
May 31, 2018 11:12:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:12:04.880Z: Unzipping flatten s24 for input s19.org.apache.beam.sdk.values.PCollection.<init>:329#8fd0f908e3ea90e3
May 31, 2018 11:12:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:12:04.934Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Reify, through flatten PAssert$33/GroupGlobally/FlattenDummyAndContents, into producer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map
May 31, 2018 11:12:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:12:04.982Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow into PAssert$33/GroupGlobally/GroupDummyAndContents/Read
May 31, 2018 11:12:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:12:05.022Z: Fusing consumer PAssert$33/GroupGlobally/ParDo(Concat) into PAssert$33/GroupGlobally/Values/Values/Map
May 31, 2018 11:12:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:12:05.072Z: Fusing consumer PAssert$33/GetPane/Map into PAssert$33/GroupGlobally/ParDo(Concat)
May 31, 2018 11:12:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:12:05.132Z: Fusing consumer PAssert$33/GroupGlobally/Values/Values/Map into PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow
May 31, 2018 11:12:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:12:05.172Z: Fusing consumer PAssert$33/RunChecks into PAssert$33/GetPane/Map
May 31, 2018 11:12:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:12:05.223Z: Fusing consumer PAssert$33/VerifyAssertions/ParDo(DefaultConclude) into PAssert$33/RunChecks
May 31, 2018 11:12:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:12:05.274Z: Unzipping flatten s24-u45 for input s26-reify-value18-c43
May 31, 2018 11:12:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:12:05.334Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Write, through flatten s24-u45, into producer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 31, 2018 11:12:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:12:05.388Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify into PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
May 31, 2018 11:12:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:12:05.438Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Write into PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 31, 2018 11:12:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:12:05.487Z: Fusing consumer PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)
May 31, 2018 11:12:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:12:05.544Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
May 31, 2018 11:12:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:12:05.590Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
May 31, 2018 11:12:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:12:05.633Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into PAssert$33/GroupGlobally/Window.Into()/Window.Assign
May 31, 2018 11:12:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:12:05.687Z: Fusing consumer OutputSideInputs into Create123/Read(CreateSource)
May 31, 2018 11:12:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:12:05.734Z: Fusing consumer PAssert$33/GroupGlobally/Window.Into()/Window.Assign into OutputSideInputs
May 31, 2018 11:12:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:12:05.779Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
May 31, 2018 11:12:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:12:05.825Z: Fusing consumer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map into PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
May 31, 2018 11:12:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:12:05.876Z: Fusing consumer PAssert$33/GroupGlobally/RewindowActuals/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map
May 31, 2018 11:12:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:12:05.929Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read
May 31, 2018 11:12:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:12:05.985Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
May 31, 2018 11:12:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:12:06.022Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
May 31, 2018 11:12:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:12:06.072Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
May 31, 2018 11:12:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:12:06.114Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
May 31, 2018 11:12:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:12:06.158Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
May 31, 2018 11:12:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:12:06.213Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into Create47/Read(CreateSource)
May 31, 2018 11:12:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:12:06.255Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
May 31, 2018 11:12:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:12:06.304Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
May 31, 2018 11:12:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:12:06.339Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
May 31, 2018 11:12:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:12:06.395Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
May 31, 2018 11:12:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:12:06.445Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
May 31, 2018 11:12:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:12:06.493Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
May 31, 2018 11:12:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:12:06.998Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Create
May 31, 2018 11:12:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:12:07.047Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Create
May 31, 2018 11:12:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:12:07.094Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
May 31, 2018 11:12:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:12:07.105Z: Starting 1 workers in us-central1-b...
May 31, 2018 11:12:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:12:07.137Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
May 31, 2018 11:12:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:12:07.414Z: Executing operation Create47/Read(CreateSource)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
May 31, 2018 11:12:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:12:07.477Z: Executing operation PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 31, 2018 11:12:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:12:16.897Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
May 31, 2018 11:12:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:12:27.424Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
May 31, 2018 11:12:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:12:27.470Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 31, 2018 11:12:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:12:43.714Z: Workers have started successfully.
May 31, 2018 11:13:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:13:12.028Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
May 31, 2018 11:13:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:13:12.101Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
May 31, 2018 11:13:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:13:19.986Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
May 31, 2018 11:13:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:13:20.056Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
May 31, 2018 11:13:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:13:32.768Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
May 31, 2018 11:13:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:13:32.940Z: Executing operation Create123/Read(CreateSource)+OutputSideInputs+PAssert$33/GroupGlobally/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write
May 31, 2018 11:13:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:13:39.599Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Close
May 31, 2018 11:13:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:13:39.701Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$33/GroupGlobally/RewindowActuals/Window.Assign+PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 31, 2018 11:13:46 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:13:44.412Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Close
May 31, 2018 11:13:46 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:13:44.511Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Read+PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$33/GroupGlobally/Values/Values/Map+PAssert$33/GroupGlobally/ParDo(Concat)+PAssert$33/GetPane/Map+PAssert$33/RunChecks+PAssert$33/VerifyAssertions/ParDo(DefaultConclude)
May 31, 2018 11:13:49 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:13:48.574Z: Cleaning up.
May 31, 2018 11:13:49 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:13:48.761Z: Stopping worker pool...
May 31, 2018 11:15:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:15:33.316Z: Autoscaling: Resized worker pool from 1 to 0.
May 31, 2018 11:15:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:15:33.366Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 31, 2018 11:15:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:15:33.433Z: Worker pool stopped.
May 31, 2018 11:15:41 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-05-31_16_11_53-17521423508217518915 finished with status DONE.
May 31, 2018 11:15:41 PM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-05-31_16_11_53-17521423508217518915. Found 1 success, 0 failures out of 1 expected assertions.
Gradle Test Executor 28 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest FAILED
209 tests completed, 34 failed, 2 skipped
Finished generating test XML results (0.538 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerTest>
Generating HTML test report...
Finished generating test html results (0.269 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest>
:beam-runners-google-cloud-dataflow-java:validatesRunnerTest (Thread[Task worker for ':' Thread 37,5,main]) completed. Took 2 hrs 21 mins 28.362 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:validatesRunnerTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 22m 26s
38 actionable tasks: 34 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/wgnm2pwuozwaq
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user katarzyna.kucharczyk@polidea.com
Not sending mail to unregistered user robbe.sneyders@ml6.eu
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user schroederc@google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user sidhom@google.com
Not sending mail to unregistered user cademarkegard@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ammons@google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user kedin@google.com
Build failed in Jenkins:
beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #389
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/389/display/redirect?page=changes>
Changes:
[tgroh] Add a test to show Flatten Execution
[coheigea] Avoid fully qualified class names, when there is an existing (static)
------------------------------------------
[...truncated 18.23 MB...]
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey as step s16
May 31, 2018 8:48:39 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map as step s17
May 31, 2018 8:48:39 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RewindowActuals/Window.Assign as step s18
May 31, 2018 8:48:39 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map as step s19
May 31, 2018 8:48:39 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveActualsTriggering/Flatten.PCollections as step s20
May 31, 2018 8:48:39 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Create.Values/Read(CreateSource) as step s21
May 31, 2018 8:48:39 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign as step s22
May 31, 2018 8:48:39 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveDummyTriggering/Flatten.PCollections as step s23
May 31, 2018 8:48:39 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/FlattenDummyAndContents as step s24
May 31, 2018 8:48:39 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/NeverTrigger/Flatten.PCollections as step s25
May 31, 2018 8:48:39 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GroupDummyAndContents as step s26
May 31, 2018 8:48:39 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Values/Values/Map as step s27
May 31, 2018 8:48:39 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/ParDo(Concat) as step s28
May 31, 2018 8:48:39 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GetPane/Map as step s29
May 31, 2018 8:48:39 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/RunChecks as step s30
May 31, 2018 8:48:39 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/VerifyAssertions/ParDo(DefaultConclude) as step s31
May 31, 2018 8:48:39 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0531204836-e5ac48d6/output/results/staging/
May 31, 2018 8:48:40 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <71120 bytes, hash gtCwZ6-VzgnP_WjHV-ApCw> to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0531204836-e5ac48d6/output/results/staging/pipeline-gtCwZ6-VzgnP_WjHV-ApCw.pb
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 31, 2018 8:48:42 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-05-31_13_48_41-7093015371132528767?project=apache-beam-testing
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Submitted job: 2018-05-31_13_48_41-7093015371132528767
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 31, 2018 8:48:42 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-05-31_13_48_41-7093015371132528767
May 31, 2018 8:48:42 PM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-05-31_13_48_41-7093015371132528767 with 1 expected assertions.
May 31, 2018 8:49:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:48:41.251Z: Autoscaling is enabled for job 2018-05-31_13_48_41-7093015371132528767. The number of workers will be between 1 and 1000.
May 31, 2018 8:49:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:48:41.288Z: Autoscaling was automatically enabled for job 2018-05-31_13_48_41-7093015371132528767.
May 31, 2018 8:49:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:48:44.383Z: Checking required Cloud APIs are enabled.
May 31, 2018 8:49:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:48:44.657Z: Checking permissions granted to controller Service Account.
May 31, 2018 8:49:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:48:50.535Z: Worker configuration: n1-standard-1 in us-central1-b.
May 31, 2018 8:49:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:48:51.143Z: Expanding CoGroupByKey operations into optimizable parts.
May 31, 2018 8:49:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:48:51.308Z: Expanding GroupByKey operations into optimizable parts.
May 31, 2018 8:49:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:48:51.346Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
May 31, 2018 8:49:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:48:51.560Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
May 31, 2018 8:49:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:48:51.597Z: Elided trivial flatten
May 31, 2018 8:49:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:48:51.635Z: Elided trivial flatten
May 31, 2018 8:49:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:48:51.661Z: Elided trivial flatten
May 31, 2018 8:49:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:48:51.705Z: Unzipping flatten s24 for input s19.org.apache.beam.sdk.values.PCollection.<init>:329#8fd0f908e3ea90e3
May 31, 2018 8:49:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:48:51.747Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Reify, through flatten PAssert$33/GroupGlobally/FlattenDummyAndContents, into producer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map
May 31, 2018 8:49:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:48:51.776Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow into PAssert$33/GroupGlobally/GroupDummyAndContents/Read
May 31, 2018 8:49:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:48:51.815Z: Fusing consumer PAssert$33/GroupGlobally/ParDo(Concat) into PAssert$33/GroupGlobally/Values/Values/Map
May 31, 2018 8:49:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:48:51.865Z: Fusing consumer PAssert$33/GetPane/Map into PAssert$33/GroupGlobally/ParDo(Concat)
May 31, 2018 8:49:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:48:51.916Z: Fusing consumer PAssert$33/GroupGlobally/Values/Values/Map into PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow
May 31, 2018 8:49:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:48:51.966Z: Fusing consumer PAssert$33/RunChecks into PAssert$33/GetPane/Map
May 31, 2018 8:49:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:48:52.011Z: Fusing consumer PAssert$33/VerifyAssertions/ParDo(DefaultConclude) into PAssert$33/RunChecks
May 31, 2018 8:49:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:48:52.052Z: Unzipping flatten s24-u45 for input s26-reify-value18-c43
May 31, 2018 8:49:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:48:52.083Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Write, through flatten s24-u45, into producer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 31, 2018 8:49:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:48:52.118Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify into PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
May 31, 2018 8:49:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:48:52.155Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Write into PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 31, 2018 8:49:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:48:52.196Z: Fusing consumer PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)
May 31, 2018 8:49:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:48:52.231Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
May 31, 2018 8:49:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:48:52.264Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
May 31, 2018 8:49:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:48:52.313Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into PAssert$33/GroupGlobally/Window.Into()/Window.Assign
May 31, 2018 8:49:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:48:52.346Z: Fusing consumer OutputSideInputs into Create123/Read(CreateSource)
May 31, 2018 8:49:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:48:52.395Z: Fusing consumer PAssert$33/GroupGlobally/Window.Into()/Window.Assign into OutputSideInputs
May 31, 2018 8:49:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:48:52.432Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
May 31, 2018 8:49:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:48:52.474Z: Fusing consumer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map into PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
May 31, 2018 8:49:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:48:52.509Z: Fusing consumer PAssert$33/GroupGlobally/RewindowActuals/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map
May 31, 2018 8:49:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:48:52.569Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read
May 31, 2018 8:49:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:48:52.596Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
May 31, 2018 8:49:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:48:52.623Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
May 31, 2018 8:49:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:48:52.661Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
May 31, 2018 8:49:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:48:52.698Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
May 31, 2018 8:49:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:48:52.750Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
May 31, 2018 8:49:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:48:52.788Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into Create47/Read(CreateSource)
May 31, 2018 8:49:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:48:52.829Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
May 31, 2018 8:49:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:48:52.875Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
May 31, 2018 8:49:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:48:52.918Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
May 31, 2018 8:49:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:48:52.955Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
May 31, 2018 8:49:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:48:52.991Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
May 31, 2018 8:49:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:48:53.019Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
May 31, 2018 8:49:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:48:53.437Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Create
May 31, 2018 8:49:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:48:53.477Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Create
May 31, 2018 8:49:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:48:53.528Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
May 31, 2018 8:49:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:48:53.538Z: Starting 1 workers in us-central1-b...
May 31, 2018 8:49:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:48:53.582Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
May 31, 2018 8:49:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:48:53.857Z: Executing operation PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 31, 2018 8:49:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:48:53.914Z: Executing operation Create47/Read(CreateSource)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
May 31, 2018 8:49:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:49:03.562Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
May 31, 2018 8:49:15 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:49:14.373Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
May 31, 2018 8:49:15 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:49:14.431Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 31, 2018 8:49:43 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:49:41.515Z: Workers have started successfully.
May 31, 2018 8:50:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:50:06.525Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
May 31, 2018 8:50:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:50:06.684Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
May 31, 2018 8:50:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:50:12.079Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
May 31, 2018 8:50:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:50:12.155Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
May 31, 2018 8:50:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:50:24.577Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
May 31, 2018 8:50:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:50:24.808Z: Executing operation Create123/Read(CreateSource)+OutputSideInputs+PAssert$33/GroupGlobally/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write
May 31, 2018 8:50:32 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:50:32.538Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Close
May 31, 2018 8:50:32 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:50:32.663Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$33/GroupGlobally/RewindowActuals/Window.Assign+PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 31, 2018 8:50:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:50:37.596Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Close
May 31, 2018 8:50:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:50:37.735Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Read+PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$33/GroupGlobally/Values/Values/Map+PAssert$33/GroupGlobally/ParDo(Concat)+PAssert$33/GetPane/Map+PAssert$33/RunChecks+PAssert$33/VerifyAssertions/ParDo(DefaultConclude)
May 31, 2018 8:50:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:50:41.824Z: Cleaning up.
May 31, 2018 8:50:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:50:41.974Z: Stopping worker pool...
May 31, 2018 8:52:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:52:52.438Z: Autoscaling: Resized worker pool from 1 to 0.
May 31, 2018 8:52:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:52:52.482Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 31, 2018 8:53:00 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-05-31_13_48_41-7093015371132528767 finished with status DONE.
May 31, 2018 8:53:00 PM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-05-31_13_48_41-7093015371132528767. Found 1 success, 0 failures out of 1 expected assertions.
Gradle Test Executor 39 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest FAILED
209 tests completed, 34 failed, 2 skipped
Finished generating test XML results (0.535 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerTest>
Generating HTML test report...
Finished generating test html results (0.447 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest>
:beam-runners-google-cloud-dataflow-java:validatesRunnerTest (Thread[Task worker for ':' Thread 46,5,main]) completed. Took 2 hrs 24 mins 5.316 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:validatesRunnerTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 24m 58s
38 actionable tasks: 34 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/waikbocozksfm
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user katarzyna.kucharczyk@polidea.com
Not sending mail to unregistered user robbe.sneyders@ml6.eu
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user schroederc@google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user sidhom@google.com
Not sending mail to unregistered user cademarkegard@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ammons@google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Build failed in Jenkins:
beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #388
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/388/display/redirect?page=changes>
Changes:
[apilloud] Run test on shadowJar on a flag
[apilloud] [SQL] Build mega jar for JDBC
[apilloud] [SQL] JDBC Class Loader IT
------------------------------------------
[...truncated 18.20 MB...]
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey as step s16
May 31, 2018 6:23:47 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map as step s17
May 31, 2018 6:23:47 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RewindowActuals/Window.Assign as step s18
May 31, 2018 6:23:47 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map as step s19
May 31, 2018 6:23:47 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveActualsTriggering/Flatten.PCollections as step s20
May 31, 2018 6:23:47 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Create.Values/Read(CreateSource) as step s21
May 31, 2018 6:23:47 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign as step s22
May 31, 2018 6:23:47 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveDummyTriggering/Flatten.PCollections as step s23
May 31, 2018 6:23:47 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/FlattenDummyAndContents as step s24
May 31, 2018 6:23:47 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/NeverTrigger/Flatten.PCollections as step s25
May 31, 2018 6:23:47 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GroupDummyAndContents as step s26
May 31, 2018 6:23:47 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Values/Values/Map as step s27
May 31, 2018 6:23:47 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/ParDo(Concat) as step s28
May 31, 2018 6:23:47 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GetPane/Map as step s29
May 31, 2018 6:23:47 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/RunChecks as step s30
May 31, 2018 6:23:47 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/VerifyAssertions/ParDo(DefaultConclude) as step s31
May 31, 2018 6:23:47 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0531182344-49ebd836/output/results/staging/
May 31, 2018 6:23:47 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <71120 bytes, hash dv-AOICw_j8KuoCA3EikDQ> to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0531182344-49ebd836/output/results/staging/pipeline-dv-AOICw_j8KuoCA3EikDQ.pb
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 31, 2018 6:23:49 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-05-31_11_23_48-8467665149338201439?project=apache-beam-testing
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Submitted job: 2018-05-31_11_23_48-8467665149338201439
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 31, 2018 6:23:49 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-05-31_11_23_48-8467665149338201439
May 31, 2018 6:23:49 PM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-05-31_11_23_48-8467665149338201439 with 1 expected assertions.
May 31, 2018 6:24:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:23:48.554Z: Autoscaling is enabled for job 2018-05-31_11_23_48-8467665149338201439. The number of workers will be between 1 and 1000.
May 31, 2018 6:24:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:23:48.592Z: Autoscaling was automatically enabled for job 2018-05-31_11_23_48-8467665149338201439.
May 31, 2018 6:24:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:23:51.513Z: Checking required Cloud APIs are enabled.
May 31, 2018 6:24:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:23:51.721Z: Checking permissions granted to controller Service Account.
May 31, 2018 6:24:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:23:56.655Z: Worker configuration: n1-standard-1 in us-central1-b.
May 31, 2018 6:24:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:23:57.192Z: Expanding CoGroupByKey operations into optimizable parts.
May 31, 2018 6:24:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:23:57.417Z: Expanding GroupByKey operations into optimizable parts.
May 31, 2018 6:24:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:23:57.458Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
May 31, 2018 6:24:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:23:57.732Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
May 31, 2018 6:24:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:23:57.782Z: Elided trivial flatten
May 31, 2018 6:24:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:23:57.824Z: Elided trivial flatten
May 31, 2018 6:24:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:23:57.871Z: Elided trivial flatten
May 31, 2018 6:24:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:23:57.920Z: Unzipping flatten s24 for input s19.org.apache.beam.sdk.values.PCollection.<init>:329#8fd0f908e3ea90e3
May 31, 2018 6:24:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:23:57.976Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Reify, through flatten PAssert$33/GroupGlobally/FlattenDummyAndContents, into producer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map
May 31, 2018 6:24:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:23:58.027Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow into PAssert$33/GroupGlobally/GroupDummyAndContents/Read
May 31, 2018 6:24:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:23:58.076Z: Fusing consumer PAssert$33/GroupGlobally/ParDo(Concat) into PAssert$33/GroupGlobally/Values/Values/Map
May 31, 2018 6:24:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:23:58.116Z: Fusing consumer PAssert$33/GetPane/Map into PAssert$33/GroupGlobally/ParDo(Concat)
May 31, 2018 6:24:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:23:58.158Z: Fusing consumer PAssert$33/GroupGlobally/Values/Values/Map into PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow
May 31, 2018 6:24:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:23:58.214Z: Fusing consumer PAssert$33/RunChecks into PAssert$33/GetPane/Map
May 31, 2018 6:24:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:23:58.262Z: Fusing consumer PAssert$33/VerifyAssertions/ParDo(DefaultConclude) into PAssert$33/RunChecks
May 31, 2018 6:24:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:23:58.318Z: Unzipping flatten s24-u45 for input s26-reify-value18-c43
May 31, 2018 6:24:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:23:58.373Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Write, through flatten s24-u45, into producer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 31, 2018 6:24:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:23:58.420Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify into PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
May 31, 2018 6:24:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:23:58.474Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Write into PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 31, 2018 6:24:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:23:58.525Z: Fusing consumer PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)
May 31, 2018 6:24:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:23:58.573Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
May 31, 2018 6:24:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:23:58.630Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
May 31, 2018 6:24:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:23:58.676Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into PAssert$33/GroupGlobally/Window.Into()/Window.Assign
May 31, 2018 6:24:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:23:58.716Z: Fusing consumer OutputSideInputs into Create123/Read(CreateSource)
May 31, 2018 6:24:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:23:58.765Z: Fusing consumer PAssert$33/GroupGlobally/Window.Into()/Window.Assign into OutputSideInputs
May 31, 2018 6:24:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:23:58.817Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
May 31, 2018 6:24:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:23:58.866Z: Fusing consumer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map into PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
May 31, 2018 6:24:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:23:58.911Z: Fusing consumer PAssert$33/GroupGlobally/RewindowActuals/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map
May 31, 2018 6:24:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:23:58.954Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read
May 31, 2018 6:24:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:23:59.004Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
May 31, 2018 6:24:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:23:59.053Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
May 31, 2018 6:24:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:23:59.098Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
May 31, 2018 6:24:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:23:59.143Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
May 31, 2018 6:24:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:23:59.181Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
May 31, 2018 6:24:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:23:59.224Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into Create47/Read(CreateSource)
May 31, 2018 6:24:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:23:59.271Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
May 31, 2018 6:24:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:23:59.324Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
May 31, 2018 6:24:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:23:59.374Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
May 31, 2018 6:24:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:23:59.421Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
May 31, 2018 6:24:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:23:59.454Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
May 31, 2018 6:24:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:23:59.500Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
May 31, 2018 6:24:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:24:00.028Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Create
May 31, 2018 6:24:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:24:00.071Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Create
May 31, 2018 6:24:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:24:00.106Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
May 31, 2018 6:24:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:24:00.142Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
May 31, 2018 6:24:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:24:00.142Z: Starting 1 workers in us-central1-b...
May 31, 2018 6:24:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:24:00.380Z: Executing operation PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 31, 2018 6:24:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:24:00.410Z: Executing operation Create47/Read(CreateSource)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
May 31, 2018 6:24:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:24:09.935Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
May 31, 2018 6:24:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:24:20.547Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
May 31, 2018 6:24:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:24:20.605Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 31, 2018 6:24:46 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:24:46.182Z: Workers have started successfully.
May 31, 2018 6:25:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:25:09.460Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
May 31, 2018 6:25:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:25:09.596Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
May 31, 2018 6:25:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:25:18.408Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
May 31, 2018 6:25:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:25:18.511Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
May 31, 2018 6:25:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:25:31.519Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
May 31, 2018 6:25:33 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:25:31.732Z: Executing operation Create123/Read(CreateSource)+OutputSideInputs+PAssert$33/GroupGlobally/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write
May 31, 2018 6:25:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:25:37.243Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Close
May 31, 2018 6:25:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:25:37.326Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$33/GroupGlobally/RewindowActuals/Window.Assign+PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 31, 2018 6:25:43 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:25:40.998Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Close
May 31, 2018 6:25:43 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:25:41.103Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Read+PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$33/GroupGlobally/Values/Values/Map+PAssert$33/GroupGlobally/ParDo(Concat)+PAssert$33/GetPane/Map+PAssert$33/RunChecks+PAssert$33/VerifyAssertions/ParDo(DefaultConclude)
May 31, 2018 6:25:46 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:25:44.355Z: Cleaning up.
May 31, 2018 6:25:46 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:25:44.437Z: Stopping worker pool...
May 31, 2018 6:27:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:27:39.133Z: Autoscaling: Resized worker pool from 1 to 0.
May 31, 2018 6:27:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:27:39.170Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 31, 2018 6:27:46 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-05-31_11_23_48-8467665149338201439 finished with status DONE.
May 31, 2018 6:27:47 PM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-05-31_11_23_48-8467665149338201439. Found 1 success, 0 failures out of 1 expected assertions.
Gradle Test Executor 44 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest FAILED
209 tests completed, 34 failed, 2 skipped
Finished generating test XML results (0.369 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerTest>
Generating HTML test report...
Finished generating test html results (0.583 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest>
:beam-runners-google-cloud-dataflow-java:validatesRunnerTest (Thread[Task worker for ':' Thread 11,5,main]) completed. Took 2 hrs 19 mins 53.752 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:validatesRunnerTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 20m 53s
38 actionable tasks: 36 executed, 2 from cache
Publishing build scan...
https://gradle.com/s/2dnkcylzzu5bq
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user katarzyna.kucharczyk@polidea.com
Not sending mail to unregistered user robbe.sneyders@ml6.eu
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user schroederc@google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user sidhom@google.com
Not sending mail to unregistered user cademarkegard@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ammons@google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Build failed in Jenkins:
beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #387
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/387/display/redirect>
------------------------------------------
[...truncated 19.07 MB...]
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map as step s17
May 31, 2018 2:16:17 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RewindowActuals/Window.Assign as step s18
May 31, 2018 2:16:17 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map as step s19
May 31, 2018 2:16:17 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveActualsTriggering/Flatten.PCollections as step s20
May 31, 2018 2:16:17 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Create.Values/Read(CreateSource) as step s21
May 31, 2018 2:16:17 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign as step s22
May 31, 2018 2:16:17 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveDummyTriggering/Flatten.PCollections as step s23
May 31, 2018 2:16:17 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/FlattenDummyAndContents as step s24
May 31, 2018 2:16:17 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/NeverTrigger/Flatten.PCollections as step s25
May 31, 2018 2:16:17 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GroupDummyAndContents as step s26
May 31, 2018 2:16:17 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Values/Values/Map as step s27
May 31, 2018 2:16:17 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/ParDo(Concat) as step s28
May 31, 2018 2:16:17 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GetPane/Map as step s29
May 31, 2018 2:16:17 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/RunChecks as step s30
May 31, 2018 2:16:17 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/VerifyAssertions/ParDo(DefaultConclude) as step s31
May 31, 2018 2:16:17 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0531141607-c836e876/output/results/staging/
May 31, 2018 2:16:17 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <71120 bytes, hash RIBc-8xQ5bvXNy7D_iRjlg> to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0531141607-c836e876/output/results/staging/pipeline-RIBc-8xQ5bvXNy7D_iRjlg.pb
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 31, 2018 2:16:19 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-05-31_07_16_18-6991294240509845280?project=apache-beam-testing
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Submitted job: 2018-05-31_07_16_18-6991294240509845280
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 31, 2018 2:16:19 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-05-31_07_16_18-6991294240509845280
May 31, 2018 2:16:19 PM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-05-31_07_16_18-6991294240509845280 with 1 expected assertions.
May 31, 2018 2:16:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:16:18.205Z: Autoscaling is enabled for job 2018-05-31_07_16_18-6991294240509845280. The number of workers will be between 1 and 1000.
May 31, 2018 2:16:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:16:18.243Z: Autoscaling was automatically enabled for job 2018-05-31_07_16_18-6991294240509845280.
May 31, 2018 2:16:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:16:21.437Z: Checking required Cloud APIs are enabled.
May 31, 2018 2:16:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:16:21.657Z: Checking permissions granted to controller Service Account.
May 31, 2018 2:16:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:16:28.542Z: Worker configuration: n1-standard-1 in us-central1-b.
May 31, 2018 2:16:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:16:28.996Z: Expanding CoGroupByKey operations into optimizable parts.
May 31, 2018 2:16:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:16:29.164Z: Expanding GroupByKey operations into optimizable parts.
May 31, 2018 2:16:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:16:29.210Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
May 31, 2018 2:16:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:16:29.434Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
May 31, 2018 2:16:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:16:29.478Z: Elided trivial flatten
May 31, 2018 2:16:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:16:29.516Z: Elided trivial flatten
May 31, 2018 2:16:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:16:29.559Z: Elided trivial flatten
May 31, 2018 2:16:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:16:29.603Z: Unzipping flatten s24 for input s19.org.apache.beam.sdk.values.PCollection.<init>:329#8fd0f908e3ea90e3
May 31, 2018 2:16:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:16:29.650Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Reify, through flatten PAssert$33/GroupGlobally/FlattenDummyAndContents, into producer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map
May 31, 2018 2:16:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:16:29.687Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow into PAssert$33/GroupGlobally/GroupDummyAndContents/Read
May 31, 2018 2:16:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:16:29.723Z: Fusing consumer PAssert$33/GroupGlobally/ParDo(Concat) into PAssert$33/GroupGlobally/Values/Values/Map
May 31, 2018 2:16:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:16:29.771Z: Fusing consumer PAssert$33/GetPane/Map into PAssert$33/GroupGlobally/ParDo(Concat)
May 31, 2018 2:16:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:16:29.807Z: Fusing consumer PAssert$33/GroupGlobally/Values/Values/Map into PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow
May 31, 2018 2:16:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:16:29.842Z: Fusing consumer PAssert$33/RunChecks into PAssert$33/GetPane/Map
May 31, 2018 2:16:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:16:29.875Z: Fusing consumer PAssert$33/VerifyAssertions/ParDo(DefaultConclude) into PAssert$33/RunChecks
May 31, 2018 2:16:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:16:29.922Z: Unzipping flatten s24-u45 for input s26-reify-value18-c43
May 31, 2018 2:16:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:16:29.966Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Write, through flatten s24-u45, into producer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 31, 2018 2:16:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:16:30.008Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify into PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
May 31, 2018 2:16:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:16:30.053Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Write into PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 31, 2018 2:16:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:16:30.094Z: Fusing consumer PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)
May 31, 2018 2:16:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:16:30.137Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
May 31, 2018 2:16:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:16:30.181Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
May 31, 2018 2:16:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:16:30.227Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into PAssert$33/GroupGlobally/Window.Into()/Window.Assign
May 31, 2018 2:16:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:16:30.272Z: Fusing consumer OutputSideInputs into Create123/Read(CreateSource)
May 31, 2018 2:16:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:16:30.307Z: Fusing consumer PAssert$33/GroupGlobally/Window.Into()/Window.Assign into OutputSideInputs
May 31, 2018 2:16:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:16:30.345Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
May 31, 2018 2:16:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:16:30.381Z: Fusing consumer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map into PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
May 31, 2018 2:16:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:16:30.427Z: Fusing consumer PAssert$33/GroupGlobally/RewindowActuals/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map
May 31, 2018 2:16:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:16:30.479Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read
May 31, 2018 2:16:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:16:30.525Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
May 31, 2018 2:16:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:16:30.553Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
May 31, 2018 2:16:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:16:30.589Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
May 31, 2018 2:16:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:16:30.627Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
May 31, 2018 2:16:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:16:30.667Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
May 31, 2018 2:16:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:16:30.713Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into Create47/Read(CreateSource)
May 31, 2018 2:16:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:16:30.754Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
May 31, 2018 2:16:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:16:30.794Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
May 31, 2018 2:16:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:16:30.839Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
May 31, 2018 2:16:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:16:30.877Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
May 31, 2018 2:16:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:16:30.919Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
May 31, 2018 2:16:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:16:30.965Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
May 31, 2018 2:16:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:16:31.470Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Create
May 31, 2018 2:16:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:16:31.517Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Create
May 31, 2018 2:16:33 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:16:31.564Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
May 31, 2018 2:16:33 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:16:31.575Z: Starting 1 workers in us-central1-b...
May 31, 2018 2:16:33 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:16:31.614Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
May 31, 2018 2:16:33 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:16:31.858Z: Executing operation PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 31, 2018 2:16:33 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:16:31.908Z: Executing operation Create47/Read(CreateSource)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
May 31, 2018 2:16:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:16:41.526Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
May 31, 2018 2:16:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:16:57.646Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
May 31, 2018 2:16:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:16:57.690Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 31, 2018 2:17:22 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:17:22.378Z: Workers have started successfully.
May 31, 2018 2:17:50 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:17:50.123Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
May 31, 2018 2:17:50 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:17:50.234Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
May 31, 2018 2:17:56 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:17:55.903Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
May 31, 2018 2:17:56 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:17:56.010Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
May 31, 2018 2:18:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:18:08.162Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
May 31, 2018 2:18:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:18:08.364Z: Executing operation Create123/Read(CreateSource)+OutputSideInputs+PAssert$33/GroupGlobally/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write
May 31, 2018 2:18:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:18:13.088Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Close
May 31, 2018 2:18:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:18:13.222Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$33/GroupGlobally/RewindowActuals/Window.Assign+PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 31, 2018 2:18:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:18:17.048Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Close
May 31, 2018 2:18:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:18:17.219Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Read+PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$33/GroupGlobally/Values/Values/Map+PAssert$33/GroupGlobally/ParDo(Concat)+PAssert$33/GetPane/Map+PAssert$33/RunChecks+PAssert$33/VerifyAssertions/ParDo(DefaultConclude)
May 31, 2018 2:18:22 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:18:21.516Z: Cleaning up.
May 31, 2018 2:18:22 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:18:21.628Z: Stopping worker pool...
May 31, 2018 2:20:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:20:13.169Z: Autoscaling: Resized worker pool from 1 to 0.
May 31, 2018 2:20:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:20:13.217Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 31, 2018 2:20:21 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-05-31_07_16_18-6991294240509845280 finished with status DONE.
May 31, 2018 2:20:21 PM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-05-31_07_16_18-6991294240509845280. Found 1 success, 0 failures out of 1 expected assertions.
Gradle Test Executor 37 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest
209 tests completed, 35 failed, 2 skipped
Finished generating test XML results (0.88 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerTest>
Generating HTML test report...
Finished generating test html results (0.526 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest>
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest FAILED
:beam-runners-google-cloud-dataflow-java:validatesRunnerTest (Thread[Task worker for ':' Thread 37,5,main]) completed. Took 2 hrs 18 mins 34.949 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:validatesRunnerTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 19m 34s
38 actionable tasks: 34 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/giih4ktockzzq
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user katarzyna.kucharczyk@polidea.com
Not sending mail to unregistered user robbe.sneyders@ml6.eu
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user schroederc@google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user sidhom@google.com
Not sending mail to unregistered user cademarkegard@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ammons@google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Build failed in Jenkins:
beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #386
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/386/display/redirect?page=changes>
Changes:
[iemejia] [BEAM-4323] Enforce ErrorProne analysis in sketching extensions
[iemejia] [BEAM-4356] Enforce ErrorProne analysis in nexmark
------------------------------------------
[...truncated 18.23 MB...]
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey as step s16
May 31, 2018 11:05:13 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map as step s17
May 31, 2018 11:05:13 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RewindowActuals/Window.Assign as step s18
May 31, 2018 11:05:13 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map as step s19
May 31, 2018 11:05:13 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveActualsTriggering/Flatten.PCollections as step s20
May 31, 2018 11:05:13 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Create.Values/Read(CreateSource) as step s21
May 31, 2018 11:05:13 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign as step s22
May 31, 2018 11:05:13 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveDummyTriggering/Flatten.PCollections as step s23
May 31, 2018 11:05:13 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/FlattenDummyAndContents as step s24
May 31, 2018 11:05:13 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/NeverTrigger/Flatten.PCollections as step s25
May 31, 2018 11:05:13 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GroupDummyAndContents as step s26
May 31, 2018 11:05:13 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Values/Values/Map as step s27
May 31, 2018 11:05:13 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/ParDo(Concat) as step s28
May 31, 2018 11:05:13 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GetPane/Map as step s29
May 31, 2018 11:05:13 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/RunChecks as step s30
May 31, 2018 11:05:13 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/VerifyAssertions/ParDo(DefaultConclude) as step s31
May 31, 2018 11:05:13 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0531110509-daf4e307/output/results/staging/
May 31, 2018 11:05:13 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <71120 bytes, hash VCCegX3cP2HMMINVQemE5g> to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0531110509-daf4e307/output/results/staging/pipeline-VCCegX3cP2HMMINVQemE5g.pb
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 31, 2018 11:05:15 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-05-31_04_05_14-10093640796875245231?project=apache-beam-testing
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Submitted job: 2018-05-31_04_05_14-10093640796875245231
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 31, 2018 11:05:15 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-05-31_04_05_14-10093640796875245231
May 31, 2018 11:05:15 AM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-05-31_04_05_14-10093640796875245231 with 1 expected assertions.
May 31, 2018 11:05:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:05:14.145Z: Autoscaling is enabled for job 2018-05-31_04_05_14-10093640796875245231. The number of workers will be between 1 and 1000.
May 31, 2018 11:05:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:05:14.162Z: Autoscaling was automatically enabled for job 2018-05-31_04_05_14-10093640796875245231.
May 31, 2018 11:05:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:05:16.941Z: Checking required Cloud APIs are enabled.
May 31, 2018 11:05:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:05:17.122Z: Checking permissions granted to controller Service Account.
May 31, 2018 11:05:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:05:24.648Z: Worker configuration: n1-standard-1 in us-central1-b.
May 31, 2018 11:05:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:05:25.007Z: Expanding CoGroupByKey operations into optimizable parts.
May 31, 2018 11:05:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:05:25.168Z: Expanding GroupByKey operations into optimizable parts.
May 31, 2018 11:05:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:05:25.223Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
May 31, 2018 11:05:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:05:25.455Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
May 31, 2018 11:05:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:05:25.497Z: Elided trivial flatten
May 31, 2018 11:05:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:05:25.543Z: Elided trivial flatten
May 31, 2018 11:05:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:05:25.580Z: Elided trivial flatten
May 31, 2018 11:05:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:05:25.622Z: Unzipping flatten s24 for input s19.org.apache.beam.sdk.values.PCollection.<init>:329#8fd0f908e3ea90e3
May 31, 2018 11:05:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:05:25.666Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Reify, through flatten PAssert$33/GroupGlobally/FlattenDummyAndContents, into producer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map
May 31, 2018 11:05:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:05:25.711Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow into PAssert$33/GroupGlobally/GroupDummyAndContents/Read
May 31, 2018 11:05:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:05:25.755Z: Fusing consumer PAssert$33/GroupGlobally/ParDo(Concat) into PAssert$33/GroupGlobally/Values/Values/Map
May 31, 2018 11:05:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:05:25.800Z: Fusing consumer PAssert$33/GetPane/Map into PAssert$33/GroupGlobally/ParDo(Concat)
May 31, 2018 11:05:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:05:25.841Z: Fusing consumer PAssert$33/GroupGlobally/Values/Values/Map into PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow
May 31, 2018 11:05:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:05:25.880Z: Fusing consumer PAssert$33/RunChecks into PAssert$33/GetPane/Map
May 31, 2018 11:05:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:05:25.922Z: Fusing consumer PAssert$33/VerifyAssertions/ParDo(DefaultConclude) into PAssert$33/RunChecks
May 31, 2018 11:05:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:05:25.954Z: Unzipping flatten s24-u45 for input s26-reify-value18-c43
May 31, 2018 11:05:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:05:26.003Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Write, through flatten s24-u45, into producer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 31, 2018 11:05:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:05:26.049Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify into PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
May 31, 2018 11:05:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:05:26.091Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Write into PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 31, 2018 11:05:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:05:26.128Z: Fusing consumer PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)
May 31, 2018 11:05:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:05:26.162Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
May 31, 2018 11:05:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:05:26.199Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
May 31, 2018 11:05:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:05:26.242Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into PAssert$33/GroupGlobally/Window.Into()/Window.Assign
May 31, 2018 11:05:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:05:26.284Z: Fusing consumer OutputSideInputs into Create123/Read(CreateSource)
May 31, 2018 11:05:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:05:26.330Z: Fusing consumer PAssert$33/GroupGlobally/Window.Into()/Window.Assign into OutputSideInputs
May 31, 2018 11:05:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:05:26.378Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
May 31, 2018 11:05:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:05:26.408Z: Fusing consumer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map into PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
May 31, 2018 11:05:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:05:26.447Z: Fusing consumer PAssert$33/GroupGlobally/RewindowActuals/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map
May 31, 2018 11:05:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:05:26.490Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read
May 31, 2018 11:05:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:05:26.535Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
May 31, 2018 11:05:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:05:26.582Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
May 31, 2018 11:05:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:05:26.625Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
May 31, 2018 11:05:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:05:26.670Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
May 31, 2018 11:05:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:05:26.718Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
May 31, 2018 11:05:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:05:26.763Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into Create47/Read(CreateSource)
May 31, 2018 11:05:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:05:26.810Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
May 31, 2018 11:05:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:05:26.852Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
May 31, 2018 11:05:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:05:26.892Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
May 31, 2018 11:05:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:05:26.940Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
May 31, 2018 11:05:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:05:26.987Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
May 31, 2018 11:05:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:05:27.034Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
May 31, 2018 11:05:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:05:27.526Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Create
May 31, 2018 11:05:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:05:27.564Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Create
May 31, 2018 11:05:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:05:27.606Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
May 31, 2018 11:05:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:05:27.621Z: Starting 1 workers in us-central1-b...
May 31, 2018 11:05:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:05:27.641Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
May 31, 2018 11:05:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:05:27.917Z: Executing operation Create47/Read(CreateSource)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
May 31, 2018 11:05:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:05:27.963Z: Executing operation PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 31, 2018 11:05:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:05:37.166Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
May 31, 2018 11:05:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:05:47.621Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
May 31, 2018 11:05:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:05:47.662Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 31, 2018 11:06:11 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:06:10.904Z: Workers have started successfully.
May 31, 2018 11:06:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:06:35.919Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
May 31, 2018 11:06:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:06:36.013Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
May 31, 2018 11:06:46 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:06:45.099Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
May 31, 2018 11:06:46 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:06:45.189Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
May 31, 2018 11:06:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:06:58.272Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
May 31, 2018 11:07:01 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:06:58.465Z: Executing operation Create123/Read(CreateSource)+OutputSideInputs+PAssert$33/GroupGlobally/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write
May 31, 2018 11:07:06 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:07:03.969Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Close
May 31, 2018 11:07:06 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:07:04.055Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$33/GroupGlobally/RewindowActuals/Window.Assign+PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 31, 2018 11:07:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:07:08.703Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Close
May 31, 2018 11:07:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:07:08.778Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Read+PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$33/GroupGlobally/Values/Values/Map+PAssert$33/GroupGlobally/ParDo(Concat)+PAssert$33/GetPane/Map+PAssert$33/RunChecks+PAssert$33/VerifyAssertions/ParDo(DefaultConclude)
May 31, 2018 11:07:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:07:11.901Z: Cleaning up.
May 31, 2018 11:07:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:07:12.013Z: Stopping worker pool...
May 31, 2018 11:09:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:09:09.202Z: Autoscaling: Resized worker pool from 1 to 0.
May 31, 2018 11:09:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:09:09.231Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 31, 2018 11:09:17 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-05-31_04_05_14-10093640796875245231 finished with status DONE.
May 31, 2018 11:09:17 AM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-05-31_04_05_14-10093640796875245231. Found 1 success, 0 failures out of 1 expected assertions.
Gradle Test Executor 42 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest FAILED
209 tests completed, 34 failed, 2 skipped
Finished generating test XML results (0.576 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerTest>
Generating HTML test report...
Finished generating test html results (0.253 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest>
:beam-runners-google-cloud-dataflow-java:validatesRunnerTest (Thread[Task worker for ':' Thread 35,5,main]) completed. Took 2 hrs 16 mins 0.853 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:validatesRunnerTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 16m 50s
38 actionable tasks: 34 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/nelgqrkb7opve
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user katarzyna.kucharczyk@polidea.com
Not sending mail to unregistered user robbe.sneyders@ml6.eu
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user schroederc@google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user sidhom@google.com
Not sending mail to unregistered user cademarkegard@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ammons@google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Build failed in Jenkins:
beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #385
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/385/display/redirect>
------------------------------------------
[...truncated 18.22 MB...]
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map as step s17
May 31, 2018 8:48:34 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RewindowActuals/Window.Assign as step s18
May 31, 2018 8:48:34 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map as step s19
May 31, 2018 8:48:34 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveActualsTriggering/Flatten.PCollections as step s20
May 31, 2018 8:48:34 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Create.Values/Read(CreateSource) as step s21
May 31, 2018 8:48:34 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign as step s22
May 31, 2018 8:48:34 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveDummyTriggering/Flatten.PCollections as step s23
May 31, 2018 8:48:34 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/FlattenDummyAndContents as step s24
May 31, 2018 8:48:34 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/NeverTrigger/Flatten.PCollections as step s25
May 31, 2018 8:48:34 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GroupDummyAndContents as step s26
May 31, 2018 8:48:34 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Values/Values/Map as step s27
May 31, 2018 8:48:34 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/ParDo(Concat) as step s28
May 31, 2018 8:48:34 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GetPane/Map as step s29
May 31, 2018 8:48:34 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/RunChecks as step s30
May 31, 2018 8:48:34 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/VerifyAssertions/ParDo(DefaultConclude) as step s31
May 31, 2018 8:48:34 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0531084830-486a081/output/results/staging/
May 31, 2018 8:48:35 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <71120 bytes, hash Uy5OfkIByk5KVpTtPk77Lw> to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0531084830-486a081/output/results/staging/pipeline-Uy5OfkIByk5KVpTtPk77Lw.pb
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 31, 2018 8:48:36 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-05-31_01_48_35-1399331152337114576?project=apache-beam-testing
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Submitted job: 2018-05-31_01_48_35-1399331152337114576
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 31, 2018 8:48:36 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-05-31_01_48_35-1399331152337114576
May 31, 2018 8:48:36 AM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-05-31_01_48_35-1399331152337114576 with 1 expected assertions.
May 31, 2018 8:48:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:48:35.517Z: Autoscaling is enabled for job 2018-05-31_01_48_35-1399331152337114576. The number of workers will be between 1 and 1000.
May 31, 2018 8:48:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:48:35.559Z: Autoscaling was automatically enabled for job 2018-05-31_01_48_35-1399331152337114576.
May 31, 2018 8:48:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:48:37.942Z: Checking required Cloud APIs are enabled.
May 31, 2018 8:48:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:48:38.137Z: Checking permissions granted to controller Service Account.
May 31, 2018 8:48:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:48:43.497Z: Worker configuration: n1-standard-1 in us-central1-b.
May 31, 2018 8:48:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:48:43.995Z: Expanding CoGroupByKey operations into optimizable parts.
May 31, 2018 8:48:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:48:44.168Z: Expanding GroupByKey operations into optimizable parts.
May 31, 2018 8:48:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:48:44.216Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
May 31, 2018 8:48:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:48:44.429Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
May 31, 2018 8:48:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:48:44.473Z: Elided trivial flatten
May 31, 2018 8:48:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:48:44.509Z: Elided trivial flatten
May 31, 2018 8:48:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:48:44.544Z: Elided trivial flatten
May 31, 2018 8:48:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:48:44.594Z: Unzipping flatten s24 for input s19.org.apache.beam.sdk.values.PCollection.<init>:329#8fd0f908e3ea90e3
May 31, 2018 8:48:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:48:44.631Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Reify, through flatten PAssert$33/GroupGlobally/FlattenDummyAndContents, into producer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map
May 31, 2018 8:48:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:48:44.674Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow into PAssert$33/GroupGlobally/GroupDummyAndContents/Read
May 31, 2018 8:48:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:48:44.720Z: Fusing consumer PAssert$33/GroupGlobally/ParDo(Concat) into PAssert$33/GroupGlobally/Values/Values/Map
May 31, 2018 8:48:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:48:44.758Z: Fusing consumer PAssert$33/GetPane/Map into PAssert$33/GroupGlobally/ParDo(Concat)
May 31, 2018 8:48:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:48:44.805Z: Fusing consumer PAssert$33/GroupGlobally/Values/Values/Map into PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow
May 31, 2018 8:48:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:48:44.850Z: Fusing consumer PAssert$33/RunChecks into PAssert$33/GetPane/Map
May 31, 2018 8:48:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:48:44.890Z: Fusing consumer PAssert$33/VerifyAssertions/ParDo(DefaultConclude) into PAssert$33/RunChecks
May 31, 2018 8:48:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:48:44.930Z: Unzipping flatten s24-u45 for input s26-reify-value18-c43
May 31, 2018 8:48:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:48:44.973Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Write, through flatten s24-u45, into producer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 31, 2018 8:48:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:48:45.019Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify into PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
May 31, 2018 8:48:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:48:45.056Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Write into PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 31, 2018 8:48:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:48:45.102Z: Fusing consumer PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)
May 31, 2018 8:48:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:48:45.139Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
May 31, 2018 8:48:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:48:45.180Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
May 31, 2018 8:48:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:48:45.225Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into PAssert$33/GroupGlobally/Window.Into()/Window.Assign
May 31, 2018 8:48:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:48:45.267Z: Fusing consumer OutputSideInputs into Create123/Read(CreateSource)
May 31, 2018 8:48:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:48:45.309Z: Fusing consumer PAssert$33/GroupGlobally/Window.Into()/Window.Assign into OutputSideInputs
May 31, 2018 8:48:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:48:45.355Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
May 31, 2018 8:48:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:48:45.400Z: Fusing consumer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map into PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
May 31, 2018 8:48:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:48:45.448Z: Fusing consumer PAssert$33/GroupGlobally/RewindowActuals/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map
May 31, 2018 8:48:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:48:45.493Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read
May 31, 2018 8:48:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:48:45.538Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
May 31, 2018 8:48:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:48:45.583Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
May 31, 2018 8:48:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:48:45.621Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
May 31, 2018 8:48:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:48:45.665Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
May 31, 2018 8:48:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:48:45.711Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
May 31, 2018 8:48:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:48:45.757Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into Create47/Read(CreateSource)
May 31, 2018 8:48:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:48:45.796Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
May 31, 2018 8:48:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:48:45.877Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
May 31, 2018 8:48:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:48:45.915Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
May 31, 2018 8:48:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:48:45.960Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
May 31, 2018 8:48:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:48:45.995Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
May 31, 2018 8:48:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:48:46.040Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
May 31, 2018 8:48:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:48:46.499Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Create
May 31, 2018 8:48:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:48:46.538Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Create
May 31, 2018 8:48:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:48:46.581Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
May 31, 2018 8:48:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:48:46.593Z: Starting 1 workers in us-central1-b...
May 31, 2018 8:48:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:48:46.623Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
May 31, 2018 8:48:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:48:46.876Z: Executing operation PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 31, 2018 8:48:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:48:46.923Z: Executing operation Create47/Read(CreateSource)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
May 31, 2018 8:48:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:48:56.270Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
May 31, 2018 8:49:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:49:06.758Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
May 31, 2018 8:49:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:49:06.800Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 31, 2018 8:49:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:49:23.539Z: Workers have started successfully.
May 31, 2018 8:49:54 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:49:52.805Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
May 31, 2018 8:49:54 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:49:52.919Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
May 31, 2018 8:50:01 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:50:01.064Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
May 31, 2018 8:50:01 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:50:01.159Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
May 31, 2018 8:50:14 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:50:14.161Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
May 31, 2018 8:50:14 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:50:14.358Z: Executing operation Create123/Read(CreateSource)+OutputSideInputs+PAssert$33/GroupGlobally/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write
May 31, 2018 8:50:20 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:50:19.992Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Close
May 31, 2018 8:50:20 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:50:20.093Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$33/GroupGlobally/RewindowActuals/Window.Assign+PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 31, 2018 8:50:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:50:24.717Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Close
May 31, 2018 8:50:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:50:24.812Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Read+PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$33/GroupGlobally/Values/Values/Map+PAssert$33/GroupGlobally/ParDo(Concat)+PAssert$33/GetPane/Map+PAssert$33/RunChecks+PAssert$33/VerifyAssertions/ParDo(DefaultConclude)
May 31, 2018 8:50:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:50:29.151Z: Cleaning up.
May 31, 2018 8:50:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:50:29.254Z: Stopping worker pool...
May 31, 2018 8:52:02 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:52:01.570Z: Autoscaling: Resized worker pool from 1 to 0.
May 31, 2018 8:52:02 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:52:01.717Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 31, 2018 8:52:02 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:52:01.770Z: Worker pool stopped.
May 31, 2018 8:52:12 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-05-31_01_48_35-1399331152337114576 finished with status DONE.
May 31, 2018 8:52:12 AM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-05-31_01_48_35-1399331152337114576. Found 1 success, 0 failures out of 1 expected assertions.
Gradle Test Executor 36 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest FAILED
209 tests completed, 34 failed, 2 skipped
Finished generating test XML results (0.523 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerTest>
Generating HTML test report...
Finished generating test html results (0.432 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest>
:beam-runners-google-cloud-dataflow-java:validatesRunnerTest (Thread[Task worker for ':' Thread 47,5,main]) completed. Took 2 hrs 9 mins 33.007 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:validatesRunnerTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 10m 22s
38 actionable tasks: 34 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/he5o44ejbjtqq
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user katarzyna.kucharczyk@polidea.com
Not sending mail to unregistered user robbe.sneyders@ml6.eu
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user schroederc@google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user sidhom@google.com
Not sending mail to unregistered user cademarkegard@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ammons@google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Build failed in Jenkins:
beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #384
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/384/display/redirect?page=changes>
Changes:
[kenn] Remove Schema.TypeName.type()
[kenn] Remove unsafe builder methods from FieldType
------------------------------------------
[...truncated 18.18 MB...]
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey as step s16
May 31, 2018 6:36:27 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map as step s17
May 31, 2018 6:36:27 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RewindowActuals/Window.Assign as step s18
May 31, 2018 6:36:27 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map as step s19
May 31, 2018 6:36:27 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveActualsTriggering/Flatten.PCollections as step s20
May 31, 2018 6:36:27 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Create.Values/Read(CreateSource) as step s21
May 31, 2018 6:36:27 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign as step s22
May 31, 2018 6:36:27 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveDummyTriggering/Flatten.PCollections as step s23
May 31, 2018 6:36:27 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/FlattenDummyAndContents as step s24
May 31, 2018 6:36:27 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/NeverTrigger/Flatten.PCollections as step s25
May 31, 2018 6:36:27 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GroupDummyAndContents as step s26
May 31, 2018 6:36:27 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Values/Values/Map as step s27
May 31, 2018 6:36:27 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/ParDo(Concat) as step s28
May 31, 2018 6:36:27 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GetPane/Map as step s29
May 31, 2018 6:36:27 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/RunChecks as step s30
May 31, 2018 6:36:27 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/VerifyAssertions/ParDo(DefaultConclude) as step s31
May 31, 2018 6:36:27 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0531063621-fe0660b7/output/results/staging/
May 31, 2018 6:36:27 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <71120 bytes, hash D5ZTy77eB1SxK4pEF55Epw> to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0531063621-fe0660b7/output/results/staging/pipeline-D5ZTy77eB1SxK4pEF55Epw.pb
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 31, 2018 6:36:28 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-05-30_23_36_27-8374727479302907689?project=apache-beam-testing
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Submitted job: 2018-05-30_23_36_27-8374727479302907689
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 31, 2018 6:36:28 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-05-30_23_36_27-8374727479302907689
May 31, 2018 6:36:28 AM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-05-30_23_36_27-8374727479302907689 with 1 expected assertions.
May 31, 2018 6:36:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:36:27.731Z: Autoscaling is enabled for job 2018-05-30_23_36_27-8374727479302907689. The number of workers will be between 1 and 1000.
May 31, 2018 6:36:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:36:27.771Z: Autoscaling was automatically enabled for job 2018-05-30_23_36_27-8374727479302907689.
May 31, 2018 6:36:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:36:30.316Z: Checking required Cloud APIs are enabled.
May 31, 2018 6:36:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:36:30.495Z: Checking permissions granted to controller Service Account.
May 31, 2018 6:36:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:36:34.631Z: Worker configuration: n1-standard-1 in us-central1-b.
May 31, 2018 6:36:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:36:35.028Z: Expanding CoGroupByKey operations into optimizable parts.
May 31, 2018 6:36:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:36:35.176Z: Expanding GroupByKey operations into optimizable parts.
May 31, 2018 6:36:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:36:35.218Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
May 31, 2018 6:36:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:36:35.424Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
May 31, 2018 6:36:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:36:35.466Z: Elided trivial flatten
May 31, 2018 6:36:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:36:35.501Z: Elided trivial flatten
May 31, 2018 6:36:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:36:35.544Z: Elided trivial flatten
May 31, 2018 6:36:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:36:35.579Z: Unzipping flatten s24 for input s19.org.apache.beam.sdk.values.PCollection.<init>:329#8fd0f908e3ea90e3
May 31, 2018 6:36:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:36:35.624Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Reify, through flatten PAssert$33/GroupGlobally/FlattenDummyAndContents, into producer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map
May 31, 2018 6:36:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:36:35.672Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow into PAssert$33/GroupGlobally/GroupDummyAndContents/Read
May 31, 2018 6:36:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:36:35.707Z: Fusing consumer PAssert$33/GroupGlobally/ParDo(Concat) into PAssert$33/GroupGlobally/Values/Values/Map
May 31, 2018 6:36:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:36:35.735Z: Fusing consumer PAssert$33/GetPane/Map into PAssert$33/GroupGlobally/ParDo(Concat)
May 31, 2018 6:36:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:36:35.774Z: Fusing consumer PAssert$33/GroupGlobally/Values/Values/Map into PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow
May 31, 2018 6:36:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:36:35.815Z: Fusing consumer PAssert$33/RunChecks into PAssert$33/GetPane/Map
May 31, 2018 6:36:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:36:35.860Z: Fusing consumer PAssert$33/VerifyAssertions/ParDo(DefaultConclude) into PAssert$33/RunChecks
May 31, 2018 6:36:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:36:35.903Z: Unzipping flatten s24-u45 for input s26-reify-value18-c43
May 31, 2018 6:36:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:36:35.949Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Write, through flatten s24-u45, into producer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 31, 2018 6:36:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:36:35.995Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify into PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
May 31, 2018 6:36:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:36:36.042Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Write into PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 31, 2018 6:36:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:36:36.077Z: Fusing consumer PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)
May 31, 2018 6:36:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:36:36.119Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
May 31, 2018 6:36:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:36:36.165Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
May 31, 2018 6:36:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:36:36.210Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into PAssert$33/GroupGlobally/Window.Into()/Window.Assign
May 31, 2018 6:36:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:36:36.249Z: Fusing consumer OutputSideInputs into Create123/Read(CreateSource)
May 31, 2018 6:36:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:36:36.292Z: Fusing consumer PAssert$33/GroupGlobally/Window.Into()/Window.Assign into OutputSideInputs
May 31, 2018 6:36:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:36:36.330Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
May 31, 2018 6:36:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:36:36.374Z: Fusing consumer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map into PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
May 31, 2018 6:36:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:36:36.420Z: Fusing consumer PAssert$33/GroupGlobally/RewindowActuals/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map
May 31, 2018 6:36:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:36:36.455Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read
May 31, 2018 6:36:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:36:36.489Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
May 31, 2018 6:36:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:36:36.533Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
May 31, 2018 6:36:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:36:36.586Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
May 31, 2018 6:36:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:36:36.627Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
May 31, 2018 6:36:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:36:36.669Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
May 31, 2018 6:36:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:36:36.712Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into Create47/Read(CreateSource)
May 31, 2018 6:36:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:36:36.748Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
May 31, 2018 6:36:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:36:36.793Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
May 31, 2018 6:36:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:36:36.837Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
May 31, 2018 6:36:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:36:36.879Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
May 31, 2018 6:36:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:36:36.920Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
May 31, 2018 6:36:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:36:36.963Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
May 31, 2018 6:36:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:36:37.405Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Create
May 31, 2018 6:36:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:36:37.449Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Create
May 31, 2018 6:36:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:36:37.484Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
May 31, 2018 6:36:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:36:37.506Z: Starting 1 workers in us-central1-b...
May 31, 2018 6:36:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:36:37.531Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
May 31, 2018 6:36:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:36:37.746Z: Executing operation Create47/Read(CreateSource)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
May 31, 2018 6:36:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:36:37.782Z: Executing operation PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 31, 2018 6:36:46 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:36:45.304Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
May 31, 2018 6:36:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:36:55.840Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
May 31, 2018 6:36:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:36:55.874Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 31, 2018 6:37:19 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:37:17.864Z: Workers have started successfully.
May 31, 2018 6:37:44 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:37:42.715Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
May 31, 2018 6:37:44 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:37:42.790Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
May 31, 2018 6:37:45 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:37:44.997Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
May 31, 2018 6:37:45 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:37:45.076Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
May 31, 2018 6:38:00 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:37:58.167Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
May 31, 2018 6:38:00 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:37:58.323Z: Executing operation Create123/Read(CreateSource)+OutputSideInputs+PAssert$33/GroupGlobally/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write
May 31, 2018 6:38:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:38:07.206Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Close
May 31, 2018 6:38:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:38:07.275Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$33/GroupGlobally/RewindowActuals/Window.Assign+PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 31, 2018 6:38:12 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:38:10.078Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Close
May 31, 2018 6:38:12 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:38:10.146Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Read+PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$33/GroupGlobally/Values/Values/Map+PAssert$33/GroupGlobally/ParDo(Concat)+PAssert$33/GetPane/Map+PAssert$33/RunChecks+PAssert$33/VerifyAssertions/ParDo(DefaultConclude)
May 31, 2018 6:38:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:38:15.089Z: Cleaning up.
May 31, 2018 6:38:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:38:15.154Z: Stopping worker pool...
May 31, 2018 6:40:12 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:40:10.103Z: Autoscaling: Resized worker pool from 1 to 0.
May 31, 2018 6:40:12 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:40:10.152Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 31, 2018 6:41:36 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-05-30_23_36_27-8374727479302907689 finished with status DONE.
May 31, 2018 6:41:36 AM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-05-30_23_36_27-8374727479302907689. Found 1 success, 0 failures out of 1 expected assertions.
Gradle Test Executor 37 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest FAILED
209 tests completed, 34 failed, 2 skipped
Finished generating test XML results (0.393 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerTest>
Generating HTML test report...
Finished generating test html results (0.259 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest>
:beam-runners-google-cloud-dataflow-java:validatesRunnerTest (Thread[Task worker for ':' Thread 44,5,main]) completed. Took 2 hrs 15 mins 27.679 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:validatesRunnerTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 16m 30s
38 actionable tasks: 35 executed, 3 from cache
Publishing build scan...
https://gradle.com/s/yxpfkwvhlex32
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user katarzyna.kucharczyk@polidea.com
Not sending mail to unregistered user robbe.sneyders@ml6.eu
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user schroederc@google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user sidhom@google.com
Not sending mail to unregistered user cademarkegard@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ammons@google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Build failed in Jenkins:
beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #383
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/383/display/redirect>
------------------------------------------
[...truncated 18.18 MB...]
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map as step s17
May 31, 2018 4:20:55 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RewindowActuals/Window.Assign as step s18
May 31, 2018 4:20:55 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map as step s19
May 31, 2018 4:20:55 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveActualsTriggering/Flatten.PCollections as step s20
May 31, 2018 4:20:55 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Create.Values/Read(CreateSource) as step s21
May 31, 2018 4:20:55 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign as step s22
May 31, 2018 4:20:55 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveDummyTriggering/Flatten.PCollections as step s23
May 31, 2018 4:20:55 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/FlattenDummyAndContents as step s24
May 31, 2018 4:20:55 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/NeverTrigger/Flatten.PCollections as step s25
May 31, 2018 4:20:55 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GroupDummyAndContents as step s26
May 31, 2018 4:20:55 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Values/Values/Map as step s27
May 31, 2018 4:20:55 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/ParDo(Concat) as step s28
May 31, 2018 4:20:55 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GetPane/Map as step s29
May 31, 2018 4:20:55 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/RunChecks as step s30
May 31, 2018 4:20:55 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/VerifyAssertions/ParDo(DefaultConclude) as step s31
May 31, 2018 4:20:55 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0531042051-4614026e/output/results/staging/
May 31, 2018 4:20:55 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <71120 bytes, hash w5VQjF7Bfi4YhN1Ka4fPeg> to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0531042051-4614026e/output/results/staging/pipeline-w5VQjF7Bfi4YhN1Ka4fPeg.pb
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 31, 2018 4:20:56 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-05-30_21_20_55-1585668727997182911?project=apache-beam-testing
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Submitted job: 2018-05-30_21_20_55-1585668727997182911
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 31, 2018 4:20:56 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-05-30_21_20_55-1585668727997182911
May 31, 2018 4:20:56 AM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-05-30_21_20_55-1585668727997182911 with 1 expected assertions.
May 31, 2018 4:21:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:20:56.038Z: Autoscaling is enabled for job 2018-05-30_21_20_55-1585668727997182911. The number of workers will be between 1 and 1000.
May 31, 2018 4:21:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:20:56.074Z: Autoscaling was automatically enabled for job 2018-05-30_21_20_55-1585668727997182911.
May 31, 2018 4:21:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:20:58.456Z: Checking required Cloud APIs are enabled.
May 31, 2018 4:21:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:20:58.576Z: Checking permissions granted to controller Service Account.
May 31, 2018 4:21:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:21:03.595Z: Worker configuration: n1-standard-1 in us-central1-b.
May 31, 2018 4:21:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:21:04.021Z: Expanding CoGroupByKey operations into optimizable parts.
May 31, 2018 4:21:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:21:04.195Z: Expanding GroupByKey operations into optimizable parts.
May 31, 2018 4:21:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:21:04.228Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
May 31, 2018 4:21:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:21:04.452Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
May 31, 2018 4:21:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:21:04.487Z: Elided trivial flatten
May 31, 2018 4:21:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:21:04.539Z: Elided trivial flatten
May 31, 2018 4:21:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:21:04.587Z: Elided trivial flatten
May 31, 2018 4:21:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:21:04.631Z: Unzipping flatten s24 for input s19.org.apache.beam.sdk.values.PCollection.<init>:329#8fd0f908e3ea90e3
May 31, 2018 4:21:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:21:04.671Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Reify, through flatten PAssert$33/GroupGlobally/FlattenDummyAndContents, into producer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map
May 31, 2018 4:21:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:21:04.708Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow into PAssert$33/GroupGlobally/GroupDummyAndContents/Read
May 31, 2018 4:21:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:21:04.749Z: Fusing consumer PAssert$33/GroupGlobally/ParDo(Concat) into PAssert$33/GroupGlobally/Values/Values/Map
May 31, 2018 4:21:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:21:04.792Z: Fusing consumer PAssert$33/GetPane/Map into PAssert$33/GroupGlobally/ParDo(Concat)
May 31, 2018 4:21:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:21:04.833Z: Fusing consumer PAssert$33/GroupGlobally/Values/Values/Map into PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow
May 31, 2018 4:21:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:21:04.875Z: Fusing consumer PAssert$33/RunChecks into PAssert$33/GetPane/Map
May 31, 2018 4:21:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:21:04.912Z: Fusing consumer PAssert$33/VerifyAssertions/ParDo(DefaultConclude) into PAssert$33/RunChecks
May 31, 2018 4:21:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:21:04.958Z: Unzipping flatten s24-u45 for input s26-reify-value18-c43
May 31, 2018 4:21:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:21:05.000Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Write, through flatten s24-u45, into producer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 31, 2018 4:21:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:21:05.037Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify into PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
May 31, 2018 4:21:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:21:05.065Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Write into PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 31, 2018 4:21:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:21:05.105Z: Fusing consumer PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)
May 31, 2018 4:21:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:21:05.143Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
May 31, 2018 4:21:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:21:05.189Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
May 31, 2018 4:21:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:21:05.225Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into PAssert$33/GroupGlobally/Window.Into()/Window.Assign
May 31, 2018 4:21:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:21:05.263Z: Fusing consumer OutputSideInputs into Create123/Read(CreateSource)
May 31, 2018 4:21:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:21:05.301Z: Fusing consumer PAssert$33/GroupGlobally/Window.Into()/Window.Assign into OutputSideInputs
May 31, 2018 4:21:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:21:05.334Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
May 31, 2018 4:21:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:21:05.374Z: Fusing consumer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map into PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
May 31, 2018 4:21:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:21:05.419Z: Fusing consumer PAssert$33/GroupGlobally/RewindowActuals/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map
May 31, 2018 4:21:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:21:05.463Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read
May 31, 2018 4:21:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:21:05.502Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
May 31, 2018 4:21:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:21:05.541Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
May 31, 2018 4:21:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:21:05.586Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
May 31, 2018 4:21:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:21:05.620Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
May 31, 2018 4:21:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:21:05.652Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
May 31, 2018 4:21:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:21:05.682Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into Create47/Read(CreateSource)
May 31, 2018 4:21:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:21:05.725Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
May 31, 2018 4:21:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:21:05.763Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
May 31, 2018 4:21:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:21:05.802Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
May 31, 2018 4:21:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:21:05.845Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
May 31, 2018 4:21:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:21:05.876Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
May 31, 2018 4:21:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:21:05.919Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
May 31, 2018 4:21:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:21:06.398Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Create
May 31, 2018 4:21:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:21:06.437Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Create
May 31, 2018 4:21:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:21:06.482Z: Starting 1 workers in us-central1-b...
May 31, 2018 4:21:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:21:06.482Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
May 31, 2018 4:21:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:21:06.522Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
May 31, 2018 4:21:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:21:06.751Z: Executing operation PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 31, 2018 4:21:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:21:06.793Z: Executing operation Create47/Read(CreateSource)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
May 31, 2018 4:21:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:21:16.598Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
May 31, 2018 4:21:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:21:27.305Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
May 31, 2018 4:21:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:21:27.345Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 31, 2018 4:21:44 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:21:43.924Z: Workers have started successfully.
May 31, 2018 4:22:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:22:07.229Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
May 31, 2018 4:22:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:22:07.320Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
May 31, 2018 4:22:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:22:12.584Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
May 31, 2018 4:22:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:22:12.676Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
May 31, 2018 4:22:26 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:22:25.943Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
May 31, 2018 4:22:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:22:26.149Z: Executing operation Create123/Read(CreateSource)+OutputSideInputs+PAssert$33/GroupGlobally/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write
May 31, 2018 4:22:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:22:32.382Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Close
May 31, 2018 4:22:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:22:32.462Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$33/GroupGlobally/RewindowActuals/Window.Assign+PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 31, 2018 4:22:39 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:22:38.015Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Close
May 31, 2018 4:22:39 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:22:38.120Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Read+PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$33/GroupGlobally/Values/Values/Map+PAssert$33/GroupGlobally/ParDo(Concat)+PAssert$33/GetPane/Map+PAssert$33/RunChecks+PAssert$33/VerifyAssertions/ParDo(DefaultConclude)
May 31, 2018 4:22:40 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:22:39.267Z: Cleaning up.
May 31, 2018 4:22:40 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:22:39.373Z: Stopping worker pool...
May 31, 2018 4:24:39 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:24:38.843Z: Autoscaling: Resized worker pool from 1 to 0.
May 31, 2018 4:24:39 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:24:38.899Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 31, 2018 4:24:39 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:24:38.964Z: Worker pool stopped.
May 31, 2018 4:24:51 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-05-30_21_20_55-1585668727997182911 finished with status DONE.
May 31, 2018 4:24:51 AM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-05-30_21_20_55-1585668727997182911. Found 1 success, 0 failures out of 1 expected assertions.
Gradle Test Executor 38 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest FAILED
209 tests completed, 34 failed, 2 skipped
Finished generating test XML results (0.336 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerTest>
Generating HTML test report...
Finished generating test html results (0.274 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest>
:beam-runners-google-cloud-dataflow-java:validatesRunnerTest (Thread[Task worker for ':' Thread 40,5,main]) completed. Took 2 hrs 17 mins 8.986 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:validatesRunnerTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 18m 2s
38 actionable tasks: 34 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/mkh2yfnmqiwek
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user katarzyna.kucharczyk@polidea.com
Not sending mail to unregistered user robbe.sneyders@ml6.eu
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user schroederc@google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user sidhom@google.com
Not sending mail to unregistered user cademarkegard@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ammons@google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Build failed in Jenkins:
beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #382
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/382/display/redirect?page=changes>
Changes:
[szewinho] HDFS large cluster configuration. Jenkins job updated to use large
[kenn] Add more field conveniences to Schema.Builder
[kenn] Remove extraneous RowSqlTypes
------------------------------------------
[...truncated 18.18 MB...]
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey as step s16
May 31, 2018 2:01:58 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map as step s17
May 31, 2018 2:01:58 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RewindowActuals/Window.Assign as step s18
May 31, 2018 2:01:58 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map as step s19
May 31, 2018 2:01:58 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveActualsTriggering/Flatten.PCollections as step s20
May 31, 2018 2:01:58 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Create.Values/Read(CreateSource) as step s21
May 31, 2018 2:01:58 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign as step s22
May 31, 2018 2:01:58 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveDummyTriggering/Flatten.PCollections as step s23
May 31, 2018 2:01:58 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/FlattenDummyAndContents as step s24
May 31, 2018 2:01:58 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/NeverTrigger/Flatten.PCollections as step s25
May 31, 2018 2:01:58 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GroupDummyAndContents as step s26
May 31, 2018 2:01:58 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Values/Values/Map as step s27
May 31, 2018 2:01:58 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/ParDo(Concat) as step s28
May 31, 2018 2:01:58 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GetPane/Map as step s29
May 31, 2018 2:01:58 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/RunChecks as step s30
May 31, 2018 2:01:58 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/VerifyAssertions/ParDo(DefaultConclude) as step s31
May 31, 2018 2:01:58 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0531020154-cc573fc8/output/results/staging/
May 31, 2018 2:01:58 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <71120 bytes, hash RrnSHd9_lHxRiH5h19TQoQ> to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0531020154-cc573fc8/output/results/staging/pipeline-RrnSHd9_lHxRiH5h19TQoQ.pb
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 31, 2018 2:01:59 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-05-30_19_01_58-12536947499388639469?project=apache-beam-testing
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Submitted job: 2018-05-30_19_01_58-12536947499388639469
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 31, 2018 2:01:59 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-05-30_19_01_58-12536947499388639469
May 31, 2018 2:01:59 AM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-05-30_19_01_58-12536947499388639469 with 1 expected assertions.
May 31, 2018 2:02:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:01:58.949Z: Autoscaling is enabled for job 2018-05-30_19_01_58-12536947499388639469. The number of workers will be between 1 and 1000.
May 31, 2018 2:02:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:01:58.995Z: Autoscaling was automatically enabled for job 2018-05-30_19_01_58-12536947499388639469.
May 31, 2018 2:02:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:02:01.425Z: Checking required Cloud APIs are enabled.
May 31, 2018 2:02:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:02:01.519Z: Checking permissions granted to controller Service Account.
May 31, 2018 2:02:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:02:05.978Z: Worker configuration: n1-standard-1 in us-central1-b.
May 31, 2018 2:02:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:02:06.355Z: Expanding CoGroupByKey operations into optimizable parts.
May 31, 2018 2:02:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:02:06.494Z: Expanding GroupByKey operations into optimizable parts.
May 31, 2018 2:02:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:02:06.535Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
May 31, 2018 2:02:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:02:06.700Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
May 31, 2018 2:02:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:02:06.731Z: Elided trivial flatten
May 31, 2018 2:02:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:02:06.772Z: Elided trivial flatten
May 31, 2018 2:02:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:02:06.796Z: Elided trivial flatten
May 31, 2018 2:02:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:02:06.834Z: Unzipping flatten s24 for input s19.org.apache.beam.sdk.values.PCollection.<init>:329#8fd0f908e3ea90e3
May 31, 2018 2:02:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:02:06.901Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Reify, through flatten PAssert$33/GroupGlobally/FlattenDummyAndContents, into producer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map
May 31, 2018 2:02:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:02:06.929Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow into PAssert$33/GroupGlobally/GroupDummyAndContents/Read
May 31, 2018 2:02:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:02:06.952Z: Fusing consumer PAssert$33/GroupGlobally/ParDo(Concat) into PAssert$33/GroupGlobally/Values/Values/Map
May 31, 2018 2:02:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:02:06.970Z: Fusing consumer PAssert$33/GetPane/Map into PAssert$33/GroupGlobally/ParDo(Concat)
May 31, 2018 2:02:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:02:06.997Z: Fusing consumer PAssert$33/GroupGlobally/Values/Values/Map into PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow
May 31, 2018 2:02:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:02:07.018Z: Fusing consumer PAssert$33/RunChecks into PAssert$33/GetPane/Map
May 31, 2018 2:02:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:02:07.045Z: Fusing consumer PAssert$33/VerifyAssertions/ParDo(DefaultConclude) into PAssert$33/RunChecks
May 31, 2018 2:02:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:02:07.084Z: Unzipping flatten s24-u45 for input s26-reify-value18-c43
May 31, 2018 2:02:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:02:07.120Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Write, through flatten s24-u45, into producer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 31, 2018 2:02:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:02:07.161Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify into PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
May 31, 2018 2:02:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:02:07.197Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Write into PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 31, 2018 2:02:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:02:07.246Z: Fusing consumer PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)
May 31, 2018 2:02:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:02:07.285Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
May 31, 2018 2:02:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:02:07.329Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
May 31, 2018 2:02:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:02:07.367Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into PAssert$33/GroupGlobally/Window.Into()/Window.Assign
May 31, 2018 2:02:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:02:07.408Z: Fusing consumer OutputSideInputs into Create123/Read(CreateSource)
May 31, 2018 2:02:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:02:07.438Z: Fusing consumer PAssert$33/GroupGlobally/Window.Into()/Window.Assign into OutputSideInputs
May 31, 2018 2:02:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:02:07.473Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
May 31, 2018 2:02:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:02:07.495Z: Fusing consumer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map into PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
May 31, 2018 2:02:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:02:07.528Z: Fusing consumer PAssert$33/GroupGlobally/RewindowActuals/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map
May 31, 2018 2:02:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:02:07.563Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read
May 31, 2018 2:02:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:02:07.599Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
May 31, 2018 2:02:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:02:07.638Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
May 31, 2018 2:02:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:02:07.681Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
May 31, 2018 2:02:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:02:07.717Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
May 31, 2018 2:02:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:02:07.752Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
May 31, 2018 2:02:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:02:07.783Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into Create47/Read(CreateSource)
May 31, 2018 2:02:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:02:07.834Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
May 31, 2018 2:02:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:02:07.862Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
May 31, 2018 2:02:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:02:07.909Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
May 31, 2018 2:02:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:02:07.954Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
May 31, 2018 2:02:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:02:07.995Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
May 31, 2018 2:02:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:02:08.032Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
May 31, 2018 2:02:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:02:08.474Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Create
May 31, 2018 2:02:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:02:08.513Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Create
May 31, 2018 2:02:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:02:08.551Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
May 31, 2018 2:02:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:02:08.551Z: Starting 1 workers in us-central1-b...
May 31, 2018 2:02:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:02:08.580Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
May 31, 2018 2:02:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:02:08.779Z: Executing operation Create47/Read(CreateSource)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
May 31, 2018 2:02:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:02:08.820Z: Executing operation PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 31, 2018 2:02:18 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:02:17.155Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
May 31, 2018 2:02:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:02:27.879Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
May 31, 2018 2:02:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:02:27.913Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 31, 2018 2:03:04 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:03:03.050Z: Workers have started successfully.
May 31, 2018 2:03:50 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:03:48.477Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
May 31, 2018 2:03:50 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:03:48.557Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
May 31, 2018 2:03:56 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:03:55.727Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
May 31, 2018 2:03:56 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:03:55.819Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
May 31, 2018 2:04:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:04:07.925Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
May 31, 2018 2:04:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:04:08.119Z: Executing operation Create123/Read(CreateSource)+OutputSideInputs+PAssert$33/GroupGlobally/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write
May 31, 2018 2:04:19 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:04:18.862Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Close
May 31, 2018 2:04:19 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:04:18.954Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$33/GroupGlobally/RewindowActuals/Window.Assign+PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 31, 2018 2:04:22 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:04:21.728Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Close
May 31, 2018 2:04:22 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:04:21.825Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Read+PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$33/GroupGlobally/Values/Values/Map+PAssert$33/GroupGlobally/ParDo(Concat)+PAssert$33/GetPane/Map+PAssert$33/RunChecks+PAssert$33/VerifyAssertions/ParDo(DefaultConclude)
May 31, 2018 2:04:27 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:04:26.968Z: Cleaning up.
May 31, 2018 2:04:27 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:04:27.082Z: Stopping worker pool...
May 31, 2018 2:06:19 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:06:18.402Z: Autoscaling: Resized worker pool from 1 to 0.
May 31, 2018 2:06:19 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:06:18.426Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 31, 2018 2:06:35 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-05-30_19_01_58-12536947499388639469 finished with status DONE.
May 31, 2018 2:06:35 AM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-05-30_19_01_58-12536947499388639469. Found 1 success, 0 failures out of 1 expected assertions.
Gradle Test Executor 38 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest FAILED
209 tests completed, 34 failed, 2 skipped
Finished generating test XML results (0.488 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerTest>
Generating HTML test report...
Finished generating test html results (0.501 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest>
:beam-runners-google-cloud-dataflow-java:validatesRunnerTest (Thread[Task worker for ':' Thread 21,5,main]) completed. Took 2 hrs 27 mins 9.188 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:validatesRunnerTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 28m 13s
38 actionable tasks: 35 executed, 3 from cache
Publishing build scan...
https://gradle.com/s/2s7jq6yzd3ipu
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user katarzyna.kucharczyk@polidea.com
Not sending mail to unregistered user robbe.sneyders@ml6.eu
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user schroederc@google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user sidhom@google.com
Not sending mail to unregistered user cademarkegard@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ammons@google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Build failed in Jenkins:
beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #381
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/381/display/redirect?page=changes>
Changes:
[Pablo] [BEAM-4322] Enforce ErrorProne analysis in protobuf extensions project
------------------------------------------
[...truncated 18.19 MB...]
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map as step s17
May 30, 2018 11:34:24 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RewindowActuals/Window.Assign as step s18
May 30, 2018 11:34:24 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map as step s19
May 30, 2018 11:34:24 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveActualsTriggering/Flatten.PCollections as step s20
May 30, 2018 11:34:24 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Create.Values/Read(CreateSource) as step s21
May 30, 2018 11:34:24 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign as step s22
May 30, 2018 11:34:24 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveDummyTriggering/Flatten.PCollections as step s23
May 30, 2018 11:34:24 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/FlattenDummyAndContents as step s24
May 30, 2018 11:34:24 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/NeverTrigger/Flatten.PCollections as step s25
May 30, 2018 11:34:24 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GroupDummyAndContents as step s26
May 30, 2018 11:34:24 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Values/Values/Map as step s27
May 30, 2018 11:34:24 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/ParDo(Concat) as step s28
May 30, 2018 11:34:24 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GetPane/Map as step s29
May 30, 2018 11:34:24 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/RunChecks as step s30
May 30, 2018 11:34:24 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/VerifyAssertions/ParDo(DefaultConclude) as step s31
May 30, 2018 11:34:24 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0530233418-9f6b7e56/output/results/staging/
May 30, 2018 11:34:24 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <71120 bytes, hash uGBY4DcXS4SCrp6MxTttSQ> to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0530233418-9f6b7e56/output/results/staging/pipeline-uGBY4DcXS4SCrp6MxTttSQ.pb
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 30, 2018 11:34:25 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-05-30_16_34_24-5278481970277675436?project=apache-beam-testing
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Submitted job: 2018-05-30_16_34_24-5278481970277675436
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 30, 2018 11:34:25 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-05-30_16_34_24-5278481970277675436
May 30, 2018 11:34:25 PM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-05-30_16_34_24-5278481970277675436 with 1 expected assertions.
May 30, 2018 11:34:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:34:24.619Z: Autoscaling is enabled for job 2018-05-30_16_34_24-5278481970277675436. The number of workers will be between 1 and 1000.
May 30, 2018 11:34:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:34:24.667Z: Autoscaling was automatically enabled for job 2018-05-30_16_34_24-5278481970277675436.
May 30, 2018 11:34:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:34:27.448Z: Checking required Cloud APIs are enabled.
May 30, 2018 11:34:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:34:27.634Z: Checking permissions granted to controller Service Account.
May 30, 2018 11:34:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:34:32.570Z: Worker configuration: n1-standard-1 in us-central1-b.
May 30, 2018 11:34:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:34:32.987Z: Expanding CoGroupByKey operations into optimizable parts.
May 30, 2018 11:34:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:34:33.172Z: Expanding GroupByKey operations into optimizable parts.
May 30, 2018 11:34:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:34:33.207Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
May 30, 2018 11:34:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:34:33.529Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
May 30, 2018 11:34:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:34:33.610Z: Elided trivial flatten
May 30, 2018 11:34:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:34:33.657Z: Elided trivial flatten
May 30, 2018 11:34:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:34:33.706Z: Elided trivial flatten
May 30, 2018 11:34:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:34:33.746Z: Unzipping flatten s24 for input s19.org.apache.beam.sdk.values.PCollection.<init>:329#8fd0f908e3ea90e3
May 30, 2018 11:34:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:34:33.797Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Reify, through flatten PAssert$33/GroupGlobally/FlattenDummyAndContents, into producer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map
May 30, 2018 11:34:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:34:33.828Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow into PAssert$33/GroupGlobally/GroupDummyAndContents/Read
May 30, 2018 11:34:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:34:33.877Z: Fusing consumer PAssert$33/GroupGlobally/ParDo(Concat) into PAssert$33/GroupGlobally/Values/Values/Map
May 30, 2018 11:34:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:34:33.931Z: Fusing consumer PAssert$33/GetPane/Map into PAssert$33/GroupGlobally/ParDo(Concat)
May 30, 2018 11:34:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:34:33.981Z: Fusing consumer PAssert$33/GroupGlobally/Values/Values/Map into PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow
May 30, 2018 11:34:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:34:34.033Z: Fusing consumer PAssert$33/RunChecks into PAssert$33/GetPane/Map
May 30, 2018 11:34:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:34:34.084Z: Fusing consumer PAssert$33/VerifyAssertions/ParDo(DefaultConclude) into PAssert$33/RunChecks
May 30, 2018 11:34:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:34:34.125Z: Unzipping flatten s24-u45 for input s26-reify-value18-c43
May 30, 2018 11:34:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:34:34.181Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Write, through flatten s24-u45, into producer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 30, 2018 11:34:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:34:34.226Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify into PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
May 30, 2018 11:34:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:34:34.274Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Write into PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 30, 2018 11:34:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:34:34.331Z: Fusing consumer PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)
May 30, 2018 11:34:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:34:34.378Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
May 30, 2018 11:34:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:34:34.423Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
May 30, 2018 11:34:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:34:34.464Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into PAssert$33/GroupGlobally/Window.Into()/Window.Assign
May 30, 2018 11:34:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:34:34.516Z: Fusing consumer OutputSideInputs into Create123/Read(CreateSource)
May 30, 2018 11:34:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:34:34.565Z: Fusing consumer PAssert$33/GroupGlobally/Window.Into()/Window.Assign into OutputSideInputs
May 30, 2018 11:34:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:34:34.616Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
May 30, 2018 11:34:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:34:34.664Z: Fusing consumer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map into PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
May 30, 2018 11:34:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:34:34.711Z: Fusing consumer PAssert$33/GroupGlobally/RewindowActuals/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map
May 30, 2018 11:34:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:34:34.762Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read
May 30, 2018 11:34:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:34:34.805Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
May 30, 2018 11:34:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:34:34.847Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
May 30, 2018 11:34:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:34:34.886Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
May 30, 2018 11:34:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:34:34.940Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
May 30, 2018 11:34:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:34:34.980Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
May 30, 2018 11:34:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:34:35.030Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into Create47/Read(CreateSource)
May 30, 2018 11:34:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:34:35.062Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
May 30, 2018 11:34:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:34:35.108Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
May 30, 2018 11:34:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:34:35.152Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
May 30, 2018 11:34:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:34:35.199Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
May 30, 2018 11:34:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:34:35.249Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
May 30, 2018 11:34:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:34:35.300Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
May 30, 2018 11:34:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:34:35.868Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Create
May 30, 2018 11:34:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:34:35.916Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Create
May 30, 2018 11:34:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:34:35.953Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
May 30, 2018 11:34:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:34:35.971Z: Starting 1 workers in us-central1-b...
May 30, 2018 11:34:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:34:36.007Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
May 30, 2018 11:34:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:34:36.318Z: Executing operation Create47/Read(CreateSource)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
May 30, 2018 11:34:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:34:36.395Z: Executing operation PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 30, 2018 11:34:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:34:43.798Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
May 30, 2018 11:34:56 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:34:54.327Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
May 30, 2018 11:34:56 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:34:54.364Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 30, 2018 11:35:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:35:14.796Z: Workers have started successfully.
May 30, 2018 11:35:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:35:35.162Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
May 30, 2018 11:35:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:35:35.285Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
May 30, 2018 11:35:40 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:35:39.925Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
May 30, 2018 11:35:40 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:35:40.018Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
May 30, 2018 11:35:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:35:52.101Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
May 30, 2018 11:35:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:35:52.293Z: Executing operation Create123/Read(CreateSource)+OutputSideInputs+PAssert$33/GroupGlobally/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write
May 30, 2018 11:36:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:35:59.422Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Close
May 30, 2018 11:36:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:35:59.532Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$33/GroupGlobally/RewindowActuals/Window.Assign+PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 30, 2018 11:36:03 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:36:02.958Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Close
May 30, 2018 11:36:03 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:36:03.069Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Read+PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$33/GroupGlobally/Values/Values/Map+PAssert$33/GroupGlobally/ParDo(Concat)+PAssert$33/GetPane/Map+PAssert$33/RunChecks+PAssert$33/VerifyAssertions/ParDo(DefaultConclude)
May 30, 2018 11:36:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:36:06.288Z: Cleaning up.
May 30, 2018 11:36:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:36:06.444Z: Stopping worker pool...
May 30, 2018 11:37:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:37:45.129Z: Autoscaling: Resized worker pool from 1 to 0.
May 30, 2018 11:37:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:37:45.233Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 30, 2018 11:37:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:37:45.296Z: Worker pool stopped.
May 30, 2018 11:37:54 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-05-30_16_34_24-5278481970277675436 finished with status DONE.
May 30, 2018 11:37:54 PM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-05-30_16_34_24-5278481970277675436. Found 1 success, 0 failures out of 1 expected assertions.
Gradle Test Executor 39 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest FAILED
209 tests completed, 34 failed, 2 skipped
Finished generating test XML results (0.466 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerTest>
Generating HTML test report...
Finished generating test html results (0.367 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest>
:beam-runners-google-cloud-dataflow-java:validatesRunnerTest (Thread[Task worker for ':' Thread 12,5,main]) completed. Took 2 hrs 25 mins 25.132 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:validatesRunnerTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 26m 38s
38 actionable tasks: 35 executed, 3 from cache
Publishing build scan...
https://gradle.com/s/qlj72s3hrt6oe
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user katarzyna.kucharczyk@polidea.com
Not sending mail to unregistered user robbe.sneyders@ml6.eu
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user schroederc@google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user sidhom@google.com
Not sending mail to unregistered user cademarkegard@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ammons@google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Build failed in Jenkins:
beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #380
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/380/display/redirect?page=changes>
Changes:
[kenn] Add convenience aliases for nullary type constructors
[kenn] Add MAP field support to Schema.Builder
[kenn] Add static factories for array, row, map types
[kenn] Schema fields are non-null by default
[kenn] TestUtils.RowsBuilder to use FieldType instead of TypeName
[kenn] Clean up CalciteUtils conversions a bit
[Pablo] enable failOnWarning for build-tools
[apilloud] Run everything with shadowJar
[apilloud] guava is on kinesis public API
[apilloud] Fix direct runner shadow config
------------------------------------------
[...truncated 18.03 MB...]
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey as step s16
May 30, 2018 9:05:42 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map as step s17
May 30, 2018 9:05:42 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RewindowActuals/Window.Assign as step s18
May 30, 2018 9:05:42 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map as step s19
May 30, 2018 9:05:42 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveActualsTriggering/Flatten.PCollections as step s20
May 30, 2018 9:05:42 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Create.Values/Read(CreateSource) as step s21
May 30, 2018 9:05:42 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign as step s22
May 30, 2018 9:05:42 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveDummyTriggering/Flatten.PCollections as step s23
May 30, 2018 9:05:42 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/FlattenDummyAndContents as step s24
May 30, 2018 9:05:42 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/NeverTrigger/Flatten.PCollections as step s25
May 30, 2018 9:05:42 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GroupDummyAndContents as step s26
May 30, 2018 9:05:42 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Values/Values/Map as step s27
May 30, 2018 9:05:42 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/ParDo(Concat) as step s28
May 30, 2018 9:05:42 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GetPane/Map as step s29
May 30, 2018 9:05:42 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/RunChecks as step s30
May 30, 2018 9:05:42 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/VerifyAssertions/ParDo(DefaultConclude) as step s31
May 30, 2018 9:05:42 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0530210538-7cf065dc/output/results/staging/
May 30, 2018 9:05:42 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <71120 bytes, hash Bz8lBCxbTBs7p9Ai1N-i0w> to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0530210538-7cf065dc/output/results/staging/pipeline-Bz8lBCxbTBs7p9Ai1N-i0w.pb
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 30, 2018 9:05:44 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-05-30_14_05_43-16634236301899883333?project=apache-beam-testing
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Submitted job: 2018-05-30_14_05_43-16634236301899883333
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 30, 2018 9:05:44 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-05-30_14_05_43-16634236301899883333
May 30, 2018 9:05:44 PM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-05-30_14_05_43-16634236301899883333 with 1 expected assertions.
May 30, 2018 9:05:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:05:43.350Z: Autoscaling is enabled for job 2018-05-30_14_05_43-16634236301899883333. The number of workers will be between 1 and 1000.
May 30, 2018 9:05:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:05:43.385Z: Autoscaling was automatically enabled for job 2018-05-30_14_05_43-16634236301899883333.
May 30, 2018 9:05:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:05:46.243Z: Checking required Cloud APIs are enabled.
May 30, 2018 9:05:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:05:46.467Z: Checking permissions granted to controller Service Account.
May 30, 2018 9:05:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:05:51.745Z: Worker configuration: n1-standard-1 in us-central1-b.
May 30, 2018 9:05:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:05:52.125Z: Expanding CoGroupByKey operations into optimizable parts.
May 30, 2018 9:05:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:05:52.345Z: Expanding GroupByKey operations into optimizable parts.
May 30, 2018 9:05:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:05:52.392Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
May 30, 2018 9:05:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:05:52.665Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
May 30, 2018 9:05:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:05:52.713Z: Elided trivial flatten
May 30, 2018 9:05:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:05:52.761Z: Elided trivial flatten
May 30, 2018 9:05:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:05:52.829Z: Elided trivial flatten
May 30, 2018 9:05:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:05:52.889Z: Unzipping flatten s24 for input s19.org.apache.beam.sdk.values.PCollection.<init>:329#8fd0f908e3ea90e3
May 30, 2018 9:05:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:05:52.936Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Reify, through flatten PAssert$33/GroupGlobally/FlattenDummyAndContents, into producer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map
May 30, 2018 9:05:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:05:53.002Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow into PAssert$33/GroupGlobally/GroupDummyAndContents/Read
May 30, 2018 9:05:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:05:53.051Z: Fusing consumer PAssert$33/GroupGlobally/ParDo(Concat) into PAssert$33/GroupGlobally/Values/Values/Map
May 30, 2018 9:05:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:05:53.097Z: Fusing consumer PAssert$33/GetPane/Map into PAssert$33/GroupGlobally/ParDo(Concat)
May 30, 2018 9:05:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:05:53.151Z: Fusing consumer PAssert$33/GroupGlobally/Values/Values/Map into PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow
May 30, 2018 9:05:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:05:53.198Z: Fusing consumer PAssert$33/RunChecks into PAssert$33/GetPane/Map
May 30, 2018 9:05:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:05:53.248Z: Fusing consumer PAssert$33/VerifyAssertions/ParDo(DefaultConclude) into PAssert$33/RunChecks
May 30, 2018 9:05:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:05:53.297Z: Unzipping flatten s24-u45 for input s26-reify-value18-c43
May 30, 2018 9:05:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:05:53.344Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Write, through flatten s24-u45, into producer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 30, 2018 9:05:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:05:53.396Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify into PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
May 30, 2018 9:05:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:05:53.443Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Write into PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 30, 2018 9:05:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:05:53.483Z: Fusing consumer PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)
May 30, 2018 9:05:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:05:53.518Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
May 30, 2018 9:05:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:05:53.567Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
May 30, 2018 9:05:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:05:53.626Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into PAssert$33/GroupGlobally/Window.Into()/Window.Assign
May 30, 2018 9:05:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:05:53.681Z: Fusing consumer OutputSideInputs into Create123/Read(CreateSource)
May 30, 2018 9:05:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:05:53.735Z: Fusing consumer PAssert$33/GroupGlobally/Window.Into()/Window.Assign into OutputSideInputs
May 30, 2018 9:05:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:05:53.788Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
May 30, 2018 9:05:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:05:53.831Z: Fusing consumer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map into PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
May 30, 2018 9:05:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:05:53.891Z: Fusing consumer PAssert$33/GroupGlobally/RewindowActuals/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map
May 30, 2018 9:05:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:05:53.947Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read
May 30, 2018 9:05:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:05:54.000Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
May 30, 2018 9:05:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:05:54.042Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
May 30, 2018 9:05:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:05:54.106Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
May 30, 2018 9:05:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:05:54.156Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
May 30, 2018 9:05:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:05:54.214Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
May 30, 2018 9:05:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:05:54.269Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into Create47/Read(CreateSource)
May 30, 2018 9:05:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:05:54.317Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
May 30, 2018 9:05:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:05:54.369Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
May 30, 2018 9:05:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:05:54.429Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
May 30, 2018 9:05:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:05:54.463Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
May 30, 2018 9:05:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:05:54.508Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
May 30, 2018 9:05:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:05:54.547Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
May 30, 2018 9:05:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:05:55.101Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Create
May 30, 2018 9:05:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:05:55.151Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Create
May 30, 2018 9:05:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:05:55.207Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
May 30, 2018 9:05:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:05:55.207Z: Starting 1 workers in us-central1-b...
May 30, 2018 9:05:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:05:55.264Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
May 30, 2018 9:05:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:05:55.525Z: Executing operation PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 30, 2018 9:05:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:05:55.588Z: Executing operation Create47/Read(CreateSource)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
May 30, 2018 9:06:06 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:06:05.341Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
May 30, 2018 9:06:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:06:16.035Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
May 30, 2018 9:06:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:06:16.066Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 30, 2018 9:06:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:06:40.343Z: Workers have started successfully.
May 30, 2018 9:07:32 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:07:30.856Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
May 30, 2018 9:07:32 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:07:30.970Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
May 30, 2018 9:07:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:07:38.357Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
May 30, 2018 9:07:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:07:38.449Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
May 30, 2018 9:07:50 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:07:50.271Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
May 30, 2018 9:07:50 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:07:50.492Z: Executing operation Create123/Read(CreateSource)+OutputSideInputs+PAssert$33/GroupGlobally/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write
May 30, 2018 9:07:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:07:56.943Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Close
May 30, 2018 9:07:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:07:57.037Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$33/GroupGlobally/RewindowActuals/Window.Assign+PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 30, 2018 9:08:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:07:59.954Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Close
May 30, 2018 9:08:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:08:00.063Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Read+PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$33/GroupGlobally/Values/Values/Map+PAssert$33/GroupGlobally/ParDo(Concat)+PAssert$33/GetPane/Map+PAssert$33/RunChecks+PAssert$33/VerifyAssertions/ParDo(DefaultConclude)
May 30, 2018 9:08:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:08:04.337Z: Cleaning up.
May 30, 2018 9:08:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:08:04.489Z: Stopping worker pool...
May 30, 2018 9:10:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:10:19.259Z: Autoscaling: Resized worker pool from 1 to 0.
May 30, 2018 9:10:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:10:19.307Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 30, 2018 9:10:56 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-05-30_14_05_43-16634236301899883333 finished with status DONE.
May 30, 2018 9:10:56 PM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-05-30_14_05_43-16634236301899883333. Found 1 success, 0 failures out of 1 expected assertions.
Gradle Test Executor 43 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest FAILED
209 tests completed, 34 failed, 2 skipped
Finished generating test XML results (0.424 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerTest>
Generating HTML test report...
Finished generating test html results (0.453 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest>
:beam-runners-google-cloud-dataflow-java:validatesRunnerTest (Thread[Task worker for ':' Thread 5,5,main]) completed. Took 2 hrs 26 mins 42.316 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:validatesRunnerTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 27m 44s
38 actionable tasks: 34 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/fkq3kqm6bmukm
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user katarzyna.kucharczyk@polidea.com
Not sending mail to unregistered user robbe.sneyders@ml6.eu
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user schroederc@google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user sidhom@google.com
Not sending mail to unregistered user cademarkegard@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ammons@google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Build failed in Jenkins:
beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #379
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/379/display/redirect?page=changes>
Changes:
[iemejia] Update postgres version to 42.2.2 (Java 8)
[coheigea] Update README to include virtualenv in the build instructions
[kenn] Finish RowType -> Schema rename
------------------------------------------
[...truncated 18.18 MB...]
INFO: Adding PAssert$33/GroupGlobally/RewindowActuals/Window.Assign as step s18
May 30, 2018 6:38:48 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map as step s19
May 30, 2018 6:38:48 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveActualsTriggering/Flatten.PCollections as step s20
May 30, 2018 6:38:48 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Create.Values/Read(CreateSource) as step s21
May 30, 2018 6:38:48 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign as step s22
May 30, 2018 6:38:48 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveDummyTriggering/Flatten.PCollections as step s23
May 30, 2018 6:38:48 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/FlattenDummyAndContents as step s24
May 30, 2018 6:38:48 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/NeverTrigger/Flatten.PCollections as step s25
May 30, 2018 6:38:48 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GroupDummyAndContents as step s26
May 30, 2018 6:38:48 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Values/Values/Map as step s27
May 30, 2018 6:38:48 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/ParDo(Concat) as step s28
May 30, 2018 6:38:48 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GetPane/Map as step s29
May 30, 2018 6:38:48 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/RunChecks as step s30
May 30, 2018 6:38:48 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/VerifyAssertions/ParDo(DefaultConclude) as step s31
May 30, 2018 6:38:48 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0530183843-209d6c83/output/results/staging/
May 30, 2018 6:38:48 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <71120 bytes, hash JnySZQCa59O5XxzoZ7v5ug> to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0530183843-209d6c83/output/results/staging/pipeline-JnySZQCa59O5XxzoZ7v5ug.pb
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 30, 2018 6:38:49 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-05-30_11_38_48-8199330797739115718?project=apache-beam-testing
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Submitted job: 2018-05-30_11_38_48-8199330797739115718
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 30, 2018 6:38:49 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-05-30_11_38_48-8199330797739115718
May 30, 2018 6:38:49 PM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-05-30_11_38_48-8199330797739115718 with 1 expected assertions.
May 30, 2018 6:39:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:38:48.573Z: Autoscaling is enabled for job 2018-05-30_11_38_48-8199330797739115718. The number of workers will be between 1 and 1000.
May 30, 2018 6:39:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:38:48.587Z: Autoscaling was automatically enabled for job 2018-05-30_11_38_48-8199330797739115718.
May 30, 2018 6:39:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:38:51.218Z: Checking required Cloud APIs are enabled.
May 30, 2018 6:39:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:38:51.378Z: Checking permissions granted to controller Service Account.
May 30, 2018 6:39:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:39:01.994Z: Worker configuration: n1-standard-1 in us-central1-b.
May 30, 2018 6:39:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:39:02.378Z: Expanding CoGroupByKey operations into optimizable parts.
May 30, 2018 6:39:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:39:02.574Z: Expanding GroupByKey operations into optimizable parts.
May 30, 2018 6:39:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:39:02.611Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
May 30, 2018 6:39:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:39:02.887Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
May 30, 2018 6:39:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:39:02.935Z: Elided trivial flatten
May 30, 2018 6:39:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:39:02.983Z: Elided trivial flatten
May 30, 2018 6:39:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:39:03.027Z: Elided trivial flatten
May 30, 2018 6:39:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:39:03.074Z: Unzipping flatten s24 for input s19.org.apache.beam.sdk.values.PCollection.<init>:329#8fd0f908e3ea90e3
May 30, 2018 6:39:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:39:03.112Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Reify, through flatten PAssert$33/GroupGlobally/FlattenDummyAndContents, into producer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map
May 30, 2018 6:39:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:39:03.159Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow into PAssert$33/GroupGlobally/GroupDummyAndContents/Read
May 30, 2018 6:39:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:39:03.207Z: Fusing consumer PAssert$33/GroupGlobally/ParDo(Concat) into PAssert$33/GroupGlobally/Values/Values/Map
May 30, 2018 6:39:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:39:03.256Z: Fusing consumer PAssert$33/GetPane/Map into PAssert$33/GroupGlobally/ParDo(Concat)
May 30, 2018 6:39:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:39:03.301Z: Fusing consumer PAssert$33/GroupGlobally/Values/Values/Map into PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow
May 30, 2018 6:39:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:39:03.347Z: Fusing consumer PAssert$33/RunChecks into PAssert$33/GetPane/Map
May 30, 2018 6:39:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:39:03.394Z: Fusing consumer PAssert$33/VerifyAssertions/ParDo(DefaultConclude) into PAssert$33/RunChecks
May 30, 2018 6:39:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:39:03.442Z: Unzipping flatten s24-u45 for input s26-reify-value18-c43
May 30, 2018 6:39:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:39:03.480Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Write, through flatten s24-u45, into producer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 30, 2018 6:39:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:39:03.524Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify into PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
May 30, 2018 6:39:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:39:03.572Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Write into PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 30, 2018 6:39:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:39:03.618Z: Fusing consumer PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)
May 30, 2018 6:39:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:39:03.663Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
May 30, 2018 6:39:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:39:03.707Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
May 30, 2018 6:39:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:39:03.753Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into PAssert$33/GroupGlobally/Window.Into()/Window.Assign
May 30, 2018 6:39:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:39:03.798Z: Fusing consumer OutputSideInputs into Create123/Read(CreateSource)
May 30, 2018 6:39:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:39:03.852Z: Fusing consumer PAssert$33/GroupGlobally/Window.Into()/Window.Assign into OutputSideInputs
May 30, 2018 6:39:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:39:03.896Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
May 30, 2018 6:39:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:39:03.942Z: Fusing consumer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map into PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
May 30, 2018 6:39:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:39:03.982Z: Fusing consumer PAssert$33/GroupGlobally/RewindowActuals/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map
May 30, 2018 6:39:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:39:04.029Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read
May 30, 2018 6:39:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:39:04.072Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
May 30, 2018 6:39:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:39:04.128Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
May 30, 2018 6:39:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:39:04.172Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
May 30, 2018 6:39:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:39:04.217Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
May 30, 2018 6:39:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:39:04.260Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
May 30, 2018 6:39:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:39:04.307Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into Create47/Read(CreateSource)
May 30, 2018 6:39:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:39:04.357Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
May 30, 2018 6:39:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:39:04.392Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
May 30, 2018 6:39:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:39:04.433Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
May 30, 2018 6:39:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:39:04.481Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
May 30, 2018 6:39:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:39:04.533Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
May 30, 2018 6:39:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:39:04.573Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
May 30, 2018 6:39:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:39:05.092Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Create
May 30, 2018 6:39:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:39:05.128Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Create
May 30, 2018 6:39:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:39:05.175Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
May 30, 2018 6:39:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:39:05.199Z: Starting 1 workers in us-central1-b...
May 30, 2018 6:39:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:39:05.214Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
May 30, 2018 6:39:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:39:05.555Z: Executing operation Create47/Read(CreateSource)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
May 30, 2018 6:39:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:39:05.601Z: Executing operation PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 30, 2018 6:39:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:39:14.961Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
May 30, 2018 6:39:47 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:39:46.867Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
May 30, 2018 6:39:47 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:39:46.909Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 30, 2018 6:40:03 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:40:02.688Z: Workers have started successfully.
May 30, 2018 6:40:29 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:40:29.098Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
May 30, 2018 6:40:29 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:40:29.204Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
May 30, 2018 6:40:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:40:36.981Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
May 30, 2018 6:40:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:40:37.093Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
May 30, 2018 6:40:50 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:40:50.215Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
May 30, 2018 6:40:50 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:40:50.379Z: Executing operation Create123/Read(CreateSource)+OutputSideInputs+PAssert$33/GroupGlobally/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write
May 30, 2018 6:40:56 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:40:53.689Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Close
May 30, 2018 6:40:56 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:40:53.815Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$33/GroupGlobally/RewindowActuals/Window.Assign+PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 30, 2018 6:41:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:40:58.401Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Close
May 30, 2018 6:41:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:40:58.510Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Read+PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$33/GroupGlobally/Values/Values/Map+PAssert$33/GroupGlobally/ParDo(Concat)+PAssert$33/GetPane/Map+PAssert$33/RunChecks+PAssert$33/VerifyAssertions/ParDo(DefaultConclude)
May 30, 2018 6:41:02 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:41:01.695Z: Cleaning up.
May 30, 2018 6:41:02 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:41:01.920Z: Stopping worker pool...
May 30, 2018 6:42:50 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:42:49.766Z: Autoscaling: Resized worker pool from 1 to 0.
May 30, 2018 6:42:50 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:42:49.816Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 30, 2018 6:42:50 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:42:49.879Z: Worker pool stopped.
May 30, 2018 6:42:58 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-05-30_11_38_48-8199330797739115718 finished with status DONE.
May 30, 2018 6:42:58 PM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-05-30_11_38_48-8199330797739115718. Found 1 success, 0 failures out of 1 expected assertions.
Gradle Test Executor 37 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest
209 tests completed, 34 failed, 2 skipped
Finished generating test XML results (0.599 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerTest>
Generating HTML test report...
Finished generating test html results (0.483 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest>
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest FAILED
:beam-runners-google-cloud-dataflow-java:validatesRunnerTest (Thread[Task worker for ':',5,main]) completed. Took 2 hrs 21 mins 50.367 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:validatesRunnerTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 23m 9s
38 actionable tasks: 35 executed, 3 from cache
Publishing build scan...
https://gradle.com/s/44ltotfy6fefo
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user katarzyna.kucharczyk@polidea.com
Not sending mail to unregistered user robbe.sneyders@ml6.eu
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user schroederc@google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user sidhom@google.com
Not sending mail to unregistered user cademarkegard@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ammons@google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Build failed in Jenkins:
beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #378
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/378/display/redirect?page=changes>
Changes:
[kenn] Add equals, hashCode, and structuralValue to Nexmark model objects
[cademarkegard] fix errorprone annotations and enable failOnWarning
------------------------------------------
[...truncated 18.40 MB...]
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map as step s17
May 30, 2018 4:15:25 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RewindowActuals/Window.Assign as step s18
May 30, 2018 4:15:25 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map as step s19
May 30, 2018 4:15:25 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveActualsTriggering/Flatten.PCollections as step s20
May 30, 2018 4:15:25 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Create.Values/Read(CreateSource) as step s21
May 30, 2018 4:15:25 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign as step s22
May 30, 2018 4:15:25 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveDummyTriggering/Flatten.PCollections as step s23
May 30, 2018 4:15:25 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/FlattenDummyAndContents as step s24
May 30, 2018 4:15:25 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/NeverTrigger/Flatten.PCollections as step s25
May 30, 2018 4:15:25 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GroupDummyAndContents as step s26
May 30, 2018 4:15:25 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Values/Values/Map as step s27
May 30, 2018 4:15:25 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/ParDo(Concat) as step s28
May 30, 2018 4:15:25 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GetPane/Map as step s29
May 30, 2018 4:15:25 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/RunChecks as step s30
May 30, 2018 4:15:25 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/VerifyAssertions/ParDo(DefaultConclude) as step s31
May 30, 2018 4:15:25 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0530161523-ca7e1bed/output/results/staging/
May 30, 2018 4:15:26 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <71120 bytes, hash AUBBMuZMFnr3SgunDTJxTw> to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0530161523-ca7e1bed/output/results/staging/pipeline-AUBBMuZMFnr3SgunDTJxTw.pb
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 30, 2018 4:15:27 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-05-30_09_15_26-11653205633351778737?project=apache-beam-testing
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Submitted job: 2018-05-30_09_15_26-11653205633351778737
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 30, 2018 4:15:27 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-05-30_09_15_26-11653205633351778737
May 30, 2018 4:15:27 PM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-05-30_09_15_26-11653205633351778737 with 1 expected assertions.
May 30, 2018 4:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:15:26.583Z: Autoscaling is enabled for job 2018-05-30_09_15_26-11653205633351778737. The number of workers will be between 1 and 1000.
May 30, 2018 4:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:15:26.623Z: Autoscaling was automatically enabled for job 2018-05-30_09_15_26-11653205633351778737.
May 30, 2018 4:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:15:29.156Z: Checking required Cloud APIs are enabled.
May 30, 2018 4:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:15:29.369Z: Checking permissions granted to controller Service Account.
May 30, 2018 4:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:15:33.392Z: Worker configuration: n1-standard-1 in us-central1-b.
May 30, 2018 4:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:15:33.865Z: Expanding CoGroupByKey operations into optimizable parts.
May 30, 2018 4:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:15:34.028Z: Expanding GroupByKey operations into optimizable parts.
May 30, 2018 4:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:15:34.076Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
May 30, 2018 4:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:15:34.313Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
May 30, 2018 4:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:15:34.364Z: Elided trivial flatten
May 30, 2018 4:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:15:34.395Z: Elided trivial flatten
May 30, 2018 4:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:15:34.441Z: Elided trivial flatten
May 30, 2018 4:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:15:34.489Z: Unzipping flatten s24 for input s19.org.apache.beam.sdk.values.PCollection.<init>:329#8fd0f908e3ea90e3
May 30, 2018 4:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:15:34.534Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Reify, through flatten PAssert$33/GroupGlobally/FlattenDummyAndContents, into producer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map
May 30, 2018 4:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:15:34.573Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow into PAssert$33/GroupGlobally/GroupDummyAndContents/Read
May 30, 2018 4:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:15:34.621Z: Fusing consumer PAssert$33/GroupGlobally/ParDo(Concat) into PAssert$33/GroupGlobally/Values/Values/Map
May 30, 2018 4:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:15:34.666Z: Fusing consumer PAssert$33/GetPane/Map into PAssert$33/GroupGlobally/ParDo(Concat)
May 30, 2018 4:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:15:34.705Z: Fusing consumer PAssert$33/GroupGlobally/Values/Values/Map into PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow
May 30, 2018 4:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:15:34.745Z: Fusing consumer PAssert$33/RunChecks into PAssert$33/GetPane/Map
May 30, 2018 4:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:15:34.783Z: Fusing consumer PAssert$33/VerifyAssertions/ParDo(DefaultConclude) into PAssert$33/RunChecks
May 30, 2018 4:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:15:34.821Z: Unzipping flatten s24-u45 for input s26-reify-value18-c43
May 30, 2018 4:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:15:34.866Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Write, through flatten s24-u45, into producer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 30, 2018 4:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:15:34.910Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify into PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
May 30, 2018 4:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:15:34.961Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Write into PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 30, 2018 4:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:15:35.001Z: Fusing consumer PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)
May 30, 2018 4:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:15:35.047Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
May 30, 2018 4:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:15:35.095Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
May 30, 2018 4:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:15:35.142Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into PAssert$33/GroupGlobally/Window.Into()/Window.Assign
May 30, 2018 4:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:15:35.194Z: Fusing consumer OutputSideInputs into Create123/Read(CreateSource)
May 30, 2018 4:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:15:35.232Z: Fusing consumer PAssert$33/GroupGlobally/Window.Into()/Window.Assign into OutputSideInputs
May 30, 2018 4:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:15:35.276Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
May 30, 2018 4:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:15:35.322Z: Fusing consumer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map into PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
May 30, 2018 4:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:15:35.375Z: Fusing consumer PAssert$33/GroupGlobally/RewindowActuals/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map
May 30, 2018 4:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:15:35.418Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read
May 30, 2018 4:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:15:35.458Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
May 30, 2018 4:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:15:35.506Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
May 30, 2018 4:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:15:35.555Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
May 30, 2018 4:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:15:35.594Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
May 30, 2018 4:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:15:35.632Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
May 30, 2018 4:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:15:35.677Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into Create47/Read(CreateSource)
May 30, 2018 4:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:15:35.725Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
May 30, 2018 4:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:15:35.770Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
May 30, 2018 4:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:15:35.819Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
May 30, 2018 4:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:15:35.867Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
May 30, 2018 4:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:15:35.908Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
May 30, 2018 4:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:15:35.956Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
May 30, 2018 4:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:15:36.444Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Create
May 30, 2018 4:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:15:36.481Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Create
May 30, 2018 4:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:15:36.515Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
May 30, 2018 4:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:15:36.553Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
May 30, 2018 4:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:15:36.553Z: Starting 1 workers in us-central1-b...
May 30, 2018 4:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:15:36.856Z: Executing operation PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 30, 2018 4:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:15:36.913Z: Executing operation Create47/Read(CreateSource)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
May 30, 2018 4:15:46 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:15:44.558Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
May 30, 2018 4:15:56 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:15:55.178Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
May 30, 2018 4:15:56 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:15:55.219Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 30, 2018 4:16:21 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:16:18.625Z: Workers have started successfully.
May 30, 2018 4:16:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:16:43.715Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
May 30, 2018 4:16:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:16:43.801Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
May 30, 2018 4:16:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:16:50.085Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
May 30, 2018 4:16:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:16:50.172Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
May 30, 2018 4:17:02 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:17:01.922Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
May 30, 2018 4:17:02 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:17:02.102Z: Executing operation Create123/Read(CreateSource)+OutputSideInputs+PAssert$33/GroupGlobally/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write
May 30, 2018 4:17:07 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:17:06.630Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Close
May 30, 2018 4:17:07 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:17:06.768Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$33/GroupGlobally/RewindowActuals/Window.Assign+PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 30, 2018 4:17:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:17:10.758Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Close
May 30, 2018 4:17:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:17:10.829Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Read+PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$33/GroupGlobally/Values/Values/Map+PAssert$33/GroupGlobally/ParDo(Concat)+PAssert$33/GetPane/Map+PAssert$33/RunChecks+PAssert$33/VerifyAssertions/ParDo(DefaultConclude)
May 30, 2018 4:17:15 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:17:15.041Z: Cleaning up.
May 30, 2018 4:17:15 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:17:15.112Z: Stopping worker pool...
May 30, 2018 4:19:24 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:19:23.126Z: Autoscaling: Resized worker pool from 1 to 0.
May 30, 2018 4:19:24 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:19:23.257Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 30, 2018 4:19:31 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-05-30_09_15_26-11653205633351778737 finished with status DONE.
May 30, 2018 4:19:31 PM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-05-30_09_15_26-11653205633351778737. Found 1 success, 0 failures out of 1 expected assertions.
Gradle Test Executor 40 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest
209 tests completed, 34 failed, 2 skipped
Finished generating test XML results (0.73 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerTest>
Generating HTML test report...
Finished generating test html results (0.505 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest>
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest FAILED
:beam-runners-google-cloud-dataflow-java:validatesRunnerTest (Thread[Task worker for ':' Thread 15,5,main]) completed. Took 2 hrs 10 mins 4.051 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:validatesRunnerTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 11m 6s
38 actionable tasks: 34 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/l2et2kxd76sue
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user katarzyna.kucharczyk@polidea.com
Not sending mail to unregistered user robbe.sneyders@ml6.eu
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user schroederc@google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user sidhom@google.com
Not sending mail to unregistered user cademarkegard@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ammons@google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Build failed in Jenkins:
beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #377
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/377/display/redirect>
------------------------------------------
[...truncated 18.11 MB...]
May 30, 2018 2:04:55 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RewindowActuals/Window.Assign as step s18
May 30, 2018 2:04:55 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map as step s19
May 30, 2018 2:04:55 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveActualsTriggering/Flatten.PCollections as step s20
May 30, 2018 2:04:55 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Create.Values/Read(CreateSource) as step s21
May 30, 2018 2:04:55 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign as step s22
May 30, 2018 2:04:55 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveDummyTriggering/Flatten.PCollections as step s23
May 30, 2018 2:04:55 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/FlattenDummyAndContents as step s24
May 30, 2018 2:04:55 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/NeverTrigger/Flatten.PCollections as step s25
May 30, 2018 2:04:55 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GroupDummyAndContents as step s26
May 30, 2018 2:04:55 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Values/Values/Map as step s27
May 30, 2018 2:04:55 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/ParDo(Concat) as step s28
May 30, 2018 2:04:55 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GetPane/Map as step s29
May 30, 2018 2:04:55 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/RunChecks as step s30
May 30, 2018 2:04:55 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/VerifyAssertions/ParDo(DefaultConclude) as step s31
May 30, 2018 2:04:55 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0530140451-6aa55bca/output/results/staging/
May 30, 2018 2:04:55 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <71120 bytes, hash -0IZduv5cekB6xlZbFYW1A> to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0530140451-6aa55bca/output/results/staging/pipeline--0IZduv5cekB6xlZbFYW1A.pb
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 30, 2018 2:04:57 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-05-30_07_04_55-2692407867062046058?project=apache-beam-testing
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Submitted job: 2018-05-30_07_04_55-2692407867062046058
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 30, 2018 2:04:57 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-05-30_07_04_55-2692407867062046058
May 30, 2018 2:04:57 PM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-05-30_07_04_55-2692407867062046058 with 1 expected assertions.
May 30, 2018 2:05:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:04:55.971Z: Autoscaling is enabled for job 2018-05-30_07_04_55-2692407867062046058. The number of workers will be between 1 and 1000.
May 30, 2018 2:05:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:04:56.012Z: Autoscaling was automatically enabled for job 2018-05-30_07_04_55-2692407867062046058.
May 30, 2018 2:05:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:04:59.476Z: Checking required Cloud APIs are enabled.
May 30, 2018 2:05:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:04:59.931Z: Checking permissions granted to controller Service Account.
May 30, 2018 2:05:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:05:03.841Z: Worker configuration: n1-standard-1 in us-central1-b.
May 30, 2018 2:05:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:05:04.258Z: Expanding CoGroupByKey operations into optimizable parts.
May 30, 2018 2:05:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:05:04.427Z: Expanding GroupByKey operations into optimizable parts.
May 30, 2018 2:05:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:05:04.467Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
May 30, 2018 2:05:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:05:04.705Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
May 30, 2018 2:05:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:05:04.756Z: Elided trivial flatten
May 30, 2018 2:05:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:05:04.802Z: Elided trivial flatten
May 30, 2018 2:05:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:05:04.847Z: Elided trivial flatten
May 30, 2018 2:05:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:05:04.897Z: Unzipping flatten s24 for input s19.org.apache.beam.sdk.values.PCollection.<init>:329#8fd0f908e3ea90e3
May 30, 2018 2:05:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:05:04.942Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Reify, through flatten PAssert$33/GroupGlobally/FlattenDummyAndContents, into producer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map
May 30, 2018 2:05:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:05:04.977Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow into PAssert$33/GroupGlobally/GroupDummyAndContents/Read
May 30, 2018 2:05:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:05:05.026Z: Fusing consumer PAssert$33/GroupGlobally/ParDo(Concat) into PAssert$33/GroupGlobally/Values/Values/Map
May 30, 2018 2:05:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:05:05.073Z: Fusing consumer PAssert$33/GetPane/Map into PAssert$33/GroupGlobally/ParDo(Concat)
May 30, 2018 2:05:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:05:05.119Z: Fusing consumer PAssert$33/GroupGlobally/Values/Values/Map into PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow
May 30, 2018 2:05:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:05:05.167Z: Fusing consumer PAssert$33/RunChecks into PAssert$33/GetPane/Map
May 30, 2018 2:05:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:05:05.214Z: Fusing consumer PAssert$33/VerifyAssertions/ParDo(DefaultConclude) into PAssert$33/RunChecks
May 30, 2018 2:05:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:05:05.241Z: Unzipping flatten s24-u45 for input s26-reify-value18-c43
May 30, 2018 2:05:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:05:05.289Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Write, through flatten s24-u45, into producer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 30, 2018 2:05:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:05:05.325Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify into PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
May 30, 2018 2:05:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:05:05.368Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Write into PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 30, 2018 2:05:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:05:05.417Z: Fusing consumer PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)
May 30, 2018 2:05:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:05:05.464Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
May 30, 2018 2:05:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:05:05.512Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
May 30, 2018 2:05:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:05:05.558Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into PAssert$33/GroupGlobally/Window.Into()/Window.Assign
May 30, 2018 2:05:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:05:05.593Z: Fusing consumer OutputSideInputs into Create123/Read(CreateSource)
May 30, 2018 2:05:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:05:05.631Z: Fusing consumer PAssert$33/GroupGlobally/Window.Into()/Window.Assign into OutputSideInputs
May 30, 2018 2:05:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:05:05.671Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
May 30, 2018 2:05:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:05:05.718Z: Fusing consumer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map into PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
May 30, 2018 2:05:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:05:05.752Z: Fusing consumer PAssert$33/GroupGlobally/RewindowActuals/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map
May 30, 2018 2:05:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:05:05.793Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read
May 30, 2018 2:05:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:05:05.838Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
May 30, 2018 2:05:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:05:05.886Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
May 30, 2018 2:05:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:05:05.935Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
May 30, 2018 2:05:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:05:05.973Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
May 30, 2018 2:05:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:05:06.024Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
May 30, 2018 2:05:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:05:06.067Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into Create47/Read(CreateSource)
May 30, 2018 2:05:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:05:06.108Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
May 30, 2018 2:05:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:05:06.151Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
May 30, 2018 2:05:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:05:06.191Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
May 30, 2018 2:05:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:05:06.236Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
May 30, 2018 2:05:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:05:06.281Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
May 30, 2018 2:05:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:05:06.321Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
May 30, 2018 2:05:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:05:06.796Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Create
May 30, 2018 2:05:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:05:06.831Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Create
May 30, 2018 2:05:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:05:06.869Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
May 30, 2018 2:05:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:05:06.885Z: Starting 1 workers in us-central1-b...
May 30, 2018 2:05:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:05:06.907Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
May 30, 2018 2:05:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:05:07.120Z: Executing operation Create47/Read(CreateSource)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
May 30, 2018 2:05:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:05:07.155Z: Executing operation PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 30, 2018 2:05:15 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:05:14.756Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
May 30, 2018 2:05:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:05:25.393Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
May 30, 2018 2:05:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:05:25.436Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 30, 2018 2:05:47 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:05:46.461Z: Workers have started successfully.
May 30, 2018 2:05:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:05:58.700Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
May 30, 2018 2:05:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:05:58.805Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
May 30, 2018 2:06:06 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:06:05.565Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
May 30, 2018 2:06:06 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:06:05.674Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
May 30, 2018 2:06:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:06:16.957Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
May 30, 2018 2:06:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:06:17.137Z: Executing operation Create123/Read(CreateSource)+OutputSideInputs+PAssert$33/GroupGlobally/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write
May 30, 2018 2:06:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:06:22.558Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Close
May 30, 2018 2:06:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:06:22.663Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$33/GroupGlobally/RewindowActuals/Window.Assign+PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 30, 2018 2:06:29 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:06:27.304Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Close
May 30, 2018 2:06:29 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:06:27.408Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Read+PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$33/GroupGlobally/Values/Values/Map+PAssert$33/GroupGlobally/ParDo(Concat)+PAssert$33/GetPane/Map+PAssert$33/RunChecks+PAssert$33/VerifyAssertions/ParDo(DefaultConclude)
May 30, 2018 2:06:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:06:30.839Z: Cleaning up.
May 30, 2018 2:06:33 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:06:30.973Z: Stopping worker pool...
May 30, 2018 2:07:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:07:58.253Z: Autoscaling: Resized worker pool from 1 to 0.
May 30, 2018 2:07:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:07:58.279Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 30, 2018 2:07:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:07:58.313Z: Worker pool stopped.
May 30, 2018 2:08:06 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-05-30_07_04_55-2692407867062046058 finished with status DONE.
May 30, 2018 2:08:06 PM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-05-30_07_04_55-2692407867062046058. Found 1 success, 0 failures out of 1 expected assertions.
Gradle Test Executor 38 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest
209 tests completed, 34 failed, 2 skipped
Finished generating test XML results (0.535 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerTest>
Generating HTML test report...
Finished generating test html results (0.747 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest>
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest FAILED
:beam-runners-google-cloud-dataflow-java:validatesRunnerTest (Thread[Task worker for ':' Thread 29,5,main]) completed. Took 2 hrs 6 mins 31.99 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:validatesRunnerTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 7m 37s
38 actionable tasks: 34 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/cb54uutb3ovke
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user katarzyna.kucharczyk@polidea.com
Not sending mail to unregistered user robbe.sneyders@ml6.eu
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user schroederc@google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user sidhom@google.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ammons@google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Build failed in Jenkins:
beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #376
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/376/display/redirect?page=changes>
Changes:
[timrobertson100] [BEAM-4389] Enable partial updates in ElasticsearchIO
------------------------------------------
[...truncated 18.07 MB...]
May 30, 2018 10:14:15 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map as step s17
May 30, 2018 10:14:15 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RewindowActuals/Window.Assign as step s18
May 30, 2018 10:14:15 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map as step s19
May 30, 2018 10:14:15 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveActualsTriggering/Flatten.PCollections as step s20
May 30, 2018 10:14:15 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Create.Values/Read(CreateSource) as step s21
May 30, 2018 10:14:15 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign as step s22
May 30, 2018 10:14:15 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveDummyTriggering/Flatten.PCollections as step s23
May 30, 2018 10:14:15 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/FlattenDummyAndContents as step s24
May 30, 2018 10:14:15 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/NeverTrigger/Flatten.PCollections as step s25
May 30, 2018 10:14:15 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GroupDummyAndContents as step s26
May 30, 2018 10:14:15 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Values/Values/Map as step s27
May 30, 2018 10:14:15 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/ParDo(Concat) as step s28
May 30, 2018 10:14:15 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GetPane/Map as step s29
May 30, 2018 10:14:15 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/RunChecks as step s30
May 30, 2018 10:14:15 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/VerifyAssertions/ParDo(DefaultConclude) as step s31
May 30, 2018 10:14:15 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0530101410-4bacc57d/output/results/staging/
May 30, 2018 10:14:16 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <71120 bytes, hash GNGMtNFRhnRtQRBFqffYhg> to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0530101410-4bacc57d/output/results/staging/pipeline-GNGMtNFRhnRtQRBFqffYhg.pb
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 30, 2018 10:14:17 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-05-30_03_14_16-10078343783506532308?project=apache-beam-testing
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Submitted job: 2018-05-30_03_14_16-10078343783506532308
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 30, 2018 10:14:17 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-05-30_03_14_16-10078343783506532308
May 30, 2018 10:14:17 AM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-05-30_03_14_16-10078343783506532308 with 1 expected assertions.
May 30, 2018 10:14:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:14:16.623Z: Autoscaling is enabled for job 2018-05-30_03_14_16-10078343783506532308. The number of workers will be between 1 and 1000.
May 30, 2018 10:14:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:14:16.663Z: Autoscaling was automatically enabled for job 2018-05-30_03_14_16-10078343783506532308.
May 30, 2018 10:14:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:14:19.350Z: Checking required Cloud APIs are enabled.
May 30, 2018 10:14:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:14:19.541Z: Checking permissions granted to controller Service Account.
May 30, 2018 10:14:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:14:25.982Z: Worker configuration: n1-standard-1 in us-central1-b.
May 30, 2018 10:14:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:14:26.408Z: Expanding CoGroupByKey operations into optimizable parts.
May 30, 2018 10:14:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:14:26.585Z: Expanding GroupByKey operations into optimizable parts.
May 30, 2018 10:14:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:14:26.622Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
May 30, 2018 10:14:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:14:26.848Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
May 30, 2018 10:14:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:14:26.893Z: Elided trivial flatten
May 30, 2018 10:14:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:14:26.930Z: Elided trivial flatten
May 30, 2018 10:14:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:14:26.972Z: Elided trivial flatten
May 30, 2018 10:14:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:14:27.014Z: Unzipping flatten s24 for input s19.org.apache.beam.sdk.values.PCollection.<init>:329#8fd0f908e3ea90e3
May 30, 2018 10:14:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:14:27.056Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Reify, through flatten PAssert$33/GroupGlobally/FlattenDummyAndContents, into producer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map
May 30, 2018 10:14:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:14:27.101Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow into PAssert$33/GroupGlobally/GroupDummyAndContents/Read
May 30, 2018 10:14:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:14:27.146Z: Fusing consumer PAssert$33/GroupGlobally/ParDo(Concat) into PAssert$33/GroupGlobally/Values/Values/Map
May 30, 2018 10:14:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:14:27.186Z: Fusing consumer PAssert$33/GetPane/Map into PAssert$33/GroupGlobally/ParDo(Concat)
May 30, 2018 10:14:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:14:27.230Z: Fusing consumer PAssert$33/GroupGlobally/Values/Values/Map into PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow
May 30, 2018 10:14:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:14:27.268Z: Fusing consumer PAssert$33/RunChecks into PAssert$33/GetPane/Map
May 30, 2018 10:14:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:14:27.312Z: Fusing consumer PAssert$33/VerifyAssertions/ParDo(DefaultConclude) into PAssert$33/RunChecks
May 30, 2018 10:14:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:14:27.357Z: Unzipping flatten s24-u45 for input s26-reify-value18-c43
May 30, 2018 10:14:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:14:27.401Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Write, through flatten s24-u45, into producer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 30, 2018 10:14:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:14:27.428Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify into PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
May 30, 2018 10:14:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:14:27.475Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Write into PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 30, 2018 10:14:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:14:27.519Z: Fusing consumer PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)
May 30, 2018 10:14:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:14:27.556Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
May 30, 2018 10:14:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:14:27.600Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
May 30, 2018 10:14:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:14:27.645Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into PAssert$33/GroupGlobally/Window.Into()/Window.Assign
May 30, 2018 10:14:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:14:27.688Z: Fusing consumer OutputSideInputs into Create123/Read(CreateSource)
May 30, 2018 10:14:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:14:27.731Z: Fusing consumer PAssert$33/GroupGlobally/Window.Into()/Window.Assign into OutputSideInputs
May 30, 2018 10:14:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:14:27.771Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
May 30, 2018 10:14:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:14:27.814Z: Fusing consumer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map into PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
May 30, 2018 10:14:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:14:27.857Z: Fusing consumer PAssert$33/GroupGlobally/RewindowActuals/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map
May 30, 2018 10:14:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:14:27.895Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read
May 30, 2018 10:14:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:14:27.939Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
May 30, 2018 10:14:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:14:27.984Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
May 30, 2018 10:14:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:14:28.030Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
May 30, 2018 10:14:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:14:28.075Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
May 30, 2018 10:14:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:14:28.127Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
May 30, 2018 10:14:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:14:28.169Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into Create47/Read(CreateSource)
May 30, 2018 10:14:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:14:28.203Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
May 30, 2018 10:14:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:14:28.247Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
May 30, 2018 10:14:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:14:28.286Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
May 30, 2018 10:14:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:14:28.329Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
May 30, 2018 10:14:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:14:28.367Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
May 30, 2018 10:14:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:14:28.397Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
May 30, 2018 10:14:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:14:28.841Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Create
May 30, 2018 10:14:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:14:28.880Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Create
May 30, 2018 10:14:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:14:28.923Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
May 30, 2018 10:14:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:14:28.938Z: Starting 1 workers in us-central1-b...
May 30, 2018 10:14:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:14:28.965Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
May 30, 2018 10:14:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:14:29.186Z: Executing operation PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 30, 2018 10:14:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:14:29.227Z: Executing operation Create47/Read(CreateSource)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
May 30, 2018 10:14:40 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:14:39.128Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
May 30, 2018 10:14:55 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:14:55.020Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
May 30, 2018 10:14:55 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:14:55.056Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 30, 2018 10:15:15 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:15:14.935Z: Workers have started successfully.
May 30, 2018 10:15:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:15:33.746Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
May 30, 2018 10:15:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:15:33.816Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
May 30, 2018 10:15:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:15:36.627Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
May 30, 2018 10:15:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:15:36.705Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
May 30, 2018 10:15:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:15:52.221Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
May 30, 2018 10:15:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:15:52.404Z: Executing operation Create123/Read(CreateSource)+OutputSideInputs+PAssert$33/GroupGlobally/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write
May 30, 2018 10:15:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:15:56.473Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Close
May 30, 2018 10:15:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:15:56.569Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$33/GroupGlobally/RewindowActuals/Window.Assign+PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 30, 2018 10:16:01 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:16:01.121Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Close
May 30, 2018 10:16:01 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:16:01.207Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Read+PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$33/GroupGlobally/Values/Values/Map+PAssert$33/GroupGlobally/ParDo(Concat)+PAssert$33/GetPane/Map+PAssert$33/RunChecks+PAssert$33/VerifyAssertions/ParDo(DefaultConclude)
May 30, 2018 10:16:04 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:16:04.316Z: Cleaning up.
May 30, 2018 10:16:04 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:16:04.427Z: Stopping worker pool...
May 30, 2018 10:17:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:17:34.481Z: Autoscaling: Resized worker pool from 1 to 0.
May 30, 2018 10:17:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:17:34.523Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 30, 2018 10:17:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:17:34.577Z: Worker pool stopped.
May 30, 2018 10:17:44 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-05-30_03_14_16-10078343783506532308 finished with status DONE.
May 30, 2018 10:17:44 AM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-05-30_03_14_16-10078343783506532308. Found 1 success, 0 failures out of 1 expected assertions.
Gradle Test Executor 37 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest FAILED
209 tests completed, 34 failed, 2 skipped
Finished generating test XML results (0.217 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerTest>
Generating HTML test report...
Finished generating test html results (0.367 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest>
:beam-runners-google-cloud-dataflow-java:validatesRunnerTest (Thread[Task worker for ':' Thread 13,5,main]) completed. Took 2 hrs 6 mins 19.834 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:validatesRunnerTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 7m 10s
38 actionable tasks: 34 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/vesy4q4aeuqg4
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user katarzyna.kucharczyk@polidea.com
Not sending mail to unregistered user robbe.sneyders@ml6.eu
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user schroederc@google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user sidhom@google.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ammons@google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Build failed in Jenkins:
beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #375
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/375/display/redirect>
------------------------------------------
[...truncated 18.08 MB...]
May 30, 2018 8:06:37 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RewindowActuals/Window.Assign as step s18
May 30, 2018 8:06:37 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map as step s19
May 30, 2018 8:06:37 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveActualsTriggering/Flatten.PCollections as step s20
May 30, 2018 8:06:37 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Create.Values/Read(CreateSource) as step s21
May 30, 2018 8:06:37 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign as step s22
May 30, 2018 8:06:37 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveDummyTriggering/Flatten.PCollections as step s23
May 30, 2018 8:06:37 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/FlattenDummyAndContents as step s24
May 30, 2018 8:06:37 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/NeverTrigger/Flatten.PCollections as step s25
May 30, 2018 8:06:37 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GroupDummyAndContents as step s26
May 30, 2018 8:06:37 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Values/Values/Map as step s27
May 30, 2018 8:06:37 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/ParDo(Concat) as step s28
May 30, 2018 8:06:37 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GetPane/Map as step s29
May 30, 2018 8:06:37 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/RunChecks as step s30
May 30, 2018 8:06:37 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/VerifyAssertions/ParDo(DefaultConclude) as step s31
May 30, 2018 8:06:37 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0530080632-3f02cf21/output/results/staging/
May 30, 2018 8:06:37 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <71120 bytes, hash rcye9WJJfznqKATLeS6fGQ> to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0530080632-3f02cf21/output/results/staging/pipeline-rcye9WJJfznqKATLeS6fGQ.pb
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 30, 2018 8:06:38 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-05-30_01_06_37-15476053250376096158?project=apache-beam-testing
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Submitted job: 2018-05-30_01_06_37-15476053250376096158
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 30, 2018 8:06:38 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-05-30_01_06_37-15476053250376096158
May 30, 2018 8:06:38 AM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-05-30_01_06_37-15476053250376096158 with 1 expected assertions.
May 30, 2018 8:06:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:06:37.959Z: Autoscaling is enabled for job 2018-05-30_01_06_37-15476053250376096158. The number of workers will be between 1 and 1000.
May 30, 2018 8:06:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:06:37.994Z: Autoscaling was automatically enabled for job 2018-05-30_01_06_37-15476053250376096158.
May 30, 2018 8:06:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:06:40.759Z: Checking required Cloud APIs are enabled.
May 30, 2018 8:06:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:06:41.022Z: Checking permissions granted to controller Service Account.
May 30, 2018 8:06:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:06:47.288Z: Worker configuration: n1-standard-1 in us-central1-b.
May 30, 2018 8:06:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:06:48.009Z: Expanding CoGroupByKey operations into optimizable parts.
May 30, 2018 8:06:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:06:48.178Z: Expanding GroupByKey operations into optimizable parts.
May 30, 2018 8:06:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:06:48.220Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
May 30, 2018 8:06:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:06:48.441Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
May 30, 2018 8:06:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:06:48.484Z: Elided trivial flatten
May 30, 2018 8:06:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:06:48.531Z: Elided trivial flatten
May 30, 2018 8:06:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:06:48.581Z: Elided trivial flatten
May 30, 2018 8:06:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:06:48.630Z: Unzipping flatten s24 for input s19.org.apache.beam.sdk.values.PCollection.<init>:329#8fd0f908e3ea90e3
May 30, 2018 8:06:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:06:48.677Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Reify, through flatten PAssert$33/GroupGlobally/FlattenDummyAndContents, into producer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map
May 30, 2018 8:06:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:06:48.725Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow into PAssert$33/GroupGlobally/GroupDummyAndContents/Read
May 30, 2018 8:06:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:06:48.760Z: Fusing consumer PAssert$33/GroupGlobally/ParDo(Concat) into PAssert$33/GroupGlobally/Values/Values/Map
May 30, 2018 8:06:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:06:48.806Z: Fusing consumer PAssert$33/GetPane/Map into PAssert$33/GroupGlobally/ParDo(Concat)
May 30, 2018 8:06:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:06:48.855Z: Fusing consumer PAssert$33/GroupGlobally/Values/Values/Map into PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow
May 30, 2018 8:06:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:06:48.904Z: Fusing consumer PAssert$33/RunChecks into PAssert$33/GetPane/Map
May 30, 2018 8:06:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:06:48.950Z: Fusing consumer PAssert$33/VerifyAssertions/ParDo(DefaultConclude) into PAssert$33/RunChecks
May 30, 2018 8:06:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:06:48.989Z: Unzipping flatten s24-u45 for input s26-reify-value18-c43
May 30, 2018 8:06:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:06:49.034Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Write, through flatten s24-u45, into producer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 30, 2018 8:06:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:06:49.073Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify into PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
May 30, 2018 8:06:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:06:49.121Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Write into PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 30, 2018 8:06:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:06:49.157Z: Fusing consumer PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)
May 30, 2018 8:06:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:06:49.193Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
May 30, 2018 8:06:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:06:49.240Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
May 30, 2018 8:06:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:06:49.288Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into PAssert$33/GroupGlobally/Window.Into()/Window.Assign
May 30, 2018 8:06:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:06:49.326Z: Fusing consumer OutputSideInputs into Create123/Read(CreateSource)
May 30, 2018 8:06:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:06:49.373Z: Fusing consumer PAssert$33/GroupGlobally/Window.Into()/Window.Assign into OutputSideInputs
May 30, 2018 8:06:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:06:49.418Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
May 30, 2018 8:06:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:06:49.457Z: Fusing consumer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map into PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
May 30, 2018 8:06:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:06:49.497Z: Fusing consumer PAssert$33/GroupGlobally/RewindowActuals/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map
May 30, 2018 8:06:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:06:49.526Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read
May 30, 2018 8:06:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:06:49.569Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
May 30, 2018 8:06:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:06:49.616Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
May 30, 2018 8:06:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:06:49.659Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
May 30, 2018 8:06:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:06:49.692Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
May 30, 2018 8:06:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:06:49.728Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
May 30, 2018 8:06:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:06:49.773Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into Create47/Read(CreateSource)
May 30, 2018 8:06:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:06:49.808Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
May 30, 2018 8:06:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:06:49.853Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
May 30, 2018 8:06:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:06:49.900Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
May 30, 2018 8:06:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:06:49.944Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
May 30, 2018 8:06:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:06:49.988Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
May 30, 2018 8:06:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:06:50.022Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
May 30, 2018 8:06:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:06:50.483Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Create
May 30, 2018 8:06:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:06:50.528Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Create
May 30, 2018 8:06:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:06:50.578Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
May 30, 2018 8:06:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:06:50.589Z: Starting 1 workers in us-central1-b...
May 30, 2018 8:06:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:06:50.623Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
May 30, 2018 8:06:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:06:50.879Z: Executing operation Create47/Read(CreateSource)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
May 30, 2018 8:06:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:06:50.926Z: Executing operation PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 30, 2018 8:07:00 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:07:00.230Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
May 30, 2018 8:07:11 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:07:10.830Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
May 30, 2018 8:07:11 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:07:10.872Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 30, 2018 8:07:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:07:33.216Z: Workers have started successfully.
May 30, 2018 8:07:59 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:07:57.756Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
May 30, 2018 8:07:59 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:07:57.839Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
May 30, 2018 8:08:01 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:08:01.342Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
May 30, 2018 8:08:01 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:08:01.436Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
May 30, 2018 8:08:24 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:08:22.893Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
May 30, 2018 8:08:24 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:08:23.089Z: Executing operation Create123/Read(CreateSource)+OutputSideInputs+PAssert$33/GroupGlobally/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write
May 30, 2018 8:08:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:08:30.743Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Close
May 30, 2018 8:08:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:08:30.842Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$33/GroupGlobally/RewindowActuals/Window.Assign+PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 30, 2018 8:08:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:08:35.568Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Close
May 30, 2018 8:08:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:08:35.660Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Read+PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$33/GroupGlobally/Values/Values/Map+PAssert$33/GroupGlobally/ParDo(Concat)+PAssert$33/GetPane/Map+PAssert$33/RunChecks+PAssert$33/VerifyAssertions/ParDo(DefaultConclude)
May 30, 2018 8:08:40 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:08:38.850Z: Cleaning up.
May 30, 2018 8:08:40 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:08:38.954Z: Stopping worker pool...
May 30, 2018 8:10:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:10:07.034Z: Autoscaling: Resized worker pool from 1 to 0.
May 30, 2018 8:10:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:10:07.079Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 30, 2018 8:10:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:10:07.129Z: Worker pool stopped.
May 30, 2018 8:10:15 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-05-30_01_06_37-15476053250376096158 finished with status DONE.
May 30, 2018 8:10:15 AM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-05-30_01_06_37-15476053250376096158. Found 1 success, 0 failures out of 1 expected assertions.
Gradle Test Executor 39 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest
209 tests completed, 34 failed, 2 skipped
Finished generating test XML results (0.457 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerTest>
Generating HTML test report...
Finished generating test html results (0.644 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest>
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest FAILED
:beam-runners-google-cloud-dataflow-java:validatesRunnerTest (Thread[Task worker for ':' Thread 14,5,main]) completed. Took 2 hrs 8 mins 24.4 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:validatesRunnerTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 9m 39s
38 actionable tasks: 34 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/xwqdjny2rv264
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user katarzyna.kucharczyk@polidea.com
Not sending mail to unregistered user robbe.sneyders@ml6.eu
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user schroederc@google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user sidhom@google.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ammons@google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Build failed in Jenkins:
beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #374
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/374/display/redirect?page=changes>
Changes:
[github] Make hash function in Coder base class more conservative.
[Pablo] [BEAM-4426]: Addressed DataflowDistributionAccumulatorTest failure on
[aaltay] Support installing Beam SDK from a wheel distribution in SDK containers.
------------------------------------------
[...truncated 18.08 MB...]
May 30, 2018 2:43:37 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map as step s17
May 30, 2018 2:43:37 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RewindowActuals/Window.Assign as step s18
May 30, 2018 2:43:37 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map as step s19
May 30, 2018 2:43:37 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveActualsTriggering/Flatten.PCollections as step s20
May 30, 2018 2:43:37 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Create.Values/Read(CreateSource) as step s21
May 30, 2018 2:43:37 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign as step s22
May 30, 2018 2:43:37 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveDummyTriggering/Flatten.PCollections as step s23
May 30, 2018 2:43:37 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/FlattenDummyAndContents as step s24
May 30, 2018 2:43:37 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/NeverTrigger/Flatten.PCollections as step s25
May 30, 2018 2:43:37 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GroupDummyAndContents as step s26
May 30, 2018 2:43:37 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Values/Values/Map as step s27
May 30, 2018 2:43:37 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/ParDo(Concat) as step s28
May 30, 2018 2:43:37 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GetPane/Map as step s29
May 30, 2018 2:43:37 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/RunChecks as step s30
May 30, 2018 2:43:37 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/VerifyAssertions/ParDo(DefaultConclude) as step s31
May 30, 2018 2:43:37 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0530024334-dfd74c47/output/results/staging/
May 30, 2018 2:43:38 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <71120 bytes, hash P7UZub7p_vEPIRM6Vr4jKA> to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0530024334-dfd74c47/output/results/staging/pipeline-P7UZub7p_vEPIRM6Vr4jKA.pb
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 30, 2018 2:43:39 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-05-29_19_43_38-2258109928401773665?project=apache-beam-testing
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Submitted job: 2018-05-29_19_43_38-2258109928401773665
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 30, 2018 2:43:39 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-05-29_19_43_38-2258109928401773665
May 30, 2018 2:43:39 AM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-05-29_19_43_38-2258109928401773665 with 1 expected assertions.
May 30, 2018 2:43:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:43:38.496Z: Autoscaling is enabled for job 2018-05-29_19_43_38-2258109928401773665. The number of workers will be between 1 and 1000.
May 30, 2018 2:43:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:43:38.522Z: Autoscaling was automatically enabled for job 2018-05-29_19_43_38-2258109928401773665.
May 30, 2018 2:43:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:43:41.638Z: Checking required Cloud APIs are enabled.
May 30, 2018 2:43:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:43:42.089Z: Checking permissions granted to controller Service Account.
May 30, 2018 2:43:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:43:47.280Z: Worker configuration: n1-standard-1 in us-central1-b.
May 30, 2018 2:43:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:43:47.733Z: Expanding CoGroupByKey operations into optimizable parts.
May 30, 2018 2:43:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:43:47.961Z: Expanding GroupByKey operations into optimizable parts.
May 30, 2018 2:43:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:43:47.981Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
May 30, 2018 2:43:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:43:48.237Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
May 30, 2018 2:43:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:43:48.325Z: Elided trivial flatten
May 30, 2018 2:43:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:43:48.349Z: Elided trivial flatten
May 30, 2018 2:43:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:43:48.422Z: Elided trivial flatten
May 30, 2018 2:43:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:43:48.450Z: Unzipping flatten s24 for input s19.org.apache.beam.sdk.values.PCollection.<init>:329#8fd0f908e3ea90e3
May 30, 2018 2:43:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:43:48.471Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Reify, through flatten PAssert$33/GroupGlobally/FlattenDummyAndContents, into producer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map
May 30, 2018 2:43:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:43:48.493Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow into PAssert$33/GroupGlobally/GroupDummyAndContents/Read
May 30, 2018 2:43:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:43:48.548Z: Fusing consumer PAssert$33/GroupGlobally/ParDo(Concat) into PAssert$33/GroupGlobally/Values/Values/Map
May 30, 2018 2:43:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:43:48.576Z: Fusing consumer PAssert$33/GetPane/Map into PAssert$33/GroupGlobally/ParDo(Concat)
May 30, 2018 2:43:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:43:48.602Z: Fusing consumer PAssert$33/GroupGlobally/Values/Values/Map into PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow
May 30, 2018 2:43:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:43:48.625Z: Fusing consumer PAssert$33/RunChecks into PAssert$33/GetPane/Map
May 30, 2018 2:43:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:43:48.650Z: Fusing consumer PAssert$33/VerifyAssertions/ParDo(DefaultConclude) into PAssert$33/RunChecks
May 30, 2018 2:43:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:43:48.677Z: Unzipping flatten s24-u45 for input s26-reify-value18-c43
May 30, 2018 2:43:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:43:48.702Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Write, through flatten s24-u45, into producer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 30, 2018 2:43:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:43:48.725Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify into PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
May 30, 2018 2:43:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:43:48.747Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Write into PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 30, 2018 2:43:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:43:48.770Z: Fusing consumer PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)
May 30, 2018 2:43:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:43:48.793Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
May 30, 2018 2:43:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:43:48.817Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
May 30, 2018 2:43:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:43:48.843Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into PAssert$33/GroupGlobally/Window.Into()/Window.Assign
May 30, 2018 2:43:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:43:48.876Z: Fusing consumer OutputSideInputs into Create123/Read(CreateSource)
May 30, 2018 2:43:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:43:48.899Z: Fusing consumer PAssert$33/GroupGlobally/Window.Into()/Window.Assign into OutputSideInputs
May 30, 2018 2:43:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:43:48.923Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
May 30, 2018 2:43:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:43:48.947Z: Fusing consumer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map into PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
May 30, 2018 2:43:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:43:48.968Z: Fusing consumer PAssert$33/GroupGlobally/RewindowActuals/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map
May 30, 2018 2:43:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:43:48.992Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read
May 30, 2018 2:43:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:43:49.025Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
May 30, 2018 2:43:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:43:49.053Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
May 30, 2018 2:43:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:43:49.079Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
May 30, 2018 2:43:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:43:49.102Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
May 30, 2018 2:43:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:43:49.125Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
May 30, 2018 2:43:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:43:49.158Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into Create47/Read(CreateSource)
May 30, 2018 2:43:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:43:49.185Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
May 30, 2018 2:43:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:43:49.222Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
May 30, 2018 2:43:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:43:49.255Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
May 30, 2018 2:43:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:43:49.280Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
May 30, 2018 2:43:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:43:49.315Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
May 30, 2018 2:43:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:43:49.351Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
May 30, 2018 2:43:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:43:49.750Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Create
May 30, 2018 2:43:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:43:49.786Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Create
May 30, 2018 2:43:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:43:49.815Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
May 30, 2018 2:43:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:43:49.832Z: Starting 1 workers in us-central1-b...
May 30, 2018 2:43:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:43:49.845Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
May 30, 2018 2:43:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:43:50.045Z: Executing operation Create47/Read(CreateSource)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
May 30, 2018 2:43:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:43:50.079Z: Executing operation PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 30, 2018 2:44:00 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:44:00.026Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
May 30, 2018 2:44:11 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:44:10.784Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
May 30, 2018 2:44:11 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:44:10.817Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 30, 2018 2:44:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:44:28.164Z: Workers have started successfully.
May 30, 2018 2:44:55 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:44:54.735Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
May 30, 2018 2:44:55 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:44:54.786Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
May 30, 2018 2:45:04 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:45:02.773Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
May 30, 2018 2:45:04 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:45:02.841Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
May 30, 2018 2:45:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:45:15.906Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
May 30, 2018 2:45:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:45:16.064Z: Executing operation Create123/Read(CreateSource)+OutputSideInputs+PAssert$33/GroupGlobally/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write
May 30, 2018 2:45:22 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:45:22.548Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Close
May 30, 2018 2:45:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:45:22.618Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$33/GroupGlobally/RewindowActuals/Window.Assign+PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 30, 2018 2:45:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:45:28.373Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Close
May 30, 2018 2:45:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:45:28.453Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Read+PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$33/GroupGlobally/Values/Values/Map+PAssert$33/GroupGlobally/ParDo(Concat)+PAssert$33/GetPane/Map+PAssert$33/RunChecks+PAssert$33/VerifyAssertions/ParDo(DefaultConclude)
May 30, 2018 2:45:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:45:33.772Z: Cleaning up.
May 30, 2018 2:45:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:45:33.863Z: Stopping worker pool...
May 30, 2018 2:47:15 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:47:15.737Z: Autoscaling: Resized worker pool from 1 to 0.
May 30, 2018 2:47:15 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:47:15.761Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 30, 2018 2:47:24 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-05-29_19_43_38-2258109928401773665 finished with status DONE.
May 30, 2018 2:47:24 AM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-05-29_19_43_38-2258109928401773665. Found 1 success, 0 failures out of 1 expected assertions.
Gradle Test Executor 40 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest
209 tests completed, 34 failed, 2 skipped
Finished generating test XML results (0.639 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerTest>
Generating HTML test report...
Finished generating test html results (0.672 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest>
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest FAILED
:beam-runners-google-cloud-dataflow-java:validatesRunnerTest (Thread[Task worker for ':' Thread 21,5,main]) completed. Took 2 hrs 10 mins 32.383 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:validatesRunnerTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 11m 24s
38 actionable tasks: 34 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/xuq3w77hikoqa
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user katarzyna.kucharczyk@polidea.com
Not sending mail to unregistered user robbe.sneyders@ml6.eu
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user schroederc@google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user sidhom@google.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ammons@google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Build failed in Jenkins:
beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #373
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/373/display/redirect?page=changes>
Changes:
[iemejia] [BEAM-4321] Enforce ErrorProne analysis in join-library extensions
[kenn] Force load of Calcite JDBC driver (avoids internal error)
[kenn] Explicitly load Beam JDBC driver before test
[iemejia] [BEAM-3813] Support (de)serialization of S3 encryption options via JSON
------------------------------------------
[...truncated 18.07 MB...]
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey as step s16
May 30, 2018 12:32:03 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map as step s17
May 30, 2018 12:32:03 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RewindowActuals/Window.Assign as step s18
May 30, 2018 12:32:03 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map as step s19
May 30, 2018 12:32:03 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveActualsTriggering/Flatten.PCollections as step s20
May 30, 2018 12:32:03 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Create.Values/Read(CreateSource) as step s21
May 30, 2018 12:32:03 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign as step s22
May 30, 2018 12:32:03 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveDummyTriggering/Flatten.PCollections as step s23
May 30, 2018 12:32:03 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/FlattenDummyAndContents as step s24
May 30, 2018 12:32:03 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/NeverTrigger/Flatten.PCollections as step s25
May 30, 2018 12:32:03 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GroupDummyAndContents as step s26
May 30, 2018 12:32:03 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Values/Values/Map as step s27
May 30, 2018 12:32:03 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/ParDo(Concat) as step s28
May 30, 2018 12:32:03 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GetPane/Map as step s29
May 30, 2018 12:32:03 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/RunChecks as step s30
May 30, 2018 12:32:03 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/VerifyAssertions/ParDo(DefaultConclude) as step s31
May 30, 2018 12:32:03 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0530003200-c24eab01/output/results/staging/
May 30, 2018 12:32:03 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <71120 bytes, hash b_zNLaHolvyo0u-4X5aOLg> to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0530003200-c24eab01/output/results/staging/pipeline-b_zNLaHolvyo0u-4X5aOLg.pb
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 30, 2018 12:32:04 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-05-29_17_32_03-14153637180621451680?project=apache-beam-testing
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Submitted job: 2018-05-29_17_32_03-14153637180621451680
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 30, 2018 12:32:04 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-05-29_17_32_03-14153637180621451680
May 30, 2018 12:32:04 AM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-05-29_17_32_03-14153637180621451680 with 1 expected assertions.
May 30, 2018 12:32:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:32:03.810Z: Autoscaling is enabled for job 2018-05-29_17_32_03-14153637180621451680. The number of workers will be between 1 and 1000.
May 30, 2018 12:32:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:32:03.839Z: Autoscaling was automatically enabled for job 2018-05-29_17_32_03-14153637180621451680.
May 30, 2018 12:32:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:32:06.764Z: Checking required Cloud APIs are enabled.
May 30, 2018 12:32:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:32:06.890Z: Checking permissions granted to controller Service Account.
May 30, 2018 12:32:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:32:12.129Z: Worker configuration: n1-standard-1 in us-central1-f.
May 30, 2018 12:32:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:32:12.524Z: Expanding CoGroupByKey operations into optimizable parts.
May 30, 2018 12:32:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:32:12.718Z: Expanding GroupByKey operations into optimizable parts.
May 30, 2018 12:32:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:32:12.762Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
May 30, 2018 12:32:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:32:13.001Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
May 30, 2018 12:32:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:32:13.036Z: Elided trivial flatten
May 30, 2018 12:32:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:32:13.077Z: Elided trivial flatten
May 30, 2018 12:32:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:32:13.110Z: Elided trivial flatten
May 30, 2018 12:32:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:32:13.160Z: Unzipping flatten s24 for input s19.org.apache.beam.sdk.values.PCollection.<init>:329#8fd0f908e3ea90e3
May 30, 2018 12:32:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:32:13.197Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Reify, through flatten PAssert$33/GroupGlobally/FlattenDummyAndContents, into producer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map
May 30, 2018 12:32:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:32:13.244Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow into PAssert$33/GroupGlobally/GroupDummyAndContents/Read
May 30, 2018 12:32:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:32:13.288Z: Fusing consumer PAssert$33/GroupGlobally/ParDo(Concat) into PAssert$33/GroupGlobally/Values/Values/Map
May 30, 2018 12:32:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:32:13.325Z: Fusing consumer PAssert$33/GetPane/Map into PAssert$33/GroupGlobally/ParDo(Concat)
May 30, 2018 12:32:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:32:13.375Z: Fusing consumer PAssert$33/GroupGlobally/Values/Values/Map into PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow
May 30, 2018 12:32:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:32:13.421Z: Fusing consumer PAssert$33/RunChecks into PAssert$33/GetPane/Map
May 30, 2018 12:32:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:32:13.447Z: Fusing consumer PAssert$33/VerifyAssertions/ParDo(DefaultConclude) into PAssert$33/RunChecks
May 30, 2018 12:32:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:32:13.495Z: Unzipping flatten s24-u45 for input s26-reify-value18-c43
May 30, 2018 12:32:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:32:13.546Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Write, through flatten s24-u45, into producer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 30, 2018 12:32:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:32:13.593Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify into PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
May 30, 2018 12:32:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:32:13.639Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Write into PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 30, 2018 12:32:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:32:13.687Z: Fusing consumer PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)
May 30, 2018 12:32:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:32:13.737Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
May 30, 2018 12:32:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:32:13.785Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
May 30, 2018 12:32:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:32:13.827Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into PAssert$33/GroupGlobally/Window.Into()/Window.Assign
May 30, 2018 12:32:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:32:13.874Z: Fusing consumer OutputSideInputs into Create123/Read(CreateSource)
May 30, 2018 12:32:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:32:13.919Z: Fusing consumer PAssert$33/GroupGlobally/Window.Into()/Window.Assign into OutputSideInputs
May 30, 2018 12:32:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:32:13.965Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
May 30, 2018 12:32:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:32:14.001Z: Fusing consumer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map into PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
May 30, 2018 12:32:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:32:14.049Z: Fusing consumer PAssert$33/GroupGlobally/RewindowActuals/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map
May 30, 2018 12:32:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:32:14.095Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read
May 30, 2018 12:32:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:32:14.132Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
May 30, 2018 12:32:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:32:14.178Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
May 30, 2018 12:32:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:32:14.215Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
May 30, 2018 12:32:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:32:14.259Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
May 30, 2018 12:32:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:32:14.305Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
May 30, 2018 12:32:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:32:14.344Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into Create47/Read(CreateSource)
May 30, 2018 12:32:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:32:14.385Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
May 30, 2018 12:32:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:32:14.430Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
May 30, 2018 12:32:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:32:14.468Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
May 30, 2018 12:32:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:32:14.514Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
May 30, 2018 12:32:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:32:14.558Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
May 30, 2018 12:32:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:32:14.596Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
May 30, 2018 12:32:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:32:15.085Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Create
May 30, 2018 12:32:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:32:15.110Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Create
May 30, 2018 12:32:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:32:15.155Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
May 30, 2018 12:32:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:32:15.180Z: Starting 1 workers in us-central1-f...
May 30, 2018 12:32:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:32:15.193Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
May 30, 2018 12:32:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:32:15.516Z: Executing operation PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 30, 2018 12:32:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:32:15.570Z: Executing operation Create47/Read(CreateSource)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
May 30, 2018 12:32:23 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:32:21.775Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
May 30, 2018 12:32:33 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:32:32.198Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
May 30, 2018 12:32:33 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:32:32.239Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 30, 2018 12:32:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:32:51.348Z: Workers have started successfully.
May 30, 2018 12:33:22 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:33:21.804Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
May 30, 2018 12:33:22 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:33:21.896Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
May 30, 2018 12:33:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:33:31.688Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
May 30, 2018 12:33:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:33:31.798Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
May 30, 2018 12:33:44 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:33:42.525Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
May 30, 2018 12:33:44 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:33:42.728Z: Executing operation Create123/Read(CreateSource)+OutputSideInputs+PAssert$33/GroupGlobally/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write
May 30, 2018 12:33:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:33:49.300Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Close
May 30, 2018 12:33:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:33:49.388Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$33/GroupGlobally/RewindowActuals/Window.Assign+PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 30, 2018 12:33:54 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:33:54.125Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Close
May 30, 2018 12:33:54 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:33:54.212Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Read+PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$33/GroupGlobally/Values/Values/Map+PAssert$33/GroupGlobally/ParDo(Concat)+PAssert$33/GetPane/Map+PAssert$33/RunChecks+PAssert$33/VerifyAssertions/ParDo(DefaultConclude)
May 30, 2018 12:34:00 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:33:58.376Z: Cleaning up.
May 30, 2018 12:34:00 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:33:58.498Z: Stopping worker pool...
May 30, 2018 12:35:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:35:33.197Z: Autoscaling: Resized worker pool from 1 to 0.
May 30, 2018 12:35:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:35:33.245Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 30, 2018 12:35:44 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-05-29_17_32_03-14153637180621451680 finished with status DONE.
May 30, 2018 12:35:44 AM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-05-29_17_32_03-14153637180621451680. Found 1 success, 0 failures out of 1 expected assertions.
Gradle Test Executor 38 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest
209 tests completed, 34 failed, 2 skipped
Finished generating test XML results (0.839 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerTest>
Generating HTML test report...
Finished generating test html results (0.859 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest>
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest FAILED
:beam-runners-google-cloud-dataflow-java:validatesRunnerTest (Thread[Task worker for ':' Thread 14,5,main]) completed. Took 2 hrs 53 mins 30.028 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:validatesRunnerTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 54m 29s
38 actionable tasks: 34 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/se37dayllyw6k
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user katarzyna.kucharczyk@polidea.com
Not sending mail to unregistered user robbe.sneyders@ml6.eu
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user schroederc@google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ammons@google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user sidhom@google.com
Build failed in Jenkins:
beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #372
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/372/display/redirect?page=changes>
Changes:
[thw] [BEAM-4297] Streaming executable stage translation and operator for
[thw] [BEAM-4297] Add serialization test and make output mapping stable.
------------------------------------------
[...truncated 18.08 MB...]
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign as step s15
May 29, 2018 9:36:57 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey as step s16
May 29, 2018 9:36:57 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map as step s17
May 29, 2018 9:36:57 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RewindowActuals/Window.Assign as step s18
May 29, 2018 9:36:57 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map as step s19
May 29, 2018 9:36:57 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveActualsTriggering/Flatten.PCollections as step s20
May 29, 2018 9:36:57 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Create.Values/Read(CreateSource) as step s21
May 29, 2018 9:36:57 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign as step s22
May 29, 2018 9:36:57 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveDummyTriggering/Flatten.PCollections as step s23
May 29, 2018 9:36:57 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/FlattenDummyAndContents as step s24
May 29, 2018 9:36:57 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/NeverTrigger/Flatten.PCollections as step s25
May 29, 2018 9:36:57 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GroupDummyAndContents as step s26
May 29, 2018 9:36:57 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Values/Values/Map as step s27
May 29, 2018 9:36:57 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/ParDo(Concat) as step s28
May 29, 2018 9:36:57 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GetPane/Map as step s29
May 29, 2018 9:36:57 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/RunChecks as step s30
May 29, 2018 9:36:57 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/VerifyAssertions/ParDo(DefaultConclude) as step s31
May 29, 2018 9:36:57 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0529213647-68a6e217/output/results/staging/
May 29, 2018 9:36:57 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <71120 bytes, hash jqGEnVDvrOYV-8AXuFUeZw> to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0529213647-68a6e217/output/results/staging/pipeline-jqGEnVDvrOYV-8AXuFUeZw.pb
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 29, 2018 9:36:59 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-05-29_14_36_58-2427693626167930636?project=apache-beam-testing
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Submitted job: 2018-05-29_14_36_58-2427693626167930636
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 29, 2018 9:36:59 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-05-29_14_36_58-2427693626167930636
May 29, 2018 9:36:59 PM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-05-29_14_36_58-2427693626167930636 with 1 expected assertions.
May 29, 2018 9:37:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:36:58.128Z: Autoscaling is enabled for job 2018-05-29_14_36_58-2427693626167930636. The number of workers will be between 1 and 1000.
May 29, 2018 9:37:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:36:58.173Z: Autoscaling was automatically enabled for job 2018-05-29_14_36_58-2427693626167930636.
May 29, 2018 9:37:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:37:00.872Z: Checking required Cloud APIs are enabled.
May 29, 2018 9:37:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:37:01.090Z: Checking permissions granted to controller Service Account.
May 29, 2018 9:37:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:37:07.854Z: Worker configuration: n1-standard-1 in us-central1-b.
May 29, 2018 9:37:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:37:08.365Z: Expanding CoGroupByKey operations into optimizable parts.
May 29, 2018 9:37:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:37:08.535Z: Expanding GroupByKey operations into optimizable parts.
May 29, 2018 9:37:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:37:08.585Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
May 29, 2018 9:37:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:37:08.827Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
May 29, 2018 9:37:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:37:08.870Z: Elided trivial flatten
May 29, 2018 9:37:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:37:08.914Z: Elided trivial flatten
May 29, 2018 9:37:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:37:08.962Z: Elided trivial flatten
May 29, 2018 9:37:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:37:09.000Z: Unzipping flatten s24 for input s19.org.apache.beam.sdk.values.PCollection.<init>:329#8fd0f908e3ea90e3
May 29, 2018 9:37:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:37:09.057Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Reify, through flatten PAssert$33/GroupGlobally/FlattenDummyAndContents, into producer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map
May 29, 2018 9:37:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:37:09.102Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow into PAssert$33/GroupGlobally/GroupDummyAndContents/Read
May 29, 2018 9:37:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:37:09.153Z: Fusing consumer PAssert$33/GroupGlobally/ParDo(Concat) into PAssert$33/GroupGlobally/Values/Values/Map
May 29, 2018 9:37:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:37:09.194Z: Fusing consumer PAssert$33/GetPane/Map into PAssert$33/GroupGlobally/ParDo(Concat)
May 29, 2018 9:37:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:37:09.243Z: Fusing consumer PAssert$33/GroupGlobally/Values/Values/Map into PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow
May 29, 2018 9:37:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:37:09.278Z: Fusing consumer PAssert$33/RunChecks into PAssert$33/GetPane/Map
May 29, 2018 9:37:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:37:09.328Z: Fusing consumer PAssert$33/VerifyAssertions/ParDo(DefaultConclude) into PAssert$33/RunChecks
May 29, 2018 9:37:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:37:09.369Z: Unzipping flatten s24-u45 for input s26-reify-value18-c43
May 29, 2018 9:37:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:37:09.417Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Write, through flatten s24-u45, into producer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 29, 2018 9:37:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:37:09.465Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify into PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
May 29, 2018 9:37:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:37:09.511Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Write into PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 29, 2018 9:37:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:37:09.559Z: Fusing consumer PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)
May 29, 2018 9:37:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:37:09.608Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
May 29, 2018 9:37:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:37:09.658Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
May 29, 2018 9:37:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:37:09.699Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into PAssert$33/GroupGlobally/Window.Into()/Window.Assign
May 29, 2018 9:37:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:37:09.746Z: Fusing consumer OutputSideInputs into Create123/Read(CreateSource)
May 29, 2018 9:37:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:37:09.790Z: Fusing consumer PAssert$33/GroupGlobally/Window.Into()/Window.Assign into OutputSideInputs
May 29, 2018 9:37:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:37:09.835Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
May 29, 2018 9:37:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:37:09.873Z: Fusing consumer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map into PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
May 29, 2018 9:37:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:37:09.919Z: Fusing consumer PAssert$33/GroupGlobally/RewindowActuals/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map
May 29, 2018 9:37:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:37:09.963Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read
May 29, 2018 9:37:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:37:10.000Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
May 29, 2018 9:37:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:37:10.048Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
May 29, 2018 9:37:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:37:10.099Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
May 29, 2018 9:37:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:37:10.142Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
May 29, 2018 9:37:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:37:10.183Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
May 29, 2018 9:37:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:37:10.230Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into Create47/Read(CreateSource)
May 29, 2018 9:37:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:37:10.272Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
May 29, 2018 9:37:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:37:10.316Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
May 29, 2018 9:37:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:37:10.349Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
May 29, 2018 9:37:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:37:10.399Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
May 29, 2018 9:37:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:37:10.444Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
May 29, 2018 9:37:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:37:10.491Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
May 29, 2018 9:37:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:37:10.998Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Create
May 29, 2018 9:37:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:37:11.048Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Create
May 29, 2018 9:37:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:37:11.096Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
May 29, 2018 9:37:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:37:11.106Z: Starting 1 workers in us-central1-b...
May 29, 2018 9:37:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:37:11.143Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
May 29, 2018 9:37:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:37:11.384Z: Executing operation PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 29, 2018 9:37:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:37:11.431Z: Executing operation Create47/Read(CreateSource)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
May 29, 2018 9:37:22 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:37:21.259Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
May 29, 2018 9:37:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:37:32.013Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
May 29, 2018 9:37:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:37:32.040Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 29, 2018 9:37:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:37:52.246Z: Workers have started successfully.
May 29, 2018 9:38:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:38:27.048Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
May 29, 2018 9:38:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:38:27.112Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
May 29, 2018 9:38:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:38:33.754Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
May 29, 2018 9:38:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:38:33.815Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
May 29, 2018 9:38:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:38:44.485Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
May 29, 2018 9:38:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:38:44.661Z: Executing operation Create123/Read(CreateSource)+OutputSideInputs+PAssert$33/GroupGlobally/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write
May 29, 2018 9:38:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:38:50.623Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Close
May 29, 2018 9:38:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:38:50.712Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$33/GroupGlobally/RewindowActuals/Window.Assign+PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 29, 2018 9:38:56 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:38:55.468Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Close
May 29, 2018 9:38:56 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:38:55.535Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Read+PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$33/GroupGlobally/Values/Values/Map+PAssert$33/GroupGlobally/ParDo(Concat)+PAssert$33/GetPane/Map+PAssert$33/RunChecks+PAssert$33/VerifyAssertions/ParDo(DefaultConclude)
May 29, 2018 9:38:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:38:57.900Z: Cleaning up.
May 29, 2018 9:38:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:38:57.991Z: Stopping worker pool...
May 29, 2018 9:40:50 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:40:48.878Z: Autoscaling: Resized worker pool from 1 to 0.
May 29, 2018 9:40:50 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:40:48.903Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 29, 2018 9:40:59 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-05-29_14_36_58-2427693626167930636 finished with status DONE.
May 29, 2018 9:40:59 PM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-05-29_14_36_58-2427693626167930636. Found 1 success, 0 failures out of 1 expected assertions.
Gradle Test Executor 39 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest FAILED
209 tests completed, 34 failed, 2 skipped
Finished generating test XML results (0.403 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerTest>
Generating HTML test report...
Finished generating test html results (0.513 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest>
:beam-runners-google-cloud-dataflow-java:validatesRunnerTest (Thread[Task worker for ':' Thread 35,5,main]) completed. Took 2 hrs 24 mins 52.343 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:validatesRunnerTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 25m 48s
38 actionable tasks: 34 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/j63lqecqhli3u
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user katarzyna.kucharczyk@polidea.com
Not sending mail to unregistered user robbe.sneyders@ml6.eu
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user schroederc@google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ammons@google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user sidhom@google.com
Build failed in Jenkins:
beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #371
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/371/display/redirect?page=changes>
Changes:
[iemejia] [BEAM-4324] Enforce ErrorProne analysis in sorter extensions
------------------------------------------
[...truncated 18.14 MB...]
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey as step s16
May 29, 2018 7:10:00 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map as step s17
May 29, 2018 7:10:00 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RewindowActuals/Window.Assign as step s18
May 29, 2018 7:10:00 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map as step s19
May 29, 2018 7:10:00 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveActualsTriggering/Flatten.PCollections as step s20
May 29, 2018 7:10:00 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Create.Values/Read(CreateSource) as step s21
May 29, 2018 7:10:00 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign as step s22
May 29, 2018 7:10:00 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveDummyTriggering/Flatten.PCollections as step s23
May 29, 2018 7:10:00 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/FlattenDummyAndContents as step s24
May 29, 2018 7:10:00 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/NeverTrigger/Flatten.PCollections as step s25
May 29, 2018 7:10:00 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GroupDummyAndContents as step s26
May 29, 2018 7:10:00 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Values/Values/Map as step s27
May 29, 2018 7:10:00 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/ParDo(Concat) as step s28
May 29, 2018 7:10:00 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GetPane/Map as step s29
May 29, 2018 7:10:00 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/RunChecks as step s30
May 29, 2018 7:10:00 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/VerifyAssertions/ParDo(DefaultConclude) as step s31
May 29, 2018 7:10:00 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0529190957-2afa90aa/output/results/staging/
May 29, 2018 7:10:00 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <71120 bytes, hash 0wFuvcysJBGRJbA4-YL_Fw> to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0529190957-2afa90aa/output/results/staging/pipeline-0wFuvcysJBGRJbA4-YL_Fw.pb
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 29, 2018 7:10:01 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-05-29_12_10_01-11318241648254347114?project=apache-beam-testing
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Submitted job: 2018-05-29_12_10_01-11318241648254347114
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 29, 2018 7:10:01 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-05-29_12_10_01-11318241648254347114
May 29, 2018 7:10:01 PM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-05-29_12_10_01-11318241648254347114 with 1 expected assertions.
May 29, 2018 7:10:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:10:01.139Z: Autoscaling is enabled for job 2018-05-29_12_10_01-11318241648254347114. The number of workers will be between 1 and 1000.
May 29, 2018 7:10:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:10:01.181Z: Autoscaling was automatically enabled for job 2018-05-29_12_10_01-11318241648254347114.
May 29, 2018 7:10:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:10:03.712Z: Checking required Cloud APIs are enabled.
May 29, 2018 7:10:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:10:03.898Z: Checking permissions granted to controller Service Account.
May 29, 2018 7:10:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:10:08.803Z: Worker configuration: n1-standard-1 in us-central1-b.
May 29, 2018 7:10:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:10:09.214Z: Expanding CoGroupByKey operations into optimizable parts.
May 29, 2018 7:10:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:10:09.382Z: Expanding GroupByKey operations into optimizable parts.
May 29, 2018 7:10:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:10:09.418Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
May 29, 2018 7:10:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:10:09.662Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
May 29, 2018 7:10:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:10:09.707Z: Elided trivial flatten
May 29, 2018 7:10:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:10:09.752Z: Elided trivial flatten
May 29, 2018 7:10:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:10:09.800Z: Elided trivial flatten
May 29, 2018 7:10:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:10:09.843Z: Unzipping flatten s24 for input s19.org.apache.beam.sdk.values.PCollection.<init>:329#8fd0f908e3ea90e3
May 29, 2018 7:10:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:10:09.880Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Reify, through flatten PAssert$33/GroupGlobally/FlattenDummyAndContents, into producer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map
May 29, 2018 7:10:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:10:09.926Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow into PAssert$33/GroupGlobally/GroupDummyAndContents/Read
May 29, 2018 7:10:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:10:09.974Z: Fusing consumer PAssert$33/GroupGlobally/ParDo(Concat) into PAssert$33/GroupGlobally/Values/Values/Map
May 29, 2018 7:10:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:10:10.024Z: Fusing consumer PAssert$33/GetPane/Map into PAssert$33/GroupGlobally/ParDo(Concat)
May 29, 2018 7:10:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:10:10.060Z: Fusing consumer PAssert$33/GroupGlobally/Values/Values/Map into PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow
May 29, 2018 7:10:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:10:10.102Z: Fusing consumer PAssert$33/RunChecks into PAssert$33/GetPane/Map
May 29, 2018 7:10:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:10:10.133Z: Fusing consumer PAssert$33/VerifyAssertions/ParDo(DefaultConclude) into PAssert$33/RunChecks
May 29, 2018 7:10:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:10:10.180Z: Unzipping flatten s24-u45 for input s26-reify-value18-c43
May 29, 2018 7:10:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:10:10.224Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Write, through flatten s24-u45, into producer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 29, 2018 7:10:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:10:10.269Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify into PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
May 29, 2018 7:10:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:10:10.316Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Write into PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 29, 2018 7:10:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:10:10.370Z: Fusing consumer PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)
May 29, 2018 7:10:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:10:10.413Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
May 29, 2018 7:10:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:10:10.459Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
May 29, 2018 7:10:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:10:10.508Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into PAssert$33/GroupGlobally/Window.Into()/Window.Assign
May 29, 2018 7:10:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:10:10.552Z: Fusing consumer OutputSideInputs into Create123/Read(CreateSource)
May 29, 2018 7:10:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:10:10.590Z: Fusing consumer PAssert$33/GroupGlobally/Window.Into()/Window.Assign into OutputSideInputs
May 29, 2018 7:10:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:10:10.632Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
May 29, 2018 7:10:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:10:10.679Z: Fusing consumer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map into PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
May 29, 2018 7:10:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:10:10.725Z: Fusing consumer PAssert$33/GroupGlobally/RewindowActuals/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map
May 29, 2018 7:10:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:10:10.771Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read
May 29, 2018 7:10:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:10:10.817Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
May 29, 2018 7:10:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:10:10.862Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
May 29, 2018 7:10:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:10:10.913Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
May 29, 2018 7:10:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:10:10.956Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
May 29, 2018 7:10:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:10:10.992Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
May 29, 2018 7:10:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:10:11.029Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into Create47/Read(CreateSource)
May 29, 2018 7:10:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:10:11.073Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
May 29, 2018 7:10:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:10:11.112Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
May 29, 2018 7:10:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:10:11.159Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
May 29, 2018 7:10:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:10:11.193Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
May 29, 2018 7:10:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:10:11.238Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
May 29, 2018 7:10:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:10:11.287Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
May 29, 2018 7:10:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:10:11.770Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Create
May 29, 2018 7:10:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:10:11.807Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Create
May 29, 2018 7:10:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:10:11.846Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
May 29, 2018 7:10:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:10:11.868Z: Starting 1 workers in us-central1-b...
May 29, 2018 7:10:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:10:11.887Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
May 29, 2018 7:10:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:10:12.191Z: Executing operation PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 29, 2018 7:10:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:10:12.233Z: Executing operation Create47/Read(CreateSource)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
May 29, 2018 7:10:21 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:10:19.584Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
May 29, 2018 7:10:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:10:40.770Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
May 29, 2018 7:10:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:10:40.817Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 29, 2018 7:11:02 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:11:01.503Z: Workers have started successfully.
May 29, 2018 7:11:57 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:11:57.657Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
May 29, 2018 7:11:57 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:11:57.740Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
May 29, 2018 7:12:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:12:02.869Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
May 29, 2018 7:12:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:12:02.965Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
May 29, 2018 7:12:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:12:16.632Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
May 29, 2018 7:12:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:12:16.822Z: Executing operation Create123/Read(CreateSource)+OutputSideInputs+PAssert$33/GroupGlobally/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write
May 29, 2018 7:12:22 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:12:21.528Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Close
May 29, 2018 7:12:22 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:12:21.619Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$33/GroupGlobally/RewindowActuals/Window.Assign+PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 29, 2018 7:12:24 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:12:23.348Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Close
May 29, 2018 7:12:24 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:12:23.431Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Read+PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$33/GroupGlobally/Values/Values/Map+PAssert$33/GroupGlobally/ParDo(Concat)+PAssert$33/GetPane/Map+PAssert$33/RunChecks+PAssert$33/VerifyAssertions/ParDo(DefaultConclude)
May 29, 2018 7:12:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:12:26.624Z: Cleaning up.
May 29, 2018 7:12:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:12:26.722Z: Stopping worker pool...
May 29, 2018 7:14:46 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:14:45.646Z: Autoscaling: Resized worker pool from 1 to 0.
May 29, 2018 7:14:46 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:14:45.672Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 29, 2018 7:14:53 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-05-29_12_10_01-11318241648254347114 finished with status DONE.
May 29, 2018 7:14:53 PM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-05-29_12_10_01-11318241648254347114. Found 1 success, 0 failures out of 1 expected assertions.
Gradle Test Executor 34 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest
209 tests completed, 34 failed, 2 skipped
Finished generating test XML results (0.663 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerTest>
Generating HTML test report...
Finished generating test html results (0.717 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest>
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest FAILED
:beam-runners-google-cloud-dataflow-java:validatesRunnerTest (Thread[Task worker for ':' Thread 18,5,main]) completed. Took 2 hrs 21 mins 28.766 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:validatesRunnerTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 22m 26s
38 actionable tasks: 34 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/kwz7ckgbieule
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user katarzyna.kucharczyk@polidea.com
Not sending mail to unregistered user robbe.sneyders@ml6.eu
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user schroederc@google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ammons@google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user sidhom@google.com
Build failed in Jenkins:
beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #370
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/370/display/redirect>
------------------------------------------
[...truncated 18.10 MB...]
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map as step s17
May 29, 2018 2:03:06 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RewindowActuals/Window.Assign as step s18
May 29, 2018 2:03:06 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map as step s19
May 29, 2018 2:03:06 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveActualsTriggering/Flatten.PCollections as step s20
May 29, 2018 2:03:06 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Create.Values/Read(CreateSource) as step s21
May 29, 2018 2:03:06 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign as step s22
May 29, 2018 2:03:06 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveDummyTriggering/Flatten.PCollections as step s23
May 29, 2018 2:03:06 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/FlattenDummyAndContents as step s24
May 29, 2018 2:03:06 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/NeverTrigger/Flatten.PCollections as step s25
May 29, 2018 2:03:06 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GroupDummyAndContents as step s26
May 29, 2018 2:03:06 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Values/Values/Map as step s27
May 29, 2018 2:03:06 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/ParDo(Concat) as step s28
May 29, 2018 2:03:06 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GetPane/Map as step s29
May 29, 2018 2:03:06 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/RunChecks as step s30
May 29, 2018 2:03:06 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/VerifyAssertions/ParDo(DefaultConclude) as step s31
May 29, 2018 2:03:06 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0529140303-1444dfc0/output/results/staging/
May 29, 2018 2:03:07 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <71120 bytes, hash Tna8S9mfsmJwhjjgQkvC8g> to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0529140303-1444dfc0/output/results/staging/pipeline-Tna8S9mfsmJwhjjgQkvC8g.pb
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 29, 2018 2:03:08 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-05-29_07_03_07-14990210872142790360?project=apache-beam-testing
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Submitted job: 2018-05-29_07_03_07-14990210872142790360
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 29, 2018 2:03:08 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-05-29_07_03_07-14990210872142790360
May 29, 2018 2:03:08 PM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-05-29_07_03_07-14990210872142790360 with 1 expected assertions.
May 29, 2018 2:03:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:03:07.683Z: Autoscaling is enabled for job 2018-05-29_07_03_07-14990210872142790360. The number of workers will be between 1 and 1000.
May 29, 2018 2:03:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:03:07.707Z: Autoscaling was automatically enabled for job 2018-05-29_07_03_07-14990210872142790360.
May 29, 2018 2:03:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:03:10.305Z: Checking required Cloud APIs are enabled.
May 29, 2018 2:03:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:03:10.480Z: Checking permissions granted to controller Service Account.
May 29, 2018 2:03:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:03:15.957Z: Worker configuration: n1-standard-1 in us-central1-f.
May 29, 2018 2:03:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:03:16.400Z: Expanding CoGroupByKey operations into optimizable parts.
May 29, 2018 2:03:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:03:16.591Z: Expanding GroupByKey operations into optimizable parts.
May 29, 2018 2:03:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:03:16.627Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
May 29, 2018 2:03:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:03:16.851Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
May 29, 2018 2:03:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:03:16.897Z: Elided trivial flatten
May 29, 2018 2:03:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:03:16.943Z: Elided trivial flatten
May 29, 2018 2:03:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:03:16.990Z: Elided trivial flatten
May 29, 2018 2:03:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:03:17.040Z: Unzipping flatten s24 for input s19.org.apache.beam.sdk.values.PCollection.<init>:329#8fd0f908e3ea90e3
May 29, 2018 2:03:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:03:17.076Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Reify, through flatten PAssert$33/GroupGlobally/FlattenDummyAndContents, into producer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map
May 29, 2018 2:03:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:03:17.124Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow into PAssert$33/GroupGlobally/GroupDummyAndContents/Read
May 29, 2018 2:03:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:03:17.170Z: Fusing consumer PAssert$33/GroupGlobally/ParDo(Concat) into PAssert$33/GroupGlobally/Values/Values/Map
May 29, 2018 2:03:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:03:17.213Z: Fusing consumer PAssert$33/GetPane/Map into PAssert$33/GroupGlobally/ParDo(Concat)
May 29, 2018 2:03:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:03:17.256Z: Fusing consumer PAssert$33/GroupGlobally/Values/Values/Map into PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow
May 29, 2018 2:03:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:03:17.301Z: Fusing consumer PAssert$33/RunChecks into PAssert$33/GetPane/Map
May 29, 2018 2:03:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:03:17.351Z: Fusing consumer PAssert$33/VerifyAssertions/ParDo(DefaultConclude) into PAssert$33/RunChecks
May 29, 2018 2:03:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:03:17.397Z: Unzipping flatten s24-u45 for input s26-reify-value18-c43
May 29, 2018 2:03:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:03:17.443Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Write, through flatten s24-u45, into producer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 29, 2018 2:03:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:03:17.488Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify into PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
May 29, 2018 2:03:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:03:17.516Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Write into PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 29, 2018 2:03:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:03:17.562Z: Fusing consumer PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)
May 29, 2018 2:03:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:03:17.606Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
May 29, 2018 2:03:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:03:17.642Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
May 29, 2018 2:03:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:03:17.688Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into PAssert$33/GroupGlobally/Window.Into()/Window.Assign
May 29, 2018 2:03:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:03:17.724Z: Fusing consumer OutputSideInputs into Create123/Read(CreateSource)
May 29, 2018 2:03:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:03:17.758Z: Fusing consumer PAssert$33/GroupGlobally/Window.Into()/Window.Assign into OutputSideInputs
May 29, 2018 2:03:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:03:17.803Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
May 29, 2018 2:03:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:03:17.849Z: Fusing consumer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map into PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
May 29, 2018 2:03:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:03:17.896Z: Fusing consumer PAssert$33/GroupGlobally/RewindowActuals/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map
May 29, 2018 2:03:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:03:17.933Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read
May 29, 2018 2:03:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:03:17.969Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
May 29, 2018 2:03:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:03:18.017Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
May 29, 2018 2:03:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:03:18.061Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
May 29, 2018 2:03:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:03:18.106Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
May 29, 2018 2:03:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:03:18.149Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
May 29, 2018 2:03:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:03:18.187Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into Create47/Read(CreateSource)
May 29, 2018 2:03:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:03:18.232Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
May 29, 2018 2:03:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:03:18.261Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
May 29, 2018 2:03:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:03:18.305Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
May 29, 2018 2:03:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:03:18.343Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
May 29, 2018 2:03:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:03:18.377Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
May 29, 2018 2:03:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:03:18.422Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
May 29, 2018 2:03:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:03:18.869Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Create
May 29, 2018 2:03:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:03:18.905Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Create
May 29, 2018 2:03:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:03:18.942Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
May 29, 2018 2:03:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:03:18.975Z: Starting 1 workers in us-central1-f...
May 29, 2018 2:03:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:03:18.975Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
May 29, 2018 2:03:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:03:19.242Z: Executing operation PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 29, 2018 2:03:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:03:19.280Z: Executing operation Create47/Read(CreateSource)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
May 29, 2018 2:03:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:03:28.647Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
May 29, 2018 2:03:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:03:39.111Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
May 29, 2018 2:03:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:03:39.159Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 29, 2018 2:03:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:03:56.569Z: Workers have started successfully.
May 29, 2018 2:04:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:04:27.403Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
May 29, 2018 2:04:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:04:27.491Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
May 29, 2018 2:04:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:04:37.127Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
May 29, 2018 2:04:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:04:37.216Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
May 29, 2018 2:04:50 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:04:49.052Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
May 29, 2018 2:04:50 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:04:49.234Z: Executing operation Create123/Read(CreateSource)+OutputSideInputs+PAssert$33/GroupGlobally/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write
May 29, 2018 2:04:55 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:04:54.267Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Close
May 29, 2018 2:04:55 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:04:54.351Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$33/GroupGlobally/RewindowActuals/Window.Assign+PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 29, 2018 2:05:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:05:00.005Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Close
May 29, 2018 2:05:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:05:00.101Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Read+PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$33/GroupGlobally/Values/Values/Map+PAssert$33/GroupGlobally/ParDo(Concat)+PAssert$33/GetPane/Map+PAssert$33/RunChecks+PAssert$33/VerifyAssertions/ParDo(DefaultConclude)
May 29, 2018 2:05:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:05:05.219Z: Cleaning up.
May 29, 2018 2:05:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:05:05.324Z: Stopping worker pool...
May 29, 2018 2:06:43 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:06:42.340Z: Autoscaling: Resized worker pool from 1 to 0.
May 29, 2018 2:06:43 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:06:42.380Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 29, 2018 2:06:43 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:06:42.436Z: Worker pool stopped.
May 29, 2018 2:06:50 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-05-29_07_03_07-14990210872142790360 finished with status DONE.
May 29, 2018 2:06:50 PM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-05-29_07_03_07-14990210872142790360. Found 1 success, 0 failures out of 1 expected assertions.
Gradle Test Executor 42 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest
209 tests completed, 34 failed, 2 skipped
Finished generating test XML results (0.654 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerTest>
Generating HTML test report...
Finished generating test html results (0.575 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest>
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest FAILED
:beam-runners-google-cloud-dataflow-java:validatesRunnerTest (Thread[Task worker for ':' Thread 16,5,main]) completed. Took 2 hrs 4 mins 57.127 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:validatesRunnerTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 6m 12s
38 actionable tasks: 34 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/r675bon5liogu
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user katarzyna.kucharczyk@polidea.com
Not sending mail to unregistered user robbe.sneyders@ml6.eu
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user schroederc@google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ammons@google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user sidhom@google.com
Build failed in Jenkins:
beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #369
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/369/display/redirect>
------------------------------------------
[...truncated 18.08 MB...]
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map as step s17
May 29, 2018 8:03:13 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RewindowActuals/Window.Assign as step s18
May 29, 2018 8:03:13 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map as step s19
May 29, 2018 8:03:13 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveActualsTriggering/Flatten.PCollections as step s20
May 29, 2018 8:03:13 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Create.Values/Read(CreateSource) as step s21
May 29, 2018 8:03:13 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign as step s22
May 29, 2018 8:03:13 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveDummyTriggering/Flatten.PCollections as step s23
May 29, 2018 8:03:13 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/FlattenDummyAndContents as step s24
May 29, 2018 8:03:13 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/NeverTrigger/Flatten.PCollections as step s25
May 29, 2018 8:03:13 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GroupDummyAndContents as step s26
May 29, 2018 8:03:13 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Values/Values/Map as step s27
May 29, 2018 8:03:13 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/ParDo(Concat) as step s28
May 29, 2018 8:03:13 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GetPane/Map as step s29
May 29, 2018 8:03:13 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/RunChecks as step s30
May 29, 2018 8:03:13 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/VerifyAssertions/ParDo(DefaultConclude) as step s31
May 29, 2018 8:03:13 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0529080310-283d4146/output/results/staging/
May 29, 2018 8:03:13 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <71120 bytes, hash G4mu3dXGCbDDe6BQUL5xRg> to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0529080310-283d4146/output/results/staging/pipeline-G4mu3dXGCbDDe6BQUL5xRg.pb
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 29, 2018 8:03:14 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-05-29_01_03_13-12526082984653603654?project=apache-beam-testing
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Submitted job: 2018-05-29_01_03_13-12526082984653603654
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 29, 2018 8:03:14 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-05-29_01_03_13-12526082984653603654
May 29, 2018 8:03:14 AM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-05-29_01_03_13-12526082984653603654 with 1 expected assertions.
May 29, 2018 8:03:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:03:13.561Z: Autoscaling is enabled for job 2018-05-29_01_03_13-12526082984653603654. The number of workers will be between 1 and 1000.
May 29, 2018 8:03:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:03:13.603Z: Autoscaling was automatically enabled for job 2018-05-29_01_03_13-12526082984653603654.
May 29, 2018 8:03:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:03:16.029Z: Checking required Cloud APIs are enabled.
May 29, 2018 8:03:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:03:16.339Z: Checking permissions granted to controller Service Account.
May 29, 2018 8:03:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:03:20.579Z: Worker configuration: n1-standard-1 in us-central1-b.
May 29, 2018 8:03:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:03:21.023Z: Expanding CoGroupByKey operations into optimizable parts.
May 29, 2018 8:03:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:03:21.203Z: Expanding GroupByKey operations into optimizable parts.
May 29, 2018 8:03:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:03:21.239Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
May 29, 2018 8:03:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:03:21.474Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
May 29, 2018 8:03:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:03:21.513Z: Elided trivial flatten
May 29, 2018 8:03:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:03:21.561Z: Elided trivial flatten
May 29, 2018 8:03:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:03:21.608Z: Elided trivial flatten
May 29, 2018 8:03:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:03:21.655Z: Unzipping flatten s24 for input s19.org.apache.beam.sdk.values.PCollection.<init>:329#8fd0f908e3ea90e3
May 29, 2018 8:03:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:03:21.701Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Reify, through flatten PAssert$33/GroupGlobally/FlattenDummyAndContents, into producer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map
May 29, 2018 8:03:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:03:21.737Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow into PAssert$33/GroupGlobally/GroupDummyAndContents/Read
May 29, 2018 8:03:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:03:21.778Z: Fusing consumer PAssert$33/GroupGlobally/ParDo(Concat) into PAssert$33/GroupGlobally/Values/Values/Map
May 29, 2018 8:03:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:03:21.809Z: Fusing consumer PAssert$33/GetPane/Map into PAssert$33/GroupGlobally/ParDo(Concat)
May 29, 2018 8:03:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:03:21.852Z: Fusing consumer PAssert$33/GroupGlobally/Values/Values/Map into PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow
May 29, 2018 8:03:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:03:21.893Z: Fusing consumer PAssert$33/RunChecks into PAssert$33/GetPane/Map
May 29, 2018 8:03:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:03:21.935Z: Fusing consumer PAssert$33/VerifyAssertions/ParDo(DefaultConclude) into PAssert$33/RunChecks
May 29, 2018 8:03:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:03:21.977Z: Unzipping flatten s24-u45 for input s26-reify-value18-c43
May 29, 2018 8:03:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:03:22.022Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Write, through flatten s24-u45, into producer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 29, 2018 8:03:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:03:22.069Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify into PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
May 29, 2018 8:03:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:03:22.105Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Write into PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 29, 2018 8:03:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:03:22.146Z: Fusing consumer PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)
May 29, 2018 8:03:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:03:22.191Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
May 29, 2018 8:03:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:03:22.238Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
May 29, 2018 8:03:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:03:22.277Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into PAssert$33/GroupGlobally/Window.Into()/Window.Assign
May 29, 2018 8:03:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:03:22.322Z: Fusing consumer OutputSideInputs into Create123/Read(CreateSource)
May 29, 2018 8:03:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:03:22.363Z: Fusing consumer PAssert$33/GroupGlobally/Window.Into()/Window.Assign into OutputSideInputs
May 29, 2018 8:03:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:03:22.400Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
May 29, 2018 8:03:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:03:22.444Z: Fusing consumer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map into PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
May 29, 2018 8:03:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:03:22.484Z: Fusing consumer PAssert$33/GroupGlobally/RewindowActuals/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map
May 29, 2018 8:03:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:03:22.530Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read
May 29, 2018 8:03:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:03:22.574Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
May 29, 2018 8:03:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:03:22.618Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
May 29, 2018 8:03:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:03:22.665Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
May 29, 2018 8:03:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:03:22.709Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
May 29, 2018 8:03:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:03:22.746Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
May 29, 2018 8:03:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:03:22.793Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into Create47/Read(CreateSource)
May 29, 2018 8:03:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:03:22.838Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
May 29, 2018 8:03:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:03:22.880Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
May 29, 2018 8:03:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:03:22.923Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
May 29, 2018 8:03:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:03:22.968Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
May 29, 2018 8:03:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:03:23.012Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
May 29, 2018 8:03:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:03:23.051Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
May 29, 2018 8:03:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:03:23.513Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Create
May 29, 2018 8:03:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:03:23.543Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Create
May 29, 2018 8:03:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:03:23.582Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
May 29, 2018 8:03:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:03:23.593Z: Starting 1 workers in us-central1-b...
May 29, 2018 8:03:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:03:23.624Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
May 29, 2018 8:03:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:03:23.853Z: Executing operation Create47/Read(CreateSource)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
May 29, 2018 8:03:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:03:23.899Z: Executing operation PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 29, 2018 8:03:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:03:33.875Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
May 29, 2018 8:03:45 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:03:44.598Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
May 29, 2018 8:03:45 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:03:44.648Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 29, 2018 8:04:04 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:04:03.880Z: Workers have started successfully.
May 29, 2018 8:04:39 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:04:37.559Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
May 29, 2018 8:04:39 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:04:37.650Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
May 29, 2018 8:04:47 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:04:45.925Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
May 29, 2018 8:04:47 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:04:46.013Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
May 29, 2018 8:04:59 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:04:57.911Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
May 29, 2018 8:04:59 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:04:58.112Z: Executing operation Create123/Read(CreateSource)+OutputSideInputs+PAssert$33/GroupGlobally/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write
May 29, 2018 8:05:05 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:05:04.028Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Close
May 29, 2018 8:05:05 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:05:04.111Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$33/GroupGlobally/RewindowActuals/Window.Assign+PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 29, 2018 8:05:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:05:06.996Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Close
May 29, 2018 8:05:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:05:07.105Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Read+PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$33/GroupGlobally/Values/Values/Map+PAssert$33/GroupGlobally/ParDo(Concat)+PAssert$33/GetPane/Map+PAssert$33/RunChecks+PAssert$33/VerifyAssertions/ParDo(DefaultConclude)
May 29, 2018 8:05:11 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:05:10.290Z: Cleaning up.
May 29, 2018 8:05:11 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:05:10.410Z: Stopping worker pool...
May 29, 2018 8:06:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:06:52.521Z: Autoscaling: Resized worker pool from 1 to 0.
May 29, 2018 8:06:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:06:52.566Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 29, 2018 8:06:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:06:52.613Z: Worker pool stopped.
May 29, 2018 8:07:02 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-05-29_01_03_13-12526082984653603654 finished with status DONE.
May 29, 2018 8:07:02 AM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-05-29_01_03_13-12526082984653603654. Found 1 success, 0 failures out of 1 expected assertions.
Gradle Test Executor 39 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest
209 tests completed, 34 failed, 2 skipped
Finished generating test XML results (0.632 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerTest>
Generating HTML test report...
Finished generating test html results (0.519 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest>
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest FAILED
:beam-runners-google-cloud-dataflow-java:validatesRunnerTest (Thread[Task worker for ':' Thread 19,5,main]) completed. Took 2 hrs 5 mins 2.429 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:validatesRunnerTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 6m 21s
38 actionable tasks: 34 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/d6z3rx6nsxzra
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user katarzyna.kucharczyk@polidea.com
Not sending mail to unregistered user robbe.sneyders@ml6.eu
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user schroederc@google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ammons@google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user sidhom@google.com
Build failed in Jenkins:
beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #368
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/368/display/redirect>
------------------------------------------
[...truncated 18.07 MB...]
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign as step s15
May 29, 2018 2:03:00 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey as step s16
May 29, 2018 2:03:00 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map as step s17
May 29, 2018 2:03:00 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RewindowActuals/Window.Assign as step s18
May 29, 2018 2:03:00 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map as step s19
May 29, 2018 2:03:00 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveActualsTriggering/Flatten.PCollections as step s20
May 29, 2018 2:03:00 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Create.Values/Read(CreateSource) as step s21
May 29, 2018 2:03:00 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign as step s22
May 29, 2018 2:03:00 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveDummyTriggering/Flatten.PCollections as step s23
May 29, 2018 2:03:00 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/FlattenDummyAndContents as step s24
May 29, 2018 2:03:00 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/NeverTrigger/Flatten.PCollections as step s25
May 29, 2018 2:03:00 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GroupDummyAndContents as step s26
May 29, 2018 2:03:00 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Values/Values/Map as step s27
May 29, 2018 2:03:00 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/ParDo(Concat) as step s28
May 29, 2018 2:03:00 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GetPane/Map as step s29
May 29, 2018 2:03:00 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/RunChecks as step s30
May 29, 2018 2:03:00 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/VerifyAssertions/ParDo(DefaultConclude) as step s31
May 29, 2018 2:03:00 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0529020257-87622d4f/output/results/staging/
May 29, 2018 2:03:00 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <71120 bytes, hash DaNaYyuZ7dtjiV3nJHuKhA> to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0529020257-87622d4f/output/results/staging/pipeline-DaNaYyuZ7dtjiV3nJHuKhA.pb
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 29, 2018 2:03:02 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-05-28_19_03_01-13697804118624917740?project=apache-beam-testing
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Submitted job: 2018-05-28_19_03_01-13697804118624917740
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 29, 2018 2:03:02 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-05-28_19_03_01-13697804118624917740
May 29, 2018 2:03:02 AM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-05-28_19_03_01-13697804118624917740 with 1 expected assertions.
May 29, 2018 2:03:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:03:01.262Z: Autoscaling is enabled for job 2018-05-28_19_03_01-13697804118624917740. The number of workers will be between 1 and 1000.
May 29, 2018 2:03:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:03:01.308Z: Autoscaling was automatically enabled for job 2018-05-28_19_03_01-13697804118624917740.
May 29, 2018 2:03:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:03:04.641Z: Checking required Cloud APIs are enabled.
May 29, 2018 2:03:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:03:04.830Z: Checking permissions granted to controller Service Account.
May 29, 2018 2:03:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:03:10.036Z: Worker configuration: n1-standard-1 in us-central1-b.
May 29, 2018 2:03:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:03:10.440Z: Expanding CoGroupByKey operations into optimizable parts.
May 29, 2018 2:03:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:03:10.615Z: Expanding GroupByKey operations into optimizable parts.
May 29, 2018 2:03:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:03:10.657Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
May 29, 2018 2:03:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:03:10.885Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
May 29, 2018 2:03:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:03:10.923Z: Elided trivial flatten
May 29, 2018 2:03:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:03:10.962Z: Elided trivial flatten
May 29, 2018 2:03:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:03:11.007Z: Elided trivial flatten
May 29, 2018 2:03:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:03:11.057Z: Unzipping flatten s24 for input s19.org.apache.beam.sdk.values.PCollection.<init>:329#8fd0f908e3ea90e3
May 29, 2018 2:03:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:03:11.097Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Reify, through flatten PAssert$33/GroupGlobally/FlattenDummyAndContents, into producer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map
May 29, 2018 2:03:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:03:11.139Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow into PAssert$33/GroupGlobally/GroupDummyAndContents/Read
May 29, 2018 2:03:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:03:11.177Z: Fusing consumer PAssert$33/GroupGlobally/ParDo(Concat) into PAssert$33/GroupGlobally/Values/Values/Map
May 29, 2018 2:03:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:03:11.217Z: Fusing consumer PAssert$33/GetPane/Map into PAssert$33/GroupGlobally/ParDo(Concat)
May 29, 2018 2:03:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:03:11.255Z: Fusing consumer PAssert$33/GroupGlobally/Values/Values/Map into PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow
May 29, 2018 2:03:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:03:11.306Z: Fusing consumer PAssert$33/RunChecks into PAssert$33/GetPane/Map
May 29, 2018 2:03:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:03:11.354Z: Fusing consumer PAssert$33/VerifyAssertions/ParDo(DefaultConclude) into PAssert$33/RunChecks
May 29, 2018 2:03:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:03:11.394Z: Unzipping flatten s24-u45 for input s26-reify-value18-c43
May 29, 2018 2:03:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:03:11.445Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Write, through flatten s24-u45, into producer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 29, 2018 2:03:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:03:11.495Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify into PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
May 29, 2018 2:03:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:03:11.541Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Write into PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 29, 2018 2:03:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:03:11.586Z: Fusing consumer PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)
May 29, 2018 2:03:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:03:11.620Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
May 29, 2018 2:03:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:03:11.674Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
May 29, 2018 2:03:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:03:11.721Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into PAssert$33/GroupGlobally/Window.Into()/Window.Assign
May 29, 2018 2:03:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:03:11.765Z: Fusing consumer OutputSideInputs into Create123/Read(CreateSource)
May 29, 2018 2:03:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:03:11.801Z: Fusing consumer PAssert$33/GroupGlobally/Window.Into()/Window.Assign into OutputSideInputs
May 29, 2018 2:03:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:03:11.848Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
May 29, 2018 2:03:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:03:11.894Z: Fusing consumer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map into PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
May 29, 2018 2:03:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:03:11.942Z: Fusing consumer PAssert$33/GroupGlobally/RewindowActuals/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map
May 29, 2018 2:03:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:03:11.979Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read
May 29, 2018 2:03:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:03:12.019Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
May 29, 2018 2:03:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:03:12.053Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
May 29, 2018 2:03:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:03:12.105Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
May 29, 2018 2:03:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:03:12.152Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
May 29, 2018 2:03:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:03:12.203Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
May 29, 2018 2:03:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:03:12.244Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into Create47/Read(CreateSource)
May 29, 2018 2:03:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:03:12.297Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
May 29, 2018 2:03:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:03:12.342Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
May 29, 2018 2:03:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:03:12.388Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
May 29, 2018 2:03:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:03:12.436Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
May 29, 2018 2:03:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:03:12.480Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
May 29, 2018 2:03:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:03:12.524Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
May 29, 2018 2:03:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:03:13.051Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Create
May 29, 2018 2:03:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:03:13.105Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Create
May 29, 2018 2:03:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:03:13.152Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
May 29, 2018 2:03:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:03:13.164Z: Starting 1 workers in us-central1-b...
May 29, 2018 2:03:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:03:13.200Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
May 29, 2018 2:03:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:03:13.459Z: Executing operation Create47/Read(CreateSource)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
May 29, 2018 2:03:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:03:13.514Z: Executing operation PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 29, 2018 2:03:24 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:03:23.261Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
May 29, 2018 2:03:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:03:33.995Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
May 29, 2018 2:03:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:03:34.026Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 29, 2018 2:03:57 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:03:56.284Z: Workers have started successfully.
May 29, 2018 2:04:20 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:04:18.920Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
May 29, 2018 2:04:20 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:04:19.010Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
May 29, 2018 2:04:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:04:37.805Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
May 29, 2018 2:04:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:04:37.889Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
May 29, 2018 2:04:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:04:50.446Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
May 29, 2018 2:04:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:04:50.606Z: Executing operation Create123/Read(CreateSource)+OutputSideInputs+PAssert$33/GroupGlobally/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write
May 29, 2018 2:04:56 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:04:56.152Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Close
May 29, 2018 2:04:56 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:04:56.228Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$33/GroupGlobally/RewindowActuals/Window.Assign+PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 29, 2018 2:05:01 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:05:00.904Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Close
May 29, 2018 2:05:01 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:05:00.985Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Read+PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$33/GroupGlobally/Values/Values/Map+PAssert$33/GroupGlobally/ParDo(Concat)+PAssert$33/GetPane/Map+PAssert$33/RunChecks+PAssert$33/VerifyAssertions/ParDo(DefaultConclude)
May 29, 2018 2:05:06 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:05:05.011Z: Cleaning up.
May 29, 2018 2:05:06 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:05:05.101Z: Stopping worker pool...
May 29, 2018 2:06:45 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:06:45.273Z: Autoscaling: Resized worker pool from 1 to 0.
May 29, 2018 2:06:45 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:06:45.312Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 29, 2018 2:06:54 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-05-28_19_03_01-13697804118624917740 finished with status DONE.
May 29, 2018 2:06:54 AM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-05-28_19_03_01-13697804118624917740. Found 1 success, 0 failures out of 1 expected assertions.
Gradle Test Executor 38 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest FAILED
209 tests completed, 34 failed, 2 skipped
Finished generating test XML results (0.652 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerTest>
Generating HTML test report...
Finished generating test html results (0.499 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest>
:beam-runners-google-cloud-dataflow-java:validatesRunnerTest (Thread[Task worker for ':' Thread 12,5,main]) completed. Took 2 hrs 5 mins 24.297 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:validatesRunnerTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 6m 18s
38 actionable tasks: 34 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/th4x6sigixm6y
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user katarzyna.kucharczyk@polidea.com
Not sending mail to unregistered user robbe.sneyders@ml6.eu
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user schroederc@google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ammons@google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user sidhom@google.com
Build failed in Jenkins:
beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #367
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/367/display/redirect>
------------------------------------------
[...truncated 18.09 MB...]
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey as step s16
May 28, 2018 8:08:52 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map as step s17
May 28, 2018 8:08:52 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RewindowActuals/Window.Assign as step s18
May 28, 2018 8:08:52 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map as step s19
May 28, 2018 8:08:52 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveActualsTriggering/Flatten.PCollections as step s20
May 28, 2018 8:08:52 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Create.Values/Read(CreateSource) as step s21
May 28, 2018 8:08:52 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign as step s22
May 28, 2018 8:08:52 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveDummyTriggering/Flatten.PCollections as step s23
May 28, 2018 8:08:52 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/FlattenDummyAndContents as step s24
May 28, 2018 8:08:52 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/NeverTrigger/Flatten.PCollections as step s25
May 28, 2018 8:08:52 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GroupDummyAndContents as step s26
May 28, 2018 8:08:52 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Values/Values/Map as step s27
May 28, 2018 8:08:52 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/ParDo(Concat) as step s28
May 28, 2018 8:08:52 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GetPane/Map as step s29
May 28, 2018 8:08:52 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/RunChecks as step s30
May 28, 2018 8:08:52 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/VerifyAssertions/ParDo(DefaultConclude) as step s31
May 28, 2018 8:08:52 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0528200849-6c33f46e/output/results/staging/
May 28, 2018 8:08:53 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <71120 bytes, hash 313FhuBZZQAMjIw226tldw> to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0528200849-6c33f46e/output/results/staging/pipeline-313FhuBZZQAMjIw226tldw.pb
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 28, 2018 8:08:54 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-05-28_13_08_53-1729043576820431779?project=apache-beam-testing
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Submitted job: 2018-05-28_13_08_53-1729043576820431779
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 28, 2018 8:08:54 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-05-28_13_08_53-1729043576820431779
May 28, 2018 8:08:54 PM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-05-28_13_08_53-1729043576820431779 with 1 expected assertions.
May 28, 2018 8:09:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:08:53.839Z: Autoscaling is enabled for job 2018-05-28_13_08_53-1729043576820431779. The number of workers will be between 1 and 1000.
May 28, 2018 8:09:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:08:53.883Z: Autoscaling was automatically enabled for job 2018-05-28_13_08_53-1729043576820431779.
May 28, 2018 8:09:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:08:56.295Z: Checking required Cloud APIs are enabled.
May 28, 2018 8:09:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:08:56.487Z: Checking permissions granted to controller Service Account.
May 28, 2018 8:09:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:09:10.278Z: Worker configuration: n1-standard-1 in us-central1-b.
May 28, 2018 8:09:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:09:10.817Z: Expanding CoGroupByKey operations into optimizable parts.
May 28, 2018 8:09:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:09:10.967Z: Expanding GroupByKey operations into optimizable parts.
May 28, 2018 8:09:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:09:11.013Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
May 28, 2018 8:09:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:09:11.246Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
May 28, 2018 8:09:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:09:11.287Z: Elided trivial flatten
May 28, 2018 8:09:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:09:11.326Z: Elided trivial flatten
May 28, 2018 8:09:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:09:11.365Z: Elided trivial flatten
May 28, 2018 8:09:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:09:11.411Z: Unzipping flatten s24 for input s19.org.apache.beam.sdk.values.PCollection.<init>:329#8fd0f908e3ea90e3
May 28, 2018 8:09:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:09:11.461Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Reify, through flatten PAssert$33/GroupGlobally/FlattenDummyAndContents, into producer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map
May 28, 2018 8:09:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:09:11.500Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow into PAssert$33/GroupGlobally/GroupDummyAndContents/Read
May 28, 2018 8:09:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:09:11.530Z: Fusing consumer PAssert$33/GroupGlobally/ParDo(Concat) into PAssert$33/GroupGlobally/Values/Values/Map
May 28, 2018 8:09:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:09:11.576Z: Fusing consumer PAssert$33/GetPane/Map into PAssert$33/GroupGlobally/ParDo(Concat)
May 28, 2018 8:09:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:09:11.615Z: Fusing consumer PAssert$33/GroupGlobally/Values/Values/Map into PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow
May 28, 2018 8:09:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:09:11.659Z: Fusing consumer PAssert$33/RunChecks into PAssert$33/GetPane/Map
May 28, 2018 8:09:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:09:11.686Z: Fusing consumer PAssert$33/VerifyAssertions/ParDo(DefaultConclude) into PAssert$33/RunChecks
May 28, 2018 8:09:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:09:11.733Z: Unzipping flatten s24-u45 for input s26-reify-value18-c43
May 28, 2018 8:09:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:09:11.779Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Write, through flatten s24-u45, into producer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 28, 2018 8:09:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:09:11.823Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify into PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
May 28, 2018 8:09:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:09:11.860Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Write into PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 28, 2018 8:09:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:09:11.909Z: Fusing consumer PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)
May 28, 2018 8:09:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:09:11.950Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
May 28, 2018 8:09:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:09:11.986Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
May 28, 2018 8:09:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:09:12.023Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into PAssert$33/GroupGlobally/Window.Into()/Window.Assign
May 28, 2018 8:09:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:09:12.044Z: Fusing consumer OutputSideInputs into Create123/Read(CreateSource)
May 28, 2018 8:09:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:09:12.081Z: Fusing consumer PAssert$33/GroupGlobally/Window.Into()/Window.Assign into OutputSideInputs
May 28, 2018 8:09:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:09:12.124Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
May 28, 2018 8:09:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:09:12.167Z: Fusing consumer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map into PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
May 28, 2018 8:09:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:09:12.209Z: Fusing consumer PAssert$33/GroupGlobally/RewindowActuals/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map
May 28, 2018 8:09:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:09:12.255Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read
May 28, 2018 8:09:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:09:12.301Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
May 28, 2018 8:09:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:09:12.335Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
May 28, 2018 8:09:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:09:12.375Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
May 28, 2018 8:09:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:09:12.412Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
May 28, 2018 8:09:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:09:12.447Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
May 28, 2018 8:09:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:09:12.483Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into Create47/Read(CreateSource)
May 28, 2018 8:09:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:09:12.515Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
May 28, 2018 8:09:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:09:12.560Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
May 28, 2018 8:09:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:09:12.606Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
May 28, 2018 8:09:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:09:12.644Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
May 28, 2018 8:09:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:09:12.688Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
May 28, 2018 8:09:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:09:12.735Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
May 28, 2018 8:09:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:09:13.168Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Create
May 28, 2018 8:09:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:09:13.208Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Create
May 28, 2018 8:09:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:09:13.255Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
May 28, 2018 8:09:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:09:13.267Z: Starting 1 workers in us-central1-b...
May 28, 2018 8:09:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:09:13.299Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
May 28, 2018 8:09:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:09:13.550Z: Executing operation PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 28, 2018 8:09:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:09:13.591Z: Executing operation Create47/Read(CreateSource)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
May 28, 2018 8:09:25 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:09:24.141Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
May 28, 2018 8:09:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:09:34.703Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
May 28, 2018 8:09:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:09:34.741Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 28, 2018 8:09:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:09:58.975Z: Workers have started successfully.
May 28, 2018 8:10:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:10:16.810Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
May 28, 2018 8:10:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:10:16.863Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
May 28, 2018 8:10:24 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:10:22.588Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
May 28, 2018 8:10:24 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:10:22.643Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
May 28, 2018 8:10:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:10:36.044Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
May 28, 2018 8:10:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:10:36.220Z: Executing operation Create123/Read(CreateSource)+OutputSideInputs+PAssert$33/GroupGlobally/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write
May 28, 2018 8:10:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:10:41.746Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Close
May 28, 2018 8:10:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:10:41.847Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$33/GroupGlobally/RewindowActuals/Window.Assign+PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 28, 2018 8:10:46 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:10:46.282Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Close
May 28, 2018 8:10:46 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:10:46.360Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Read+PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$33/GroupGlobally/Values/Values/Map+PAssert$33/GroupGlobally/ParDo(Concat)+PAssert$33/GetPane/Map+PAssert$33/RunChecks+PAssert$33/VerifyAssertions/ParDo(DefaultConclude)
May 28, 2018 8:10:50 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:10:50.087Z: Cleaning up.
May 28, 2018 8:10:50 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:10:50.222Z: Stopping worker pool...
May 28, 2018 8:12:50 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:12:48.782Z: Autoscaling: Resized worker pool from 1 to 0.
May 28, 2018 8:12:50 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:12:48.907Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 28, 2018 8:12:50 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:12:48.957Z: Worker pool stopped.
May 28, 2018 8:12:56 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-05-28_13_08_53-1729043576820431779 finished with status DONE.
May 28, 2018 8:12:57 PM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-05-28_13_08_53-1729043576820431779. Found 1 success, 0 failures out of 1 expected assertions.
Gradle Test Executor 35 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest FAILED
209 tests completed, 34 failed, 2 skipped
Finished generating test XML results (0.73 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerTest>
Generating HTML test report...
Finished generating test html results (0.436 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest>
:beam-runners-google-cloud-dataflow-java:validatesRunnerTest (Thread[Task worker for ':' Thread 40,5,main]) completed. Took 2 hrs 11 mins 9.03 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:validatesRunnerTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 12m 20s
38 actionable tasks: 34 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/v5vwr5ojtlmim
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user katarzyna.kucharczyk@polidea.com
Not sending mail to unregistered user robbe.sneyders@ml6.eu
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user schroederc@google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ammons@google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user sidhom@google.com
Build failed in Jenkins:
beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #366
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/366/display/redirect?page=changes>
Changes:
[iemejia] Refine dependencies, make new ones explicit and minor maven plugins
------------------------------------------
[...truncated 18.07 MB...]
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign as step s15
May 28, 2018 4:04:44 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey as step s16
May 28, 2018 4:04:44 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map as step s17
May 28, 2018 4:04:44 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RewindowActuals/Window.Assign as step s18
May 28, 2018 4:04:44 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map as step s19
May 28, 2018 4:04:44 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveActualsTriggering/Flatten.PCollections as step s20
May 28, 2018 4:04:44 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Create.Values/Read(CreateSource) as step s21
May 28, 2018 4:04:44 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign as step s22
May 28, 2018 4:04:44 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveDummyTriggering/Flatten.PCollections as step s23
May 28, 2018 4:04:44 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/FlattenDummyAndContents as step s24
May 28, 2018 4:04:44 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/NeverTrigger/Flatten.PCollections as step s25
May 28, 2018 4:04:44 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GroupDummyAndContents as step s26
May 28, 2018 4:04:44 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Values/Values/Map as step s27
May 28, 2018 4:04:44 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/ParDo(Concat) as step s28
May 28, 2018 4:04:44 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GetPane/Map as step s29
May 28, 2018 4:04:44 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/RunChecks as step s30
May 28, 2018 4:04:44 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/VerifyAssertions/ParDo(DefaultConclude) as step s31
May 28, 2018 4:04:44 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0528160441-aad7a812/output/results/staging/
May 28, 2018 4:04:44 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <71120 bytes, hash sDO54lzHnncWqfW3Uzb7-A> to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0528160441-aad7a812/output/results/staging/pipeline-sDO54lzHnncWqfW3Uzb7-A.pb
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 28, 2018 4:04:45 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-05-28_09_04_44-10792389488258178972?project=apache-beam-testing
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Submitted job: 2018-05-28_09_04_44-10792389488258178972
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 28, 2018 4:04:45 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-05-28_09_04_44-10792389488258178972
May 28, 2018 4:04:45 PM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-05-28_09_04_44-10792389488258178972 with 1 expected assertions.
May 28, 2018 4:05:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:04:44.776Z: Autoscaling is enabled for job 2018-05-28_09_04_44-10792389488258178972. The number of workers will be between 1 and 1000.
May 28, 2018 4:05:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:04:44.816Z: Autoscaling was automatically enabled for job 2018-05-28_09_04_44-10792389488258178972.
May 28, 2018 4:05:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:04:47.151Z: Checking required Cloud APIs are enabled.
May 28, 2018 4:05:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:04:47.451Z: Checking permissions granted to controller Service Account.
May 28, 2018 4:05:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:04:54.907Z: Worker configuration: n1-standard-1 in us-central1-b.
May 28, 2018 4:05:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:04:55.279Z: Expanding CoGroupByKey operations into optimizable parts.
May 28, 2018 4:05:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:04:55.451Z: Expanding GroupByKey operations into optimizable parts.
May 28, 2018 4:05:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:04:55.492Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
May 28, 2018 4:05:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:04:55.702Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
May 28, 2018 4:05:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:04:55.748Z: Elided trivial flatten
May 28, 2018 4:05:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:04:55.780Z: Elided trivial flatten
May 28, 2018 4:05:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:04:55.821Z: Elided trivial flatten
May 28, 2018 4:05:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:04:55.868Z: Unzipping flatten s24 for input s19.org.apache.beam.sdk.values.PCollection.<init>:329#8fd0f908e3ea90e3
May 28, 2018 4:05:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:04:55.916Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Reify, through flatten PAssert$33/GroupGlobally/FlattenDummyAndContents, into producer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map
May 28, 2018 4:05:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:04:55.963Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow into PAssert$33/GroupGlobally/GroupDummyAndContents/Read
May 28, 2018 4:05:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:04:55.997Z: Fusing consumer PAssert$33/GroupGlobally/ParDo(Concat) into PAssert$33/GroupGlobally/Values/Values/Map
May 28, 2018 4:05:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:04:56.042Z: Fusing consumer PAssert$33/GetPane/Map into PAssert$33/GroupGlobally/ParDo(Concat)
May 28, 2018 4:05:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:04:56.080Z: Fusing consumer PAssert$33/GroupGlobally/Values/Values/Map into PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow
May 28, 2018 4:05:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:04:56.125Z: Fusing consumer PAssert$33/RunChecks into PAssert$33/GetPane/Map
May 28, 2018 4:05:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:04:56.174Z: Fusing consumer PAssert$33/VerifyAssertions/ParDo(DefaultConclude) into PAssert$33/RunChecks
May 28, 2018 4:05:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:04:56.215Z: Unzipping flatten s24-u45 for input s26-reify-value18-c43
May 28, 2018 4:05:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:04:56.257Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Write, through flatten s24-u45, into producer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 28, 2018 4:05:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:04:56.295Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify into PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
May 28, 2018 4:05:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:04:56.333Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Write into PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 28, 2018 4:05:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:04:56.378Z: Fusing consumer PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)
May 28, 2018 4:05:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:04:56.416Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
May 28, 2018 4:05:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:04:56.450Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
May 28, 2018 4:05:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:04:56.488Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into PAssert$33/GroupGlobally/Window.Into()/Window.Assign
May 28, 2018 4:05:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:04:56.533Z: Fusing consumer OutputSideInputs into Create123/Read(CreateSource)
May 28, 2018 4:05:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:04:56.578Z: Fusing consumer PAssert$33/GroupGlobally/Window.Into()/Window.Assign into OutputSideInputs
May 28, 2018 4:05:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:04:56.624Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
May 28, 2018 4:05:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:04:56.665Z: Fusing consumer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map into PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
May 28, 2018 4:05:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:04:56.706Z: Fusing consumer PAssert$33/GroupGlobally/RewindowActuals/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map
May 28, 2018 4:05:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:04:56.751Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read
May 28, 2018 4:05:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:04:56.797Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
May 28, 2018 4:05:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:04:56.832Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
May 28, 2018 4:05:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:04:56.876Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
May 28, 2018 4:05:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:04:56.923Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
May 28, 2018 4:05:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:04:56.957Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
May 28, 2018 4:05:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:04:56.998Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into Create47/Read(CreateSource)
May 28, 2018 4:05:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:04:57.035Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
May 28, 2018 4:05:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:04:57.080Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
May 28, 2018 4:05:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:04:57.128Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
May 28, 2018 4:05:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:04:57.175Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
May 28, 2018 4:05:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:04:57.212Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
May 28, 2018 4:05:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:04:57.259Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
May 28, 2018 4:05:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:04:57.673Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Create
May 28, 2018 4:05:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:04:57.704Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Create
May 28, 2018 4:05:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:04:57.739Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
May 28, 2018 4:05:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:04:57.773Z: Starting 1 workers in us-central1-b...
May 28, 2018 4:05:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:04:57.773Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
May 28, 2018 4:05:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:04:57.961Z: Executing operation PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 28, 2018 4:05:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:04:58.016Z: Executing operation Create47/Read(CreateSource)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
May 28, 2018 4:05:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:05:05.573Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
May 28, 2018 4:05:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:05:16.156Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
May 28, 2018 4:05:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:05:16.194Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 28, 2018 4:05:43 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:05:42.603Z: Workers have started successfully.
May 28, 2018 4:05:57 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:05:57.423Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
May 28, 2018 4:05:57 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:05:57.516Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
May 28, 2018 4:06:07 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:06:06.268Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
May 28, 2018 4:06:07 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:06:06.356Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
May 28, 2018 4:06:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:06:19.952Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
May 28, 2018 4:06:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:06:20.137Z: Executing operation Create123/Read(CreateSource)+OutputSideInputs+PAssert$33/GroupGlobally/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write
May 28, 2018 4:06:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:06:24.728Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Close
May 28, 2018 4:06:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:06:24.823Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$33/GroupGlobally/RewindowActuals/Window.Assign+PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 28, 2018 4:06:29 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:06:28.506Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Close
May 28, 2018 4:06:29 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:06:28.593Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Read+PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$33/GroupGlobally/Values/Values/Map+PAssert$33/GroupGlobally/ParDo(Concat)+PAssert$33/GetPane/Map+PAssert$33/RunChecks+PAssert$33/VerifyAssertions/ParDo(DefaultConclude)
May 28, 2018 4:06:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:06:32.819Z: Cleaning up.
May 28, 2018 4:06:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:06:32.923Z: Stopping worker pool...
May 28, 2018 4:08:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:08:15.497Z: Autoscaling: Resized worker pool from 1 to 0.
May 28, 2018 4:08:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:08:15.543Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 28, 2018 4:08:25 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-05-28_09_04_44-10792389488258178972 finished with status DONE.
May 28, 2018 4:08:25 PM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-05-28_09_04_44-10792389488258178972. Found 1 success, 0 failures out of 1 expected assertions.
Gradle Test Executor 36 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest FAILED
209 tests completed, 34 failed, 2 skipped
Finished generating test XML results (0.731 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerTest>
Generating HTML test report...
Finished generating test html results (0.367 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest>
:beam-runners-google-cloud-dataflow-java:validatesRunnerTest (Thread[Task worker for ':' Thread 2,5,main]) completed. Took 2 hrs 3 mins 47.444 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:validatesRunnerTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 4m 41s
38 actionable tasks: 34 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/pw7ehlqxaf6kw
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user katarzyna.kucharczyk@polidea.com
Not sending mail to unregistered user robbe.sneyders@ml6.eu
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user schroederc@google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ammons@google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user sidhom@google.com
Build failed in Jenkins:
beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #365
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/365/display/redirect>
------------------------------------------
[...truncated 18.13 MB...]
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey as step s16
May 28, 2018 1:59:58 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map as step s17
May 28, 2018 1:59:58 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RewindowActuals/Window.Assign as step s18
May 28, 2018 1:59:58 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map as step s19
May 28, 2018 1:59:58 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveActualsTriggering/Flatten.PCollections as step s20
May 28, 2018 1:59:58 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Create.Values/Read(CreateSource) as step s21
May 28, 2018 1:59:58 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign as step s22
May 28, 2018 1:59:58 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveDummyTriggering/Flatten.PCollections as step s23
May 28, 2018 1:59:58 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/FlattenDummyAndContents as step s24
May 28, 2018 1:59:58 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/NeverTrigger/Flatten.PCollections as step s25
May 28, 2018 1:59:58 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GroupDummyAndContents as step s26
May 28, 2018 1:59:58 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Values/Values/Map as step s27
May 28, 2018 1:59:58 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/ParDo(Concat) as step s28
May 28, 2018 1:59:58 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GetPane/Map as step s29
May 28, 2018 1:59:58 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/RunChecks as step s30
May 28, 2018 1:59:58 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/VerifyAssertions/ParDo(DefaultConclude) as step s31
May 28, 2018 1:59:58 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0528135954-c31ceaa/output/results/staging/
May 28, 2018 1:59:58 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <71120 bytes, hash uezJoAtHowg_kN_E2rXRdQ> to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0528135954-c31ceaa/output/results/staging/pipeline-uezJoAtHowg_kN_E2rXRdQ.pb
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 28, 2018 1:59:59 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-05-28_06_59_58-18180271460954501526?project=apache-beam-testing
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Submitted job: 2018-05-28_06_59_58-18180271460954501526
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 28, 2018 1:59:59 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-05-28_06_59_58-18180271460954501526
May 28, 2018 1:59:59 PM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-05-28_06_59_58-18180271460954501526 with 1 expected assertions.
May 28, 2018 2:00:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T13:59:58.646Z: Autoscaling is enabled for job 2018-05-28_06_59_58-18180271460954501526. The number of workers will be between 1 and 1000.
May 28, 2018 2:00:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T13:59:58.693Z: Autoscaling was automatically enabled for job 2018-05-28_06_59_58-18180271460954501526.
May 28, 2018 2:00:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:00:01.628Z: Checking required Cloud APIs are enabled.
May 28, 2018 2:00:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:00:01.805Z: Checking permissions granted to controller Service Account.
May 28, 2018 2:00:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:00:08.373Z: Worker configuration: n1-standard-1 in us-central1-f.
May 28, 2018 2:00:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:00:08.841Z: Expanding CoGroupByKey operations into optimizable parts.
May 28, 2018 2:00:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:00:09.021Z: Expanding GroupByKey operations into optimizable parts.
May 28, 2018 2:00:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:00:09.060Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
May 28, 2018 2:00:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:00:09.286Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
May 28, 2018 2:00:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:00:09.330Z: Elided trivial flatten
May 28, 2018 2:00:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:00:09.374Z: Elided trivial flatten
May 28, 2018 2:00:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:00:09.414Z: Elided trivial flatten
May 28, 2018 2:00:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:00:09.463Z: Unzipping flatten s24 for input s19.org.apache.beam.sdk.values.PCollection.<init>:329#8fd0f908e3ea90e3
May 28, 2018 2:00:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:00:09.507Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Reify, through flatten PAssert$33/GroupGlobally/FlattenDummyAndContents, into producer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map
May 28, 2018 2:00:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:00:09.553Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow into PAssert$33/GroupGlobally/GroupDummyAndContents/Read
May 28, 2018 2:00:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:00:09.599Z: Fusing consumer PAssert$33/GroupGlobally/ParDo(Concat) into PAssert$33/GroupGlobally/Values/Values/Map
May 28, 2018 2:00:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:00:09.642Z: Fusing consumer PAssert$33/GetPane/Map into PAssert$33/GroupGlobally/ParDo(Concat)
May 28, 2018 2:00:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:00:09.688Z: Fusing consumer PAssert$33/GroupGlobally/Values/Values/Map into PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow
May 28, 2018 2:00:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:00:09.732Z: Fusing consumer PAssert$33/RunChecks into PAssert$33/GetPane/Map
May 28, 2018 2:00:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:00:09.801Z: Fusing consumer PAssert$33/VerifyAssertions/ParDo(DefaultConclude) into PAssert$33/RunChecks
May 28, 2018 2:00:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:00:09.836Z: Unzipping flatten s24-u45 for input s26-reify-value18-c43
May 28, 2018 2:00:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:00:09.869Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Write, through flatten s24-u45, into producer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 28, 2018 2:00:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:00:09.913Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify into PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
May 28, 2018 2:00:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:00:09.953Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Write into PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 28, 2018 2:00:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:00:09.977Z: Fusing consumer PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)
May 28, 2018 2:00:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:00:10.016Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
May 28, 2018 2:00:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:00:10.058Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
May 28, 2018 2:00:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:00:10.103Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into PAssert$33/GroupGlobally/Window.Into()/Window.Assign
May 28, 2018 2:00:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:00:10.148Z: Fusing consumer OutputSideInputs into Create123/Read(CreateSource)
May 28, 2018 2:00:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:00:10.187Z: Fusing consumer PAssert$33/GroupGlobally/Window.Into()/Window.Assign into OutputSideInputs
May 28, 2018 2:00:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:00:10.236Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
May 28, 2018 2:00:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:00:10.276Z: Fusing consumer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map into PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
May 28, 2018 2:00:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:00:10.303Z: Fusing consumer PAssert$33/GroupGlobally/RewindowActuals/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map
May 28, 2018 2:00:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:00:10.348Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read
May 28, 2018 2:00:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:00:10.400Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
May 28, 2018 2:00:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:00:10.447Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
May 28, 2018 2:00:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:00:10.486Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
May 28, 2018 2:00:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:00:10.534Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
May 28, 2018 2:00:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:00:10.580Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
May 28, 2018 2:00:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:00:10.627Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into Create47/Read(CreateSource)
May 28, 2018 2:00:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:00:10.673Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
May 28, 2018 2:00:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:00:10.718Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
May 28, 2018 2:00:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:00:10.764Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
May 28, 2018 2:00:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:00:10.813Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
May 28, 2018 2:00:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:00:10.858Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
May 28, 2018 2:00:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:00:10.904Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
May 28, 2018 2:00:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:00:11.360Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Create
May 28, 2018 2:00:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:00:11.406Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Create
May 28, 2018 2:00:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:00:11.453Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
May 28, 2018 2:00:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:00:11.462Z: Starting 1 workers in us-central1-f...
May 28, 2018 2:00:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:00:11.490Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
May 28, 2018 2:00:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:00:11.733Z: Executing operation PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 28, 2018 2:00:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:00:11.776Z: Executing operation Create47/Read(CreateSource)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
May 28, 2018 2:00:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:00:18.729Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
May 28, 2018 2:00:29 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:00:29.230Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
May 28, 2018 2:00:29 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:00:29.277Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 28, 2018 2:00:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:00:49.777Z: Workers have started successfully.
May 28, 2018 2:01:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:01:09.666Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
May 28, 2018 2:01:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:01:09.751Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
May 28, 2018 2:01:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:01:16.127Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
May 28, 2018 2:01:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:01:16.220Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
May 28, 2018 2:01:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:01:28.310Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
May 28, 2018 2:01:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:01:28.492Z: Executing operation Create123/Read(CreateSource)+OutputSideInputs+PAssert$33/GroupGlobally/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write
May 28, 2018 2:01:33 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:01:32.860Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Close
May 28, 2018 2:01:33 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:01:32.955Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$33/GroupGlobally/RewindowActuals/Window.Assign+PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 28, 2018 2:01:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:01:36.489Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Close
May 28, 2018 2:01:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:01:36.583Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Read+PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$33/GroupGlobally/Values/Values/Map+PAssert$33/GroupGlobally/ParDo(Concat)+PAssert$33/GetPane/Map+PAssert$33/RunChecks+PAssert$33/VerifyAssertions/ParDo(DefaultConclude)
May 28, 2018 2:01:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:01:41.529Z: Cleaning up.
May 28, 2018 2:01:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:01:41.681Z: Stopping worker pool...
May 28, 2018 2:03:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:03:20.878Z: Autoscaling: Resized worker pool from 1 to 0.
May 28, 2018 2:03:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:03:20.918Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 28, 2018 2:03:30 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-05-28_06_59_58-18180271460954501526 finished with status DONE.
May 28, 2018 2:03:31 PM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-05-28_06_59_58-18180271460954501526. Found 1 success, 0 failures out of 1 expected assertions.
Gradle Test Executor 3 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest
209 tests completed, 34 failed, 2 skipped
Finished generating test XML results (0.682 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerTest>
Generating HTML test report...
Finished generating test html results (0.491 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest>
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest FAILED
:beam-runners-google-cloud-dataflow-java:validatesRunnerTest (Thread[Task worker for ':' Thread 4,5,main]) completed. Took 2 hrs 1 mins 13.527 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:validatesRunnerTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 2m 34s
38 actionable tasks: 34 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/lrhbnnlclfjvk
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user katarzyna.kucharczyk@polidea.com
Not sending mail to unregistered user robbe.sneyders@ml6.eu
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user schroederc@google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ammons@google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user sidhom@google.com
Build failed in Jenkins:
beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #364
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/364/display/redirect>
------------------------------------------
[...truncated 18.07 MB...]
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey as step s16
May 28, 2018 7:57:17 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map as step s17
May 28, 2018 7:57:17 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RewindowActuals/Window.Assign as step s18
May 28, 2018 7:57:17 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map as step s19
May 28, 2018 7:57:17 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveActualsTriggering/Flatten.PCollections as step s20
May 28, 2018 7:57:17 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Create.Values/Read(CreateSource) as step s21
May 28, 2018 7:57:17 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign as step s22
May 28, 2018 7:57:17 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveDummyTriggering/Flatten.PCollections as step s23
May 28, 2018 7:57:17 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/FlattenDummyAndContents as step s24
May 28, 2018 7:57:17 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/NeverTrigger/Flatten.PCollections as step s25
May 28, 2018 7:57:17 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GroupDummyAndContents as step s26
May 28, 2018 7:57:17 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Values/Values/Map as step s27
May 28, 2018 7:57:17 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/ParDo(Concat) as step s28
May 28, 2018 7:57:17 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GetPane/Map as step s29
May 28, 2018 7:57:17 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/RunChecks as step s30
May 28, 2018 7:57:17 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/VerifyAssertions/ParDo(DefaultConclude) as step s31
May 28, 2018 7:57:17 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0528075714-8a33e07e/output/results/staging/
May 28, 2018 7:57:18 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <71120 bytes, hash Jz1m661l_C30RpWGrXUVUQ> to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0528075714-8a33e07e/output/results/staging/pipeline-Jz1m661l_C30RpWGrXUVUQ.pb
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 28, 2018 7:57:19 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-05-28_00_57_18-10301430768425555556?project=apache-beam-testing
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Submitted job: 2018-05-28_00_57_18-10301430768425555556
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 28, 2018 7:57:19 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-05-28_00_57_18-10301430768425555556
May 28, 2018 7:57:19 AM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-05-28_00_57_18-10301430768425555556 with 1 expected assertions.
May 28, 2018 7:57:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:57:18.554Z: Autoscaling is enabled for job 2018-05-28_00_57_18-10301430768425555556. The number of workers will be between 1 and 1000.
May 28, 2018 7:57:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:57:18.588Z: Autoscaling was automatically enabled for job 2018-05-28_00_57_18-10301430768425555556.
May 28, 2018 7:57:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:57:21.099Z: Checking required Cloud APIs are enabled.
May 28, 2018 7:57:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:57:21.348Z: Checking permissions granted to controller Service Account.
May 28, 2018 7:57:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:57:26.250Z: Worker configuration: n1-standard-1 in us-central1-f.
May 28, 2018 7:57:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:57:26.653Z: Expanding CoGroupByKey operations into optimizable parts.
May 28, 2018 7:57:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:57:26.787Z: Expanding GroupByKey operations into optimizable parts.
May 28, 2018 7:57:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:57:26.818Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
May 28, 2018 7:57:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:57:26.980Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
May 28, 2018 7:57:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:57:27.017Z: Elided trivial flatten
May 28, 2018 7:57:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:57:27.042Z: Elided trivial flatten
May 28, 2018 7:57:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:57:27.073Z: Elided trivial flatten
May 28, 2018 7:57:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:57:27.109Z: Unzipping flatten s24 for input s19.org.apache.beam.sdk.values.PCollection.<init>:329#8fd0f908e3ea90e3
May 28, 2018 7:57:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:57:27.139Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Reify, through flatten PAssert$33/GroupGlobally/FlattenDummyAndContents, into producer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map
May 28, 2018 7:57:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:57:27.173Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow into PAssert$33/GroupGlobally/GroupDummyAndContents/Read
May 28, 2018 7:57:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:57:27.207Z: Fusing consumer PAssert$33/GroupGlobally/ParDo(Concat) into PAssert$33/GroupGlobally/Values/Values/Map
May 28, 2018 7:57:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:57:27.240Z: Fusing consumer PAssert$33/GetPane/Map into PAssert$33/GroupGlobally/ParDo(Concat)
May 28, 2018 7:57:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:57:27.274Z: Fusing consumer PAssert$33/GroupGlobally/Values/Values/Map into PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow
May 28, 2018 7:57:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:57:27.309Z: Fusing consumer PAssert$33/RunChecks into PAssert$33/GetPane/Map
May 28, 2018 7:57:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:57:27.339Z: Fusing consumer PAssert$33/VerifyAssertions/ParDo(DefaultConclude) into PAssert$33/RunChecks
May 28, 2018 7:57:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:57:27.385Z: Unzipping flatten s24-u45 for input s26-reify-value18-c43
May 28, 2018 7:57:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:57:27.429Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Write, through flatten s24-u45, into producer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 28, 2018 7:57:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:57:27.464Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify into PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
May 28, 2018 7:57:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:57:27.510Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Write into PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 28, 2018 7:57:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:57:27.555Z: Fusing consumer PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)
May 28, 2018 7:57:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:57:27.592Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
May 28, 2018 7:57:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:57:27.633Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
May 28, 2018 7:57:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:57:27.670Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into PAssert$33/GroupGlobally/Window.Into()/Window.Assign
May 28, 2018 7:57:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:57:27.718Z: Fusing consumer OutputSideInputs into Create123/Read(CreateSource)
May 28, 2018 7:57:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:57:27.763Z: Fusing consumer PAssert$33/GroupGlobally/Window.Into()/Window.Assign into OutputSideInputs
May 28, 2018 7:57:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:57:27.804Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
May 28, 2018 7:57:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:57:27.849Z: Fusing consumer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map into PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
May 28, 2018 7:57:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:57:27.891Z: Fusing consumer PAssert$33/GroupGlobally/RewindowActuals/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map
May 28, 2018 7:57:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:57:27.929Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read
May 28, 2018 7:57:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:57:27.970Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
May 28, 2018 7:57:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:57:28.012Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
May 28, 2018 7:57:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:57:28.061Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
May 28, 2018 7:57:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:57:28.097Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
May 28, 2018 7:57:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:57:28.141Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
May 28, 2018 7:57:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:57:28.178Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into Create47/Read(CreateSource)
May 28, 2018 7:57:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:57:28.216Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
May 28, 2018 7:57:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:57:28.261Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
May 28, 2018 7:57:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:57:28.303Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
May 28, 2018 7:57:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:57:28.338Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
May 28, 2018 7:57:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:57:28.382Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
May 28, 2018 7:57:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:57:28.420Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
May 28, 2018 7:57:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:57:28.851Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Create
May 28, 2018 7:57:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:57:28.889Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Create
May 28, 2018 7:57:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:57:28.922Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
May 28, 2018 7:57:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:57:28.946Z: Starting 1 workers in us-central1-f...
May 28, 2018 7:57:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:57:28.958Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
May 28, 2018 7:57:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:57:29.176Z: Executing operation PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 28, 2018 7:57:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:57:29.201Z: Executing operation Create47/Read(CreateSource)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
May 28, 2018 7:57:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:57:36.177Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
May 28, 2018 7:57:54 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:57:51.816Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
May 28, 2018 7:57:54 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:57:51.851Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 28, 2018 7:58:12 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:58:12.093Z: Workers have started successfully.
May 28, 2018 7:58:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:58:35.943Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
May 28, 2018 7:58:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:58:36.038Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
May 28, 2018 7:58:41 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:58:41.154Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
May 28, 2018 7:58:41 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:58:41.244Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
May 28, 2018 7:58:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:58:53.274Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
May 28, 2018 7:58:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:58:53.473Z: Executing operation Create123/Read(CreateSource)+OutputSideInputs+PAssert$33/GroupGlobally/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write
May 28, 2018 7:59:00 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:58:59.837Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Close
May 28, 2018 7:59:00 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:58:59.914Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$33/GroupGlobally/RewindowActuals/Window.Assign+PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 28, 2018 7:59:06 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:59:04.610Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Close
May 28, 2018 7:59:06 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:59:04.687Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Read+PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$33/GroupGlobally/Values/Values/Map+PAssert$33/GroupGlobally/ParDo(Concat)+PAssert$33/GetPane/Map+PAssert$33/RunChecks+PAssert$33/VerifyAssertions/ParDo(DefaultConclude)
May 28, 2018 7:59:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:59:07.704Z: Cleaning up.
May 28, 2018 7:59:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:59:07.805Z: Stopping worker pool...
May 28, 2018 8:00:41 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T08:00:40.125Z: Autoscaling: Resized worker pool from 1 to 0.
May 28, 2018 8:00:41 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T08:00:40.168Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 28, 2018 8:00:51 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-05-28_00_57_18-10301430768425555556 finished with status DONE.
May 28, 2018 8:00:51 AM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-05-28_00_57_18-10301430768425555556. Found 1 success, 0 failures out of 1 expected assertions.
Gradle Test Executor 28 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest
209 tests completed, 41 failed, 2 skipped
Finished generating test XML results (0.563 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerTest>
Generating HTML test report...
Finished generating test html results (0.631 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest>
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest FAILED
:beam-runners-google-cloud-dataflow-java:validatesRunnerTest (Thread[Task worker for ':' Thread 42,5,main]) completed. Took 1 hrs 59 mins 4.403 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:validatesRunnerTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 0m 15s
38 actionable tasks: 34 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/2yjk5pt7wtsag
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user katarzyna.kucharczyk@polidea.com
Not sending mail to unregistered user robbe.sneyders@ml6.eu
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user schroederc@google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ammons@google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user sidhom@google.com
Build failed in Jenkins:
beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #363
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/363/display/redirect>
------------------------------------------
[...truncated 18.16 MB...]
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign as step s15
May 28, 2018 2:00:35 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey as step s16
May 28, 2018 2:00:35 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map as step s17
May 28, 2018 2:00:35 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RewindowActuals/Window.Assign as step s18
May 28, 2018 2:00:35 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map as step s19
May 28, 2018 2:00:35 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveActualsTriggering/Flatten.PCollections as step s20
May 28, 2018 2:00:35 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Create.Values/Read(CreateSource) as step s21
May 28, 2018 2:00:35 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign as step s22
May 28, 2018 2:00:35 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveDummyTriggering/Flatten.PCollections as step s23
May 28, 2018 2:00:35 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/FlattenDummyAndContents as step s24
May 28, 2018 2:00:35 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/NeverTrigger/Flatten.PCollections as step s25
May 28, 2018 2:00:35 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GroupDummyAndContents as step s26
May 28, 2018 2:00:35 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Values/Values/Map as step s27
May 28, 2018 2:00:35 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/ParDo(Concat) as step s28
May 28, 2018 2:00:35 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GetPane/Map as step s29
May 28, 2018 2:00:35 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/RunChecks as step s30
May 28, 2018 2:00:35 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/VerifyAssertions/ParDo(DefaultConclude) as step s31
May 28, 2018 2:00:35 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0528020004-7604cd4c/output/results/staging/
May 28, 2018 2:00:35 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <71120 bytes, hash x-NUCKBFZScYOjG2EovYWw> to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0528020004-7604cd4c/output/results/staging/pipeline-x-NUCKBFZScYOjG2EovYWw.pb
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 28, 2018 2:00:36 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-05-27_19_00_36-1106837276470209947?project=apache-beam-testing
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Submitted job: 2018-05-27_19_00_36-1106837276470209947
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 28, 2018 2:00:36 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-05-27_19_00_36-1106837276470209947
May 28, 2018 2:00:36 AM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-05-27_19_00_36-1106837276470209947 with 1 expected assertions.
May 28, 2018 2:00:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:00:36.166Z: Autoscaling is enabled for job 2018-05-27_19_00_36-1106837276470209947. The number of workers will be between 1 and 1000.
May 28, 2018 2:00:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:00:36.205Z: Autoscaling was automatically enabled for job 2018-05-27_19_00_36-1106837276470209947.
May 28, 2018 2:00:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:00:38.737Z: Checking required Cloud APIs are enabled.
May 28, 2018 2:00:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:00:38.926Z: Checking permissions granted to controller Service Account.
May 28, 2018 2:00:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:00:45.195Z: Worker configuration: n1-standard-1 in us-central1-c.
May 28, 2018 2:00:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:00:45.665Z: Expanding CoGroupByKey operations into optimizable parts.
May 28, 2018 2:00:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:00:45.816Z: Expanding GroupByKey operations into optimizable parts.
May 28, 2018 2:00:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:00:45.856Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
May 28, 2018 2:00:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:00:46.078Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
May 28, 2018 2:00:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:00:46.122Z: Elided trivial flatten
May 28, 2018 2:00:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:00:46.161Z: Elided trivial flatten
May 28, 2018 2:00:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:00:46.207Z: Elided trivial flatten
May 28, 2018 2:00:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:00:46.244Z: Unzipping flatten s24 for input s19.org.apache.beam.sdk.values.PCollection.<init>:329#8fd0f908e3ea90e3
May 28, 2018 2:00:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:00:46.287Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Reify, through flatten PAssert$33/GroupGlobally/FlattenDummyAndContents, into producer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map
May 28, 2018 2:00:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:00:46.331Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow into PAssert$33/GroupGlobally/GroupDummyAndContents/Read
May 28, 2018 2:00:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:00:46.375Z: Fusing consumer PAssert$33/GroupGlobally/ParDo(Concat) into PAssert$33/GroupGlobally/Values/Values/Map
May 28, 2018 2:00:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:00:46.412Z: Fusing consumer PAssert$33/GetPane/Map into PAssert$33/GroupGlobally/ParDo(Concat)
May 28, 2018 2:00:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:00:46.457Z: Fusing consumer PAssert$33/GroupGlobally/Values/Values/Map into PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow
May 28, 2018 2:00:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:00:46.500Z: Fusing consumer PAssert$33/RunChecks into PAssert$33/GetPane/Map
May 28, 2018 2:00:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:00:46.544Z: Fusing consumer PAssert$33/VerifyAssertions/ParDo(DefaultConclude) into PAssert$33/RunChecks
May 28, 2018 2:00:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:00:46.585Z: Unzipping flatten s24-u45 for input s26-reify-value18-c43
May 28, 2018 2:00:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:00:46.628Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Write, through flatten s24-u45, into producer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 28, 2018 2:00:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:00:46.670Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify into PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
May 28, 2018 2:00:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:00:46.716Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Write into PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 28, 2018 2:00:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:00:46.761Z: Fusing consumer PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)
May 28, 2018 2:00:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:00:46.803Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
May 28, 2018 2:00:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:00:46.847Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
May 28, 2018 2:00:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:00:46.890Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into PAssert$33/GroupGlobally/Window.Into()/Window.Assign
May 28, 2018 2:00:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:00:46.933Z: Fusing consumer OutputSideInputs into Create123/Read(CreateSource)
May 28, 2018 2:00:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:00:46.976Z: Fusing consumer PAssert$33/GroupGlobally/Window.Into()/Window.Assign into OutputSideInputs
May 28, 2018 2:00:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:00:47.021Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
May 28, 2018 2:00:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:00:47.058Z: Fusing consumer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map into PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
May 28, 2018 2:00:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:00:47.100Z: Fusing consumer PAssert$33/GroupGlobally/RewindowActuals/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map
May 28, 2018 2:00:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:00:47.140Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read
May 28, 2018 2:00:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:00:47.178Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
May 28, 2018 2:00:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:00:47.222Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
May 28, 2018 2:00:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:00:47.266Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
May 28, 2018 2:00:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:00:47.311Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
May 28, 2018 2:00:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:00:47.357Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
May 28, 2018 2:00:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:00:47.396Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into Create47/Read(CreateSource)
May 28, 2018 2:00:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:00:47.440Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
May 28, 2018 2:00:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:00:47.474Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
May 28, 2018 2:00:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:00:47.517Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
May 28, 2018 2:00:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:00:47.556Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
May 28, 2018 2:00:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:00:47.589Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
May 28, 2018 2:00:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:00:47.632Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
May 28, 2018 2:00:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:00:48.080Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Create
May 28, 2018 2:00:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:00:48.124Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Create
May 28, 2018 2:00:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:00:48.163Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
May 28, 2018 2:00:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:00:48.176Z: Starting 1 workers in us-central1-c...
May 28, 2018 2:00:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:00:48.203Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
May 28, 2018 2:00:50 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:00:48.411Z: Executing operation Create47/Read(CreateSource)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
May 28, 2018 2:00:50 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:00:48.456Z: Executing operation PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 28, 2018 2:00:56 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:00:56.013Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
May 28, 2018 2:01:07 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:01:06.560Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
May 28, 2018 2:01:07 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:01:06.599Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 28, 2018 2:01:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:01:25.565Z: Workers have started successfully.
May 28, 2018 2:02:02 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:02:00.205Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
May 28, 2018 2:02:02 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:02:00.294Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
May 28, 2018 2:02:09 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:02:07.025Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
May 28, 2018 2:02:09 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:02:07.111Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
May 28, 2018 2:02:19 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:02:19.045Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
May 28, 2018 2:02:19 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:02:19.222Z: Executing operation Create123/Read(CreateSource)+OutputSideInputs+PAssert$33/GroupGlobally/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write
May 28, 2018 2:02:27 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:02:25.182Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Close
May 28, 2018 2:02:27 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:02:25.257Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$33/GroupGlobally/RewindowActuals/Window.Assign+PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 28, 2018 2:02:31 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:02:29.236Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Close
May 28, 2018 2:02:31 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:02:29.323Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Read+PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$33/GroupGlobally/Values/Values/Map+PAssert$33/GroupGlobally/ParDo(Concat)+PAssert$33/GetPane/Map+PAssert$33/RunChecks+PAssert$33/VerifyAssertions/ParDo(DefaultConclude)
May 28, 2018 2:02:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:02:34.801Z: Cleaning up.
May 28, 2018 2:02:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:02:34.895Z: Stopping worker pool...
May 28, 2018 2:03:42 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:03:40.339Z: Autoscaling: Resized worker pool from 1 to 0.
May 28, 2018 2:03:42 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:03:40.387Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 28, 2018 2:03:48 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-05-27_19_00_36-1106837276470209947 finished with status DONE.
May 28, 2018 2:03:49 AM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-05-27_19_00_36-1106837276470209947. Found 1 success, 0 failures out of 1 expected assertions.
Gradle Test Executor 36 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest FAILED
209 tests completed, 34 failed, 2 skipped
Finished generating test XML results (0.424 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerTest>
Generating HTML test report...
Finished generating test html results (0.202 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest>
:beam-runners-google-cloud-dataflow-java:validatesRunnerTest (Thread[Task worker for ':' Thread 31,5,main]) completed. Took 2 hrs 1 mins 27.679 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:validatesRunnerTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 2m 43s
38 actionable tasks: 34 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/jpn4v2jkksqpw
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user katarzyna.kucharczyk@polidea.com
Not sending mail to unregistered user robbe.sneyders@ml6.eu
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user schroederc@google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ammons@google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user sidhom@google.com
Build failed in Jenkins:
beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #362
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/362/display/redirect>
------------------------------------------
[...truncated 18.05 MB...]
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign as step s15
May 27, 2018 8:01:03 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey as step s16
May 27, 2018 8:01:03 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map as step s17
May 27, 2018 8:01:03 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RewindowActuals/Window.Assign as step s18
May 27, 2018 8:01:03 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map as step s19
May 27, 2018 8:01:03 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveActualsTriggering/Flatten.PCollections as step s20
May 27, 2018 8:01:03 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Create.Values/Read(CreateSource) as step s21
May 27, 2018 8:01:03 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign as step s22
May 27, 2018 8:01:03 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveDummyTriggering/Flatten.PCollections as step s23
May 27, 2018 8:01:03 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/FlattenDummyAndContents as step s24
May 27, 2018 8:01:03 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/NeverTrigger/Flatten.PCollections as step s25
May 27, 2018 8:01:03 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GroupDummyAndContents as step s26
May 27, 2018 8:01:03 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Values/Values/Map as step s27
May 27, 2018 8:01:03 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/ParDo(Concat) as step s28
May 27, 2018 8:01:03 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GetPane/Map as step s29
May 27, 2018 8:01:03 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/RunChecks as step s30
May 27, 2018 8:01:03 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/VerifyAssertions/ParDo(DefaultConclude) as step s31
May 27, 2018 8:01:03 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0527200100-c753ef01/output/results/staging/
May 27, 2018 8:01:03 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <71120 bytes, hash y2p6K1gfdl2gKEwcLOCv1g> to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0527200100-c753ef01/output/results/staging/pipeline-y2p6K1gfdl2gKEwcLOCv1g.pb
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 27, 2018 8:01:05 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-05-27_13_01_04-315167547435459851?project=apache-beam-testing
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Submitted job: 2018-05-27_13_01_04-315167547435459851
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 27, 2018 8:01:05 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-05-27_13_01_04-315167547435459851
May 27, 2018 8:01:05 PM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-05-27_13_01_04-315167547435459851 with 1 expected assertions.
May 27, 2018 8:01:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:01:04.236Z: Autoscaling is enabled for job 2018-05-27_13_01_04-315167547435459851. The number of workers will be between 1 and 1000.
May 27, 2018 8:01:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:01:04.288Z: Autoscaling was automatically enabled for job 2018-05-27_13_01_04-315167547435459851.
May 27, 2018 8:01:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:01:06.783Z: Checking required Cloud APIs are enabled.
May 27, 2018 8:01:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:01:06.970Z: Checking permissions granted to controller Service Account.
May 27, 2018 8:01:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:01:11.711Z: Worker configuration: n1-standard-1 in us-central1-b.
May 27, 2018 8:01:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:01:12.192Z: Expanding CoGroupByKey operations into optimizable parts.
May 27, 2018 8:01:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:01:12.425Z: Expanding GroupByKey operations into optimizable parts.
May 27, 2018 8:01:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:01:12.479Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
May 27, 2018 8:01:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:01:12.735Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
May 27, 2018 8:01:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:01:12.774Z: Elided trivial flatten
May 27, 2018 8:01:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:01:12.820Z: Elided trivial flatten
May 27, 2018 8:01:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:01:12.873Z: Elided trivial flatten
May 27, 2018 8:01:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:01:12.927Z: Unzipping flatten s24 for input s19.org.apache.beam.sdk.values.PCollection.<init>:329#8fd0f908e3ea90e3
May 27, 2018 8:01:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:01:12.975Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Reify, through flatten PAssert$33/GroupGlobally/FlattenDummyAndContents, into producer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map
May 27, 2018 8:01:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:01:13.016Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow into PAssert$33/GroupGlobally/GroupDummyAndContents/Read
May 27, 2018 8:01:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:01:13.061Z: Fusing consumer PAssert$33/GroupGlobally/ParDo(Concat) into PAssert$33/GroupGlobally/Values/Values/Map
May 27, 2018 8:01:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:01:13.093Z: Fusing consumer PAssert$33/GetPane/Map into PAssert$33/GroupGlobally/ParDo(Concat)
May 27, 2018 8:01:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:01:13.150Z: Fusing consumer PAssert$33/GroupGlobally/Values/Values/Map into PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow
May 27, 2018 8:01:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:01:13.203Z: Fusing consumer PAssert$33/RunChecks into PAssert$33/GetPane/Map
May 27, 2018 8:01:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:01:13.255Z: Fusing consumer PAssert$33/VerifyAssertions/ParDo(DefaultConclude) into PAssert$33/RunChecks
May 27, 2018 8:01:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:01:13.305Z: Unzipping flatten s24-u45 for input s26-reify-value18-c43
May 27, 2018 8:01:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:01:13.340Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Write, through flatten s24-u45, into producer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 27, 2018 8:01:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:01:13.388Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify into PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
May 27, 2018 8:01:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:01:13.450Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Write into PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 27, 2018 8:01:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:01:13.482Z: Fusing consumer PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)
May 27, 2018 8:01:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:01:13.520Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
May 27, 2018 8:01:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:01:13.569Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
May 27, 2018 8:01:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:01:13.620Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into PAssert$33/GroupGlobally/Window.Into()/Window.Assign
May 27, 2018 8:01:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:01:13.674Z: Fusing consumer OutputSideInputs into Create123/Read(CreateSource)
May 27, 2018 8:01:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:01:13.722Z: Fusing consumer PAssert$33/GroupGlobally/Window.Into()/Window.Assign into OutputSideInputs
May 27, 2018 8:01:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:01:13.776Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
May 27, 2018 8:01:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:01:13.828Z: Fusing consumer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map into PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
May 27, 2018 8:01:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:01:13.881Z: Fusing consumer PAssert$33/GroupGlobally/RewindowActuals/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map
May 27, 2018 8:01:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:01:13.930Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read
May 27, 2018 8:01:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:01:13.987Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
May 27, 2018 8:01:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:01:14.035Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
May 27, 2018 8:01:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:01:14.085Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
May 27, 2018 8:01:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:01:14.134Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
May 27, 2018 8:01:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:01:14.205Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
May 27, 2018 8:01:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:01:14.241Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into Create47/Read(CreateSource)
May 27, 2018 8:01:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:01:14.297Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
May 27, 2018 8:01:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:01:14.336Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
May 27, 2018 8:01:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:01:14.386Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
May 27, 2018 8:01:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:01:14.425Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
May 27, 2018 8:01:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:01:14.466Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
May 27, 2018 8:01:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:01:14.506Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
May 27, 2018 8:01:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:01:15.051Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Create
May 27, 2018 8:01:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:01:15.090Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Create
May 27, 2018 8:01:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:01:15.138Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
May 27, 2018 8:01:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:01:15.167Z: Starting 1 workers in us-central1-b...
May 27, 2018 8:01:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:01:15.189Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
May 27, 2018 8:01:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:01:15.475Z: Executing operation PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 27, 2018 8:01:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:01:15.537Z: Executing operation Create47/Read(CreateSource)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
May 27, 2018 8:01:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:01:25.720Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
May 27, 2018 8:01:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:01:52.253Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
May 27, 2018 8:01:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:01:52.298Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 27, 2018 8:02:21 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:02:19.704Z: Workers have started successfully.
May 27, 2018 8:02:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:02:44.405Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
May 27, 2018 8:02:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:02:44.519Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
May 27, 2018 8:02:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:02:51.022Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
May 27, 2018 8:02:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:02:51.126Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
May 27, 2018 8:03:02 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:03:02.523Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
May 27, 2018 8:03:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:03:02.748Z: Executing operation Create123/Read(CreateSource)+OutputSideInputs+PAssert$33/GroupGlobally/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write
May 27, 2018 8:03:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:03:07.714Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Close
May 27, 2018 8:03:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:03:07.806Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$33/GroupGlobally/RewindowActuals/Window.Assign+PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 27, 2018 8:03:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:03:11.810Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Close
May 27, 2018 8:03:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:03:11.919Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Read+PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$33/GroupGlobally/Values/Values/Map+PAssert$33/GroupGlobally/ParDo(Concat)+PAssert$33/GetPane/Map+PAssert$33/RunChecks+PAssert$33/VerifyAssertions/ParDo(DefaultConclude)
May 27, 2018 8:03:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:03:16.314Z: Cleaning up.
May 27, 2018 8:03:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:03:16.430Z: Stopping worker pool...
May 27, 2018 8:04:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:04:51.058Z: Autoscaling: Resized worker pool from 1 to 0.
May 27, 2018 8:04:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:04:51.106Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 27, 2018 8:04:59 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-05-27_13_01_04-315167547435459851 finished with status DONE.
May 27, 2018 8:04:59 PM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-05-27_13_01_04-315167547435459851. Found 1 success, 0 failures out of 1 expected assertions.
Gradle Test Executor 39 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest FAILED
209 tests completed, 34 failed, 2 skipped
Finished generating test XML results (0.374 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerTest>
Generating HTML test report...
Finished generating test html results (0.302 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest>
:beam-runners-google-cloud-dataflow-java:validatesRunnerTest (Thread[Task worker for ':' Thread 21,5,main]) completed. Took 2 hrs 3 mins 3.254 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:validatesRunnerTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 4m 21s
38 actionable tasks: 34 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/5pud4kdxlyals
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user katarzyna.kucharczyk@polidea.com
Not sending mail to unregistered user robbe.sneyders@ml6.eu
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user schroederc@google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ammons@google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user sidhom@google.com
Build failed in Jenkins:
beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #361
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/361/display/redirect>
------------------------------------------
[...truncated 18.09 MB...]
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign as step s15
May 27, 2018 1:54:15 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey as step s16
May 27, 2018 1:54:15 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map as step s17
May 27, 2018 1:54:15 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RewindowActuals/Window.Assign as step s18
May 27, 2018 1:54:15 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map as step s19
May 27, 2018 1:54:15 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveActualsTriggering/Flatten.PCollections as step s20
May 27, 2018 1:54:15 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Create.Values/Read(CreateSource) as step s21
May 27, 2018 1:54:15 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign as step s22
May 27, 2018 1:54:15 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveDummyTriggering/Flatten.PCollections as step s23
May 27, 2018 1:54:15 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/FlattenDummyAndContents as step s24
May 27, 2018 1:54:15 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/NeverTrigger/Flatten.PCollections as step s25
May 27, 2018 1:54:15 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GroupDummyAndContents as step s26
May 27, 2018 1:54:15 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Values/Values/Map as step s27
May 27, 2018 1:54:15 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/ParDo(Concat) as step s28
May 27, 2018 1:54:15 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GetPane/Map as step s29
May 27, 2018 1:54:15 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/RunChecks as step s30
May 27, 2018 1:54:15 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/VerifyAssertions/ParDo(DefaultConclude) as step s31
May 27, 2018 1:54:15 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0527135412-8e7d95c6/output/results/staging/
May 27, 2018 1:54:15 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <71120 bytes, hash 9JKtFub9zUe3PYfim1Mkwg> to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0527135412-8e7d95c6/output/results/staging/pipeline-9JKtFub9zUe3PYfim1Mkwg.pb
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 27, 2018 1:54:17 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-05-27_06_54_16-17297844100176345573?project=apache-beam-testing
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Submitted job: 2018-05-27_06_54_16-17297844100176345573
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 27, 2018 1:54:17 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-05-27_06_54_16-17297844100176345573
May 27, 2018 1:54:17 PM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-05-27_06_54_16-17297844100176345573 with 1 expected assertions.
May 27, 2018 1:54:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:54:16.671Z: Autoscaling is enabled for job 2018-05-27_06_54_16-17297844100176345573. The number of workers will be between 1 and 1000.
May 27, 2018 1:54:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:54:16.684Z: Autoscaling was automatically enabled for job 2018-05-27_06_54_16-17297844100176345573.
May 27, 2018 1:54:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:54:19.682Z: Checking required Cloud APIs are enabled.
May 27, 2018 1:54:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:54:19.930Z: Checking permissions granted to controller Service Account.
May 27, 2018 1:54:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:54:32.361Z: Worker configuration: n1-standard-1 in us-central1-f.
May 27, 2018 1:54:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:54:32.736Z: Expanding CoGroupByKey operations into optimizable parts.
May 27, 2018 1:54:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:54:32.830Z: Expanding GroupByKey operations into optimizable parts.
May 27, 2018 1:54:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:54:32.856Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
May 27, 2018 1:54:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:54:32.995Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
May 27, 2018 1:54:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:54:33.012Z: Elided trivial flatten
May 27, 2018 1:54:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:54:33.033Z: Elided trivial flatten
May 27, 2018 1:54:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:54:33.052Z: Elided trivial flatten
May 27, 2018 1:54:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:54:33.078Z: Unzipping flatten s24 for input s19.org.apache.beam.sdk.values.PCollection.<init>:329#8fd0f908e3ea90e3
May 27, 2018 1:54:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:54:33.099Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Reify, through flatten PAssert$33/GroupGlobally/FlattenDummyAndContents, into producer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map
May 27, 2018 1:54:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:54:33.122Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow into PAssert$33/GroupGlobally/GroupDummyAndContents/Read
May 27, 2018 1:54:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:54:33.158Z: Fusing consumer PAssert$33/GroupGlobally/ParDo(Concat) into PAssert$33/GroupGlobally/Values/Values/Map
May 27, 2018 1:54:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:54:33.176Z: Fusing consumer PAssert$33/GetPane/Map into PAssert$33/GroupGlobally/ParDo(Concat)
May 27, 2018 1:54:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:54:33.200Z: Fusing consumer PAssert$33/GroupGlobally/Values/Values/Map into PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow
May 27, 2018 1:54:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:54:33.223Z: Fusing consumer PAssert$33/RunChecks into PAssert$33/GetPane/Map
May 27, 2018 1:54:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:54:33.239Z: Fusing consumer PAssert$33/VerifyAssertions/ParDo(DefaultConclude) into PAssert$33/RunChecks
May 27, 2018 1:54:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:54:33.265Z: Unzipping flatten s24-u45 for input s26-reify-value18-c43
May 27, 2018 1:54:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:54:33.285Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Write, through flatten s24-u45, into producer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 27, 2018 1:54:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:54:33.307Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify into PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
May 27, 2018 1:54:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:54:33.333Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Write into PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 27, 2018 1:54:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:54:33.350Z: Fusing consumer PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)
May 27, 2018 1:54:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:54:33.374Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
May 27, 2018 1:54:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:54:33.395Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
May 27, 2018 1:54:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:54:33.412Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into PAssert$33/GroupGlobally/Window.Into()/Window.Assign
May 27, 2018 1:54:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:54:33.435Z: Fusing consumer OutputSideInputs into Create123/Read(CreateSource)
May 27, 2018 1:54:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:54:33.460Z: Fusing consumer PAssert$33/GroupGlobally/Window.Into()/Window.Assign into OutputSideInputs
May 27, 2018 1:54:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:54:33.485Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
May 27, 2018 1:54:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:54:33.510Z: Fusing consumer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map into PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
May 27, 2018 1:54:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:54:33.534Z: Fusing consumer PAssert$33/GroupGlobally/RewindowActuals/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map
May 27, 2018 1:54:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:54:33.556Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read
May 27, 2018 1:54:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:54:33.579Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
May 27, 2018 1:54:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:54:33.600Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
May 27, 2018 1:54:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:54:33.621Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
May 27, 2018 1:54:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:54:33.640Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
May 27, 2018 1:54:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:54:33.664Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
May 27, 2018 1:54:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:54:33.688Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into Create47/Read(CreateSource)
May 27, 2018 1:54:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:54:33.710Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
May 27, 2018 1:54:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:54:33.729Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
May 27, 2018 1:54:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:54:33.753Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
May 27, 2018 1:54:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:54:33.778Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
May 27, 2018 1:54:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:54:33.805Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
May 27, 2018 1:54:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:54:33.819Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
May 27, 2018 1:54:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:54:34.120Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Create
May 27, 2018 1:54:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:54:34.150Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Create
May 27, 2018 1:54:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:54:34.178Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
May 27, 2018 1:54:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:54:34.189Z: Starting 1 workers in us-central1-f...
May 27, 2018 1:54:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:54:34.206Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
May 27, 2018 1:54:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:54:34.349Z: Executing operation PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 27, 2018 1:54:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:54:34.371Z: Executing operation Create47/Read(CreateSource)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
May 27, 2018 1:54:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:54:43.605Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
May 27, 2018 1:54:55 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:54:54.044Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
May 27, 2018 1:54:55 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:54:54.068Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 27, 2018 1:55:15 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:55:14.053Z: Workers have started successfully.
May 27, 2018 1:55:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:55:38.552Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
May 27, 2018 1:55:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:55:38.602Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
May 27, 2018 1:55:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:55:43.184Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
May 27, 2018 1:55:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:55:43.224Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
May 27, 2018 1:55:56 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:55:55.897Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
May 27, 2018 1:55:56 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:55:56.015Z: Executing operation Create123/Read(CreateSource)+OutputSideInputs+PAssert$33/GroupGlobally/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write
May 27, 2018 1:56:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:56:02.417Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Close
May 27, 2018 1:56:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:56:02.452Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$33/GroupGlobally/RewindowActuals/Window.Assign+PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 27, 2018 1:56:07 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:56:06.145Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Close
May 27, 2018 1:56:07 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:56:06.207Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Read+PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$33/GroupGlobally/Values/Values/Map+PAssert$33/GroupGlobally/ParDo(Concat)+PAssert$33/GetPane/Map+PAssert$33/RunChecks+PAssert$33/VerifyAssertions/ParDo(DefaultConclude)
May 27, 2018 1:56:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:56:09.410Z: Cleaning up.
May 27, 2018 1:56:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:56:09.472Z: Stopping worker pool...
May 27, 2018 1:57:29 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:57:27.928Z: Autoscaling: Resized worker pool from 1 to 0.
May 27, 2018 1:57:29 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:57:27.951Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 27, 2018 1:57:36 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-05-27_06_54_16-17297844100176345573 finished with status DONE.
May 27, 2018 1:57:36 PM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-05-27_06_54_16-17297844100176345573. Found 1 success, 0 failures out of 1 expected assertions.
Gradle Test Executor 10 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest FAILED
209 tests completed, 34 failed, 2 skipped
Finished generating test XML results (0.43 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerTest>
Generating HTML test report...
Finished generating test html results (0.323 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest>
:beam-runners-google-cloud-dataflow-java:validatesRunnerTest (Thread[Task worker for ':' Thread 20,5,main]) completed. Took 1 hrs 56 mins 1.719 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:validatesRunnerTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1h 57m 10s
38 actionable tasks: 34 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/rh6hmlxoxlyhi
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user katarzyna.kucharczyk@polidea.com
Not sending mail to unregistered user robbe.sneyders@ml6.eu
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user schroederc@google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ammons@google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user sidhom@google.com
Build failed in Jenkins:
beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #360
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/360/display/redirect>
------------------------------------------
[...truncated 18.00 MB...]
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey as step s16
May 27, 2018 7:57:06 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map as step s17
May 27, 2018 7:57:06 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RewindowActuals/Window.Assign as step s18
May 27, 2018 7:57:06 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map as step s19
May 27, 2018 7:57:06 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveActualsTriggering/Flatten.PCollections as step s20
May 27, 2018 7:57:06 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Create.Values/Read(CreateSource) as step s21
May 27, 2018 7:57:06 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign as step s22
May 27, 2018 7:57:06 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveDummyTriggering/Flatten.PCollections as step s23
May 27, 2018 7:57:06 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/FlattenDummyAndContents as step s24
May 27, 2018 7:57:06 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/NeverTrigger/Flatten.PCollections as step s25
May 27, 2018 7:57:06 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GroupDummyAndContents as step s26
May 27, 2018 7:57:06 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Values/Values/Map as step s27
May 27, 2018 7:57:06 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/ParDo(Concat) as step s28
May 27, 2018 7:57:06 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GetPane/Map as step s29
May 27, 2018 7:57:06 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/RunChecks as step s30
May 27, 2018 7:57:06 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/VerifyAssertions/ParDo(DefaultConclude) as step s31
May 27, 2018 7:57:06 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0527075702-2d95e2d9/output/results/staging/
May 27, 2018 7:57:06 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <71120 bytes, hash b41vfpzjIZIeKpcKSI8qHQ> to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0527075702-2d95e2d9/output/results/staging/pipeline-b41vfpzjIZIeKpcKSI8qHQ.pb
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 27, 2018 7:57:07 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-05-27_00_57_06-4153166613470041538?project=apache-beam-testing
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Submitted job: 2018-05-27_00_57_06-4153166613470041538
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 27, 2018 7:57:07 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-05-27_00_57_06-4153166613470041538
May 27, 2018 7:57:07 AM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-05-27_00_57_06-4153166613470041538 with 1 expected assertions.
May 27, 2018 7:57:15 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T07:57:06.936Z: Autoscaling is enabled for job 2018-05-27_00_57_06-4153166613470041538. The number of workers will be between 1 and 1000.
May 27, 2018 7:57:15 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T07:57:06.958Z: Autoscaling was automatically enabled for job 2018-05-27_00_57_06-4153166613470041538.
May 27, 2018 7:57:15 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T07:57:09.360Z: Checking required Cloud APIs are enabled.
May 27, 2018 7:57:15 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T07:57:09.543Z: Checking permissions granted to controller Service Account.
May 27, 2018 7:57:15 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T07:57:14.403Z: Worker configuration: n1-standard-1 in us-central1-f.
May 27, 2018 7:57:15 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T07:57:14.824Z: Expanding CoGroupByKey operations into optimizable parts.
May 27, 2018 7:57:15 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T07:57:14.918Z: Expanding GroupByKey operations into optimizable parts.
May 27, 2018 7:57:15 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T07:57:14.942Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
May 27, 2018 7:57:15 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T07:57:15.021Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
May 27, 2018 7:57:15 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T07:57:15.034Z: Elided trivial flatten
May 27, 2018 7:57:15 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T07:57:15.047Z: Elided trivial flatten
May 27, 2018 7:57:15 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T07:57:15.060Z: Elided trivial flatten
May 27, 2018 7:57:15 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T07:57:15.074Z: Unzipping flatten s24 for input s19.org.apache.beam.sdk.values.PCollection.<init>:329#8fd0f908e3ea90e3
May 27, 2018 7:57:15 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T07:57:15.087Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Reify, through flatten PAssert$33/GroupGlobally/FlattenDummyAndContents, into producer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map
May 27, 2018 7:57:15 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T07:57:15.101Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow into PAssert$33/GroupGlobally/GroupDummyAndContents/Read
May 27, 2018 7:57:15 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T07:57:15.112Z: Fusing consumer PAssert$33/GroupGlobally/ParDo(Concat) into PAssert$33/GroupGlobally/Values/Values/Map
May 27, 2018 7:57:15 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T07:57:15.127Z: Fusing consumer PAssert$33/GetPane/Map into PAssert$33/GroupGlobally/ParDo(Concat)
May 27, 2018 7:57:15 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T07:57:15.140Z: Fusing consumer PAssert$33/GroupGlobally/Values/Values/Map into PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow
May 27, 2018 7:57:15 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T07:57:15.152Z: Fusing consumer PAssert$33/RunChecks into PAssert$33/GetPane/Map
May 27, 2018 7:57:15 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T07:57:15.164Z: Fusing consumer PAssert$33/VerifyAssertions/ParDo(DefaultConclude) into PAssert$33/RunChecks
May 27, 2018 7:57:15 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T07:57:15.177Z: Unzipping flatten s24-u45 for input s26-reify-value18-c43
May 27, 2018 7:57:15 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T07:57:15.190Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Write, through flatten s24-u45, into producer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 27, 2018 7:57:15 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T07:57:15.204Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify into PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
May 27, 2018 7:57:15 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T07:57:15.217Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Write into PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 27, 2018 7:57:15 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T07:57:15.231Z: Fusing consumer PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)
May 27, 2018 7:57:15 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T07:57:15.243Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
May 27, 2018 7:57:15 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T07:57:15.256Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
May 27, 2018 7:57:15 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T07:57:15.268Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into PAssert$33/GroupGlobally/Window.Into()/Window.Assign
May 27, 2018 7:57:15 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T07:57:15.284Z: Fusing consumer OutputSideInputs into Create123/Read(CreateSource)
May 27, 2018 7:57:15 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T07:57:15.299Z: Fusing consumer PAssert$33/GroupGlobally/Window.Into()/Window.Assign into OutputSideInputs
May 27, 2018 7:57:15 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T07:57:15.311Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
May 27, 2018 7:57:15 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T07:57:15.324Z: Fusing consumer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map into PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
May 27, 2018 7:57:15 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T07:57:15.337Z: Fusing consumer PAssert$33/GroupGlobally/RewindowActuals/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map
May 27, 2018 7:57:15 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T07:57:15.350Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read
May 27, 2018 7:57:15 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T07:57:15.363Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
May 27, 2018 7:57:15 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T07:57:15.375Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
May 27, 2018 7:57:15 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T07:57:15.389Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
May 27, 2018 7:57:15 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T07:57:15.415Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
May 27, 2018 7:57:15 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T07:57:15.439Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
May 27, 2018 7:57:15 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T07:57:15.453Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into Create47/Read(CreateSource)
May 27, 2018 7:57:15 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T07:57:15.477Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
May 27, 2018 7:57:15 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T07:57:15.501Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
May 27, 2018 7:57:15 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T07:57:15.524Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
May 27, 2018 7:57:15 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T07:57:15.547Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
May 27, 2018 7:57:15 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T07:57:15.559Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
May 27, 2018 7:57:15 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T07:57:15.577Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
May 27, 2018 7:57:18 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T07:57:15.832Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Create
May 27, 2018 7:57:18 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T07:57:15.856Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Create
May 27, 2018 7:57:18 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T07:57:15.880Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
May 27, 2018 7:57:18 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T07:57:15.892Z: Starting 1 workers in us-central1-f...
May 27, 2018 7:57:18 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T07:57:15.903Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
May 27, 2018 7:57:18 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T07:57:16.050Z: Executing operation Create47/Read(CreateSource)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
May 27, 2018 7:57:18 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T07:57:16.073Z: Executing operation PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 27, 2018 7:57:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T07:57:23.083Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
May 27, 2018 7:57:33 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T07:57:33.553Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
May 27, 2018 7:57:33 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T07:57:33.574Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 27, 2018 7:57:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T07:57:48.887Z: Workers have started successfully.
May 27, 2018 7:58:19 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T07:58:19.297Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
May 27, 2018 7:58:19 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T07:58:19.380Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
May 27, 2018 7:58:27 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T07:58:26.638Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
May 27, 2018 7:58:27 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T07:58:26.719Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
May 27, 2018 7:58:40 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T07:58:40.064Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
May 27, 2018 7:58:40 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T07:58:40.268Z: Executing operation Create123/Read(CreateSource)+OutputSideInputs+PAssert$33/GroupGlobally/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write
May 27, 2018 7:58:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T07:58:46.016Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Close
May 27, 2018 7:58:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T07:58:46.107Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$33/GroupGlobally/RewindowActuals/Window.Assign+PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 27, 2018 7:58:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T07:58:51.912Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Close
May 27, 2018 7:58:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T07:58:51.990Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Read+PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$33/GroupGlobally/Values/Values/Map+PAssert$33/GroupGlobally/ParDo(Concat)+PAssert$33/GetPane/Map+PAssert$33/RunChecks+PAssert$33/VerifyAssertions/ParDo(DefaultConclude)
May 27, 2018 7:58:57 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T07:58:56.058Z: Cleaning up.
May 27, 2018 7:58:57 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T07:58:56.160Z: Stopping worker pool...
May 27, 2018 8:00:19 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T08:00:18.707Z: Autoscaling: Resized worker pool from 1 to 0.
May 27, 2018 8:00:19 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T08:00:18.757Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 27, 2018 8:00:19 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T08:00:18.822Z: Worker pool stopped.
May 27, 2018 8:00:27 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-05-27_00_57_06-4153166613470041538 finished with status DONE.
May 27, 2018 8:00:27 AM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-05-27_00_57_06-4153166613470041538. Found 1 success, 0 failures out of 1 expected assertions.
Gradle Test Executor 23 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest FAILED
209 tests completed, 34 failed, 2 skipped
Finished generating test XML results (0.629 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerTest>
Generating HTML test report...
Finished generating test html results (0.459 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest>
:beam-runners-google-cloud-dataflow-java:validatesRunnerTest (Thread[Task worker for ':' Thread 17,5,main]) completed. Took 1 hrs 58 mins 25.026 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:validatesRunnerTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1h 59m 39s
38 actionable tasks: 32 executed, 6 from cache
Publishing build scan...
https://gradle.com/s/sgk25v45irzqc
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user katarzyna.kucharczyk@polidea.com
Not sending mail to unregistered user robbe.sneyders@ml6.eu
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user schroederc@google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ammons@google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user sidhom@google.com
Build failed in Jenkins:
beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #359
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/359/display/redirect>
------------------------------------------
[...truncated 18.17 MB...]
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign as step s15
May 27, 2018 2:01:52 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey as step s16
May 27, 2018 2:01:52 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map as step s17
May 27, 2018 2:01:52 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RewindowActuals/Window.Assign as step s18
May 27, 2018 2:01:52 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map as step s19
May 27, 2018 2:01:52 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveActualsTriggering/Flatten.PCollections as step s20
May 27, 2018 2:01:52 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Create.Values/Read(CreateSource) as step s21
May 27, 2018 2:01:52 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign as step s22
May 27, 2018 2:01:52 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveDummyTriggering/Flatten.PCollections as step s23
May 27, 2018 2:01:52 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/FlattenDummyAndContents as step s24
May 27, 2018 2:01:52 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/NeverTrigger/Flatten.PCollections as step s25
May 27, 2018 2:01:52 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GroupDummyAndContents as step s26
May 27, 2018 2:01:52 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Values/Values/Map as step s27
May 27, 2018 2:01:52 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/ParDo(Concat) as step s28
May 27, 2018 2:01:52 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GetPane/Map as step s29
May 27, 2018 2:01:52 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/RunChecks as step s30
May 27, 2018 2:01:52 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/VerifyAssertions/ParDo(DefaultConclude) as step s31
May 27, 2018 2:01:52 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0527020149-521ee8b/output/results/staging/
May 27, 2018 2:01:52 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <71120 bytes, hash ywBKK9bWLLnssJP7A4UzHQ> to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0527020149-521ee8b/output/results/staging/pipeline-ywBKK9bWLLnssJP7A4UzHQ.pb
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 27, 2018 2:01:54 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-05-26_19_01_53-4078653272859147426?project=apache-beam-testing
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Submitted job: 2018-05-26_19_01_53-4078653272859147426
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 27, 2018 2:01:54 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-05-26_19_01_53-4078653272859147426
May 27, 2018 2:01:54 AM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-05-26_19_01_53-4078653272859147426 with 1 expected assertions.
May 27, 2018 2:02:09 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T02:01:53.193Z: Autoscaling is enabled for job 2018-05-26_19_01_53-4078653272859147426. The number of workers will be between 1 and 1000.
May 27, 2018 2:02:09 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T02:01:53.236Z: Autoscaling was automatically enabled for job 2018-05-26_19_01_53-4078653272859147426.
May 27, 2018 2:02:09 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T02:01:56.017Z: Checking required Cloud APIs are enabled.
May 27, 2018 2:02:09 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T02:01:56.213Z: Checking permissions granted to controller Service Account.
May 27, 2018 2:02:09 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T02:02:02.177Z: Worker configuration: n1-standard-1 in us-central1-b.
May 27, 2018 2:02:09 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T02:02:02.641Z: Expanding CoGroupByKey operations into optimizable parts.
May 27, 2018 2:02:09 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T02:02:02.812Z: Expanding GroupByKey operations into optimizable parts.
May 27, 2018 2:02:09 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T02:02:02.852Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
May 27, 2018 2:02:09 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T02:02:03.086Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
May 27, 2018 2:02:09 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T02:02:03.132Z: Elided trivial flatten
May 27, 2018 2:02:09 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T02:02:03.173Z: Elided trivial flatten
May 27, 2018 2:02:09 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T02:02:03.219Z: Elided trivial flatten
May 27, 2018 2:02:09 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T02:02:03.267Z: Unzipping flatten s24 for input s19.org.apache.beam.sdk.values.PCollection.<init>:329#8fd0f908e3ea90e3
May 27, 2018 2:02:09 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T02:02:03.310Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Reify, through flatten PAssert$33/GroupGlobally/FlattenDummyAndContents, into producer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map
May 27, 2018 2:02:09 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T02:02:03.352Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow into PAssert$33/GroupGlobally/GroupDummyAndContents/Read
May 27, 2018 2:02:09 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T02:02:03.393Z: Fusing consumer PAssert$33/GroupGlobally/ParDo(Concat) into PAssert$33/GroupGlobally/Values/Values/Map
May 27, 2018 2:02:09 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T02:02:03.437Z: Fusing consumer PAssert$33/GetPane/Map into PAssert$33/GroupGlobally/ParDo(Concat)
May 27, 2018 2:02:09 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T02:02:03.476Z: Fusing consumer PAssert$33/GroupGlobally/Values/Values/Map into PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow
May 27, 2018 2:02:09 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T02:02:03.527Z: Fusing consumer PAssert$33/RunChecks into PAssert$33/GetPane/Map
May 27, 2018 2:02:09 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T02:02:03.566Z: Fusing consumer PAssert$33/VerifyAssertions/ParDo(DefaultConclude) into PAssert$33/RunChecks
May 27, 2018 2:02:09 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T02:02:03.606Z: Unzipping flatten s24-u45 for input s26-reify-value18-c43
May 27, 2018 2:02:09 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T02:02:03.650Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Write, through flatten s24-u45, into producer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 27, 2018 2:02:09 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T02:02:03.697Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify into PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
May 27, 2018 2:02:09 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T02:02:03.745Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Write into PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 27, 2018 2:02:09 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T02:02:03.794Z: Fusing consumer PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)
May 27, 2018 2:02:09 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T02:02:03.840Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
May 27, 2018 2:02:09 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T02:02:03.881Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
May 27, 2018 2:02:09 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T02:02:03.920Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into PAssert$33/GroupGlobally/Window.Into()/Window.Assign
May 27, 2018 2:02:09 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T02:02:03.959Z: Fusing consumer OutputSideInputs into Create123/Read(CreateSource)
May 27, 2018 2:02:09 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T02:02:03.997Z: Fusing consumer PAssert$33/GroupGlobally/Window.Into()/Window.Assign into OutputSideInputs
May 27, 2018 2:02:09 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T02:02:04.033Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
May 27, 2018 2:02:09 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T02:02:04.070Z: Fusing consumer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map into PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
May 27, 2018 2:02:09 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T02:02:04.116Z: Fusing consumer PAssert$33/GroupGlobally/RewindowActuals/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map
May 27, 2018 2:02:09 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T02:02:04.161Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read
May 27, 2018 2:02:09 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T02:02:04.204Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
May 27, 2018 2:02:09 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T02:02:04.242Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
May 27, 2018 2:02:09 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T02:02:04.289Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
May 27, 2018 2:02:09 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T02:02:04.341Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
May 27, 2018 2:02:09 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T02:02:04.375Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
May 27, 2018 2:02:09 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T02:02:04.423Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into Create47/Read(CreateSource)
May 27, 2018 2:02:09 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T02:02:04.463Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
May 27, 2018 2:02:09 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T02:02:04.507Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
May 27, 2018 2:02:09 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T02:02:04.543Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
May 27, 2018 2:02:09 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T02:02:04.590Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
May 27, 2018 2:02:09 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T02:02:04.631Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
May 27, 2018 2:02:09 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T02:02:04.677Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
May 27, 2018 2:02:09 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T02:02:05.101Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Create
May 27, 2018 2:02:09 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T02:02:05.143Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Create
May 27, 2018 2:02:09 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T02:02:05.196Z: Starting 1 workers in us-central1-b...
May 27, 2018 2:02:09 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T02:02:05.196Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
May 27, 2018 2:02:09 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T02:02:05.246Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
May 27, 2018 2:02:09 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T02:02:05.480Z: Executing operation PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 27, 2018 2:02:09 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T02:02:05.532Z: Executing operation Create47/Read(CreateSource)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
May 27, 2018 2:02:15 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T02:02:15.147Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
May 27, 2018 2:02:27 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T02:02:25.783Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
May 27, 2018 2:02:27 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T02:02:25.825Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 27, 2018 2:02:46 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T02:02:45.959Z: Workers have started successfully.
May 27, 2018 2:03:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T02:03:15.555Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
May 27, 2018 2:03:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T02:03:15.648Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
May 27, 2018 2:03:27 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T02:03:25.429Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
May 27, 2018 2:03:27 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T02:03:25.523Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
May 27, 2018 2:03:39 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T02:03:38.340Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
May 27, 2018 2:03:39 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T02:03:38.531Z: Executing operation Create123/Read(CreateSource)+OutputSideInputs+PAssert$33/GroupGlobally/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write
May 27, 2018 2:03:45 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T02:03:44.591Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Close
May 27, 2018 2:03:45 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T02:03:44.679Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$33/GroupGlobally/RewindowActuals/Window.Assign+PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 27, 2018 2:03:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T02:03:47.572Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Close
May 27, 2018 2:03:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T02:03:47.652Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Read+PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$33/GroupGlobally/Values/Values/Map+PAssert$33/GroupGlobally/ParDo(Concat)+PAssert$33/GetPane/Map+PAssert$33/RunChecks+PAssert$33/VerifyAssertions/ParDo(DefaultConclude)
May 27, 2018 2:03:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T02:03:52.957Z: Cleaning up.
May 27, 2018 2:03:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T02:03:53.094Z: Stopping worker pool...
May 27, 2018 2:05:24 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T02:05:24.487Z: Autoscaling: Resized worker pool from 1 to 0.
May 27, 2018 2:05:24 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T02:05:24.523Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 27, 2018 2:05:33 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-05-26_19_01_53-4078653272859147426 finished with status DONE.
May 27, 2018 2:05:33 AM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-05-26_19_01_53-4078653272859147426. Found 1 success, 0 failures out of 1 expected assertions.
Gradle Test Executor 39 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest FAILED
209 tests completed, 34 failed, 2 skipped
Finished generating test XML results (0.591 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerTest>
Generating HTML test report...
Finished generating test html results (0.414 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest>
:beam-runners-google-cloud-dataflow-java:validatesRunnerTest (Thread[Task worker for ':' Thread 11,5,main]) completed. Took 2 hrs 4 mins 2.374 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:validatesRunnerTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 5m 9s
38 actionable tasks: 34 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/u2gy2g3zgdf72
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user katarzyna.kucharczyk@polidea.com
Not sending mail to unregistered user robbe.sneyders@ml6.eu
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user schroederc@google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ammons@google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user sidhom@google.com
Build failed in Jenkins:
beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #358
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/358/display/redirect?page=changes>
Changes:
[iemejia] [BEAM-4306] Enforce ErrorProne analysis in apex runner
------------------------------------------
[...truncated 18.18 MB...]
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map as step s17
May 26, 2018 10:02:50 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RewindowActuals/Window.Assign as step s18
May 26, 2018 10:02:50 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map as step s19
May 26, 2018 10:02:50 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveActualsTriggering/Flatten.PCollections as step s20
May 26, 2018 10:02:50 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Create.Values/Read(CreateSource) as step s21
May 26, 2018 10:02:50 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign as step s22
May 26, 2018 10:02:50 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveDummyTriggering/Flatten.PCollections as step s23
May 26, 2018 10:02:50 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/FlattenDummyAndContents as step s24
May 26, 2018 10:02:50 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/NeverTrigger/Flatten.PCollections as step s25
May 26, 2018 10:02:50 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GroupDummyAndContents as step s26
May 26, 2018 10:02:50 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Values/Values/Map as step s27
May 26, 2018 10:02:50 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/ParDo(Concat) as step s28
May 26, 2018 10:02:50 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GetPane/Map as step s29
May 26, 2018 10:02:50 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/RunChecks as step s30
May 26, 2018 10:02:50 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/VerifyAssertions/ParDo(DefaultConclude) as step s31
May 26, 2018 10:02:50 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0526220246-44fd3a9d/output/results/staging/
May 26, 2018 10:02:50 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <71120 bytes, hash jsZuA-K0fNz4iVe4H4fRlg> to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0526220246-44fd3a9d/output/results/staging/pipeline-jsZuA-K0fNz4iVe4H4fRlg.pb
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 26, 2018 10:02:52 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-05-26_15_02_51-1937486401134024745?project=apache-beam-testing
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Submitted job: 2018-05-26_15_02_51-1937486401134024745
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 26, 2018 10:02:52 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-05-26_15_02_51-1937486401134024745
May 26, 2018 10:02:52 PM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-05-26_15_02_51-1937486401134024745 with 1 expected assertions.
May 26, 2018 10:03:06 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T22:02:51.346Z: Autoscaling is enabled for job 2018-05-26_15_02_51-1937486401134024745. The number of workers will be between 1 and 1000.
May 26, 2018 10:03:06 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T22:02:51.376Z: Autoscaling was automatically enabled for job 2018-05-26_15_02_51-1937486401134024745.
May 26, 2018 10:03:06 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T22:02:54.146Z: Checking required Cloud APIs are enabled.
May 26, 2018 10:03:06 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T22:02:54.325Z: Checking permissions granted to controller Service Account.
May 26, 2018 10:03:06 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T22:03:01.841Z: Worker configuration: n1-standard-1 in us-central1-b.
May 26, 2018 10:03:06 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T22:03:02.308Z: Expanding CoGroupByKey operations into optimizable parts.
May 26, 2018 10:03:06 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T22:03:02.506Z: Expanding GroupByKey operations into optimizable parts.
May 26, 2018 10:03:06 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T22:03:02.551Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
May 26, 2018 10:03:06 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T22:03:02.780Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
May 26, 2018 10:03:06 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T22:03:02.822Z: Elided trivial flatten
May 26, 2018 10:03:06 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T22:03:02.869Z: Elided trivial flatten
May 26, 2018 10:03:06 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T22:03:02.920Z: Elided trivial flatten
May 26, 2018 10:03:06 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T22:03:02.970Z: Unzipping flatten s24 for input s19.org.apache.beam.sdk.values.PCollection.<init>:329#8fd0f908e3ea90e3
May 26, 2018 10:03:06 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T22:03:03.014Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Reify, through flatten PAssert$33/GroupGlobally/FlattenDummyAndContents, into producer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map
May 26, 2018 10:03:06 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T22:03:03.053Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow into PAssert$33/GroupGlobally/GroupDummyAndContents/Read
May 26, 2018 10:03:06 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T22:03:03.106Z: Fusing consumer PAssert$33/GroupGlobally/ParDo(Concat) into PAssert$33/GroupGlobally/Values/Values/Map
May 26, 2018 10:03:06 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T22:03:03.145Z: Fusing consumer PAssert$33/GetPane/Map into PAssert$33/GroupGlobally/ParDo(Concat)
May 26, 2018 10:03:06 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T22:03:03.185Z: Fusing consumer PAssert$33/GroupGlobally/Values/Values/Map into PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow
May 26, 2018 10:03:06 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T22:03:03.223Z: Fusing consumer PAssert$33/RunChecks into PAssert$33/GetPane/Map
May 26, 2018 10:03:06 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T22:03:03.272Z: Fusing consumer PAssert$33/VerifyAssertions/ParDo(DefaultConclude) into PAssert$33/RunChecks
May 26, 2018 10:03:06 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T22:03:03.316Z: Unzipping flatten s24-u45 for input s26-reify-value18-c43
May 26, 2018 10:03:06 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T22:03:03.364Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Write, through flatten s24-u45, into producer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 26, 2018 10:03:06 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T22:03:03.424Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify into PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
May 26, 2018 10:03:06 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T22:03:03.479Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Write into PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 26, 2018 10:03:06 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T22:03:03.526Z: Fusing consumer PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)
May 26, 2018 10:03:06 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T22:03:03.563Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
May 26, 2018 10:03:06 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T22:03:03.604Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
May 26, 2018 10:03:06 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T22:03:03.654Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into PAssert$33/GroupGlobally/Window.Into()/Window.Assign
May 26, 2018 10:03:06 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T22:03:03.692Z: Fusing consumer OutputSideInputs into Create123/Read(CreateSource)
May 26, 2018 10:03:06 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T22:03:03.743Z: Fusing consumer PAssert$33/GroupGlobally/Window.Into()/Window.Assign into OutputSideInputs
May 26, 2018 10:03:06 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T22:03:03.793Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
May 26, 2018 10:03:06 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T22:03:03.828Z: Fusing consumer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map into PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
May 26, 2018 10:03:06 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T22:03:03.878Z: Fusing consumer PAssert$33/GroupGlobally/RewindowActuals/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map
May 26, 2018 10:03:06 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T22:03:03.910Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read
May 26, 2018 10:03:06 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T22:03:03.954Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
May 26, 2018 10:03:06 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T22:03:03.989Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
May 26, 2018 10:03:06 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T22:03:04.036Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
May 26, 2018 10:03:06 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T22:03:04.091Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
May 26, 2018 10:03:06 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T22:03:04.140Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
May 26, 2018 10:03:06 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T22:03:04.166Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into Create47/Read(CreateSource)
May 26, 2018 10:03:06 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T22:03:04.198Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
May 26, 2018 10:03:06 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T22:03:04.245Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
May 26, 2018 10:03:06 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T22:03:04.281Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
May 26, 2018 10:03:06 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T22:03:04.335Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
May 26, 2018 10:03:06 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T22:03:04.374Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
May 26, 2018 10:03:06 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T22:03:04.419Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
May 26, 2018 10:03:06 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T22:03:04.891Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Create
May 26, 2018 10:03:06 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T22:03:04.934Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Create
May 26, 2018 10:03:06 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T22:03:04.981Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
May 26, 2018 10:03:06 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T22:03:04.990Z: Starting 1 workers in us-central1-b...
May 26, 2018 10:03:06 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T22:03:05.023Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
May 26, 2018 10:03:06 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T22:03:05.270Z: Executing operation PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 26, 2018 10:03:06 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T22:03:05.310Z: Executing operation Create47/Read(CreateSource)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
May 26, 2018 10:03:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T22:03:14.998Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
May 26, 2018 10:03:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T22:03:25.742Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
May 26, 2018 10:03:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T22:03:25.792Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 26, 2018 10:03:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T22:03:57.550Z: Workers have started successfully.
May 26, 2018 10:04:43 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T22:04:42.750Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
May 26, 2018 10:04:43 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T22:04:42.825Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
May 26, 2018 10:04:48 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T22:04:47.845Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
May 26, 2018 10:04:48 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T22:04:47.942Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
May 26, 2018 10:05:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T22:05:00.953Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
May 26, 2018 10:05:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T22:05:01.061Z: Executing operation Create123/Read(CreateSource)+OutputSideInputs+PAssert$33/GroupGlobally/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write
May 26, 2018 10:05:06 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T22:05:04.394Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Close
May 26, 2018 10:05:06 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T22:05:04.458Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$33/GroupGlobally/RewindowActuals/Window.Assign+PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 26, 2018 10:05:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T22:05:08.181Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Close
May 26, 2018 10:05:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T22:05:08.258Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Read+PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$33/GroupGlobally/Values/Values/Map+PAssert$33/GroupGlobally/ParDo(Concat)+PAssert$33/GetPane/Map+PAssert$33/RunChecks+PAssert$33/VerifyAssertions/ParDo(DefaultConclude)
May 26, 2018 10:05:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T22:05:13.074Z: Cleaning up.
May 26, 2018 10:05:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T22:05:13.156Z: Stopping worker pool...
May 26, 2018 10:07:03 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T22:07:02.740Z: Autoscaling: Resized worker pool from 1 to 0.
May 26, 2018 10:07:03 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T22:07:02.793Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 26, 2018 10:07:03 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T22:07:02.848Z: Worker pool stopped.
May 26, 2018 10:07:12 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-05-26_15_02_51-1937486401134024745 finished with status DONE.
May 26, 2018 10:07:12 PM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-05-26_15_02_51-1937486401134024745. Found 1 success, 0 failures out of 1 expected assertions.
Gradle Test Executor 31 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest
209 tests completed, 34 failed, 2 skipped
Finished generating test XML results (0.656 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerTest>
Generating HTML test report...
Finished generating test html results (0.468 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest>
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest FAILED
:beam-runners-google-cloud-dataflow-java:validatesRunnerTest (Thread[Task worker for ':' Thread 26,5,main]) completed. Took 2 hrs 0 mins 40.483 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:validatesRunnerTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 1m 45s
38 actionable tasks: 34 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/sldhy44o3za2w
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user katarzyna.kucharczyk@polidea.com
Not sending mail to unregistered user robbe.sneyders@ml6.eu
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user schroederc@google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ammons@google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user sidhom@google.com
Build failed in Jenkins:
beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #357
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/357/display/redirect>
------------------------------------------
[...truncated 18.18 MB...]
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign as step s15
May 26, 2018 8:01:26 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey as step s16
May 26, 2018 8:01:26 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map as step s17
May 26, 2018 8:01:26 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RewindowActuals/Window.Assign as step s18
May 26, 2018 8:01:26 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map as step s19
May 26, 2018 8:01:26 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveActualsTriggering/Flatten.PCollections as step s20
May 26, 2018 8:01:26 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Create.Values/Read(CreateSource) as step s21
May 26, 2018 8:01:26 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign as step s22
May 26, 2018 8:01:26 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveDummyTriggering/Flatten.PCollections as step s23
May 26, 2018 8:01:26 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/FlattenDummyAndContents as step s24
May 26, 2018 8:01:26 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/NeverTrigger/Flatten.PCollections as step s25
May 26, 2018 8:01:26 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GroupDummyAndContents as step s26
May 26, 2018 8:01:26 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Values/Values/Map as step s27
May 26, 2018 8:01:26 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/ParDo(Concat) as step s28
May 26, 2018 8:01:26 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GetPane/Map as step s29
May 26, 2018 8:01:26 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/RunChecks as step s30
May 26, 2018 8:01:26 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/VerifyAssertions/ParDo(DefaultConclude) as step s31
May 26, 2018 8:01:26 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0526200121-1bdde8a6/output/results/staging/
May 26, 2018 8:01:26 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <71120 bytes, hash e2qkr9EepgAwFJ1qWmud7w> to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0526200121-1bdde8a6/output/results/staging/pipeline-e2qkr9EepgAwFJ1qWmud7w.pb
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 26, 2018 8:01:27 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-05-26_13_01_27-9967548429403791757?project=apache-beam-testing
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Submitted job: 2018-05-26_13_01_27-9967548429403791757
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 26, 2018 8:01:27 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-05-26_13_01_27-9967548429403791757
May 26, 2018 8:01:27 PM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-05-26_13_01_27-9967548429403791757 with 1 expected assertions.
May 26, 2018 8:01:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T20:01:27.068Z: Autoscaling is enabled for job 2018-05-26_13_01_27-9967548429403791757. The number of workers will be between 1 and 1000.
May 26, 2018 8:01:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T20:01:27.109Z: Autoscaling was automatically enabled for job 2018-05-26_13_01_27-9967548429403791757.
May 26, 2018 8:01:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T20:01:29.869Z: Checking required Cloud APIs are enabled.
May 26, 2018 8:01:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T20:01:30.000Z: Checking permissions granted to controller Service Account.
May 26, 2018 8:01:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T20:01:37.601Z: Worker configuration: n1-standard-1 in us-central1-f.
May 26, 2018 8:01:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T20:01:37.985Z: Expanding CoGroupByKey operations into optimizable parts.
May 26, 2018 8:01:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T20:01:38.154Z: Expanding GroupByKey operations into optimizable parts.
May 26, 2018 8:01:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T20:01:38.200Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
May 26, 2018 8:01:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T20:01:38.432Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
May 26, 2018 8:01:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T20:01:38.469Z: Elided trivial flatten
May 26, 2018 8:01:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T20:01:38.518Z: Elided trivial flatten
May 26, 2018 8:01:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T20:01:38.569Z: Elided trivial flatten
May 26, 2018 8:01:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T20:01:38.613Z: Unzipping flatten s24 for input s19.org.apache.beam.sdk.values.PCollection.<init>:329#8fd0f908e3ea90e3
May 26, 2018 8:01:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T20:01:38.649Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Reify, through flatten PAssert$33/GroupGlobally/FlattenDummyAndContents, into producer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map
May 26, 2018 8:01:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T20:01:38.704Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow into PAssert$33/GroupGlobally/GroupDummyAndContents/Read
May 26, 2018 8:01:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T20:01:38.748Z: Fusing consumer PAssert$33/GroupGlobally/ParDo(Concat) into PAssert$33/GroupGlobally/Values/Values/Map
May 26, 2018 8:01:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T20:01:38.788Z: Fusing consumer PAssert$33/GetPane/Map into PAssert$33/GroupGlobally/ParDo(Concat)
May 26, 2018 8:01:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T20:01:38.827Z: Fusing consumer PAssert$33/GroupGlobally/Values/Values/Map into PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow
May 26, 2018 8:01:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T20:01:38.871Z: Fusing consumer PAssert$33/RunChecks into PAssert$33/GetPane/Map
May 26, 2018 8:01:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T20:01:38.917Z: Fusing consumer PAssert$33/VerifyAssertions/ParDo(DefaultConclude) into PAssert$33/RunChecks
May 26, 2018 8:01:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T20:01:38.963Z: Unzipping flatten s24-u45 for input s26-reify-value18-c43
May 26, 2018 8:01:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T20:01:39.007Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Write, through flatten s24-u45, into producer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 26, 2018 8:01:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T20:01:39.049Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify into PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
May 26, 2018 8:01:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T20:01:39.087Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Write into PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 26, 2018 8:01:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T20:01:39.128Z: Fusing consumer PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)
May 26, 2018 8:01:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T20:01:39.171Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
May 26, 2018 8:01:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T20:01:39.221Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
May 26, 2018 8:01:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T20:01:39.271Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into PAssert$33/GroupGlobally/Window.Into()/Window.Assign
May 26, 2018 8:01:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T20:01:39.318Z: Fusing consumer OutputSideInputs into Create123/Read(CreateSource)
May 26, 2018 8:01:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T20:01:39.351Z: Fusing consumer PAssert$33/GroupGlobally/Window.Into()/Window.Assign into OutputSideInputs
May 26, 2018 8:01:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T20:01:39.396Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
May 26, 2018 8:01:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T20:01:39.437Z: Fusing consumer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map into PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
May 26, 2018 8:01:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T20:01:39.483Z: Fusing consumer PAssert$33/GroupGlobally/RewindowActuals/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map
May 26, 2018 8:01:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T20:01:39.532Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read
May 26, 2018 8:01:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T20:01:39.568Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
May 26, 2018 8:01:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T20:01:39.618Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
May 26, 2018 8:01:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T20:01:39.657Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
May 26, 2018 8:01:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T20:01:39.705Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
May 26, 2018 8:01:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T20:01:39.750Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
May 26, 2018 8:01:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T20:01:39.790Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into Create47/Read(CreateSource)
May 26, 2018 8:01:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T20:01:39.838Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
May 26, 2018 8:01:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T20:01:39.878Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
May 26, 2018 8:01:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T20:01:39.925Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
May 26, 2018 8:01:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T20:01:39.983Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
May 26, 2018 8:01:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T20:01:40.032Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
May 26, 2018 8:01:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T20:01:40.060Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
May 26, 2018 8:01:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T20:01:40.485Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Create
May 26, 2018 8:01:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T20:01:40.525Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Create
May 26, 2018 8:01:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T20:01:40.568Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
May 26, 2018 8:01:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T20:01:40.584Z: Starting 1 workers in us-central1-f...
May 26, 2018 8:01:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T20:01:40.615Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
May 26, 2018 8:01:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T20:01:40.844Z: Executing operation Create47/Read(CreateSource)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
May 26, 2018 8:01:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T20:01:40.893Z: Executing operation PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 26, 2018 8:01:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T20:01:47.615Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
May 26, 2018 8:02:24 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T20:02:23.921Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
May 26, 2018 8:02:24 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T20:02:23.970Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 26, 2018 8:02:43 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T20:02:42.284Z: Workers have started successfully.
May 26, 2018 8:03:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T20:03:03.848Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
May 26, 2018 8:03:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T20:03:03.928Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
May 26, 2018 8:03:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T20:03:12.504Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
May 26, 2018 8:03:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T20:03:12.578Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
May 26, 2018 8:03:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T20:03:26.425Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
May 26, 2018 8:03:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T20:03:26.675Z: Executing operation Create123/Read(CreateSource)+OutputSideInputs+PAssert$33/GroupGlobally/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write
May 26, 2018 8:03:33 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T20:03:32.223Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Close
May 26, 2018 8:03:33 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T20:03:32.321Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$33/GroupGlobally/RewindowActuals/Window.Assign+PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 26, 2018 8:03:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T20:03:35.843Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Close
May 26, 2018 8:03:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T20:03:35.924Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Read+PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$33/GroupGlobally/Values/Values/Map+PAssert$33/GroupGlobally/ParDo(Concat)+PAssert$33/GetPane/Map+PAssert$33/RunChecks+PAssert$33/VerifyAssertions/ParDo(DefaultConclude)
May 26, 2018 8:03:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T20:03:37.555Z: Cleaning up.
May 26, 2018 8:03:40 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T20:03:37.657Z: Stopping worker pool...
May 26, 2018 8:05:03 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T20:05:03.211Z: Autoscaling: Resized worker pool from 1 to 0.
May 26, 2018 8:05:03 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T20:05:03.239Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 26, 2018 8:05:13 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-05-26_13_01_27-9967548429403791757 finished with status DONE.
May 26, 2018 8:05:13 PM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-05-26_13_01_27-9967548429403791757. Found 1 success, 0 failures out of 1 expected assertions.
Gradle Test Executor 39 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest FAILED
209 tests completed, 34 failed, 2 skipped
Finished generating test XML results (0.748 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerTest>
Generating HTML test report...
Finished generating test html results (0.46 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest>
:beam-runners-google-cloud-dataflow-java:validatesRunnerTest (Thread[Task worker for ':' Thread 34,5,main]) completed. Took 2 hrs 2 mins 53.688 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:validatesRunnerTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 4m 19s
38 actionable tasks: 34 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/ceeu5gmv7baqm
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user katarzyna.kucharczyk@polidea.com
Not sending mail to unregistered user robbe.sneyders@ml6.eu
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user schroederc@google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ammons@google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user sidhom@google.com
Build failed in Jenkins:
beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #356
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/356/display/redirect?page=changes>
Changes:
[iemejia] [BEAM-4317] Enforce ErrorProne analysis in runners/reference/java
------------------------------------------
[...truncated 18.18 MB...]
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey as step s16
May 26, 2018 4:10:05 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map as step s17
May 26, 2018 4:10:05 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RewindowActuals/Window.Assign as step s18
May 26, 2018 4:10:05 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map as step s19
May 26, 2018 4:10:05 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveActualsTriggering/Flatten.PCollections as step s20
May 26, 2018 4:10:05 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Create.Values/Read(CreateSource) as step s21
May 26, 2018 4:10:05 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign as step s22
May 26, 2018 4:10:05 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveDummyTriggering/Flatten.PCollections as step s23
May 26, 2018 4:10:05 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/FlattenDummyAndContents as step s24
May 26, 2018 4:10:05 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/NeverTrigger/Flatten.PCollections as step s25
May 26, 2018 4:10:05 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GroupDummyAndContents as step s26
May 26, 2018 4:10:05 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Values/Values/Map as step s27
May 26, 2018 4:10:05 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/ParDo(Concat) as step s28
May 26, 2018 4:10:05 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GetPane/Map as step s29
May 26, 2018 4:10:05 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/RunChecks as step s30
May 26, 2018 4:10:05 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/VerifyAssertions/ParDo(DefaultConclude) as step s31
May 26, 2018 4:10:05 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0526160957-eb256fbb/output/results/staging/
May 26, 2018 4:10:05 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <71120 bytes, hash Y_WZ8M4Ne-2Qfe-WysrWdg> to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0526160957-eb256fbb/output/results/staging/pipeline-Y_WZ8M4Ne-2Qfe-WysrWdg.pb
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 26, 2018 4:10:07 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-05-26_09_10_06-1251008024246467950?project=apache-beam-testing
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Submitted job: 2018-05-26_09_10_06-1251008024246467950
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 26, 2018 4:10:07 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-05-26_09_10_06-1251008024246467950
May 26, 2018 4:10:07 PM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-05-26_09_10_06-1251008024246467950 with 1 expected assertions.
May 26, 2018 4:10:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T16:10:06.068Z: Autoscaling is enabled for job 2018-05-26_09_10_06-1251008024246467950. The number of workers will be between 1 and 1000.
May 26, 2018 4:10:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T16:10:06.109Z: Autoscaling was automatically enabled for job 2018-05-26_09_10_06-1251008024246467950.
May 26, 2018 4:10:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T16:10:08.702Z: Checking required Cloud APIs are enabled.
May 26, 2018 4:10:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T16:10:08.877Z: Checking permissions granted to controller Service Account.
May 26, 2018 4:10:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T16:10:15.459Z: Worker configuration: n1-standard-1 in us-central1-b.
May 26, 2018 4:10:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T16:10:15.932Z: Expanding CoGroupByKey operations into optimizable parts.
May 26, 2018 4:10:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T16:10:16.095Z: Expanding GroupByKey operations into optimizable parts.
May 26, 2018 4:10:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T16:10:16.140Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
May 26, 2018 4:10:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T16:10:16.339Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
May 26, 2018 4:10:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T16:10:16.364Z: Elided trivial flatten
May 26, 2018 4:10:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T16:10:16.406Z: Elided trivial flatten
May 26, 2018 4:10:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T16:10:16.443Z: Elided trivial flatten
May 26, 2018 4:10:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T16:10:16.479Z: Unzipping flatten s24 for input s19.org.apache.beam.sdk.values.PCollection.<init>:329#8fd0f908e3ea90e3
May 26, 2018 4:10:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T16:10:16.511Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Reify, through flatten PAssert$33/GroupGlobally/FlattenDummyAndContents, into producer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map
May 26, 2018 4:10:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T16:10:16.554Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow into PAssert$33/GroupGlobally/GroupDummyAndContents/Read
May 26, 2018 4:10:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T16:10:16.598Z: Fusing consumer PAssert$33/GroupGlobally/ParDo(Concat) into PAssert$33/GroupGlobally/Values/Values/Map
May 26, 2018 4:10:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T16:10:16.629Z: Fusing consumer PAssert$33/GetPane/Map into PAssert$33/GroupGlobally/ParDo(Concat)
May 26, 2018 4:10:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T16:10:16.662Z: Fusing consumer PAssert$33/GroupGlobally/Values/Values/Map into PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow
May 26, 2018 4:10:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T16:10:16.698Z: Fusing consumer PAssert$33/RunChecks into PAssert$33/GetPane/Map
May 26, 2018 4:10:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T16:10:16.741Z: Fusing consumer PAssert$33/VerifyAssertions/ParDo(DefaultConclude) into PAssert$33/RunChecks
May 26, 2018 4:10:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T16:10:16.777Z: Unzipping flatten s24-u45 for input s26-reify-value18-c43
May 26, 2018 4:10:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T16:10:16.820Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Write, through flatten s24-u45, into producer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 26, 2018 4:10:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T16:10:16.864Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify into PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
May 26, 2018 4:10:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T16:10:16.908Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Write into PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 26, 2018 4:10:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T16:10:16.944Z: Fusing consumer PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)
May 26, 2018 4:10:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T16:10:16.987Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
May 26, 2018 4:10:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T16:10:17.026Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
May 26, 2018 4:10:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T16:10:17.070Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into PAssert$33/GroupGlobally/Window.Into()/Window.Assign
May 26, 2018 4:10:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T16:10:17.110Z: Fusing consumer OutputSideInputs into Create123/Read(CreateSource)
May 26, 2018 4:10:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T16:10:17.156Z: Fusing consumer PAssert$33/GroupGlobally/Window.Into()/Window.Assign into OutputSideInputs
May 26, 2018 4:10:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T16:10:17.200Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
May 26, 2018 4:10:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T16:10:17.235Z: Fusing consumer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map into PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
May 26, 2018 4:10:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T16:10:17.270Z: Fusing consumer PAssert$33/GroupGlobally/RewindowActuals/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map
May 26, 2018 4:10:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T16:10:17.307Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read
May 26, 2018 4:10:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T16:10:17.346Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
May 26, 2018 4:10:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T16:10:17.390Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
May 26, 2018 4:10:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T16:10:17.431Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
May 26, 2018 4:10:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T16:10:17.478Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
May 26, 2018 4:10:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T16:10:17.522Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
May 26, 2018 4:10:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T16:10:17.551Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into Create47/Read(CreateSource)
May 26, 2018 4:10:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T16:10:17.591Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
May 26, 2018 4:10:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T16:10:17.631Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
May 26, 2018 4:10:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T16:10:17.667Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
May 26, 2018 4:10:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T16:10:17.712Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
May 26, 2018 4:10:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T16:10:17.745Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
May 26, 2018 4:10:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T16:10:17.782Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
May 26, 2018 4:10:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T16:10:18.215Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Create
May 26, 2018 4:10:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T16:10:18.251Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Create
May 26, 2018 4:10:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T16:10:18.282Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
May 26, 2018 4:10:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T16:10:18.307Z: Starting 1 workers in us-central1-b...
May 26, 2018 4:10:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T16:10:18.317Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
May 26, 2018 4:10:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T16:10:18.572Z: Executing operation Create47/Read(CreateSource)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
May 26, 2018 4:10:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T16:10:18.611Z: Executing operation PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 26, 2018 4:10:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T16:10:28.381Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
May 26, 2018 4:10:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T16:10:39.112Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
May 26, 2018 4:10:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T16:10:39.158Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 26, 2018 4:11:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T16:11:01.151Z: Workers have started successfully.
May 26, 2018 4:11:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T16:11:22.493Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
May 26, 2018 4:11:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T16:11:22.562Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
May 26, 2018 4:11:29 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T16:11:27.689Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
May 26, 2018 4:11:29 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T16:11:27.771Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
May 26, 2018 4:11:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T16:11:38.674Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
May 26, 2018 4:11:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T16:11:38.856Z: Executing operation Create123/Read(CreateSource)+OutputSideInputs+PAssert$33/GroupGlobally/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write
May 26, 2018 4:11:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T16:11:44.348Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Close
May 26, 2018 4:11:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T16:11:44.443Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$33/GroupGlobally/RewindowActuals/Window.Assign+PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 26, 2018 4:11:47 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T16:11:47.140Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Close
May 26, 2018 4:11:49 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T16:11:47.236Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Read+PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$33/GroupGlobally/Values/Values/Map+PAssert$33/GroupGlobally/ParDo(Concat)+PAssert$33/GetPane/Map+PAssert$33/RunChecks+PAssert$33/VerifyAssertions/ParDo(DefaultConclude)
May 26, 2018 4:11:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T16:11:51.140Z: Cleaning up.
May 26, 2018 4:11:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T16:11:51.251Z: Stopping worker pool...
May 26, 2018 4:13:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T16:13:24.867Z: Autoscaling: Resized worker pool from 1 to 0.
May 26, 2018 4:13:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T16:13:24.890Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 26, 2018 4:13:34 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-05-26_09_10_06-1251008024246467950 finished with status DONE.
May 26, 2018 4:13:34 PM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-05-26_09_10_06-1251008024246467950. Found 1 success, 0 failures out of 1 expected assertions.
Gradle Test Executor 43 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest
209 tests completed, 34 failed, 2 skipped
Finished generating test XML results (0.479 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerTest>
Generating HTML test report...
Finished generating test html results (0.76 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest>
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest FAILED
:beam-runners-google-cloud-dataflow-java:validatesRunnerTest (Thread[Task worker for ':' Thread 29,5,main]) completed. Took 2 hrs 5 mins 2.092 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:validatesRunnerTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 5m 56s
38 actionable tasks: 34 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/hyzl5zf4ya4mk
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user katarzyna.kucharczyk@polidea.com
Not sending mail to unregistered user robbe.sneyders@ml6.eu
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user schroederc@google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ammons@google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user sidhom@google.com
Build failed in Jenkins:
beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #355
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/355/display/redirect>
------------------------------------------
[...truncated 18.21 MB...]
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign as step s15
May 26, 2018 2:03:54 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey as step s16
May 26, 2018 2:03:54 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map as step s17
May 26, 2018 2:03:54 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RewindowActuals/Window.Assign as step s18
May 26, 2018 2:03:54 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map as step s19
May 26, 2018 2:03:54 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveActualsTriggering/Flatten.PCollections as step s20
May 26, 2018 2:03:54 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Create.Values/Read(CreateSource) as step s21
May 26, 2018 2:03:54 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign as step s22
May 26, 2018 2:03:54 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveDummyTriggering/Flatten.PCollections as step s23
May 26, 2018 2:03:54 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/FlattenDummyAndContents as step s24
May 26, 2018 2:03:54 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/NeverTrigger/Flatten.PCollections as step s25
May 26, 2018 2:03:54 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GroupDummyAndContents as step s26
May 26, 2018 2:03:54 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Values/Values/Map as step s27
May 26, 2018 2:03:54 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/ParDo(Concat) as step s28
May 26, 2018 2:03:54 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GetPane/Map as step s29
May 26, 2018 2:03:54 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/RunChecks as step s30
May 26, 2018 2:03:54 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/VerifyAssertions/ParDo(DefaultConclude) as step s31
May 26, 2018 2:03:54 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0526140351-26b6ba22/output/results/staging/
May 26, 2018 2:03:54 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <71120 bytes, hash c5Hg-CGvIBK08MhcL8OWIQ> to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0526140351-26b6ba22/output/results/staging/pipeline-c5Hg-CGvIBK08MhcL8OWIQ.pb
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 26, 2018 2:03:56 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-05-26_07_03_55-8454700760240127139?project=apache-beam-testing
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Submitted job: 2018-05-26_07_03_55-8454700760240127139
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 26, 2018 2:03:56 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-05-26_07_03_55-8454700760240127139
May 26, 2018 2:03:56 PM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-05-26_07_03_55-8454700760240127139 with 1 expected assertions.
May 26, 2018 2:04:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T14:03:55.368Z: Autoscaling is enabled for job 2018-05-26_07_03_55-8454700760240127139. The number of workers will be between 1 and 1000.
May 26, 2018 2:04:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T14:03:55.409Z: Autoscaling was automatically enabled for job 2018-05-26_07_03_55-8454700760240127139.
May 26, 2018 2:04:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T14:03:57.944Z: Checking required Cloud APIs are enabled.
May 26, 2018 2:04:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T14:03:58.066Z: Checking permissions granted to controller Service Account.
May 26, 2018 2:04:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T14:04:03.910Z: Worker configuration: n1-standard-1 in us-central1-b.
May 26, 2018 2:04:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T14:04:04.313Z: Expanding CoGroupByKey operations into optimizable parts.
May 26, 2018 2:04:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T14:04:04.499Z: Expanding GroupByKey operations into optimizable parts.
May 26, 2018 2:04:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T14:04:04.546Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
May 26, 2018 2:04:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T14:04:04.789Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
May 26, 2018 2:04:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T14:04:04.835Z: Elided trivial flatten
May 26, 2018 2:04:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T14:04:04.876Z: Elided trivial flatten
May 26, 2018 2:04:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T14:04:04.918Z: Elided trivial flatten
May 26, 2018 2:04:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T14:04:04.966Z: Unzipping flatten s24 for input s19.org.apache.beam.sdk.values.PCollection.<init>:329#8fd0f908e3ea90e3
May 26, 2018 2:04:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T14:04:05.322Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Reify, through flatten PAssert$33/GroupGlobally/FlattenDummyAndContents, into producer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map
May 26, 2018 2:04:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T14:04:05.367Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow into PAssert$33/GroupGlobally/GroupDummyAndContents/Read
May 26, 2018 2:04:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T14:04:05.404Z: Fusing consumer PAssert$33/GroupGlobally/ParDo(Concat) into PAssert$33/GroupGlobally/Values/Values/Map
May 26, 2018 2:04:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T14:04:05.456Z: Fusing consumer PAssert$33/GetPane/Map into PAssert$33/GroupGlobally/ParDo(Concat)
May 26, 2018 2:04:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T14:04:05.491Z: Fusing consumer PAssert$33/GroupGlobally/Values/Values/Map into PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow
May 26, 2018 2:04:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T14:04:05.535Z: Fusing consumer PAssert$33/RunChecks into PAssert$33/GetPane/Map
May 26, 2018 2:04:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T14:04:05.573Z: Fusing consumer PAssert$33/VerifyAssertions/ParDo(DefaultConclude) into PAssert$33/RunChecks
May 26, 2018 2:04:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T14:04:05.608Z: Unzipping flatten s24-u45 for input s26-reify-value18-c43
May 26, 2018 2:04:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T14:04:05.655Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Write, through flatten s24-u45, into producer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 26, 2018 2:04:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T14:04:05.692Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify into PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
May 26, 2018 2:04:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T14:04:05.736Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Write into PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 26, 2018 2:04:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T14:04:05.783Z: Fusing consumer PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)
May 26, 2018 2:04:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T14:04:05.817Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
May 26, 2018 2:04:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T14:04:05.857Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
May 26, 2018 2:04:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T14:04:05.895Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into PAssert$33/GroupGlobally/Window.Into()/Window.Assign
May 26, 2018 2:04:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T14:04:05.939Z: Fusing consumer OutputSideInputs into Create123/Read(CreateSource)
May 26, 2018 2:04:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T14:04:05.976Z: Fusing consumer PAssert$33/GroupGlobally/Window.Into()/Window.Assign into OutputSideInputs
May 26, 2018 2:04:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T14:04:06.025Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
May 26, 2018 2:04:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T14:04:06.219Z: Fusing consumer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map into PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
May 26, 2018 2:04:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T14:04:06.266Z: Fusing consumer PAssert$33/GroupGlobally/RewindowActuals/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map
May 26, 2018 2:04:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T14:04:06.313Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read
May 26, 2018 2:04:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T14:04:06.351Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
May 26, 2018 2:04:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T14:04:06.393Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
May 26, 2018 2:04:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T14:04:06.442Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
May 26, 2018 2:04:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T14:04:06.485Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
May 26, 2018 2:04:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T14:04:06.520Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
May 26, 2018 2:04:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T14:04:06.564Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into Create47/Read(CreateSource)
May 26, 2018 2:04:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T14:04:06.595Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
May 26, 2018 2:04:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T14:04:06.641Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
May 26, 2018 2:04:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T14:04:06.681Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
May 26, 2018 2:04:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T14:04:06.719Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
May 26, 2018 2:04:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T14:04:06.757Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
May 26, 2018 2:04:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T14:04:06.804Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
May 26, 2018 2:04:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T14:04:07.284Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Create
May 26, 2018 2:04:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T14:04:07.328Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Create
May 26, 2018 2:04:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T14:04:07.365Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
May 26, 2018 2:04:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T14:04:07.419Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
May 26, 2018 2:04:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T14:04:07.419Z: Starting 1 workers in us-central1-b...
May 26, 2018 2:04:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T14:04:07.697Z: Executing operation Create47/Read(CreateSource)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
May 26, 2018 2:04:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T14:04:07.742Z: Executing operation PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 26, 2018 2:04:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T14:04:17.359Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
May 26, 2018 2:04:33 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T14:04:33.445Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
May 26, 2018 2:04:33 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T14:04:33.482Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 26, 2018 2:04:57 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T14:04:57.235Z: Workers have started successfully.
May 26, 2018 2:05:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T14:05:16.907Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
May 26, 2018 2:05:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T14:05:16.999Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
May 26, 2018 2:05:21 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T14:05:21.636Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
May 26, 2018 2:05:21 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T14:05:21.717Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
May 26, 2018 2:05:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T14:05:34.239Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
May 26, 2018 2:05:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T14:05:34.461Z: Executing operation Create123/Read(CreateSource)+OutputSideInputs+PAssert$33/GroupGlobally/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write
May 26, 2018 2:05:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T14:05:41.467Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Close
May 26, 2018 2:05:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T14:05:41.581Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$33/GroupGlobally/RewindowActuals/Window.Assign+PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 26, 2018 2:05:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T14:05:44.211Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Close
May 26, 2018 2:05:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T14:05:44.315Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Read+PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$33/GroupGlobally/Values/Values/Map+PAssert$33/GroupGlobally/ParDo(Concat)+PAssert$33/GetPane/Map+PAssert$33/RunChecks+PAssert$33/VerifyAssertions/ParDo(DefaultConclude)
May 26, 2018 2:05:49 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T14:05:48.207Z: Cleaning up.
May 26, 2018 2:05:49 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T14:05:48.315Z: Stopping worker pool...
May 26, 2018 2:07:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T14:07:14.294Z: Autoscaling: Resized worker pool from 1 to 0.
May 26, 2018 2:07:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T14:07:14.333Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 26, 2018 2:07:22 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-05-26_07_03_55-8454700760240127139 finished with status DONE.
May 26, 2018 2:07:22 PM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-05-26_07_03_55-8454700760240127139. Found 1 success, 0 failures out of 1 expected assertions.
Gradle Test Executor 37 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest FAILED
209 tests completed, 34 failed, 2 skipped
Finished generating test XML results (0.558 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerTest>
Generating HTML test report...
Finished generating test html results (0.401 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest>
:beam-runners-google-cloud-dataflow-java:validatesRunnerTest (Thread[Task worker for ':' Thread 31,5,main]) completed. Took 2 hrs 5 mins 17.138 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:validatesRunnerTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 6m 42s
38 actionable tasks: 34 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/uazktwnftzg2y
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user katarzyna.kucharczyk@polidea.com
Not sending mail to unregistered user robbe.sneyders@ml6.eu
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user schroederc@google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ammons@google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user sidhom@google.com
Build failed in Jenkins:
beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #354
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/354/display/redirect>
------------------------------------------
[...truncated 18.19 MB...]
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign as step s15
May 26, 2018 8:03:32 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey as step s16
May 26, 2018 8:03:32 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map as step s17
May 26, 2018 8:03:32 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RewindowActuals/Window.Assign as step s18
May 26, 2018 8:03:32 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map as step s19
May 26, 2018 8:03:32 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveActualsTriggering/Flatten.PCollections as step s20
May 26, 2018 8:03:32 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Create.Values/Read(CreateSource) as step s21
May 26, 2018 8:03:32 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign as step s22
May 26, 2018 8:03:32 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveDummyTriggering/Flatten.PCollections as step s23
May 26, 2018 8:03:32 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/FlattenDummyAndContents as step s24
May 26, 2018 8:03:32 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/NeverTrigger/Flatten.PCollections as step s25
May 26, 2018 8:03:32 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GroupDummyAndContents as step s26
May 26, 2018 8:03:32 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Values/Values/Map as step s27
May 26, 2018 8:03:32 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/ParDo(Concat) as step s28
May 26, 2018 8:03:32 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GetPane/Map as step s29
May 26, 2018 8:03:32 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/RunChecks as step s30
May 26, 2018 8:03:32 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/VerifyAssertions/ParDo(DefaultConclude) as step s31
May 26, 2018 8:03:32 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0526080329-8be8a965/output/results/staging/
May 26, 2018 8:03:32 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <71120 bytes, hash 0xvdA6oIRV_AaF2CWdkaLw> to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0526080329-8be8a965/output/results/staging/pipeline-0xvdA6oIRV_AaF2CWdkaLw.pb
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 26, 2018 8:03:34 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-05-26_01_03_33-6171732059637139894?project=apache-beam-testing
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Submitted job: 2018-05-26_01_03_33-6171732059637139894
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 26, 2018 8:03:34 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-05-26_01_03_33-6171732059637139894
May 26, 2018 8:03:34 AM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-05-26_01_03_33-6171732059637139894 with 1 expected assertions.
May 26, 2018 8:03:47 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T08:03:33.251Z: Autoscaling is enabled for job 2018-05-26_01_03_33-6171732059637139894. The number of workers will be between 1 and 1000.
May 26, 2018 8:03:47 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T08:03:33.286Z: Autoscaling was automatically enabled for job 2018-05-26_01_03_33-6171732059637139894.
May 26, 2018 8:03:47 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T08:03:36.039Z: Checking required Cloud APIs are enabled.
May 26, 2018 8:03:47 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T08:03:36.225Z: Checking permissions granted to controller Service Account.
May 26, 2018 8:03:47 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T08:03:41.309Z: Worker configuration: n1-standard-1 in us-central1-b.
May 26, 2018 8:03:47 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T08:03:41.792Z: Expanding CoGroupByKey operations into optimizable parts.
May 26, 2018 8:03:47 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T08:03:42.010Z: Expanding GroupByKey operations into optimizable parts.
May 26, 2018 8:03:47 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T08:03:42.060Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
May 26, 2018 8:03:47 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T08:03:42.311Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
May 26, 2018 8:03:47 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T08:03:42.351Z: Elided trivial flatten
May 26, 2018 8:03:47 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T08:03:42.399Z: Elided trivial flatten
May 26, 2018 8:03:47 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T08:03:42.448Z: Elided trivial flatten
May 26, 2018 8:03:47 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T08:03:42.496Z: Unzipping flatten s24 for input s19.org.apache.beam.sdk.values.PCollection.<init>:329#8fd0f908e3ea90e3
May 26, 2018 8:03:47 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T08:03:42.542Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Reify, through flatten PAssert$33/GroupGlobally/FlattenDummyAndContents, into producer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map
May 26, 2018 8:03:47 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T08:03:42.590Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow into PAssert$33/GroupGlobally/GroupDummyAndContents/Read
May 26, 2018 8:03:47 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T08:03:42.639Z: Fusing consumer PAssert$33/GroupGlobally/ParDo(Concat) into PAssert$33/GroupGlobally/Values/Values/Map
May 26, 2018 8:03:47 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T08:03:42.685Z: Fusing consumer PAssert$33/GetPane/Map into PAssert$33/GroupGlobally/ParDo(Concat)
May 26, 2018 8:03:47 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T08:03:42.725Z: Fusing consumer PAssert$33/GroupGlobally/Values/Values/Map into PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow
May 26, 2018 8:03:47 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T08:03:42.754Z: Fusing consumer PAssert$33/RunChecks into PAssert$33/GetPane/Map
May 26, 2018 8:03:47 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T08:03:42.821Z: Fusing consumer PAssert$33/VerifyAssertions/ParDo(DefaultConclude) into PAssert$33/RunChecks
May 26, 2018 8:03:47 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T08:03:42.870Z: Unzipping flatten s24-u45 for input s26-reify-value18-c43
May 26, 2018 8:03:47 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T08:03:42.910Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Write, through flatten s24-u45, into producer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 26, 2018 8:03:47 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T08:03:42.957Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify into PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
May 26, 2018 8:03:47 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T08:03:43.006Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Write into PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 26, 2018 8:03:47 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T08:03:43.057Z: Fusing consumer PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)
May 26, 2018 8:03:47 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T08:03:43.105Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
May 26, 2018 8:03:47 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T08:03:43.157Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
May 26, 2018 8:03:47 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T08:03:43.201Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into PAssert$33/GroupGlobally/Window.Into()/Window.Assign
May 26, 2018 8:03:47 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T08:03:43.246Z: Fusing consumer OutputSideInputs into Create123/Read(CreateSource)
May 26, 2018 8:03:47 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T08:03:43.287Z: Fusing consumer PAssert$33/GroupGlobally/Window.Into()/Window.Assign into OutputSideInputs
May 26, 2018 8:03:47 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T08:03:43.335Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
May 26, 2018 8:03:47 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T08:03:43.374Z: Fusing consumer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map into PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
May 26, 2018 8:03:47 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T08:03:43.427Z: Fusing consumer PAssert$33/GroupGlobally/RewindowActuals/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map
May 26, 2018 8:03:47 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T08:03:43.453Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read
May 26, 2018 8:03:47 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T08:03:43.486Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
May 26, 2018 8:03:47 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T08:03:43.532Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
May 26, 2018 8:03:47 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T08:03:43.569Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
May 26, 2018 8:03:47 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T08:03:43.608Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
May 26, 2018 8:03:47 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T08:03:43.649Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
May 26, 2018 8:03:47 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T08:03:43.691Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into Create47/Read(CreateSource)
May 26, 2018 8:03:47 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T08:03:43.742Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
May 26, 2018 8:03:47 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T08:03:43.786Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
May 26, 2018 8:03:47 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T08:03:43.820Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
May 26, 2018 8:03:47 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T08:03:43.857Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
May 26, 2018 8:03:47 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T08:03:43.895Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
May 26, 2018 8:03:47 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T08:03:43.947Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
May 26, 2018 8:03:47 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T08:03:44.441Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Create
May 26, 2018 8:03:47 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T08:03:44.489Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Create
May 26, 2018 8:03:47 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T08:03:44.524Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
May 26, 2018 8:03:47 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T08:03:44.550Z: Starting 1 workers in us-central1-b...
May 26, 2018 8:03:47 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T08:03:44.573Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
May 26, 2018 8:03:47 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T08:03:44.833Z: Executing operation PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 26, 2018 8:03:47 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T08:03:44.869Z: Executing operation Create47/Read(CreateSource)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
May 26, 2018 8:03:55 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T08:03:54.949Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
May 26, 2018 8:04:06 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T08:04:05.653Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
May 26, 2018 8:04:06 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T08:04:05.701Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 26, 2018 8:04:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T08:04:28.421Z: Workers have started successfully.
May 26, 2018 8:04:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T08:04:52.006Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
May 26, 2018 8:04:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T08:04:52.111Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
May 26, 2018 8:04:59 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T08:04:57.488Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
May 26, 2018 8:04:59 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T08:04:57.588Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
May 26, 2018 8:05:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T08:05:11.249Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
May 26, 2018 8:05:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T08:05:11.468Z: Executing operation Create123/Read(CreateSource)+OutputSideInputs+PAssert$33/GroupGlobally/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write
May 26, 2018 8:05:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T08:05:16.138Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Close
May 26, 2018 8:05:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T08:05:16.228Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$33/GroupGlobally/RewindowActuals/Window.Assign+PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 26, 2018 8:05:19 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T08:05:18.221Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Close
May 26, 2018 8:05:19 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T08:05:18.326Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Read+PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$33/GroupGlobally/Values/Values/Map+PAssert$33/GroupGlobally/ParDo(Concat)+PAssert$33/GetPane/Map+PAssert$33/RunChecks+PAssert$33/VerifyAssertions/ParDo(DefaultConclude)
May 26, 2018 8:05:22 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T08:05:21.695Z: Cleaning up.
May 26, 2018 8:05:22 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T08:05:21.813Z: Stopping worker pool...
May 26, 2018 8:06:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T08:06:58.066Z: Autoscaling: Resized worker pool from 1 to 0.
May 26, 2018 8:06:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T08:06:58.095Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 26, 2018 8:07:06 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-05-26_01_03_33-6171732059637139894 finished with status DONE.
May 26, 2018 8:07:06 AM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-05-26_01_03_33-6171732059637139894. Found 1 success, 0 failures out of 1 expected assertions.
Gradle Test Executor 36 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest FAILED
209 tests completed, 34 failed, 2 skipped
Finished generating test XML results (0.374 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerTest>
Generating HTML test report...
Finished generating test html results (0.315 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest>
:beam-runners-google-cloud-dataflow-java:validatesRunnerTest (Thread[Task worker for ':' Thread 13,5,main]) completed. Took 2 hrs 4 mins 36.651 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:validatesRunnerTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 5m 59s
38 actionable tasks: 34 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/2wdbysfn77qm4
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user katarzyna.kucharczyk@polidea.com
Not sending mail to unregistered user robbe.sneyders@ml6.eu
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user schroederc@google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ammons@google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user sidhom@google.com
Build failed in Jenkins:
beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #353
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/353/display/redirect?page=changes>
Changes:
[tgroh] Add a Portable TransformEvaluatorRegistry
[tgroh] Consistent Parameter Order in Evaluator Factories
------------------------------------------
[...truncated 18.13 MB...]
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map as step s17
May 26, 2018 5:42:34 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RewindowActuals/Window.Assign as step s18
May 26, 2018 5:42:34 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map as step s19
May 26, 2018 5:42:34 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveActualsTriggering/Flatten.PCollections as step s20
May 26, 2018 5:42:34 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Create.Values/Read(CreateSource) as step s21
May 26, 2018 5:42:34 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign as step s22
May 26, 2018 5:42:34 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveDummyTriggering/Flatten.PCollections as step s23
May 26, 2018 5:42:34 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/FlattenDummyAndContents as step s24
May 26, 2018 5:42:34 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/NeverTrigger/Flatten.PCollections as step s25
May 26, 2018 5:42:34 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GroupDummyAndContents as step s26
May 26, 2018 5:42:34 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Values/Values/Map as step s27
May 26, 2018 5:42:34 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/ParDo(Concat) as step s28
May 26, 2018 5:42:34 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GetPane/Map as step s29
May 26, 2018 5:42:34 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/RunChecks as step s30
May 26, 2018 5:42:34 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/VerifyAssertions/ParDo(DefaultConclude) as step s31
May 26, 2018 5:42:34 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0526054230-7d0bc86d/output/results/staging/
May 26, 2018 5:42:34 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <71120 bytes, hash -HMU01OF9AT0mGPlYeRwLQ> to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0526054230-7d0bc86d/output/results/staging/pipeline--HMU01OF9AT0mGPlYeRwLQ.pb
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 26, 2018 5:42:35 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-05-25_22_42_34-10417657797012504459?project=apache-beam-testing
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Submitted job: 2018-05-25_22_42_34-10417657797012504459
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 26, 2018 5:42:35 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-05-25_22_42_34-10417657797012504459
May 26, 2018 5:42:35 AM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-05-25_22_42_34-10417657797012504459 with 1 expected assertions.
May 26, 2018 5:42:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T05:42:34.931Z: Autoscaling is enabled for job 2018-05-25_22_42_34-10417657797012504459. The number of workers will be between 1 and 1000.
May 26, 2018 5:42:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T05:42:34.966Z: Autoscaling was automatically enabled for job 2018-05-25_22_42_34-10417657797012504459.
May 26, 2018 5:42:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T05:42:37.878Z: Checking required Cloud APIs are enabled.
May 26, 2018 5:42:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T05:42:38.071Z: Checking permissions granted to controller Service Account.
May 26, 2018 5:42:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T05:42:42.312Z: Worker configuration: n1-standard-1 in us-central1-b.
May 26, 2018 5:42:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T05:42:42.782Z: Expanding CoGroupByKey operations into optimizable parts.
May 26, 2018 5:42:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T05:42:42.951Z: Expanding GroupByKey operations into optimizable parts.
May 26, 2018 5:42:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T05:42:42.985Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
May 26, 2018 5:42:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T05:42:43.205Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
May 26, 2018 5:42:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T05:42:43.247Z: Elided trivial flatten
May 26, 2018 5:42:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T05:42:43.284Z: Elided trivial flatten
May 26, 2018 5:42:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T05:42:43.325Z: Elided trivial flatten
May 26, 2018 5:42:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T05:42:43.366Z: Unzipping flatten s24 for input s19.org.apache.beam.sdk.values.PCollection.<init>:329#8fd0f908e3ea90e3
May 26, 2018 5:42:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T05:42:43.426Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Reify, through flatten PAssert$33/GroupGlobally/FlattenDummyAndContents, into producer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map
May 26, 2018 5:42:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T05:42:43.469Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow into PAssert$33/GroupGlobally/GroupDummyAndContents/Read
May 26, 2018 5:42:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T05:42:43.503Z: Fusing consumer PAssert$33/GroupGlobally/ParDo(Concat) into PAssert$33/GroupGlobally/Values/Values/Map
May 26, 2018 5:42:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T05:42:43.539Z: Fusing consumer PAssert$33/GetPane/Map into PAssert$33/GroupGlobally/ParDo(Concat)
May 26, 2018 5:42:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T05:42:43.576Z: Fusing consumer PAssert$33/GroupGlobally/Values/Values/Map into PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow
May 26, 2018 5:42:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T05:42:43.621Z: Fusing consumer PAssert$33/RunChecks into PAssert$33/GetPane/Map
May 26, 2018 5:42:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T05:42:43.659Z: Fusing consumer PAssert$33/VerifyAssertions/ParDo(DefaultConclude) into PAssert$33/RunChecks
May 26, 2018 5:42:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T05:42:43.685Z: Unzipping flatten s24-u45 for input s26-reify-value18-c43
May 26, 2018 5:42:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T05:42:43.733Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Write, through flatten s24-u45, into producer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 26, 2018 5:42:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T05:42:43.779Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify into PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
May 26, 2018 5:42:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T05:42:43.828Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Write into PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 26, 2018 5:42:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T05:42:43.871Z: Fusing consumer PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)
May 26, 2018 5:42:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T05:42:43.919Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
May 26, 2018 5:42:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T05:42:43.963Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
May 26, 2018 5:42:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T05:42:43.998Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into PAssert$33/GroupGlobally/Window.Into()/Window.Assign
May 26, 2018 5:42:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T05:42:44.044Z: Fusing consumer OutputSideInputs into Create123/Read(CreateSource)
May 26, 2018 5:42:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T05:42:44.069Z: Fusing consumer PAssert$33/GroupGlobally/Window.Into()/Window.Assign into OutputSideInputs
May 26, 2018 5:42:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T05:42:44.111Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
May 26, 2018 5:42:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T05:42:44.156Z: Fusing consumer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map into PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
May 26, 2018 5:42:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T05:42:44.202Z: Fusing consumer PAssert$33/GroupGlobally/RewindowActuals/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map
May 26, 2018 5:42:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T05:42:44.249Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read
May 26, 2018 5:42:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T05:42:44.294Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
May 26, 2018 5:42:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T05:42:44.339Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
May 26, 2018 5:42:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T05:42:44.375Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
May 26, 2018 5:42:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T05:42:44.411Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
May 26, 2018 5:42:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T05:42:44.460Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
May 26, 2018 5:42:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T05:42:44.506Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into Create47/Read(CreateSource)
May 26, 2018 5:42:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T05:42:44.553Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
May 26, 2018 5:42:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T05:42:44.600Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
May 26, 2018 5:42:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T05:42:44.646Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
May 26, 2018 5:42:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T05:42:44.686Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
May 26, 2018 5:42:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T05:42:44.729Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
May 26, 2018 5:42:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T05:42:44.777Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
May 26, 2018 5:42:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T05:42:45.196Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Create
May 26, 2018 5:42:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T05:42:45.232Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Create
May 26, 2018 5:42:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T05:42:45.260Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
May 26, 2018 5:42:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T05:42:45.285Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
May 26, 2018 5:42:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T05:42:45.285Z: Starting 1 workers in us-central1-b...
May 26, 2018 5:42:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T05:42:45.522Z: Executing operation Create47/Read(CreateSource)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
May 26, 2018 5:42:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T05:42:45.557Z: Executing operation PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 26, 2018 5:42:56 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T05:42:56.014Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
May 26, 2018 5:43:07 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T05:43:06.706Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
May 26, 2018 5:43:07 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T05:43:06.747Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 26, 2018 5:43:29 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T05:43:27.988Z: Workers have started successfully.
May 26, 2018 5:43:43 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T05:43:43.066Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
May 26, 2018 5:43:43 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T05:43:43.128Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
May 26, 2018 5:43:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T05:43:50.675Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
May 26, 2018 5:43:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T05:43:50.762Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
May 26, 2018 5:44:04 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T05:44:02.679Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
May 26, 2018 5:44:04 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T05:44:02.803Z: Executing operation Create123/Read(CreateSource)+OutputSideInputs+PAssert$33/GroupGlobally/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write
May 26, 2018 5:44:06 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T05:44:06.098Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Close
May 26, 2018 5:44:06 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T05:44:06.154Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$33/GroupGlobally/RewindowActuals/Window.Assign+PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 26, 2018 5:44:09 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T05:44:08.832Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Close
May 26, 2018 5:44:09 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T05:44:08.874Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Read+PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$33/GroupGlobally/Values/Values/Map+PAssert$33/GroupGlobally/ParDo(Concat)+PAssert$33/GetPane/Map+PAssert$33/RunChecks+PAssert$33/VerifyAssertions/ParDo(DefaultConclude)
May 26, 2018 5:44:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T05:44:12.877Z: Cleaning up.
May 26, 2018 5:44:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T05:44:12.942Z: Stopping worker pool...
May 26, 2018 5:46:02 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T05:46:00.348Z: Autoscaling: Resized worker pool from 1 to 0.
May 26, 2018 5:46:02 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T05:46:00.383Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 26, 2018 5:46:02 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T05:46:00.434Z: Worker pool stopped.
May 26, 2018 5:46:08 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-05-25_22_42_34-10417657797012504459 finished with status DONE.
May 26, 2018 5:46:08 AM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-05-25_22_42_34-10417657797012504459. Found 1 success, 0 failures out of 1 expected assertions.
Gradle Test Executor 37 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest
209 tests completed, 34 failed, 2 skipped
Finished generating test XML results (0.738 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerTest>
Generating HTML test report...
Finished generating test html results (0.698 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest>
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest FAILED
:beam-runners-google-cloud-dataflow-java:validatesRunnerTest (Thread[Task worker for ':' Thread 5,5,main]) completed. Took 2 hrs 17 mins 22.81 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:validatesRunnerTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 18m 14s
38 actionable tasks: 34 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/e7vptgay5wgxu
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user katarzyna.kucharczyk@polidea.com
Not sending mail to unregistered user robbe.sneyders@ml6.eu
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user schroederc@google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ammons@google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user sidhom@google.com
Build failed in Jenkins:
beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #352
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/352/display/redirect?page=changes>
Changes:
[katarzyna.kucharczyk] Replaced created datetime to jenkins build id in kubernetes namespace.
------------------------------------------
[...truncated 18.08 MB...]
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey as step s16
May 26, 2018 3:24:19 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map as step s17
May 26, 2018 3:24:19 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RewindowActuals/Window.Assign as step s18
May 26, 2018 3:24:19 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map as step s19
May 26, 2018 3:24:19 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveActualsTriggering/Flatten.PCollections as step s20
May 26, 2018 3:24:19 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Create.Values/Read(CreateSource) as step s21
May 26, 2018 3:24:19 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign as step s22
May 26, 2018 3:24:19 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveDummyTriggering/Flatten.PCollections as step s23
May 26, 2018 3:24:19 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/FlattenDummyAndContents as step s24
May 26, 2018 3:24:19 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/NeverTrigger/Flatten.PCollections as step s25
May 26, 2018 3:24:19 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GroupDummyAndContents as step s26
May 26, 2018 3:24:19 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Values/Values/Map as step s27
May 26, 2018 3:24:19 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/ParDo(Concat) as step s28
May 26, 2018 3:24:19 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GetPane/Map as step s29
May 26, 2018 3:24:19 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/RunChecks as step s30
May 26, 2018 3:24:19 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/VerifyAssertions/ParDo(DefaultConclude) as step s31
May 26, 2018 3:24:19 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0526032416-f602189/output/results/staging/
May 26, 2018 3:24:19 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <71120 bytes, hash oPsyAR6GoAjy_N1kiYrKHQ> to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0526032416-f602189/output/results/staging/pipeline-oPsyAR6GoAjy_N1kiYrKHQ.pb
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 26, 2018 3:24:21 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-05-25_20_24_20-2030771955770548121?project=apache-beam-testing
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Submitted job: 2018-05-25_20_24_20-2030771955770548121
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 26, 2018 3:24:21 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-05-25_20_24_20-2030771955770548121
May 26, 2018 3:24:21 AM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-05-25_20_24_20-2030771955770548121 with 1 expected assertions.
May 26, 2018 3:24:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T03:24:20.370Z: Autoscaling is enabled for job 2018-05-25_20_24_20-2030771955770548121. The number of workers will be between 1 and 1000.
May 26, 2018 3:24:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T03:24:20.405Z: Autoscaling was automatically enabled for job 2018-05-25_20_24_20-2030771955770548121.
May 26, 2018 3:24:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T03:24:23.108Z: Checking required Cloud APIs are enabled.
May 26, 2018 3:24:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T03:24:23.281Z: Checking permissions granted to controller Service Account.
May 26, 2018 3:24:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T03:24:30.222Z: Worker configuration: n1-standard-1 in us-central1-b.
May 26, 2018 3:24:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T03:24:30.755Z: Expanding CoGroupByKey operations into optimizable parts.
May 26, 2018 3:24:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T03:24:30.980Z: Expanding GroupByKey operations into optimizable parts.
May 26, 2018 3:24:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T03:24:31.387Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
May 26, 2018 3:24:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T03:24:31.673Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
May 26, 2018 3:24:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T03:24:31.713Z: Elided trivial flatten
May 26, 2018 3:24:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T03:24:31.753Z: Elided trivial flatten
May 26, 2018 3:24:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T03:24:31.794Z: Elided trivial flatten
May 26, 2018 3:24:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T03:24:31.843Z: Unzipping flatten s24 for input s19.org.apache.beam.sdk.values.PCollection.<init>:329#8fd0f908e3ea90e3
May 26, 2018 3:24:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T03:24:31.889Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Reify, through flatten PAssert$33/GroupGlobally/FlattenDummyAndContents, into producer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map
May 26, 2018 3:24:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T03:24:31.938Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow into PAssert$33/GroupGlobally/GroupDummyAndContents/Read
May 26, 2018 3:24:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T03:24:31.975Z: Fusing consumer PAssert$33/GroupGlobally/ParDo(Concat) into PAssert$33/GroupGlobally/Values/Values/Map
May 26, 2018 3:24:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T03:24:32.024Z: Fusing consumer PAssert$33/GetPane/Map into PAssert$33/GroupGlobally/ParDo(Concat)
May 26, 2018 3:24:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T03:24:32.080Z: Fusing consumer PAssert$33/GroupGlobally/Values/Values/Map into PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow
May 26, 2018 3:24:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T03:24:32.134Z: Fusing consumer PAssert$33/RunChecks into PAssert$33/GetPane/Map
May 26, 2018 3:24:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T03:24:32.192Z: Fusing consumer PAssert$33/VerifyAssertions/ParDo(DefaultConclude) into PAssert$33/RunChecks
May 26, 2018 3:24:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T03:24:32.253Z: Unzipping flatten s24-u45 for input s26-reify-value18-c43
May 26, 2018 3:24:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T03:24:32.316Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Write, through flatten s24-u45, into producer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 26, 2018 3:24:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T03:24:32.347Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify into PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
May 26, 2018 3:24:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T03:24:32.394Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Write into PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 26, 2018 3:24:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T03:24:32.425Z: Fusing consumer PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)
May 26, 2018 3:24:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T03:24:32.474Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
May 26, 2018 3:24:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T03:24:32.511Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
May 26, 2018 3:24:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T03:24:32.555Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into PAssert$33/GroupGlobally/Window.Into()/Window.Assign
May 26, 2018 3:24:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T03:24:32.603Z: Fusing consumer OutputSideInputs into Create123/Read(CreateSource)
May 26, 2018 3:24:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T03:24:32.649Z: Fusing consumer PAssert$33/GroupGlobally/Window.Into()/Window.Assign into OutputSideInputs
May 26, 2018 3:24:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T03:24:32.695Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
May 26, 2018 3:24:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T03:24:32.741Z: Fusing consumer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map into PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
May 26, 2018 3:24:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T03:24:32.790Z: Fusing consumer PAssert$33/GroupGlobally/RewindowActuals/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map
May 26, 2018 3:24:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T03:24:32.820Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read
May 26, 2018 3:24:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T03:24:32.865Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
May 26, 2018 3:24:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T03:24:32.915Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
May 26, 2018 3:24:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T03:24:32.964Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
May 26, 2018 3:24:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T03:24:33.012Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
May 26, 2018 3:24:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T03:24:33.054Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
May 26, 2018 3:24:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T03:24:33.097Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into Create47/Read(CreateSource)
May 26, 2018 3:24:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T03:24:33.133Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
May 26, 2018 3:24:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T03:24:33.170Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
May 26, 2018 3:24:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T03:24:33.217Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
May 26, 2018 3:24:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T03:24:33.262Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
May 26, 2018 3:24:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T03:24:33.314Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
May 26, 2018 3:24:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T03:24:33.379Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
May 26, 2018 3:24:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T03:24:33.844Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Create
May 26, 2018 3:24:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T03:24:33.886Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Create
May 26, 2018 3:24:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T03:24:33.925Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
May 26, 2018 3:24:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T03:24:33.948Z: Starting 1 workers in us-central1-b...
May 26, 2018 3:24:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T03:24:33.963Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
May 26, 2018 3:24:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T03:24:34.214Z: Executing operation Create47/Read(CreateSource)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
May 26, 2018 3:24:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T03:24:34.271Z: Executing operation PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 26, 2018 3:24:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T03:24:46.638Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
May 26, 2018 3:24:59 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T03:24:57.410Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
May 26, 2018 3:24:59 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T03:24:57.455Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 26, 2018 3:25:14 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T03:25:14.001Z: Workers have started successfully.
May 26, 2018 3:25:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T03:25:37.039Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
May 26, 2018 3:25:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T03:25:37.217Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
May 26, 2018 3:25:45 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T03:25:43.855Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
May 26, 2018 3:25:45 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T03:25:43.953Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
May 26, 2018 3:26:01 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T03:26:00.544Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
May 26, 2018 3:26:01 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T03:26:00.749Z: Executing operation Create123/Read(CreateSource)+OutputSideInputs+PAssert$33/GroupGlobally/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write
May 26, 2018 3:26:09 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T03:26:09.066Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Close
May 26, 2018 3:26:11 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T03:26:09.157Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$33/GroupGlobally/RewindowActuals/Window.Assign+PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 26, 2018 3:26:14 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T03:26:13.001Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Close
May 26, 2018 3:26:14 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T03:26:13.086Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Read+PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$33/GroupGlobally/Values/Values/Map+PAssert$33/GroupGlobally/ParDo(Concat)+PAssert$33/GetPane/Map+PAssert$33/RunChecks+PAssert$33/VerifyAssertions/ParDo(DefaultConclude)
May 26, 2018 3:26:14 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T03:26:14.307Z: Cleaning up.
May 26, 2018 3:26:14 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T03:26:14.432Z: Stopping worker pool...
May 26, 2018 3:27:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T03:27:31.250Z: Autoscaling: Resized worker pool from 1 to 0.
May 26, 2018 3:27:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T03:27:31.291Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 26, 2018 3:27:39 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-05-25_20_24_20-2030771955770548121 finished with status DONE.
May 26, 2018 3:27:39 AM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-05-25_20_24_20-2030771955770548121. Found 1 success, 0 failures out of 1 expected assertions.
Gradle Test Executor 38 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest
209 tests completed, 34 failed, 2 skipped
Finished generating test XML results (0.652 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerTest>
Generating HTML test report...
Finished generating test html results (0.729 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest>
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest FAILED
:beam-runners-google-cloud-dataflow-java:validatesRunnerTest (Thread[Task worker for ':' Thread 36,5,main]) completed. Took 2 hrs 13 mins 33.087 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:validatesRunnerTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 14m 25s
38 actionable tasks: 34 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/riukxsqnpmxx4
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user katarzyna.kucharczyk@polidea.com
Not sending mail to unregistered user robbe.sneyders@ml6.eu
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user schroederc@google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ammons@google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user sidhom@google.com
Build failed in Jenkins:
beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #351
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/351/display/redirect?page=changes>
Changes:
[tgroh] Make ImmutableExecutableStage Public
[lcwik] [BEAM-4411] Update Jackson version to latest to pick up security fixes.
[kenn] Implement UNNEST operator for SQL
------------------------------------------
[...truncated 18.11 MB...]
May 26, 2018 1:09:22 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey as step s16
May 26, 2018 1:09:22 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map as step s17
May 26, 2018 1:09:22 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RewindowActuals/Window.Assign as step s18
May 26, 2018 1:09:22 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map as step s19
May 26, 2018 1:09:22 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveActualsTriggering/Flatten.PCollections as step s20
May 26, 2018 1:09:22 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Create.Values/Read(CreateSource) as step s21
May 26, 2018 1:09:22 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign as step s22
May 26, 2018 1:09:22 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveDummyTriggering/Flatten.PCollections as step s23
May 26, 2018 1:09:22 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/FlattenDummyAndContents as step s24
May 26, 2018 1:09:22 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/NeverTrigger/Flatten.PCollections as step s25
May 26, 2018 1:09:22 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GroupDummyAndContents as step s26
May 26, 2018 1:09:22 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Values/Values/Map as step s27
May 26, 2018 1:09:22 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/ParDo(Concat) as step s28
May 26, 2018 1:09:22 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GetPane/Map as step s29
May 26, 2018 1:09:22 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/RunChecks as step s30
May 26, 2018 1:09:22 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/VerifyAssertions/ParDo(DefaultConclude) as step s31
May 26, 2018 1:09:22 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0526010918-acc5122a/output/results/staging/
May 26, 2018 1:09:22 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <71120 bytes, hash Qn4l5fslnPO696chCQHfsw> to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0526010918-acc5122a/output/results/staging/pipeline-Qn4l5fslnPO696chCQHfsw.pb
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 26, 2018 1:09:23 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-05-25_18_09_22-18215969196897215788?project=apache-beam-testing
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Submitted job: 2018-05-25_18_09_22-18215969196897215788
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 26, 2018 1:09:23 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-05-25_18_09_22-18215969196897215788
May 26, 2018 1:09:23 AM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-05-25_18_09_22-18215969196897215788 with 1 expected assertions.
May 26, 2018 1:09:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T01:09:22.897Z: Autoscaling is enabled for job 2018-05-25_18_09_22-18215969196897215788. The number of workers will be between 1 and 1000.
May 26, 2018 1:09:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T01:09:22.939Z: Autoscaling was automatically enabled for job 2018-05-25_18_09_22-18215969196897215788.
May 26, 2018 1:09:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T01:09:25.649Z: Checking required Cloud APIs are enabled.
May 26, 2018 1:09:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T01:09:25.828Z: Checking permissions granted to controller Service Account.
May 26, 2018 1:09:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T01:09:30.513Z: Worker configuration: n1-standard-1 in us-central1-b.
May 26, 2018 1:09:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T01:09:30.982Z: Expanding CoGroupByKey operations into optimizable parts.
May 26, 2018 1:09:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T01:09:31.161Z: Expanding GroupByKey operations into optimizable parts.
May 26, 2018 1:09:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T01:09:31.211Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
May 26, 2018 1:09:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T01:09:31.444Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
May 26, 2018 1:09:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T01:09:31.493Z: Elided trivial flatten
May 26, 2018 1:09:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T01:09:31.535Z: Elided trivial flatten
May 26, 2018 1:09:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T01:09:31.584Z: Elided trivial flatten
May 26, 2018 1:09:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T01:09:31.628Z: Unzipping flatten s24 for input s19.org.apache.beam.sdk.values.PCollection.<init>:329#8fd0f908e3ea90e3
May 26, 2018 1:09:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T01:09:31.695Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Reify, through flatten PAssert$33/GroupGlobally/FlattenDummyAndContents, into producer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map
May 26, 2018 1:09:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T01:09:31.740Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow into PAssert$33/GroupGlobally/GroupDummyAndContents/Read
May 26, 2018 1:09:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T01:09:31.769Z: Fusing consumer PAssert$33/GroupGlobally/ParDo(Concat) into PAssert$33/GroupGlobally/Values/Values/Map
May 26, 2018 1:09:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T01:09:31.816Z: Fusing consumer PAssert$33/GetPane/Map into PAssert$33/GroupGlobally/ParDo(Concat)
May 26, 2018 1:09:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T01:09:31.856Z: Fusing consumer PAssert$33/GroupGlobally/Values/Values/Map into PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow
May 26, 2018 1:09:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T01:09:31.896Z: Fusing consumer PAssert$33/RunChecks into PAssert$33/GetPane/Map
May 26, 2018 1:09:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T01:09:31.941Z: Fusing consumer PAssert$33/VerifyAssertions/ParDo(DefaultConclude) into PAssert$33/RunChecks
May 26, 2018 1:09:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T01:09:31.986Z: Unzipping flatten s24-u45 for input s26-reify-value18-c43
May 26, 2018 1:09:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T01:09:32.032Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Write, through flatten s24-u45, into producer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 26, 2018 1:09:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T01:09:32.080Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify into PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
May 26, 2018 1:09:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T01:09:32.128Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Write into PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 26, 2018 1:09:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T01:09:32.182Z: Fusing consumer PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)
May 26, 2018 1:09:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T01:09:32.227Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
May 26, 2018 1:09:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T01:09:32.260Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
May 26, 2018 1:09:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T01:09:32.304Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into PAssert$33/GroupGlobally/Window.Into()/Window.Assign
May 26, 2018 1:09:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T01:09:32.354Z: Fusing consumer OutputSideInputs into Create123/Read(CreateSource)
May 26, 2018 1:09:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T01:09:32.400Z: Fusing consumer PAssert$33/GroupGlobally/Window.Into()/Window.Assign into OutputSideInputs
May 26, 2018 1:09:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T01:09:32.447Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
May 26, 2018 1:09:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T01:09:32.489Z: Fusing consumer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map into PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
May 26, 2018 1:09:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T01:09:32.538Z: Fusing consumer PAssert$33/GroupGlobally/RewindowActuals/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map
May 26, 2018 1:09:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T01:09:32.578Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read
May 26, 2018 1:09:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T01:09:32.619Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
May 26, 2018 1:09:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T01:09:32.651Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
May 26, 2018 1:09:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T01:09:32.689Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
May 26, 2018 1:09:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T01:09:32.727Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
May 26, 2018 1:09:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T01:09:32.776Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
May 26, 2018 1:09:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T01:09:32.829Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into Create47/Read(CreateSource)
May 26, 2018 1:09:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T01:09:32.870Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
May 26, 2018 1:09:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T01:09:32.921Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
May 26, 2018 1:09:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T01:09:32.968Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
May 26, 2018 1:09:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T01:09:33.006Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
May 26, 2018 1:09:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T01:09:33.051Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
May 26, 2018 1:09:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T01:09:33.085Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
May 26, 2018 1:09:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T01:09:33.501Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Create
May 26, 2018 1:09:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T01:09:33.538Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Create
May 26, 2018 1:09:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T01:09:33.581Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
May 26, 2018 1:09:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T01:09:33.596Z: Starting 1 workers in us-central1-b...
May 26, 2018 1:09:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T01:09:33.629Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
May 26, 2018 1:09:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T01:09:33.860Z: Executing operation PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 26, 2018 1:09:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T01:09:33.898Z: Executing operation Create47/Read(CreateSource)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
May 26, 2018 1:09:45 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T01:09:44.734Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
May 26, 2018 1:09:57 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T01:09:55.489Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
May 26, 2018 1:09:57 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T01:09:55.528Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 26, 2018 1:10:18 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T01:10:18.144Z: Workers have started successfully.
May 26, 2018 1:10:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T01:10:35.927Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
May 26, 2018 1:10:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T01:10:36.024Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
May 26, 2018 1:10:43 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T01:10:42.056Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
May 26, 2018 1:10:43 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T01:10:42.154Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
May 26, 2018 1:10:55 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T01:10:53.790Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
May 26, 2018 1:10:55 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T01:10:54.181Z: Executing operation Create123/Read(CreateSource)+OutputSideInputs+PAssert$33/GroupGlobally/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write
May 26, 2018 1:11:01 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T01:10:58.630Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Close
May 26, 2018 1:11:01 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T01:10:58.746Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$33/GroupGlobally/RewindowActuals/Window.Assign+PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 26, 2018 1:11:04 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T01:11:04.397Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Close
May 26, 2018 1:11:07 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T01:11:04.483Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Read+PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$33/GroupGlobally/Values/Values/Map+PAssert$33/GroupGlobally/ParDo(Concat)+PAssert$33/GetPane/Map+PAssert$33/RunChecks+PAssert$33/VerifyAssertions/ParDo(DefaultConclude)
May 26, 2018 1:11:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T01:11:08.457Z: Cleaning up.
May 26, 2018 1:11:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T01:11:08.564Z: Stopping worker pool...
May 26, 2018 1:12:50 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T01:12:48.695Z: Autoscaling: Resized worker pool from 1 to 0.
May 26, 2018 1:12:50 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T01:12:48.736Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 26, 2018 1:12:50 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-26T01:12:48.774Z: Worker pool stopped.
May 26, 2018 1:12:57 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-05-25_18_09_22-18215969196897215788 finished with status DONE.
May 26, 2018 1:12:57 AM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-05-25_18_09_22-18215969196897215788. Found 1 success, 0 failures out of 1 expected assertions.
Gradle Test Executor 36 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest FAILED
209 tests completed, 34 failed, 2 skipped
Finished generating test XML results (0.457 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerTest>
Generating HTML test report...
Finished generating test html results (0.61 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest>
:beam-runners-google-cloud-dataflow-java:validatesRunnerTest (Thread[Daemon worker,5,main]) completed. Took 2 hrs 12 mins 53.777 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:validatesRunnerTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 14m 7s
38 actionable tasks: 35 executed, 3 from cache
Publishing build scan...
https://gradle.com/s/4jmejdgqqmxva
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user robbe.sneyders@ml6.eu
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user schroederc@google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ammons@google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user sidhom@google.com
Build failed in Jenkins:
beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #350
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/350/display/redirect>
------------------------------------------
[...truncated 18.09 MB...]
May 25, 2018 10:54:56 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey as step s16
May 25, 2018 10:54:56 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map as step s17
May 25, 2018 10:54:56 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RewindowActuals/Window.Assign as step s18
May 25, 2018 10:54:56 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map as step s19
May 25, 2018 10:54:56 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveActualsTriggering/Flatten.PCollections as step s20
May 25, 2018 10:54:56 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Create.Values/Read(CreateSource) as step s21
May 25, 2018 10:54:56 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign as step s22
May 25, 2018 10:54:56 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveDummyTriggering/Flatten.PCollections as step s23
May 25, 2018 10:54:56 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/FlattenDummyAndContents as step s24
May 25, 2018 10:54:56 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/NeverTrigger/Flatten.PCollections as step s25
May 25, 2018 10:54:56 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GroupDummyAndContents as step s26
May 25, 2018 10:54:56 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Values/Values/Map as step s27
May 25, 2018 10:54:56 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/ParDo(Concat) as step s28
May 25, 2018 10:54:56 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GetPane/Map as step s29
May 25, 2018 10:54:56 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/RunChecks as step s30
May 25, 2018 10:54:56 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/VerifyAssertions/ParDo(DefaultConclude) as step s31
May 25, 2018 10:54:56 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0525225452-1f29f4e2/output/results/staging/
May 25, 2018 10:54:56 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <71120 bytes, hash 6k_jKhNdgPvBrYBBtdSQYQ> to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0525225452-1f29f4e2/output/results/staging/pipeline-6k_jKhNdgPvBrYBBtdSQYQ.pb
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 25, 2018 10:54:58 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-05-25_15_54_57-3947313671853722850?project=apache-beam-testing
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Submitted job: 2018-05-25_15_54_57-3947313671853722850
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 25, 2018 10:54:58 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-05-25_15_54_57-3947313671853722850
May 25, 2018 10:54:58 PM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-05-25_15_54_57-3947313671853722850 with 1 expected assertions.
May 25, 2018 10:55:07 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T22:54:57.292Z: Autoscaling is enabled for job 2018-05-25_15_54_57-3947313671853722850. The number of workers will be between 1 and 1000.
May 25, 2018 10:55:07 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T22:54:57.329Z: Autoscaling was automatically enabled for job 2018-05-25_15_54_57-3947313671853722850.
May 25, 2018 10:55:07 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T22:55:00.176Z: Checking required Cloud APIs are enabled.
May 25, 2018 10:55:07 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T22:55:00.484Z: Checking permissions granted to controller Service Account.
May 25, 2018 10:55:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T22:55:04.267Z: Worker configuration: n1-standard-1 in us-central1-b.
May 25, 2018 10:55:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T22:55:04.681Z: Expanding CoGroupByKey operations into optimizable parts.
May 25, 2018 10:55:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T22:55:04.816Z: Expanding GroupByKey operations into optimizable parts.
May 25, 2018 10:55:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T22:55:04.844Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
May 25, 2018 10:55:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T22:55:05.022Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
May 25, 2018 10:55:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T22:55:05.056Z: Elided trivial flatten
May 25, 2018 10:55:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T22:55:05.086Z: Elided trivial flatten
May 25, 2018 10:55:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T22:55:05.117Z: Elided trivial flatten
May 25, 2018 10:55:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T22:55:05.151Z: Unzipping flatten s24 for input s19.org.apache.beam.sdk.values.PCollection.<init>:329#8fd0f908e3ea90e3
May 25, 2018 10:55:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T22:55:05.187Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Reify, through flatten PAssert$33/GroupGlobally/FlattenDummyAndContents, into producer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map
May 25, 2018 10:55:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T22:55:05.218Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow into PAssert$33/GroupGlobally/GroupDummyAndContents/Read
May 25, 2018 10:55:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T22:55:05.240Z: Fusing consumer PAssert$33/GroupGlobally/ParDo(Concat) into PAssert$33/GroupGlobally/Values/Values/Map
May 25, 2018 10:55:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T22:55:05.264Z: Fusing consumer PAssert$33/GetPane/Map into PAssert$33/GroupGlobally/ParDo(Concat)
May 25, 2018 10:55:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T22:55:05.291Z: Fusing consumer PAssert$33/GroupGlobally/Values/Values/Map into PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow
May 25, 2018 10:55:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T22:55:05.317Z: Fusing consumer PAssert$33/RunChecks into PAssert$33/GetPane/Map
May 25, 2018 10:55:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T22:55:05.341Z: Fusing consumer PAssert$33/VerifyAssertions/ParDo(DefaultConclude) into PAssert$33/RunChecks
May 25, 2018 10:55:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T22:55:05.372Z: Unzipping flatten s24-u45 for input s26-reify-value18-c43
May 25, 2018 10:55:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T22:55:05.401Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Write, through flatten s24-u45, into producer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 25, 2018 10:55:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T22:55:05.434Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify into PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
May 25, 2018 10:55:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T22:55:05.468Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Write into PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 25, 2018 10:55:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T22:55:05.493Z: Fusing consumer PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)
May 25, 2018 10:55:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T22:55:05.524Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
May 25, 2018 10:55:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T22:55:05.546Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
May 25, 2018 10:55:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T22:55:05.572Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into PAssert$33/GroupGlobally/Window.Into()/Window.Assign
May 25, 2018 10:55:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T22:55:05.599Z: Fusing consumer OutputSideInputs into Create123/Read(CreateSource)
May 25, 2018 10:55:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T22:55:05.632Z: Fusing consumer PAssert$33/GroupGlobally/Window.Into()/Window.Assign into OutputSideInputs
May 25, 2018 10:55:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T22:55:05.654Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
May 25, 2018 10:55:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T22:55:05.676Z: Fusing consumer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map into PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
May 25, 2018 10:55:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T22:55:05.707Z: Fusing consumer PAssert$33/GroupGlobally/RewindowActuals/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map
May 25, 2018 10:55:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T22:55:05.731Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read
May 25, 2018 10:55:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T22:55:05.757Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
May 25, 2018 10:55:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T22:55:05.790Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
May 25, 2018 10:55:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T22:55:05.815Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
May 25, 2018 10:55:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T22:55:05.839Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
May 25, 2018 10:55:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T22:55:05.874Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
May 25, 2018 10:55:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T22:55:05.906Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into Create47/Read(CreateSource)
May 25, 2018 10:55:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T22:55:05.926Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
May 25, 2018 10:55:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T22:55:05.953Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
May 25, 2018 10:55:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T22:55:05.988Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
May 25, 2018 10:55:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T22:55:06.016Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
May 25, 2018 10:55:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T22:55:06.052Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
May 25, 2018 10:55:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T22:55:06.080Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
May 25, 2018 10:55:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T22:55:06.421Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Create
May 25, 2018 10:55:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T22:55:06.452Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Create
May 25, 2018 10:55:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T22:55:06.484Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
May 25, 2018 10:55:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T22:55:06.488Z: Starting 1 workers in us-central1-b...
May 25, 2018 10:55:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T22:55:06.511Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
May 25, 2018 10:55:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T22:55:06.655Z: Executing operation PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 25, 2018 10:55:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T22:55:06.686Z: Executing operation Create47/Read(CreateSource)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
May 25, 2018 10:55:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T22:55:17.303Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
May 25, 2018 10:55:29 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T22:55:27.919Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
May 25, 2018 10:55:29 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T22:55:27.955Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 25, 2018 10:55:47 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T22:55:46.303Z: Workers have started successfully.
May 25, 2018 10:56:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T22:56:08.648Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
May 25, 2018 10:56:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T22:56:08.715Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
May 25, 2018 10:56:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T22:56:14.713Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
May 25, 2018 10:56:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T22:56:14.784Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
May 25, 2018 10:56:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T22:56:26.696Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
May 25, 2018 10:56:29 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T22:56:26.827Z: Executing operation Create123/Read(CreateSource)+OutputSideInputs+PAssert$33/GroupGlobally/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write
May 25, 2018 10:56:32 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T22:56:30.430Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Close
May 25, 2018 10:56:32 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T22:56:30.490Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$33/GroupGlobally/RewindowActuals/Window.Assign+PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 25, 2018 10:56:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T22:56:35.365Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Close
May 25, 2018 10:56:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T22:56:35.439Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Read+PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$33/GroupGlobally/Values/Values/Map+PAssert$33/GroupGlobally/ParDo(Concat)+PAssert$33/GetPane/Map+PAssert$33/RunChecks+PAssert$33/VerifyAssertions/ParDo(DefaultConclude)
May 25, 2018 10:56:40 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T22:56:39.598Z: Cleaning up.
May 25, 2018 10:56:40 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T22:56:39.700Z: Stopping worker pool...
May 25, 2018 10:58:25 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T22:58:24.894Z: Autoscaling: Resized worker pool from 1 to 0.
May 25, 2018 10:58:25 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T22:58:24.945Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 25, 2018 10:58:35 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-05-25_15_54_57-3947313671853722850 finished with status DONE.
May 25, 2018 10:58:35 PM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-05-25_15_54_57-3947313671853722850. Found 1 success, 0 failures out of 1 expected assertions.
Gradle Test Executor 46 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest
209 tests completed, 34 failed, 2 skipped
Finished generating test XML results (0.564 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerTest>
Generating HTML test report...
Finished generating test html results (0.712 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest>
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest FAILED
:beam-runners-google-cloud-dataflow-java:validatesRunnerTest (Thread[Task worker for ':' Thread 25,5,main]) completed. Took 2 hrs 11 mins 28.342 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:validatesRunnerTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 12m 46s
38 actionable tasks: 35 executed, 3 from cache
Publishing build scan...
https://gradle.com/s/nrgtwok7vobzi
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user robbe.sneyders@ml6.eu
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user schroederc@google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ammons@google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user sidhom@google.com
Build failed in Jenkins:
beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #349
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/349/display/redirect?page=changes>
Changes:
[iemejia] [BEAM-4308] Enforce ErrorProne analysis in runners-core-java
------------------------------------------
[...truncated 18.00 MB...]
May 25, 2018 8:42:03 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey as step s16
May 25, 2018 8:42:03 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map as step s17
May 25, 2018 8:42:03 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RewindowActuals/Window.Assign as step s18
May 25, 2018 8:42:03 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map as step s19
May 25, 2018 8:42:03 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveActualsTriggering/Flatten.PCollections as step s20
May 25, 2018 8:42:03 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Create.Values/Read(CreateSource) as step s21
May 25, 2018 8:42:03 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign as step s22
May 25, 2018 8:42:03 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveDummyTriggering/Flatten.PCollections as step s23
May 25, 2018 8:42:03 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/FlattenDummyAndContents as step s24
May 25, 2018 8:42:03 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/NeverTrigger/Flatten.PCollections as step s25
May 25, 2018 8:42:03 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GroupDummyAndContents as step s26
May 25, 2018 8:42:03 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Values/Values/Map as step s27
May 25, 2018 8:42:03 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/ParDo(Concat) as step s28
May 25, 2018 8:42:03 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GetPane/Map as step s29
May 25, 2018 8:42:03 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/RunChecks as step s30
May 25, 2018 8:42:03 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/VerifyAssertions/ParDo(DefaultConclude) as step s31
May 25, 2018 8:42:03 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0525204200-e318b26c/output/results/staging/
May 25, 2018 8:42:03 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <71120 bytes, hash a4AKjWWef-uZqG1fwRw2aw> to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0525204200-e318b26c/output/results/staging/pipeline-a4AKjWWef-uZqG1fwRw2aw.pb
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 25, 2018 8:42:05 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-05-25_13_42_04-414989599226294784?project=apache-beam-testing
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Submitted job: 2018-05-25_13_42_04-414989599226294784
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 25, 2018 8:42:05 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-05-25_13_42_04-414989599226294784
May 25, 2018 8:42:05 PM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-05-25_13_42_04-414989599226294784 with 1 expected assertions.
May 25, 2018 8:42:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T20:42:04.163Z: Autoscaling is enabled for job 2018-05-25_13_42_04-414989599226294784. The number of workers will be between 1 and 1000.
May 25, 2018 8:42:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T20:42:04.208Z: Autoscaling was automatically enabled for job 2018-05-25_13_42_04-414989599226294784.
May 25, 2018 8:42:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T20:42:07.165Z: Checking required Cloud APIs are enabled.
May 25, 2018 8:42:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T20:42:07.478Z: Checking permissions granted to controller Service Account.
May 25, 2018 8:42:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T20:42:11.833Z: Worker configuration: n1-standard-1 in us-central1-b.
May 25, 2018 8:42:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T20:42:12.210Z: Expanding CoGroupByKey operations into optimizable parts.
May 25, 2018 8:42:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T20:42:12.408Z: Expanding GroupByKey operations into optimizable parts.
May 25, 2018 8:42:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T20:42:12.457Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
May 25, 2018 8:42:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T20:42:12.717Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
May 25, 2018 8:42:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T20:42:12.769Z: Elided trivial flatten
May 25, 2018 8:42:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T20:42:12.823Z: Elided trivial flatten
May 25, 2018 8:42:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T20:42:12.871Z: Elided trivial flatten
May 25, 2018 8:42:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T20:42:12.901Z: Unzipping flatten s24 for input s19.org.apache.beam.sdk.values.PCollection.<init>:329#8fd0f908e3ea90e3
May 25, 2018 8:42:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T20:42:12.958Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Reify, through flatten PAssert$33/GroupGlobally/FlattenDummyAndContents, into producer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map
May 25, 2018 8:42:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T20:42:12.992Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow into PAssert$33/GroupGlobally/GroupDummyAndContents/Read
May 25, 2018 8:42:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T20:42:13.040Z: Fusing consumer PAssert$33/GroupGlobally/ParDo(Concat) into PAssert$33/GroupGlobally/Values/Values/Map
May 25, 2018 8:42:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T20:42:13.093Z: Fusing consumer PAssert$33/GetPane/Map into PAssert$33/GroupGlobally/ParDo(Concat)
May 25, 2018 8:42:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T20:42:13.152Z: Fusing consumer PAssert$33/GroupGlobally/Values/Values/Map into PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow
May 25, 2018 8:42:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T20:42:13.192Z: Fusing consumer PAssert$33/RunChecks into PAssert$33/GetPane/Map
May 25, 2018 8:42:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T20:42:13.238Z: Fusing consumer PAssert$33/VerifyAssertions/ParDo(DefaultConclude) into PAssert$33/RunChecks
May 25, 2018 8:42:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T20:42:13.284Z: Unzipping flatten s24-u45 for input s26-reify-value18-c43
May 25, 2018 8:42:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T20:42:13.329Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Write, through flatten s24-u45, into producer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 25, 2018 8:42:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T20:42:13.373Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify into PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
May 25, 2018 8:42:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T20:42:13.419Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Write into PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 25, 2018 8:42:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T20:42:13.461Z: Fusing consumer PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)
May 25, 2018 8:42:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T20:42:13.498Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
May 25, 2018 8:42:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T20:42:13.547Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
May 25, 2018 8:42:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T20:42:13.595Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into PAssert$33/GroupGlobally/Window.Into()/Window.Assign
May 25, 2018 8:42:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T20:42:13.642Z: Fusing consumer OutputSideInputs into Create123/Read(CreateSource)
May 25, 2018 8:42:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T20:42:13.668Z: Fusing consumer PAssert$33/GroupGlobally/Window.Into()/Window.Assign into OutputSideInputs
May 25, 2018 8:42:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T20:42:13.706Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
May 25, 2018 8:42:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T20:42:13.745Z: Fusing consumer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map into PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
May 25, 2018 8:42:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T20:42:13.789Z: Fusing consumer PAssert$33/GroupGlobally/RewindowActuals/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map
May 25, 2018 8:42:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T20:42:13.836Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read
May 25, 2018 8:42:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T20:42:13.882Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
May 25, 2018 8:42:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T20:42:13.924Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
May 25, 2018 8:42:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T20:42:13.966Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
May 25, 2018 8:42:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T20:42:14.013Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
May 25, 2018 8:42:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T20:42:14.059Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
May 25, 2018 8:42:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T20:42:14.110Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into Create47/Read(CreateSource)
May 25, 2018 8:42:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T20:42:14.153Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
May 25, 2018 8:42:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T20:42:14.202Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
May 25, 2018 8:42:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T20:42:14.250Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
May 25, 2018 8:42:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T20:42:14.303Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
May 25, 2018 8:42:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T20:42:14.351Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
May 25, 2018 8:42:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T20:42:14.400Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
May 25, 2018 8:42:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T20:42:14.967Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Create
May 25, 2018 8:42:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T20:42:15.016Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Create
May 25, 2018 8:42:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T20:42:15.060Z: Starting 1 workers in us-central1-b...
May 25, 2018 8:42:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T20:42:15.060Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
May 25, 2018 8:42:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T20:42:15.105Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
May 25, 2018 8:42:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T20:42:15.353Z: Executing operation PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 25, 2018 8:42:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T20:42:15.414Z: Executing operation Create47/Read(CreateSource)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
May 25, 2018 8:42:25 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T20:42:22.967Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
May 25, 2018 8:42:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T20:42:33.716Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
May 25, 2018 8:42:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T20:42:33.767Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 25, 2018 8:42:50 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T20:42:49.523Z: Workers have started successfully.
May 25, 2018 8:43:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T20:43:11.316Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
May 25, 2018 8:43:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T20:43:11.427Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
May 25, 2018 8:43:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T20:43:17.275Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
May 25, 2018 8:43:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T20:43:17.354Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
May 25, 2018 8:43:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T20:43:27.504Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
May 25, 2018 8:43:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T20:43:27.753Z: Executing operation Create123/Read(CreateSource)+OutputSideInputs+PAssert$33/GroupGlobally/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write
May 25, 2018 8:43:35 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T20:43:33.786Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Close
May 25, 2018 8:43:35 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T20:43:33.906Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$33/GroupGlobally/RewindowActuals/Window.Assign+PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 25, 2018 8:43:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T20:43:38.262Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Close
May 25, 2018 8:43:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T20:43:38.395Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Read+PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$33/GroupGlobally/Values/Values/Map+PAssert$33/GroupGlobally/ParDo(Concat)+PAssert$33/GetPane/Map+PAssert$33/RunChecks+PAssert$33/VerifyAssertions/ParDo(DefaultConclude)
May 25, 2018 8:43:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T20:43:41.965Z: Cleaning up.
May 25, 2018 8:43:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T20:43:42.130Z: Stopping worker pool...
May 25, 2018 8:45:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T20:45:26.912Z: Autoscaling: Resized worker pool from 1 to 0.
May 25, 2018 8:45:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T20:45:26.941Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 25, 2018 8:45:35 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-05-25_13_42_04-414989599226294784 finished with status DONE.
May 25, 2018 8:45:35 PM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-05-25_13_42_04-414989599226294784. Found 1 success, 0 failures out of 1 expected assertions.
Gradle Test Executor 14 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest
209 tests completed, 34 failed, 2 skipped
Finished generating test XML results (0.546 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerTest>
Generating HTML test report...
Finished generating test html results (0.663 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest>
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest FAILED
:beam-runners-google-cloud-dataflow-java:validatesRunnerTest (Thread[Task worker for ':' Thread 34,5,main]) completed. Took 2 hrs 7 mins 42.939 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:validatesRunnerTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 8m 37s
38 actionable tasks: 34 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/scr75yge3oixm
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user robbe.sneyders@ml6.eu
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user schroederc@google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ammons@google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user sidhom@google.com
Build failed in Jenkins:
beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #348
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/348/display/redirect?page=changes>
Changes:
[iemejia] [BEAM-4307] Enforce ErrorProne analysis in
------------------------------------------
[...truncated 18.06 MB...]
May 25, 2018 6:32:53 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign as step s15
May 25, 2018 6:32:53 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey as step s16
May 25, 2018 6:32:53 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map as step s17
May 25, 2018 6:32:53 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RewindowActuals/Window.Assign as step s18
May 25, 2018 6:32:53 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map as step s19
May 25, 2018 6:32:53 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveActualsTriggering/Flatten.PCollections as step s20
May 25, 2018 6:32:53 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Create.Values/Read(CreateSource) as step s21
May 25, 2018 6:32:53 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign as step s22
May 25, 2018 6:32:53 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveDummyTriggering/Flatten.PCollections as step s23
May 25, 2018 6:32:53 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/FlattenDummyAndContents as step s24
May 25, 2018 6:32:53 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/NeverTrigger/Flatten.PCollections as step s25
May 25, 2018 6:32:53 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GroupDummyAndContents as step s26
May 25, 2018 6:32:53 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Values/Values/Map as step s27
May 25, 2018 6:32:53 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/ParDo(Concat) as step s28
May 25, 2018 6:32:53 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GetPane/Map as step s29
May 25, 2018 6:32:53 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/RunChecks as step s30
May 25, 2018 6:32:53 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/VerifyAssertions/ParDo(DefaultConclude) as step s31
May 25, 2018 6:32:53 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0525183249-9baa13ef/output/results/staging/
May 25, 2018 6:32:53 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <71120 bytes, hash 0TBEjGSx74BBJOwXMN0s3g> to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0525183249-9baa13ef/output/results/staging/pipeline-0TBEjGSx74BBJOwXMN0s3g.pb
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 25, 2018 6:32:54 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-05-25_11_32_53-16943753811765757669?project=apache-beam-testing
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Submitted job: 2018-05-25_11_32_53-16943753811765757669
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 25, 2018 6:32:54 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-05-25_11_32_53-16943753811765757669
May 25, 2018 6:32:54 PM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-05-25_11_32_53-16943753811765757669 with 1 expected assertions.
May 25, 2018 6:33:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T18:32:54.000Z: Autoscaling is enabled for job 2018-05-25_11_32_53-16943753811765757669. The number of workers will be between 1 and 1000.
May 25, 2018 6:33:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T18:32:54.044Z: Autoscaling was automatically enabled for job 2018-05-25_11_32_53-16943753811765757669.
May 25, 2018 6:33:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T18:32:56.854Z: Checking required Cloud APIs are enabled.
May 25, 2018 6:33:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T18:32:57.105Z: Checking permissions granted to controller Service Account.
May 25, 2018 6:33:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T18:33:01.882Z: Worker configuration: n1-standard-1 in us-central1-b.
May 25, 2018 6:33:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T18:33:02.208Z: Expanding CoGroupByKey operations into optimizable parts.
May 25, 2018 6:33:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T18:33:02.377Z: Expanding GroupByKey operations into optimizable parts.
May 25, 2018 6:33:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T18:33:02.424Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
May 25, 2018 6:33:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T18:33:02.634Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
May 25, 2018 6:33:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T18:33:02.671Z: Elided trivial flatten
May 25, 2018 6:33:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T18:33:02.706Z: Elided trivial flatten
May 25, 2018 6:33:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T18:33:02.751Z: Elided trivial flatten
May 25, 2018 6:33:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T18:33:02.826Z: Unzipping flatten s24 for input s19.org.apache.beam.sdk.values.PCollection.<init>:329#8fd0f908e3ea90e3
May 25, 2018 6:33:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T18:33:02.865Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Reify, through flatten PAssert$33/GroupGlobally/FlattenDummyAndContents, into producer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map
May 25, 2018 6:33:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T18:33:02.910Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow into PAssert$33/GroupGlobally/GroupDummyAndContents/Read
May 25, 2018 6:33:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T18:33:02.954Z: Fusing consumer PAssert$33/GroupGlobally/ParDo(Concat) into PAssert$33/GroupGlobally/Values/Values/Map
May 25, 2018 6:33:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T18:33:02.992Z: Fusing consumer PAssert$33/GetPane/Map into PAssert$33/GroupGlobally/ParDo(Concat)
May 25, 2018 6:33:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T18:33:03.028Z: Fusing consumer PAssert$33/GroupGlobally/Values/Values/Map into PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow
May 25, 2018 6:33:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T18:33:03.074Z: Fusing consumer PAssert$33/RunChecks into PAssert$33/GetPane/Map
May 25, 2018 6:33:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T18:33:03.112Z: Fusing consumer PAssert$33/VerifyAssertions/ParDo(DefaultConclude) into PAssert$33/RunChecks
May 25, 2018 6:33:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T18:33:03.158Z: Unzipping flatten s24-u45 for input s26-reify-value18-c43
May 25, 2018 6:33:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T18:33:03.233Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Write, through flatten s24-u45, into producer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 25, 2018 6:33:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T18:33:03.282Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify into PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
May 25, 2018 6:33:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T18:33:03.328Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Write into PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 25, 2018 6:33:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T18:33:03.359Z: Fusing consumer PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)
May 25, 2018 6:33:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T18:33:03.405Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
May 25, 2018 6:33:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T18:33:03.447Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
May 25, 2018 6:33:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T18:33:03.485Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into PAssert$33/GroupGlobally/Window.Into()/Window.Assign
May 25, 2018 6:33:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T18:33:03.541Z: Fusing consumer OutputSideInputs into Create123/Read(CreateSource)
May 25, 2018 6:33:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T18:33:03.607Z: Fusing consumer PAssert$33/GroupGlobally/Window.Into()/Window.Assign into OutputSideInputs
May 25, 2018 6:33:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T18:33:03.645Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
May 25, 2018 6:33:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T18:33:03.690Z: Fusing consumer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map into PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
May 25, 2018 6:33:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T18:33:03.728Z: Fusing consumer PAssert$33/GroupGlobally/RewindowActuals/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map
May 25, 2018 6:33:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T18:33:03.769Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read
May 25, 2018 6:33:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T18:33:03.807Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
May 25, 2018 6:33:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T18:33:03.844Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
May 25, 2018 6:33:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T18:33:03.890Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
May 25, 2018 6:33:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T18:33:03.935Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
May 25, 2018 6:33:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T18:33:03.970Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
May 25, 2018 6:33:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T18:33:04.018Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into Create47/Read(CreateSource)
May 25, 2018 6:33:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T18:33:04.064Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
May 25, 2018 6:33:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T18:33:04.111Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
May 25, 2018 6:33:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T18:33:04.148Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
May 25, 2018 6:33:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T18:33:04.196Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
May 25, 2018 6:33:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T18:33:04.235Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
May 25, 2018 6:33:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T18:33:04.284Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
May 25, 2018 6:33:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T18:33:04.773Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Create
May 25, 2018 6:33:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T18:33:04.818Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Create
May 25, 2018 6:33:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T18:33:04.861Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
May 25, 2018 6:33:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T18:33:04.874Z: Starting 1 workers in us-central1-b...
May 25, 2018 6:33:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T18:33:04.904Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
May 25, 2018 6:33:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T18:33:05.153Z: Executing operation PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 25, 2018 6:33:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T18:33:05.199Z: Executing operation Create47/Read(CreateSource)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
May 25, 2018 6:33:15 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T18:33:14.768Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
May 25, 2018 6:33:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T18:33:25.450Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
May 25, 2018 6:33:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T18:33:25.486Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 25, 2018 6:33:48 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T18:33:48.242Z: Workers have started successfully.
May 25, 2018 6:34:06 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T18:34:05.700Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
May 25, 2018 6:34:06 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T18:34:05.792Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
May 25, 2018 6:34:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T18:34:09.622Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
May 25, 2018 6:34:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T18:34:09.721Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
May 25, 2018 6:34:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T18:34:23.303Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
May 25, 2018 6:34:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T18:34:23.482Z: Executing operation Create123/Read(CreateSource)+OutputSideInputs+PAssert$33/GroupGlobally/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write
May 25, 2018 6:34:32 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T18:34:31.144Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Close
May 25, 2018 6:34:32 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T18:34:31.224Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$33/GroupGlobally/RewindowActuals/Window.Assign+PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 25, 2018 6:34:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T18:34:36.158Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Close
May 25, 2018 6:34:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T18:34:36.269Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Read+PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$33/GroupGlobally/Values/Values/Map+PAssert$33/GroupGlobally/ParDo(Concat)+PAssert$33/GetPane/Map+PAssert$33/RunChecks+PAssert$33/VerifyAssertions/ParDo(DefaultConclude)
May 25, 2018 6:34:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T18:34:39.814Z: Cleaning up.
May 25, 2018 6:34:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T18:34:39.948Z: Stopping worker pool...
May 25, 2018 6:36:35 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T18:36:33.479Z: Autoscaling: Resized worker pool from 1 to 0.
May 25, 2018 6:36:35 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T18:36:33.526Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 25, 2018 6:36:44 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-05-25_11_32_53-16943753811765757669 finished with status DONE.
May 25, 2018 6:36:44 PM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-05-25_11_32_53-16943753811765757669. Found 1 success, 0 failures out of 1 expected assertions.
Gradle Test Executor 16 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest FAILED
209 tests completed, 34 failed, 2 skipped
Finished generating test XML results (0.489 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerTest>
Generating HTML test report...
Finished generating test html results (0.357 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest>
:beam-runners-google-cloud-dataflow-java:validatesRunnerTest (Thread[Task worker for ':' Thread 38,5,main]) completed. Took 2 hrs 8 mins 29.44 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:validatesRunnerTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 9m 24s
38 actionable tasks: 34 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/vq5yyhhs3az3c
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user robbe.sneyders@ml6.eu
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user schroederc@google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ammons@google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user sidhom@google.com
Build failed in Jenkins:
beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #347
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/347/display/redirect?page=changes>
Changes:
[ammons] Say that merging windows are not supported in Distinct.java.
------------------------------------------
[...truncated 18.05 MB...]
May 25, 2018 4:23:54 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey as step s16
May 25, 2018 4:23:54 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map as step s17
May 25, 2018 4:23:54 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RewindowActuals/Window.Assign as step s18
May 25, 2018 4:23:54 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map as step s19
May 25, 2018 4:23:54 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveActualsTriggering/Flatten.PCollections as step s20
May 25, 2018 4:23:54 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Create.Values/Read(CreateSource) as step s21
May 25, 2018 4:23:54 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign as step s22
May 25, 2018 4:23:54 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveDummyTriggering/Flatten.PCollections as step s23
May 25, 2018 4:23:54 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/FlattenDummyAndContents as step s24
May 25, 2018 4:23:54 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/NeverTrigger/Flatten.PCollections as step s25
May 25, 2018 4:23:54 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GroupDummyAndContents as step s26
May 25, 2018 4:23:54 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Values/Values/Map as step s27
May 25, 2018 4:23:54 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/ParDo(Concat) as step s28
May 25, 2018 4:23:54 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GetPane/Map as step s29
May 25, 2018 4:23:54 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/RunChecks as step s30
May 25, 2018 4:23:54 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/VerifyAssertions/ParDo(DefaultConclude) as step s31
May 25, 2018 4:23:54 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0525162351-ac8d1b7d/output/results/staging/
May 25, 2018 4:23:55 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <71120 bytes, hash I901TLkP3Sb3SgMAbnz6AQ> to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0525162351-ac8d1b7d/output/results/staging/pipeline-I901TLkP3Sb3SgMAbnz6AQ.pb
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 25, 2018 4:23:56 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-05-25_09_23_55-17984963898635708046?project=apache-beam-testing
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Submitted job: 2018-05-25_09_23_55-17984963898635708046
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 25, 2018 4:23:56 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-05-25_09_23_55-17984963898635708046
May 25, 2018 4:23:56 PM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-05-25_09_23_55-17984963898635708046 with 1 expected assertions.
May 25, 2018 4:24:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T16:23:55.462Z: Autoscaling is enabled for job 2018-05-25_09_23_55-17984963898635708046. The number of workers will be between 1 and 1000.
May 25, 2018 4:24:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T16:23:55.499Z: Autoscaling was automatically enabled for job 2018-05-25_09_23_55-17984963898635708046.
May 25, 2018 4:24:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T16:23:58.683Z: Checking required Cloud APIs are enabled.
May 25, 2018 4:24:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T16:23:58.788Z: Checking permissions granted to controller Service Account.
May 25, 2018 4:24:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T16:24:02.413Z: Worker configuration: n1-standard-1 in us-central1-b.
May 25, 2018 4:24:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T16:24:02.850Z: Expanding CoGroupByKey operations into optimizable parts.
May 25, 2018 4:24:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T16:24:03.029Z: Expanding GroupByKey operations into optimizable parts.
May 25, 2018 4:24:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T16:24:03.079Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
May 25, 2018 4:24:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T16:24:03.297Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
May 25, 2018 4:24:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T16:24:03.345Z: Elided trivial flatten
May 25, 2018 4:24:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T16:24:03.396Z: Elided trivial flatten
May 25, 2018 4:24:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T16:24:03.434Z: Elided trivial flatten
May 25, 2018 4:24:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T16:24:03.474Z: Unzipping flatten s24 for input s19.org.apache.beam.sdk.values.PCollection.<init>:329#8fd0f908e3ea90e3
May 25, 2018 4:24:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T16:24:03.520Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Reify, through flatten PAssert$33/GroupGlobally/FlattenDummyAndContents, into producer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map
May 25, 2018 4:24:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T16:24:03.552Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow into PAssert$33/GroupGlobally/GroupDummyAndContents/Read
May 25, 2018 4:24:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T16:24:03.590Z: Fusing consumer PAssert$33/GroupGlobally/ParDo(Concat) into PAssert$33/GroupGlobally/Values/Values/Map
May 25, 2018 4:24:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T16:24:03.636Z: Fusing consumer PAssert$33/GetPane/Map into PAssert$33/GroupGlobally/ParDo(Concat)
May 25, 2018 4:24:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T16:24:03.684Z: Fusing consumer PAssert$33/GroupGlobally/Values/Values/Map into PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow
May 25, 2018 4:24:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T16:24:03.734Z: Fusing consumer PAssert$33/RunChecks into PAssert$33/GetPane/Map
May 25, 2018 4:24:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T16:24:03.772Z: Fusing consumer PAssert$33/VerifyAssertions/ParDo(DefaultConclude) into PAssert$33/RunChecks
May 25, 2018 4:24:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T16:24:03.817Z: Unzipping flatten s24-u45 for input s26-reify-value18-c43
May 25, 2018 4:24:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T16:24:03.865Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Write, through flatten s24-u45, into producer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 25, 2018 4:24:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T16:24:03.910Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify into PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
May 25, 2018 4:24:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T16:24:03.951Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Write into PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 25, 2018 4:24:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T16:24:03.997Z: Fusing consumer PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)
May 25, 2018 4:24:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T16:24:04.036Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
May 25, 2018 4:24:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T16:24:04.073Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
May 25, 2018 4:24:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T16:24:04.118Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into PAssert$33/GroupGlobally/Window.Into()/Window.Assign
May 25, 2018 4:24:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T16:24:04.163Z: Fusing consumer OutputSideInputs into Create123/Read(CreateSource)
May 25, 2018 4:24:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T16:24:04.205Z: Fusing consumer PAssert$33/GroupGlobally/Window.Into()/Window.Assign into OutputSideInputs
May 25, 2018 4:24:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T16:24:04.249Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
May 25, 2018 4:24:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T16:24:04.286Z: Fusing consumer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map into PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
May 25, 2018 4:24:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T16:24:04.324Z: Fusing consumer PAssert$33/GroupGlobally/RewindowActuals/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map
May 25, 2018 4:24:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T16:24:04.364Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read
May 25, 2018 4:24:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T16:24:04.410Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
May 25, 2018 4:24:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T16:24:04.457Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
May 25, 2018 4:24:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T16:24:04.496Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
May 25, 2018 4:24:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T16:24:04.533Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
May 25, 2018 4:24:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T16:24:04.575Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
May 25, 2018 4:24:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T16:24:04.622Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into Create47/Read(CreateSource)
May 25, 2018 4:24:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T16:24:04.669Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
May 25, 2018 4:24:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T16:24:04.715Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
May 25, 2018 4:24:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T16:24:04.760Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
May 25, 2018 4:24:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T16:24:04.801Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
May 25, 2018 4:24:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T16:24:04.848Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
May 25, 2018 4:24:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T16:24:04.897Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
May 25, 2018 4:24:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T16:24:05.358Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Create
May 25, 2018 4:24:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T16:24:05.405Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Create
May 25, 2018 4:24:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T16:24:05.442Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
May 25, 2018 4:24:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T16:24:05.466Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
May 25, 2018 4:24:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T16:24:05.466Z: Starting 1 workers in us-central1-b...
May 25, 2018 4:24:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T16:24:05.702Z: Executing operation PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 25, 2018 4:24:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T16:24:05.745Z: Executing operation Create47/Read(CreateSource)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
May 25, 2018 4:24:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T16:24:13.208Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
May 25, 2018 4:24:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T16:24:23.786Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
May 25, 2018 4:24:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T16:24:23.818Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 25, 2018 4:24:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T16:24:38.767Z: Workers have started successfully.
May 25, 2018 4:25:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T16:24:59.338Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
May 25, 2018 4:25:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T16:24:59.439Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
May 25, 2018 4:25:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T16:25:04.971Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
May 25, 2018 4:25:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T16:25:05.075Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
May 25, 2018 4:25:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T16:25:16.995Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
May 25, 2018 4:25:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T16:25:17.193Z: Executing operation Create123/Read(CreateSource)+OutputSideInputs+PAssert$33/GroupGlobally/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write
May 25, 2018 4:25:22 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T16:25:21.969Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Close
May 25, 2018 4:25:22 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T16:25:22.069Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$33/GroupGlobally/RewindowActuals/Window.Assign+PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 25, 2018 4:25:25 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T16:25:25.598Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Close
May 25, 2018 4:25:25 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T16:25:25.706Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Read+PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$33/GroupGlobally/Values/Values/Map+PAssert$33/GroupGlobally/ParDo(Concat)+PAssert$33/GetPane/Map+PAssert$33/RunChecks+PAssert$33/VerifyAssertions/ParDo(DefaultConclude)
May 25, 2018 4:25:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T16:25:29.245Z: Cleaning up.
May 25, 2018 4:25:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T16:25:29.358Z: Stopping worker pool...
May 25, 2018 4:26:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T16:26:57.016Z: Autoscaling: Resized worker pool from 1 to 0.
May 25, 2018 4:26:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T16:26:57.055Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 25, 2018 4:26:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T16:26:57.126Z: Worker pool stopped.
May 25, 2018 4:27:05 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-05-25_09_23_55-17984963898635708046 finished with status DONE.
May 25, 2018 4:27:06 PM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-05-25_09_23_55-17984963898635708046. Found 1 success, 0 failures out of 1 expected assertions.
Gradle Test Executor 39 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest FAILED
209 tests completed, 34 failed, 2 skipped
Finished generating test XML results (0.359 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerTest>
Generating HTML test report...
Finished generating test html results (0.565 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest>
:beam-runners-google-cloud-dataflow-java:validatesRunnerTest (Thread[Daemon worker,5,main]) completed. Took 2 hrs 5 mins 13.208 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:validatesRunnerTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 6m 23s
38 actionable tasks: 35 executed, 3 from cache
Publishing build scan...
https://gradle.com/s/itts7laxpqam4
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user robbe.sneyders@ml6.eu
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user schroederc@google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ammons@google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user sidhom@google.com
Build failed in Jenkins:
beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #346
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/346/display/redirect>
------------------------------------------
[...truncated 18.06 MB...]
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign as step s15
May 25, 2018 2:17:12 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey as step s16
May 25, 2018 2:17:12 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map as step s17
May 25, 2018 2:17:12 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RewindowActuals/Window.Assign as step s18
May 25, 2018 2:17:12 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map as step s19
May 25, 2018 2:17:12 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveActualsTriggering/Flatten.PCollections as step s20
May 25, 2018 2:17:12 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Create.Values/Read(CreateSource) as step s21
May 25, 2018 2:17:12 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign as step s22
May 25, 2018 2:17:12 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveDummyTriggering/Flatten.PCollections as step s23
May 25, 2018 2:17:12 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/FlattenDummyAndContents as step s24
May 25, 2018 2:17:12 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/NeverTrigger/Flatten.PCollections as step s25
May 25, 2018 2:17:12 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GroupDummyAndContents as step s26
May 25, 2018 2:17:12 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Values/Values/Map as step s27
May 25, 2018 2:17:12 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/ParDo(Concat) as step s28
May 25, 2018 2:17:12 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GetPane/Map as step s29
May 25, 2018 2:17:12 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/RunChecks as step s30
May 25, 2018 2:17:12 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/VerifyAssertions/ParDo(DefaultConclude) as step s31
May 25, 2018 2:17:12 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0525141708-9f93bb0e/output/results/staging/
May 25, 2018 2:17:12 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <71120 bytes, hash _D8KbhrjmpfvIZKfPfPqIg> to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0525141708-9f93bb0e/output/results/staging/pipeline-_D8KbhrjmpfvIZKfPfPqIg.pb
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 25, 2018 2:17:13 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-05-25_07_17_12-9786856366001369626?project=apache-beam-testing
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Submitted job: 2018-05-25_07_17_12-9786856366001369626
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 25, 2018 2:17:13 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-05-25_07_17_12-9786856366001369626
May 25, 2018 2:17:13 PM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-05-25_07_17_12-9786856366001369626 with 1 expected assertions.
May 25, 2018 2:17:25 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T14:17:12.783Z: Autoscaling is enabled for job 2018-05-25_07_17_12-9786856366001369626. The number of workers will be between 1 and 1000.
May 25, 2018 2:17:25 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T14:17:12.811Z: Autoscaling was automatically enabled for job 2018-05-25_07_17_12-9786856366001369626.
May 25, 2018 2:17:25 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T14:17:15.652Z: Checking required Cloud APIs are enabled.
May 25, 2018 2:17:25 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T14:17:15.864Z: Checking permissions granted to controller Service Account.
May 25, 2018 2:17:25 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T14:17:19.422Z: Worker configuration: n1-standard-1 in us-central1-b.
May 25, 2018 2:17:25 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T14:17:19.906Z: Expanding CoGroupByKey operations into optimizable parts.
May 25, 2018 2:17:25 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T14:17:20.100Z: Expanding GroupByKey operations into optimizable parts.
May 25, 2018 2:17:25 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T14:17:20.147Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
May 25, 2018 2:17:25 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T14:17:20.389Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
May 25, 2018 2:17:25 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T14:17:20.438Z: Elided trivial flatten
May 25, 2018 2:17:25 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T14:17:20.488Z: Elided trivial flatten
May 25, 2018 2:17:25 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T14:17:20.528Z: Elided trivial flatten
May 25, 2018 2:17:25 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T14:17:20.574Z: Unzipping flatten s24 for input s19.org.apache.beam.sdk.values.PCollection.<init>:329#8fd0f908e3ea90e3
May 25, 2018 2:17:25 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T14:17:20.618Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Reify, through flatten PAssert$33/GroupGlobally/FlattenDummyAndContents, into producer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map
May 25, 2018 2:17:25 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T14:17:20.654Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow into PAssert$33/GroupGlobally/GroupDummyAndContents/Read
May 25, 2018 2:17:25 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T14:17:20.703Z: Fusing consumer PAssert$33/GroupGlobally/ParDo(Concat) into PAssert$33/GroupGlobally/Values/Values/Map
May 25, 2018 2:17:25 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T14:17:20.745Z: Fusing consumer PAssert$33/GetPane/Map into PAssert$33/GroupGlobally/ParDo(Concat)
May 25, 2018 2:17:25 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T14:17:20.795Z: Fusing consumer PAssert$33/GroupGlobally/Values/Values/Map into PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow
May 25, 2018 2:17:25 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T14:17:20.836Z: Fusing consumer PAssert$33/RunChecks into PAssert$33/GetPane/Map
May 25, 2018 2:17:25 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T14:17:20.882Z: Fusing consumer PAssert$33/VerifyAssertions/ParDo(DefaultConclude) into PAssert$33/RunChecks
May 25, 2018 2:17:25 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T14:17:20.921Z: Unzipping flatten s24-u45 for input s26-reify-value18-c43
May 25, 2018 2:17:25 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T14:17:20.964Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Write, through flatten s24-u45, into producer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 25, 2018 2:17:25 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T14:17:21.012Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify into PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
May 25, 2018 2:17:25 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T14:17:21.051Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Write into PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 25, 2018 2:17:25 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T14:17:21.092Z: Fusing consumer PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)
May 25, 2018 2:17:25 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T14:17:21.140Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
May 25, 2018 2:17:25 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T14:17:21.181Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
May 25, 2018 2:17:25 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T14:17:21.220Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into PAssert$33/GroupGlobally/Window.Into()/Window.Assign
May 25, 2018 2:17:25 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T14:17:21.260Z: Fusing consumer OutputSideInputs into Create123/Read(CreateSource)
May 25, 2018 2:17:25 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T14:17:21.305Z: Fusing consumer PAssert$33/GroupGlobally/Window.Into()/Window.Assign into OutputSideInputs
May 25, 2018 2:17:25 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T14:17:21.348Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
May 25, 2018 2:17:25 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T14:17:21.385Z: Fusing consumer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map into PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
May 25, 2018 2:17:25 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T14:17:21.433Z: Fusing consumer PAssert$33/GroupGlobally/RewindowActuals/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map
May 25, 2018 2:17:25 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T14:17:21.486Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read
May 25, 2018 2:17:25 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T14:17:21.522Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
May 25, 2018 2:17:25 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T14:17:21.574Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
May 25, 2018 2:17:25 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T14:17:21.616Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
May 25, 2018 2:17:25 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T14:17:21.657Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
May 25, 2018 2:17:25 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T14:17:21.699Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
May 25, 2018 2:17:25 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T14:17:21.735Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into Create47/Read(CreateSource)
May 25, 2018 2:17:25 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T14:17:21.769Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
May 25, 2018 2:17:25 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T14:17:21.809Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
May 25, 2018 2:17:25 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T14:17:21.853Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
May 25, 2018 2:17:25 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T14:17:21.893Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
May 25, 2018 2:17:25 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T14:17:21.933Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
May 25, 2018 2:17:25 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T14:17:21.969Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
May 25, 2018 2:17:25 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T14:17:22.443Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Create
May 25, 2018 2:17:25 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T14:17:22.489Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Create
May 25, 2018 2:17:25 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T14:17:22.534Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
May 25, 2018 2:17:25 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T14:17:22.545Z: Starting 1 workers in us-central1-b...
May 25, 2018 2:17:25 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T14:17:22.581Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
May 25, 2018 2:17:25 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T14:17:22.827Z: Executing operation PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 25, 2018 2:17:25 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T14:17:22.867Z: Executing operation Create47/Read(CreateSource)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
May 25, 2018 2:17:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T14:17:29.853Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
May 25, 2018 2:17:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T14:17:40.325Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
May 25, 2018 2:17:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T14:17:40.371Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 25, 2018 2:18:06 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T14:18:04.400Z: Workers have started successfully.
May 25, 2018 2:18:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T14:18:27.979Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
May 25, 2018 2:18:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T14:18:28.085Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
May 25, 2018 2:18:35 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T14:18:34.093Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
May 25, 2018 2:18:35 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T14:18:34.185Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
May 25, 2018 2:18:47 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T14:18:44.751Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
May 25, 2018 2:18:47 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T14:18:44.875Z: Executing operation Create123/Read(CreateSource)+OutputSideInputs+PAssert$33/GroupGlobally/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write
May 25, 2018 2:18:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T14:18:51.604Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Close
May 25, 2018 2:18:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T14:18:51.689Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$33/GroupGlobally/RewindowActuals/Window.Assign+PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 25, 2018 2:18:56 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T14:18:55.194Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Close
May 25, 2018 2:18:56 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T14:18:55.268Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Read+PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$33/GroupGlobally/Values/Values/Map+PAssert$33/GroupGlobally/ParDo(Concat)+PAssert$33/GetPane/Map+PAssert$33/RunChecks+PAssert$33/VerifyAssertions/ParDo(DefaultConclude)
May 25, 2018 2:18:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T14:18:59.195Z: Cleaning up.
May 25, 2018 2:19:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T14:18:59.280Z: Stopping worker pool...
May 25, 2018 2:20:21 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T14:20:20.180Z: Autoscaling: Resized worker pool from 1 to 0.
May 25, 2018 2:20:21 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T14:20:20.216Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 25, 2018 2:20:29 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-05-25_07_17_12-9786856366001369626 finished with status DONE.
May 25, 2018 2:20:29 PM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-05-25_07_17_12-9786856366001369626. Found 1 success, 0 failures out of 1 expected assertions.
Gradle Test Executor 40 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest
209 tests completed, 34 failed, 2 skipped
Finished generating test XML results (0.926 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerTest>
Generating HTML test report...
Finished generating test html results (0.399 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest>
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest FAILED
:beam-runners-google-cloud-dataflow-java:validatesRunnerTest (Thread[Task worker for ':' Thread 47,5,main]) completed. Took 2 hrs 2 mins 59.045 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:validatesRunnerTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 3m 51s
38 actionable tasks: 34 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/gwvj3vmtzd6zu
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user robbe.sneyders@ml6.eu
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user schroederc@google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user sidhom@google.com
Build failed in Jenkins:
beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #345
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/345/display/redirect?page=changes>
Changes:
[jbonofre] Fix Maven parent version in ParquetIO
[iemejia] [BEAM-4312] Enforce ErrorProne analysis in gearpump runner
------------------------------------------
[...truncated 18.02 MB...]
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map as step s14
May 25, 2018 12:12:43 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign as step s15
May 25, 2018 12:12:43 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey as step s16
May 25, 2018 12:12:43 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map as step s17
May 25, 2018 12:12:43 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RewindowActuals/Window.Assign as step s18
May 25, 2018 12:12:43 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map as step s19
May 25, 2018 12:12:43 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveActualsTriggering/Flatten.PCollections as step s20
May 25, 2018 12:12:43 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Create.Values/Read(CreateSource) as step s21
May 25, 2018 12:12:43 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign as step s22
May 25, 2018 12:12:43 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveDummyTriggering/Flatten.PCollections as step s23
May 25, 2018 12:12:43 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/FlattenDummyAndContents as step s24
May 25, 2018 12:12:43 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/NeverTrigger/Flatten.PCollections as step s25
May 25, 2018 12:12:43 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GroupDummyAndContents as step s26
May 25, 2018 12:12:43 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Values/Values/Map as step s27
May 25, 2018 12:12:43 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/ParDo(Concat) as step s28
May 25, 2018 12:12:43 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GetPane/Map as step s29
May 25, 2018 12:12:43 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/RunChecks as step s30
May 25, 2018 12:12:43 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/VerifyAssertions/ParDo(DefaultConclude) as step s31
May 25, 2018 12:12:43 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0525121239-ee645ab3/output/results/staging/
May 25, 2018 12:12:43 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <71120 bytes, hash HpnDBJEUzp73Zx81N2b6CQ> to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0525121239-ee645ab3/output/results/staging/pipeline-HpnDBJEUzp73Zx81N2b6CQ.pb
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 25, 2018 12:12:45 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-05-25_05_12_44-160234745879878573?project=apache-beam-testing
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Submitted job: 2018-05-25_05_12_44-160234745879878573
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 25, 2018 12:12:45 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-05-25_05_12_44-160234745879878573
May 25, 2018 12:12:45 PM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-05-25_05_12_44-160234745879878573 with 1 expected assertions.
May 25, 2018 12:12:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T12:12:44.518Z: Autoscaling is enabled for job 2018-05-25_05_12_44-160234745879878573. The number of workers will be between 1 and 1000.
May 25, 2018 12:12:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T12:12:44.535Z: Autoscaling was automatically enabled for job 2018-05-25_05_12_44-160234745879878573.
May 25, 2018 12:12:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T12:12:46.706Z: Checking required Cloud APIs are enabled.
May 25, 2018 12:12:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T12:12:46.812Z: Checking permissions granted to controller Service Account.
May 25, 2018 12:12:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T12:12:50.780Z: Worker configuration: n1-standard-1 in us-central1-b.
May 25, 2018 12:12:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T12:12:51.090Z: Expanding CoGroupByKey operations into optimizable parts.
May 25, 2018 12:12:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T12:12:51.224Z: Expanding GroupByKey operations into optimizable parts.
May 25, 2018 12:12:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T12:12:51.249Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
May 25, 2018 12:12:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T12:12:51.411Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
May 25, 2018 12:12:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T12:12:51.441Z: Elided trivial flatten
May 25, 2018 12:12:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T12:12:51.469Z: Elided trivial flatten
May 25, 2018 12:12:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T12:12:51.494Z: Elided trivial flatten
May 25, 2018 12:12:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T12:12:51.532Z: Unzipping flatten s24 for input s19.org.apache.beam.sdk.values.PCollection.<init>:329#8fd0f908e3ea90e3
May 25, 2018 12:12:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T12:12:51.569Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Reify, through flatten PAssert$33/GroupGlobally/FlattenDummyAndContents, into producer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map
May 25, 2018 12:12:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T12:12:51.595Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow into PAssert$33/GroupGlobally/GroupDummyAndContents/Read
May 25, 2018 12:12:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T12:12:51.634Z: Fusing consumer PAssert$33/GroupGlobally/ParDo(Concat) into PAssert$33/GroupGlobally/Values/Values/Map
May 25, 2018 12:12:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T12:12:51.673Z: Fusing consumer PAssert$33/GetPane/Map into PAssert$33/GroupGlobally/ParDo(Concat)
May 25, 2018 12:12:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T12:12:51.701Z: Fusing consumer PAssert$33/GroupGlobally/Values/Values/Map into PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow
May 25, 2018 12:12:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T12:12:51.739Z: Fusing consumer PAssert$33/RunChecks into PAssert$33/GetPane/Map
May 25, 2018 12:12:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T12:12:51.775Z: Fusing consumer PAssert$33/VerifyAssertions/ParDo(DefaultConclude) into PAssert$33/RunChecks
May 25, 2018 12:12:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T12:12:51.804Z: Unzipping flatten s24-u45 for input s26-reify-value18-c43
May 25, 2018 12:12:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T12:12:51.840Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Write, through flatten s24-u45, into producer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 25, 2018 12:12:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T12:12:51.874Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify into PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
May 25, 2018 12:12:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T12:12:51.909Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Write into PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 25, 2018 12:12:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T12:12:51.946Z: Fusing consumer PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)
May 25, 2018 12:12:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T12:12:51.982Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
May 25, 2018 12:12:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T12:12:52.023Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
May 25, 2018 12:12:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T12:12:52.050Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into PAssert$33/GroupGlobally/Window.Into()/Window.Assign
May 25, 2018 12:12:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T12:12:52.072Z: Fusing consumer OutputSideInputs into Create123/Read(CreateSource)
May 25, 2018 12:12:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T12:12:52.106Z: Fusing consumer PAssert$33/GroupGlobally/Window.Into()/Window.Assign into OutputSideInputs
May 25, 2018 12:12:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T12:12:52.133Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
May 25, 2018 12:12:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T12:12:52.160Z: Fusing consumer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map into PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
May 25, 2018 12:12:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T12:12:52.186Z: Fusing consumer PAssert$33/GroupGlobally/RewindowActuals/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map
May 25, 2018 12:12:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T12:12:52.220Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read
May 25, 2018 12:12:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T12:12:52.247Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
May 25, 2018 12:12:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T12:12:52.293Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
May 25, 2018 12:12:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T12:12:52.330Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
May 25, 2018 12:12:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T12:12:52.371Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
May 25, 2018 12:12:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T12:12:52.417Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
May 25, 2018 12:12:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T12:12:52.456Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into Create47/Read(CreateSource)
May 25, 2018 12:12:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T12:12:52.492Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
May 25, 2018 12:12:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T12:12:52.530Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
May 25, 2018 12:12:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T12:12:52.556Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
May 25, 2018 12:12:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T12:12:52.601Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
May 25, 2018 12:12:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T12:12:52.644Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
May 25, 2018 12:12:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T12:12:52.691Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
May 25, 2018 12:12:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T12:12:53.118Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Create
May 25, 2018 12:12:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T12:12:53.152Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Create
May 25, 2018 12:12:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T12:12:53.178Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
May 25, 2018 12:12:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T12:12:53.208Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
May 25, 2018 12:12:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T12:12:53.208Z: Starting 1 workers in us-central1-b...
May 25, 2018 12:12:54 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T12:12:53.436Z: Executing operation Create47/Read(CreateSource)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
May 25, 2018 12:12:54 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T12:12:53.472Z: Executing operation PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 25, 2018 12:13:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T12:13:02.867Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
May 25, 2018 12:13:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T12:13:13.399Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
May 25, 2018 12:13:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T12:13:13.412Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 25, 2018 12:13:33 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T12:13:31.557Z: Workers have started successfully.
May 25, 2018 12:14:03 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T12:14:03.279Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
May 25, 2018 12:14:03 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T12:14:03.352Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
May 25, 2018 12:14:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T12:14:11.183Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
May 25, 2018 12:14:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T12:14:11.237Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
May 25, 2018 12:14:22 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T12:14:22.023Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
May 25, 2018 12:14:22 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T12:14:22.165Z: Executing operation Create123/Read(CreateSource)+OutputSideInputs+PAssert$33/GroupGlobally/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write
May 25, 2018 12:14:29 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T12:14:27.825Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Close
May 25, 2018 12:14:29 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T12:14:27.876Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$33/GroupGlobally/RewindowActuals/Window.Assign+PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 25, 2018 12:14:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T12:14:32.640Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Close
May 25, 2018 12:14:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T12:14:32.695Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Read+PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$33/GroupGlobally/Values/Values/Map+PAssert$33/GroupGlobally/ParDo(Concat)+PAssert$33/GetPane/Map+PAssert$33/RunChecks+PAssert$33/VerifyAssertions/ParDo(DefaultConclude)
May 25, 2018 12:14:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T12:14:36.599Z: Cleaning up.
May 25, 2018 12:14:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T12:14:36.780Z: Stopping worker pool...
May 25, 2018 12:16:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T12:16:18.188Z: Autoscaling: Resized worker pool from 1 to 0.
May 25, 2018 12:16:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T12:16:18.231Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 25, 2018 12:16:26 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-05-25_05_12_44-160234745879878573 finished with status DONE.
May 25, 2018 12:16:26 PM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-05-25_05_12_44-160234745879878573. Found 1 success, 0 failures out of 1 expected assertions.
Gradle Test Executor 38 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest FAILED
209 tests completed, 34 failed, 2 skipped
Finished generating test XML results (0.64 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerTest>
Generating HTML test report...
Finished generating test html results (0.31 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest>
:beam-runners-google-cloud-dataflow-java:validatesRunnerTest (Thread[Task worker for ':' Thread 31,5,main]) completed. Took 1 hrs 59 mins 17.969 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:validatesRunnerTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 0m 8s
38 actionable tasks: 34 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/524k2qu3rshyc
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user robbe.sneyders@ml6.eu
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user schroederc@google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user sidhom@google.com
Re: Build failed in Jenkins:
beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #344
Posted by "Matthias J. Sax" <ma...@confluent.io>.
Thanks for talking a look!
I don't contribute the Beam and I am not subscribed to any mailing list
either (just to dev list as of today to discuss the matter). Really not
sure why Jenkins sends those emails.
-Matthias
On 5/25/18 9:17 AM, Kenneth Knowles wrote:
> Taking a look, I track this to May 17:
> https://builds.apache.org/blue/organizations/jenkins/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/detail/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/288/changes/
>
> As far as I can tell, you've got no commits in our logs nor any
> reference in our codebase or Jenkins job definitions.
>
> Kenn
>
> On Fri, May 25, 2018 at 8:43 AM Matthias J. Sax <matthias@confluent.io
> <ma...@confluent.io>> wrote:
>
> Hi Beam folks,
>
> couple of days ago I started to receive emails from your Jenkins build
> (forwarding one of the received emails). I am not sure why... It's quite
> annoying and I would appreciate your help to get rid of them.
>
> Hope you can help me out.
>
> Thanks a lot.
>
>
> -Matthias
>
>
> -------- Forwarded Message --------
> Subject: Build failed in Jenkins:
> beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #344
> Date: Fri, 25 May 2018 10:16:06 +0000 (UTC)
> From: Apache Jenkins Server <jenkins@builds.apache.org
> <ma...@builds.apache.org>>
> To: commits@beam.apache.org <ma...@beam.apache.org>,
> matthias@confluent.io <ma...@confluent.io>,
> robertwb@gmail.com <ma...@gmail.com>,
> iemejia@gmail.com <ma...@gmail.com>, lcwik@google.com
> <ma...@google.com>, tgroh@google.com <ma...@google.com>
>
> See
> <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/344/display/redirect?page=changes>
>
> Changes:
>
> [iemejia] Fix broken build (again third time this week yay!)
>
> ------------------------------------------
> [...truncated 18.05 MB...]
> Â Â INFO: Adding
> PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign as
> step s15
> Â Â May 25, 2018 10:12:22 AM
> org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator
> addStep
> Â Â INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey as
> step s16
> Â Â May 25, 2018 10:12:22 AM
> org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator
> addStep
> Â Â INFO: Adding
> PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map as step s17
> Â Â May 25, 2018 10:12:22 AM
> org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator
> addStep
> Â Â INFO: Adding PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
> as step s18
> Â Â May 25, 2018 10:12:22 AM
> org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator
> addStep
> Â Â INFO: Adding PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map as
> step s19
> Â Â May 25, 2018 10:12:22 AM
> org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator
> addStep
> Â Â INFO: Adding
> PAssert$33/GroupGlobally/RemoveActualsTriggering/Flatten.PCollections as
> step s20
> Â Â May 25, 2018 10:12:22 AM
> org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator
> addStep
> Â Â INFO: Adding
> PAssert$33/GroupGlobally/Create.Values/Read(CreateSource) as step s21
> Â Â May 25, 2018 10:12:22 AM
> org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator
> addStep
> Â Â INFO: Adding PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
> as step s22
> Â Â May 25, 2018 10:12:22 AM
> org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator
> addStep
> Â Â INFO: Adding
> PAssert$33/GroupGlobally/RemoveDummyTriggering/Flatten.PCollections as
> step s23
> Â Â May 25, 2018 10:12:22 AM
> org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator
> addStep
> Â Â INFO: Adding PAssert$33/GroupGlobally/FlattenDummyAndContents as
> step s24
> Â Â May 25, 2018 10:12:22 AM
> org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator
> addStep
> Â Â INFO: Adding
> PAssert$33/GroupGlobally/NeverTrigger/Flatten.PCollections as step s25
> Â Â May 25, 2018 10:12:22 AM
> org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator
> addStep
> Â Â INFO: Adding PAssert$33/GroupGlobally/GroupDummyAndContents as
> step s26
> Â Â May 25, 2018 10:12:22 AM
> org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator
> addStep
> Â Â INFO: Adding PAssert$33/GroupGlobally/Values/Values/Map as step s27
> Â Â May 25, 2018 10:12:22 AM
> org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator
> addStep
> Â Â INFO: Adding PAssert$33/GroupGlobally/ParDo(Concat) as step s28
> Â Â May 25, 2018 10:12:22 AM
> org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator
> addStep
> Â Â INFO: Adding PAssert$33/GetPane/Map as step s29
> Â Â May 25, 2018 10:12:22 AM
> org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator
> addStep
> Â Â INFO: Adding PAssert$33/RunChecks as step s30
> Â Â May 25, 2018 10:12:22 AM
> org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator
> addStep
> Â Â INFO: Adding PAssert$33/VerifyAssertions/ParDo(DefaultConclude) as
> step s31
> Â Â May 25, 2018 10:12:22 AM
> org.apache.beam.runners.dataflow.DataflowRunner run
> Â Â INFO: Staging pipeline description to
> gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0525101218-9da8b226/output/results/staging/
> Â Â May 25, 2018 10:12:22 AM
> org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
> Â Â INFO: Uploading <71120 bytes, hash SiX30c8DyZkuiGKKPnDqxQ> to
> gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0525101218-9da8b226/output/results/staging/pipeline-SiX30c8DyZkuiGKKPnDqxQ.pb
>
> org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput
> STANDARD_OUT
> Â Â Dataflow SDK version: 2.5.0-SNAPSHOT
>
> org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput
> STANDARD_ERROR
> Â Â May 25, 2018 10:12:23 AM
> org.apache.beam.runners.dataflow.DataflowRunner run
> Â Â INFO: To access the Dataflow monitoring console, please navigate to
> https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-05-25_03_12_22-14221036885415975375?project=apache-beam-testing
>
> org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput
> STANDARD_OUT
> Â Â Submitted job: 2018-05-25_03_12_22-14221036885415975375
>
> org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput
> STANDARD_ERROR
> Â Â May 25, 2018 10:12:23 AM
> org.apache.beam.runners.dataflow.DataflowRunner run
> Â Â INFO: To cancel the job using the 'gcloud' tool, run:
> Â Â > gcloud dataflow jobs --project=apache-beam-testing cancel
> --region=us-central1 2018-05-25_03_12_22-14221036885415975375
> Â Â May 25, 2018 10:12:23 AM
> org.apache.beam.runners.dataflow.TestDataflowRunner run
> Â Â INFO: Running Dataflow job 2018-05-25_03_12_22-14221036885415975375
> with 1 expected assertions.
> Â Â May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:12:22.725Z: Autoscaling is enabled for job
> 2018-05-25_03_12_22-14221036885415975375. The number of workers will be
> between 1 and 1000.
> Â Â May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:12:22.768Z: Autoscaling was automatically
> enabled for job 2018-05-25_03_12_22-14221036885415975375.
> Â Â May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:12:25.613Z: Checking required Cloud APIs are
> enabled.
> Â Â May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:12:25.746Z: Checking permissions granted to
> controller Service Account.
> Â Â May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:12:30.129Z: Worker configuration: n1-standard-1
> in us-central1-b.
> Â Â May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:12:30.537Z: Expanding CoGroupByKey operations
> into optimizable parts.
> Â Â May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:12:30.685Z: Expanding GroupByKey operations into
> optimizable parts.
> Â Â May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:12:30.724Z: Lifting ValueCombiningMappingFns
> into MergeBucketsMappingFns
> Â Â May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:12:30.953Z: Fusing adjacent ParDo, Read, Write,
> and Flatten operations
> Â Â May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
>   INFO: 2018-05-25T10:12:31.000Z: Elided trivial flatten   May 25,
> 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
>   INFO: 2018-05-25T10:12:31.028Z: Elided trivial flatten   May 25,
> 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
>   INFO: 2018-05-25T10:12:31.072Z: Elided trivial flatten   May 25,
> 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:12:31.118Z: Unzipping flatten s24 for input
> s19.org.apache.beam.sdk.values.PCollection.<init>:329#8fd0f908e3ea90e3
> Â Â May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:12:31.164Z: Fusing unzipped copy of
> PAssert$33/GroupGlobally/GroupDummyAndContents/Reify, through flatten
> PAssert$33/GroupGlobally/FlattenDummyAndContents, into producer
> PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map
> Â Â May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:12:31.211Z: Fusing consumer
> PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow into
> PAssert$33/GroupGlobally/GroupDummyAndContents/Read
> Â Â May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:12:31.259Z: Fusing consumer
> PAssert$33/GroupGlobally/ParDo(Concat) into
> PAssert$33/GroupGlobally/Values/Values/Map
> Â Â May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:12:31.308Z: Fusing consumer
> PAssert$33/GetPane/Map into PAssert$33/GroupGlobally/ParDo(Concat)
> Â Â May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:12:31.354Z: Fusing consumer
> PAssert$33/GroupGlobally/Values/Values/Map into
> PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow
> Â Â May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:12:31.403Z: Fusing consumer PAssert$33/RunChecks
> into PAssert$33/GetPane/Map
> Â Â May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:12:31.447Z: Fusing consumer
> PAssert$33/VerifyAssertions/ParDo(DefaultConclude) into
> PAssert$33/RunChecks
> Â Â May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:12:31.487Z: Unzipping flatten s24-u45 for input
> s26-reify-value18-c43
> Â Â May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:12:31.529Z: Fusing unzipped copy of
> PAssert$33/GroupGlobally/GroupDummyAndContents/Write, through flatten
> s24-u45, into producer
> PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
> Â Â May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:12:31.567Z: Fusing consumer
> PAssert$33/GroupGlobally/GroupDummyAndContents/Reify into
> PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
> Â Â May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:12:31.602Z: Fusing consumer
> PAssert$33/GroupGlobally/GroupDummyAndContents/Write into
> PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
> Â Â May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:12:31.641Z: Fusing consumer
> PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign into
> PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)
> Â Â May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:12:31.683Z: Fusing consumer
> PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into
> PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
> Â Â May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:12:31.724Z: Fusing consumer
> PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write into
> PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
> Â Â May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:12:31.771Z: Fusing consumer
> PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
> into PAssert$33/GroupGlobally/Window.Into()/Window.Assign
> Â Â May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:12:31.817Z: Fusing consumer OutputSideInputs
> into Create123/Read(CreateSource)
> Â Â May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:12:31.856Z: Fusing consumer
> PAssert$33/GroupGlobally/Window.Into()/Window.Assign into
> OutputSideInputs
> Â Â May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:12:31.893Z: Fusing consumer
> PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map into
> PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
> Â Â May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:12:31.925Z: Fusing consumer
> PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map into
> PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
> Â Â May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:12:31.971Z: Fusing consumer
> PAssert$33/GroupGlobally/RewindowActuals/Window.Assign into
> PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map
> Â Â May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:12:32.018Z: Fusing consumer
> PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into
> PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read
> Â Â May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:12:32.070Z: Fusing consumer
> PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into
> PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
> Â Â May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:12:32.116Z: Fusing consumer
> PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
> into PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
> Â Â May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:12:32.150Z: Fusing consumer
> View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
> into
> View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
> Â Â May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:12:32.196Z: Fusing consumer
> View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
> into
> View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
> Â Â May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:12:32.239Z: Fusing consumer
> View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
> into
> View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
> Â Â May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:12:32.285Z: Fusing consumer
> View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
> into Create47/Read(CreateSource)
> Â Â May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:12:32.330Z: Fusing consumer
> View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
> into
> View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
> Â Â May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:12:32.376Z: Fusing consumer
> View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
> into
> View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
> Â Â May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:12:32.421Z: Fusing consumer
> View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
> into
> View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
> Â Â May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:12:32.465Z: Fusing consumer
> View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
> into
> View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
> Â Â May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:12:32.496Z: Fusing consumer
> View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
> into
> View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
> Â Â May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:12:32.538Z: Fusing consumer
> View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
> into
> View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
> Â Â May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:12:32.998Z: Executing operation
> PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Create
> Â Â May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:12:33.036Z: Executing operation
> PAssert$33/GroupGlobally/GroupDummyAndContents/Create
> Â Â May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:12:33.070Z: Executing operation
> View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
> Â Â May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:12:33.094Z: Starting 1 workers in
> us-central1-b...
> Â Â May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:12:33.112Z: Executing operation
> View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
> Â Â May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:12:33.383Z: Executing operation
> Create47/Read(CreateSource)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
> Â Â May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:12:33.425Z: Executing operation
> PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
> Â Â May 25, 2018 10:12:43 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:12:43.365Z: Autoscaling: Raised the number of
> workers to 0 based on the rate of progress in the currently running
> step(s).
> Â Â May 25, 2018 10:12:59 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:12:59.310Z: Autoscaling: Raised the number of
> workers to 1 based on the rate of progress in the currently running
> step(s).
> Â Â May 25, 2018 10:12:59 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:12:59.357Z: Autoscaling: Would further reduce
> the number of workers but reached the minimum number allowed for the
> job.
> Â Â May 25, 2018 10:13:22 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:13:20.869Z: Workers have started successfully.
> Â Â May 25, 2018 10:13:44 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:13:44.141Z: Executing operation
> View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
> Â Â May 25, 2018 10:13:46 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:13:44.232Z: Executing operation
> View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
> Â Â May 25, 2018 10:13:52 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:13:51.330Z: Executing operation
> View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
> Â Â May 25, 2018 10:13:52 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:13:51.423Z: Executing operation
> View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
> Â Â May 25, 2018 10:14:02 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:14:02.546Z: Executing operation
> View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
> Â Â May 25, 2018 10:14:02 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:14:02.763Z: Executing operation
> Create123/Read(CreateSource)+OutputSideInputs+PAssert$33/GroupGlobally/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write
> Â Â May 25, 2018 10:14:11 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:14:09.292Z: Executing operation
> PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Close
> Â Â May 25, 2018 10:14:11 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:14:09.391Z: Executing operation
> PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$33/GroupGlobally/RewindowActuals/Window.Assign+PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
> Â Â May 25, 2018 10:14:14 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:14:14.311Z: Executing operation
> PAssert$33/GroupGlobally/GroupDummyAndContents/Close
> Â Â May 25, 2018 10:14:14 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:14:14.396Z: Executing operation
> PAssert$33/GroupGlobally/GroupDummyAndContents/Read+PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$33/GroupGlobally/Values/Values/Map+PAssert$33/GroupGlobally/ParDo(Concat)+PAssert$33/GetPane/Map+PAssert$33/RunChecks+PAssert$33/VerifyAssertions/ParDo(DefaultConclude)
> Â Â May 25, 2018 10:14:20 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:14:18.765Z: Cleaning up.
> Â Â May 25, 2018 10:14:20 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:14:18.860Z: Stopping worker pool...
> Â Â May 25, 2018 10:15:49 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:15:47.896Z: Autoscaling: Resized worker pool
> from 1 to 0.
> Â Â May 25, 2018 10:15:49 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:15:47.938Z: Autoscaling: Would further reduce
> the number of workers but reached the minimum number allowed for the
> job.
> Â Â May 25, 2018 10:15:49 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:15:47.974Z: Worker pool stopped.
> Â Â May 25, 2018 10:15:57 AM
> org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
> Â Â INFO: Job 2018-05-25_03_12_22-14221036885415975375 finished with
> status DONE.
> Â Â May 25, 2018 10:15:57 AM
> org.apache.beam.runners.dataflow.TestDataflowRunner
> checkForPAssertSuccess
> Â Â INFO: Success result for Dataflow job
> 2018-05-25_03_12_22-14221036885415975375. Found 1 success, 0 failures
> out of 1 expected assertions.
>
> Gradle Test Executor 39 finished executing tests.
>
> > Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest
> FAILED
>
> 209 tests completed, 34 failed, 2 skipped
> Finished generating test XML results (0.584 secs) into:
> <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerTest>
> Generating HTML test report...
> Finished generating test html results (0.579 secs) into:
> <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest>
> :beam-runners-google-cloud-dataflow-java:validatesRunnerTest
> (Thread[Task worker for ':' Thread 9,5,main]) completed. Took 2 hrs 2
> mins 29.205 secs.
>
> FAILURE: Build failed with an exception.
>
> * What went wrong:
> Execution failed for task
> ':beam-runners-google-cloud-dataflow-java:validatesRunnerTest'.
> > There were failing tests. See the report at:
> file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest/index.html>
>
> * Try:
> Run with --stacktrace option to get the stack trace. Run with --debug
> option to get more log output. Run with --scan to get full insights.
>
> * Get more help at https://help.gradle.org
>
> Deprecated Gradle features were used in this build, making it
> incompatible with Gradle 5.0.
> See
> https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
>
> BUILD FAILED in 2h 3m 27s
> 38 actionable tasks: 34 executed, 4 from cache
>
> Publishing build scan...
> https://gradle.com/s/ibo6vmhiogj2s
>
> Build step 'Invoke Gradle script' changed build result to FAILURE
> Build step 'Invoke Gradle script' marked build as failure
> Recording test results
> Not sending mail to unregistered user apilloud@google.com
> <ma...@google.com>
> Not sending mail to unregistered user robbe.sneyders@ml6.eu
> <ma...@ml6.eu>
> Not sending mail to unregistered user github@alasdairhodge.co.uk
> <ma...@alasdairhodge.co.uk>
> Not sending mail to unregistered user schroederc@google.com
> <ma...@google.com>
> Not sending mail to unregistered user lukasz.gajowy@polidea.com
> <ma...@polidea.com>
> Not sending mail to unregistered user szewinho@gmail.com
> <ma...@gmail.com>
> Not sending mail to unregistered user ankurgoenka@gmail.com
> <ma...@gmail.com>
> Not sending mail to unregistered user ekirpichov@gmail.com
> <ma...@gmail.com>
> Not sending mail to unregistered user boyuanz@google.com
> <ma...@google.com>
> Not sending mail to unregistered user timrobertson100@gmail.com
> <ma...@gmail.com>
> Not sending mail to unregistered user
> yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
> <ma...@yifanzou-linuxworkstation.sea.corp.google.com>
> Not sending mail to unregistered user klk@google.com
> <ma...@google.com>
> Not sending mail to unregistered user sidhom@google.com
> <ma...@google.com>
>
Re: Build failed in Jenkins:
beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #344
Posted by "Matthias J. Sax" <ma...@confluent.io>.
Interesting.
>> So it looks like Jenkins found a user matthias@ml6.eu
>> <ma...@ml6.eu> (hence no line in the log) and then sent mail
>> to you. In the case of build 288 you are the only recipient of mail and
But the mail address is completely different -- where does Jenkins get
my address from?
-Matthias
On 5/25/18 9:30 AM, Kenneth Knowles wrote:
> Possibly a red herring, but in both that build
> and https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/323/display/redirect?page=changes
> there are commits by:
>
> Â Â Author: Matthias Feys <matthias@ml6.eu <ma...@ml6.eu>>
>
> And then in the logs you see
>
> Â Â Recording test results
>   Not sending mail to unregistered user axelmagn@gmail.com
> <ma...@gmail.com>
>   Not sending mail to unregistered user github@alasdairhodge.co.uk
> <ma...@alasdairhodge.co.uk>
>   Not sending mail to unregistered user kedin@google.com
> <ma...@google.com>
>
> So it looks like Jenkins found a user matthias@ml6.eu
> <ma...@ml6.eu> (hence no line in the log) and then sent mail
> to you. In the case of build 288 you are the only recipient of mail and
> also that's the only commit where Jenkins didn't complain about an
> unregistered user.
>
> Kenn
>
> On Fri, May 25, 2018 at 9:17 AM Kenneth Knowles <klk@google.com
> <ma...@google.com>> wrote:
>
> Taking a look, I track this to May 17:
> https://builds.apache.org/blue/organizations/jenkins/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/detail/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/288/changes/
>
> As far as I can tell, you've got no commits in our logs nor any
> reference in our codebase or Jenkins job definitions.
>
> Kenn
>
> On Fri, May 25, 2018 at 8:43 AM Matthias J. Sax
> <matthias@confluent.io <ma...@confluent.io>> wrote:
>
> Hi Beam folks,
>
> couple of days ago I started to receive emails from your Jenkins
> build
> (forwarding one of the received emails). I am not sure why...
> It's quite
> annoying and I would appreciate your help to get rid of them.
>
> Hope you can help me out.
>
> Thanks a lot.
>
>
> -Matthias
>
>
> -------- Forwarded Message --------
> Subject: Build failed in Jenkins:
> beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #344
> Date: Fri, 25 May 2018 10:16:06 +0000 (UTC)
> From: Apache Jenkins Server <jenkins@builds.apache.org
> <ma...@builds.apache.org>>
> To: commits@beam.apache.org <ma...@beam.apache.org>,
> matthias@confluent.io <ma...@confluent.io>,
> robertwb@gmail.com <ma...@gmail.com>,
> iemejia@gmail.com <ma...@gmail.com>, lcwik@google.com
> <ma...@google.com>, tgroh@google.com
> <ma...@google.com>
>
> See
> <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/344/display/redirect?page=changes>
>
> Changes:
>
> [iemejia] Fix broken build (again third time this week yay!)
>
> ------------------------------------------
> [...truncated 18.05 MB...]
> Â Â INFO: Adding
> PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
> as
> step s15
> Â Â May 25, 2018 10:12:22 AM
> org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator
> addStep
> Â Â INFO: Adding
> PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey as
> step s16
> Â Â May 25, 2018 10:12:22 AM
> org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator
> addStep
> Â Â INFO: Adding
> PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map as
> step s17
> Â Â May 25, 2018 10:12:22 AM
> org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator
> addStep
> Â Â INFO: Adding
> PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
> as step s18
> Â Â May 25, 2018 10:12:22 AM
> org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator
> addStep
> Â Â INFO: Adding PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map as
> step s19
> Â Â May 25, 2018 10:12:22 AM
> org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator
> addStep
> Â Â INFO: Adding
> PAssert$33/GroupGlobally/RemoveActualsTriggering/Flatten.PCollections
> as
> step s20
> Â Â May 25, 2018 10:12:22 AM
> org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator
> addStep
> Â Â INFO: Adding
> PAssert$33/GroupGlobally/Create.Values/Read(CreateSource) as
> step s21
> Â Â May 25, 2018 10:12:22 AM
> org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator
> addStep
> Â Â INFO: Adding
> PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
> as step s22
> Â Â May 25, 2018 10:12:22 AM
> org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator
> addStep
> Â Â INFO: Adding
> PAssert$33/GroupGlobally/RemoveDummyTriggering/Flatten.PCollections
> as
> step s23
> Â Â May 25, 2018 10:12:22 AM
> org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator
> addStep
> Â Â INFO: Adding PAssert$33/GroupGlobally/FlattenDummyAndContents as
> step s24
> Â Â May 25, 2018 10:12:22 AM
> org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator
> addStep
> Â Â INFO: Adding
> PAssert$33/GroupGlobally/NeverTrigger/Flatten.PCollections as
> step s25
> Â Â May 25, 2018 10:12:22 AM
> org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator
> addStep
> Â Â INFO: Adding PAssert$33/GroupGlobally/GroupDummyAndContents
> as step s26
> Â Â May 25, 2018 10:12:22 AM
> org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator
> addStep
> Â Â INFO: Adding PAssert$33/GroupGlobally/Values/Values/Map as
> step s27
> Â Â May 25, 2018 10:12:22 AM
> org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator
> addStep
> Â Â INFO: Adding PAssert$33/GroupGlobally/ParDo(Concat) as step s28
> Â Â May 25, 2018 10:12:22 AM
> org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator
> addStep
> Â Â INFO: Adding PAssert$33/GetPane/Map as step s29
> Â Â May 25, 2018 10:12:22 AM
> org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator
> addStep
> Â Â INFO: Adding PAssert$33/RunChecks as step s30
> Â Â May 25, 2018 10:12:22 AM
> org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator
> addStep
> Â Â INFO: Adding
> PAssert$33/VerifyAssertions/ParDo(DefaultConclude) as
> step s31
> Â Â May 25, 2018 10:12:22 AM
> org.apache.beam.runners.dataflow.DataflowRunner run
> Â Â INFO: Staging pipeline description to
> gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0525101218-9da8b226/output/results/staging/
> Â Â May 25, 2018 10:12:22 AM
> org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
> Â Â INFO: Uploading <71120 bytes, hash SiX30c8DyZkuiGKKPnDqxQ> to
> gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0525101218-9da8b226/output/results/staging/pipeline-SiX30c8DyZkuiGKKPnDqxQ.pb
>
> org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput
> STANDARD_OUT
> Â Â Dataflow SDK version: 2.5.0-SNAPSHOT
>
> org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput
> STANDARD_ERROR
> Â Â May 25, 2018 10:12:23 AM
> org.apache.beam.runners.dataflow.DataflowRunner run
> Â Â INFO: To access the Dataflow monitoring console, please
> navigate to
> https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-05-25_03_12_22-14221036885415975375?project=apache-beam-testing
>
> org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput
> STANDARD_OUT
> Â Â Submitted job: 2018-05-25_03_12_22-14221036885415975375
>
> org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput
> STANDARD_ERROR
> Â Â May 25, 2018 10:12:23 AM
> org.apache.beam.runners.dataflow.DataflowRunner run
> Â Â INFO: To cancel the job using the 'gcloud' tool, run:
> Â Â > gcloud dataflow jobs --project=apache-beam-testing cancel
> --region=us-central1 2018-05-25_03_12_22-14221036885415975375
> Â Â May 25, 2018 10:12:23 AM
> org.apache.beam.runners.dataflow.TestDataflowRunner run
> Â Â INFO: Running Dataflow job
> 2018-05-25_03_12_22-14221036885415975375
> with 1 expected assertions.
> Â Â May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:12:22.725Z: Autoscaling is enabled for job
> 2018-05-25_03_12_22-14221036885415975375. The number of workers
> will be
> between 1 and 1000.
> Â Â May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:12:22.768Z: Autoscaling was automatically
> enabled for job 2018-05-25_03_12_22-14221036885415975375.
> Â Â May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:12:25.613Z: Checking required Cloud APIs are
> enabled.
> Â Â May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:12:25.746Z: Checking permissions granted to
> controller Service Account.
> Â Â May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:12:30.129Z: Worker configuration:
> n1-standard-1
> in us-central1-b.
> Â Â May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:12:30.537Z: Expanding CoGroupByKey
> operations
> into optimizable parts.
> Â Â May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:12:30.685Z: Expanding GroupByKey
> operations into
> optimizable parts.
> Â Â May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:12:30.724Z: Lifting ValueCombiningMappingFns
> into MergeBucketsMappingFns
> Â Â May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:12:30.953Z: Fusing adjacent ParDo, Read,
> Write,
> and Flatten operations
> Â Â May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
>   INFO: 2018-05-25T10:12:31.000Z: Elided trivial flatten Â
> Â May 25,
> 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
>   INFO: 2018-05-25T10:12:31.028Z: Elided trivial flatten Â
> Â May 25,
> 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
>   INFO: 2018-05-25T10:12:31.072Z: Elided trivial flatten Â
> Â May 25,
> 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:12:31.118Z: Unzipping flatten s24 for input
> s19.org.apache.beam.sdk.values.PCollection.<init>:329#8fd0f908e3ea90e3
> Â Â May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:12:31.164Z: Fusing unzipped copy of
> PAssert$33/GroupGlobally/GroupDummyAndContents/Reify, through
> flatten
> PAssert$33/GroupGlobally/FlattenDummyAndContents, into producer
> PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map
> Â Â May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:12:31.211Z: Fusing consumer
> PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow into
> PAssert$33/GroupGlobally/GroupDummyAndContents/Read
> Â Â May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:12:31.259Z: Fusing consumer
> PAssert$33/GroupGlobally/ParDo(Concat) into
> PAssert$33/GroupGlobally/Values/Values/Map
> Â Â May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:12:31.308Z: Fusing consumer
> PAssert$33/GetPane/Map into PAssert$33/GroupGlobally/ParDo(Concat)
> Â Â May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:12:31.354Z: Fusing consumer
> PAssert$33/GroupGlobally/Values/Values/Map into
> PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow
> Â Â May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:12:31.403Z: Fusing consumer
> PAssert$33/RunChecks
> into PAssert$33/GetPane/Map
> Â Â May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:12:31.447Z: Fusing consumer
> PAssert$33/VerifyAssertions/ParDo(DefaultConclude) into
> PAssert$33/RunChecks
> Â Â May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:12:31.487Z: Unzipping flatten s24-u45
> for input
> s26-reify-value18-c43
> Â Â May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:12:31.529Z: Fusing unzipped copy of
> PAssert$33/GroupGlobally/GroupDummyAndContents/Write, through
> flatten
> s24-u45, into producer
> PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
> Â Â May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:12:31.567Z: Fusing consumer
> PAssert$33/GroupGlobally/GroupDummyAndContents/Reify into
> PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
> Â Â May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:12:31.602Z: Fusing consumer
> PAssert$33/GroupGlobally/GroupDummyAndContents/Write into
> PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
> Â Â May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:12:31.641Z: Fusing consumer
> PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign into
> PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)
> Â Â May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:12:31.683Z: Fusing consumer
> PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into
> PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
> Â Â May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:12:31.724Z: Fusing consumer
> PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write into
> PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
> Â Â May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:12:31.771Z: Fusing consumer
> PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
> into PAssert$33/GroupGlobally/Window.Into()/Window.Assign
> Â Â May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:12:31.817Z: Fusing consumer OutputSideInputs
> into Create123/Read(CreateSource)
> Â Â May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:12:31.856Z: Fusing consumer
> PAssert$33/GroupGlobally/Window.Into()/Window.Assign into
> OutputSideInputs
> Â Â May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:12:31.893Z: Fusing consumer
> PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map into
> PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
> Â Â May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:12:31.925Z: Fusing consumer
> PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map into
> PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
> Â Â May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:12:31.971Z: Fusing consumer
> PAssert$33/GroupGlobally/RewindowActuals/Window.Assign into
> PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map
> Â Â May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:12:32.018Z: Fusing consumer
> PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
> into
> PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read
> Â Â May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:12:32.070Z: Fusing consumer
> PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into
> PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
> Â Â May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:12:32.116Z: Fusing consumer
> PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
> into PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
> Â Â May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:12:32.150Z: Fusing consumer
> View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
> into
> View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
> Â Â May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:12:32.196Z: Fusing consumer
> View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
> into
> View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
> Â Â May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:12:32.239Z: Fusing consumer
> View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
> into
> View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
> Â Â May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:12:32.285Z: Fusing consumer
> View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
> into Create47/Read(CreateSource)
> Â Â May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:12:32.330Z: Fusing consumer
> View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
> into
> View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
> Â Â May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:12:32.376Z: Fusing consumer
> View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
> into
> View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
> Â Â May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:12:32.421Z: Fusing consumer
> View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
> into
> View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
> Â Â May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:12:32.465Z: Fusing consumer
> View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
> into
> View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
> Â Â May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:12:32.496Z: Fusing consumer
> View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
> into
> View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
> Â Â May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:12:32.538Z: Fusing consumer
> View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
> into
> View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
> Â Â May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:12:32.998Z: Executing operation
> PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Create
> Â Â May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:12:33.036Z: Executing operation
> PAssert$33/GroupGlobally/GroupDummyAndContents/Create
> Â Â May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:12:33.070Z: Executing operation
> View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
> Â Â May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:12:33.094Z: Starting 1 workers in
> us-central1-b...
> Â Â May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:12:33.112Z: Executing operation
> View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
> Â Â May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:12:33.383Z: Executing operation
> Create47/Read(CreateSource)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
> Â Â May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:12:33.425Z: Executing operation
> PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
> Â Â May 25, 2018 10:12:43 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:12:43.365Z: Autoscaling: Raised the
> number of
> workers to 0 based on the rate of progress in the currently
> running step(s).
> Â Â May 25, 2018 10:12:59 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:12:59.310Z: Autoscaling: Raised the
> number of
> workers to 1 based on the rate of progress in the currently
> running step(s).
> Â Â May 25, 2018 10:12:59 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:12:59.357Z: Autoscaling: Would further
> reduce
> the number of workers but reached the minimum number allowed for
> the job.
> Â Â May 25, 2018 10:13:22 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:13:20.869Z: Workers have started
> successfully.
> Â Â May 25, 2018 10:13:44 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:13:44.141Z: Executing operation
> View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
> Â Â May 25, 2018 10:13:46 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:13:44.232Z: Executing operation
> View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
> Â Â May 25, 2018 10:13:52 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:13:51.330Z: Executing operation
> View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
> Â Â May 25, 2018 10:13:52 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:13:51.423Z: Executing operation
> View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
> Â Â May 25, 2018 10:14:02 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:14:02.546Z: Executing operation
> View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
> Â Â May 25, 2018 10:14:02 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:14:02.763Z: Executing operation
> Create123/Read(CreateSource)+OutputSideInputs+PAssert$33/GroupGlobally/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write
> Â Â May 25, 2018 10:14:11 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:14:09.292Z: Executing operation
> PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Close
> Â Â May 25, 2018 10:14:11 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:14:09.391Z: Executing operation
> PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$33/GroupGlobally/RewindowActuals/Window.Assign+PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
> Â Â May 25, 2018 10:14:14 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:14:14.311Z: Executing operation
> PAssert$33/GroupGlobally/GroupDummyAndContents/Close
> Â Â May 25, 2018 10:14:14 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:14:14.396Z: Executing operation
> PAssert$33/GroupGlobally/GroupDummyAndContents/Read+PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$33/GroupGlobally/Values/Values/Map+PAssert$33/GroupGlobally/ParDo(Concat)+PAssert$33/GetPane/Map+PAssert$33/RunChecks+PAssert$33/VerifyAssertions/ParDo(DefaultConclude)
> Â Â May 25, 2018 10:14:20 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:14:18.765Z: Cleaning up.
> Â Â May 25, 2018 10:14:20 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:14:18.860Z: Stopping worker pool...
> Â Â May 25, 2018 10:15:49 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:15:47.896Z: Autoscaling: Resized worker pool
> from 1 to 0.
> Â Â May 25, 2018 10:15:49 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:15:47.938Z: Autoscaling: Would further
> reduce
> the number of workers but reached the minimum number allowed for
> the job.
> Â Â May 25, 2018 10:15:49 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
> process
> Â Â INFO: 2018-05-25T10:15:47.974Z: Worker pool stopped.
> Â Â May 25, 2018 10:15:57 AM
> org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
> Â Â INFO: Job 2018-05-25_03_12_22-14221036885415975375 finished with
> status DONE.
> Â Â May 25, 2018 10:15:57 AM
> org.apache.beam.runners.dataflow.TestDataflowRunner
> checkForPAssertSuccess
> Â Â INFO: Success result for Dataflow job
> 2018-05-25_03_12_22-14221036885415975375. Found 1 success, 0
> failures
> out of 1 expected assertions.
>
> Gradle Test Executor 39 finished executing tests.
>
> > Task
> :beam-runners-google-cloud-dataflow-java:validatesRunnerTest FAILED
>
> 209 tests completed, 34 failed, 2 skipped
> Finished generating test XML results (0.584 secs) into:
> <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerTest>
> Generating HTML test report...
> Finished generating test html results (0.579 secs) into:
> <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest>
> :beam-runners-google-cloud-dataflow-java:validatesRunnerTest
> (Thread[Task worker for ':' Thread 9,5,main]) completed. Took 2
> hrs 2
> mins 29.205 secs.
>
> FAILURE: Build failed with an exception.
>
> * What went wrong:
> Execution failed for task
> ':beam-runners-google-cloud-dataflow-java:validatesRunnerTest'.
> > There were failing tests. See the report at:
> file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest/index.html>
>
> * Try:
> Run with --stacktrace option to get the stack trace. Run with
> --debug
> option to get more log output. Run with --scan to get full insights.
>
> * Get more help at https://help.gradle.org
>
> Deprecated Gradle features were used in this build, making it
> incompatible with Gradle 5.0.
> See
> https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
>
> BUILD FAILED in 2h 3m 27s
> 38 actionable tasks: 34 executed, 4 from cache
>
> Publishing build scan...
> https://gradle.com/s/ibo6vmhiogj2s
>
> Build step 'Invoke Gradle script' changed build result to FAILURE
> Build step 'Invoke Gradle script' marked build as failure
> Recording test results
> Not sending mail to unregistered user apilloud@google.com
> <ma...@google.com>
> Not sending mail to unregistered user robbe.sneyders@ml6.eu
> <ma...@ml6.eu>
> Not sending mail to unregistered user github@alasdairhodge.co.uk
> <ma...@alasdairhodge.co.uk>
> Not sending mail to unregistered user schroederc@google.com
> <ma...@google.com>
> Not sending mail to unregistered user lukasz.gajowy@polidea.com
> <ma...@polidea.com>
> Not sending mail to unregistered user szewinho@gmail.com
> <ma...@gmail.com>
> Not sending mail to unregistered user ankurgoenka@gmail.com
> <ma...@gmail.com>
> Not sending mail to unregistered user ekirpichov@gmail.com
> <ma...@gmail.com>
> Not sending mail to unregistered user boyuanz@google.com
> <ma...@google.com>
> Not sending mail to unregistered user timrobertson100@gmail.com
> <ma...@gmail.com>
> Not sending mail to unregistered user
> yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
> <ma...@yifanzou-linuxworkstation.sea.corp.google.com>
> Not sending mail to unregistered user klk@google.com
> <ma...@google.com>
> Not sending mail to unregistered user sidhom@google.com
> <ma...@google.com>
>
Re: Build failed in Jenkins: beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle
#344
Posted by Kenneth Knowles <kl...@google.com>.
Possibly a red herring, but in both that build and
https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/323/display/redirect?page=changes
there are commits by:
Author: Matthias Feys <ma...@ml6.eu>
And then in the logs you see
Recording test results
Not sending mail to unregistered user axelmagn@gmail.com
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user kedin@google.com
So it looks like Jenkins found a user matthias@ml6.eu (hence no line in the
log) and then sent mail to you. In the case of build 288 you are the only
recipient of mail and also that's the only commit where Jenkins didn't
complain about an unregistered user.
Kenn
On Fri, May 25, 2018 at 9:17 AM Kenneth Knowles <kl...@google.com> wrote:
> Taking a look, I track this to May 17:
> https://builds.apache.org/blue/organizations/jenkins/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/detail/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/288/changes/
>
> As far as I can tell, you've got no commits in our logs nor any reference
> in our codebase or Jenkins job definitions.
>
> Kenn
>
> On Fri, May 25, 2018 at 8:43 AM Matthias J. Sax <ma...@confluent.io>
> wrote:
>
>> Hi Beam folks,
>>
>> couple of days ago I started to receive emails from your Jenkins build
>> (forwarding one of the received emails). I am not sure why... It's quite
>> annoying and I would appreciate your help to get rid of them.
>>
>> Hope you can help me out.
>>
>> Thanks a lot.
>>
>>
>> -Matthias
>>
>>
>> -------- Forwarded Message --------
>> Subject: Build failed in Jenkins:
>> beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #344
>> Date: Fri, 25 May 2018 10:16:06 +0000 (UTC)
>> From: Apache Jenkins Server <je...@builds.apache.org>
>> To: commits@beam.apache.org, matthias@confluent.io, robertwb@gmail.com,
>> iemejia@gmail.com, lcwik@google.com, tgroh@google.com
>>
>> See
>> <
>> https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/344/display/redirect?page=changes
>> >
>>
>> Changes:
>>
>> [iemejia] Fix broken build (again third time this week yay!)
>>
>> ------------------------------------------
>> [...truncated 18.05 MB...]
>> INFO: Adding
>> PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign as
>> step s15
>> May 25, 2018 10:12:22 AM
>> org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator
>> addStep
>> INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey as
>> step s16
>> May 25, 2018 10:12:22 AM
>> org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator
>> addStep
>> INFO: Adding
>> PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map as step s17
>> May 25, 2018 10:12:22 AM
>> org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator
>> addStep
>> INFO: Adding PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
>> as step s18
>> May 25, 2018 10:12:22 AM
>> org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator
>> addStep
>> INFO: Adding PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map as
>> step s19
>> May 25, 2018 10:12:22 AM
>> org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator
>> addStep
>> INFO: Adding
>> PAssert$33/GroupGlobally/RemoveActualsTriggering/Flatten.PCollections as
>> step s20
>> May 25, 2018 10:12:22 AM
>> org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator
>> addStep
>> INFO: Adding
>> PAssert$33/GroupGlobally/Create.Values/Read(CreateSource) as step s21
>> May 25, 2018 10:12:22 AM
>> org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator
>> addStep
>> INFO: Adding PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
>> as step s22
>> May 25, 2018 10:12:22 AM
>> org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator
>> addStep
>> INFO: Adding
>> PAssert$33/GroupGlobally/RemoveDummyTriggering/Flatten.PCollections as
>> step s23
>> May 25, 2018 10:12:22 AM
>> org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator
>> addStep
>> INFO: Adding PAssert$33/GroupGlobally/FlattenDummyAndContents as
>> step s24
>> May 25, 2018 10:12:22 AM
>> org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator
>> addStep
>> INFO: Adding
>> PAssert$33/GroupGlobally/NeverTrigger/Flatten.PCollections as step s25
>> May 25, 2018 10:12:22 AM
>> org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator
>> addStep
>> INFO: Adding PAssert$33/GroupGlobally/GroupDummyAndContents as step
>> s26
>> May 25, 2018 10:12:22 AM
>> org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator
>> addStep
>> INFO: Adding PAssert$33/GroupGlobally/Values/Values/Map as step s27
>> May 25, 2018 10:12:22 AM
>> org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator
>> addStep
>> INFO: Adding PAssert$33/GroupGlobally/ParDo(Concat) as step s28
>> May 25, 2018 10:12:22 AM
>> org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator
>> addStep
>> INFO: Adding PAssert$33/GetPane/Map as step s29
>> May 25, 2018 10:12:22 AM
>> org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator
>> addStep
>> INFO: Adding PAssert$33/RunChecks as step s30
>> May 25, 2018 10:12:22 AM
>> org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator
>> addStep
>> INFO: Adding PAssert$33/VerifyAssertions/ParDo(DefaultConclude) as
>> step s31
>> May 25, 2018 10:12:22 AM
>> org.apache.beam.runners.dataflow.DataflowRunner run
>> INFO: Staging pipeline description to
>>
>> gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0525101218-9da8b226/output/results/staging/
>> May 25, 2018 10:12:22 AM
>> org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
>> INFO: Uploading <71120 bytes, hash SiX30c8DyZkuiGKKPnDqxQ> to
>>
>> gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0525101218-9da8b226/output/results/staging/pipeline-SiX30c8DyZkuiGKKPnDqxQ.pb
>>
>> org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput
>> STANDARD_OUT
>> Dataflow SDK version: 2.5.0-SNAPSHOT
>>
>> org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput
>> STANDARD_ERROR
>> May 25, 2018 10:12:23 AM
>> org.apache.beam.runners.dataflow.DataflowRunner run
>> INFO: To access the Dataflow monitoring console, please navigate to
>>
>> https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-05-25_03_12_22-14221036885415975375?project=apache-beam-testing
>>
>> org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput
>> STANDARD_OUT
>> Submitted job: 2018-05-25_03_12_22-14221036885415975375
>>
>> org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput
>> STANDARD_ERROR
>> May 25, 2018 10:12:23 AM
>> org.apache.beam.runners.dataflow.DataflowRunner run
>> INFO: To cancel the job using the 'gcloud' tool, run:
>> > gcloud dataflow jobs --project=apache-beam-testing cancel
>> --region=us-central1 2018-05-25_03_12_22-14221036885415975375
>> May 25, 2018 10:12:23 AM
>> org.apache.beam.runners.dataflow.TestDataflowRunner run
>> INFO: Running Dataflow job 2018-05-25_03_12_22-14221036885415975375
>> with 1 expected assertions.
>> May 25, 2018 10:12:38 AM
>> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
>> process
>> INFO: 2018-05-25T10:12:22.725Z: Autoscaling is enabled for job
>> 2018-05-25_03_12_22-14221036885415975375. The number of workers will be
>> between 1 and 1000.
>> May 25, 2018 10:12:38 AM
>> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
>> process
>> INFO: 2018-05-25T10:12:22.768Z: Autoscaling was automatically
>> enabled for job 2018-05-25_03_12_22-14221036885415975375.
>> May 25, 2018 10:12:38 AM
>> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
>> process
>> INFO: 2018-05-25T10:12:25.613Z: Checking required Cloud APIs are
>> enabled.
>> May 25, 2018 10:12:38 AM
>> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
>> process
>> INFO: 2018-05-25T10:12:25.746Z: Checking permissions granted to
>> controller Service Account.
>> May 25, 2018 10:12:38 AM
>> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
>> process
>> INFO: 2018-05-25T10:12:30.129Z: Worker configuration: n1-standard-1
>> in us-central1-b.
>> May 25, 2018 10:12:38 AM
>> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
>> process
>> INFO: 2018-05-25T10:12:30.537Z: Expanding CoGroupByKey operations
>> into optimizable parts.
>> May 25, 2018 10:12:38 AM
>> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
>> process
>> INFO: 2018-05-25T10:12:30.685Z: Expanding GroupByKey operations into
>> optimizable parts.
>> May 25, 2018 10:12:38 AM
>> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
>> process
>> INFO: 2018-05-25T10:12:30.724Z: Lifting ValueCombiningMappingFns
>> into MergeBucketsMappingFns
>> May 25, 2018 10:12:38 AM
>> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
>> process
>> INFO: 2018-05-25T10:12:30.953Z: Fusing adjacent ParDo, Read, Write,
>> and Flatten operations
>> May 25, 2018 10:12:38 AM
>> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
>> process
>> INFO: 2018-05-25T10:12:31.000Z: Elided trivial flatten May 25,
>> 2018 10:12:38 AM
>> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
>> process
>> INFO: 2018-05-25T10:12:31.028Z: Elided trivial flatten May 25,
>> 2018 10:12:38 AM
>> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
>> process
>> INFO: 2018-05-25T10:12:31.072Z: Elided trivial flatten May 25,
>> 2018 10:12:38 AM
>> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
>> process
>> INFO: 2018-05-25T10:12:31.118Z: Unzipping flatten s24 for input
>> s19.org.apache.beam.sdk.values.PCollection.<init>:329#8fd0f908e3ea90e3
>> May 25, 2018 10:12:38 AM
>> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
>> process
>> INFO: 2018-05-25T10:12:31.164Z: Fusing unzipped copy of
>> PAssert$33/GroupGlobally/GroupDummyAndContents/Reify, through flatten
>> PAssert$33/GroupGlobally/FlattenDummyAndContents, into producer
>> PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map
>> May 25, 2018 10:12:38 AM
>> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
>> process
>> INFO: 2018-05-25T10:12:31.211Z: Fusing consumer
>> PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow into
>> PAssert$33/GroupGlobally/GroupDummyAndContents/Read
>> May 25, 2018 10:12:38 AM
>> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
>> process
>> INFO: 2018-05-25T10:12:31.259Z: Fusing consumer
>> PAssert$33/GroupGlobally/ParDo(Concat) into
>> PAssert$33/GroupGlobally/Values/Values/Map
>> May 25, 2018 10:12:38 AM
>> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
>> process
>> INFO: 2018-05-25T10:12:31.308Z: Fusing consumer
>> PAssert$33/GetPane/Map into PAssert$33/GroupGlobally/ParDo(Concat)
>> May 25, 2018 10:12:38 AM
>> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
>> process
>> INFO: 2018-05-25T10:12:31.354Z: Fusing consumer
>> PAssert$33/GroupGlobally/Values/Values/Map into
>> PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow
>> May 25, 2018 10:12:38 AM
>> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
>> process
>> INFO: 2018-05-25T10:12:31.403Z: Fusing consumer PAssert$33/RunChecks
>> into PAssert$33/GetPane/Map
>> May 25, 2018 10:12:38 AM
>> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
>> process
>> INFO: 2018-05-25T10:12:31.447Z: Fusing consumer
>> PAssert$33/VerifyAssertions/ParDo(DefaultConclude) into
>> PAssert$33/RunChecks
>> May 25, 2018 10:12:38 AM
>> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
>> process
>> INFO: 2018-05-25T10:12:31.487Z: Unzipping flatten s24-u45 for input
>> s26-reify-value18-c43
>> May 25, 2018 10:12:38 AM
>> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
>> process
>> INFO: 2018-05-25T10:12:31.529Z: Fusing unzipped copy of
>> PAssert$33/GroupGlobally/GroupDummyAndContents/Write, through flatten
>> s24-u45, into producer
>> PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
>> May 25, 2018 10:12:38 AM
>> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
>> process
>> INFO: 2018-05-25T10:12:31.567Z: Fusing consumer
>> PAssert$33/GroupGlobally/GroupDummyAndContents/Reify into
>> PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
>> May 25, 2018 10:12:38 AM
>> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
>> process
>> INFO: 2018-05-25T10:12:31.602Z: Fusing consumer
>> PAssert$33/GroupGlobally/GroupDummyAndContents/Write into
>> PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
>> May 25, 2018 10:12:38 AM
>> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
>> process
>> INFO: 2018-05-25T10:12:31.641Z: Fusing consumer
>> PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign into
>> PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)
>> May 25, 2018 10:12:38 AM
>> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
>> process
>> INFO: 2018-05-25T10:12:31.683Z: Fusing consumer
>> PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into
>> PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
>> May 25, 2018 10:12:38 AM
>> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
>> process
>> INFO: 2018-05-25T10:12:31.724Z: Fusing consumer
>> PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write into
>> PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
>> May 25, 2018 10:12:38 AM
>> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
>> process
>> INFO: 2018-05-25T10:12:31.771Z: Fusing consumer
>> PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
>> into PAssert$33/GroupGlobally/Window.Into()/Window.Assign
>> May 25, 2018 10:12:38 AM
>> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
>> process
>> INFO: 2018-05-25T10:12:31.817Z: Fusing consumer OutputSideInputs
>> into Create123/Read(CreateSource)
>> May 25, 2018 10:12:38 AM
>> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
>> process
>> INFO: 2018-05-25T10:12:31.856Z: Fusing consumer
>> PAssert$33/GroupGlobally/Window.Into()/Window.Assign into OutputSideInputs
>> May 25, 2018 10:12:38 AM
>> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
>> process
>> INFO: 2018-05-25T10:12:31.893Z: Fusing consumer
>> PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map into
>> PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
>> May 25, 2018 10:12:38 AM
>> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
>> process
>> INFO: 2018-05-25T10:12:31.925Z: Fusing consumer
>> PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map into
>> PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
>> May 25, 2018 10:12:38 AM
>> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
>> process
>> INFO: 2018-05-25T10:12:31.971Z: Fusing consumer
>> PAssert$33/GroupGlobally/RewindowActuals/Window.Assign into
>> PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map
>> May 25, 2018 10:12:38 AM
>> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
>> process
>> INFO: 2018-05-25T10:12:32.018Z: Fusing consumer
>> PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into
>> PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read
>> May 25, 2018 10:12:38 AM
>> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
>> process
>> INFO: 2018-05-25T10:12:32.070Z: Fusing consumer
>> PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into
>> PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
>> May 25, 2018 10:12:38 AM
>> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
>> process
>> INFO: 2018-05-25T10:12:32.116Z: Fusing consumer
>> PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
>> into PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
>> May 25, 2018 10:12:38 AM
>> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
>> process
>> INFO: 2018-05-25T10:12:32.150Z: Fusing consumer
>>
>> View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
>> into
>>
>> View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
>> May 25, 2018 10:12:38 AM
>> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
>> process
>> INFO: 2018-05-25T10:12:32.196Z: Fusing consumer
>>
>> View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
>> into
>>
>> View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
>> May 25, 2018 10:12:38 AM
>> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
>> process
>> INFO: 2018-05-25T10:12:32.239Z: Fusing consumer
>>
>> View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
>> into
>>
>> View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
>> May 25, 2018 10:12:38 AM
>> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
>> process
>> INFO: 2018-05-25T10:12:32.285Z: Fusing consumer
>>
>> View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
>> into Create47/Read(CreateSource)
>> May 25, 2018 10:12:38 AM
>> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
>> process
>> INFO: 2018-05-25T10:12:32.330Z: Fusing consumer
>>
>> View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
>> into
>>
>> View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
>> May 25, 2018 10:12:38 AM
>> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
>> process
>> INFO: 2018-05-25T10:12:32.376Z: Fusing consumer
>>
>> View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
>> into
>>
>> View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
>> May 25, 2018 10:12:38 AM
>> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
>> process
>> INFO: 2018-05-25T10:12:32.421Z: Fusing consumer
>>
>> View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
>> into
>>
>> View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
>> May 25, 2018 10:12:38 AM
>> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
>> process
>> INFO: 2018-05-25T10:12:32.465Z: Fusing consumer
>>
>> View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
>> into
>>
>> View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
>> May 25, 2018 10:12:38 AM
>> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
>> process
>> INFO: 2018-05-25T10:12:32.496Z: Fusing consumer
>>
>> View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
>> into
>>
>> View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
>> May 25, 2018 10:12:38 AM
>> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
>> process
>> INFO: 2018-05-25T10:12:32.538Z: Fusing consumer
>>
>> View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
>> into
>>
>> View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
>> May 25, 2018 10:12:38 AM
>> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
>> process
>> INFO: 2018-05-25T10:12:32.998Z: Executing operation
>> PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Create
>> May 25, 2018 10:12:38 AM
>> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
>> process
>> INFO: 2018-05-25T10:12:33.036Z: Executing operation
>> PAssert$33/GroupGlobally/GroupDummyAndContents/Create
>> May 25, 2018 10:12:38 AM
>> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
>> process
>> INFO: 2018-05-25T10:12:33.070Z: Executing operation
>>
>> View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
>> May 25, 2018 10:12:38 AM
>> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
>> process
>> INFO: 2018-05-25T10:12:33.094Z: Starting 1 workers in us-central1-b...
>> May 25, 2018 10:12:38 AM
>> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
>> process
>> INFO: 2018-05-25T10:12:33.112Z: Executing operation
>>
>> View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
>> May 25, 2018 10:12:38 AM
>> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
>> process
>> INFO: 2018-05-25T10:12:33.383Z: Executing operation
>>
>> Create47/Read(CreateSource)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
>> May 25, 2018 10:12:38 AM
>> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
>> process
>> INFO: 2018-05-25T10:12:33.425Z: Executing operation
>>
>> PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
>> May 25, 2018 10:12:43 AM
>> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
>> process
>> INFO: 2018-05-25T10:12:43.365Z: Autoscaling: Raised the number of
>> workers to 0 based on the rate of progress in the currently running
>> step(s).
>> May 25, 2018 10:12:59 AM
>> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
>> process
>> INFO: 2018-05-25T10:12:59.310Z: Autoscaling: Raised the number of
>> workers to 1 based on the rate of progress in the currently running
>> step(s).
>> May 25, 2018 10:12:59 AM
>> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
>> process
>> INFO: 2018-05-25T10:12:59.357Z: Autoscaling: Would further reduce
>> the number of workers but reached the minimum number allowed for the job.
>> May 25, 2018 10:13:22 AM
>> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
>> process
>> INFO: 2018-05-25T10:13:20.869Z: Workers have started successfully.
>> May 25, 2018 10:13:44 AM
>> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
>> process
>> INFO: 2018-05-25T10:13:44.141Z: Executing operation
>>
>> View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
>> May 25, 2018 10:13:46 AM
>> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
>> process
>> INFO: 2018-05-25T10:13:44.232Z: Executing operation
>>
>> View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
>> May 25, 2018 10:13:52 AM
>> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
>> process
>> INFO: 2018-05-25T10:13:51.330Z: Executing operation
>>
>> View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
>> May 25, 2018 10:13:52 AM
>> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
>> process
>> INFO: 2018-05-25T10:13:51.423Z: Executing operation
>>
>> View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
>> May 25, 2018 10:14:02 AM
>> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
>> process
>> INFO: 2018-05-25T10:14:02.546Z: Executing operation
>> View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
>> May 25, 2018 10:14:02 AM
>> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
>> process
>> INFO: 2018-05-25T10:14:02.763Z: Executing operation
>>
>> Create123/Read(CreateSource)+OutputSideInputs+PAssert$33/GroupGlobally/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write
>> May 25, 2018 10:14:11 AM
>> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
>> process
>> INFO: 2018-05-25T10:14:09.292Z: Executing operation
>> PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Close
>> May 25, 2018 10:14:11 AM
>> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
>> process
>> INFO: 2018-05-25T10:14:09.391Z: Executing operation
>>
>> PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$33/GroupGlobally/RewindowActuals/Window.Assign+PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
>> May 25, 2018 10:14:14 AM
>> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
>> process
>> INFO: 2018-05-25T10:14:14.311Z: Executing operation
>> PAssert$33/GroupGlobally/GroupDummyAndContents/Close
>> May 25, 2018 10:14:14 AM
>> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
>> process
>> INFO: 2018-05-25T10:14:14.396Z: Executing operation
>>
>> PAssert$33/GroupGlobally/GroupDummyAndContents/Read+PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$33/GroupGlobally/Values/Values/Map+PAssert$33/GroupGlobally/ParDo(Concat)+PAssert$33/GetPane/Map+PAssert$33/RunChecks+PAssert$33/VerifyAssertions/ParDo(DefaultConclude)
>> May 25, 2018 10:14:20 AM
>> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
>> process
>> INFO: 2018-05-25T10:14:18.765Z: Cleaning up.
>> May 25, 2018 10:14:20 AM
>> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
>> process
>> INFO: 2018-05-25T10:14:18.860Z: Stopping worker pool...
>> May 25, 2018 10:15:49 AM
>> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
>> process
>> INFO: 2018-05-25T10:15:47.896Z: Autoscaling: Resized worker pool
>> from 1 to 0.
>> May 25, 2018 10:15:49 AM
>> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
>> process
>> INFO: 2018-05-25T10:15:47.938Z: Autoscaling: Would further reduce
>> the number of workers but reached the minimum number allowed for the job.
>> May 25, 2018 10:15:49 AM
>> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler
>> process
>> INFO: 2018-05-25T10:15:47.974Z: Worker pool stopped.
>> May 25, 2018 10:15:57 AM
>> org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
>> INFO: Job 2018-05-25_03_12_22-14221036885415975375 finished with
>> status DONE.
>> May 25, 2018 10:15:57 AM
>> org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
>> INFO: Success result for Dataflow job
>> 2018-05-25_03_12_22-14221036885415975375. Found 1 success, 0 failures
>> out of 1 expected assertions.
>>
>> Gradle Test Executor 39 finished executing tests.
>>
>> > Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest FAILED
>>
>> 209 tests completed, 34 failed, 2 skipped
>> Finished generating test XML results (0.584 secs) into:
>> <
>> https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerTest
>> >
>> Generating HTML test report...
>> Finished generating test html results (0.579 secs) into:
>> <
>> https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest
>> >
>> :beam-runners-google-cloud-dataflow-java:validatesRunnerTest
>> (Thread[Task worker for ':' Thread 9,5,main]) completed. Took 2 hrs 2
>> mins 29.205 secs.
>>
>> FAILURE: Build failed with an exception.
>>
>> * What went wrong:
>> Execution failed for task
>> ':beam-runners-google-cloud-dataflow-java:validatesRunnerTest'.
>> > There were failing tests. See the report at: file://<
>> https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest/index.html
>> >
>>
>> * Try:
>> Run with --stacktrace option to get the stack trace. Run with --debug
>> option to get more log output. Run with --scan to get full insights.
>>
>> * Get more help at https://help.gradle.org
>>
>> Deprecated Gradle features were used in this build, making it
>> incompatible with Gradle 5.0.
>> See
>>
>> https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
>>
>> BUILD FAILED in 2h 3m 27s
>> 38 actionable tasks: 34 executed, 4 from cache
>>
>> Publishing build scan...
>> https://gradle.com/s/ibo6vmhiogj2s
>>
>> Build step 'Invoke Gradle script' changed build result to FAILURE
>> Build step 'Invoke Gradle script' marked build as failure
>> Recording test results
>> Not sending mail to unregistered user apilloud@google.com
>> Not sending mail to unregistered user robbe.sneyders@ml6.eu
>> Not sending mail to unregistered user github@alasdairhodge.co.uk
>> Not sending mail to unregistered user schroederc@google.com
>> Not sending mail to unregistered user lukasz.gajowy@polidea.com
>> Not sending mail to unregistered user szewinho@gmail.com
>> Not sending mail to unregistered user ankurgoenka@gmail.com
>> Not sending mail to unregistered user ekirpichov@gmail.com
>> Not sending mail to unregistered user boyuanz@google.com
>> Not sending mail to unregistered user timrobertson100@gmail.com
>> Not sending mail to unregistered user
>> yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
>> Not sending mail to unregistered user klk@google.com
>> Not sending mail to unregistered user sidhom@google.com
>>
>>
Re: Build failed in Jenkins: beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle
#344
Posted by Kenneth Knowles <kl...@google.com>.
Taking a look, I track this to May 17:
https://builds.apache.org/blue/organizations/jenkins/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/detail/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/288/changes/
As far as I can tell, you've got no commits in our logs nor any reference
in our codebase or Jenkins job definitions.
Kenn
On Fri, May 25, 2018 at 8:43 AM Matthias J. Sax <ma...@confluent.io>
wrote:
> Hi Beam folks,
>
> couple of days ago I started to receive emails from your Jenkins build
> (forwarding one of the received emails). I am not sure why... It's quite
> annoying and I would appreciate your help to get rid of them.
>
> Hope you can help me out.
>
> Thanks a lot.
>
>
> -Matthias
>
>
> -------- Forwarded Message --------
> Subject: Build failed in Jenkins:
> beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #344
> Date: Fri, 25 May 2018 10:16:06 +0000 (UTC)
> From: Apache Jenkins Server <je...@builds.apache.org>
> To: commits@beam.apache.org, matthias@confluent.io, robertwb@gmail.com,
> iemejia@gmail.com, lcwik@google.com, tgroh@google.com
>
> See
> <
> https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/344/display/redirect?page=changes
> >
>
> Changes:
>
> [iemejia] Fix broken build (again third time this week yay!)
>
> ------------------------------------------
> [...truncated 18.05 MB...]
> INFO: Adding
> PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign as
> step s15
> May 25, 2018 10:12:22 AM
> org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator
> addStep
> INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey as
> step s16
> May 25, 2018 10:12:22 AM
> org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator
> addStep
> INFO: Adding
> PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map as step s17
> May 25, 2018 10:12:22 AM
> org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator
> addStep
> INFO: Adding PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
> as step s18
> May 25, 2018 10:12:22 AM
> org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator
> addStep
> INFO: Adding PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map as
> step s19
> May 25, 2018 10:12:22 AM
> org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator
> addStep
> INFO: Adding
> PAssert$33/GroupGlobally/RemoveActualsTriggering/Flatten.PCollections as
> step s20
> May 25, 2018 10:12:22 AM
> org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator
> addStep
> INFO: Adding
> PAssert$33/GroupGlobally/Create.Values/Read(CreateSource) as step s21
> May 25, 2018 10:12:22 AM
> org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator
> addStep
> INFO: Adding PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
> as step s22
> May 25, 2018 10:12:22 AM
> org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator
> addStep
> INFO: Adding
> PAssert$33/GroupGlobally/RemoveDummyTriggering/Flatten.PCollections as
> step s23
> May 25, 2018 10:12:22 AM
> org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator
> addStep
> INFO: Adding PAssert$33/GroupGlobally/FlattenDummyAndContents as
> step s24
> May 25, 2018 10:12:22 AM
> org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator
> addStep
> INFO: Adding
> PAssert$33/GroupGlobally/NeverTrigger/Flatten.PCollections as step s25
> May 25, 2018 10:12:22 AM
> org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator
> addStep
> INFO: Adding PAssert$33/GroupGlobally/GroupDummyAndContents as step s26
> May 25, 2018 10:12:22 AM
> org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator
> addStep
> INFO: Adding PAssert$33/GroupGlobally/Values/Values/Map as step s27
> May 25, 2018 10:12:22 AM
> org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator
> addStep
> INFO: Adding PAssert$33/GroupGlobally/ParDo(Concat) as step s28
> May 25, 2018 10:12:22 AM
> org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator
> addStep
> INFO: Adding PAssert$33/GetPane/Map as step s29
> May 25, 2018 10:12:22 AM
> org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator
> addStep
> INFO: Adding PAssert$33/RunChecks as step s30
> May 25, 2018 10:12:22 AM
> org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator
> addStep
> INFO: Adding PAssert$33/VerifyAssertions/ParDo(DefaultConclude) as
> step s31
> May 25, 2018 10:12:22 AM
> org.apache.beam.runners.dataflow.DataflowRunner run
> INFO: Staging pipeline description to
>
> gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0525101218-9da8b226/output/results/staging/
> May 25, 2018 10:12:22 AM
> org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
> INFO: Uploading <71120 bytes, hash SiX30c8DyZkuiGKKPnDqxQ> to
>
> gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0525101218-9da8b226/output/results/staging/pipeline-SiX30c8DyZkuiGKKPnDqxQ.pb
>
> org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput
> STANDARD_OUT
> Dataflow SDK version: 2.5.0-SNAPSHOT
>
> org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput
> STANDARD_ERROR
> May 25, 2018 10:12:23 AM
> org.apache.beam.runners.dataflow.DataflowRunner run
> INFO: To access the Dataflow monitoring console, please navigate to
>
> https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-05-25_03_12_22-14221036885415975375?project=apache-beam-testing
>
> org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput
> STANDARD_OUT
> Submitted job: 2018-05-25_03_12_22-14221036885415975375
>
> org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput
> STANDARD_ERROR
> May 25, 2018 10:12:23 AM
> org.apache.beam.runners.dataflow.DataflowRunner run
> INFO: To cancel the job using the 'gcloud' tool, run:
> > gcloud dataflow jobs --project=apache-beam-testing cancel
> --region=us-central1 2018-05-25_03_12_22-14221036885415975375
> May 25, 2018 10:12:23 AM
> org.apache.beam.runners.dataflow.TestDataflowRunner run
> INFO: Running Dataflow job 2018-05-25_03_12_22-14221036885415975375
> with 1 expected assertions.
> May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
> INFO: 2018-05-25T10:12:22.725Z: Autoscaling is enabled for job
> 2018-05-25_03_12_22-14221036885415975375. The number of workers will be
> between 1 and 1000.
> May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
> INFO: 2018-05-25T10:12:22.768Z: Autoscaling was automatically
> enabled for job 2018-05-25_03_12_22-14221036885415975375.
> May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
> INFO: 2018-05-25T10:12:25.613Z: Checking required Cloud APIs are
> enabled.
> May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
> INFO: 2018-05-25T10:12:25.746Z: Checking permissions granted to
> controller Service Account.
> May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
> INFO: 2018-05-25T10:12:30.129Z: Worker configuration: n1-standard-1
> in us-central1-b.
> May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
> INFO: 2018-05-25T10:12:30.537Z: Expanding CoGroupByKey operations
> into optimizable parts.
> May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
> INFO: 2018-05-25T10:12:30.685Z: Expanding GroupByKey operations into
> optimizable parts.
> May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
> INFO: 2018-05-25T10:12:30.724Z: Lifting ValueCombiningMappingFns
> into MergeBucketsMappingFns
> May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
> INFO: 2018-05-25T10:12:30.953Z: Fusing adjacent ParDo, Read, Write,
> and Flatten operations
> May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
> INFO: 2018-05-25T10:12:31.000Z: Elided trivial flatten May 25,
> 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
> INFO: 2018-05-25T10:12:31.028Z: Elided trivial flatten May 25,
> 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
> INFO: 2018-05-25T10:12:31.072Z: Elided trivial flatten May 25,
> 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
> INFO: 2018-05-25T10:12:31.118Z: Unzipping flatten s24 for input
> s19.org.apache.beam.sdk.values.PCollection.<init>:329#8fd0f908e3ea90e3
> May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
> INFO: 2018-05-25T10:12:31.164Z: Fusing unzipped copy of
> PAssert$33/GroupGlobally/GroupDummyAndContents/Reify, through flatten
> PAssert$33/GroupGlobally/FlattenDummyAndContents, into producer
> PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map
> May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
> INFO: 2018-05-25T10:12:31.211Z: Fusing consumer
> PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow into
> PAssert$33/GroupGlobally/GroupDummyAndContents/Read
> May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
> INFO: 2018-05-25T10:12:31.259Z: Fusing consumer
> PAssert$33/GroupGlobally/ParDo(Concat) into
> PAssert$33/GroupGlobally/Values/Values/Map
> May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
> INFO: 2018-05-25T10:12:31.308Z: Fusing consumer
> PAssert$33/GetPane/Map into PAssert$33/GroupGlobally/ParDo(Concat)
> May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
> INFO: 2018-05-25T10:12:31.354Z: Fusing consumer
> PAssert$33/GroupGlobally/Values/Values/Map into
> PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow
> May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
> INFO: 2018-05-25T10:12:31.403Z: Fusing consumer PAssert$33/RunChecks
> into PAssert$33/GetPane/Map
> May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
> INFO: 2018-05-25T10:12:31.447Z: Fusing consumer
> PAssert$33/VerifyAssertions/ParDo(DefaultConclude) into
> PAssert$33/RunChecks
> May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
> INFO: 2018-05-25T10:12:31.487Z: Unzipping flatten s24-u45 for input
> s26-reify-value18-c43
> May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
> INFO: 2018-05-25T10:12:31.529Z: Fusing unzipped copy of
> PAssert$33/GroupGlobally/GroupDummyAndContents/Write, through flatten
> s24-u45, into producer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
> May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
> INFO: 2018-05-25T10:12:31.567Z: Fusing consumer
> PAssert$33/GroupGlobally/GroupDummyAndContents/Reify into
> PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
> May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
> INFO: 2018-05-25T10:12:31.602Z: Fusing consumer
> PAssert$33/GroupGlobally/GroupDummyAndContents/Write into
> PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
> May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
> INFO: 2018-05-25T10:12:31.641Z: Fusing consumer
> PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign into
> PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)
> May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
> INFO: 2018-05-25T10:12:31.683Z: Fusing consumer
> PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into
> PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
> May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
> INFO: 2018-05-25T10:12:31.724Z: Fusing consumer
> PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write into
> PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
> May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
> INFO: 2018-05-25T10:12:31.771Z: Fusing consumer
> PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
> into PAssert$33/GroupGlobally/Window.Into()/Window.Assign
> May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
> INFO: 2018-05-25T10:12:31.817Z: Fusing consumer OutputSideInputs
> into Create123/Read(CreateSource)
> May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
> INFO: 2018-05-25T10:12:31.856Z: Fusing consumer
> PAssert$33/GroupGlobally/Window.Into()/Window.Assign into OutputSideInputs
> May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
> INFO: 2018-05-25T10:12:31.893Z: Fusing consumer
> PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map into
> PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
> May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
> INFO: 2018-05-25T10:12:31.925Z: Fusing consumer
> PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map into
> PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
> May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
> INFO: 2018-05-25T10:12:31.971Z: Fusing consumer
> PAssert$33/GroupGlobally/RewindowActuals/Window.Assign into
> PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map
> May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
> INFO: 2018-05-25T10:12:32.018Z: Fusing consumer
> PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into
> PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read
> May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
> INFO: 2018-05-25T10:12:32.070Z: Fusing consumer
> PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into
> PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
> May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
> INFO: 2018-05-25T10:12:32.116Z: Fusing consumer
> PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
> into PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
> May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
> INFO: 2018-05-25T10:12:32.150Z: Fusing consumer
>
> View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
> into
>
> View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
> May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
> INFO: 2018-05-25T10:12:32.196Z: Fusing consumer
>
> View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
> into
>
> View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
> May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
> INFO: 2018-05-25T10:12:32.239Z: Fusing consumer
>
> View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
> into
>
> View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
> May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
> INFO: 2018-05-25T10:12:32.285Z: Fusing consumer
>
> View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
> into Create47/Read(CreateSource)
> May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
> INFO: 2018-05-25T10:12:32.330Z: Fusing consumer
>
> View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
> into
>
> View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
> May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
> INFO: 2018-05-25T10:12:32.376Z: Fusing consumer
>
> View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
> into
>
> View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
> May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
> INFO: 2018-05-25T10:12:32.421Z: Fusing consumer
>
> View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
> into
>
> View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
> May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
> INFO: 2018-05-25T10:12:32.465Z: Fusing consumer
>
> View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
> into
>
> View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
> May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
> INFO: 2018-05-25T10:12:32.496Z: Fusing consumer
>
> View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
> into
>
> View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
> May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
> INFO: 2018-05-25T10:12:32.538Z: Fusing consumer
>
> View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
> into
>
> View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
> May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
> INFO: 2018-05-25T10:12:32.998Z: Executing operation
> PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Create
> May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
> INFO: 2018-05-25T10:12:33.036Z: Executing operation
> PAssert$33/GroupGlobally/GroupDummyAndContents/Create
> May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
> INFO: 2018-05-25T10:12:33.070Z: Executing operation
>
> View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
> May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
> INFO: 2018-05-25T10:12:33.094Z: Starting 1 workers in us-central1-b...
> May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
> INFO: 2018-05-25T10:12:33.112Z: Executing operation
>
> View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
> May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
> INFO: 2018-05-25T10:12:33.383Z: Executing operation
>
> Create47/Read(CreateSource)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
> May 25, 2018 10:12:38 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
> INFO: 2018-05-25T10:12:33.425Z: Executing operation
>
> PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
> May 25, 2018 10:12:43 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
> INFO: 2018-05-25T10:12:43.365Z: Autoscaling: Raised the number of
> workers to 0 based on the rate of progress in the currently running
> step(s).
> May 25, 2018 10:12:59 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
> INFO: 2018-05-25T10:12:59.310Z: Autoscaling: Raised the number of
> workers to 1 based on the rate of progress in the currently running
> step(s).
> May 25, 2018 10:12:59 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
> INFO: 2018-05-25T10:12:59.357Z: Autoscaling: Would further reduce
> the number of workers but reached the minimum number allowed for the job.
> May 25, 2018 10:13:22 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
> INFO: 2018-05-25T10:13:20.869Z: Workers have started successfully.
> May 25, 2018 10:13:44 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
> INFO: 2018-05-25T10:13:44.141Z: Executing operation
>
> View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
> May 25, 2018 10:13:46 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
> INFO: 2018-05-25T10:13:44.232Z: Executing operation
>
> View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
> May 25, 2018 10:13:52 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
> INFO: 2018-05-25T10:13:51.330Z: Executing operation
>
> View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
> May 25, 2018 10:13:52 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
> INFO: 2018-05-25T10:13:51.423Z: Executing operation
>
> View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
> May 25, 2018 10:14:02 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
> INFO: 2018-05-25T10:14:02.546Z: Executing operation
> View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
> May 25, 2018 10:14:02 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
> INFO: 2018-05-25T10:14:02.763Z: Executing operation
>
> Create123/Read(CreateSource)+OutputSideInputs+PAssert$33/GroupGlobally/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write
> May 25, 2018 10:14:11 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
> INFO: 2018-05-25T10:14:09.292Z: Executing operation
> PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Close
> May 25, 2018 10:14:11 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
> INFO: 2018-05-25T10:14:09.391Z: Executing operation
>
> PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$33/GroupGlobally/RewindowActuals/Window.Assign+PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
> May 25, 2018 10:14:14 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
> INFO: 2018-05-25T10:14:14.311Z: Executing operation
> PAssert$33/GroupGlobally/GroupDummyAndContents/Close
> May 25, 2018 10:14:14 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
> INFO: 2018-05-25T10:14:14.396Z: Executing operation
>
> PAssert$33/GroupGlobally/GroupDummyAndContents/Read+PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$33/GroupGlobally/Values/Values/Map+PAssert$33/GroupGlobally/ParDo(Concat)+PAssert$33/GetPane/Map+PAssert$33/RunChecks+PAssert$33/VerifyAssertions/ParDo(DefaultConclude)
> May 25, 2018 10:14:20 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
> INFO: 2018-05-25T10:14:18.765Z: Cleaning up.
> May 25, 2018 10:14:20 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
> INFO: 2018-05-25T10:14:18.860Z: Stopping worker pool...
> May 25, 2018 10:15:49 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
> INFO: 2018-05-25T10:15:47.896Z: Autoscaling: Resized worker pool
> from 1 to 0.
> May 25, 2018 10:15:49 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
> INFO: 2018-05-25T10:15:47.938Z: Autoscaling: Would further reduce
> the number of workers but reached the minimum number allowed for the job.
> May 25, 2018 10:15:49 AM
> org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
> INFO: 2018-05-25T10:15:47.974Z: Worker pool stopped.
> May 25, 2018 10:15:57 AM
> org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
> INFO: Job 2018-05-25_03_12_22-14221036885415975375 finished with
> status DONE.
> May 25, 2018 10:15:57 AM
> org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
> INFO: Success result for Dataflow job
> 2018-05-25_03_12_22-14221036885415975375. Found 1 success, 0 failures
> out of 1 expected assertions.
>
> Gradle Test Executor 39 finished executing tests.
>
> > Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest FAILED
>
> 209 tests completed, 34 failed, 2 skipped
> Finished generating test XML results (0.584 secs) into:
> <
> https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerTest
> >
> Generating HTML test report...
> Finished generating test html results (0.579 secs) into:
> <
> https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest
> >
> :beam-runners-google-cloud-dataflow-java:validatesRunnerTest
> (Thread[Task worker for ':' Thread 9,5,main]) completed. Took 2 hrs 2
> mins 29.205 secs.
>
> FAILURE: Build failed with an exception.
>
> * What went wrong:
> Execution failed for task
> ':beam-runners-google-cloud-dataflow-java:validatesRunnerTest'.
> > There were failing tests. See the report at: file://<
> https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest/index.html
> >
>
> * Try:
> Run with --stacktrace option to get the stack trace. Run with --debug
> option to get more log output. Run with --scan to get full insights.
>
> * Get more help at https://help.gradle.org
>
> Deprecated Gradle features were used in this build, making it
> incompatible with Gradle 5.0.
> See
>
> https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
>
> BUILD FAILED in 2h 3m 27s
> 38 actionable tasks: 34 executed, 4 from cache
>
> Publishing build scan...
> https://gradle.com/s/ibo6vmhiogj2s
>
> Build step 'Invoke Gradle script' changed build result to FAILURE
> Build step 'Invoke Gradle script' marked build as failure
> Recording test results
> Not sending mail to unregistered user apilloud@google.com
> Not sending mail to unregistered user robbe.sneyders@ml6.eu
> Not sending mail to unregistered user github@alasdairhodge.co.uk
> Not sending mail to unregistered user schroederc@google.com
> Not sending mail to unregistered user lukasz.gajowy@polidea.com
> Not sending mail to unregistered user szewinho@gmail.com
> Not sending mail to unregistered user ankurgoenka@gmail.com
> Not sending mail to unregistered user ekirpichov@gmail.com
> Not sending mail to unregistered user boyuanz@google.com
> Not sending mail to unregistered user timrobertson100@gmail.com
> Not sending mail to unregistered user
> yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
> Not sending mail to unregistered user klk@google.com
> Not sending mail to unregistered user sidhom@google.com
>
>
Fwd: Build failed in Jenkins:
beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #344
Posted by "Matthias J. Sax" <ma...@confluent.io>.
Hi Beam folks,
couple of days ago I started to receive emails from your Jenkins build
(forwarding one of the received emails). I am not sure why... It's quite
annoying and I would appreciate your help to get rid of them.
Hope you can help me out.
Thanks a lot.
-Matthias
-------- Forwarded Message --------
Subject: Build failed in Jenkins:
beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #344
Date: Fri, 25 May 2018 10:16:06 +0000 (UTC)
From: Apache Jenkins Server <je...@builds.apache.org>
To: commits@beam.apache.org, matthias@confluent.io, robertwb@gmail.com,
iemejia@gmail.com, lcwik@google.com, tgroh@google.com
See
<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/344/display/redirect?page=changes>
Changes:
[iemejia] Fix broken build (again third time this week yay!)
------------------------------------------
[...truncated 18.05 MB...]
INFO: Adding
PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign as
step s15
May 25, 2018 10:12:22 AM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator
addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey as
step s16
May 25, 2018 10:12:22 AM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator
addStep
INFO: Adding
PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map as step s17
May 25, 2018 10:12:22 AM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator
addStep
INFO: Adding PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
as step s18
May 25, 2018 10:12:22 AM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator
addStep
INFO: Adding PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map as
step s19
May 25, 2018 10:12:22 AM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator
addStep
INFO: Adding
PAssert$33/GroupGlobally/RemoveActualsTriggering/Flatten.PCollections as
step s20
May 25, 2018 10:12:22 AM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator
addStep
INFO: Adding
PAssert$33/GroupGlobally/Create.Values/Read(CreateSource) as step s21
May 25, 2018 10:12:22 AM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator
addStep
INFO: Adding PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
as step s22
May 25, 2018 10:12:22 AM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator
addStep
INFO: Adding
PAssert$33/GroupGlobally/RemoveDummyTriggering/Flatten.PCollections as
step s23
May 25, 2018 10:12:22 AM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator
addStep
INFO: Adding PAssert$33/GroupGlobally/FlattenDummyAndContents as
step s24
May 25, 2018 10:12:22 AM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator
addStep
INFO: Adding
PAssert$33/GroupGlobally/NeverTrigger/Flatten.PCollections as step s25
May 25, 2018 10:12:22 AM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator
addStep
INFO: Adding PAssert$33/GroupGlobally/GroupDummyAndContents as step s26
May 25, 2018 10:12:22 AM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator
addStep
INFO: Adding PAssert$33/GroupGlobally/Values/Values/Map as step s27
May 25, 2018 10:12:22 AM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator
addStep
INFO: Adding PAssert$33/GroupGlobally/ParDo(Concat) as step s28
May 25, 2018 10:12:22 AM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator
addStep
INFO: Adding PAssert$33/GetPane/Map as step s29
May 25, 2018 10:12:22 AM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator
addStep
INFO: Adding PAssert$33/RunChecks as step s30
May 25, 2018 10:12:22 AM
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator
addStep
INFO: Adding PAssert$33/VerifyAssertions/ParDo(DefaultConclude) as
step s31
May 25, 2018 10:12:22 AM
org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to
gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0525101218-9da8b226/output/results/staging/
May 25, 2018 10:12:22 AM
org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <71120 bytes, hash SiX30c8DyZkuiGKKPnDqxQ> to
gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0525101218-9da8b226/output/results/staging/pipeline-SiX30c8DyZkuiGKKPnDqxQ.pb
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput
STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput
STANDARD_ERROR
May 25, 2018 10:12:23 AM
org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to
https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-05-25_03_12_22-14221036885415975375?project=apache-beam-testing
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput
STANDARD_OUT
Submitted job: 2018-05-25_03_12_22-14221036885415975375
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput
STANDARD_ERROR
May 25, 2018 10:12:23 AM
org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel
--region=us-central1 2018-05-25_03_12_22-14221036885415975375
May 25, 2018 10:12:23 AM
org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-05-25_03_12_22-14221036885415975375
with 1 expected assertions.
May 25, 2018 10:12:38 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:12:22.725Z: Autoscaling is enabled for job
2018-05-25_03_12_22-14221036885415975375. The number of workers will be
between 1 and 1000.
May 25, 2018 10:12:38 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:12:22.768Z: Autoscaling was automatically
enabled for job 2018-05-25_03_12_22-14221036885415975375.
May 25, 2018 10:12:38 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:12:25.613Z: Checking required Cloud APIs are
enabled.
May 25, 2018 10:12:38 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:12:25.746Z: Checking permissions granted to
controller Service Account.
May 25, 2018 10:12:38 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:12:30.129Z: Worker configuration: n1-standard-1
in us-central1-b.
May 25, 2018 10:12:38 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:12:30.537Z: Expanding CoGroupByKey operations
into optimizable parts.
May 25, 2018 10:12:38 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:12:30.685Z: Expanding GroupByKey operations into
optimizable parts.
May 25, 2018 10:12:38 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:12:30.724Z: Lifting ValueCombiningMappingFns
into MergeBucketsMappingFns
May 25, 2018 10:12:38 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:12:30.953Z: Fusing adjacent ParDo, Read, Write,
and Flatten operations
May 25, 2018 10:12:38 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:12:31.000Z: Elided trivial flatten May 25,
2018 10:12:38 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:12:31.028Z: Elided trivial flatten May 25,
2018 10:12:38 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:12:31.072Z: Elided trivial flatten May 25,
2018 10:12:38 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:12:31.118Z: Unzipping flatten s24 for input
s19.org.apache.beam.sdk.values.PCollection.<init>:329#8fd0f908e3ea90e3
May 25, 2018 10:12:38 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:12:31.164Z: Fusing unzipped copy of
PAssert$33/GroupGlobally/GroupDummyAndContents/Reify, through flatten
PAssert$33/GroupGlobally/FlattenDummyAndContents, into producer
PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map
May 25, 2018 10:12:38 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:12:31.211Z: Fusing consumer
PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow into
PAssert$33/GroupGlobally/GroupDummyAndContents/Read
May 25, 2018 10:12:38 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:12:31.259Z: Fusing consumer
PAssert$33/GroupGlobally/ParDo(Concat) into
PAssert$33/GroupGlobally/Values/Values/Map
May 25, 2018 10:12:38 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:12:31.308Z: Fusing consumer
PAssert$33/GetPane/Map into PAssert$33/GroupGlobally/ParDo(Concat)
May 25, 2018 10:12:38 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:12:31.354Z: Fusing consumer
PAssert$33/GroupGlobally/Values/Values/Map into
PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow
May 25, 2018 10:12:38 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:12:31.403Z: Fusing consumer PAssert$33/RunChecks
into PAssert$33/GetPane/Map
May 25, 2018 10:12:38 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:12:31.447Z: Fusing consumer
PAssert$33/VerifyAssertions/ParDo(DefaultConclude) into PAssert$33/RunChecks
May 25, 2018 10:12:38 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:12:31.487Z: Unzipping flatten s24-u45 for input
s26-reify-value18-c43
May 25, 2018 10:12:38 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:12:31.529Z: Fusing unzipped copy of
PAssert$33/GroupGlobally/GroupDummyAndContents/Write, through flatten
s24-u45, into producer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 25, 2018 10:12:38 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:12:31.567Z: Fusing consumer
PAssert$33/GroupGlobally/GroupDummyAndContents/Reify into
PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
May 25, 2018 10:12:38 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:12:31.602Z: Fusing consumer
PAssert$33/GroupGlobally/GroupDummyAndContents/Write into
PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 25, 2018 10:12:38 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:12:31.641Z: Fusing consumer
PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign into
PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)
May 25, 2018 10:12:38 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:12:31.683Z: Fusing consumer
PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into
PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
May 25, 2018 10:12:38 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:12:31.724Z: Fusing consumer
PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write into
PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
May 25, 2018 10:12:38 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:12:31.771Z: Fusing consumer
PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
into PAssert$33/GroupGlobally/Window.Into()/Window.Assign
May 25, 2018 10:12:38 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:12:31.817Z: Fusing consumer OutputSideInputs
into Create123/Read(CreateSource)
May 25, 2018 10:12:38 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:12:31.856Z: Fusing consumer
PAssert$33/GroupGlobally/Window.Into()/Window.Assign into OutputSideInputs
May 25, 2018 10:12:38 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:12:31.893Z: Fusing consumer
PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map into
PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
May 25, 2018 10:12:38 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:12:31.925Z: Fusing consumer
PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map into
PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
May 25, 2018 10:12:38 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:12:31.971Z: Fusing consumer
PAssert$33/GroupGlobally/RewindowActuals/Window.Assign into
PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map
May 25, 2018 10:12:38 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:12:32.018Z: Fusing consumer
PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into
PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read
May 25, 2018 10:12:38 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:12:32.070Z: Fusing consumer
PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into
PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
May 25, 2018 10:12:38 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:12:32.116Z: Fusing consumer
PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
into PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
May 25, 2018 10:12:38 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:12:32.150Z: Fusing consumer
View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
into
View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
May 25, 2018 10:12:38 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:12:32.196Z: Fusing consumer
View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
into
View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
May 25, 2018 10:12:38 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:12:32.239Z: Fusing consumer
View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
into
View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
May 25, 2018 10:12:38 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:12:32.285Z: Fusing consumer
View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
into Create47/Read(CreateSource)
May 25, 2018 10:12:38 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:12:32.330Z: Fusing consumer
View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
into
View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
May 25, 2018 10:12:38 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:12:32.376Z: Fusing consumer
View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
into
View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
May 25, 2018 10:12:38 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:12:32.421Z: Fusing consumer
View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
into
View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
May 25, 2018 10:12:38 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:12:32.465Z: Fusing consumer
View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
into
View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
May 25, 2018 10:12:38 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:12:32.496Z: Fusing consumer
View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
into
View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
May 25, 2018 10:12:38 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:12:32.538Z: Fusing consumer
View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
into
View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
May 25, 2018 10:12:38 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:12:32.998Z: Executing operation
PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Create
May 25, 2018 10:12:38 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:12:33.036Z: Executing operation
PAssert$33/GroupGlobally/GroupDummyAndContents/Create
May 25, 2018 10:12:38 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:12:33.070Z: Executing operation
View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
May 25, 2018 10:12:38 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:12:33.094Z: Starting 1 workers in us-central1-b...
May 25, 2018 10:12:38 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:12:33.112Z: Executing operation
View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
May 25, 2018 10:12:38 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:12:33.383Z: Executing operation
Create47/Read(CreateSource)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
May 25, 2018 10:12:38 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:12:33.425Z: Executing operation
PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 25, 2018 10:12:43 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:12:43.365Z: Autoscaling: Raised the number of
workers to 0 based on the rate of progress in the currently running step(s).
May 25, 2018 10:12:59 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:12:59.310Z: Autoscaling: Raised the number of
workers to 1 based on the rate of progress in the currently running step(s).
May 25, 2018 10:12:59 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:12:59.357Z: Autoscaling: Would further reduce
the number of workers but reached the minimum number allowed for the job.
May 25, 2018 10:13:22 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:13:20.869Z: Workers have started successfully.
May 25, 2018 10:13:44 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:13:44.141Z: Executing operation
View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
May 25, 2018 10:13:46 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:13:44.232Z: Executing operation
View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
May 25, 2018 10:13:52 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:13:51.330Z: Executing operation
View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
May 25, 2018 10:13:52 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:13:51.423Z: Executing operation
View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
May 25, 2018 10:14:02 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:14:02.546Z: Executing operation
View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
May 25, 2018 10:14:02 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:14:02.763Z: Executing operation
Create123/Read(CreateSource)+OutputSideInputs+PAssert$33/GroupGlobally/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write
May 25, 2018 10:14:11 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:14:09.292Z: Executing operation
PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Close
May 25, 2018 10:14:11 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:14:09.391Z: Executing operation
PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$33/GroupGlobally/RewindowActuals/Window.Assign+PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 25, 2018 10:14:14 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:14:14.311Z: Executing operation
PAssert$33/GroupGlobally/GroupDummyAndContents/Close
May 25, 2018 10:14:14 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:14:14.396Z: Executing operation
PAssert$33/GroupGlobally/GroupDummyAndContents/Read+PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$33/GroupGlobally/Values/Values/Map+PAssert$33/GroupGlobally/ParDo(Concat)+PAssert$33/GetPane/Map+PAssert$33/RunChecks+PAssert$33/VerifyAssertions/ParDo(DefaultConclude)
May 25, 2018 10:14:20 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:14:18.765Z: Cleaning up.
May 25, 2018 10:14:20 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:14:18.860Z: Stopping worker pool...
May 25, 2018 10:15:49 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:15:47.896Z: Autoscaling: Resized worker pool
from 1 to 0.
May 25, 2018 10:15:49 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:15:47.938Z: Autoscaling: Would further reduce
the number of workers but reached the minimum number allowed for the job.
May 25, 2018 10:15:49 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:15:47.974Z: Worker pool stopped.
May 25, 2018 10:15:57 AM
org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-05-25_03_12_22-14221036885415975375 finished with
status DONE.
May 25, 2018 10:15:57 AM
org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job
2018-05-25_03_12_22-14221036885415975375. Found 1 success, 0 failures
out of 1 expected assertions.
Gradle Test Executor 39 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest FAILED
209 tests completed, 34 failed, 2 skipped
Finished generating test XML results (0.584 secs) into:
<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerTest>
Generating HTML test report...
Finished generating test html results (0.579 secs) into:
<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest>
:beam-runners-google-cloud-dataflow-java:validatesRunnerTest
(Thread[Task worker for ':' Thread 9,5,main]) completed. Took 2 hrs 2
mins 29.205 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task
':beam-runners-google-cloud-dataflow-java:validatesRunnerTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug
option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it
incompatible with Gradle 5.0.
See
https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 3m 27s
38 actionable tasks: 34 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/ibo6vmhiogj2s
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user robbe.sneyders@ml6.eu
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user schroederc@google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user
yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user sidhom@google.com
Build failed in Jenkins:
beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #344
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/344/display/redirect?page=changes>
Changes:
[iemejia] Fix broken build (again third time this week yay!)
------------------------------------------
[...truncated 18.05 MB...]
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign as step s15
May 25, 2018 10:12:22 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey as step s16
May 25, 2018 10:12:22 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map as step s17
May 25, 2018 10:12:22 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RewindowActuals/Window.Assign as step s18
May 25, 2018 10:12:22 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map as step s19
May 25, 2018 10:12:22 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveActualsTriggering/Flatten.PCollections as step s20
May 25, 2018 10:12:22 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Create.Values/Read(CreateSource) as step s21
May 25, 2018 10:12:22 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign as step s22
May 25, 2018 10:12:22 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveDummyTriggering/Flatten.PCollections as step s23
May 25, 2018 10:12:22 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/FlattenDummyAndContents as step s24
May 25, 2018 10:12:22 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/NeverTrigger/Flatten.PCollections as step s25
May 25, 2018 10:12:22 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GroupDummyAndContents as step s26
May 25, 2018 10:12:22 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Values/Values/Map as step s27
May 25, 2018 10:12:22 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/ParDo(Concat) as step s28
May 25, 2018 10:12:22 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GetPane/Map as step s29
May 25, 2018 10:12:22 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/RunChecks as step s30
May 25, 2018 10:12:22 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/VerifyAssertions/ParDo(DefaultConclude) as step s31
May 25, 2018 10:12:22 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0525101218-9da8b226/output/results/staging/
May 25, 2018 10:12:22 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <71120 bytes, hash SiX30c8DyZkuiGKKPnDqxQ> to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0525101218-9da8b226/output/results/staging/pipeline-SiX30c8DyZkuiGKKPnDqxQ.pb
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 25, 2018 10:12:23 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-05-25_03_12_22-14221036885415975375?project=apache-beam-testing
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Submitted job: 2018-05-25_03_12_22-14221036885415975375
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 25, 2018 10:12:23 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-05-25_03_12_22-14221036885415975375
May 25, 2018 10:12:23 AM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-05-25_03_12_22-14221036885415975375 with 1 expected assertions.
May 25, 2018 10:12:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:12:22.725Z: Autoscaling is enabled for job 2018-05-25_03_12_22-14221036885415975375. The number of workers will be between 1 and 1000.
May 25, 2018 10:12:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:12:22.768Z: Autoscaling was automatically enabled for job 2018-05-25_03_12_22-14221036885415975375.
May 25, 2018 10:12:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:12:25.613Z: Checking required Cloud APIs are enabled.
May 25, 2018 10:12:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:12:25.746Z: Checking permissions granted to controller Service Account.
May 25, 2018 10:12:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:12:30.129Z: Worker configuration: n1-standard-1 in us-central1-b.
May 25, 2018 10:12:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:12:30.537Z: Expanding CoGroupByKey operations into optimizable parts.
May 25, 2018 10:12:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:12:30.685Z: Expanding GroupByKey operations into optimizable parts.
May 25, 2018 10:12:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:12:30.724Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
May 25, 2018 10:12:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:12:30.953Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
May 25, 2018 10:12:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:12:31.000Z: Elided trivial flatten
May 25, 2018 10:12:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:12:31.028Z: Elided trivial flatten
May 25, 2018 10:12:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:12:31.072Z: Elided trivial flatten
May 25, 2018 10:12:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:12:31.118Z: Unzipping flatten s24 for input s19.org.apache.beam.sdk.values.PCollection.<init>:329#8fd0f908e3ea90e3
May 25, 2018 10:12:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:12:31.164Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Reify, through flatten PAssert$33/GroupGlobally/FlattenDummyAndContents, into producer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map
May 25, 2018 10:12:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:12:31.211Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow into PAssert$33/GroupGlobally/GroupDummyAndContents/Read
May 25, 2018 10:12:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:12:31.259Z: Fusing consumer PAssert$33/GroupGlobally/ParDo(Concat) into PAssert$33/GroupGlobally/Values/Values/Map
May 25, 2018 10:12:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:12:31.308Z: Fusing consumer PAssert$33/GetPane/Map into PAssert$33/GroupGlobally/ParDo(Concat)
May 25, 2018 10:12:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:12:31.354Z: Fusing consumer PAssert$33/GroupGlobally/Values/Values/Map into PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow
May 25, 2018 10:12:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:12:31.403Z: Fusing consumer PAssert$33/RunChecks into PAssert$33/GetPane/Map
May 25, 2018 10:12:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:12:31.447Z: Fusing consumer PAssert$33/VerifyAssertions/ParDo(DefaultConclude) into PAssert$33/RunChecks
May 25, 2018 10:12:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:12:31.487Z: Unzipping flatten s24-u45 for input s26-reify-value18-c43
May 25, 2018 10:12:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:12:31.529Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Write, through flatten s24-u45, into producer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 25, 2018 10:12:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:12:31.567Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify into PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
May 25, 2018 10:12:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:12:31.602Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Write into PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 25, 2018 10:12:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:12:31.641Z: Fusing consumer PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)
May 25, 2018 10:12:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:12:31.683Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
May 25, 2018 10:12:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:12:31.724Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
May 25, 2018 10:12:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:12:31.771Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into PAssert$33/GroupGlobally/Window.Into()/Window.Assign
May 25, 2018 10:12:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:12:31.817Z: Fusing consumer OutputSideInputs into Create123/Read(CreateSource)
May 25, 2018 10:12:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:12:31.856Z: Fusing consumer PAssert$33/GroupGlobally/Window.Into()/Window.Assign into OutputSideInputs
May 25, 2018 10:12:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:12:31.893Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
May 25, 2018 10:12:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:12:31.925Z: Fusing consumer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map into PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
May 25, 2018 10:12:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:12:31.971Z: Fusing consumer PAssert$33/GroupGlobally/RewindowActuals/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map
May 25, 2018 10:12:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:12:32.018Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read
May 25, 2018 10:12:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:12:32.070Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
May 25, 2018 10:12:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:12:32.116Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
May 25, 2018 10:12:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:12:32.150Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
May 25, 2018 10:12:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:12:32.196Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
May 25, 2018 10:12:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:12:32.239Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
May 25, 2018 10:12:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:12:32.285Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into Create47/Read(CreateSource)
May 25, 2018 10:12:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:12:32.330Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
May 25, 2018 10:12:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:12:32.376Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
May 25, 2018 10:12:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:12:32.421Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
May 25, 2018 10:12:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:12:32.465Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
May 25, 2018 10:12:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:12:32.496Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
May 25, 2018 10:12:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:12:32.538Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
May 25, 2018 10:12:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:12:32.998Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Create
May 25, 2018 10:12:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:12:33.036Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Create
May 25, 2018 10:12:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:12:33.070Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
May 25, 2018 10:12:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:12:33.094Z: Starting 1 workers in us-central1-b...
May 25, 2018 10:12:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:12:33.112Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
May 25, 2018 10:12:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:12:33.383Z: Executing operation Create47/Read(CreateSource)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
May 25, 2018 10:12:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:12:33.425Z: Executing operation PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 25, 2018 10:12:43 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:12:43.365Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
May 25, 2018 10:12:59 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:12:59.310Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
May 25, 2018 10:12:59 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:12:59.357Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 25, 2018 10:13:22 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:13:20.869Z: Workers have started successfully.
May 25, 2018 10:13:44 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:13:44.141Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
May 25, 2018 10:13:46 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:13:44.232Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
May 25, 2018 10:13:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:13:51.330Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
May 25, 2018 10:13:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:13:51.423Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
May 25, 2018 10:14:02 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:14:02.546Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
May 25, 2018 10:14:02 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:14:02.763Z: Executing operation Create123/Read(CreateSource)+OutputSideInputs+PAssert$33/GroupGlobally/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write
May 25, 2018 10:14:11 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:14:09.292Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Close
May 25, 2018 10:14:11 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:14:09.391Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$33/GroupGlobally/RewindowActuals/Window.Assign+PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 25, 2018 10:14:14 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:14:14.311Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Close
May 25, 2018 10:14:14 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:14:14.396Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Read+PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$33/GroupGlobally/Values/Values/Map+PAssert$33/GroupGlobally/ParDo(Concat)+PAssert$33/GetPane/Map+PAssert$33/RunChecks+PAssert$33/VerifyAssertions/ParDo(DefaultConclude)
May 25, 2018 10:14:20 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:14:18.765Z: Cleaning up.
May 25, 2018 10:14:20 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:14:18.860Z: Stopping worker pool...
May 25, 2018 10:15:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:15:47.896Z: Autoscaling: Resized worker pool from 1 to 0.
May 25, 2018 10:15:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:15:47.938Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 25, 2018 10:15:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T10:15:47.974Z: Worker pool stopped.
May 25, 2018 10:15:57 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-05-25_03_12_22-14221036885415975375 finished with status DONE.
May 25, 2018 10:15:57 AM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-05-25_03_12_22-14221036885415975375. Found 1 success, 0 failures out of 1 expected assertions.
Gradle Test Executor 39 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest FAILED
209 tests completed, 34 failed, 2 skipped
Finished generating test XML results (0.584 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerTest>
Generating HTML test report...
Finished generating test html results (0.579 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest>
:beam-runners-google-cloud-dataflow-java:validatesRunnerTest (Thread[Task worker for ':' Thread 9,5,main]) completed. Took 2 hrs 2 mins 29.205 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:validatesRunnerTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 3m 27s
38 actionable tasks: 34 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/ibo6vmhiogj2s
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user robbe.sneyders@ml6.eu
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user schroederc@google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user sidhom@google.com
Build failed in Jenkins:
beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #343
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/343/display/redirect>
------------------------------------------
[...truncated 18.00 MB...]
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map as step s14
May 25, 2018 8:03:17 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign as step s15
May 25, 2018 8:03:17 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey as step s16
May 25, 2018 8:03:17 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map as step s17
May 25, 2018 8:03:17 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RewindowActuals/Window.Assign as step s18
May 25, 2018 8:03:17 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map as step s19
May 25, 2018 8:03:17 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveActualsTriggering/Flatten.PCollections as step s20
May 25, 2018 8:03:17 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Create.Values/Read(CreateSource) as step s21
May 25, 2018 8:03:17 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign as step s22
May 25, 2018 8:03:17 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveDummyTriggering/Flatten.PCollections as step s23
May 25, 2018 8:03:17 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/FlattenDummyAndContents as step s24
May 25, 2018 8:03:17 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/NeverTrigger/Flatten.PCollections as step s25
May 25, 2018 8:03:17 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GroupDummyAndContents as step s26
May 25, 2018 8:03:17 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Values/Values/Map as step s27
May 25, 2018 8:03:17 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/ParDo(Concat) as step s28
May 25, 2018 8:03:17 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GetPane/Map as step s29
May 25, 2018 8:03:17 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/RunChecks as step s30
May 25, 2018 8:03:17 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/VerifyAssertions/ParDo(DefaultConclude) as step s31
May 25, 2018 8:03:17 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0525080314-e3b1c7c1/output/results/staging/
May 25, 2018 8:03:18 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <71120 bytes, hash ejt02NZrPhkUvIUwVeW_Qw> to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0525080314-e3b1c7c1/output/results/staging/pipeline-ejt02NZrPhkUvIUwVeW_Qw.pb
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 25, 2018 8:03:19 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-05-25_01_03_18-6975355041943436726?project=apache-beam-testing
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Submitted job: 2018-05-25_01_03_18-6975355041943436726
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 25, 2018 8:03:19 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-05-25_01_03_18-6975355041943436726
May 25, 2018 8:03:19 AM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-05-25_01_03_18-6975355041943436726 with 1 expected assertions.
May 25, 2018 8:03:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T08:03:18.526Z: Autoscaling is enabled for job 2018-05-25_01_03_18-6975355041943436726. The number of workers will be between 1 and 1000.
May 25, 2018 8:03:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T08:03:18.565Z: Autoscaling was automatically enabled for job 2018-05-25_01_03_18-6975355041943436726.
May 25, 2018 8:03:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T08:03:21.273Z: Checking required Cloud APIs are enabled.
May 25, 2018 8:03:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T08:03:21.521Z: Checking permissions granted to controller Service Account.
May 25, 2018 8:03:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T08:03:29.347Z: Worker configuration: n1-standard-1 in us-central1-b.
May 25, 2018 8:03:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T08:03:29.789Z: Expanding CoGroupByKey operations into optimizable parts.
May 25, 2018 8:03:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T08:03:29.967Z: Expanding GroupByKey operations into optimizable parts.
May 25, 2018 8:03:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T08:03:30.002Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
May 25, 2018 8:03:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T08:03:30.281Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
May 25, 2018 8:03:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T08:03:30.329Z: Elided trivial flatten
May 25, 2018 8:03:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T08:03:30.378Z: Elided trivial flatten
May 25, 2018 8:03:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T08:03:30.414Z: Elided trivial flatten
May 25, 2018 8:03:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T08:03:30.460Z: Unzipping flatten s24 for input s19.org.apache.beam.sdk.values.PCollection.<init>:329#8fd0f908e3ea90e3
May 25, 2018 8:03:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T08:03:30.508Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Reify, through flatten PAssert$33/GroupGlobally/FlattenDummyAndContents, into producer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map
May 25, 2018 8:03:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T08:03:30.554Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow into PAssert$33/GroupGlobally/GroupDummyAndContents/Read
May 25, 2018 8:03:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T08:03:30.602Z: Fusing consumer PAssert$33/GroupGlobally/ParDo(Concat) into PAssert$33/GroupGlobally/Values/Values/Map
May 25, 2018 8:03:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T08:03:30.651Z: Fusing consumer PAssert$33/GetPane/Map into PAssert$33/GroupGlobally/ParDo(Concat)
May 25, 2018 8:03:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T08:03:30.688Z: Fusing consumer PAssert$33/GroupGlobally/Values/Values/Map into PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow
May 25, 2018 8:03:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T08:03:30.735Z: Fusing consumer PAssert$33/RunChecks into PAssert$33/GetPane/Map
May 25, 2018 8:03:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T08:03:30.783Z: Fusing consumer PAssert$33/VerifyAssertions/ParDo(DefaultConclude) into PAssert$33/RunChecks
May 25, 2018 8:03:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T08:03:30.829Z: Unzipping flatten s24-u45 for input s26-reify-value18-c43
May 25, 2018 8:03:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T08:03:30.878Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Write, through flatten s24-u45, into producer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 25, 2018 8:03:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T08:03:31.114Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify into PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
May 25, 2018 8:03:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T08:03:31.156Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Write into PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 25, 2018 8:03:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T08:03:31.198Z: Fusing consumer PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)
May 25, 2018 8:03:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T08:03:31.238Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
May 25, 2018 8:03:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T08:03:31.277Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
May 25, 2018 8:03:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T08:03:31.323Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into PAssert$33/GroupGlobally/Window.Into()/Window.Assign
May 25, 2018 8:03:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T08:03:31.380Z: Fusing consumer OutputSideInputs into Create123/Read(CreateSource)
May 25, 2018 8:03:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T08:03:31.421Z: Fusing consumer PAssert$33/GroupGlobally/Window.Into()/Window.Assign into OutputSideInputs
May 25, 2018 8:03:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T08:03:31.458Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
May 25, 2018 8:03:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T08:03:31.492Z: Fusing consumer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map into PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
May 25, 2018 8:03:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T08:03:31.536Z: Fusing consumer PAssert$33/GroupGlobally/RewindowActuals/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map
May 25, 2018 8:03:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T08:03:31.581Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read
May 25, 2018 8:03:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T08:03:31.619Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
May 25, 2018 8:03:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T08:03:31.657Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
May 25, 2018 8:03:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T08:03:31.707Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
May 25, 2018 8:03:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T08:03:31.748Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
May 25, 2018 8:03:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T08:03:31.785Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
May 25, 2018 8:03:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T08:03:31.841Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into Create47/Read(CreateSource)
May 25, 2018 8:03:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T08:03:31.886Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
May 25, 2018 8:03:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T08:03:31.935Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
May 25, 2018 8:03:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T08:03:31.980Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
May 25, 2018 8:03:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T08:03:32.029Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
May 25, 2018 8:03:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T08:03:32.068Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
May 25, 2018 8:03:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T08:03:32.115Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
May 25, 2018 8:03:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T08:03:32.586Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Create
May 25, 2018 8:03:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T08:03:32.634Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Create
May 25, 2018 8:03:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T08:03:32.681Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
May 25, 2018 8:03:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T08:03:32.692Z: Starting 1 workers in us-central1-b...
May 25, 2018 8:03:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T08:03:32.721Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
May 25, 2018 8:03:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T08:03:32.943Z: Executing operation PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 25, 2018 8:03:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T08:03:32.978Z: Executing operation Create47/Read(CreateSource)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
May 25, 2018 8:03:40 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T08:03:40.659Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
May 25, 2018 8:03:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T08:03:51.446Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
May 25, 2018 8:03:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T08:03:51.497Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 25, 2018 8:04:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T08:04:12.144Z: Workers have started successfully.
May 25, 2018 8:04:31 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T08:04:30.125Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
May 25, 2018 8:04:31 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T08:04:30.246Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
May 25, 2018 8:04:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T08:04:35.727Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
May 25, 2018 8:04:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T08:04:35.827Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
May 25, 2018 8:04:50 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T08:04:48.655Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
May 25, 2018 8:04:50 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T08:04:48.892Z: Executing operation Create123/Read(CreateSource)+OutputSideInputs+PAssert$33/GroupGlobally/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write
May 25, 2018 8:04:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T08:04:50.952Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Close
May 25, 2018 8:04:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T08:04:51.066Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$33/GroupGlobally/RewindowActuals/Window.Assign+PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 25, 2018 8:04:56 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T08:04:54.566Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Close
May 25, 2018 8:04:56 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T08:04:54.655Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Read+PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$33/GroupGlobally/Values/Values/Map+PAssert$33/GroupGlobally/ParDo(Concat)+PAssert$33/GetPane/Map+PAssert$33/RunChecks+PAssert$33/VerifyAssertions/ParDo(DefaultConclude)
May 25, 2018 8:04:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T08:04:57.233Z: Cleaning up.
May 25, 2018 8:04:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T08:04:57.372Z: Stopping worker pool...
May 25, 2018 8:06:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T08:06:14.831Z: Autoscaling: Resized worker pool from 1 to 0.
May 25, 2018 8:06:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T08:06:14.873Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 25, 2018 8:06:24 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-05-25_01_03_18-6975355041943436726 finished with status DONE.
May 25, 2018 8:06:24 AM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-05-25_01_03_18-6975355041943436726. Found 1 success, 0 failures out of 1 expected assertions.
Gradle Test Executor 38 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest FAILED
209 tests completed, 34 failed, 2 skipped
Finished generating test XML results (0.457 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerTest>
Generating HTML test report...
Finished generating test html results (0.403 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest>
:beam-runners-google-cloud-dataflow-java:validatesRunnerTest (Thread[Task worker for ':' Thread 40,5,main]) completed. Took 2 hrs 4 mins 2.243 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:validatesRunnerTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 5m 22s
38 actionable tasks: 34 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/to4p3givkgqey
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user robbe.sneyders@ml6.eu
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user schroederc@google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user sidhom@google.com
Build failed in Jenkins:
beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #342
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/342/display/redirect?page=changes>
Changes:
[robertwb] Slowly ramp up wait time in state sampler.
[tgroh] Move the Local Artifact Services to the DirectRunner
[tgroh] Migrate the ReferenceRunnerJobServer to runners-direct
[tgroh] Fix License Headers
[apilloud] [SQL] Fix transitive dependencies
[apilloud] [SQL] Run tests against actual jar
[tgroh] Update Docker Command
------------------------------------------
[...truncated 18.06 MB...]
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey as step s16
May 25, 2018 2:12:49 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map as step s17
May 25, 2018 2:12:49 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RewindowActuals/Window.Assign as step s18
May 25, 2018 2:12:49 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map as step s19
May 25, 2018 2:12:49 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveActualsTriggering/Flatten.PCollections as step s20
May 25, 2018 2:12:49 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Create.Values/Read(CreateSource) as step s21
May 25, 2018 2:12:49 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign as step s22
May 25, 2018 2:12:49 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveDummyTriggering/Flatten.PCollections as step s23
May 25, 2018 2:12:49 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/FlattenDummyAndContents as step s24
May 25, 2018 2:12:49 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/NeverTrigger/Flatten.PCollections as step s25
May 25, 2018 2:12:49 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GroupDummyAndContents as step s26
May 25, 2018 2:12:49 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Values/Values/Map as step s27
May 25, 2018 2:12:49 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/ParDo(Concat) as step s28
May 25, 2018 2:12:49 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GetPane/Map as step s29
May 25, 2018 2:12:49 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/RunChecks as step s30
May 25, 2018 2:12:49 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/VerifyAssertions/ParDo(DefaultConclude) as step s31
May 25, 2018 2:12:49 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0525021245-6e73552b/output/results/staging/
May 25, 2018 2:12:49 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <71120 bytes, hash 0yY4SgYX_KT_-h7hSmBFvw> to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0525021245-6e73552b/output/results/staging/pipeline-0yY4SgYX_KT_-h7hSmBFvw.pb
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 25, 2018 2:12:50 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-05-24_19_12_49-15493961418752181912?project=apache-beam-testing
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Submitted job: 2018-05-24_19_12_49-15493961418752181912
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 25, 2018 2:12:50 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-05-24_19_12_49-15493961418752181912
May 25, 2018 2:12:50 AM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-05-24_19_12_49-15493961418752181912 with 1 expected assertions.
May 25, 2018 2:12:59 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T02:12:49.735Z: Autoscaling is enabled for job 2018-05-24_19_12_49-15493961418752181912. The number of workers will be between 1 and 1000.
May 25, 2018 2:12:59 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T02:12:49.773Z: Autoscaling was automatically enabled for job 2018-05-24_19_12_49-15493961418752181912.
May 25, 2018 2:12:59 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T02:12:52.272Z: Checking required Cloud APIs are enabled.
May 25, 2018 2:12:59 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T02:12:52.461Z: Checking permissions granted to controller Service Account.
May 25, 2018 2:12:59 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T02:12:56.742Z: Worker configuration: n1-standard-1 in us-central1-f.
May 25, 2018 2:12:59 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T02:12:57.138Z: Expanding CoGroupByKey operations into optimizable parts.
May 25, 2018 2:12:59 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T02:12:57.319Z: Expanding GroupByKey operations into optimizable parts.
May 25, 2018 2:12:59 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T02:12:57.358Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
May 25, 2018 2:12:59 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T02:12:57.589Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
May 25, 2018 2:12:59 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T02:12:57.628Z: Elided trivial flatten
May 25, 2018 2:12:59 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T02:12:57.674Z: Elided trivial flatten
May 25, 2018 2:12:59 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T02:12:57.715Z: Elided trivial flatten
May 25, 2018 2:12:59 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T02:12:57.760Z: Unzipping flatten s24 for input s19.org.apache.beam.sdk.values.PCollection.<init>:329#8fd0f908e3ea90e3
May 25, 2018 2:12:59 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T02:12:57.806Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Reify, through flatten PAssert$33/GroupGlobally/FlattenDummyAndContents, into producer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map
May 25, 2018 2:12:59 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T02:12:57.849Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow into PAssert$33/GroupGlobally/GroupDummyAndContents/Read
May 25, 2018 2:12:59 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T02:12:57.890Z: Fusing consumer PAssert$33/GroupGlobally/ParDo(Concat) into PAssert$33/GroupGlobally/Values/Values/Map
May 25, 2018 2:12:59 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T02:12:57.935Z: Fusing consumer PAssert$33/GetPane/Map into PAssert$33/GroupGlobally/ParDo(Concat)
May 25, 2018 2:12:59 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T02:12:57.986Z: Fusing consumer PAssert$33/GroupGlobally/Values/Values/Map into PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow
May 25, 2018 2:12:59 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T02:12:58.034Z: Fusing consumer PAssert$33/RunChecks into PAssert$33/GetPane/Map
May 25, 2018 2:12:59 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T02:12:58.081Z: Fusing consumer PAssert$33/VerifyAssertions/ParDo(DefaultConclude) into PAssert$33/RunChecks
May 25, 2018 2:12:59 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T02:12:58.126Z: Unzipping flatten s24-u45 for input s26-reify-value18-c43
May 25, 2018 2:12:59 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T02:12:58.175Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Write, through flatten s24-u45, into producer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 25, 2018 2:12:59 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T02:12:58.224Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify into PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
May 25, 2018 2:12:59 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T02:12:58.274Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Write into PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 25, 2018 2:12:59 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T02:12:58.318Z: Fusing consumer PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)
May 25, 2018 2:12:59 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T02:12:58.365Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
May 25, 2018 2:12:59 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T02:12:58.413Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
May 25, 2018 2:12:59 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T02:12:58.454Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into PAssert$33/GroupGlobally/Window.Into()/Window.Assign
May 25, 2018 2:12:59 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T02:12:58.499Z: Fusing consumer OutputSideInputs into Create123/Read(CreateSource)
May 25, 2018 2:12:59 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T02:12:58.546Z: Fusing consumer PAssert$33/GroupGlobally/Window.Into()/Window.Assign into OutputSideInputs
May 25, 2018 2:12:59 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T02:12:58.593Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
May 25, 2018 2:12:59 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T02:12:58.644Z: Fusing consumer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map into PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
May 25, 2018 2:12:59 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T02:12:58.687Z: Fusing consumer PAssert$33/GroupGlobally/RewindowActuals/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map
May 25, 2018 2:12:59 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T02:12:58.728Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read
May 25, 2018 2:12:59 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T02:12:58.769Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
May 25, 2018 2:12:59 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T02:12:58.807Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
May 25, 2018 2:12:59 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T02:12:58.855Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
May 25, 2018 2:12:59 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T02:12:58.903Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
May 25, 2018 2:12:59 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T02:12:58.950Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
May 25, 2018 2:12:59 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T02:12:58.999Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into Create47/Read(CreateSource)
May 25, 2018 2:12:59 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T02:12:59.039Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
May 25, 2018 2:12:59 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T02:12:59.079Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
May 25, 2018 2:12:59 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T02:12:59.126Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
May 25, 2018 2:12:59 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T02:12:59.175Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
May 25, 2018 2:12:59 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T02:12:59.214Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
May 25, 2018 2:12:59 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T02:12:59.255Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
May 25, 2018 2:13:02 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T02:12:59.697Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Create
May 25, 2018 2:13:02 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T02:12:59.734Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Create
May 25, 2018 2:13:02 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T02:12:59.773Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
May 25, 2018 2:13:02 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T02:12:59.798Z: Starting 1 workers in us-central1-f...
May 25, 2018 2:13:02 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T02:12:59.811Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
May 25, 2018 2:13:02 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T02:13:00.026Z: Executing operation Create47/Read(CreateSource)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
May 25, 2018 2:13:02 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T02:13:00.059Z: Executing operation PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 25, 2018 2:13:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T02:13:06.633Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
May 25, 2018 2:13:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T02:13:17.077Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
May 25, 2018 2:13:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T02:13:17.121Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 25, 2018 2:13:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T02:13:35.782Z: Workers have started successfully.
May 25, 2018 2:14:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T02:14:01.789Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
May 25, 2018 2:14:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T02:14:01.882Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
May 25, 2018 2:14:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T02:14:09.167Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
May 25, 2018 2:14:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T02:14:09.261Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
May 25, 2018 2:14:23 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T02:14:22.536Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
May 25, 2018 2:14:23 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T02:14:22.706Z: Executing operation Create123/Read(CreateSource)+OutputSideInputs+PAssert$33/GroupGlobally/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write
May 25, 2018 2:14:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T02:14:29.046Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Close
May 25, 2018 2:14:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T02:14:29.133Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$33/GroupGlobally/RewindowActuals/Window.Assign+PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 25, 2018 2:14:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T02:14:34.828Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Close
May 25, 2018 2:14:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T02:14:34.893Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Read+PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$33/GroupGlobally/Values/Values/Map+PAssert$33/GroupGlobally/ParDo(Concat)+PAssert$33/GetPane/Map+PAssert$33/RunChecks+PAssert$33/VerifyAssertions/ParDo(DefaultConclude)
May 25, 2018 2:14:39 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T02:14:39.002Z: Cleaning up.
May 25, 2018 2:14:40 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T02:14:39.106Z: Stopping worker pool...
May 25, 2018 2:15:57 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T02:15:55.628Z: Autoscaling: Resized worker pool from 1 to 0.
May 25, 2018 2:15:57 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T02:15:55.669Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 25, 2018 2:15:57 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T02:15:55.722Z: Worker pool stopped.
May 25, 2018 2:16:04 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-05-24_19_12_49-15493961418752181912 finished with status DONE.
May 25, 2018 2:16:04 AM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-05-24_19_12_49-15493961418752181912. Found 1 success, 0 failures out of 1 expected assertions.
Gradle Test Executor 34 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest
209 tests completed, 34 failed, 2 skipped
Finished generating test XML results (0.846 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerTest>
Generating HTML test report...
Finished generating test html results (0.653 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest>
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest FAILED
:beam-runners-google-cloud-dataflow-java:validatesRunnerTest (Thread[Task worker for ':' Thread 13,5,main]) completed. Took 2 hrs 1 mins 55.453 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:validatesRunnerTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 2m 48s
38 actionable tasks: 34 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/xrdulqzcvorxa
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user robbe.sneyders@ml6.eu
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user schroederc@google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user sidhom@google.com
Build failed in Jenkins:
beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #341
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/341/display/redirect?page=changes>
Changes:
[tgroh] Update GroupAlsoByWindowEvaluatorFactory
[boyuanz] Change bulid rules of sdks/java/harness to make harness as a uber-jar
[boyuanz] [BEAM-4393]: Copy root repo's LICENSE & NOTICE into shadowJar
------------------------------------------
[...truncated 18.05 MB...]
May 25, 2018 12:09:49 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map as step s14
May 25, 2018 12:09:49 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign as step s15
May 25, 2018 12:09:49 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey as step s16
May 25, 2018 12:09:49 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map as step s17
May 25, 2018 12:09:49 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RewindowActuals/Window.Assign as step s18
May 25, 2018 12:09:49 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map as step s19
May 25, 2018 12:09:49 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveActualsTriggering/Flatten.PCollections as step s20
May 25, 2018 12:09:49 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Create.Values/Read(CreateSource) as step s21
May 25, 2018 12:09:49 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign as step s22
May 25, 2018 12:09:49 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveDummyTriggering/Flatten.PCollections as step s23
May 25, 2018 12:09:49 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/FlattenDummyAndContents as step s24
May 25, 2018 12:09:49 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/NeverTrigger/Flatten.PCollections as step s25
May 25, 2018 12:09:49 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GroupDummyAndContents as step s26
May 25, 2018 12:09:49 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Values/Values/Map as step s27
May 25, 2018 12:09:49 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/ParDo(Concat) as step s28
May 25, 2018 12:09:49 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GetPane/Map as step s29
May 25, 2018 12:09:49 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/RunChecks as step s30
May 25, 2018 12:09:49 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/VerifyAssertions/ParDo(DefaultConclude) as step s31
May 25, 2018 12:09:49 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0525000946-a8a470c0/output/results/staging/
May 25, 2018 12:09:49 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <71120 bytes, hash sd06lC0hzqLaAFuIa3_jJw> to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0525000946-a8a470c0/output/results/staging/pipeline-sd06lC0hzqLaAFuIa3_jJw.pb
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 25, 2018 12:09:50 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-05-24_17_09_49-4612987860916041288?project=apache-beam-testing
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Submitted job: 2018-05-24_17_09_49-4612987860916041288
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 25, 2018 12:09:50 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-05-24_17_09_49-4612987860916041288
May 25, 2018 12:09:50 AM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-05-24_17_09_49-4612987860916041288 with 1 expected assertions.
May 25, 2018 12:10:07 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T00:09:49.879Z: Autoscaling is enabled for job 2018-05-24_17_09_49-4612987860916041288. The number of workers will be between 1 and 1000.
May 25, 2018 12:10:07 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T00:09:49.920Z: Autoscaling was automatically enabled for job 2018-05-24_17_09_49-4612987860916041288.
May 25, 2018 12:10:07 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T00:09:52.212Z: Checking required Cloud APIs are enabled.
May 25, 2018 12:10:07 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T00:09:52.391Z: Checking permissions granted to controller Service Account.
May 25, 2018 12:10:07 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T00:09:56.465Z: Worker configuration: n1-standard-1 in us-central1-f.
May 25, 2018 12:10:07 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T00:09:56.839Z: Expanding CoGroupByKey operations into optimizable parts.
May 25, 2018 12:10:07 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T00:09:57.018Z: Expanding GroupByKey operations into optimizable parts.
May 25, 2018 12:10:07 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T00:09:57.069Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
May 25, 2018 12:10:07 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T00:09:57.314Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
May 25, 2018 12:10:07 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T00:09:57.364Z: Elided trivial flatten
May 25, 2018 12:10:07 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T00:09:57.404Z: Elided trivial flatten
May 25, 2018 12:10:07 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T00:09:57.444Z: Elided trivial flatten
May 25, 2018 12:10:07 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T00:09:57.495Z: Unzipping flatten s24 for input s19.org.apache.beam.sdk.values.PCollection.<init>:329#8fd0f908e3ea90e3
May 25, 2018 12:10:07 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T00:09:57.547Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Reify, through flatten PAssert$33/GroupGlobally/FlattenDummyAndContents, into producer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map
May 25, 2018 12:10:07 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T00:09:57.587Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow into PAssert$33/GroupGlobally/GroupDummyAndContents/Read
May 25, 2018 12:10:07 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T00:09:57.629Z: Fusing consumer PAssert$33/GroupGlobally/ParDo(Concat) into PAssert$33/GroupGlobally/Values/Values/Map
May 25, 2018 12:10:07 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T00:09:57.678Z: Fusing consumer PAssert$33/GetPane/Map into PAssert$33/GroupGlobally/ParDo(Concat)
May 25, 2018 12:10:07 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T00:09:57.721Z: Fusing consumer PAssert$33/GroupGlobally/Values/Values/Map into PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow
May 25, 2018 12:10:07 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T00:09:57.766Z: Fusing consumer PAssert$33/RunChecks into PAssert$33/GetPane/Map
May 25, 2018 12:10:07 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T00:09:57.818Z: Fusing consumer PAssert$33/VerifyAssertions/ParDo(DefaultConclude) into PAssert$33/RunChecks
May 25, 2018 12:10:07 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T00:09:57.872Z: Unzipping flatten s24-u45 for input s26-reify-value18-c43
May 25, 2018 12:10:07 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T00:09:57.919Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Write, through flatten s24-u45, into producer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 25, 2018 12:10:07 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T00:09:57.973Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify into PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
May 25, 2018 12:10:07 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T00:09:58.015Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Write into PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 25, 2018 12:10:07 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T00:09:58.063Z: Fusing consumer PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)
May 25, 2018 12:10:07 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T00:09:58.112Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
May 25, 2018 12:10:07 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T00:09:58.155Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
May 25, 2018 12:10:07 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T00:09:58.206Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into PAssert$33/GroupGlobally/Window.Into()/Window.Assign
May 25, 2018 12:10:07 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T00:09:58.250Z: Fusing consumer OutputSideInputs into Create123/Read(CreateSource)
May 25, 2018 12:10:07 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T00:09:58.300Z: Fusing consumer PAssert$33/GroupGlobally/Window.Into()/Window.Assign into OutputSideInputs
May 25, 2018 12:10:07 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T00:09:58.351Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
May 25, 2018 12:10:07 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T00:09:58.396Z: Fusing consumer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map into PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
May 25, 2018 12:10:07 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T00:09:58.442Z: Fusing consumer PAssert$33/GroupGlobally/RewindowActuals/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map
May 25, 2018 12:10:07 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T00:09:58.492Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read
May 25, 2018 12:10:07 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T00:09:58.530Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
May 25, 2018 12:10:07 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T00:09:58.580Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
May 25, 2018 12:10:07 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T00:09:58.620Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
May 25, 2018 12:10:07 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T00:09:58.668Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
May 25, 2018 12:10:07 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T00:09:58.717Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
May 25, 2018 12:10:07 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T00:09:58.771Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into Create47/Read(CreateSource)
May 25, 2018 12:10:07 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T00:09:58.794Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
May 25, 2018 12:10:07 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T00:09:58.840Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
May 25, 2018 12:10:07 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T00:09:58.884Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
May 25, 2018 12:10:07 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T00:09:58.920Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
May 25, 2018 12:10:07 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T00:09:58.962Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
May 25, 2018 12:10:07 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T00:09:59.000Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
May 25, 2018 12:10:07 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T00:09:59.462Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Create
May 25, 2018 12:10:07 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T00:09:59.512Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Create
May 25, 2018 12:10:07 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T00:09:59.579Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
May 25, 2018 12:10:07 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T00:09:59.604Z: Starting 1 workers in us-central1-f...
May 25, 2018 12:10:07 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T00:09:59.642Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
May 25, 2018 12:10:07 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T00:09:59.891Z: Executing operation Create47/Read(CreateSource)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
May 25, 2018 12:10:07 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T00:09:59.941Z: Executing operation PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 25, 2018 12:10:07 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T00:10:06.091Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
May 25, 2018 12:10:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T00:10:16.452Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
May 25, 2018 12:10:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T00:10:16.492Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 25, 2018 12:10:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T00:10:46.149Z: Workers have started successfully.
May 25, 2018 12:11:07 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T00:11:07.048Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
May 25, 2018 12:11:07 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T00:11:07.143Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
May 25, 2018 12:11:14 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T00:11:13.778Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
May 25, 2018 12:11:14 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T00:11:13.884Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
May 25, 2018 12:11:26 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T00:11:25.212Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
May 25, 2018 12:11:26 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T00:11:25.500Z: Executing operation Create123/Read(CreateSource)+OutputSideInputs+PAssert$33/GroupGlobally/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write
May 25, 2018 12:11:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T00:11:31.299Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Close
May 25, 2018 12:11:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T00:11:31.399Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$33/GroupGlobally/RewindowActuals/Window.Assign+PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 25, 2018 12:11:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T00:11:35.130Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Close
May 25, 2018 12:11:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T00:11:35.259Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Read+PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$33/GroupGlobally/Values/Values/Map+PAssert$33/GroupGlobally/ParDo(Concat)+PAssert$33/GetPane/Map+PAssert$33/RunChecks+PAssert$33/VerifyAssertions/ParDo(DefaultConclude)
May 25, 2018 12:11:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T00:11:37.509Z: Cleaning up.
May 25, 2018 12:11:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T00:11:37.623Z: Stopping worker pool...
May 25, 2018 12:12:55 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T00:12:54.946Z: Autoscaling: Resized worker pool from 1 to 0.
May 25, 2018 12:12:55 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-25T00:12:54.986Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 25, 2018 12:13:04 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-05-24_17_09_49-4612987860916041288 finished with status DONE.
May 25, 2018 12:13:05 AM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-05-24_17_09_49-4612987860916041288. Found 1 success, 0 failures out of 1 expected assertions.
Gradle Test Executor 42 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest FAILED
209 tests completed, 34 failed, 2 skipped
Finished generating test XML results (0.688 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerTest>
Generating HTML test report...
Finished generating test html results (0.363 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest>
:beam-runners-google-cloud-dataflow-java:validatesRunnerTest (Thread[Task worker for ':' Thread 8,5,main]) completed. Took 2 hrs 7 mins 7.171 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:validatesRunnerTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 8m 1s
38 actionable tasks: 36 executed, 2 from cache
Publishing build scan...
https://gradle.com/s/re7mvwwffdeeq
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user robbe.sneyders@ml6.eu
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user schroederc@google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user sidhom@google.com
Build failed in Jenkins:
beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #340
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/340/display/redirect?page=changes>
Changes:
[schroederc] Use ElementEncoders for beam.Create
[schroederc] Add test case for proto oneof fields in create_test.go
------------------------------------------
[...truncated 17.98 MB...]
May 24, 2018 10:00:58 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign as step s15
May 24, 2018 10:00:58 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey as step s16
May 24, 2018 10:00:58 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map as step s17
May 24, 2018 10:00:58 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RewindowActuals/Window.Assign as step s18
May 24, 2018 10:00:58 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map as step s19
May 24, 2018 10:00:58 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveActualsTriggering/Flatten.PCollections as step s20
May 24, 2018 10:00:58 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Create.Values/Read(CreateSource) as step s21
May 24, 2018 10:00:58 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign as step s22
May 24, 2018 10:00:58 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveDummyTriggering/Flatten.PCollections as step s23
May 24, 2018 10:00:58 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/FlattenDummyAndContents as step s24
May 24, 2018 10:00:58 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/NeverTrigger/Flatten.PCollections as step s25
May 24, 2018 10:00:58 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GroupDummyAndContents as step s26
May 24, 2018 10:00:58 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Values/Values/Map as step s27
May 24, 2018 10:00:58 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/ParDo(Concat) as step s28
May 24, 2018 10:00:58 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GetPane/Map as step s29
May 24, 2018 10:00:58 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/RunChecks as step s30
May 24, 2018 10:00:58 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/VerifyAssertions/ParDo(DefaultConclude) as step s31
May 24, 2018 10:00:58 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0524220052-d26ba83e/output/results/staging/
May 24, 2018 10:00:59 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <71120 bytes, hash RD0lOwHI0W7S-BwZnLTysQ> to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0524220052-d26ba83e/output/results/staging/pipeline-RD0lOwHI0W7S-BwZnLTysQ.pb
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 24, 2018 10:01:00 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-05-24_15_00_59-17256475416120802083?project=apache-beam-testing
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Submitted job: 2018-05-24_15_00_59-17256475416120802083
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 24, 2018 10:01:00 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-05-24_15_00_59-17256475416120802083
May 24, 2018 10:01:00 PM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-05-24_15_00_59-17256475416120802083 with 1 expected assertions.
May 24, 2018 10:01:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T22:00:59.613Z: Autoscaling is enabled for job 2018-05-24_15_00_59-17256475416120802083. The number of workers will be between 1 and 1000.
May 24, 2018 10:01:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T22:00:59.656Z: Autoscaling was automatically enabled for job 2018-05-24_15_00_59-17256475416120802083.
May 24, 2018 10:01:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T22:01:02.605Z: Checking required Cloud APIs are enabled.
May 24, 2018 10:01:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T22:01:02.881Z: Checking permissions granted to controller Service Account.
May 24, 2018 10:01:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T22:01:07.312Z: Worker configuration: n1-standard-1 in us-central1-b.
May 24, 2018 10:01:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T22:01:07.767Z: Expanding CoGroupByKey operations into optimizable parts.
May 24, 2018 10:01:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T22:01:07.941Z: Expanding GroupByKey operations into optimizable parts.
May 24, 2018 10:01:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T22:01:07.990Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
May 24, 2018 10:01:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T22:01:08.258Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
May 24, 2018 10:01:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T22:01:08.312Z: Elided trivial flatten
May 24, 2018 10:01:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T22:01:08.362Z: Elided trivial flatten
May 24, 2018 10:01:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T22:01:08.406Z: Elided trivial flatten
May 24, 2018 10:01:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T22:01:08.461Z: Unzipping flatten s24 for input s19.org.apache.beam.sdk.values.PCollection.<init>:329#8fd0f908e3ea90e3
May 24, 2018 10:01:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T22:01:08.507Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Reify, through flatten PAssert$33/GroupGlobally/FlattenDummyAndContents, into producer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map
May 24, 2018 10:01:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T22:01:08.559Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow into PAssert$33/GroupGlobally/GroupDummyAndContents/Read
May 24, 2018 10:01:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T22:01:08.606Z: Fusing consumer PAssert$33/GroupGlobally/ParDo(Concat) into PAssert$33/GroupGlobally/Values/Values/Map
May 24, 2018 10:01:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T22:01:08.654Z: Fusing consumer PAssert$33/GetPane/Map into PAssert$33/GroupGlobally/ParDo(Concat)
May 24, 2018 10:01:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T22:01:08.686Z: Fusing consumer PAssert$33/GroupGlobally/Values/Values/Map into PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow
May 24, 2018 10:01:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T22:01:08.738Z: Fusing consumer PAssert$33/RunChecks into PAssert$33/GetPane/Map
May 24, 2018 10:01:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T22:01:08.785Z: Fusing consumer PAssert$33/VerifyAssertions/ParDo(DefaultConclude) into PAssert$33/RunChecks
May 24, 2018 10:01:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T22:01:08.837Z: Unzipping flatten s24-u45 for input s26-reify-value18-c43
May 24, 2018 10:01:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T22:01:08.891Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Write, through flatten s24-u45, into producer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 24, 2018 10:01:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T22:01:08.944Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify into PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
May 24, 2018 10:01:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T22:01:08.994Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Write into PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 24, 2018 10:01:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T22:01:09.049Z: Fusing consumer PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)
May 24, 2018 10:01:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T22:01:09.100Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
May 24, 2018 10:01:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T22:01:09.159Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
May 24, 2018 10:01:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T22:01:09.190Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into PAssert$33/GroupGlobally/Window.Into()/Window.Assign
May 24, 2018 10:01:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T22:01:09.235Z: Fusing consumer OutputSideInputs into Create123/Read(CreateSource)
May 24, 2018 10:01:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T22:01:09.285Z: Fusing consumer PAssert$33/GroupGlobally/Window.Into()/Window.Assign into OutputSideInputs
May 24, 2018 10:01:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T22:01:09.336Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
May 24, 2018 10:01:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T22:01:09.374Z: Fusing consumer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map into PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
May 24, 2018 10:01:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T22:01:09.414Z: Fusing consumer PAssert$33/GroupGlobally/RewindowActuals/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map
May 24, 2018 10:01:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T22:01:09.464Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read
May 24, 2018 10:01:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T22:01:09.513Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
May 24, 2018 10:01:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T22:01:09.552Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
May 24, 2018 10:01:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T22:01:09.602Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
May 24, 2018 10:01:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T22:01:09.648Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
May 24, 2018 10:01:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T22:01:09.683Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
May 24, 2018 10:01:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T22:01:09.734Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into Create47/Read(CreateSource)
May 24, 2018 10:01:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T22:01:09.783Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
May 24, 2018 10:01:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T22:01:09.825Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
May 24, 2018 10:01:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T22:01:09.869Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
May 24, 2018 10:01:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T22:01:09.908Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
May 24, 2018 10:01:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T22:01:09.947Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
May 24, 2018 10:01:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T22:01:09.995Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
May 24, 2018 10:01:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T22:01:10.488Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Create
May 24, 2018 10:01:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T22:01:10.528Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Create
May 24, 2018 10:01:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T22:01:10.567Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
May 24, 2018 10:01:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T22:01:10.590Z: Starting 1 workers in us-central1-b...
May 24, 2018 10:01:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T22:01:10.610Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
May 24, 2018 10:01:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T22:01:10.886Z: Executing operation Create47/Read(CreateSource)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
May 24, 2018 10:01:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T22:01:10.944Z: Executing operation PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 24, 2018 10:01:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T22:01:18.028Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
May 24, 2018 10:01:56 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T22:01:54.647Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
May 24, 2018 10:01:56 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T22:01:54.679Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 24, 2018 10:02:24 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T22:02:21.651Z: Workers have started successfully.
May 24, 2018 10:02:46 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T22:02:45.324Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
May 24, 2018 10:02:46 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T22:02:45.430Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
May 24, 2018 10:02:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T22:02:52.590Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
May 24, 2018 10:02:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T22:02:52.687Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
May 24, 2018 10:03:06 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T22:03:05.235Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
May 24, 2018 10:03:06 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T22:03:05.439Z: Executing operation Create123/Read(CreateSource)+OutputSideInputs+PAssert$33/GroupGlobally/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write
May 24, 2018 10:03:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T22:03:11.051Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Close
May 24, 2018 10:03:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T22:03:11.146Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$33/GroupGlobally/RewindowActuals/Window.Assign+PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 24, 2018 10:03:15 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T22:03:13.996Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Close
May 24, 2018 10:03:15 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T22:03:14.085Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Read+PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$33/GroupGlobally/Values/Values/Map+PAssert$33/GroupGlobally/ParDo(Concat)+PAssert$33/GetPane/Map+PAssert$33/RunChecks+PAssert$33/VerifyAssertions/ParDo(DefaultConclude)
May 24, 2018 10:03:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T22:03:15.435Z: Cleaning up.
May 24, 2018 10:03:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T22:03:15.552Z: Stopping worker pool...
May 24, 2018 10:04:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T22:04:40.312Z: Autoscaling: Resized worker pool from 1 to 0.
May 24, 2018 10:04:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T22:04:40.356Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 24, 2018 10:04:49 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-05-24_15_00_59-17256475416120802083 finished with status DONE.
May 24, 2018 10:04:50 PM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-05-24_15_00_59-17256475416120802083. Found 1 success, 0 failures out of 1 expected assertions.
Gradle Test Executor 38 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest
209 tests completed, 34 failed, 2 skipped
Finished generating test XML results (0.683 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerTest>
Generating HTML test report...
Finished generating test html results (0.438 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest>
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest FAILED
:beam-runners-google-cloud-dataflow-java:validatesRunnerTest (Thread[Task worker for ':' Thread 15,5,main]) completed. Took 2 hrs 12 mins 10.996 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:validatesRunnerTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 13m 15s
38 actionable tasks: 34 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/vd7nbrpnwlwhu
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user robbe.sneyders@ml6.eu
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user schroederc@google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user sidhom@google.com
Build failed in Jenkins:
beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #339
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/339/display/redirect?page=changes>
Changes:
[tgroh] Add an InProcessEnvironmentFactory
[tgroh] Update InProcessManagedChannelFactory
[tgroh] Add a RemoteStageEvaluatorFactory
[tgroh] Move InProcessEnvironmentFactory to java-fn-execution
------------------------------------------
[...truncated 17.96 MB...]
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map as step s14
May 24, 2018 7:47:41 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign as step s15
May 24, 2018 7:47:41 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey as step s16
May 24, 2018 7:47:41 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map as step s17
May 24, 2018 7:47:41 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RewindowActuals/Window.Assign as step s18
May 24, 2018 7:47:41 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map as step s19
May 24, 2018 7:47:41 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveActualsTriggering/Flatten.PCollections as step s20
May 24, 2018 7:47:41 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Create.Values/Read(CreateSource) as step s21
May 24, 2018 7:47:41 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign as step s22
May 24, 2018 7:47:41 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveDummyTriggering/Flatten.PCollections as step s23
May 24, 2018 7:47:41 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/FlattenDummyAndContents as step s24
May 24, 2018 7:47:41 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/NeverTrigger/Flatten.PCollections as step s25
May 24, 2018 7:47:41 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GroupDummyAndContents as step s26
May 24, 2018 7:47:41 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Values/Values/Map as step s27
May 24, 2018 7:47:41 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/ParDo(Concat) as step s28
May 24, 2018 7:47:41 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GetPane/Map as step s29
May 24, 2018 7:47:41 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/RunChecks as step s30
May 24, 2018 7:47:41 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/VerifyAssertions/ParDo(DefaultConclude) as step s31
May 24, 2018 7:47:41 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0524194735-646ae93c/output/results/staging/
May 24, 2018 7:47:41 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <71120 bytes, hash -DerEyNgAMYpLnLh4Yz0xA> to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0524194735-646ae93c/output/results/staging/pipeline--DerEyNgAMYpLnLh4Yz0xA.pb
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 24, 2018 7:47:43 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-05-24_12_47_41-1262897970622296428?project=apache-beam-testing
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Submitted job: 2018-05-24_12_47_41-1262897970622296428
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 24, 2018 7:47:43 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-05-24_12_47_41-1262897970622296428
May 24, 2018 7:47:43 PM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-05-24_12_47_41-1262897970622296428 with 1 expected assertions.
May 24, 2018 7:47:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T19:47:41.908Z: Autoscaling is enabled for job 2018-05-24_12_47_41-1262897970622296428. The number of workers will be between 1 and 1000.
May 24, 2018 7:47:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T19:47:42.050Z: Autoscaling was automatically enabled for job 2018-05-24_12_47_41-1262897970622296428.
May 24, 2018 7:47:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T19:47:44.716Z: Checking required Cloud APIs are enabled.
May 24, 2018 7:47:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T19:47:44.954Z: Checking permissions granted to controller Service Account.
May 24, 2018 7:47:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T19:47:48.497Z: Worker configuration: n1-standard-1 in us-central1-b.
May 24, 2018 7:47:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T19:47:48.821Z: Expanding CoGroupByKey operations into optimizable parts.
May 24, 2018 7:47:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T19:47:48.924Z: Expanding GroupByKey operations into optimizable parts.
May 24, 2018 7:47:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T19:47:48.952Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
May 24, 2018 7:47:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T19:47:49.126Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
May 24, 2018 7:47:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T19:47:49.158Z: Elided trivial flatten
May 24, 2018 7:47:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T19:47:49.180Z: Elided trivial flatten
May 24, 2018 7:47:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T19:47:49.217Z: Elided trivial flatten
May 24, 2018 7:47:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T19:47:49.247Z: Unzipping flatten s24 for input s19.org.apache.beam.sdk.values.PCollection.<init>:329#8fd0f908e3ea90e3
May 24, 2018 7:47:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T19:47:49.275Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Reify, through flatten PAssert$33/GroupGlobally/FlattenDummyAndContents, into producer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map
May 24, 2018 7:47:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T19:47:49.304Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow into PAssert$33/GroupGlobally/GroupDummyAndContents/Read
May 24, 2018 7:47:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T19:47:49.345Z: Fusing consumer PAssert$33/GroupGlobally/ParDo(Concat) into PAssert$33/GroupGlobally/Values/Values/Map
May 24, 2018 7:47:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T19:47:49.379Z: Fusing consumer PAssert$33/GetPane/Map into PAssert$33/GroupGlobally/ParDo(Concat)
May 24, 2018 7:47:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T19:47:49.401Z: Fusing consumer PAssert$33/GroupGlobally/Values/Values/Map into PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow
May 24, 2018 7:47:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T19:47:49.434Z: Fusing consumer PAssert$33/RunChecks into PAssert$33/GetPane/Map
May 24, 2018 7:47:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T19:47:49.468Z: Fusing consumer PAssert$33/VerifyAssertions/ParDo(DefaultConclude) into PAssert$33/RunChecks
May 24, 2018 7:47:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T19:47:49.490Z: Unzipping flatten s24-u45 for input s26-reify-value18-c43
May 24, 2018 7:47:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T19:47:49.516Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Write, through flatten s24-u45, into producer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 24, 2018 7:47:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T19:47:49.549Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify into PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
May 24, 2018 7:47:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T19:47:49.579Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Write into PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 24, 2018 7:47:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T19:47:49.609Z: Fusing consumer PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)
May 24, 2018 7:47:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T19:47:49.641Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
May 24, 2018 7:47:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T19:47:49.667Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
May 24, 2018 7:47:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T19:47:49.700Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into PAssert$33/GroupGlobally/Window.Into()/Window.Assign
May 24, 2018 7:47:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T19:47:49.721Z: Fusing consumer OutputSideInputs into Create123/Read(CreateSource)
May 24, 2018 7:47:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T19:47:49.752Z: Fusing consumer PAssert$33/GroupGlobally/Window.Into()/Window.Assign into OutputSideInputs
May 24, 2018 7:47:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T19:47:49.784Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
May 24, 2018 7:47:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T19:47:49.816Z: Fusing consumer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map into PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
May 24, 2018 7:47:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T19:47:49.841Z: Fusing consumer PAssert$33/GroupGlobally/RewindowActuals/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map
May 24, 2018 7:47:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T19:47:49.864Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read
May 24, 2018 7:47:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T19:47:49.893Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
May 24, 2018 7:47:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T19:47:49.917Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
May 24, 2018 7:47:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T19:47:49.943Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
May 24, 2018 7:47:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T19:47:49.961Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
May 24, 2018 7:47:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T19:47:49.990Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
May 24, 2018 7:47:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T19:47:50.014Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into Create47/Read(CreateSource)
May 24, 2018 7:47:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T19:47:50.047Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
May 24, 2018 7:47:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T19:47:50.077Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
May 24, 2018 7:47:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T19:47:50.100Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
May 24, 2018 7:47:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T19:47:50.123Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
May 24, 2018 7:47:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T19:47:50.147Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
May 24, 2018 7:47:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T19:47:50.171Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
May 24, 2018 7:47:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T19:47:50.479Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Create
May 24, 2018 7:47:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T19:47:50.507Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Create
May 24, 2018 7:47:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T19:47:50.527Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
May 24, 2018 7:47:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T19:47:50.544Z: Starting 1 workers in us-central1-b...
May 24, 2018 7:47:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T19:47:50.558Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
May 24, 2018 7:47:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T19:47:50.707Z: Executing operation PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 24, 2018 7:47:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T19:47:50.735Z: Executing operation Create47/Read(CreateSource)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
May 24, 2018 7:47:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T19:47:57.515Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
May 24, 2018 7:48:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T19:48:08.005Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
May 24, 2018 7:48:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T19:48:08.031Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 24, 2018 7:48:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T19:48:32.563Z: Workers have started successfully.
May 24, 2018 7:48:49 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T19:48:48.747Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
May 24, 2018 7:48:49 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T19:48:48.836Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
May 24, 2018 7:48:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T19:48:55.925Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
May 24, 2018 7:48:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T19:48:56.034Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
May 24, 2018 7:49:06 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T19:49:06.194Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
May 24, 2018 7:49:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T19:49:06.448Z: Executing operation Create123/Read(CreateSource)+OutputSideInputs+PAssert$33/GroupGlobally/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write
May 24, 2018 7:49:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T19:49:13.011Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Close
May 24, 2018 7:49:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T19:49:13.118Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$33/GroupGlobally/RewindowActuals/Window.Assign+PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 24, 2018 7:49:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T19:49:15.877Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Close
May 24, 2018 7:49:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T19:49:15.965Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Read+PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$33/GroupGlobally/Values/Values/Map+PAssert$33/GroupGlobally/ParDo(Concat)+PAssert$33/GetPane/Map+PAssert$33/RunChecks+PAssert$33/VerifyAssertions/ParDo(DefaultConclude)
May 24, 2018 7:49:22 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T19:49:22.151Z: Cleaning up.
May 24, 2018 7:49:22 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T19:49:22.257Z: Stopping worker pool...
May 24, 2018 7:51:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T19:51:14.023Z: Autoscaling: Resized worker pool from 1 to 0.
May 24, 2018 7:51:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T19:51:14.044Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 24, 2018 7:51:22 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-05-24_12_47_41-1262897970622296428 finished with status DONE.
May 24, 2018 7:51:22 PM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-05-24_12_47_41-1262897970622296428. Found 1 success, 0 failures out of 1 expected assertions.
Gradle Test Executor 38 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest
209 tests completed, 36 failed, 2 skipped
Finished generating test XML results (0.675 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerTest>
Generating HTML test report...
Finished generating test html results (0.928 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest>
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest FAILED
:beam-runners-google-cloud-dataflow-java:validatesRunnerTest (Thread[Task worker for ':' Thread 40,5,main]) completed. Took 2 hrs 13 mins 38.998 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:validatesRunnerTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 14m 42s
38 actionable tasks: 34 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/igkc4vvzbtoou
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user robbe.sneyders@ml6.eu
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user sidhom@google.com
Build failed in Jenkins:
beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #338
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/338/display/redirect?page=changes>
Changes:
[boyuanz] Solve BEAM-4393: Missing copyright notices for shaded packages
------------------------------------------
[...truncated 17.93 MB...]
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map as step s14
May 24, 2018 5:33:07 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign as step s15
May 24, 2018 5:33:07 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey as step s16
May 24, 2018 5:33:07 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map as step s17
May 24, 2018 5:33:07 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RewindowActuals/Window.Assign as step s18
May 24, 2018 5:33:07 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map as step s19
May 24, 2018 5:33:07 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveActualsTriggering/Flatten.PCollections as step s20
May 24, 2018 5:33:07 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Create.Values/Read(CreateSource) as step s21
May 24, 2018 5:33:07 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign as step s22
May 24, 2018 5:33:07 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveDummyTriggering/Flatten.PCollections as step s23
May 24, 2018 5:33:07 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/FlattenDummyAndContents as step s24
May 24, 2018 5:33:07 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/NeverTrigger/Flatten.PCollections as step s25
May 24, 2018 5:33:07 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GroupDummyAndContents as step s26
May 24, 2018 5:33:07 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Values/Values/Map as step s27
May 24, 2018 5:33:07 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/ParDo(Concat) as step s28
May 24, 2018 5:33:07 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GetPane/Map as step s29
May 24, 2018 5:33:07 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/RunChecks as step s30
May 24, 2018 5:33:07 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/VerifyAssertions/ParDo(DefaultConclude) as step s31
May 24, 2018 5:33:07 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0524173300-ca4165e3/output/results/staging/
May 24, 2018 5:33:07 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <71120 bytes, hash RQ9NqdyVEi5LqmMdLlxOrA> to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0524173300-ca4165e3/output/results/staging/pipeline-RQ9NqdyVEi5LqmMdLlxOrA.pb
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 24, 2018 5:33:09 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-05-24_10_33_08-11442287894219628733?project=apache-beam-testing
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Submitted job: 2018-05-24_10_33_08-11442287894219628733
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 24, 2018 5:33:09 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-05-24_10_33_08-11442287894219628733
May 24, 2018 5:33:09 PM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-05-24_10_33_08-11442287894219628733 with 1 expected assertions.
May 24, 2018 5:33:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T17:33:08.449Z: Autoscaling is enabled for job 2018-05-24_10_33_08-11442287894219628733. The number of workers will be between 1 and 1000.
May 24, 2018 5:33:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T17:33:08.501Z: Autoscaling was automatically enabled for job 2018-05-24_10_33_08-11442287894219628733.
May 24, 2018 5:33:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T17:33:11.209Z: Checking required Cloud APIs are enabled.
May 24, 2018 5:33:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T17:33:11.404Z: Checking permissions granted to controller Service Account.
May 24, 2018 5:33:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T17:33:17.045Z: Worker configuration: n1-standard-1 in us-central1-b.
May 24, 2018 5:33:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T17:33:17.544Z: Expanding CoGroupByKey operations into optimizable parts.
May 24, 2018 5:33:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T17:33:17.737Z: Expanding GroupByKey operations into optimizable parts.
May 24, 2018 5:33:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T17:33:17.777Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
May 24, 2018 5:33:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T17:33:17.994Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
May 24, 2018 5:33:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T17:33:18.026Z: Elided trivial flatten
May 24, 2018 5:33:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T17:33:18.072Z: Elided trivial flatten
May 24, 2018 5:33:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T17:33:18.120Z: Elided trivial flatten
May 24, 2018 5:33:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T17:33:18.171Z: Unzipping flatten s24 for input s19.org.apache.beam.sdk.values.PCollection.<init>:329#8fd0f908e3ea90e3
May 24, 2018 5:33:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T17:33:18.212Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Reify, through flatten PAssert$33/GroupGlobally/FlattenDummyAndContents, into producer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map
May 24, 2018 5:33:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T17:33:18.258Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow into PAssert$33/GroupGlobally/GroupDummyAndContents/Read
May 24, 2018 5:33:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T17:33:18.306Z: Fusing consumer PAssert$33/GroupGlobally/ParDo(Concat) into PAssert$33/GroupGlobally/Values/Values/Map
May 24, 2018 5:33:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T17:33:18.348Z: Fusing consumer PAssert$33/GetPane/Map into PAssert$33/GroupGlobally/ParDo(Concat)
May 24, 2018 5:33:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T17:33:18.395Z: Fusing consumer PAssert$33/GroupGlobally/Values/Values/Map into PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow
May 24, 2018 5:33:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T17:33:18.444Z: Fusing consumer PAssert$33/RunChecks into PAssert$33/GetPane/Map
May 24, 2018 5:33:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T17:33:18.485Z: Fusing consumer PAssert$33/VerifyAssertions/ParDo(DefaultConclude) into PAssert$33/RunChecks
May 24, 2018 5:33:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T17:33:18.546Z: Unzipping flatten s24-u45 for input s26-reify-value18-c43
May 24, 2018 5:33:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T17:33:18.592Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Write, through flatten s24-u45, into producer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 24, 2018 5:33:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T17:33:18.637Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify into PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
May 24, 2018 5:33:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T17:33:18.687Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Write into PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 24, 2018 5:33:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T17:33:18.740Z: Fusing consumer PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)
May 24, 2018 5:33:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T17:33:18.783Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
May 24, 2018 5:33:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T17:33:18.829Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
May 24, 2018 5:33:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T17:33:18.874Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into PAssert$33/GroupGlobally/Window.Into()/Window.Assign
May 24, 2018 5:33:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T17:33:18.924Z: Fusing consumer OutputSideInputs into Create123/Read(CreateSource)
May 24, 2018 5:33:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T17:33:18.971Z: Fusing consumer PAssert$33/GroupGlobally/Window.Into()/Window.Assign into OutputSideInputs
May 24, 2018 5:33:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T17:33:19.010Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
May 24, 2018 5:33:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T17:33:19.059Z: Fusing consumer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map into PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
May 24, 2018 5:33:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T17:33:19.104Z: Fusing consumer PAssert$33/GroupGlobally/RewindowActuals/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map
May 24, 2018 5:33:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T17:33:19.151Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read
May 24, 2018 5:33:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T17:33:19.198Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
May 24, 2018 5:33:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T17:33:19.243Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
May 24, 2018 5:33:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T17:33:19.290Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
May 24, 2018 5:33:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T17:33:19.337Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
May 24, 2018 5:33:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T17:33:19.384Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
May 24, 2018 5:33:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T17:33:19.419Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into Create47/Read(CreateSource)
May 24, 2018 5:33:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T17:33:19.465Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
May 24, 2018 5:33:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T17:33:19.513Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
May 24, 2018 5:33:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T17:33:19.557Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
May 24, 2018 5:33:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T17:33:19.618Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
May 24, 2018 5:33:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T17:33:19.661Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
May 24, 2018 5:33:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T17:33:19.709Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
May 24, 2018 5:33:22 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T17:33:20.170Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Create
May 24, 2018 5:33:22 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T17:33:20.215Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Create
May 24, 2018 5:33:22 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T17:33:20.266Z: Starting 1 workers in us-central1-b...
May 24, 2018 5:33:22 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T17:33:20.266Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
May 24, 2018 5:33:22 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T17:33:20.313Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
May 24, 2018 5:33:22 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T17:33:20.564Z: Executing operation Create47/Read(CreateSource)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
May 24, 2018 5:33:22 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T17:33:20.607Z: Executing operation PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 24, 2018 5:33:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T17:33:28.134Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
May 24, 2018 5:33:40 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T17:33:38.714Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
May 24, 2018 5:33:40 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T17:33:38.757Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 24, 2018 5:34:02 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T17:34:00.760Z: Workers have started successfully.
May 24, 2018 5:34:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T17:34:17.137Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
May 24, 2018 5:34:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T17:34:17.229Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
May 24, 2018 5:34:24 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T17:34:24.249Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
May 24, 2018 5:34:24 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T17:34:24.360Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
May 24, 2018 5:34:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T17:34:38.084Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
May 24, 2018 5:34:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T17:34:38.305Z: Executing operation Create123/Read(CreateSource)+OutputSideInputs+PAssert$33/GroupGlobally/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write
May 24, 2018 5:34:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T17:34:40.424Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Close
May 24, 2018 5:34:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T17:34:40.501Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$33/GroupGlobally/RewindowActuals/Window.Assign+PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 24, 2018 5:34:47 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T17:34:45.917Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Close
May 24, 2018 5:34:47 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T17:34:46.026Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Read+PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$33/GroupGlobally/Values/Values/Map+PAssert$33/GroupGlobally/ParDo(Concat)+PAssert$33/GetPane/Map+PAssert$33/RunChecks+PAssert$33/VerifyAssertions/ParDo(DefaultConclude)
May 24, 2018 5:34:50 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T17:34:49.954Z: Cleaning up.
May 24, 2018 5:34:50 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T17:34:50.074Z: Stopping worker pool...
May 24, 2018 5:36:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T17:36:16.298Z: Autoscaling: Resized worker pool from 1 to 0.
May 24, 2018 5:36:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T17:36:16.342Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 24, 2018 5:36:26 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-05-24_10_33_08-11442287894219628733 finished with status DONE.
May 24, 2018 5:36:27 PM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-05-24_10_33_08-11442287894219628733. Found 1 success, 0 failures out of 1 expected assertions.
Gradle Test Executor 38 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest
209 tests completed, 35 failed, 2 skipped
Finished generating test XML results (0.453 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerTest>
Generating HTML test report...
Finished generating test html results (0.508 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest>
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest FAILED
:beam-runners-google-cloud-dataflow-java:validatesRunnerTest (Thread[Task worker for ':' Thread 21,5,main]) completed. Took 2 hrs 9 mins 32.268 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:validatesRunnerTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 10m 34s
38 actionable tasks: 34 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/vafbbhkc2kkie
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user robbe.sneyders@ml6.eu
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user sidhom@google.com
Build failed in Jenkins:
beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #337
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/337/display/redirect>
------------------------------------------
[...truncated 18.04 MB...]
May 24, 2018 3:21:59 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) as step s13
May 24, 2018 3:21:59 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map as step s14
May 24, 2018 3:21:59 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign as step s15
May 24, 2018 3:21:59 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey as step s16
May 24, 2018 3:21:59 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map as step s17
May 24, 2018 3:21:59 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RewindowActuals/Window.Assign as step s18
May 24, 2018 3:21:59 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map as step s19
May 24, 2018 3:21:59 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveActualsTriggering/Flatten.PCollections as step s20
May 24, 2018 3:21:59 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Create.Values/Read(CreateSource) as step s21
May 24, 2018 3:21:59 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign as step s22
May 24, 2018 3:21:59 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveDummyTriggering/Flatten.PCollections as step s23
May 24, 2018 3:21:59 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/FlattenDummyAndContents as step s24
May 24, 2018 3:21:59 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/NeverTrigger/Flatten.PCollections as step s25
May 24, 2018 3:21:59 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GroupDummyAndContents as step s26
May 24, 2018 3:21:59 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Values/Values/Map as step s27
May 24, 2018 3:21:59 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/ParDo(Concat) as step s28
May 24, 2018 3:21:59 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GetPane/Map as step s29
May 24, 2018 3:21:59 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/RunChecks as step s30
May 24, 2018 3:21:59 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/VerifyAssertions/ParDo(DefaultConclude) as step s31
May 24, 2018 3:21:59 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0524152153-d5bce425/output/results/staging/
May 24, 2018 3:21:59 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <71120 bytes, hash vyurxz7s8s-jKDG6NL6Yrg> to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0524152153-d5bce425/output/results/staging/pipeline-vyurxz7s8s-jKDG6NL6Yrg.pb
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 24, 2018 3:22:00 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-05-24_08_21_59-3879208200103790821?project=apache-beam-testing
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Submitted job: 2018-05-24_08_21_59-3879208200103790821
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 24, 2018 3:22:00 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-05-24_08_21_59-3879208200103790821
May 24, 2018 3:22:00 PM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-05-24_08_21_59-3879208200103790821 with 1 expected assertions.
May 24, 2018 3:22:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T15:22:00.023Z: Autoscaling is enabled for job 2018-05-24_08_21_59-3879208200103790821. The number of workers will be between 1 and 1000.
May 24, 2018 3:22:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T15:22:00.057Z: Autoscaling was automatically enabled for job 2018-05-24_08_21_59-3879208200103790821.
May 24, 2018 3:22:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T15:22:02.509Z: Checking required Cloud APIs are enabled.
May 24, 2018 3:22:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T15:22:02.691Z: Checking permissions granted to controller Service Account.
May 24, 2018 3:22:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T15:22:08.473Z: Worker configuration: n1-standard-1 in us-central1-f.
May 24, 2018 3:22:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T15:22:08.851Z: Expanding CoGroupByKey operations into optimizable parts.
May 24, 2018 3:22:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T15:22:09.051Z: Expanding GroupByKey operations into optimizable parts.
May 24, 2018 3:22:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T15:22:09.098Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
May 24, 2018 3:22:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T15:22:09.338Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
May 24, 2018 3:22:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T15:22:09.378Z: Elided trivial flatten
May 24, 2018 3:22:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T15:22:09.428Z: Elided trivial flatten
May 24, 2018 3:22:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T15:22:09.471Z: Elided trivial flatten
May 24, 2018 3:22:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T15:22:09.518Z: Unzipping flatten s24 for input s19.org.apache.beam.sdk.values.PCollection.<init>:329#8fd0f908e3ea90e3
May 24, 2018 3:22:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T15:22:09.562Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Reify, through flatten PAssert$33/GroupGlobally/FlattenDummyAndContents, into producer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map
May 24, 2018 3:22:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T15:22:09.611Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow into PAssert$33/GroupGlobally/GroupDummyAndContents/Read
May 24, 2018 3:22:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T15:22:09.656Z: Fusing consumer PAssert$33/GroupGlobally/ParDo(Concat) into PAssert$33/GroupGlobally/Values/Values/Map
May 24, 2018 3:22:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T15:22:09.699Z: Fusing consumer PAssert$33/GetPane/Map into PAssert$33/GroupGlobally/ParDo(Concat)
May 24, 2018 3:22:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T15:22:09.738Z: Fusing consumer PAssert$33/GroupGlobally/Values/Values/Map into PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow
May 24, 2018 3:22:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T15:22:09.779Z: Fusing consumer PAssert$33/RunChecks into PAssert$33/GetPane/Map
May 24, 2018 3:22:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T15:22:09.827Z: Fusing consumer PAssert$33/VerifyAssertions/ParDo(DefaultConclude) into PAssert$33/RunChecks
May 24, 2018 3:22:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T15:22:09.864Z: Unzipping flatten s24-u45 for input s26-reify-value18-c43
May 24, 2018 3:22:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T15:22:09.911Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Write, through flatten s24-u45, into producer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 24, 2018 3:22:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T15:22:09.955Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify into PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
May 24, 2018 3:22:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T15:22:09.991Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Write into PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 24, 2018 3:22:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T15:22:10.034Z: Fusing consumer PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)
May 24, 2018 3:22:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T15:22:10.084Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
May 24, 2018 3:22:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T15:22:10.122Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
May 24, 2018 3:22:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T15:22:10.185Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into PAssert$33/GroupGlobally/Window.Into()/Window.Assign
May 24, 2018 3:22:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T15:22:10.227Z: Fusing consumer OutputSideInputs into Create123/Read(CreateSource)
May 24, 2018 3:22:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T15:22:10.277Z: Fusing consumer PAssert$33/GroupGlobally/Window.Into()/Window.Assign into OutputSideInputs
May 24, 2018 3:22:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T15:22:10.326Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
May 24, 2018 3:22:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T15:22:10.367Z: Fusing consumer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map into PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
May 24, 2018 3:22:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T15:22:10.418Z: Fusing consumer PAssert$33/GroupGlobally/RewindowActuals/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map
May 24, 2018 3:22:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T15:22:10.472Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read
May 24, 2018 3:22:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T15:22:10.517Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
May 24, 2018 3:22:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T15:22:10.568Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
May 24, 2018 3:22:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T15:22:10.603Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
May 24, 2018 3:22:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T15:22:10.640Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
May 24, 2018 3:22:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T15:22:10.687Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
May 24, 2018 3:22:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T15:22:10.725Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into Create47/Read(CreateSource)
May 24, 2018 3:22:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T15:22:10.769Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
May 24, 2018 3:22:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T15:22:10.811Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
May 24, 2018 3:22:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T15:22:10.862Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
May 24, 2018 3:22:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T15:22:10.908Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
May 24, 2018 3:22:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T15:22:10.953Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
May 24, 2018 3:22:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T15:22:10.998Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
May 24, 2018 3:22:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T15:22:11.467Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Create
May 24, 2018 3:22:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T15:22:11.507Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Create
May 24, 2018 3:22:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T15:22:11.543Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
May 24, 2018 3:22:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T15:22:11.568Z: Starting 1 workers in us-central1-f...
May 24, 2018 3:22:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T15:22:11.592Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
May 24, 2018 3:22:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T15:22:11.846Z: Executing operation Create47/Read(CreateSource)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
May 24, 2018 3:22:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T15:22:11.894Z: Executing operation PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 24, 2018 3:22:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T15:22:18.445Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
May 24, 2018 3:22:40 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T15:22:39.186Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
May 24, 2018 3:22:40 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T15:22:39.228Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 24, 2018 3:23:06 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T15:23:04.101Z: Workers have started successfully.
May 24, 2018 3:23:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T15:23:25.461Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
May 24, 2018 3:23:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T15:23:25.569Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
May 24, 2018 3:23:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T15:23:31.991Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
May 24, 2018 3:23:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T15:23:32.100Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
May 24, 2018 3:23:47 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T15:23:44.960Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
May 24, 2018 3:23:47 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T15:23:45.144Z: Executing operation Create123/Read(CreateSource)+OutputSideInputs+PAssert$33/GroupGlobally/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write
May 24, 2018 3:23:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T15:23:51.388Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Close
May 24, 2018 3:23:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T15:23:51.490Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$33/GroupGlobally/RewindowActuals/Window.Assign+PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 24, 2018 3:23:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T15:23:56.083Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Close
May 24, 2018 3:23:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T15:23:56.174Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Read+PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$33/GroupGlobally/Values/Values/Map+PAssert$33/GroupGlobally/ParDo(Concat)+PAssert$33/GetPane/Map+PAssert$33/RunChecks+PAssert$33/VerifyAssertions/ParDo(DefaultConclude)
May 24, 2018 3:24:03 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T15:24:02.414Z: Cleaning up.
May 24, 2018 3:24:03 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T15:24:02.525Z: Stopping worker pool...
May 24, 2018 3:25:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T15:25:28.929Z: Autoscaling: Resized worker pool from 1 to 0.
May 24, 2018 3:25:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T15:25:28.978Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 24, 2018 3:25:38 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-05-24_08_21_59-3879208200103790821 finished with status DONE.
May 24, 2018 3:25:38 PM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-05-24_08_21_59-3879208200103790821. Found 1 success, 0 failures out of 1 expected assertions.
Gradle Test Executor 38 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest FAILED
209 tests completed, 34 failed, 2 skipped
Finished generating test XML results (0.566 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerTest>
Generating HTML test report...
Finished generating test html results (0.338 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest>
:beam-runners-google-cloud-dataflow-java:validatesRunnerTest (Thread[Task worker for ':' Thread 10,5,main]) completed. Took 2 hrs 10 mins 33.919 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:validatesRunnerTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 11m 31s
38 actionable tasks: 34 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/d22tkbhshipyu
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user robbe.sneyders@ml6.eu
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user sidhom@google.com
Build failed in Jenkins:
beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #336
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/336/display/redirect?page=changes>
Changes:
[timrobertson100] [BEAM-4342] Enforce ErrorProne analysis in hadoop IO, and static
------------------------------------------
[...truncated 18.02 MB...]
May 24, 2018 1:09:43 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) as step s13
May 24, 2018 1:09:43 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map as step s14
May 24, 2018 1:09:43 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign as step s15
May 24, 2018 1:09:43 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey as step s16
May 24, 2018 1:09:43 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map as step s17
May 24, 2018 1:09:43 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RewindowActuals/Window.Assign as step s18
May 24, 2018 1:09:43 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map as step s19
May 24, 2018 1:09:43 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveActualsTriggering/Flatten.PCollections as step s20
May 24, 2018 1:09:43 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Create.Values/Read(CreateSource) as step s21
May 24, 2018 1:09:43 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign as step s22
May 24, 2018 1:09:43 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveDummyTriggering/Flatten.PCollections as step s23
May 24, 2018 1:09:43 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/FlattenDummyAndContents as step s24
May 24, 2018 1:09:43 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/NeverTrigger/Flatten.PCollections as step s25
May 24, 2018 1:09:43 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GroupDummyAndContents as step s26
May 24, 2018 1:09:43 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Values/Values/Map as step s27
May 24, 2018 1:09:43 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/ParDo(Concat) as step s28
May 24, 2018 1:09:43 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GetPane/Map as step s29
May 24, 2018 1:09:43 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/RunChecks as step s30
May 24, 2018 1:09:43 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/VerifyAssertions/ParDo(DefaultConclude) as step s31
May 24, 2018 1:09:43 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0524130937-265ee934/output/results/staging/
May 24, 2018 1:09:43 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <71120 bytes, hash 2teQQw1wINYSvgP0j3oq7g> to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0524130937-265ee934/output/results/staging/pipeline-2teQQw1wINYSvgP0j3oq7g.pb
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 24, 2018 1:09:44 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-05-24_06_09_43-9752993737486253309?project=apache-beam-testing
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Submitted job: 2018-05-24_06_09_43-9752993737486253309
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 24, 2018 1:09:44 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-05-24_06_09_43-9752993737486253309
May 24, 2018 1:09:44 PM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-05-24_06_09_43-9752993737486253309 with 1 expected assertions.
May 24, 2018 1:09:55 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T13:09:43.940Z: Autoscaling is enabled for job 2018-05-24_06_09_43-9752993737486253309. The number of workers will be between 1 and 1000.
May 24, 2018 1:09:55 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T13:09:43.985Z: Autoscaling was automatically enabled for job 2018-05-24_06_09_43-9752993737486253309.
May 24, 2018 1:09:55 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T13:09:46.499Z: Checking required Cloud APIs are enabled.
May 24, 2018 1:09:55 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T13:09:46.622Z: Checking permissions granted to controller Service Account.
May 24, 2018 1:09:55 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T13:09:50.710Z: Worker configuration: n1-standard-1 in us-central1-b.
May 24, 2018 1:09:55 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T13:09:51.212Z: Expanding CoGroupByKey operations into optimizable parts.
May 24, 2018 1:09:55 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T13:09:51.388Z: Expanding GroupByKey operations into optimizable parts.
May 24, 2018 1:09:55 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T13:09:51.435Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
May 24, 2018 1:09:55 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T13:09:51.642Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
May 24, 2018 1:09:55 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T13:09:51.678Z: Elided trivial flatten
May 24, 2018 1:09:55 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T13:09:51.724Z: Elided trivial flatten
May 24, 2018 1:09:55 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T13:09:51.752Z: Elided trivial flatten
May 24, 2018 1:09:55 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T13:09:51.799Z: Unzipping flatten s24 for input s19.org.apache.beam.sdk.values.PCollection.<init>:329#8fd0f908e3ea90e3
May 24, 2018 1:09:55 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T13:09:51.840Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Reify, through flatten PAssert$33/GroupGlobally/FlattenDummyAndContents, into producer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map
May 24, 2018 1:09:55 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T13:09:51.877Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow into PAssert$33/GroupGlobally/GroupDummyAndContents/Read
May 24, 2018 1:09:55 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T13:09:51.918Z: Fusing consumer PAssert$33/GroupGlobally/ParDo(Concat) into PAssert$33/GroupGlobally/Values/Values/Map
May 24, 2018 1:09:55 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T13:09:51.968Z: Fusing consumer PAssert$33/GetPane/Map into PAssert$33/GroupGlobally/ParDo(Concat)
May 24, 2018 1:09:55 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T13:09:52.003Z: Fusing consumer PAssert$33/GroupGlobally/Values/Values/Map into PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow
May 24, 2018 1:09:55 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T13:09:52.044Z: Fusing consumer PAssert$33/RunChecks into PAssert$33/GetPane/Map
May 24, 2018 1:09:55 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T13:09:52.091Z: Fusing consumer PAssert$33/VerifyAssertions/ParDo(DefaultConclude) into PAssert$33/RunChecks
May 24, 2018 1:09:55 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T13:09:52.139Z: Unzipping flatten s24-u45 for input s26-reify-value18-c43
May 24, 2018 1:09:55 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T13:09:52.183Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Write, through flatten s24-u45, into producer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 24, 2018 1:09:55 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T13:09:52.231Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify into PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
May 24, 2018 1:09:55 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T13:09:52.270Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Write into PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 24, 2018 1:09:55 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T13:09:52.314Z: Fusing consumer PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)
May 24, 2018 1:09:55 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T13:09:52.362Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
May 24, 2018 1:09:55 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T13:09:52.405Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
May 24, 2018 1:09:55 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T13:09:52.441Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into PAssert$33/GroupGlobally/Window.Into()/Window.Assign
May 24, 2018 1:09:55 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T13:09:52.484Z: Fusing consumer OutputSideInputs into Create123/Read(CreateSource)
May 24, 2018 1:09:55 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T13:09:52.528Z: Fusing consumer PAssert$33/GroupGlobally/Window.Into()/Window.Assign into OutputSideInputs
May 24, 2018 1:09:55 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T13:09:52.571Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
May 24, 2018 1:09:55 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T13:09:52.611Z: Fusing consumer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map into PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
May 24, 2018 1:09:55 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T13:09:52.650Z: Fusing consumer PAssert$33/GroupGlobally/RewindowActuals/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map
May 24, 2018 1:09:55 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T13:09:52.697Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read
May 24, 2018 1:09:55 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T13:09:52.748Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
May 24, 2018 1:09:55 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T13:09:52.788Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
May 24, 2018 1:09:55 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T13:09:52.834Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
May 24, 2018 1:09:55 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T13:09:52.880Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
May 24, 2018 1:09:55 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T13:09:52.923Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
May 24, 2018 1:09:55 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T13:09:52.959Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into Create47/Read(CreateSource)
May 24, 2018 1:09:55 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T13:09:53.007Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
May 24, 2018 1:09:55 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T13:09:53.042Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
May 24, 2018 1:09:55 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T13:09:53.089Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
May 24, 2018 1:09:55 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T13:09:53.137Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
May 24, 2018 1:09:55 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T13:09:53.182Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
May 24, 2018 1:09:55 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T13:09:53.225Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
May 24, 2018 1:09:55 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T13:09:53.658Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Create
May 24, 2018 1:09:55 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T13:09:53.706Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Create
May 24, 2018 1:09:55 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T13:09:53.743Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
May 24, 2018 1:09:55 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T13:09:53.743Z: Starting 1 workers in us-central1-b...
May 24, 2018 1:09:55 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T13:09:53.774Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
May 24, 2018 1:09:55 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T13:09:54.010Z: Executing operation PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 24, 2018 1:09:55 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T13:09:54.050Z: Executing operation Create47/Read(CreateSource)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
May 24, 2018 1:10:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T13:10:01.427Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
May 24, 2018 1:10:43 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T13:10:43.314Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
May 24, 2018 1:10:43 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T13:10:43.347Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 24, 2018 1:11:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T13:11:09.192Z: Workers have started successfully.
May 24, 2018 1:11:32 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T13:11:32.167Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
May 24, 2018 1:11:35 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T13:11:32.241Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
May 24, 2018 1:11:40 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T13:11:38.592Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
May 24, 2018 1:11:40 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T13:11:38.684Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
May 24, 2018 1:11:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T13:11:52.778Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
May 24, 2018 1:11:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T13:11:52.981Z: Executing operation Create123/Read(CreateSource)+OutputSideInputs+PAssert$33/GroupGlobally/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write
May 24, 2018 1:11:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T13:11:59.587Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Close
May 24, 2018 1:11:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T13:11:59.671Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$33/GroupGlobally/RewindowActuals/Window.Assign+PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 24, 2018 1:12:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T13:12:04.268Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Close
May 24, 2018 1:12:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T13:12:04.361Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Read+PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$33/GroupGlobally/Values/Values/Map+PAssert$33/GroupGlobally/ParDo(Concat)+PAssert$33/GetPane/Map+PAssert$33/RunChecks+PAssert$33/VerifyAssertions/ParDo(DefaultConclude)
May 24, 2018 1:12:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T13:12:06.492Z: Cleaning up.
May 24, 2018 1:12:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T13:12:06.591Z: Stopping worker pool...
May 24, 2018 1:13:47 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T13:13:44.977Z: Autoscaling: Resized worker pool from 1 to 0.
May 24, 2018 1:13:47 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T13:13:45.014Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 24, 2018 1:13:55 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-05-24_06_09_43-9752993737486253309 finished with status DONE.
May 24, 2018 1:13:55 PM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-05-24_06_09_43-9752993737486253309. Found 1 success, 0 failures out of 1 expected assertions.
Gradle Test Executor 38 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest FAILED
209 tests completed, 34 failed, 2 skipped
Finished generating test XML results (0.406 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerTest>
Generating HTML test report...
Finished generating test html results (0.281 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest>
:beam-runners-google-cloud-dataflow-java:validatesRunnerTest (Thread[Task worker for ':' Thread 34,5,main]) completed. Took 2 hrs 3 mins 33.532 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:validatesRunnerTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 4m 31s
38 actionable tasks: 34 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/qy35ysmnwatay
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user robbe.sneyders@ml6.eu
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user sidhom@google.com
Build failed in Jenkins:
beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #335
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/335/display/redirect?page=changes>
Changes:
[iemejia] Remove repeated GCPIO dependency in SQL module (Again!)
[iemejia] Enforce error-prone in ParquetIO, fix missing javadoc and refine deps
------------------------------------------
[...truncated 17.98 MB...]
May 24, 2018 11:05:51 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) as step s13
May 24, 2018 11:05:51 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map as step s14
May 24, 2018 11:05:51 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign as step s15
May 24, 2018 11:05:51 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey as step s16
May 24, 2018 11:05:51 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map as step s17
May 24, 2018 11:05:51 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RewindowActuals/Window.Assign as step s18
May 24, 2018 11:05:51 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map as step s19
May 24, 2018 11:05:51 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveActualsTriggering/Flatten.PCollections as step s20
May 24, 2018 11:05:51 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Create.Values/Read(CreateSource) as step s21
May 24, 2018 11:05:51 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign as step s22
May 24, 2018 11:05:51 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveDummyTriggering/Flatten.PCollections as step s23
May 24, 2018 11:05:51 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/FlattenDummyAndContents as step s24
May 24, 2018 11:05:51 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/NeverTrigger/Flatten.PCollections as step s25
May 24, 2018 11:05:51 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GroupDummyAndContents as step s26
May 24, 2018 11:05:51 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Values/Values/Map as step s27
May 24, 2018 11:05:51 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/ParDo(Concat) as step s28
May 24, 2018 11:05:51 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GetPane/Map as step s29
May 24, 2018 11:05:51 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/RunChecks as step s30
May 24, 2018 11:05:51 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/VerifyAssertions/ParDo(DefaultConclude) as step s31
May 24, 2018 11:05:51 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0524110544-5e4269b3/output/results/staging/
May 24, 2018 11:05:51 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <71120 bytes, hash Suqchs9xS9R4eXdX2FtSCA> to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0524110544-5e4269b3/output/results/staging/pipeline-Suqchs9xS9R4eXdX2FtSCA.pb
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 24, 2018 11:05:53 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-05-24_04_05_51-17487677595797184430?project=apache-beam-testing
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Submitted job: 2018-05-24_04_05_51-17487677595797184430
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 24, 2018 11:05:53 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-05-24_04_05_51-17487677595797184430
May 24, 2018 11:05:53 AM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-05-24_04_05_51-17487677595797184430 with 1 expected assertions.
May 24, 2018 11:06:02 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T11:05:52.020Z: Autoscaling is enabled for job 2018-05-24_04_05_51-17487677595797184430. The number of workers will be between 1 and 1000.
May 24, 2018 11:06:02 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T11:05:52.059Z: Autoscaling was automatically enabled for job 2018-05-24_04_05_51-17487677595797184430.
May 24, 2018 11:06:02 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T11:05:55.035Z: Checking required Cloud APIs are enabled.
May 24, 2018 11:06:02 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T11:05:55.163Z: Checking permissions granted to controller Service Account.
May 24, 2018 11:06:02 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T11:05:58.976Z: Worker configuration: n1-standard-1 in us-central1-b.
May 24, 2018 11:06:02 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T11:05:59.342Z: Expanding CoGroupByKey operations into optimizable parts.
May 24, 2018 11:06:02 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T11:05:59.509Z: Expanding GroupByKey operations into optimizable parts.
May 24, 2018 11:06:02 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T11:05:59.546Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
May 24, 2018 11:06:02 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T11:05:59.754Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
May 24, 2018 11:06:02 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T11:05:59.800Z: Elided trivial flatten
May 24, 2018 11:06:02 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T11:05:59.848Z: Elided trivial flatten
May 24, 2018 11:06:02 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T11:05:59.899Z: Elided trivial flatten
May 24, 2018 11:06:02 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T11:05:59.945Z: Unzipping flatten s24 for input s19.org.apache.beam.sdk.values.PCollection.<init>:329#8fd0f908e3ea90e3
May 24, 2018 11:06:02 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T11:05:59.989Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Reify, through flatten PAssert$33/GroupGlobally/FlattenDummyAndContents, into producer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map
May 24, 2018 11:06:02 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T11:06:00.031Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow into PAssert$33/GroupGlobally/GroupDummyAndContents/Read
May 24, 2018 11:06:02 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T11:06:00.072Z: Fusing consumer PAssert$33/GroupGlobally/ParDo(Concat) into PAssert$33/GroupGlobally/Values/Values/Map
May 24, 2018 11:06:02 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T11:06:00.120Z: Fusing consumer PAssert$33/GetPane/Map into PAssert$33/GroupGlobally/ParDo(Concat)
May 24, 2018 11:06:02 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T11:06:00.172Z: Fusing consumer PAssert$33/GroupGlobally/Values/Values/Map into PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow
May 24, 2018 11:06:02 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T11:06:00.207Z: Fusing consumer PAssert$33/RunChecks into PAssert$33/GetPane/Map
May 24, 2018 11:06:02 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T11:06:00.254Z: Fusing consumer PAssert$33/VerifyAssertions/ParDo(DefaultConclude) into PAssert$33/RunChecks
May 24, 2018 11:06:02 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T11:06:00.305Z: Unzipping flatten s24-u45 for input s26-reify-value18-c43
May 24, 2018 11:06:02 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T11:06:00.345Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Write, through flatten s24-u45, into producer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 24, 2018 11:06:02 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T11:06:00.393Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify into PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
May 24, 2018 11:06:02 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T11:06:00.439Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Write into PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 24, 2018 11:06:02 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T11:06:00.487Z: Fusing consumer PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)
May 24, 2018 11:06:02 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T11:06:00.529Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
May 24, 2018 11:06:02 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T11:06:00.577Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
May 24, 2018 11:06:02 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T11:06:00.613Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into PAssert$33/GroupGlobally/Window.Into()/Window.Assign
May 24, 2018 11:06:02 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T11:06:00.652Z: Fusing consumer OutputSideInputs into Create123/Read(CreateSource)
May 24, 2018 11:06:02 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T11:06:00.692Z: Fusing consumer PAssert$33/GroupGlobally/Window.Into()/Window.Assign into OutputSideInputs
May 24, 2018 11:06:02 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T11:06:00.728Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
May 24, 2018 11:06:02 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T11:06:00.777Z: Fusing consumer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map into PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
May 24, 2018 11:06:02 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T11:06:00.812Z: Fusing consumer PAssert$33/GroupGlobally/RewindowActuals/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map
May 24, 2018 11:06:02 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T11:06:00.861Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read
May 24, 2018 11:06:02 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T11:06:00.909Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
May 24, 2018 11:06:02 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T11:06:00.950Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
May 24, 2018 11:06:02 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T11:06:00.988Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
May 24, 2018 11:06:02 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T11:06:01.035Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
May 24, 2018 11:06:02 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T11:06:01.076Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
May 24, 2018 11:06:02 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T11:06:01.114Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into Create47/Read(CreateSource)
May 24, 2018 11:06:02 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T11:06:01.151Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
May 24, 2018 11:06:02 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T11:06:01.189Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
May 24, 2018 11:06:02 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T11:06:01.234Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
May 24, 2018 11:06:02 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T11:06:01.276Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
May 24, 2018 11:06:02 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T11:06:01.321Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
May 24, 2018 11:06:02 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T11:06:01.366Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
May 24, 2018 11:06:02 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T11:06:01.823Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Create
May 24, 2018 11:06:02 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T11:06:01.861Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Create
May 24, 2018 11:06:02 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T11:06:01.909Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
May 24, 2018 11:06:02 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T11:06:01.919Z: Starting 1 workers in us-central1-b...
May 24, 2018 11:06:02 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T11:06:01.955Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
May 24, 2018 11:06:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T11:06:02.182Z: Executing operation PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 24, 2018 11:06:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T11:06:02.230Z: Executing operation Create47/Read(CreateSource)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
May 24, 2018 11:06:11 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T11:06:09.756Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
May 24, 2018 11:06:26 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T11:06:25.442Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
May 24, 2018 11:06:26 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T11:06:25.478Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 24, 2018 11:06:45 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T11:06:43.278Z: Workers have started successfully.
May 24, 2018 11:07:06 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T11:07:05.109Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
May 24, 2018 11:07:06 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T11:07:05.198Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
May 24, 2018 11:07:11 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T11:07:11.148Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
May 24, 2018 11:07:11 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T11:07:11.235Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
May 24, 2018 11:07:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T11:07:23.819Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
May 24, 2018 11:07:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T11:07:23.997Z: Executing operation Create123/Read(CreateSource)+OutputSideInputs+PAssert$33/GroupGlobally/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write
May 24, 2018 11:07:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T11:07:28.166Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Close
May 24, 2018 11:07:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T11:07:28.262Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$33/GroupGlobally/RewindowActuals/Window.Assign+PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 24, 2018 11:07:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T11:07:33.747Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Close
May 24, 2018 11:07:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T11:07:33.850Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Read+PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$33/GroupGlobally/Values/Values/Map+PAssert$33/GroupGlobally/ParDo(Concat)+PAssert$33/GetPane/Map+PAssert$33/RunChecks+PAssert$33/VerifyAssertions/ParDo(DefaultConclude)
May 24, 2018 11:07:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T11:07:36.709Z: Cleaning up.
May 24, 2018 11:07:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T11:07:36.812Z: Stopping worker pool...
May 24, 2018 11:09:05 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T11:09:03.313Z: Autoscaling: Resized worker pool from 1 to 0.
May 24, 2018 11:09:05 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T11:09:03.356Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 24, 2018 11:09:11 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-05-24_04_05_51-17487677595797184430 finished with status DONE.
May 24, 2018 11:09:11 AM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-05-24_04_05_51-17487677595797184430. Found 1 success, 0 failures out of 1 expected assertions.
Gradle Test Executor 35 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest FAILED
209 tests completed, 34 failed, 2 skipped
Finished generating test XML results (0.577 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerTest>
Generating HTML test report...
Finished generating test html results (0.61 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest>
:beam-runners-google-cloud-dataflow-java:validatesRunnerTest (Thread[Task worker for ':' Thread 33,5,main]) completed. Took 2 hrs 6 mins 4.992 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:validatesRunnerTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 7m 3s
38 actionable tasks: 34 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/y7svr2mfenacw
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user robbe.sneyders@ml6.eu
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user sidhom@google.com
Build failed in Jenkins:
beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #334
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/334/display/redirect>
------------------------------------------
[...truncated 18.01 MB...]
May 24, 2018 8:07:55 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) as step s13
May 24, 2018 8:07:55 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map as step s14
May 24, 2018 8:07:55 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign as step s15
May 24, 2018 8:07:55 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey as step s16
May 24, 2018 8:07:55 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map as step s17
May 24, 2018 8:07:55 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RewindowActuals/Window.Assign as step s18
May 24, 2018 8:07:55 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map as step s19
May 24, 2018 8:07:55 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveActualsTriggering/Flatten.PCollections as step s20
May 24, 2018 8:07:55 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Create.Values/Read(CreateSource) as step s21
May 24, 2018 8:07:55 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign as step s22
May 24, 2018 8:07:55 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveDummyTriggering/Flatten.PCollections as step s23
May 24, 2018 8:07:55 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/FlattenDummyAndContents as step s24
May 24, 2018 8:07:55 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/NeverTrigger/Flatten.PCollections as step s25
May 24, 2018 8:07:55 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GroupDummyAndContents as step s26
May 24, 2018 8:07:55 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Values/Values/Map as step s27
May 24, 2018 8:07:55 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/ParDo(Concat) as step s28
May 24, 2018 8:07:55 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GetPane/Map as step s29
May 24, 2018 8:07:55 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/RunChecks as step s30
May 24, 2018 8:07:55 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/VerifyAssertions/ParDo(DefaultConclude) as step s31
May 24, 2018 8:07:55 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0524080748-f6bc8dd7/output/results/staging/
May 24, 2018 8:07:55 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <71120 bytes, hash IbuyJqZHYLOBn2BZNVgbLQ> to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0524080748-f6bc8dd7/output/results/staging/pipeline-IbuyJqZHYLOBn2BZNVgbLQ.pb
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 24, 2018 8:07:57 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-05-24_01_07_56-8825729845175619452?project=apache-beam-testing
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Submitted job: 2018-05-24_01_07_56-8825729845175619452
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 24, 2018 8:07:57 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-05-24_01_07_56-8825729845175619452
May 24, 2018 8:07:57 AM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-05-24_01_07_56-8825729845175619452 with 1 expected assertions.
May 24, 2018 8:08:11 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T08:07:56.600Z: Autoscaling is enabled for job 2018-05-24_01_07_56-8825729845175619452. The number of workers will be between 1 and 1000.
May 24, 2018 8:08:11 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T08:07:56.641Z: Autoscaling was automatically enabled for job 2018-05-24_01_07_56-8825729845175619452.
May 24, 2018 8:08:11 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T08:07:59.370Z: Checking required Cloud APIs are enabled.
May 24, 2018 8:08:11 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T08:07:59.572Z: Checking permissions granted to controller Service Account.
May 24, 2018 8:08:11 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T08:08:06.329Z: Worker configuration: n1-standard-1 in us-central1-b.
May 24, 2018 8:08:11 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T08:08:06.801Z: Expanding CoGroupByKey operations into optimizable parts.
May 24, 2018 8:08:11 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T08:08:06.990Z: Expanding GroupByKey operations into optimizable parts.
May 24, 2018 8:08:11 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T08:08:07.029Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
May 24, 2018 8:08:11 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T08:08:07.297Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
May 24, 2018 8:08:11 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T08:08:07.356Z: Elided trivial flatten
May 24, 2018 8:08:11 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T08:08:07.396Z: Elided trivial flatten
May 24, 2018 8:08:11 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T08:08:07.443Z: Elided trivial flatten
May 24, 2018 8:08:11 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T08:08:07.486Z: Unzipping flatten s24 for input s19.org.apache.beam.sdk.values.PCollection.<init>:329#8fd0f908e3ea90e3
May 24, 2018 8:08:11 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T08:08:07.543Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Reify, through flatten PAssert$33/GroupGlobally/FlattenDummyAndContents, into producer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map
May 24, 2018 8:08:11 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T08:08:07.591Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow into PAssert$33/GroupGlobally/GroupDummyAndContents/Read
May 24, 2018 8:08:11 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T08:08:07.638Z: Fusing consumer PAssert$33/GroupGlobally/ParDo(Concat) into PAssert$33/GroupGlobally/Values/Values/Map
May 24, 2018 8:08:11 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T08:08:07.691Z: Fusing consumer PAssert$33/GetPane/Map into PAssert$33/GroupGlobally/ParDo(Concat)
May 24, 2018 8:08:11 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T08:08:07.739Z: Fusing consumer PAssert$33/GroupGlobally/Values/Values/Map into PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow
May 24, 2018 8:08:11 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T08:08:07.791Z: Fusing consumer PAssert$33/RunChecks into PAssert$33/GetPane/Map
May 24, 2018 8:08:11 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T08:08:07.844Z: Fusing consumer PAssert$33/VerifyAssertions/ParDo(DefaultConclude) into PAssert$33/RunChecks
May 24, 2018 8:08:11 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T08:08:07.882Z: Unzipping flatten s24-u45 for input s26-reify-value18-c43
May 24, 2018 8:08:11 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T08:08:07.932Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Write, through flatten s24-u45, into producer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 24, 2018 8:08:11 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T08:08:07.979Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify into PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
May 24, 2018 8:08:11 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T08:08:08.023Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Write into PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 24, 2018 8:08:11 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T08:08:08.071Z: Fusing consumer PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)
May 24, 2018 8:08:11 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T08:08:08.109Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
May 24, 2018 8:08:11 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T08:08:08.157Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
May 24, 2018 8:08:11 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T08:08:08.203Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into PAssert$33/GroupGlobally/Window.Into()/Window.Assign
May 24, 2018 8:08:11 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T08:08:08.239Z: Fusing consumer OutputSideInputs into Create123/Read(CreateSource)
May 24, 2018 8:08:11 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T08:08:08.288Z: Fusing consumer PAssert$33/GroupGlobally/Window.Into()/Window.Assign into OutputSideInputs
May 24, 2018 8:08:11 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T08:08:08.336Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
May 24, 2018 8:08:11 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T08:08:08.382Z: Fusing consumer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map into PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
May 24, 2018 8:08:11 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T08:08:08.430Z: Fusing consumer PAssert$33/GroupGlobally/RewindowActuals/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map
May 24, 2018 8:08:11 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T08:08:08.477Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read
May 24, 2018 8:08:11 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T08:08:08.525Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
May 24, 2018 8:08:11 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T08:08:08.575Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
May 24, 2018 8:08:11 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T08:08:08.622Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
May 24, 2018 8:08:11 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T08:08:08.655Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
May 24, 2018 8:08:11 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T08:08:08.692Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
May 24, 2018 8:08:11 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T08:08:08.742Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into Create47/Read(CreateSource)
May 24, 2018 8:08:11 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T08:08:08.794Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
May 24, 2018 8:08:11 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T08:08:08.832Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
May 24, 2018 8:08:11 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T08:08:08.876Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
May 24, 2018 8:08:11 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T08:08:08.928Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
May 24, 2018 8:08:11 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T08:08:08.979Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
May 24, 2018 8:08:11 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T08:08:09.028Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
May 24, 2018 8:08:11 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T08:08:09.503Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Create
May 24, 2018 8:08:11 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T08:08:09.534Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Create
May 24, 2018 8:08:11 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T08:08:09.558Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
May 24, 2018 8:08:11 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T08:08:09.598Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
May 24, 2018 8:08:11 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T08:08:09.608Z: Starting 1 workers in us-central1-b...
May 24, 2018 8:08:11 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T08:08:09.898Z: Executing operation Create47/Read(CreateSource)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
May 24, 2018 8:08:11 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T08:08:09.954Z: Executing operation PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 24, 2018 8:08:18 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T08:08:17.333Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
May 24, 2018 8:08:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T08:08:28.004Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
May 24, 2018 8:08:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T08:08:28.053Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 24, 2018 8:08:46 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T08:08:44.336Z: Workers have started successfully.
May 24, 2018 8:09:15 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T08:09:13.970Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
May 24, 2018 8:09:15 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T08:09:14.078Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
May 24, 2018 8:09:23 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T08:09:23.793Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
May 24, 2018 8:09:23 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T08:09:23.900Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
May 24, 2018 8:09:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T08:09:37.123Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
May 24, 2018 8:09:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T08:09:37.336Z: Executing operation Create123/Read(CreateSource)+OutputSideInputs+PAssert$33/GroupGlobally/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write
May 24, 2018 8:09:43 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T08:09:43.392Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Close
May 24, 2018 8:09:43 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T08:09:43.497Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$33/GroupGlobally/RewindowActuals/Window.Assign+PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 24, 2018 8:09:47 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T08:09:47.085Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Close
May 24, 2018 8:09:47 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T08:09:47.207Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Read+PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$33/GroupGlobally/Values/Values/Map+PAssert$33/GroupGlobally/ParDo(Concat)+PAssert$33/GetPane/Map+PAssert$33/RunChecks+PAssert$33/VerifyAssertions/ParDo(DefaultConclude)
May 24, 2018 8:09:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T08:09:51.171Z: Cleaning up.
May 24, 2018 8:09:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T08:09:51.282Z: Stopping worker pool...
May 24, 2018 8:11:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T08:11:10.362Z: Autoscaling: Resized worker pool from 1 to 0.
May 24, 2018 8:11:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T08:11:10.406Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 24, 2018 8:11:19 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-05-24_01_07_56-8825729845175619452 finished with status DONE.
May 24, 2018 8:11:19 AM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-05-24_01_07_56-8825729845175619452. Found 1 success, 0 failures out of 1 expected assertions.
Gradle Test Executor 42 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest FAILED
209 tests completed, 35 failed, 2 skipped
Finished generating test XML results (0.489 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerTest>
Generating HTML test report...
Finished generating test html results (0.305 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest>
:beam-runners-google-cloud-dataflow-java:validatesRunnerTest (Thread[Task worker for ':' Thread 27,5,main]) completed. Took 2 hrs 8 mins 43.434 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:validatesRunnerTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 10m 8s
38 actionable tasks: 31 executed, 7 from cache
Publishing build scan...
https://gradle.com/s/q2zjipjodccm2
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user robbe.sneyders@ml6.eu
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user sidhom@google.com
Build failed in Jenkins:
beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #333
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/333/display/redirect?page=changes>
Changes:
[klk] Autoformat sdks/java/extensions/sql
[klk] Add spotless config to global gradle file
[klk] Activate spotless for SQL module
------------------------------------------
[...truncated 17.99 MB...]
May 24, 2018 5:01:47 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) as step s13
May 24, 2018 5:01:47 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map as step s14
May 24, 2018 5:01:47 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign as step s15
May 24, 2018 5:01:47 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey as step s16
May 24, 2018 5:01:47 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map as step s17
May 24, 2018 5:01:47 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RewindowActuals/Window.Assign as step s18
May 24, 2018 5:01:47 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map as step s19
May 24, 2018 5:01:47 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveActualsTriggering/Flatten.PCollections as step s20
May 24, 2018 5:01:47 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Create.Values/Read(CreateSource) as step s21
May 24, 2018 5:01:47 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign as step s22
May 24, 2018 5:01:47 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveDummyTriggering/Flatten.PCollections as step s23
May 24, 2018 5:01:47 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/FlattenDummyAndContents as step s24
May 24, 2018 5:01:47 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/NeverTrigger/Flatten.PCollections as step s25
May 24, 2018 5:01:47 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GroupDummyAndContents as step s26
May 24, 2018 5:01:47 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Values/Values/Map as step s27
May 24, 2018 5:01:47 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/ParDo(Concat) as step s28
May 24, 2018 5:01:47 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GetPane/Map as step s29
May 24, 2018 5:01:47 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/RunChecks as step s30
May 24, 2018 5:01:47 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/VerifyAssertions/ParDo(DefaultConclude) as step s31
May 24, 2018 5:01:47 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0524050142-7d26c29f/output/results/staging/
May 24, 2018 5:01:47 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <71120 bytes, hash HfF9Xp8MuI2tMrGID6KaWg> to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0524050142-7d26c29f/output/results/staging/pipeline-HfF9Xp8MuI2tMrGID6KaWg.pb
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 24, 2018 5:01:48 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-05-23_22_01_47-2941473741019527225?project=apache-beam-testing
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Submitted job: 2018-05-23_22_01_47-2941473741019527225
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 24, 2018 5:01:48 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-05-23_22_01_47-2941473741019527225
May 24, 2018 5:01:48 AM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-05-23_22_01_47-2941473741019527225 with 1 expected assertions.
May 24, 2018 5:02:06 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T05:01:47.952Z: Autoscaling is enabled for job 2018-05-23_22_01_47-2941473741019527225. The number of workers will be between 1 and 1000.
May 24, 2018 5:02:06 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T05:01:47.980Z: Autoscaling was automatically enabled for job 2018-05-23_22_01_47-2941473741019527225.
May 24, 2018 5:02:06 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T05:01:50.763Z: Checking required Cloud APIs are enabled.
May 24, 2018 5:02:06 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T05:01:50.955Z: Checking permissions granted to controller Service Account.
May 24, 2018 5:02:06 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T05:01:57.334Z: Worker configuration: n1-standard-1 in us-central1-f.
May 24, 2018 5:02:06 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T05:01:57.757Z: Expanding CoGroupByKey operations into optimizable parts.
May 24, 2018 5:02:06 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T05:01:57.928Z: Expanding GroupByKey operations into optimizable parts.
May 24, 2018 5:02:06 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T05:01:57.977Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
May 24, 2018 5:02:06 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T05:01:58.227Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
May 24, 2018 5:02:06 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T05:01:58.282Z: Elided trivial flatten
May 24, 2018 5:02:06 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T05:01:58.343Z: Elided trivial flatten
May 24, 2018 5:02:06 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T05:01:58.402Z: Elided trivial flatten
May 24, 2018 5:02:06 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T05:01:58.475Z: Unzipping flatten s24 for input s19.org.apache.beam.sdk.values.PCollection.<init>:329#8fd0f908e3ea90e3
May 24, 2018 5:02:06 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T05:01:58.559Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Reify, through flatten PAssert$33/GroupGlobally/FlattenDummyAndContents, into producer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map
May 24, 2018 5:02:06 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T05:01:58.623Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow into PAssert$33/GroupGlobally/GroupDummyAndContents/Read
May 24, 2018 5:02:06 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T05:01:58.683Z: Fusing consumer PAssert$33/GroupGlobally/ParDo(Concat) into PAssert$33/GroupGlobally/Values/Values/Map
May 24, 2018 5:02:06 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T05:01:58.740Z: Fusing consumer PAssert$33/GetPane/Map into PAssert$33/GroupGlobally/ParDo(Concat)
May 24, 2018 5:02:06 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T05:01:58.784Z: Fusing consumer PAssert$33/GroupGlobally/Values/Values/Map into PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow
May 24, 2018 5:02:06 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T05:01:58.832Z: Fusing consumer PAssert$33/RunChecks into PAssert$33/GetPane/Map
May 24, 2018 5:02:06 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T05:01:58.881Z: Fusing consumer PAssert$33/VerifyAssertions/ParDo(DefaultConclude) into PAssert$33/RunChecks
May 24, 2018 5:02:06 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T05:01:58.918Z: Unzipping flatten s24-u45 for input s26-reify-value18-c43
May 24, 2018 5:02:06 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T05:01:58.958Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Write, through flatten s24-u45, into producer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 24, 2018 5:02:06 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T05:01:59.005Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify into PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
May 24, 2018 5:02:06 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T05:01:59.050Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Write into PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 24, 2018 5:02:06 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T05:01:59.097Z: Fusing consumer PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)
May 24, 2018 5:02:06 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T05:01:59.144Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
May 24, 2018 5:02:06 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T05:01:59.191Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
May 24, 2018 5:02:06 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T05:01:59.237Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into PAssert$33/GroupGlobally/Window.Into()/Window.Assign
May 24, 2018 5:02:06 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T05:01:59.283Z: Fusing consumer OutputSideInputs into Create123/Read(CreateSource)
May 24, 2018 5:02:06 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T05:01:59.326Z: Fusing consumer PAssert$33/GroupGlobally/Window.Into()/Window.Assign into OutputSideInputs
May 24, 2018 5:02:06 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T05:01:59.376Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
May 24, 2018 5:02:06 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T05:01:59.423Z: Fusing consumer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map into PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
May 24, 2018 5:02:06 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T05:01:59.460Z: Fusing consumer PAssert$33/GroupGlobally/RewindowActuals/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map
May 24, 2018 5:02:06 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T05:01:59.508Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read
May 24, 2018 5:02:06 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T05:01:59.558Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
May 24, 2018 5:02:06 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T05:01:59.609Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
May 24, 2018 5:02:06 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T05:01:59.650Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
May 24, 2018 5:02:06 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T05:01:59.698Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
May 24, 2018 5:02:06 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T05:01:59.744Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
May 24, 2018 5:02:06 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T05:01:59.782Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into Create47/Read(CreateSource)
May 24, 2018 5:02:06 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T05:01:59.830Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
May 24, 2018 5:02:06 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T05:01:59.868Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
May 24, 2018 5:02:06 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T05:01:59.926Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
May 24, 2018 5:02:06 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T05:01:59.973Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
May 24, 2018 5:02:06 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T05:02:00.003Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
May 24, 2018 5:02:06 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T05:02:00.043Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
May 24, 2018 5:02:06 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T05:02:00.536Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Create
May 24, 2018 5:02:06 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T05:02:00.584Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Create
May 24, 2018 5:02:06 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T05:02:00.632Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
May 24, 2018 5:02:06 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T05:02:00.653Z: Starting 1 workers in us-central1-f...
May 24, 2018 5:02:06 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T05:02:00.681Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
May 24, 2018 5:02:06 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T05:02:00.994Z: Executing operation Create47/Read(CreateSource)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
May 24, 2018 5:02:06 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T05:02:01.064Z: Executing operation PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 24, 2018 5:02:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T05:02:07.730Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
May 24, 2018 5:02:18 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T05:02:18.136Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
May 24, 2018 5:02:18 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T05:02:18.169Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 24, 2018 5:02:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T05:02:37.064Z: Workers have started successfully.
May 24, 2018 5:03:09 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T05:03:09.250Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
May 24, 2018 5:03:09 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T05:03:09.325Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
May 24, 2018 5:03:18 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T05:03:17.533Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
May 24, 2018 5:03:18 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T05:03:17.628Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
May 24, 2018 5:03:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T05:03:31.977Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
May 24, 2018 5:03:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T05:03:32.164Z: Executing operation Create123/Read(CreateSource)+OutputSideInputs+PAssert$33/GroupGlobally/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write
May 24, 2018 5:03:41 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T05:03:39.841Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Close
May 24, 2018 5:03:41 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T05:03:39.944Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$33/GroupGlobally/RewindowActuals/Window.Assign+PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 24, 2018 5:03:47 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T05:03:45.675Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Close
May 24, 2018 5:03:47 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T05:03:45.770Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Read+PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$33/GroupGlobally/Values/Values/Map+PAssert$33/GroupGlobally/ParDo(Concat)+PAssert$33/GetPane/Map+PAssert$33/RunChecks+PAssert$33/VerifyAssertions/ParDo(DefaultConclude)
May 24, 2018 5:03:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T05:03:49.672Z: Cleaning up.
May 24, 2018 5:03:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T05:03:49.790Z: Stopping worker pool...
May 24, 2018 5:05:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T05:05:09.629Z: Autoscaling: Resized worker pool from 1 to 0.
May 24, 2018 5:05:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T05:05:09.666Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 24, 2018 5:05:18 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-05-23_22_01_47-2941473741019527225 finished with status DONE.
May 24, 2018 5:05:18 AM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-05-23_22_01_47-2941473741019527225. Found 1 success, 0 failures out of 1 expected assertions.
Gradle Test Executor 39 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest FAILED
209 tests completed, 34 failed, 2 skipped
Finished generating test XML results (0.657 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerTest>
Generating HTML test report...
Finished generating test html results (0.343 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest>
:beam-runners-google-cloud-dataflow-java:validatesRunnerTest (Thread[Task worker for ':' Thread 8,5,main]) completed. Took 2 hrs 5 mins 29.2 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:validatesRunnerTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 6m 26s
38 actionable tasks: 34 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/v2tfxmixk2vog
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user robbe.sneyders@ml6.eu
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user sidhom@google.com
Not sending mail to unregistered user klk@google.com
Build failed in Jenkins:
beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #332
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/332/display/redirect?page=changes>
Changes:
[tgroh] Use WindowOnlyContext in ReduceFnContextFactory
------------------------------------------
[...truncated 18.01 MB...]
INFO: Adding PAssert$33/GroupGlobally/Window.Into()/Window.Assign as step s12
May 24, 2018 2:55:05 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) as step s13
May 24, 2018 2:55:05 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map as step s14
May 24, 2018 2:55:05 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign as step s15
May 24, 2018 2:55:05 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey as step s16
May 24, 2018 2:55:05 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map as step s17
May 24, 2018 2:55:05 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RewindowActuals/Window.Assign as step s18
May 24, 2018 2:55:05 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map as step s19
May 24, 2018 2:55:05 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveActualsTriggering/Flatten.PCollections as step s20
May 24, 2018 2:55:05 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Create.Values/Read(CreateSource) as step s21
May 24, 2018 2:55:05 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign as step s22
May 24, 2018 2:55:05 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveDummyTriggering/Flatten.PCollections as step s23
May 24, 2018 2:55:05 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/FlattenDummyAndContents as step s24
May 24, 2018 2:55:05 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/NeverTrigger/Flatten.PCollections as step s25
May 24, 2018 2:55:05 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GroupDummyAndContents as step s26
May 24, 2018 2:55:05 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Values/Values/Map as step s27
May 24, 2018 2:55:05 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/ParDo(Concat) as step s28
May 24, 2018 2:55:05 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GetPane/Map as step s29
May 24, 2018 2:55:05 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/RunChecks as step s30
May 24, 2018 2:55:05 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/VerifyAssertions/ParDo(DefaultConclude) as step s31
May 24, 2018 2:55:05 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0524025500-8f305c81/output/results/staging/
May 24, 2018 2:55:05 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <71120 bytes, hash SHq4GJySDcL1H-u00k9GJA> to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0524025500-8f305c81/output/results/staging/pipeline-SHq4GJySDcL1H-u00k9GJA.pb
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 24, 2018 2:55:07 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-05-23_19_55_06-3953815153201611122?project=apache-beam-testing
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Submitted job: 2018-05-23_19_55_06-3953815153201611122
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 24, 2018 2:55:07 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-05-23_19_55_06-3953815153201611122
May 24, 2018 2:55:07 AM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-05-23_19_55_06-3953815153201611122 with 1 expected assertions.
May 24, 2018 2:55:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T02:55:06.157Z: Autoscaling is enabled for job 2018-05-23_19_55_06-3953815153201611122. The number of workers will be between 1 and 1000.
May 24, 2018 2:55:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T02:55:06.181Z: Autoscaling was automatically enabled for job 2018-05-23_19_55_06-3953815153201611122.
May 24, 2018 2:55:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T02:55:09.940Z: Checking required Cloud APIs are enabled.
May 24, 2018 2:55:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T02:55:10.151Z: Checking permissions granted to controller Service Account.
May 24, 2018 2:55:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T02:55:15.683Z: Worker configuration: n1-standard-1 in us-central1-b.
May 24, 2018 2:55:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T02:55:18.255Z: Expanding CoGroupByKey operations into optimizable parts.
May 24, 2018 2:55:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T02:55:18.366Z: Expanding GroupByKey operations into optimizable parts.
May 24, 2018 2:55:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T02:55:18.395Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
May 24, 2018 2:55:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T02:55:18.574Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
May 24, 2018 2:55:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T02:55:18.604Z: Elided trivial flatten
May 24, 2018 2:55:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T02:55:18.633Z: Elided trivial flatten
May 24, 2018 2:55:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T02:55:18.661Z: Elided trivial flatten
May 24, 2018 2:55:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T02:55:18.694Z: Unzipping flatten s24 for input s19.org.apache.beam.sdk.values.PCollection.<init>:329#8fd0f908e3ea90e3
May 24, 2018 2:55:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T02:55:18.728Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Reify, through flatten PAssert$33/GroupGlobally/FlattenDummyAndContents, into producer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map
May 24, 2018 2:55:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T02:55:18.765Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow into PAssert$33/GroupGlobally/GroupDummyAndContents/Read
May 24, 2018 2:55:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T02:55:18.806Z: Fusing consumer PAssert$33/GroupGlobally/ParDo(Concat) into PAssert$33/GroupGlobally/Values/Values/Map
May 24, 2018 2:55:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T02:55:18.848Z: Fusing consumer PAssert$33/GetPane/Map into PAssert$33/GroupGlobally/ParDo(Concat)
May 24, 2018 2:55:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T02:55:18.887Z: Fusing consumer PAssert$33/GroupGlobally/Values/Values/Map into PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow
May 24, 2018 2:55:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T02:55:18.928Z: Fusing consumer PAssert$33/RunChecks into PAssert$33/GetPane/Map
May 24, 2018 2:55:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T02:55:18.965Z: Fusing consumer PAssert$33/VerifyAssertions/ParDo(DefaultConclude) into PAssert$33/RunChecks
May 24, 2018 2:55:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T02:55:18.998Z: Unzipping flatten s24-u45 for input s26-reify-value18-c43
May 24, 2018 2:55:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T02:55:19.039Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Write, through flatten s24-u45, into producer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 24, 2018 2:55:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T02:55:19.075Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify into PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
May 24, 2018 2:55:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T02:55:19.107Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Write into PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 24, 2018 2:55:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T02:55:19.134Z: Fusing consumer PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)
May 24, 2018 2:55:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T02:55:19.162Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
May 24, 2018 2:55:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T02:55:19.192Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
May 24, 2018 2:55:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T02:55:19.230Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into PAssert$33/GroupGlobally/Window.Into()/Window.Assign
May 24, 2018 2:55:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T02:55:19.276Z: Fusing consumer OutputSideInputs into Create123/Read(CreateSource)
May 24, 2018 2:55:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T02:55:19.320Z: Fusing consumer PAssert$33/GroupGlobally/Window.Into()/Window.Assign into OutputSideInputs
May 24, 2018 2:55:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T02:55:19.362Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
May 24, 2018 2:55:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T02:55:19.396Z: Fusing consumer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map into PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
May 24, 2018 2:55:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T02:55:19.439Z: Fusing consumer PAssert$33/GroupGlobally/RewindowActuals/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map
May 24, 2018 2:55:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T02:55:19.477Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read
May 24, 2018 2:55:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T02:55:19.521Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
May 24, 2018 2:55:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T02:55:19.546Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
May 24, 2018 2:55:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T02:55:19.587Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
May 24, 2018 2:55:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T02:55:19.628Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
May 24, 2018 2:55:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T02:55:19.671Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
May 24, 2018 2:55:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T02:55:19.711Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into Create47/Read(CreateSource)
May 24, 2018 2:55:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T02:55:19.756Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
May 24, 2018 2:55:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T02:55:19.791Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
May 24, 2018 2:55:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T02:55:19.832Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
May 24, 2018 2:55:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T02:55:19.876Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
May 24, 2018 2:55:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T02:55:19.913Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
May 24, 2018 2:55:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T02:55:19.951Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
May 24, 2018 2:55:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T02:55:20.325Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Create
May 24, 2018 2:55:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T02:55:20.352Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Create
May 24, 2018 2:55:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T02:55:20.376Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
May 24, 2018 2:55:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T02:55:20.405Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
May 24, 2018 2:55:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T02:55:20.416Z: Starting 1 workers in us-central1-b...
May 24, 2018 2:55:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T02:55:20.607Z: Executing operation PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 24, 2018 2:55:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T02:55:20.641Z: Executing operation Create47/Read(CreateSource)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
May 24, 2018 2:55:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T02:55:27.446Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
May 24, 2018 2:55:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T02:55:37.920Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
May 24, 2018 2:55:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T02:55:37.952Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 24, 2018 2:55:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T02:55:57.772Z: Workers have started successfully.
May 24, 2018 2:56:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T02:56:17.401Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
May 24, 2018 2:56:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T02:56:17.474Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
May 24, 2018 2:56:26 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T02:56:25.202Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
May 24, 2018 2:56:26 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T02:56:25.256Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
May 24, 2018 2:56:39 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T02:56:38.748Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
May 24, 2018 2:56:39 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T02:56:38.882Z: Executing operation Create123/Read(CreateSource)+OutputSideInputs+PAssert$33/GroupGlobally/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write
May 24, 2018 2:56:46 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T02:56:45.282Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Close
May 24, 2018 2:56:46 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T02:56:45.349Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$33/GroupGlobally/RewindowActuals/Window.Assign+PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 24, 2018 2:56:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T02:56:49.080Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Close
May 24, 2018 2:56:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T02:56:49.148Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Read+PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$33/GroupGlobally/Values/Values/Map+PAssert$33/GroupGlobally/ParDo(Concat)+PAssert$33/GetPane/Map+PAssert$33/RunChecks+PAssert$33/VerifyAssertions/ParDo(DefaultConclude)
May 24, 2018 2:56:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T02:56:51.132Z: Cleaning up.
May 24, 2018 2:56:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T02:56:51.249Z: Stopping worker pool...
May 24, 2018 2:58:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T02:58:28.180Z: Autoscaling: Resized worker pool from 1 to 0.
May 24, 2018 2:58:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T02:58:28.226Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 24, 2018 2:58:37 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-05-23_19_55_06-3953815153201611122 finished with status DONE.
May 24, 2018 2:58:37 AM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-05-23_19_55_06-3953815153201611122. Found 1 success, 0 failures out of 1 expected assertions.
Gradle Test Executor 36 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest FAILED
209 tests completed, 34 failed, 2 skipped
Finished generating test XML results (0.451 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerTest>
Generating HTML test report...
Finished generating test html results (0.48 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest>
:beam-runners-google-cloud-dataflow-java:validatesRunnerTest (Thread[Task worker for ':' Thread 41,5,main]) completed. Took 2 hrs 14 mins 43.94 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:validatesRunnerTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 15m 47s
38 actionable tasks: 34 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/epaqjnkbnpfl2
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user robbe.sneyders@ml6.eu
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user sidhom@google.com
Build failed in Jenkins:
beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #331
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/331/display/redirect?page=changes>
Changes:
[timrobertson100] [BEAM-4347] Enforce ErrorProne analysis in kafka IO
[timrobertson100] [BEAM-4347] Improve ErrorProne analysis in kafka IO
[timrobertson100] [BEAM-4347] Minor changes following PR review
[timrobertson100] [BEAM-4347] Correction of typo following PR review
------------------------------------------
[...truncated 18.02 MB...]
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) as step s13
May 24, 2018 12:38:47 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map as step s14
May 24, 2018 12:38:47 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign as step s15
May 24, 2018 12:38:47 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey as step s16
May 24, 2018 12:38:47 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map as step s17
May 24, 2018 12:38:47 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RewindowActuals/Window.Assign as step s18
May 24, 2018 12:38:47 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map as step s19
May 24, 2018 12:38:47 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveActualsTriggering/Flatten.PCollections as step s20
May 24, 2018 12:38:47 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Create.Values/Read(CreateSource) as step s21
May 24, 2018 12:38:47 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign as step s22
May 24, 2018 12:38:47 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveDummyTriggering/Flatten.PCollections as step s23
May 24, 2018 12:38:47 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/FlattenDummyAndContents as step s24
May 24, 2018 12:38:47 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/NeverTrigger/Flatten.PCollections as step s25
May 24, 2018 12:38:47 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GroupDummyAndContents as step s26
May 24, 2018 12:38:47 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Values/Values/Map as step s27
May 24, 2018 12:38:47 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/ParDo(Concat) as step s28
May 24, 2018 12:38:47 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GetPane/Map as step s29
May 24, 2018 12:38:47 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/RunChecks as step s30
May 24, 2018 12:38:47 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/VerifyAssertions/ParDo(DefaultConclude) as step s31
May 24, 2018 12:38:47 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0524003841-6d509008/output/results/staging/
May 24, 2018 12:38:47 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <71120 bytes, hash EqLlcOXx18uXnRny_t5QLA> to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0524003841-6d509008/output/results/staging/pipeline-EqLlcOXx18uXnRny_t5QLA.pb
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 24, 2018 12:38:48 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-05-23_17_38_47-1893331436128805200?project=apache-beam-testing
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Submitted job: 2018-05-23_17_38_47-1893331436128805200
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 24, 2018 12:38:48 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-05-23_17_38_47-1893331436128805200
May 24, 2018 12:38:48 AM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-05-23_17_38_47-1893331436128805200 with 1 expected assertions.
May 24, 2018 12:38:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T00:38:47.749Z: Autoscaling is enabled for job 2018-05-23_17_38_47-1893331436128805200. The number of workers will be between 1 and 1000.
May 24, 2018 12:38:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T00:38:47.804Z: Autoscaling was automatically enabled for job 2018-05-23_17_38_47-1893331436128805200.
May 24, 2018 12:38:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T00:38:50.347Z: Checking required Cloud APIs are enabled.
May 24, 2018 12:38:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T00:38:50.524Z: Checking permissions granted to controller Service Account.
May 24, 2018 12:38:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T00:38:55.423Z: Worker configuration: n1-standard-1 in us-central1-f.
May 24, 2018 12:38:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T00:38:55.878Z: Expanding CoGroupByKey operations into optimizable parts.
May 24, 2018 12:38:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T00:38:56.083Z: Expanding GroupByKey operations into optimizable parts.
May 24, 2018 12:38:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T00:38:56.132Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
May 24, 2018 12:38:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T00:38:56.359Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
May 24, 2018 12:38:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T00:38:56.409Z: Elided trivial flatten
May 24, 2018 12:38:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T00:38:56.457Z: Elided trivial flatten
May 24, 2018 12:38:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T00:38:56.509Z: Elided trivial flatten
May 24, 2018 12:38:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T00:38:56.556Z: Unzipping flatten s24 for input s19.org.apache.beam.sdk.values.PCollection.<init>:329#8fd0f908e3ea90e3
May 24, 2018 12:38:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T00:38:56.605Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Reify, through flatten PAssert$33/GroupGlobally/FlattenDummyAndContents, into producer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map
May 24, 2018 12:38:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T00:38:56.646Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow into PAssert$33/GroupGlobally/GroupDummyAndContents/Read
May 24, 2018 12:38:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T00:38:56.692Z: Fusing consumer PAssert$33/GroupGlobally/ParDo(Concat) into PAssert$33/GroupGlobally/Values/Values/Map
May 24, 2018 12:38:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T00:38:56.741Z: Fusing consumer PAssert$33/GetPane/Map into PAssert$33/GroupGlobally/ParDo(Concat)
May 24, 2018 12:38:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T00:38:56.778Z: Fusing consumer PAssert$33/GroupGlobally/Values/Values/Map into PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow
May 24, 2018 12:38:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T00:38:56.824Z: Fusing consumer PAssert$33/RunChecks into PAssert$33/GetPane/Map
May 24, 2018 12:38:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T00:38:56.867Z: Fusing consumer PAssert$33/VerifyAssertions/ParDo(DefaultConclude) into PAssert$33/RunChecks
May 24, 2018 12:38:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T00:38:56.917Z: Unzipping flatten s24-u45 for input s26-reify-value18-c43
May 24, 2018 12:38:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T00:38:56.976Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Write, through flatten s24-u45, into producer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 24, 2018 12:38:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T00:38:57.026Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify into PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
May 24, 2018 12:38:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T00:38:57.074Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Write into PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 24, 2018 12:38:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T00:38:57.116Z: Fusing consumer PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)
May 24, 2018 12:38:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T00:38:57.163Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
May 24, 2018 12:38:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T00:38:57.201Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
May 24, 2018 12:38:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T00:38:57.251Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into PAssert$33/GroupGlobally/Window.Into()/Window.Assign
May 24, 2018 12:38:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T00:38:57.300Z: Fusing consumer OutputSideInputs into Create123/Read(CreateSource)
May 24, 2018 12:38:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T00:38:57.338Z: Fusing consumer PAssert$33/GroupGlobally/Window.Into()/Window.Assign into OutputSideInputs
May 24, 2018 12:38:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T00:38:57.379Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
May 24, 2018 12:38:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T00:38:57.426Z: Fusing consumer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map into PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
May 24, 2018 12:38:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T00:38:57.473Z: Fusing consumer PAssert$33/GroupGlobally/RewindowActuals/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map
May 24, 2018 12:38:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T00:38:57.520Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read
May 24, 2018 12:38:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T00:38:57.561Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
May 24, 2018 12:38:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T00:38:57.613Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
May 24, 2018 12:38:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T00:38:57.664Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
May 24, 2018 12:38:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T00:38:57.712Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
May 24, 2018 12:38:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T00:38:57.756Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
May 24, 2018 12:38:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T00:38:57.808Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into Create47/Read(CreateSource)
May 24, 2018 12:38:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T00:38:57.858Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
May 24, 2018 12:38:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T00:38:57.905Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
May 24, 2018 12:38:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T00:38:57.952Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
May 24, 2018 12:38:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T00:38:58.002Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
May 24, 2018 12:38:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T00:38:58.046Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
May 24, 2018 12:38:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T00:38:58.091Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
May 24, 2018 12:38:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T00:38:58.528Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Create
May 24, 2018 12:38:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T00:38:58.567Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Create
May 24, 2018 12:38:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T00:38:58.610Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
May 24, 2018 12:38:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T00:38:58.618Z: Starting 1 workers in us-central1-f...
May 24, 2018 12:38:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T00:38:58.638Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
May 24, 2018 12:39:01 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T00:38:58.891Z: Executing operation Create47/Read(CreateSource)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
May 24, 2018 12:39:01 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T00:38:58.940Z: Executing operation PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 24, 2018 12:39:05 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T00:39:04.924Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
May 24, 2018 12:39:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T00:39:15.295Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
May 24, 2018 12:39:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T00:39:15.349Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 24, 2018 12:39:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T00:39:47.099Z: Workers have started successfully.
May 24, 2018 12:40:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T00:40:08.553Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
May 24, 2018 12:40:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T00:40:08.667Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
May 24, 2018 12:40:15 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T00:40:14.742Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
May 24, 2018 12:40:15 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T00:40:14.853Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
May 24, 2018 12:40:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T00:40:27.984Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
May 24, 2018 12:40:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T00:40:28.219Z: Executing operation Create123/Read(CreateSource)+OutputSideInputs+PAssert$33/GroupGlobally/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write
May 24, 2018 12:40:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T00:40:34.377Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Close
May 24, 2018 12:40:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T00:40:34.486Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$33/GroupGlobally/RewindowActuals/Window.Assign+PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 24, 2018 12:40:39 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T00:40:38.525Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Close
May 24, 2018 12:40:39 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T00:40:38.618Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Read+PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$33/GroupGlobally/Values/Values/Map+PAssert$33/GroupGlobally/ParDo(Concat)+PAssert$33/GetPane/Map+PAssert$33/RunChecks+PAssert$33/VerifyAssertions/ParDo(DefaultConclude)
May 24, 2018 12:40:45 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T00:40:43.273Z: Cleaning up.
May 24, 2018 12:40:45 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T00:40:43.417Z: Stopping worker pool...
May 24, 2018 12:42:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T00:42:28.362Z: Autoscaling: Resized worker pool from 1 to 0.
May 24, 2018 12:42:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T00:42:28.388Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 24, 2018 12:42:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-24T00:42:28.430Z: Worker pool stopped.
May 24, 2018 12:42:37 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-05-23_17_38_47-1893331436128805200 finished with status DONE.
May 24, 2018 12:42:37 AM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-05-23_17_38_47-1893331436128805200. Found 1 success, 0 failures out of 1 expected assertions.
Gradle Test Executor 36 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest FAILED
209 tests completed, 34 failed, 2 skipped
Finished generating test XML results (0.634 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerTest>
Generating HTML test report...
Finished generating test html results (0.47 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest>
:beam-runners-google-cloud-dataflow-java:validatesRunnerTest (Thread[Task worker for ':' Thread 29,5,main]) completed. Took 2 hrs 13 mins 42.487 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:validatesRunnerTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 14m 46s
38 actionable tasks: 34 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/gm7mb6zhredya
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user robbe.sneyders@ml6.eu
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user sidhom@google.com
Build failed in Jenkins:
beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #330
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/330/display/redirect>
------------------------------------------
[...truncated 18.01 MB...]
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) as step s13
May 23, 2018 10:23:55 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map as step s14
May 23, 2018 10:23:55 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign as step s15
May 23, 2018 10:23:55 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey as step s16
May 23, 2018 10:23:55 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map as step s17
May 23, 2018 10:23:55 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RewindowActuals/Window.Assign as step s18
May 23, 2018 10:23:55 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map as step s19
May 23, 2018 10:23:55 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveActualsTriggering/Flatten.PCollections as step s20
May 23, 2018 10:23:55 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Create.Values/Read(CreateSource) as step s21
May 23, 2018 10:23:55 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign as step s22
May 23, 2018 10:23:55 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveDummyTriggering/Flatten.PCollections as step s23
May 23, 2018 10:23:55 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/FlattenDummyAndContents as step s24
May 23, 2018 10:23:55 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/NeverTrigger/Flatten.PCollections as step s25
May 23, 2018 10:23:55 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GroupDummyAndContents as step s26
May 23, 2018 10:23:55 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Values/Values/Map as step s27
May 23, 2018 10:23:55 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/ParDo(Concat) as step s28
May 23, 2018 10:23:55 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GetPane/Map as step s29
May 23, 2018 10:23:55 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/RunChecks as step s30
May 23, 2018 10:23:55 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/VerifyAssertions/ParDo(DefaultConclude) as step s31
May 23, 2018 10:23:55 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0523222349-240b71e8/output/results/staging/
May 23, 2018 10:23:55 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <71120 bytes, hash nMmn4ni_3wKhn3Q21dBU5Q> to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0523222349-240b71e8/output/results/staging/pipeline-nMmn4ni_3wKhn3Q21dBU5Q.pb
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 23, 2018 10:23:56 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-05-23_15_23_55-11859672486562389339?project=apache-beam-testing
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Submitted job: 2018-05-23_15_23_55-11859672486562389339
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 23, 2018 10:23:56 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-05-23_15_23_55-11859672486562389339
May 23, 2018 10:23:56 PM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-05-23_15_23_55-11859672486562389339 with 1 expected assertions.
May 23, 2018 10:24:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T22:23:55.665Z: Autoscaling is enabled for job 2018-05-23_15_23_55-11859672486562389339. The number of workers will be between 1 and 1000.
May 23, 2018 10:24:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T22:23:55.709Z: Autoscaling was automatically enabled for job 2018-05-23_15_23_55-11859672486562389339.
May 23, 2018 10:24:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T22:23:58.354Z: Checking required Cloud APIs are enabled.
May 23, 2018 10:24:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T22:23:58.477Z: Checking permissions granted to controller Service Account.
May 23, 2018 10:24:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T22:24:05.238Z: Worker configuration: n1-standard-1 in us-central1-b.
May 23, 2018 10:24:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T22:24:05.665Z: Expanding CoGroupByKey operations into optimizable parts.
May 23, 2018 10:24:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T22:24:05.828Z: Expanding GroupByKey operations into optimizable parts.
May 23, 2018 10:24:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T22:24:05.878Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
May 23, 2018 10:24:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T22:24:06.094Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
May 23, 2018 10:24:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T22:24:06.134Z: Elided trivial flatten
May 23, 2018 10:24:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T22:24:06.183Z: Elided trivial flatten
May 23, 2018 10:24:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T22:24:06.228Z: Elided trivial flatten
May 23, 2018 10:24:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T22:24:06.266Z: Unzipping flatten s24 for input s19.org.apache.beam.sdk.values.PCollection.<init>:329#8fd0f908e3ea90e3
May 23, 2018 10:24:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T22:24:06.309Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Reify, through flatten PAssert$33/GroupGlobally/FlattenDummyAndContents, into producer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map
May 23, 2018 10:24:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T22:24:06.351Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow into PAssert$33/GroupGlobally/GroupDummyAndContents/Read
May 23, 2018 10:24:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T22:24:06.389Z: Fusing consumer PAssert$33/GroupGlobally/ParDo(Concat) into PAssert$33/GroupGlobally/Values/Values/Map
May 23, 2018 10:24:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T22:24:06.417Z: Fusing consumer PAssert$33/GetPane/Map into PAssert$33/GroupGlobally/ParDo(Concat)
May 23, 2018 10:24:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T22:24:06.442Z: Fusing consumer PAssert$33/GroupGlobally/Values/Values/Map into PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow
May 23, 2018 10:24:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T22:24:06.484Z: Fusing consumer PAssert$33/RunChecks into PAssert$33/GetPane/Map
May 23, 2018 10:24:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T22:24:06.528Z: Fusing consumer PAssert$33/VerifyAssertions/ParDo(DefaultConclude) into PAssert$33/RunChecks
May 23, 2018 10:24:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T22:24:06.569Z: Unzipping flatten s24-u45 for input s26-reify-value18-c43
May 23, 2018 10:24:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T22:24:06.609Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Write, through flatten s24-u45, into producer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 23, 2018 10:24:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T22:24:06.669Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify into PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
May 23, 2018 10:24:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T22:24:06.715Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Write into PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 23, 2018 10:24:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T22:24:06.761Z: Fusing consumer PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)
May 23, 2018 10:24:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T22:24:06.802Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
May 23, 2018 10:24:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T22:24:06.834Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
May 23, 2018 10:24:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T22:24:06.876Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into PAssert$33/GroupGlobally/Window.Into()/Window.Assign
May 23, 2018 10:24:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T22:24:06.911Z: Fusing consumer OutputSideInputs into Create123/Read(CreateSource)
May 23, 2018 10:24:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T22:24:06.941Z: Fusing consumer PAssert$33/GroupGlobally/Window.Into()/Window.Assign into OutputSideInputs
May 23, 2018 10:24:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T22:24:06.987Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
May 23, 2018 10:24:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T22:24:07.030Z: Fusing consumer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map into PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
May 23, 2018 10:24:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T22:24:07.074Z: Fusing consumer PAssert$33/GroupGlobally/RewindowActuals/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map
May 23, 2018 10:24:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T22:24:07.118Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read
May 23, 2018 10:24:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T22:24:07.157Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
May 23, 2018 10:24:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T22:24:07.199Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
May 23, 2018 10:24:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T22:24:07.221Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
May 23, 2018 10:24:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T22:24:07.260Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
May 23, 2018 10:24:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T22:24:07.299Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
May 23, 2018 10:24:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T22:24:07.345Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into Create47/Read(CreateSource)
May 23, 2018 10:24:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T22:24:07.392Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
May 23, 2018 10:24:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T22:24:07.436Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
May 23, 2018 10:24:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T22:24:07.475Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
May 23, 2018 10:24:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T22:24:07.509Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
May 23, 2018 10:24:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T22:24:07.550Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
May 23, 2018 10:24:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T22:24:07.589Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
May 23, 2018 10:24:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T22:24:08.015Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Create
May 23, 2018 10:24:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T22:24:08.059Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Create
May 23, 2018 10:24:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T22:24:08.099Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
May 23, 2018 10:24:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T22:24:08.121Z: Starting 1 workers in us-central1-b...
May 23, 2018 10:24:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T22:24:08.136Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
May 23, 2018 10:24:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T22:24:08.328Z: Executing operation Create47/Read(CreateSource)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
May 23, 2018 10:24:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T22:24:08.367Z: Executing operation PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 23, 2018 10:24:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T22:24:15.781Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
May 23, 2018 10:24:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T22:24:26.281Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
May 23, 2018 10:24:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T22:24:26.321Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 23, 2018 10:24:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T22:24:52.703Z: Workers have started successfully.
May 23, 2018 10:25:22 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T22:25:21.149Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
May 23, 2018 10:25:22 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T22:25:21.229Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
May 23, 2018 10:25:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T22:25:26.892Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
May 23, 2018 10:25:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T22:25:26.967Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
May 23, 2018 10:25:40 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T22:25:39.850Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
May 23, 2018 10:25:40 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T22:25:40.045Z: Executing operation Create123/Read(CreateSource)+OutputSideInputs+PAssert$33/GroupGlobally/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write
May 23, 2018 10:25:46 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T22:25:45.756Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Close
May 23, 2018 10:25:46 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T22:25:45.854Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$33/GroupGlobally/RewindowActuals/Window.Assign+PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 23, 2018 10:25:48 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T22:25:47.789Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Close
May 23, 2018 10:25:48 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T22:25:47.880Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Read+PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$33/GroupGlobally/Values/Values/Map+PAssert$33/GroupGlobally/ParDo(Concat)+PAssert$33/GetPane/Map+PAssert$33/RunChecks+PAssert$33/VerifyAssertions/ParDo(DefaultConclude)
May 23, 2018 10:25:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T22:25:51.195Z: Cleaning up.
May 23, 2018 10:25:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T22:25:51.307Z: Stopping worker pool...
May 23, 2018 10:27:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T22:27:25.496Z: Autoscaling: Resized worker pool from 1 to 0.
May 23, 2018 10:27:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T22:27:25.549Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 23, 2018 10:27:36 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-05-23_15_23_55-11859672486562389339 finished with status DONE.
May 23, 2018 10:27:36 PM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-05-23_15_23_55-11859672486562389339. Found 1 success, 0 failures out of 1 expected assertions.
Gradle Test Executor 37 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest
209 tests completed, 34 failed, 2 skipped
Finished generating test XML results (0.585 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerTest>
Generating HTML test report...
Finished generating test html results (0.755 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest>
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest FAILED
:beam-runners-google-cloud-dataflow-java:validatesRunnerTest (Thread[Task worker for ':' Thread 44,5,main]) completed. Took 2 hrs 14 mins 35.493 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:validatesRunnerTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 15m 40s
38 actionable tasks: 34 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/42c5fobgzv4bm
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user robbe.sneyders@ml6.eu
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user sidhom@google.com
Build failed in Jenkins:
beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #329
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/329/display/redirect?page=changes>
Changes:
[iemejia] Fix build with Maven (Again!)
------------------------------------------
[...truncated 18.04 MB...]
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) as step s13
May 23, 2018 8:07:14 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map as step s14
May 23, 2018 8:07:14 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign as step s15
May 23, 2018 8:07:14 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey as step s16
May 23, 2018 8:07:14 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map as step s17
May 23, 2018 8:07:14 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RewindowActuals/Window.Assign as step s18
May 23, 2018 8:07:14 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map as step s19
May 23, 2018 8:07:14 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveActualsTriggering/Flatten.PCollections as step s20
May 23, 2018 8:07:14 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Create.Values/Read(CreateSource) as step s21
May 23, 2018 8:07:14 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign as step s22
May 23, 2018 8:07:14 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveDummyTriggering/Flatten.PCollections as step s23
May 23, 2018 8:07:14 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/FlattenDummyAndContents as step s24
May 23, 2018 8:07:14 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/NeverTrigger/Flatten.PCollections as step s25
May 23, 2018 8:07:14 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GroupDummyAndContents as step s26
May 23, 2018 8:07:14 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Values/Values/Map as step s27
May 23, 2018 8:07:14 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/ParDo(Concat) as step s28
May 23, 2018 8:07:14 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GetPane/Map as step s29
May 23, 2018 8:07:14 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/RunChecks as step s30
May 23, 2018 8:07:14 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/VerifyAssertions/ParDo(DefaultConclude) as step s31
May 23, 2018 8:07:14 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0523200708-4858810a/output/results/staging/
May 23, 2018 8:07:14 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <71120 bytes, hash BINf6ZeBEX7tFcFVqHM3Yg> to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0523200708-4858810a/output/results/staging/pipeline-BINf6ZeBEX7tFcFVqHM3Yg.pb
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 23, 2018 8:07:15 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-05-23_13_07_14-10996759833510424469?project=apache-beam-testing
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Submitted job: 2018-05-23_13_07_14-10996759833510424469
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 23, 2018 8:07:15 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-05-23_13_07_14-10996759833510424469
May 23, 2018 8:07:15 PM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-05-23_13_07_14-10996759833510424469 with 1 expected assertions.
May 23, 2018 8:07:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T20:07:14.972Z: Autoscaling is enabled for job 2018-05-23_13_07_14-10996759833510424469. The number of workers will be between 1 and 1000.
May 23, 2018 8:07:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T20:07:15.015Z: Autoscaling was automatically enabled for job 2018-05-23_13_07_14-10996759833510424469.
May 23, 2018 8:07:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T20:07:17.411Z: Checking required Cloud APIs are enabled.
May 23, 2018 8:07:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T20:07:17.536Z: Checking permissions granted to controller Service Account.
May 23, 2018 8:07:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T20:07:24.131Z: Worker configuration: n1-standard-1 in us-central1-b.
May 23, 2018 8:07:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T20:07:24.622Z: Expanding CoGroupByKey operations into optimizable parts.
May 23, 2018 8:07:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T20:07:24.807Z: Expanding GroupByKey operations into optimizable parts.
May 23, 2018 8:07:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T20:07:24.851Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
May 23, 2018 8:07:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T20:07:25.085Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
May 23, 2018 8:07:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T20:07:25.123Z: Elided trivial flatten
May 23, 2018 8:07:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T20:07:25.168Z: Elided trivial flatten
May 23, 2018 8:07:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T20:07:25.216Z: Elided trivial flatten
May 23, 2018 8:07:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T20:07:25.263Z: Unzipping flatten s24 for input s19.org.apache.beam.sdk.values.PCollection.<init>:329#8fd0f908e3ea90e3
May 23, 2018 8:07:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T20:07:25.301Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Reify, through flatten PAssert$33/GroupGlobally/FlattenDummyAndContents, into producer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map
May 23, 2018 8:07:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T20:07:25.332Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow into PAssert$33/GroupGlobally/GroupDummyAndContents/Read
May 23, 2018 8:07:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T20:07:25.374Z: Fusing consumer PAssert$33/GroupGlobally/ParDo(Concat) into PAssert$33/GroupGlobally/Values/Values/Map
May 23, 2018 8:07:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T20:07:25.410Z: Fusing consumer PAssert$33/GetPane/Map into PAssert$33/GroupGlobally/ParDo(Concat)
May 23, 2018 8:07:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T20:07:25.459Z: Fusing consumer PAssert$33/GroupGlobally/Values/Values/Map into PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow
May 23, 2018 8:07:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T20:07:25.509Z: Fusing consumer PAssert$33/RunChecks into PAssert$33/GetPane/Map
May 23, 2018 8:07:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T20:07:25.555Z: Fusing consumer PAssert$33/VerifyAssertions/ParDo(DefaultConclude) into PAssert$33/RunChecks
May 23, 2018 8:07:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T20:07:25.603Z: Unzipping flatten s24-u45 for input s26-reify-value18-c43
May 23, 2018 8:07:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T20:07:25.639Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Write, through flatten s24-u45, into producer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 23, 2018 8:07:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T20:07:25.679Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify into PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
May 23, 2018 8:07:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T20:07:25.720Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Write into PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 23, 2018 8:07:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T20:07:25.765Z: Fusing consumer PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)
May 23, 2018 8:07:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T20:07:25.811Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
May 23, 2018 8:07:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T20:07:25.861Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
May 23, 2018 8:07:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T20:07:25.904Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into PAssert$33/GroupGlobally/Window.Into()/Window.Assign
May 23, 2018 8:07:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T20:07:25.951Z: Fusing consumer OutputSideInputs into Create123/Read(CreateSource)
May 23, 2018 8:07:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T20:07:25.995Z: Fusing consumer PAssert$33/GroupGlobally/Window.Into()/Window.Assign into OutputSideInputs
May 23, 2018 8:07:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T20:07:26.047Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
May 23, 2018 8:07:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T20:07:26.087Z: Fusing consumer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map into PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
May 23, 2018 8:07:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T20:07:26.135Z: Fusing consumer PAssert$33/GroupGlobally/RewindowActuals/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map
May 23, 2018 8:07:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T20:07:26.186Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read
May 23, 2018 8:07:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T20:07:26.224Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
May 23, 2018 8:07:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T20:07:26.273Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
May 23, 2018 8:07:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T20:07:26.320Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
May 23, 2018 8:07:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T20:07:26.363Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
May 23, 2018 8:07:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T20:07:26.409Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
May 23, 2018 8:07:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T20:07:26.451Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into Create47/Read(CreateSource)
May 23, 2018 8:07:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T20:07:26.498Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
May 23, 2018 8:07:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T20:07:26.537Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
May 23, 2018 8:07:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T20:07:26.579Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
May 23, 2018 8:07:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T20:07:26.617Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
May 23, 2018 8:07:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T20:07:26.656Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
May 23, 2018 8:07:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T20:07:26.685Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
May 23, 2018 8:07:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T20:07:27.179Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Create
May 23, 2018 8:07:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T20:07:27.216Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Create
May 23, 2018 8:07:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T20:07:27.263Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
May 23, 2018 8:07:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T20:07:27.308Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
May 23, 2018 8:07:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T20:07:27.619Z: Starting 1 workers in us-central1-b...
May 23, 2018 8:07:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T20:07:27.928Z: Executing operation PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 23, 2018 8:07:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T20:07:27.981Z: Executing operation Create47/Read(CreateSource)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
May 23, 2018 8:07:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T20:07:35.189Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
May 23, 2018 8:07:48 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T20:07:45.690Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
May 23, 2018 8:07:48 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T20:07:45.733Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 23, 2018 8:08:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T20:08:17.676Z: Workers have started successfully.
May 23, 2018 8:09:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T20:09:05.766Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
May 23, 2018 8:09:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T20:09:05.853Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
May 23, 2018 8:09:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T20:09:15.892Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
May 23, 2018 8:09:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T20:09:15.991Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
May 23, 2018 8:09:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T20:09:30.454Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
May 23, 2018 8:09:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T20:09:30.629Z: Executing operation Create123/Read(CreateSource)+OutputSideInputs+PAssert$33/GroupGlobally/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write
May 23, 2018 8:09:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T20:09:37.217Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Close
May 23, 2018 8:09:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T20:09:37.321Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$33/GroupGlobally/RewindowActuals/Window.Assign+PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 23, 2018 8:09:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T20:09:40.056Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Close
May 23, 2018 8:09:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T20:09:40.148Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Read+PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$33/GroupGlobally/Values/Values/Map+PAssert$33/GroupGlobally/ParDo(Concat)+PAssert$33/GetPane/Map+PAssert$33/RunChecks+PAssert$33/VerifyAssertions/ParDo(DefaultConclude)
May 23, 2018 8:09:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T20:09:44.201Z: Cleaning up.
May 23, 2018 8:09:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T20:09:44.322Z: Stopping worker pool...
May 23, 2018 8:11:33 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T20:11:31.739Z: Autoscaling: Resized worker pool from 1 to 0.
May 23, 2018 8:11:33 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T20:11:31.760Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 23, 2018 8:11:42 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-05-23_13_07_14-10996759833510424469 finished with status DONE.
May 23, 2018 8:11:42 PM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-05-23_13_07_14-10996759833510424469. Found 1 success, 0 failures out of 1 expected assertions.
Gradle Test Executor 38 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest
209 tests completed, 34 failed, 2 skipped
Finished generating test XML results (0.74 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerTest>
Generating HTML test report...
Finished generating test html results (0.575 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest>
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest FAILED
:beam-runners-google-cloud-dataflow-java:validatesRunnerTest (Thread[Task worker for ':' Thread 34,5,main]) completed. Took 2 hrs 25 mins 27.749 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:validatesRunnerTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 26m 32s
38 actionable tasks: 34 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/qy6apkpgugtfu
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user robbe.sneyders@ml6.eu
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user sidhom@google.com
Build failed in Jenkins:
beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #328
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/328/display/redirect?page=changes>
Changes:
[lukasz.gajowy] [BEAM-214] Add ParquetIO
[lukasz.gajowy] [BEAM-214] Add gradle build in ParquetIO
[lukasz.gajowy] [BEAM-214] Refactore the reads to leverage FileIO
[lukasz.gajowy] [BEAM-214] Use Parquet 1.10.0 version in ParquetIO.Sink
[lukasz.gajowy] [BEAM-214] Add ParquetIOIT
[lukasz.gajowy] [BEAM-214] Update ReadFn to an non deprecated, newest Parquet API
[lukasz.gajowy] [BEAM-214] Simplify the IO by removing redundant PTransforms
[lukasz.gajowy] [BEAM-214] Implement writing slices of bytes in BeamOutputStream
[lukasz.gajowy] [BEAM-214] Apply reviewer's suggestions
------------------------------------------
[...truncated 17.97 MB...]
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map as step s14
May 23, 2018 5:41:05 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign as step s15
May 23, 2018 5:41:05 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey as step s16
May 23, 2018 5:41:05 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map as step s17
May 23, 2018 5:41:05 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RewindowActuals/Window.Assign as step s18
May 23, 2018 5:41:05 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map as step s19
May 23, 2018 5:41:05 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveActualsTriggering/Flatten.PCollections as step s20
May 23, 2018 5:41:05 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Create.Values/Read(CreateSource) as step s21
May 23, 2018 5:41:05 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign as step s22
May 23, 2018 5:41:05 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveDummyTriggering/Flatten.PCollections as step s23
May 23, 2018 5:41:05 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/FlattenDummyAndContents as step s24
May 23, 2018 5:41:05 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/NeverTrigger/Flatten.PCollections as step s25
May 23, 2018 5:41:05 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GroupDummyAndContents as step s26
May 23, 2018 5:41:05 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Values/Values/Map as step s27
May 23, 2018 5:41:05 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/ParDo(Concat) as step s28
May 23, 2018 5:41:05 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GetPane/Map as step s29
May 23, 2018 5:41:05 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/RunChecks as step s30
May 23, 2018 5:41:05 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/VerifyAssertions/ParDo(DefaultConclude) as step s31
May 23, 2018 5:41:05 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0523174100-e8c1d5f5/output/results/staging/
May 23, 2018 5:41:05 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <71120 bytes, hash k0g2PwU-YUQBbiAe1piHZA> to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0523174100-e8c1d5f5/output/results/staging/pipeline-k0g2PwU-YUQBbiAe1piHZA.pb
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 23, 2018 5:41:07 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-05-23_10_41_06-7799824319188587165?project=apache-beam-testing
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Submitted job: 2018-05-23_10_41_06-7799824319188587165
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 23, 2018 5:41:07 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-05-23_10_41_06-7799824319188587165
May 23, 2018 5:41:07 PM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-05-23_10_41_06-7799824319188587165 with 1 expected assertions.
May 23, 2018 5:41:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T17:41:06.340Z: Autoscaling is enabled for job 2018-05-23_10_41_06-7799824319188587165. The number of workers will be between 1 and 1000.
May 23, 2018 5:41:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T17:41:06.378Z: Autoscaling was automatically enabled for job 2018-05-23_10_41_06-7799824319188587165.
May 23, 2018 5:41:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T17:41:09.014Z: Checking required Cloud APIs are enabled.
May 23, 2018 5:41:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T17:41:09.218Z: Checking permissions granted to controller Service Account.
May 23, 2018 5:41:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T17:41:15.380Z: Worker configuration: n1-standard-1 in us-central1-f.
May 23, 2018 5:41:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T17:41:15.738Z: Expanding CoGroupByKey operations into optimizable parts.
May 23, 2018 5:41:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T17:41:15.903Z: Expanding GroupByKey operations into optimizable parts.
May 23, 2018 5:41:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T17:41:15.947Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
May 23, 2018 5:41:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T17:41:16.166Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
May 23, 2018 5:41:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T17:41:16.209Z: Elided trivial flatten
May 23, 2018 5:41:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T17:41:16.256Z: Elided trivial flatten
May 23, 2018 5:41:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T17:41:16.305Z: Elided trivial flatten
May 23, 2018 5:41:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T17:41:16.352Z: Unzipping flatten s24 for input s19.org.apache.beam.sdk.values.PCollection.<init>:329#8fd0f908e3ea90e3
May 23, 2018 5:41:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T17:41:16.393Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Reify, through flatten PAssert$33/GroupGlobally/FlattenDummyAndContents, into producer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map
May 23, 2018 5:41:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T17:41:16.437Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow into PAssert$33/GroupGlobally/GroupDummyAndContents/Read
May 23, 2018 5:41:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T17:41:16.480Z: Fusing consumer PAssert$33/GroupGlobally/ParDo(Concat) into PAssert$33/GroupGlobally/Values/Values/Map
May 23, 2018 5:41:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T17:41:16.522Z: Fusing consumer PAssert$33/GetPane/Map into PAssert$33/GroupGlobally/ParDo(Concat)
May 23, 2018 5:41:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T17:41:16.565Z: Fusing consumer PAssert$33/GroupGlobally/Values/Values/Map into PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow
May 23, 2018 5:41:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T17:41:16.607Z: Fusing consumer PAssert$33/RunChecks into PAssert$33/GetPane/Map
May 23, 2018 5:41:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T17:41:16.651Z: Fusing consumer PAssert$33/VerifyAssertions/ParDo(DefaultConclude) into PAssert$33/RunChecks
May 23, 2018 5:41:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T17:41:16.697Z: Unzipping flatten s24-u45 for input s26-reify-value18-c43
May 23, 2018 5:41:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T17:41:16.741Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Write, through flatten s24-u45, into producer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 23, 2018 5:41:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T17:41:16.783Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify into PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
May 23, 2018 5:41:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T17:41:16.830Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Write into PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 23, 2018 5:41:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T17:41:16.877Z: Fusing consumer PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)
May 23, 2018 5:41:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T17:41:16.922Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
May 23, 2018 5:41:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T17:41:16.968Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
May 23, 2018 5:41:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T17:41:17.003Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into PAssert$33/GroupGlobally/Window.Into()/Window.Assign
May 23, 2018 5:41:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T17:41:17.039Z: Fusing consumer OutputSideInputs into Create123/Read(CreateSource)
May 23, 2018 5:41:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T17:41:17.085Z: Fusing consumer PAssert$33/GroupGlobally/Window.Into()/Window.Assign into OutputSideInputs
May 23, 2018 5:41:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T17:41:17.131Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
May 23, 2018 5:41:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T17:41:17.176Z: Fusing consumer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map into PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
May 23, 2018 5:41:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T17:41:17.212Z: Fusing consumer PAssert$33/GroupGlobally/RewindowActuals/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map
May 23, 2018 5:41:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T17:41:17.259Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read
May 23, 2018 5:41:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T17:41:17.306Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
May 23, 2018 5:41:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T17:41:17.352Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
May 23, 2018 5:41:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T17:41:17.388Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
May 23, 2018 5:41:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T17:41:17.432Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
May 23, 2018 5:41:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T17:41:17.470Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
May 23, 2018 5:41:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T17:41:17.507Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into Create47/Read(CreateSource)
May 23, 2018 5:41:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T17:41:17.551Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
May 23, 2018 5:41:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T17:41:17.591Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
May 23, 2018 5:41:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T17:41:17.637Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
May 23, 2018 5:41:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T17:41:17.678Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
May 23, 2018 5:41:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T17:41:17.721Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
May 23, 2018 5:41:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T17:41:17.767Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
May 23, 2018 5:41:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T17:41:18.220Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Create
May 23, 2018 5:41:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T17:41:18.265Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Create
May 23, 2018 5:41:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T17:41:18.306Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
May 23, 2018 5:41:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T17:41:18.320Z: Starting 1 workers in us-central1-f...
May 23, 2018 5:41:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T17:41:18.350Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
May 23, 2018 5:41:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T17:41:18.599Z: Executing operation PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 23, 2018 5:41:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T17:41:18.652Z: Executing operation Create47/Read(CreateSource)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
May 23, 2018 5:41:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T17:41:25.295Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
May 23, 2018 5:41:47 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T17:41:45.964Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
May 23, 2018 5:41:47 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T17:41:46.002Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 23, 2018 5:42:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T17:42:00.744Z: Workers have started successfully.
May 23, 2018 5:42:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T17:42:22.197Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
May 23, 2018 5:42:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T17:42:22.282Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
May 23, 2018 5:42:25 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T17:42:24.239Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
May 23, 2018 5:42:25 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T17:42:24.320Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
May 23, 2018 5:42:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T17:42:33.350Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
May 23, 2018 5:42:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T17:42:33.561Z: Executing operation Create123/Read(CreateSource)+OutputSideInputs+PAssert$33/GroupGlobally/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write
May 23, 2018 5:42:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T17:42:34.636Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Close
May 23, 2018 5:42:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T17:42:34.748Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$33/GroupGlobally/RewindowActuals/Window.Assign+PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 23, 2018 5:42:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T17:42:37.097Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Close
May 23, 2018 5:42:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T17:42:37.186Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Read+PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$33/GroupGlobally/Values/Values/Map+PAssert$33/GroupGlobally/ParDo(Concat)+PAssert$33/GetPane/Map+PAssert$33/RunChecks+PAssert$33/VerifyAssertions/ParDo(DefaultConclude)
May 23, 2018 5:42:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T17:42:38.353Z: Cleaning up.
May 23, 2018 5:42:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T17:42:38.448Z: Stopping worker pool...
May 23, 2018 5:44:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T17:44:40.804Z: Autoscaling: Resized worker pool from 1 to 0.
May 23, 2018 5:44:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T17:44:40.845Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 23, 2018 5:44:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T17:44:40.901Z: Worker pool stopped.
May 23, 2018 5:44:49 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-05-23_10_41_06-7799824319188587165 finished with status DONE.
May 23, 2018 5:44:49 PM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-05-23_10_41_06-7799824319188587165. Found 1 success, 0 failures out of 1 expected assertions.
Gradle Test Executor 41 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest
209 tests completed, 34 failed, 2 skipped
Finished generating test XML results (0.607 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerTest>
Generating HTML test report...
Finished generating test html results (0.69 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest>
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest FAILED
:beam-runners-google-cloud-dataflow-java:validatesRunnerTest (Thread[Task worker for ':' Thread 44,5,main]) completed. Took 2 hrs 5 mins 46.91 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:validatesRunnerTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 6m 57s
38 actionable tasks: 34 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/vtjr6wiymvhqs
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user robbe.sneyders@ml6.eu
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user sidhom@google.com
Build failed in Jenkins:
beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #327
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/327/display/redirect>
------------------------------------------
[...truncated 18.07 MB...]
May 23, 2018 2:05:37 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) as step s13
May 23, 2018 2:05:37 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map as step s14
May 23, 2018 2:05:37 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign as step s15
May 23, 2018 2:05:37 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey as step s16
May 23, 2018 2:05:37 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map as step s17
May 23, 2018 2:05:37 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RewindowActuals/Window.Assign as step s18
May 23, 2018 2:05:37 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map as step s19
May 23, 2018 2:05:37 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveActualsTriggering/Flatten.PCollections as step s20
May 23, 2018 2:05:37 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Create.Values/Read(CreateSource) as step s21
May 23, 2018 2:05:37 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign as step s22
May 23, 2018 2:05:37 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveDummyTriggering/Flatten.PCollections as step s23
May 23, 2018 2:05:37 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/FlattenDummyAndContents as step s24
May 23, 2018 2:05:37 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/NeverTrigger/Flatten.PCollections as step s25
May 23, 2018 2:05:37 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GroupDummyAndContents as step s26
May 23, 2018 2:05:37 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Values/Values/Map as step s27
May 23, 2018 2:05:37 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/ParDo(Concat) as step s28
May 23, 2018 2:05:37 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GetPane/Map as step s29
May 23, 2018 2:05:37 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/RunChecks as step s30
May 23, 2018 2:05:37 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/VerifyAssertions/ParDo(DefaultConclude) as step s31
May 23, 2018 2:05:37 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0523140532-f323c42e/output/results/staging/
May 23, 2018 2:05:37 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <71120 bytes, hash Dk-VSnB8mXTPMqf01JK2_A> to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0523140532-f323c42e/output/results/staging/pipeline-Dk-VSnB8mXTPMqf01JK2_A.pb
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 23, 2018 2:05:39 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-05-23_07_05_38-13756324777971081810?project=apache-beam-testing
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Submitted job: 2018-05-23_07_05_38-13756324777971081810
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 23, 2018 2:05:39 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-05-23_07_05_38-13756324777971081810
May 23, 2018 2:05:39 PM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-05-23_07_05_38-13756324777971081810 with 1 expected assertions.
May 23, 2018 2:05:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T14:05:38.383Z: Autoscaling is enabled for job 2018-05-23_07_05_38-13756324777971081810. The number of workers will be between 1 and 1000.
May 23, 2018 2:05:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T14:05:38.412Z: Autoscaling was automatically enabled for job 2018-05-23_07_05_38-13756324777971081810.
May 23, 2018 2:05:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T14:05:41.070Z: Checking required Cloud APIs are enabled.
May 23, 2018 2:05:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T14:05:41.392Z: Checking permissions granted to controller Service Account.
May 23, 2018 2:05:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T14:05:47.173Z: Worker configuration: n1-standard-1 in us-central1-f.
May 23, 2018 2:05:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T14:05:47.567Z: Expanding CoGroupByKey operations into optimizable parts.
May 23, 2018 2:05:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T14:05:47.728Z: Expanding GroupByKey operations into optimizable parts.
May 23, 2018 2:05:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T14:05:47.759Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
May 23, 2018 2:05:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T14:05:47.990Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
May 23, 2018 2:05:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T14:05:48.033Z: Elided trivial flatten
May 23, 2018 2:05:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T14:05:48.078Z: Elided trivial flatten
May 23, 2018 2:05:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T14:05:48.142Z: Elided trivial flatten
May 23, 2018 2:05:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T14:05:48.199Z: Unzipping flatten s24 for input s19.org.apache.beam.sdk.values.PCollection.<init>:329#8fd0f908e3ea90e3
May 23, 2018 2:05:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T14:05:48.233Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Reify, through flatten PAssert$33/GroupGlobally/FlattenDummyAndContents, into producer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map
May 23, 2018 2:05:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T14:05:48.268Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow into PAssert$33/GroupGlobally/GroupDummyAndContents/Read
May 23, 2018 2:05:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T14:05:48.307Z: Fusing consumer PAssert$33/GroupGlobally/ParDo(Concat) into PAssert$33/GroupGlobally/Values/Values/Map
May 23, 2018 2:05:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T14:05:48.345Z: Fusing consumer PAssert$33/GetPane/Map into PAssert$33/GroupGlobally/ParDo(Concat)
May 23, 2018 2:05:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T14:05:48.390Z: Fusing consumer PAssert$33/GroupGlobally/Values/Values/Map into PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow
May 23, 2018 2:05:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T14:05:48.431Z: Fusing consumer PAssert$33/RunChecks into PAssert$33/GetPane/Map
May 23, 2018 2:05:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T14:05:48.474Z: Fusing consumer PAssert$33/VerifyAssertions/ParDo(DefaultConclude) into PAssert$33/RunChecks
May 23, 2018 2:05:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T14:05:48.511Z: Unzipping flatten s24-u45 for input s26-reify-value18-c43
May 23, 2018 2:05:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T14:05:48.557Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Write, through flatten s24-u45, into producer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 23, 2018 2:05:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T14:05:48.603Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify into PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
May 23, 2018 2:05:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T14:05:48.640Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Write into PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 23, 2018 2:05:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T14:05:48.677Z: Fusing consumer PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)
May 23, 2018 2:05:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T14:05:48.718Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
May 23, 2018 2:05:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T14:05:48.756Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
May 23, 2018 2:05:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T14:05:48.793Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into PAssert$33/GroupGlobally/Window.Into()/Window.Assign
May 23, 2018 2:05:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T14:05:48.830Z: Fusing consumer OutputSideInputs into Create123/Read(CreateSource)
May 23, 2018 2:05:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T14:05:48.877Z: Fusing consumer PAssert$33/GroupGlobally/Window.Into()/Window.Assign into OutputSideInputs
May 23, 2018 2:05:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T14:05:48.913Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
May 23, 2018 2:05:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T14:05:48.950Z: Fusing consumer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map into PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
May 23, 2018 2:05:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T14:05:48.979Z: Fusing consumer PAssert$33/GroupGlobally/RewindowActuals/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map
May 23, 2018 2:05:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T14:05:49.024Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read
May 23, 2018 2:05:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T14:05:49.072Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
May 23, 2018 2:05:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T14:05:49.108Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
May 23, 2018 2:05:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T14:05:49.154Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
May 23, 2018 2:05:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T14:05:49.200Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
May 23, 2018 2:05:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T14:05:49.234Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
May 23, 2018 2:05:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T14:05:49.261Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into Create47/Read(CreateSource)
May 23, 2018 2:05:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T14:05:49.293Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
May 23, 2018 2:05:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T14:05:49.328Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
May 23, 2018 2:05:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T14:05:49.365Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
May 23, 2018 2:05:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T14:05:49.400Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
May 23, 2018 2:05:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T14:05:49.438Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
May 23, 2018 2:05:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T14:05:49.481Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
May 23, 2018 2:05:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T14:05:49.923Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Create
May 23, 2018 2:05:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T14:05:49.951Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Create
May 23, 2018 2:05:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T14:05:49.986Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
May 23, 2018 2:05:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T14:05:50.019Z: Starting 1 workers in us-central1-f...
May 23, 2018 2:05:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T14:05:50.019Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
May 23, 2018 2:05:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T14:05:50.319Z: Executing operation Create47/Read(CreateSource)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
May 23, 2018 2:05:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T14:05:50.355Z: Executing operation PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 23, 2018 2:05:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T14:05:57.412Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
May 23, 2018 2:06:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T14:06:07.890Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
May 23, 2018 2:06:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T14:06:07.932Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 23, 2018 2:06:24 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T14:06:23.852Z: Workers have started successfully.
May 23, 2018 2:06:56 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T14:06:56.397Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
May 23, 2018 2:06:56 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T14:06:56.466Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
May 23, 2018 2:07:07 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T14:07:06.365Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
May 23, 2018 2:07:07 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T14:07:06.453Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
May 23, 2018 2:07:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T14:07:17.824Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
May 23, 2018 2:07:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T14:07:17.993Z: Executing operation Create123/Read(CreateSource)+OutputSideInputs+PAssert$33/GroupGlobally/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write
May 23, 2018 2:07:24 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T14:07:22.508Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Close
May 23, 2018 2:07:24 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T14:07:22.548Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$33/GroupGlobally/RewindowActuals/Window.Assign+PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 23, 2018 2:07:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T14:07:26.371Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Close
May 23, 2018 2:07:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T14:07:26.417Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Read+PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$33/GroupGlobally/Values/Values/Map+PAssert$33/GroupGlobally/ParDo(Concat)+PAssert$33/GetPane/Map+PAssert$33/RunChecks+PAssert$33/VerifyAssertions/ParDo(DefaultConclude)
May 23, 2018 2:07:32 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T14:07:31.374Z: Cleaning up.
May 23, 2018 2:07:32 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T14:07:31.469Z: Stopping worker pool...
May 23, 2018 2:08:54 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T14:08:52.939Z: Autoscaling: Resized worker pool from 1 to 0.
May 23, 2018 2:08:54 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T14:08:52.961Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 23, 2018 2:08:54 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T14:08:52.995Z: Worker pool stopped.
May 23, 2018 2:09:02 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-05-23_07_05_38-13756324777971081810 finished with status DONE.
May 23, 2018 2:09:02 PM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-05-23_07_05_38-13756324777971081810. Found 1 success, 0 failures out of 1 expected assertions.
Gradle Test Executor 38 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest FAILED
209 tests completed, 34 failed, 2 skipped
Finished generating test XML results (0.659 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerTest>
Generating HTML test report...
Finished generating test html results (0.224 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest>
:beam-runners-google-cloud-dataflow-java:validatesRunnerTest (Thread[Task worker for ':' Thread 30,5,main]) completed. Took 2 hrs 7 mins 15.515 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:validatesRunnerTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 8m 36s
38 actionable tasks: 34 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/ad6erjqfmhv4s
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user robbe.sneyders@ml6.eu
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user sidhom@google.com
Build failed in Jenkins:
beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #326
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/326/display/redirect?page=changes>
Changes:
[timrobertson100] [BEAM-4354] Enforce ErrorProne analysis in tika IO
------------------------------------------
[...truncated 18.02 MB...]
May 23, 2018 10:13:47 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Window.Into()/Window.Assign as step s12
May 23, 2018 10:13:47 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) as step s13
May 23, 2018 10:13:47 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map as step s14
May 23, 2018 10:13:47 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign as step s15
May 23, 2018 10:13:47 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey as step s16
May 23, 2018 10:13:47 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map as step s17
May 23, 2018 10:13:47 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RewindowActuals/Window.Assign as step s18
May 23, 2018 10:13:47 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map as step s19
May 23, 2018 10:13:47 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveActualsTriggering/Flatten.PCollections as step s20
May 23, 2018 10:13:47 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Create.Values/Read(CreateSource) as step s21
May 23, 2018 10:13:47 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign as step s22
May 23, 2018 10:13:47 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveDummyTriggering/Flatten.PCollections as step s23
May 23, 2018 10:13:47 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/FlattenDummyAndContents as step s24
May 23, 2018 10:13:47 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/NeverTrigger/Flatten.PCollections as step s25
May 23, 2018 10:13:47 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GroupDummyAndContents as step s26
May 23, 2018 10:13:47 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Values/Values/Map as step s27
May 23, 2018 10:13:47 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/ParDo(Concat) as step s28
May 23, 2018 10:13:47 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GetPane/Map as step s29
May 23, 2018 10:13:47 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/RunChecks as step s30
May 23, 2018 10:13:47 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/VerifyAssertions/ParDo(DefaultConclude) as step s31
May 23, 2018 10:13:47 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0523101342-cb2cf220/output/results/staging/
May 23, 2018 10:13:47 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <71120 bytes, hash H71nZ82QfvOyK9RvcVR5_w> to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0523101342-cb2cf220/output/results/staging/pipeline-H71nZ82QfvOyK9RvcVR5_w.pb
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 23, 2018 10:13:49 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-05-23_03_13_48-11120570797316254617?project=apache-beam-testing
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Submitted job: 2018-05-23_03_13_48-11120570797316254617
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 23, 2018 10:13:49 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-05-23_03_13_48-11120570797316254617
May 23, 2018 10:13:49 AM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-05-23_03_13_48-11120570797316254617 with 1 expected assertions.
May 23, 2018 10:14:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T10:13:48.548Z: Autoscaling is enabled for job 2018-05-23_03_13_48-11120570797316254617. The number of workers will be between 1 and 1000.
May 23, 2018 10:14:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T10:13:48.591Z: Autoscaling was automatically enabled for job 2018-05-23_03_13_48-11120570797316254617.
May 23, 2018 10:14:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T10:13:51.082Z: Checking required Cloud APIs are enabled.
May 23, 2018 10:14:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T10:13:51.211Z: Checking permissions granted to controller Service Account.
May 23, 2018 10:14:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T10:13:56.756Z: Worker configuration: n1-standard-1 in us-central1-f.
May 23, 2018 10:14:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T10:13:57.244Z: Expanding CoGroupByKey operations into optimizable parts.
May 23, 2018 10:14:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T10:13:57.399Z: Expanding GroupByKey operations into optimizable parts.
May 23, 2018 10:14:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T10:13:57.439Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
May 23, 2018 10:14:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T10:13:57.661Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
May 23, 2018 10:14:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T10:13:57.694Z: Elided trivial flatten
May 23, 2018 10:14:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T10:13:57.736Z: Elided trivial flatten
May 23, 2018 10:14:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T10:13:57.780Z: Elided trivial flatten
May 23, 2018 10:14:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T10:13:57.812Z: Unzipping flatten s24 for input s19.org.apache.beam.sdk.values.PCollection.<init>:329#8fd0f908e3ea90e3
May 23, 2018 10:14:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T10:13:57.848Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Reify, through flatten PAssert$33/GroupGlobally/FlattenDummyAndContents, into producer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map
May 23, 2018 10:14:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T10:13:57.883Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow into PAssert$33/GroupGlobally/GroupDummyAndContents/Read
May 23, 2018 10:14:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T10:13:57.917Z: Fusing consumer PAssert$33/GroupGlobally/ParDo(Concat) into PAssert$33/GroupGlobally/Values/Values/Map
May 23, 2018 10:14:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T10:13:57.946Z: Fusing consumer PAssert$33/GetPane/Map into PAssert$33/GroupGlobally/ParDo(Concat)
May 23, 2018 10:14:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T10:13:57.971Z: Fusing consumer PAssert$33/GroupGlobally/Values/Values/Map into PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow
May 23, 2018 10:14:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T10:13:58.006Z: Fusing consumer PAssert$33/RunChecks into PAssert$33/GetPane/Map
May 23, 2018 10:14:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T10:13:58.040Z: Fusing consumer PAssert$33/VerifyAssertions/ParDo(DefaultConclude) into PAssert$33/RunChecks
May 23, 2018 10:14:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T10:13:58.076Z: Unzipping flatten s24-u45 for input s26-reify-value18-c43
May 23, 2018 10:14:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T10:13:58.112Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Write, through flatten s24-u45, into producer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 23, 2018 10:14:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T10:13:58.142Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify into PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
May 23, 2018 10:14:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T10:13:58.174Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Write into PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 23, 2018 10:14:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T10:13:58.216Z: Fusing consumer PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)
May 23, 2018 10:14:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T10:13:58.248Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
May 23, 2018 10:14:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T10:13:58.284Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
May 23, 2018 10:14:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T10:13:58.327Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into PAssert$33/GroupGlobally/Window.Into()/Window.Assign
May 23, 2018 10:14:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T10:13:58.368Z: Fusing consumer OutputSideInputs into Create123/Read(CreateSource)
May 23, 2018 10:14:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T10:13:58.402Z: Fusing consumer PAssert$33/GroupGlobally/Window.Into()/Window.Assign into OutputSideInputs
May 23, 2018 10:14:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T10:13:58.439Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
May 23, 2018 10:14:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T10:13:58.472Z: Fusing consumer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map into PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
May 23, 2018 10:14:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T10:13:58.514Z: Fusing consumer PAssert$33/GroupGlobally/RewindowActuals/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map
May 23, 2018 10:14:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T10:13:58.558Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read
May 23, 2018 10:14:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T10:13:58.600Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
May 23, 2018 10:14:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T10:13:58.644Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
May 23, 2018 10:14:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T10:13:58.666Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
May 23, 2018 10:14:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T10:13:58.699Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
May 23, 2018 10:14:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T10:13:58.736Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
May 23, 2018 10:14:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T10:13:58.775Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into Create47/Read(CreateSource)
May 23, 2018 10:14:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T10:13:58.811Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
May 23, 2018 10:14:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T10:13:58.847Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
May 23, 2018 10:14:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T10:13:58.883Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
May 23, 2018 10:14:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T10:13:58.911Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
May 23, 2018 10:14:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T10:13:58.947Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
May 23, 2018 10:14:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T10:13:58.988Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
May 23, 2018 10:14:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T10:13:59.405Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Create
May 23, 2018 10:14:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T10:13:59.450Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Create
May 23, 2018 10:14:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T10:13:59.484Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
May 23, 2018 10:14:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T10:13:59.505Z: Starting 1 workers in us-central1-f...
May 23, 2018 10:14:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T10:13:59.517Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
May 23, 2018 10:14:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T10:13:59.770Z: Executing operation PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 23, 2018 10:14:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T10:13:59.806Z: Executing operation Create47/Read(CreateSource)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
May 23, 2018 10:14:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T10:14:06.321Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
May 23, 2018 10:14:22 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T10:14:21.890Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
May 23, 2018 10:14:22 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T10:14:21.933Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 23, 2018 10:14:41 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T10:14:40.702Z: Workers have started successfully.
May 23, 2018 10:15:07 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T10:15:04.568Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
May 23, 2018 10:15:07 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T10:15:04.654Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
May 23, 2018 10:15:19 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T10:15:19.227Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
May 23, 2018 10:15:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T10:15:19.309Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
May 23, 2018 10:15:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T10:15:30.189Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
May 23, 2018 10:15:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T10:15:30.373Z: Executing operation Create123/Read(CreateSource)+OutputSideInputs+PAssert$33/GroupGlobally/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write
May 23, 2018 10:15:39 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T10:15:38.072Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Close
May 23, 2018 10:15:39 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T10:15:38.164Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$33/GroupGlobally/RewindowActuals/Window.Assign+PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 23, 2018 10:15:43 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T10:15:42.775Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Close
May 23, 2018 10:15:43 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T10:15:42.856Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Read+PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$33/GroupGlobally/Values/Values/Map+PAssert$33/GroupGlobally/ParDo(Concat)+PAssert$33/GetPane/Map+PAssert$33/RunChecks+PAssert$33/VerifyAssertions/ParDo(DefaultConclude)
May 23, 2018 10:15:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T10:15:47.042Z: Cleaning up.
May 23, 2018 10:15:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T10:15:47.147Z: Stopping worker pool...
May 23, 2018 10:17:23 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T10:17:20.706Z: Autoscaling: Resized worker pool from 1 to 0.
May 23, 2018 10:17:23 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T10:17:20.754Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 23, 2018 10:17:29 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-05-23_03_13_48-11120570797316254617 finished with status DONE.
May 23, 2018 10:17:29 AM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-05-23_03_13_48-11120570797316254617. Found 1 success, 0 failures out of 1 expected assertions.
Gradle Test Executor 36 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest FAILED
209 tests completed, 34 failed, 2 skipped
Finished generating test XML results (0.384 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerTest>
Generating HTML test report...
Finished generating test html results (0.249 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest>
:beam-runners-google-cloud-dataflow-java:validatesRunnerTest (Thread[Task worker for ':' Thread 31,5,main]) completed. Took 2 hrs 8 mins 49.43 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:validatesRunnerTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 9m 49s
38 actionable tasks: 34 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/442id5pdgun6s
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user robbe.sneyders@ml6.eu
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user sidhom@google.com
Build failed in Jenkins:
beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #325
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/325/display/redirect>
------------------------------------------
[...truncated 18.06 MB...]
May 23, 2018 8:04:13 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) as step s13
May 23, 2018 8:04:13 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map as step s14
May 23, 2018 8:04:13 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign as step s15
May 23, 2018 8:04:13 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey as step s16
May 23, 2018 8:04:13 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map as step s17
May 23, 2018 8:04:13 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RewindowActuals/Window.Assign as step s18
May 23, 2018 8:04:13 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map as step s19
May 23, 2018 8:04:13 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveActualsTriggering/Flatten.PCollections as step s20
May 23, 2018 8:04:13 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Create.Values/Read(CreateSource) as step s21
May 23, 2018 8:04:13 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign as step s22
May 23, 2018 8:04:13 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveDummyTriggering/Flatten.PCollections as step s23
May 23, 2018 8:04:13 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/FlattenDummyAndContents as step s24
May 23, 2018 8:04:13 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/NeverTrigger/Flatten.PCollections as step s25
May 23, 2018 8:04:13 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GroupDummyAndContents as step s26
May 23, 2018 8:04:13 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Values/Values/Map as step s27
May 23, 2018 8:04:13 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/ParDo(Concat) as step s28
May 23, 2018 8:04:13 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GetPane/Map as step s29
May 23, 2018 8:04:13 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/RunChecks as step s30
May 23, 2018 8:04:13 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/VerifyAssertions/ParDo(DefaultConclude) as step s31
May 23, 2018 8:04:13 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0523080407-d956f34a/output/results/staging/
May 23, 2018 8:04:13 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <71120 bytes, hash 4aHx17MkMVYcdGnKYrZVZw> to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0523080407-d956f34a/output/results/staging/pipeline-4aHx17MkMVYcdGnKYrZVZw.pb
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 23, 2018 8:04:14 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-05-23_01_04_13-14948991846158578001?project=apache-beam-testing
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Submitted job: 2018-05-23_01_04_13-14948991846158578001
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 23, 2018 8:04:14 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-05-23_01_04_13-14948991846158578001
May 23, 2018 8:04:14 AM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-05-23_01_04_13-14948991846158578001 with 1 expected assertions.
May 23, 2018 8:04:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T08:04:13.701Z: Autoscaling is enabled for job 2018-05-23_01_04_13-14948991846158578001. The number of workers will be between 1 and 1000.
May 23, 2018 8:04:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T08:04:13.741Z: Autoscaling was automatically enabled for job 2018-05-23_01_04_13-14948991846158578001.
May 23, 2018 8:04:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T08:04:16.156Z: Checking required Cloud APIs are enabled.
May 23, 2018 8:04:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T08:04:16.249Z: Checking permissions granted to controller Service Account.
May 23, 2018 8:04:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T08:04:22.394Z: Worker configuration: n1-standard-1 in us-central1-f.
May 23, 2018 8:04:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T08:04:22.800Z: Expanding CoGroupByKey operations into optimizable parts.
May 23, 2018 8:04:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T08:04:22.984Z: Expanding GroupByKey operations into optimizable parts.
May 23, 2018 8:04:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T08:04:23.033Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
May 23, 2018 8:04:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T08:04:23.247Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
May 23, 2018 8:04:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T08:04:23.287Z: Elided trivial flatten
May 23, 2018 8:04:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T08:04:23.313Z: Elided trivial flatten
May 23, 2018 8:04:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T08:04:23.343Z: Elided trivial flatten
May 23, 2018 8:04:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T08:04:23.384Z: Unzipping flatten s24 for input s19.org.apache.beam.sdk.values.PCollection.<init>:329#8fd0f908e3ea90e3
May 23, 2018 8:04:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T08:04:23.425Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Reify, through flatten PAssert$33/GroupGlobally/FlattenDummyAndContents, into producer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map
May 23, 2018 8:04:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T08:04:23.462Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow into PAssert$33/GroupGlobally/GroupDummyAndContents/Read
May 23, 2018 8:04:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T08:04:23.505Z: Fusing consumer PAssert$33/GroupGlobally/ParDo(Concat) into PAssert$33/GroupGlobally/Values/Values/Map
May 23, 2018 8:04:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T08:04:23.693Z: Fusing consumer PAssert$33/GetPane/Map into PAssert$33/GroupGlobally/ParDo(Concat)
May 23, 2018 8:04:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T08:04:23.734Z: Fusing consumer PAssert$33/GroupGlobally/Values/Values/Map into PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow
May 23, 2018 8:04:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T08:04:23.781Z: Fusing consumer PAssert$33/RunChecks into PAssert$33/GetPane/Map
May 23, 2018 8:04:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T08:04:23.814Z: Fusing consumer PAssert$33/VerifyAssertions/ParDo(DefaultConclude) into PAssert$33/RunChecks
May 23, 2018 8:04:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T08:04:23.858Z: Unzipping flatten s24-u45 for input s26-reify-value18-c43
May 23, 2018 8:04:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T08:04:23.902Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Write, through flatten s24-u45, into producer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 23, 2018 8:04:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T08:04:23.942Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify into PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
May 23, 2018 8:04:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T08:04:23.971Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Write into PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 23, 2018 8:04:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T08:04:24.020Z: Fusing consumer PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)
May 23, 2018 8:04:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T08:04:24.070Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
May 23, 2018 8:04:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T08:04:24.117Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
May 23, 2018 8:04:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T08:04:24.153Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into PAssert$33/GroupGlobally/Window.Into()/Window.Assign
May 23, 2018 8:04:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T08:04:24.195Z: Fusing consumer OutputSideInputs into Create123/Read(CreateSource)
May 23, 2018 8:04:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T08:04:24.242Z: Fusing consumer PAssert$33/GroupGlobally/Window.Into()/Window.Assign into OutputSideInputs
May 23, 2018 8:04:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T08:04:24.278Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
May 23, 2018 8:04:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T08:04:24.322Z: Fusing consumer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map into PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
May 23, 2018 8:04:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T08:04:24.368Z: Fusing consumer PAssert$33/GroupGlobally/RewindowActuals/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map
May 23, 2018 8:04:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T08:04:24.414Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read
May 23, 2018 8:04:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T08:04:24.459Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
May 23, 2018 8:04:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T08:04:24.506Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
May 23, 2018 8:04:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T08:04:24.536Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
May 23, 2018 8:04:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T08:04:24.584Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
May 23, 2018 8:04:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T08:04:24.631Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
May 23, 2018 8:04:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T08:04:24.676Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into Create47/Read(CreateSource)
May 23, 2018 8:04:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T08:04:24.713Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
May 23, 2018 8:04:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T08:04:24.755Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
May 23, 2018 8:04:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T08:04:24.794Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
May 23, 2018 8:04:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T08:04:24.831Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
May 23, 2018 8:04:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T08:04:24.891Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
May 23, 2018 8:04:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T08:04:24.935Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
May 23, 2018 8:04:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T08:04:25.402Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Create
May 23, 2018 8:04:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T08:04:25.447Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Create
May 23, 2018 8:04:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T08:04:25.498Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
May 23, 2018 8:04:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T08:04:25.510Z: Starting 1 workers in us-central1-f...
May 23, 2018 8:04:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T08:04:25.532Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
May 23, 2018 8:04:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T08:04:25.796Z: Executing operation PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 23, 2018 8:04:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T08:04:25.843Z: Executing operation Create47/Read(CreateSource)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
May 23, 2018 8:04:33 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T08:04:33.154Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
May 23, 2018 8:04:43 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T08:04:43.531Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
May 23, 2018 8:04:43 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T08:04:43.569Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 23, 2018 8:04:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T08:04:58.377Z: Workers have started successfully.
May 23, 2018 8:05:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T08:05:32.403Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
May 23, 2018 8:05:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T08:05:32.482Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
May 23, 2018 8:05:41 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T08:05:39.684Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
May 23, 2018 8:05:41 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T08:05:39.755Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
May 23, 2018 8:05:54 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T08:05:53.310Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
May 23, 2018 8:05:54 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T08:05:53.511Z: Executing operation Create123/Read(CreateSource)+OutputSideInputs+PAssert$33/GroupGlobally/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write
May 23, 2018 8:06:01 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T08:06:01.164Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Close
May 23, 2018 8:06:01 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T08:06:01.253Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$33/GroupGlobally/RewindowActuals/Window.Assign+PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 23, 2018 8:06:06 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T08:06:06.100Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Close
May 23, 2018 8:06:06 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T08:06:06.189Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Read+PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$33/GroupGlobally/Values/Values/Map+PAssert$33/GroupGlobally/ParDo(Concat)+PAssert$33/GetPane/Map+PAssert$33/RunChecks+PAssert$33/VerifyAssertions/ParDo(DefaultConclude)
May 23, 2018 8:06:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T08:06:11.205Z: Cleaning up.
May 23, 2018 8:06:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T08:06:11.295Z: Stopping worker pool...
May 23, 2018 8:07:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T08:07:17.105Z: Autoscaling: Resized worker pool from 1 to 0.
May 23, 2018 8:07:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T08:07:17.144Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 23, 2018 8:07:25 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-05-23_01_04_13-14948991846158578001 finished with status DONE.
May 23, 2018 8:07:25 AM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-05-23_01_04_13-14948991846158578001. Found 1 success, 0 failures out of 1 expected assertions.
Gradle Test Executor 38 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest
209 tests completed, 34 failed, 2 skipped
Finished generating test XML results (0.905 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerTest>
Generating HTML test report...
Finished generating test html results (0.634 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest>
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest FAILED
:beam-runners-google-cloud-dataflow-java:validatesRunnerTest (Thread[Task worker for ':' Thread 14,5,main]) completed. Took 2 hrs 5 mins 33.169 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:validatesRunnerTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 7m 1s
38 actionable tasks: 34 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/diokgzeg47rxk
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user robbe.sneyders@ml6.eu
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user sidhom@google.com
Build failed in Jenkins:
beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #324
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/324/display/redirect?page=changes>
Changes:
[ankurgoenka] Adding ArtifactStagingFileHandler to push files to staging server
[ankurgoenka] Adding filesystem based artifact service to ULR job service
[ankurgoenka] Adding context manager to ArtifactStagingFileHandler
[ankurgoenka] Converting ArtifactServiceFileHandler to PortableStager based on
[ankurgoenka] Simplifying numeric constants
[ankurgoenka] Logging and naming changes
[ankurgoenka] Enhancing test cases
[ankurgoenka] Updating the dostring
------------------------------------------
[...truncated 18.03 MB...]
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map as step s14
May 23, 2018 3:40:52 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign as step s15
May 23, 2018 3:40:52 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey as step s16
May 23, 2018 3:40:52 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map as step s17
May 23, 2018 3:40:52 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RewindowActuals/Window.Assign as step s18
May 23, 2018 3:40:52 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map as step s19
May 23, 2018 3:40:52 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveActualsTriggering/Flatten.PCollections as step s20
May 23, 2018 3:40:52 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Create.Values/Read(CreateSource) as step s21
May 23, 2018 3:40:52 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign as step s22
May 23, 2018 3:40:52 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveDummyTriggering/Flatten.PCollections as step s23
May 23, 2018 3:40:52 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/FlattenDummyAndContents as step s24
May 23, 2018 3:40:52 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/NeverTrigger/Flatten.PCollections as step s25
May 23, 2018 3:40:52 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GroupDummyAndContents as step s26
May 23, 2018 3:40:52 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Values/Values/Map as step s27
May 23, 2018 3:40:52 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/ParDo(Concat) as step s28
May 23, 2018 3:40:52 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GetPane/Map as step s29
May 23, 2018 3:40:52 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/RunChecks as step s30
May 23, 2018 3:40:52 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/VerifyAssertions/ParDo(DefaultConclude) as step s31
May 23, 2018 3:40:52 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0523034046-cdd8ef59/output/results/staging/
May 23, 2018 3:40:52 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <71120 bytes, hash _HN0Fa2MkFbUAiDaG-EYsA> to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0523034046-cdd8ef59/output/results/staging/pipeline-_HN0Fa2MkFbUAiDaG-EYsA.pb
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 23, 2018 3:40:54 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-05-22_20_40_53-10774031641738260836?project=apache-beam-testing
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Submitted job: 2018-05-22_20_40_53-10774031641738260836
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 23, 2018 3:40:54 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-05-22_20_40_53-10774031641738260836
May 23, 2018 3:40:54 AM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-05-22_20_40_53-10774031641738260836 with 1 expected assertions.
May 23, 2018 3:41:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T03:40:53.327Z: Autoscaling is enabled for job 2018-05-22_20_40_53-10774031641738260836. The number of workers will be between 1 and 1000.
May 23, 2018 3:41:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T03:40:53.371Z: Autoscaling was automatically enabled for job 2018-05-22_20_40_53-10774031641738260836.
May 23, 2018 3:41:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T03:40:56.109Z: Checking required Cloud APIs are enabled.
May 23, 2018 3:41:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T03:40:56.308Z: Checking permissions granted to controller Service Account.
May 23, 2018 3:41:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T03:41:02.745Z: Worker configuration: n1-standard-1 in us-central1-b.
May 23, 2018 3:41:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T03:41:03.301Z: Expanding CoGroupByKey operations into optimizable parts.
May 23, 2018 3:41:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T03:41:03.460Z: Expanding GroupByKey operations into optimizable parts.
May 23, 2018 3:41:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T03:41:03.509Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
May 23, 2018 3:41:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T03:41:03.732Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
May 23, 2018 3:41:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T03:41:03.775Z: Elided trivial flatten
May 23, 2018 3:41:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T03:41:03.809Z: Elided trivial flatten
May 23, 2018 3:41:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T03:41:03.850Z: Elided trivial flatten
May 23, 2018 3:41:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T03:41:03.893Z: Unzipping flatten s24 for input s19.org.apache.beam.sdk.values.PCollection.<init>:329#8fd0f908e3ea90e3
May 23, 2018 3:41:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T03:41:03.934Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Reify, through flatten PAssert$33/GroupGlobally/FlattenDummyAndContents, into producer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map
May 23, 2018 3:41:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T03:41:03.980Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow into PAssert$33/GroupGlobally/GroupDummyAndContents/Read
May 23, 2018 3:41:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T03:41:04.027Z: Fusing consumer PAssert$33/GroupGlobally/ParDo(Concat) into PAssert$33/GroupGlobally/Values/Values/Map
May 23, 2018 3:41:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T03:41:04.063Z: Fusing consumer PAssert$33/GetPane/Map into PAssert$33/GroupGlobally/ParDo(Concat)
May 23, 2018 3:41:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T03:41:04.104Z: Fusing consumer PAssert$33/GroupGlobally/Values/Values/Map into PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow
May 23, 2018 3:41:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T03:41:04.143Z: Fusing consumer PAssert$33/RunChecks into PAssert$33/GetPane/Map
May 23, 2018 3:41:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T03:41:04.188Z: Fusing consumer PAssert$33/VerifyAssertions/ParDo(DefaultConclude) into PAssert$33/RunChecks
May 23, 2018 3:41:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T03:41:04.224Z: Unzipping flatten s24-u45 for input s26-reify-value18-c43
May 23, 2018 3:41:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T03:41:04.270Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Write, through flatten s24-u45, into producer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 23, 2018 3:41:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T03:41:04.315Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify into PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
May 23, 2018 3:41:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T03:41:04.352Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Write into PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 23, 2018 3:41:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T03:41:04.400Z: Fusing consumer PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)
May 23, 2018 3:41:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T03:41:04.436Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
May 23, 2018 3:41:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T03:41:04.469Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
May 23, 2018 3:41:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T03:41:04.498Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into PAssert$33/GroupGlobally/Window.Into()/Window.Assign
May 23, 2018 3:41:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T03:41:04.542Z: Fusing consumer OutputSideInputs into Create123/Read(CreateSource)
May 23, 2018 3:41:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T03:41:04.578Z: Fusing consumer PAssert$33/GroupGlobally/Window.Into()/Window.Assign into OutputSideInputs
May 23, 2018 3:41:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T03:41:04.610Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
May 23, 2018 3:41:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T03:41:04.647Z: Fusing consumer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map into PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
May 23, 2018 3:41:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T03:41:04.703Z: Fusing consumer PAssert$33/GroupGlobally/RewindowActuals/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map
May 23, 2018 3:41:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T03:41:04.747Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read
May 23, 2018 3:41:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T03:41:04.789Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
May 23, 2018 3:41:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T03:41:04.836Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
May 23, 2018 3:41:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T03:41:04.872Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
May 23, 2018 3:41:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T03:41:04.919Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
May 23, 2018 3:41:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T03:41:04.967Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
May 23, 2018 3:41:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T03:41:05.019Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into Create47/Read(CreateSource)
May 23, 2018 3:41:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T03:41:05.064Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
May 23, 2018 3:41:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T03:41:05.109Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
May 23, 2018 3:41:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T03:41:05.149Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
May 23, 2018 3:41:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T03:41:05.193Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
May 23, 2018 3:41:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T03:41:05.241Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
May 23, 2018 3:41:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T03:41:05.279Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
May 23, 2018 3:41:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T03:41:05.661Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Create
May 23, 2018 3:41:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T03:41:05.693Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Create
May 23, 2018 3:41:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T03:41:05.721Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
May 23, 2018 3:41:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T03:41:05.748Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
May 23, 2018 3:41:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T03:41:05.759Z: Starting 1 workers in us-central1-b...
May 23, 2018 3:41:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T03:41:05.976Z: Executing operation PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 23, 2018 3:41:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T03:41:06.011Z: Executing operation Create47/Read(CreateSource)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
May 23, 2018 3:41:14 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T03:41:13.197Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
May 23, 2018 3:41:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T03:41:23.753Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
May 23, 2018 3:41:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T03:41:23.782Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 23, 2018 3:41:46 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T03:41:44.267Z: Workers have started successfully.
May 23, 2018 3:42:07 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T03:42:07.243Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
May 23, 2018 3:42:07 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T03:42:07.322Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
May 23, 2018 3:42:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T03:42:16.421Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
May 23, 2018 3:42:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T03:42:16.487Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
May 23, 2018 3:42:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T03:42:30.077Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
May 23, 2018 3:42:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T03:42:30.252Z: Executing operation Create123/Read(CreateSource)+OutputSideInputs+PAssert$33/GroupGlobally/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write
May 23, 2018 3:42:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T03:42:36.033Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Close
May 23, 2018 3:42:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T03:42:36.121Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$33/GroupGlobally/RewindowActuals/Window.Assign+PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 23, 2018 3:42:41 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T03:42:39.838Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Close
May 23, 2018 3:42:41 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T03:42:39.943Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Read+PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$33/GroupGlobally/Values/Values/Map+PAssert$33/GroupGlobally/ParDo(Concat)+PAssert$33/GetPane/Map+PAssert$33/RunChecks+PAssert$33/VerifyAssertions/ParDo(DefaultConclude)
May 23, 2018 3:42:45 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T03:42:43.991Z: Cleaning up.
May 23, 2018 3:42:45 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T03:42:44.112Z: Stopping worker pool...
May 23, 2018 3:44:19 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T03:44:17.234Z: Autoscaling: Resized worker pool from 1 to 0.
May 23, 2018 3:44:19 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T03:44:17.261Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 23, 2018 3:44:19 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T03:44:17.316Z: Worker pool stopped.
May 23, 2018 3:44:28 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-05-22_20_40_53-10774031641738260836 finished with status DONE.
May 23, 2018 3:44:28 AM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-05-22_20_40_53-10774031641738260836. Found 1 success, 0 failures out of 1 expected assertions.
Gradle Test Executor 36 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest FAILED
209 tests completed, 34 failed, 2 skipped
Finished generating test XML results (0.536 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerTest>
Generating HTML test report...
Finished generating test html results (0.511 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest>
:beam-runners-google-cloud-dataflow-java:validatesRunnerTest (Thread[Task worker for ':' Thread 4,5,main]) completed. Took 2 hrs 1 mins 11.139 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:validatesRunnerTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 2m 13s
38 actionable tasks: 34 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/tiluvmzqoqb6q
Build cache (/home/jenkins/.gradle/caches/build-cache-1) remove files older than Wed May 16 01:42:19 UTC 2018.
Build cache (/home/jenkins/.gradle/caches/build-cache-1) removing 6910 cache entries (695 MB reclaimed).
Build cache (/home/jenkins/.gradle/caches/build-cache-1) cleaned up in 0.496 secs.
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user robbe.sneyders@ml6.eu
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user sidhom@google.com
Build failed in Jenkins:
beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #323
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/323/display/redirect?page=changes>
Changes:
[robbe.sneyders] Futurize internal subpackage
[matthias] Futurize options subpackage
------------------------------------------
[...truncated 18.15 MB...]
INFO: Adding OutputSideInputs as step s11
May 23, 2018 1:38:32 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Window.Into()/Window.Assign as step s12
May 23, 2018 1:38:32 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) as step s13
May 23, 2018 1:38:32 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map as step s14
May 23, 2018 1:38:32 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign as step s15
May 23, 2018 1:38:32 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey as step s16
May 23, 2018 1:38:32 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map as step s17
May 23, 2018 1:38:32 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RewindowActuals/Window.Assign as step s18
May 23, 2018 1:38:32 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map as step s19
May 23, 2018 1:38:32 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveActualsTriggering/Flatten.PCollections as step s20
May 23, 2018 1:38:32 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Create.Values/Read(CreateSource) as step s21
May 23, 2018 1:38:32 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign as step s22
May 23, 2018 1:38:32 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveDummyTriggering/Flatten.PCollections as step s23
May 23, 2018 1:38:32 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/FlattenDummyAndContents as step s24
May 23, 2018 1:38:32 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/NeverTrigger/Flatten.PCollections as step s25
May 23, 2018 1:38:32 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GroupDummyAndContents as step s26
May 23, 2018 1:38:32 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Values/Values/Map as step s27
May 23, 2018 1:38:32 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/ParDo(Concat) as step s28
May 23, 2018 1:38:32 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GetPane/Map as step s29
May 23, 2018 1:38:32 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/RunChecks as step s30
May 23, 2018 1:38:32 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/VerifyAssertions/ParDo(DefaultConclude) as step s31
May 23, 2018 1:38:32 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0523013827-b12703e9/output/results/staging/
May 23, 2018 1:38:32 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <71120 bytes, hash gmsqi43JO3L_ZncYbhfxVA> to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0523013827-b12703e9/output/results/staging/pipeline-gmsqi43JO3L_ZncYbhfxVA.pb
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 23, 2018 1:38:34 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-05-22_18_38_33-7724316353375228374?project=apache-beam-testing
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Submitted job: 2018-05-22_18_38_33-7724316353375228374
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 23, 2018 1:38:34 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-05-22_18_38_33-7724316353375228374
May 23, 2018 1:38:34 AM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-05-22_18_38_33-7724316353375228374 with 1 expected assertions.
May 23, 2018 1:38:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T01:38:33.289Z: Autoscaling is enabled for job 2018-05-22_18_38_33-7724316353375228374. The number of workers will be between 1 and 1000.
May 23, 2018 1:38:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T01:38:33.316Z: Autoscaling was automatically enabled for job 2018-05-22_18_38_33-7724316353375228374.
May 23, 2018 1:38:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T01:38:36.087Z: Checking required Cloud APIs are enabled.
May 23, 2018 1:38:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T01:38:36.402Z: Checking permissions granted to controller Service Account.
May 23, 2018 1:38:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T01:38:43.568Z: Worker configuration: n1-standard-1 in us-central1-b.
May 23, 2018 1:38:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T01:38:43.949Z: Expanding CoGroupByKey operations into optimizable parts.
May 23, 2018 1:38:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T01:38:44.057Z: Expanding GroupByKey operations into optimizable parts.
May 23, 2018 1:38:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T01:38:44.083Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
May 23, 2018 1:38:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T01:38:44.271Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
May 23, 2018 1:38:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T01:38:44.305Z: Elided trivial flatten
May 23, 2018 1:38:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T01:38:44.345Z: Elided trivial flatten
May 23, 2018 1:38:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T01:38:44.374Z: Elided trivial flatten
May 23, 2018 1:38:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T01:38:44.399Z: Unzipping flatten s24 for input s19.org.apache.beam.sdk.values.PCollection.<init>:329#8fd0f908e3ea90e3
May 23, 2018 1:38:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T01:38:44.422Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Reify, through flatten PAssert$33/GroupGlobally/FlattenDummyAndContents, into producer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map
May 23, 2018 1:38:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T01:38:44.455Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow into PAssert$33/GroupGlobally/GroupDummyAndContents/Read
May 23, 2018 1:38:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T01:38:44.486Z: Fusing consumer PAssert$33/GroupGlobally/ParDo(Concat) into PAssert$33/GroupGlobally/Values/Values/Map
May 23, 2018 1:38:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T01:38:44.513Z: Fusing consumer PAssert$33/GetPane/Map into PAssert$33/GroupGlobally/ParDo(Concat)
May 23, 2018 1:38:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T01:38:44.535Z: Fusing consumer PAssert$33/GroupGlobally/Values/Values/Map into PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow
May 23, 2018 1:38:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T01:38:44.560Z: Fusing consumer PAssert$33/RunChecks into PAssert$33/GetPane/Map
May 23, 2018 1:38:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T01:38:44.589Z: Fusing consumer PAssert$33/VerifyAssertions/ParDo(DefaultConclude) into PAssert$33/RunChecks
May 23, 2018 1:38:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T01:38:44.616Z: Unzipping flatten s24-u45 for input s26-reify-value18-c43
May 23, 2018 1:38:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T01:38:44.657Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Write, through flatten s24-u45, into producer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 23, 2018 1:38:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T01:38:44.689Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify into PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
May 23, 2018 1:38:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T01:38:44.713Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Write into PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 23, 2018 1:38:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T01:38:44.756Z: Fusing consumer PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)
May 23, 2018 1:38:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T01:38:44.789Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
May 23, 2018 1:38:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T01:38:44.808Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
May 23, 2018 1:38:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T01:38:44.837Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into PAssert$33/GroupGlobally/Window.Into()/Window.Assign
May 23, 2018 1:38:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T01:38:44.861Z: Fusing consumer OutputSideInputs into Create123/Read(CreateSource)
May 23, 2018 1:38:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T01:38:44.890Z: Fusing consumer PAssert$33/GroupGlobally/Window.Into()/Window.Assign into OutputSideInputs
May 23, 2018 1:38:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T01:38:44.918Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
May 23, 2018 1:38:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T01:38:44.958Z: Fusing consumer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map into PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
May 23, 2018 1:38:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T01:38:44.990Z: Fusing consumer PAssert$33/GroupGlobally/RewindowActuals/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map
May 23, 2018 1:38:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T01:38:45.022Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read
May 23, 2018 1:38:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T01:38:45.054Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
May 23, 2018 1:38:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T01:38:45.080Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
May 23, 2018 1:38:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T01:38:45.109Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
May 23, 2018 1:38:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T01:38:45.133Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
May 23, 2018 1:38:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T01:38:45.159Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
May 23, 2018 1:38:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T01:38:45.193Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into Create47/Read(CreateSource)
May 23, 2018 1:38:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T01:38:45.219Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
May 23, 2018 1:38:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T01:38:45.245Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
May 23, 2018 1:38:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T01:38:45.272Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
May 23, 2018 1:38:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T01:38:45.301Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
May 23, 2018 1:38:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T01:38:45.327Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
May 23, 2018 1:38:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T01:38:45.356Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
May 23, 2018 1:38:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T01:38:45.736Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Create
May 23, 2018 1:38:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T01:38:45.768Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Create
May 23, 2018 1:38:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T01:38:45.811Z: Starting 1 workers in us-central1-b...
May 23, 2018 1:38:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T01:38:45.812Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
May 23, 2018 1:38:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T01:38:45.850Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
May 23, 2018 1:38:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T01:38:46.029Z: Executing operation Create47/Read(CreateSource)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
May 23, 2018 1:38:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T01:38:46.070Z: Executing operation PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 23, 2018 1:38:54 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T01:38:53.016Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
May 23, 2018 1:39:05 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T01:39:03.487Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
May 23, 2018 1:39:05 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T01:39:03.518Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 23, 2018 1:39:29 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T01:39:27.591Z: Workers have started successfully.
May 23, 2018 1:39:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T01:39:46.035Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
May 23, 2018 1:39:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T01:39:46.112Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
May 23, 2018 1:39:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T01:39:50.290Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
May 23, 2018 1:39:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T01:39:50.353Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
May 23, 2018 1:40:05 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T01:40:04.513Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
May 23, 2018 1:40:05 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T01:40:04.668Z: Executing operation Create123/Read(CreateSource)+OutputSideInputs+PAssert$33/GroupGlobally/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write
May 23, 2018 1:40:12 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T01:40:11.050Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Close
May 23, 2018 1:40:12 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T01:40:11.108Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$33/GroupGlobally/RewindowActuals/Window.Assign+PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 23, 2018 1:40:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T01:40:15.883Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Close
May 23, 2018 1:40:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T01:40:15.943Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Read+PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$33/GroupGlobally/Values/Values/Map+PAssert$33/GroupGlobally/ParDo(Concat)+PAssert$33/GetPane/Map+PAssert$33/RunChecks+PAssert$33/VerifyAssertions/ParDo(DefaultConclude)
May 23, 2018 1:40:20 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T01:40:20.129Z: Cleaning up.
May 23, 2018 1:40:20 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T01:40:20.204Z: Stopping worker pool...
May 23, 2018 1:41:56 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T01:41:55.545Z: Autoscaling: Resized worker pool from 1 to 0.
May 23, 2018 1:41:56 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-23T01:41:55.598Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 23, 2018 1:42:04 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-05-22_18_38_33-7724316353375228374 finished with status DONE.
May 23, 2018 1:42:04 AM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-05-22_18_38_33-7724316353375228374. Found 1 success, 0 failures out of 1 expected assertions.
Gradle Test Executor 38 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest FAILED
209 tests completed, 34 failed, 2 skipped
Finished generating test XML results (0.765 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerTest>
Generating HTML test report...
Finished generating test html results (0.31 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest>
:beam-runners-google-cloud-dataflow-java:validatesRunnerTest (Thread[Task worker for ':' Thread 15,5,main]) completed. Took 2 hrs 4 mins 55.926 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:validatesRunnerTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 6m 7s
38 actionable tasks: 34 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/4mnahk6w4mwi6
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user robbe.sneyders@ml6.eu
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user sidhom@google.com