You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2018/05/27 13:57:42 UTC
Build failed in Jenkins:
beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #361
See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/361/display/redirect>
------------------------------------------
[...truncated 18.09 MB...]
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign as step s15
May 27, 2018 1:54:15 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey as step s16
May 27, 2018 1:54:15 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map as step s17
May 27, 2018 1:54:15 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RewindowActuals/Window.Assign as step s18
May 27, 2018 1:54:15 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map as step s19
May 27, 2018 1:54:15 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveActualsTriggering/Flatten.PCollections as step s20
May 27, 2018 1:54:15 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Create.Values/Read(CreateSource) as step s21
May 27, 2018 1:54:15 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign as step s22
May 27, 2018 1:54:15 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveDummyTriggering/Flatten.PCollections as step s23
May 27, 2018 1:54:15 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/FlattenDummyAndContents as step s24
May 27, 2018 1:54:15 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/NeverTrigger/Flatten.PCollections as step s25
May 27, 2018 1:54:15 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GroupDummyAndContents as step s26
May 27, 2018 1:54:15 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Values/Values/Map as step s27
May 27, 2018 1:54:15 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/ParDo(Concat) as step s28
May 27, 2018 1:54:15 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GetPane/Map as step s29
May 27, 2018 1:54:15 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/RunChecks as step s30
May 27, 2018 1:54:15 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/VerifyAssertions/ParDo(DefaultConclude) as step s31
May 27, 2018 1:54:15 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0527135412-8e7d95c6/output/results/staging/
May 27, 2018 1:54:15 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <71120 bytes, hash 9JKtFub9zUe3PYfim1Mkwg> to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0527135412-8e7d95c6/output/results/staging/pipeline-9JKtFub9zUe3PYfim1Mkwg.pb
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 27, 2018 1:54:17 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-05-27_06_54_16-17297844100176345573?project=apache-beam-testing
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Submitted job: 2018-05-27_06_54_16-17297844100176345573
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 27, 2018 1:54:17 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-05-27_06_54_16-17297844100176345573
May 27, 2018 1:54:17 PM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-05-27_06_54_16-17297844100176345573 with 1 expected assertions.
May 27, 2018 1:54:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:54:16.671Z: Autoscaling is enabled for job 2018-05-27_06_54_16-17297844100176345573. The number of workers will be between 1 and 1000.
May 27, 2018 1:54:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:54:16.684Z: Autoscaling was automatically enabled for job 2018-05-27_06_54_16-17297844100176345573.
May 27, 2018 1:54:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:54:19.682Z: Checking required Cloud APIs are enabled.
May 27, 2018 1:54:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:54:19.930Z: Checking permissions granted to controller Service Account.
May 27, 2018 1:54:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:54:32.361Z: Worker configuration: n1-standard-1 in us-central1-f.
May 27, 2018 1:54:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:54:32.736Z: Expanding CoGroupByKey operations into optimizable parts.
May 27, 2018 1:54:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:54:32.830Z: Expanding GroupByKey operations into optimizable parts.
May 27, 2018 1:54:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:54:32.856Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
May 27, 2018 1:54:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:54:32.995Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
May 27, 2018 1:54:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:54:33.012Z: Elided trivial flatten
May 27, 2018 1:54:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:54:33.033Z: Elided trivial flatten
May 27, 2018 1:54:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:54:33.052Z: Elided trivial flatten
May 27, 2018 1:54:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:54:33.078Z: Unzipping flatten s24 for input s19.org.apache.beam.sdk.values.PCollection.<init>:329#8fd0f908e3ea90e3
May 27, 2018 1:54:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:54:33.099Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Reify, through flatten PAssert$33/GroupGlobally/FlattenDummyAndContents, into producer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map
May 27, 2018 1:54:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:54:33.122Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow into PAssert$33/GroupGlobally/GroupDummyAndContents/Read
May 27, 2018 1:54:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:54:33.158Z: Fusing consumer PAssert$33/GroupGlobally/ParDo(Concat) into PAssert$33/GroupGlobally/Values/Values/Map
May 27, 2018 1:54:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:54:33.176Z: Fusing consumer PAssert$33/GetPane/Map into PAssert$33/GroupGlobally/ParDo(Concat)
May 27, 2018 1:54:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:54:33.200Z: Fusing consumer PAssert$33/GroupGlobally/Values/Values/Map into PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow
May 27, 2018 1:54:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:54:33.223Z: Fusing consumer PAssert$33/RunChecks into PAssert$33/GetPane/Map
May 27, 2018 1:54:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:54:33.239Z: Fusing consumer PAssert$33/VerifyAssertions/ParDo(DefaultConclude) into PAssert$33/RunChecks
May 27, 2018 1:54:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:54:33.265Z: Unzipping flatten s24-u45 for input s26-reify-value18-c43
May 27, 2018 1:54:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:54:33.285Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Write, through flatten s24-u45, into producer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 27, 2018 1:54:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:54:33.307Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify into PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
May 27, 2018 1:54:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:54:33.333Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Write into PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 27, 2018 1:54:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:54:33.350Z: Fusing consumer PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)
May 27, 2018 1:54:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:54:33.374Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
May 27, 2018 1:54:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:54:33.395Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
May 27, 2018 1:54:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:54:33.412Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into PAssert$33/GroupGlobally/Window.Into()/Window.Assign
May 27, 2018 1:54:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:54:33.435Z: Fusing consumer OutputSideInputs into Create123/Read(CreateSource)
May 27, 2018 1:54:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:54:33.460Z: Fusing consumer PAssert$33/GroupGlobally/Window.Into()/Window.Assign into OutputSideInputs
May 27, 2018 1:54:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:54:33.485Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
May 27, 2018 1:54:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:54:33.510Z: Fusing consumer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map into PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
May 27, 2018 1:54:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:54:33.534Z: Fusing consumer PAssert$33/GroupGlobally/RewindowActuals/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map
May 27, 2018 1:54:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:54:33.556Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read
May 27, 2018 1:54:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:54:33.579Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
May 27, 2018 1:54:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:54:33.600Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
May 27, 2018 1:54:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:54:33.621Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
May 27, 2018 1:54:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:54:33.640Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
May 27, 2018 1:54:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:54:33.664Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
May 27, 2018 1:54:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:54:33.688Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into Create47/Read(CreateSource)
May 27, 2018 1:54:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:54:33.710Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
May 27, 2018 1:54:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:54:33.729Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
May 27, 2018 1:54:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:54:33.753Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
May 27, 2018 1:54:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:54:33.778Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
May 27, 2018 1:54:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:54:33.805Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
May 27, 2018 1:54:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:54:33.819Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
May 27, 2018 1:54:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:54:34.120Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Create
May 27, 2018 1:54:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:54:34.150Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Create
May 27, 2018 1:54:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:54:34.178Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
May 27, 2018 1:54:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:54:34.189Z: Starting 1 workers in us-central1-f...
May 27, 2018 1:54:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:54:34.206Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
May 27, 2018 1:54:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:54:34.349Z: Executing operation PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 27, 2018 1:54:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:54:34.371Z: Executing operation Create47/Read(CreateSource)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
May 27, 2018 1:54:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:54:43.605Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
May 27, 2018 1:54:55 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:54:54.044Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
May 27, 2018 1:54:55 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:54:54.068Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 27, 2018 1:55:15 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:55:14.053Z: Workers have started successfully.
May 27, 2018 1:55:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:55:38.552Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
May 27, 2018 1:55:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:55:38.602Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
May 27, 2018 1:55:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:55:43.184Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
May 27, 2018 1:55:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:55:43.224Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
May 27, 2018 1:55:56 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:55:55.897Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
May 27, 2018 1:55:56 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:55:56.015Z: Executing operation Create123/Read(CreateSource)+OutputSideInputs+PAssert$33/GroupGlobally/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write
May 27, 2018 1:56:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:56:02.417Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Close
May 27, 2018 1:56:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:56:02.452Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$33/GroupGlobally/RewindowActuals/Window.Assign+PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 27, 2018 1:56:07 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:56:06.145Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Close
May 27, 2018 1:56:07 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:56:06.207Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Read+PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$33/GroupGlobally/Values/Values/Map+PAssert$33/GroupGlobally/ParDo(Concat)+PAssert$33/GetPane/Map+PAssert$33/RunChecks+PAssert$33/VerifyAssertions/ParDo(DefaultConclude)
May 27, 2018 1:56:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:56:09.410Z: Cleaning up.
May 27, 2018 1:56:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:56:09.472Z: Stopping worker pool...
May 27, 2018 1:57:29 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:57:27.928Z: Autoscaling: Resized worker pool from 1 to 0.
May 27, 2018 1:57:29 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T13:57:27.951Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 27, 2018 1:57:36 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-05-27_06_54_16-17297844100176345573 finished with status DONE.
May 27, 2018 1:57:36 PM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-05-27_06_54_16-17297844100176345573. Found 1 success, 0 failures out of 1 expected assertions.
Gradle Test Executor 10 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest FAILED
209 tests completed, 34 failed, 2 skipped
Finished generating test XML results (0.43 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerTest>
Generating HTML test report...
Finished generating test html results (0.323 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest>
:beam-runners-google-cloud-dataflow-java:validatesRunnerTest (Thread[Task worker for ':' Thread 20,5,main]) completed. Took 1 hrs 56 mins 1.719 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:validatesRunnerTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1h 57m 10s
38 actionable tasks: 34 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/rh6hmlxoxlyhi
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user katarzyna.kucharczyk@polidea.com
Not sending mail to unregistered user robbe.sneyders@ml6.eu
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user schroederc@google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ammons@google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user sidhom@google.com
Jenkins build is back to normal :
beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #402
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/402/display/redirect>
Build failed in Jenkins:
beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #401
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/401/display/redirect>
------------------------------------------
[...truncated 18.16 MB...]
INFO: Adding PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map as step s19
Jun 02, 2018 3:15:12 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveActualsTriggering/Flatten.PCollections as step s20
Jun 02, 2018 3:15:12 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Create.Values/Read(CreateSource) as step s21
Jun 02, 2018 3:15:12 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign as step s22
Jun 02, 2018 3:15:12 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveDummyTriggering/Flatten.PCollections as step s23
Jun 02, 2018 3:15:12 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/FlattenDummyAndContents as step s24
Jun 02, 2018 3:15:12 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/NeverTrigger/Flatten.PCollections as step s25
Jun 02, 2018 3:15:12 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GroupDummyAndContents as step s26
Jun 02, 2018 3:15:12 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Values/Values/Map as step s27
Jun 02, 2018 3:15:12 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/ParDo(Concat) as step s28
Jun 02, 2018 3:15:12 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GetPane/Map as step s29
Jun 02, 2018 3:15:12 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/RunChecks as step s30
Jun 02, 2018 3:15:12 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/VerifyAssertions/ParDo(DefaultConclude) as step s31
Jun 02, 2018 3:15:12 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0602031509-a3bf8230/output/results/staging/
Jun 02, 2018 3:15:12 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <71120 bytes, hash 0Oo6soJlZd7y3BFqxBih7A> to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0602031509-a3bf8230/output/results/staging/pipeline-0Oo6soJlZd7y3BFqxBih7A.pb
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
Jun 02, 2018 3:15:13 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-06-01_20_15_13-13771455054867111793?project=apache-beam-testing
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Submitted job: 2018-06-01_20_15_13-13771455054867111793
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
Jun 02, 2018 3:15:13 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-06-01_20_15_13-13771455054867111793
Jun 02, 2018 3:15:13 AM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-06-01_20_15_13-13771455054867111793 with 1 expected assertions.
Jun 02, 2018 3:15:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:15:13.139Z: Autoscaling is enabled for job 2018-06-01_20_15_13-13771455054867111793. The number of workers will be between 1 and 1000.
Jun 02, 2018 3:15:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:15:13.180Z: Autoscaling was automatically enabled for job 2018-06-01_20_15_13-13771455054867111793.
Jun 02, 2018 3:15:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:15:15.764Z: Checking required Cloud APIs are enabled.
Jun 02, 2018 3:15:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:15:16.085Z: Checking permissions granted to controller Service Account.
Jun 02, 2018 3:15:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:15:22.190Z: Worker configuration: n1-standard-1 in us-central1-b.
Jun 02, 2018 3:15:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:15:22.561Z: Expanding CoGroupByKey operations into optimizable parts.
Jun 02, 2018 3:15:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:15:22.700Z: Expanding GroupByKey operations into optimizable parts.
Jun 02, 2018 3:15:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:15:22.732Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
Jun 02, 2018 3:15:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:15:22.905Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
Jun 02, 2018 3:15:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:15:22.941Z: Elided trivial flatten
Jun 02, 2018 3:15:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:15:22.961Z: Elided trivial flatten
Jun 02, 2018 3:15:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:15:22.994Z: Elided trivial flatten
Jun 02, 2018 3:15:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:15:23.029Z: Unzipping flatten s24 for input s19.org.apache.beam.sdk.values.PCollection.<init>:329#8fd0f908e3ea90e3
Jun 02, 2018 3:15:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:15:23.063Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Reify, through flatten PAssert$33/GroupGlobally/FlattenDummyAndContents, into producer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map
Jun 02, 2018 3:15:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:15:23.095Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow into PAssert$33/GroupGlobally/GroupDummyAndContents/Read
Jun 02, 2018 3:15:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:15:23.117Z: Fusing consumer PAssert$33/GroupGlobally/ParDo(Concat) into PAssert$33/GroupGlobally/Values/Values/Map
Jun 02, 2018 3:15:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:15:23.155Z: Fusing consumer PAssert$33/GetPane/Map into PAssert$33/GroupGlobally/ParDo(Concat)
Jun 02, 2018 3:15:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:15:23.186Z: Fusing consumer PAssert$33/GroupGlobally/Values/Values/Map into PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow
Jun 02, 2018 3:15:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:15:23.217Z: Fusing consumer PAssert$33/RunChecks into PAssert$33/GetPane/Map
Jun 02, 2018 3:15:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:15:23.280Z: Fusing consumer PAssert$33/VerifyAssertions/ParDo(DefaultConclude) into PAssert$33/RunChecks
Jun 02, 2018 3:15:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:15:23.309Z: Unzipping flatten s24-u45 for input s26-reify-value18-c43
Jun 02, 2018 3:15:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:15:23.355Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Write, through flatten s24-u45, into producer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
Jun 02, 2018 3:15:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:15:23.384Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify into PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
Jun 02, 2018 3:15:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:15:23.417Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Write into PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
Jun 02, 2018 3:15:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:15:23.447Z: Fusing consumer PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)
Jun 02, 2018 3:15:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:15:23.484Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
Jun 02, 2018 3:15:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:15:23.517Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
Jun 02, 2018 3:15:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:15:23.551Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into PAssert$33/GroupGlobally/Window.Into()/Window.Assign
Jun 02, 2018 3:15:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:15:23.586Z: Fusing consumer OutputSideInputs into Create123/Read(CreateSource)
Jun 02, 2018 3:15:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:15:23.621Z: Fusing consumer PAssert$33/GroupGlobally/Window.Into()/Window.Assign into OutputSideInputs
Jun 02, 2018 3:15:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:15:23.656Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
Jun 02, 2018 3:15:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:15:23.693Z: Fusing consumer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map into PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
Jun 02, 2018 3:15:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:15:23.724Z: Fusing consumer PAssert$33/GroupGlobally/RewindowActuals/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map
Jun 02, 2018 3:15:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:15:23.759Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read
Jun 02, 2018 3:15:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:15:23.793Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
Jun 02, 2018 3:15:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:15:23.819Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
Jun 02, 2018 3:15:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:15:23.857Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
Jun 02, 2018 3:15:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:15:23.894Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
Jun 02, 2018 3:15:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:15:23.926Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
Jun 02, 2018 3:15:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:15:23.953Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into Create47/Read(CreateSource)
Jun 02, 2018 3:15:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:15:23.988Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
Jun 02, 2018 3:15:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:15:24.022Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
Jun 02, 2018 3:15:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:15:24.056Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
Jun 02, 2018 3:15:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:15:24.091Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
Jun 02, 2018 3:15:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:15:24.127Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
Jun 02, 2018 3:15:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:15:24.166Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
Jun 02, 2018 3:15:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:15:24.499Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Create
Jun 02, 2018 3:15:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:15:24.521Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Create
Jun 02, 2018 3:15:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:15:24.555Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
Jun 02, 2018 3:15:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:15:24.592Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
Jun 02, 2018 3:15:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:15:24.602Z: Starting 1 workers in us-central1-b...
Jun 02, 2018 3:15:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:15:24.851Z: Executing operation PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
Jun 02, 2018 3:15:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:15:24.882Z: Executing operation Create47/Read(CreateSource)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
Jun 02, 2018 3:15:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:15:34.501Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
Jun 02, 2018 3:15:47 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:15:45.255Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
Jun 02, 2018 3:15:47 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:15:45.294Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
Jun 02, 2018 3:16:00 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:16:00.602Z: Workers have started successfully.
Jun 02, 2018 3:16:29 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:16:28.118Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
Jun 02, 2018 3:16:29 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:16:28.204Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
Jun 02, 2018 3:16:41 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:16:39.230Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
Jun 02, 2018 3:16:41 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:16:39.312Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
Jun 02, 2018 3:16:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:16:52.142Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
Jun 02, 2018 3:16:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:16:52.310Z: Executing operation Create123/Read(CreateSource)+OutputSideInputs+PAssert$33/GroupGlobally/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write
Jun 02, 2018 3:16:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:16:57.641Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Close
Jun 02, 2018 3:16:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:16:57.744Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$33/GroupGlobally/RewindowActuals/Window.Assign+PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
Jun 02, 2018 3:17:01 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:17:01.542Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Close
Jun 02, 2018 3:17:02 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:17:01.658Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Read+PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$33/GroupGlobally/Values/Values/Map+PAssert$33/GroupGlobally/ParDo(Concat)+PAssert$33/GetPane/Map+PAssert$33/RunChecks+PAssert$33/VerifyAssertions/ParDo(DefaultConclude)
Jun 02, 2018 3:17:06 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:17:05.664Z: Cleaning up.
Jun 02, 2018 3:17:06 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:17:05.786Z: Stopping worker pool...
Jun 02, 2018 3:18:54 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:18:54.134Z: Autoscaling: Resized worker pool from 1 to 0.
Jun 02, 2018 3:18:54 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:18:54.173Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
Jun 02, 2018 3:18:54 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T03:18:54.217Z: Worker pool stopped.
Jun 02, 2018 3:19:02 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-06-01_20_15_13-13771455054867111793 finished with status DONE.
Jun 02, 2018 3:19:02 AM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-06-01_20_15_13-13771455054867111793. Found 1 success, 0 failures out of 1 expected assertions.
Gradle Test Executor 42 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest
209 tests completed, 34 failed, 2 skipped
Finished generating test XML results (0.727 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerTest>
Generating HTML test report...
Finished generating test html results (0.471 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest>
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest FAILED
:beam-runners-google-cloud-dataflow-java:validatesRunnerTest (Thread[Task worker for ':' Thread 39,5,main]) completed. Took 2 hrs 9 mins 0.989 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:validatesRunnerTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 9m 55s
38 actionable tasks: 34 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/qoqzo3yg43ney
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user katarzyna.kucharczyk@polidea.com
Not sending mail to unregistered user robbe.sneyders@ml6.eu
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user schroederc@google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user sidhom@google.com
Not sending mail to unregistered user aromanenko.dev@gmail.com
Not sending mail to unregistered user cademarkegard@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ammons@google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user kedin@google.com
Build failed in Jenkins:
beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #400
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/400/display/redirect?page=changes>
Changes:
[cademarkegard] [BEAM-4303] Enforce ErrorProne analysis in examples project
[aromanenko.dev] [BEAM-4421] Fix for issue with reading s3 files using ParquetIO
------------------------------------------
[...truncated 18.15 MB...]
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map as step s17
Jun 02, 2018 1:05:20 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RewindowActuals/Window.Assign as step s18
Jun 02, 2018 1:05:20 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map as step s19
Jun 02, 2018 1:05:20 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveActualsTriggering/Flatten.PCollections as step s20
Jun 02, 2018 1:05:20 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Create.Values/Read(CreateSource) as step s21
Jun 02, 2018 1:05:20 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign as step s22
Jun 02, 2018 1:05:20 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveDummyTriggering/Flatten.PCollections as step s23
Jun 02, 2018 1:05:20 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/FlattenDummyAndContents as step s24
Jun 02, 2018 1:05:20 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/NeverTrigger/Flatten.PCollections as step s25
Jun 02, 2018 1:05:20 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GroupDummyAndContents as step s26
Jun 02, 2018 1:05:20 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Values/Values/Map as step s27
Jun 02, 2018 1:05:20 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/ParDo(Concat) as step s28
Jun 02, 2018 1:05:20 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GetPane/Map as step s29
Jun 02, 2018 1:05:20 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/RunChecks as step s30
Jun 02, 2018 1:05:20 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/VerifyAssertions/ParDo(DefaultConclude) as step s31
Jun 02, 2018 1:05:20 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0602010515-aaecd3c4/output/results/staging/
Jun 02, 2018 1:05:20 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <71120 bytes, hash YktyUgaU5DbTByIaIZKT5A> to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0602010515-aaecd3c4/output/results/staging/pipeline-YktyUgaU5DbTByIaIZKT5A.pb
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
Jun 02, 2018 1:05:22 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-06-01_18_05_21-12746651185546532388?project=apache-beam-testing
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Submitted job: 2018-06-01_18_05_21-12746651185546532388
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
Jun 02, 2018 1:05:22 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-06-01_18_05_21-12746651185546532388
Jun 02, 2018 1:05:22 AM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-06-01_18_05_21-12746651185546532388 with 1 expected assertions.
Jun 02, 2018 1:05:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:05:21.108Z: Autoscaling is enabled for job 2018-06-01_18_05_21-12746651185546532388. The number of workers will be between 1 and 1000.
Jun 02, 2018 1:05:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:05:21.147Z: Autoscaling was automatically enabled for job 2018-06-01_18_05_21-12746651185546532388.
Jun 02, 2018 1:05:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:05:23.865Z: Checking required Cloud APIs are enabled.
Jun 02, 2018 1:05:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:05:23.981Z: Checking permissions granted to controller Service Account.
Jun 02, 2018 1:05:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:05:29.065Z: Worker configuration: n1-standard-1 in us-central1-b.
Jun 02, 2018 1:05:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:05:29.622Z: Expanding CoGroupByKey operations into optimizable parts.
Jun 02, 2018 1:05:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:05:29.797Z: Expanding GroupByKey operations into optimizable parts.
Jun 02, 2018 1:05:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:05:29.840Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
Jun 02, 2018 1:05:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:05:30.066Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
Jun 02, 2018 1:05:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:05:30.096Z: Elided trivial flatten
Jun 02, 2018 1:05:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:05:30.143Z: Elided trivial flatten
Jun 02, 2018 1:05:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:05:30.187Z: Elided trivial flatten
Jun 02, 2018 1:05:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:05:30.216Z: Unzipping flatten s24 for input s19.org.apache.beam.sdk.values.PCollection.<init>:329#8fd0f908e3ea90e3
Jun 02, 2018 1:05:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:05:30.251Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Reify, through flatten PAssert$33/GroupGlobally/FlattenDummyAndContents, into producer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map
Jun 02, 2018 1:05:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:05:30.291Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow into PAssert$33/GroupGlobally/GroupDummyAndContents/Read
Jun 02, 2018 1:05:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:05:30.331Z: Fusing consumer PAssert$33/GroupGlobally/ParDo(Concat) into PAssert$33/GroupGlobally/Values/Values/Map
Jun 02, 2018 1:05:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:05:30.369Z: Fusing consumer PAssert$33/GetPane/Map into PAssert$33/GroupGlobally/ParDo(Concat)
Jun 02, 2018 1:05:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:05:30.404Z: Fusing consumer PAssert$33/GroupGlobally/Values/Values/Map into PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow
Jun 02, 2018 1:05:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:05:30.444Z: Fusing consumer PAssert$33/RunChecks into PAssert$33/GetPane/Map
Jun 02, 2018 1:05:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:05:30.488Z: Fusing consumer PAssert$33/VerifyAssertions/ParDo(DefaultConclude) into PAssert$33/RunChecks
Jun 02, 2018 1:05:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:05:30.528Z: Unzipping flatten s24-u45 for input s26-reify-value18-c43
Jun 02, 2018 1:05:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:05:30.564Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Write, through flatten s24-u45, into producer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
Jun 02, 2018 1:05:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:05:30.610Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify into PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
Jun 02, 2018 1:05:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:05:30.662Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Write into PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
Jun 02, 2018 1:05:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:05:30.701Z: Fusing consumer PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)
Jun 02, 2018 1:05:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:05:30.747Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
Jun 02, 2018 1:05:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:05:30.788Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
Jun 02, 2018 1:05:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:05:30.827Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into PAssert$33/GroupGlobally/Window.Into()/Window.Assign
Jun 02, 2018 1:05:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:05:30.869Z: Fusing consumer OutputSideInputs into Create123/Read(CreateSource)
Jun 02, 2018 1:05:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:05:30.913Z: Fusing consumer PAssert$33/GroupGlobally/Window.Into()/Window.Assign into OutputSideInputs
Jun 02, 2018 1:05:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:05:30.951Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
Jun 02, 2018 1:05:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:05:30.996Z: Fusing consumer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map into PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
Jun 02, 2018 1:05:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:05:31.042Z: Fusing consumer PAssert$33/GroupGlobally/RewindowActuals/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map
Jun 02, 2018 1:05:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:05:31.090Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read
Jun 02, 2018 1:05:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:05:31.137Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
Jun 02, 2018 1:05:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:05:31.183Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
Jun 02, 2018 1:05:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:05:31.222Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
Jun 02, 2018 1:05:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:05:31.268Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
Jun 02, 2018 1:05:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:05:31.312Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
Jun 02, 2018 1:05:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:05:31.357Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into Create47/Read(CreateSource)
Jun 02, 2018 1:05:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:05:31.398Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
Jun 02, 2018 1:05:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:05:31.438Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
Jun 02, 2018 1:05:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:05:31.484Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
Jun 02, 2018 1:05:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:05:31.522Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
Jun 02, 2018 1:05:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:05:31.562Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
Jun 02, 2018 1:05:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:05:31.602Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
Jun 02, 2018 1:05:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:05:32.022Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Create
Jun 02, 2018 1:05:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:05:32.098Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Create
Jun 02, 2018 1:05:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:05:32.146Z: Starting 1 workers in us-central1-b...
Jun 02, 2018 1:05:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:05:32.146Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
Jun 02, 2018 1:05:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:05:32.186Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
Jun 02, 2018 1:05:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:05:32.390Z: Executing operation PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
Jun 02, 2018 1:05:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:05:32.435Z: Executing operation Create47/Read(CreateSource)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
Jun 02, 2018 1:05:44 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:05:42.056Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
Jun 02, 2018 1:05:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:05:52.635Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
Jun 02, 2018 1:05:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:05:52.675Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
Jun 02, 2018 1:06:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:06:10.213Z: Workers have started successfully.
Jun 02, 2018 1:06:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:06:35.350Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
Jun 02, 2018 1:06:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:06:35.437Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
Jun 02, 2018 1:06:43 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:06:40.974Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
Jun 02, 2018 1:06:43 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:06:41.071Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
Jun 02, 2018 1:06:50 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:06:50.396Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
Jun 02, 2018 1:06:50 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:06:50.598Z: Executing operation Create123/Read(CreateSource)+OutputSideInputs+PAssert$33/GroupGlobally/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write
Jun 02, 2018 1:06:57 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:06:55.669Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Close
Jun 02, 2018 1:06:57 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:06:55.766Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$33/GroupGlobally/RewindowActuals/Window.Assign+PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
Jun 02, 2018 1:06:59 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:06:58.084Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Close
Jun 02, 2018 1:06:59 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:06:58.174Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Read+PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$33/GroupGlobally/Values/Values/Map+PAssert$33/GroupGlobally/ParDo(Concat)+PAssert$33/GetPane/Map+PAssert$33/RunChecks+PAssert$33/VerifyAssertions/ParDo(DefaultConclude)
Jun 02, 2018 1:07:02 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:07:02.048Z: Cleaning up.
Jun 02, 2018 1:07:02 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:07:02.149Z: Stopping worker pool...
Jun 02, 2018 1:08:43 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:08:42.078Z: Autoscaling: Resized worker pool from 1 to 0.
Jun 02, 2018 1:08:43 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-02T01:08:42.123Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
Jun 02, 2018 1:08:52 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-06-01_18_05_21-12746651185546532388 finished with status DONE.
Jun 02, 2018 1:08:52 AM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-06-01_18_05_21-12746651185546532388. Found 1 success, 0 failures out of 1 expected assertions.
Gradle Test Executor 38 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest FAILED
209 tests completed, 34 failed, 2 skipped
Finished generating test XML results (0.611 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerTest>
Generating HTML test report...
Finished generating test html results (0.449 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest>
:beam-runners-google-cloud-dataflow-java:validatesRunnerTest (Thread[Task worker for ':' Thread 40,5,main]) completed. Took 2 hrs 10 mins 41.41 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:validatesRunnerTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 11m 33s
38 actionable tasks: 34 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/penehpisajvfe
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user katarzyna.kucharczyk@polidea.com
Not sending mail to unregistered user robbe.sneyders@ml6.eu
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user schroederc@google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user sidhom@google.com
Not sending mail to unregistered user cademarkegard@gmail.com
Not sending mail to unregistered user aromanenko.dev@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ammons@google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user kedin@google.com
Build failed in Jenkins:
beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #399
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/399/display/redirect?page=changes>
Changes:
[tgroh] Add an abstraction for State and Timers
[tgroh] DirectRunner Cleanups
[tgroh] Link up the Portable DirectRunner
[tgroh] Reuse ID Generators across Environments
------------------------------------------
[...truncated 18.23 MB...]
Jun 01, 2018 10:53:04 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RewindowActuals/Window.Assign as step s18
Jun 01, 2018 10:53:04 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map as step s19
Jun 01, 2018 10:53:04 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveActualsTriggering/Flatten.PCollections as step s20
Jun 01, 2018 10:53:04 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Create.Values/Read(CreateSource) as step s21
Jun 01, 2018 10:53:04 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign as step s22
Jun 01, 2018 10:53:04 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveDummyTriggering/Flatten.PCollections as step s23
Jun 01, 2018 10:53:04 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/FlattenDummyAndContents as step s24
Jun 01, 2018 10:53:04 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/NeverTrigger/Flatten.PCollections as step s25
Jun 01, 2018 10:53:04 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GroupDummyAndContents as step s26
Jun 01, 2018 10:53:04 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Values/Values/Map as step s27
Jun 01, 2018 10:53:04 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/ParDo(Concat) as step s28
Jun 01, 2018 10:53:04 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GetPane/Map as step s29
Jun 01, 2018 10:53:04 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/RunChecks as step s30
Jun 01, 2018 10:53:04 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/VerifyAssertions/ParDo(DefaultConclude) as step s31
Jun 01, 2018 10:53:04 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0601225300-148a29ea/output/results/staging/
Jun 01, 2018 10:53:04 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <71120 bytes, hash _joS0SriPgJ7W-VfhEQe3w> to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0601225300-148a29ea/output/results/staging/pipeline-_joS0SriPgJ7W-VfhEQe3w.pb
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
Jun 01, 2018 10:53:05 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-06-01_15_53_04-17341074202606167799?project=apache-beam-testing
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Submitted job: 2018-06-01_15_53_04-17341074202606167799
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
Jun 01, 2018 10:53:05 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-06-01_15_53_04-17341074202606167799
Jun 01, 2018 10:53:05 PM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-06-01_15_53_04-17341074202606167799 with 1 expected assertions.
Jun 01, 2018 10:53:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:53:04.813Z: Autoscaling is enabled for job 2018-06-01_15_53_04-17341074202606167799. The number of workers will be between 1 and 1000.
Jun 01, 2018 10:53:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:53:04.839Z: Autoscaling was automatically enabled for job 2018-06-01_15_53_04-17341074202606167799.
Jun 01, 2018 10:53:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:53:07.611Z: Checking required Cloud APIs are enabled.
Jun 01, 2018 10:53:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:53:07.921Z: Checking permissions granted to controller Service Account.
Jun 01, 2018 10:53:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:53:13.421Z: Worker configuration: n1-standard-1 in us-central1-b.
Jun 01, 2018 10:53:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:53:13.810Z: Expanding CoGroupByKey operations into optimizable parts.
Jun 01, 2018 10:53:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:53:13.964Z: Expanding GroupByKey operations into optimizable parts.
Jun 01, 2018 10:53:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:53:14.002Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
Jun 01, 2018 10:53:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:53:14.185Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
Jun 01, 2018 10:53:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:53:14.218Z: Elided trivial flatten
Jun 01, 2018 10:53:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:53:14.249Z: Elided trivial flatten
Jun 01, 2018 10:53:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:53:14.291Z: Elided trivial flatten
Jun 01, 2018 10:53:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:53:14.325Z: Unzipping flatten s24 for input s19.org.apache.beam.sdk.values.PCollection.<init>:329#8fd0f908e3ea90e3
Jun 01, 2018 10:53:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:53:14.363Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Reify, through flatten PAssert$33/GroupGlobally/FlattenDummyAndContents, into producer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map
Jun 01, 2018 10:53:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:53:14.399Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow into PAssert$33/GroupGlobally/GroupDummyAndContents/Read
Jun 01, 2018 10:53:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:53:14.428Z: Fusing consumer PAssert$33/GroupGlobally/ParDo(Concat) into PAssert$33/GroupGlobally/Values/Values/Map
Jun 01, 2018 10:53:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:53:14.462Z: Fusing consumer PAssert$33/GetPane/Map into PAssert$33/GroupGlobally/ParDo(Concat)
Jun 01, 2018 10:53:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:53:14.497Z: Fusing consumer PAssert$33/GroupGlobally/Values/Values/Map into PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow
Jun 01, 2018 10:53:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:53:14.536Z: Fusing consumer PAssert$33/RunChecks into PAssert$33/GetPane/Map
Jun 01, 2018 10:53:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:53:14.572Z: Fusing consumer PAssert$33/VerifyAssertions/ParDo(DefaultConclude) into PAssert$33/RunChecks
Jun 01, 2018 10:53:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:53:14.610Z: Unzipping flatten s24-u45 for input s26-reify-value18-c43
Jun 01, 2018 10:53:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:53:14.642Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Write, through flatten s24-u45, into producer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
Jun 01, 2018 10:53:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:53:14.674Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify into PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
Jun 01, 2018 10:53:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:53:14.711Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Write into PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
Jun 01, 2018 10:53:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:53:14.753Z: Fusing consumer PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)
Jun 01, 2018 10:53:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:53:14.785Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
Jun 01, 2018 10:53:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:53:14.823Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
Jun 01, 2018 10:53:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:53:14.855Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into PAssert$33/GroupGlobally/Window.Into()/Window.Assign
Jun 01, 2018 10:53:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:53:14.886Z: Fusing consumer OutputSideInputs into Create123/Read(CreateSource)
Jun 01, 2018 10:53:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:53:14.912Z: Fusing consumer PAssert$33/GroupGlobally/Window.Into()/Window.Assign into OutputSideInputs
Jun 01, 2018 10:53:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:53:14.950Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
Jun 01, 2018 10:53:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:53:14.983Z: Fusing consumer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map into PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
Jun 01, 2018 10:53:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:53:15.012Z: Fusing consumer PAssert$33/GroupGlobally/RewindowActuals/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map
Jun 01, 2018 10:53:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:53:15.041Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read
Jun 01, 2018 10:53:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:53:15.077Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
Jun 01, 2018 10:53:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:53:15.113Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
Jun 01, 2018 10:53:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:53:15.148Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
Jun 01, 2018 10:53:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:53:15.191Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
Jun 01, 2018 10:53:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:53:15.220Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
Jun 01, 2018 10:53:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:53:15.255Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into Create47/Read(CreateSource)
Jun 01, 2018 10:53:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:53:15.286Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
Jun 01, 2018 10:53:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:53:15.314Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
Jun 01, 2018 10:53:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:53:15.350Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
Jun 01, 2018 10:53:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:53:15.388Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
Jun 01, 2018 10:53:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:53:15.423Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
Jun 01, 2018 10:53:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:53:15.454Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
Jun 01, 2018 10:53:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:53:15.804Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Create
Jun 01, 2018 10:53:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:53:15.832Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Create
Jun 01, 2018 10:53:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:53:15.858Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
Jun 01, 2018 10:53:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:53:15.872Z: Starting 1 workers in us-central1-b...
Jun 01, 2018 10:53:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:53:15.880Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
Jun 01, 2018 10:53:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:53:16.059Z: Executing operation Create47/Read(CreateSource)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
Jun 01, 2018 10:53:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:53:16.095Z: Executing operation PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
Jun 01, 2018 10:53:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:53:26.884Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
Jun 01, 2018 10:53:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:53:43.075Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
Jun 01, 2018 10:53:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:53:43.096Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
Jun 01, 2018 10:54:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:53:59.966Z: Workers have started successfully.
Jun 01, 2018 10:54:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:54:29.400Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
Jun 01, 2018 10:54:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:54:29.474Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
Jun 01, 2018 10:54:40 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:54:39.275Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
Jun 01, 2018 10:54:40 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:54:39.381Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
Jun 01, 2018 10:54:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:54:51.830Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
Jun 01, 2018 10:54:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:54:51.993Z: Executing operation Create123/Read(CreateSource)+OutputSideInputs+PAssert$33/GroupGlobally/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write
Jun 01, 2018 10:54:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:54:58.563Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Close
Jun 01, 2018 10:54:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:54:58.634Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$33/GroupGlobally/RewindowActuals/Window.Assign+PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
Jun 01, 2018 10:55:02 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:55:01.422Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Close
Jun 01, 2018 10:55:02 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:55:01.490Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Read+PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$33/GroupGlobally/Values/Values/Map+PAssert$33/GroupGlobally/ParDo(Concat)+PAssert$33/GetPane/Map+PAssert$33/RunChecks+PAssert$33/VerifyAssertions/ParDo(DefaultConclude)
Jun 01, 2018 10:55:06 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:55:05.530Z: Cleaning up.
Jun 01, 2018 10:55:06 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:55:05.621Z: Stopping worker pool...
Jun 01, 2018 10:56:56 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:56:53.883Z: Autoscaling: Resized worker pool from 1 to 0.
Jun 01, 2018 10:56:56 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:56:53.904Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
Jun 01, 2018 10:56:56 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T22:56:53.937Z: Worker pool stopped.
Jun 01, 2018 10:57:02 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-06-01_15_53_04-17341074202606167799 finished with status DONE.
Jun 01, 2018 10:57:02 PM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-06-01_15_53_04-17341074202606167799. Found 1 success, 0 failures out of 1 expected assertions.
Gradle Test Executor 36 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest FAILED
209 tests completed, 34 failed, 2 skipped
Finished generating test XML results (0.476 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerTest>
Generating HTML test report...
Finished generating test html results (0.476 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest>
:beam-runners-google-cloud-dataflow-java:validatesRunnerTest (Thread[Task worker for ':' Thread 7,5,main]) completed. Took 2 hrs 9 mins 26.326 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:validatesRunnerTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 10m 19s
38 actionable tasks: 34 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/5fiea6rlyu6nw
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user katarzyna.kucharczyk@polidea.com
Not sending mail to unregistered user robbe.sneyders@ml6.eu
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user schroederc@google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user sidhom@google.com
Not sending mail to unregistered user cademarkegard@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ammons@google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user kedin@google.com
Build failed in Jenkins:
beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #398
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/398/display/redirect?page=changes>
Changes:
[boyuanz] Address BEAM-4328: :beam-sdks-java-io-google-cloud-platform:test failure
------------------------------------------
[...truncated 18.15 MB...]
Jun 01, 2018 8:42:37 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map as step s17
Jun 01, 2018 8:42:37 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RewindowActuals/Window.Assign as step s18
Jun 01, 2018 8:42:37 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map as step s19
Jun 01, 2018 8:42:37 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveActualsTriggering/Flatten.PCollections as step s20
Jun 01, 2018 8:42:37 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Create.Values/Read(CreateSource) as step s21
Jun 01, 2018 8:42:37 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign as step s22
Jun 01, 2018 8:42:37 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveDummyTriggering/Flatten.PCollections as step s23
Jun 01, 2018 8:42:37 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/FlattenDummyAndContents as step s24
Jun 01, 2018 8:42:37 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/NeverTrigger/Flatten.PCollections as step s25
Jun 01, 2018 8:42:37 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GroupDummyAndContents as step s26
Jun 01, 2018 8:42:37 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Values/Values/Map as step s27
Jun 01, 2018 8:42:37 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/ParDo(Concat) as step s28
Jun 01, 2018 8:42:37 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GetPane/Map as step s29
Jun 01, 2018 8:42:37 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/RunChecks as step s30
Jun 01, 2018 8:42:37 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/VerifyAssertions/ParDo(DefaultConclude) as step s31
Jun 01, 2018 8:42:37 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0601204233-797de8fc/output/results/staging/
Jun 01, 2018 8:42:37 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <71120 bytes, hash WJ74_K4nTbzQBDBXyDS5Dw> to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0601204233-797de8fc/output/results/staging/pipeline-WJ74_K4nTbzQBDBXyDS5Dw.pb
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
Jun 01, 2018 8:42:38 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-06-01_13_42_37-458591976342178231?project=apache-beam-testing
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Submitted job: 2018-06-01_13_42_37-458591976342178231
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
Jun 01, 2018 8:42:38 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-06-01_13_42_37-458591976342178231
Jun 01, 2018 8:42:38 PM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-06-01_13_42_37-458591976342178231 with 1 expected assertions.
Jun 01, 2018 8:42:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:42:37.959Z: Autoscaling is enabled for job 2018-06-01_13_42_37-458591976342178231. The number of workers will be between 1 and 1000.
Jun 01, 2018 8:42:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:42:38.008Z: Autoscaling was automatically enabled for job 2018-06-01_13_42_37-458591976342178231.
Jun 01, 2018 8:42:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:42:40.656Z: Checking required Cloud APIs are enabled.
Jun 01, 2018 8:42:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:42:40.972Z: Checking permissions granted to controller Service Account.
Jun 01, 2018 8:42:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:42:48.526Z: Worker configuration: n1-standard-1 in us-central1-b.
Jun 01, 2018 8:42:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:42:49.025Z: Expanding CoGroupByKey operations into optimizable parts.
Jun 01, 2018 8:42:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:42:49.188Z: Expanding GroupByKey operations into optimizable parts.
Jun 01, 2018 8:42:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:42:49.239Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
Jun 01, 2018 8:42:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:42:49.498Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
Jun 01, 2018 8:42:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:42:49.542Z: Elided trivial flatten
Jun 01, 2018 8:42:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:42:49.594Z: Elided trivial flatten
Jun 01, 2018 8:42:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:42:49.646Z: Elided trivial flatten
Jun 01, 2018 8:42:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:42:49.682Z: Unzipping flatten s24 for input s19.org.apache.beam.sdk.values.PCollection.<init>:329#8fd0f908e3ea90e3
Jun 01, 2018 8:42:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:42:49.724Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Reify, through flatten PAssert$33/GroupGlobally/FlattenDummyAndContents, into producer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map
Jun 01, 2018 8:42:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:42:49.772Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow into PAssert$33/GroupGlobally/GroupDummyAndContents/Read
Jun 01, 2018 8:42:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:42:49.813Z: Fusing consumer PAssert$33/GroupGlobally/ParDo(Concat) into PAssert$33/GroupGlobally/Values/Values/Map
Jun 01, 2018 8:42:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:42:49.849Z: Fusing consumer PAssert$33/GetPane/Map into PAssert$33/GroupGlobally/ParDo(Concat)
Jun 01, 2018 8:42:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:42:49.892Z: Fusing consumer PAssert$33/GroupGlobally/Values/Values/Map into PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow
Jun 01, 2018 8:42:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:42:49.934Z: Fusing consumer PAssert$33/RunChecks into PAssert$33/GetPane/Map
Jun 01, 2018 8:42:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:42:49.978Z: Fusing consumer PAssert$33/VerifyAssertions/ParDo(DefaultConclude) into PAssert$33/RunChecks
Jun 01, 2018 8:42:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:42:50.025Z: Unzipping flatten s24-u45 for input s26-reify-value18-c43
Jun 01, 2018 8:42:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:42:50.071Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Write, through flatten s24-u45, into producer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
Jun 01, 2018 8:42:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:42:50.109Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify into PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
Jun 01, 2018 8:42:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:42:50.146Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Write into PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
Jun 01, 2018 8:42:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:42:50.185Z: Fusing consumer PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)
Jun 01, 2018 8:42:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:42:50.227Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
Jun 01, 2018 8:42:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:42:50.260Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
Jun 01, 2018 8:42:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:42:50.294Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into PAssert$33/GroupGlobally/Window.Into()/Window.Assign
Jun 01, 2018 8:42:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:42:50.331Z: Fusing consumer OutputSideInputs into Create123/Read(CreateSource)
Jun 01, 2018 8:42:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:42:50.380Z: Fusing consumer PAssert$33/GroupGlobally/Window.Into()/Window.Assign into OutputSideInputs
Jun 01, 2018 8:42:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:42:50.429Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
Jun 01, 2018 8:42:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:42:50.474Z: Fusing consumer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map into PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
Jun 01, 2018 8:42:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:42:50.503Z: Fusing consumer PAssert$33/GroupGlobally/RewindowActuals/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map
Jun 01, 2018 8:42:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:42:50.540Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read
Jun 01, 2018 8:42:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:42:50.581Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
Jun 01, 2018 8:42:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:42:50.628Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
Jun 01, 2018 8:42:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:42:50.672Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
Jun 01, 2018 8:42:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:42:50.721Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
Jun 01, 2018 8:42:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:42:50.774Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
Jun 01, 2018 8:42:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:42:50.809Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into Create47/Read(CreateSource)
Jun 01, 2018 8:42:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:42:50.854Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
Jun 01, 2018 8:42:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:42:50.904Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
Jun 01, 2018 8:42:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:42:50.952Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
Jun 01, 2018 8:42:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:42:51.004Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
Jun 01, 2018 8:42:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:42:51.050Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
Jun 01, 2018 8:42:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:42:51.078Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
Jun 01, 2018 8:42:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:42:51.568Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Create
Jun 01, 2018 8:42:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:42:51.601Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Create
Jun 01, 2018 8:42:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:42:51.640Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
Jun 01, 2018 8:42:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:42:51.663Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
Jun 01, 2018 8:42:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:42:51.663Z: Starting 1 workers in us-central1-b...
Jun 01, 2018 8:42:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:42:51.908Z: Executing operation PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
Jun 01, 2018 8:42:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:42:51.958Z: Executing operation Create47/Read(CreateSource)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
Jun 01, 2018 8:43:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:43:01.357Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
Jun 01, 2018 8:43:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:43:12.060Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
Jun 01, 2018 8:43:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:43:12.113Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
Jun 01, 2018 8:43:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:43:29.677Z: Workers have started successfully.
Jun 01, 2018 8:43:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:43:58.259Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
Jun 01, 2018 8:43:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:43:58.354Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
Jun 01, 2018 8:44:07 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:44:05.653Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
Jun 01, 2018 8:44:07 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:44:05.755Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
Jun 01, 2018 8:44:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:44:17.983Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
Jun 01, 2018 8:44:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:44:18.158Z: Executing operation Create123/Read(CreateSource)+OutputSideInputs+PAssert$33/GroupGlobally/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write
Jun 01, 2018 8:44:24 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:44:23.750Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Close
Jun 01, 2018 8:44:24 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:44:23.812Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$33/GroupGlobally/RewindowActuals/Window.Assign+PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
Jun 01, 2018 8:44:29 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:44:28.544Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Close
Jun 01, 2018 8:44:29 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:44:28.602Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Read+PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$33/GroupGlobally/Values/Values/Map+PAssert$33/GroupGlobally/ParDo(Concat)+PAssert$33/GetPane/Map+PAssert$33/RunChecks+PAssert$33/VerifyAssertions/ParDo(DefaultConclude)
Jun 01, 2018 8:44:32 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:44:31.597Z: Cleaning up.
Jun 01, 2018 8:44:32 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:44:31.672Z: Stopping worker pool...
Jun 01, 2018 8:46:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:46:19.617Z: Autoscaling: Resized worker pool from 1 to 0.
Jun 01, 2018 8:46:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T20:46:19.669Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
Jun 01, 2018 8:46:29 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-06-01_13_42_37-458591976342178231 finished with status DONE.
Jun 01, 2018 8:46:29 PM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-06-01_13_42_37-458591976342178231. Found 1 success, 0 failures out of 1 expected assertions.
Gradle Test Executor 38 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest FAILED
209 tests completed, 34 failed, 2 skipped
Finished generating test XML results (0.592 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerTest>
Generating HTML test report...
Finished generating test html results (0.422 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest>
:beam-runners-google-cloud-dataflow-java:validatesRunnerTest (Thread[Task worker for ':' Thread 29,5,main]) completed. Took 2 hrs 18 mins 31.196 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:validatesRunnerTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 19m 22s
38 actionable tasks: 34 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/w2ko2bvgjjuxw
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user katarzyna.kucharczyk@polidea.com
Not sending mail to unregistered user robbe.sneyders@ml6.eu
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user schroederc@google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user sidhom@google.com
Not sending mail to unregistered user cademarkegard@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ammons@google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user kedin@google.com
Build failed in Jenkins:
beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #397
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/397/display/redirect?page=changes>
Changes:
[github] Undefined names: import MetricKey, MetricName
------------------------------------------
[...truncated 18.18 MB...]
Jun 01, 2018 6:23:17 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RewindowActuals/Window.Assign as step s18
Jun 01, 2018 6:23:17 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map as step s19
Jun 01, 2018 6:23:17 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveActualsTriggering/Flatten.PCollections as step s20
Jun 01, 2018 6:23:17 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Create.Values/Read(CreateSource) as step s21
Jun 01, 2018 6:23:17 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign as step s22
Jun 01, 2018 6:23:17 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveDummyTriggering/Flatten.PCollections as step s23
Jun 01, 2018 6:23:17 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/FlattenDummyAndContents as step s24
Jun 01, 2018 6:23:17 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/NeverTrigger/Flatten.PCollections as step s25
Jun 01, 2018 6:23:17 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GroupDummyAndContents as step s26
Jun 01, 2018 6:23:17 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Values/Values/Map as step s27
Jun 01, 2018 6:23:17 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/ParDo(Concat) as step s28
Jun 01, 2018 6:23:17 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GetPane/Map as step s29
Jun 01, 2018 6:23:17 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/RunChecks as step s30
Jun 01, 2018 6:23:17 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/VerifyAssertions/ParDo(DefaultConclude) as step s31
Jun 01, 2018 6:23:17 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0601182303-3032c7a9/output/results/staging/
Jun 01, 2018 6:23:17 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <71120 bytes, hash fPqOJ_a3RkUlyoG4jFwK6w> to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0601182303-3032c7a9/output/results/staging/pipeline-fPqOJ_a3RkUlyoG4jFwK6w.pb
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
Jun 01, 2018 6:23:18 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-06-01_11_23_17-6039041211300200157?project=apache-beam-testing
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Submitted job: 2018-06-01_11_23_17-6039041211300200157
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
Jun 01, 2018 6:23:18 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-06-01_11_23_17-6039041211300200157
Jun 01, 2018 6:23:18 PM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-06-01_11_23_17-6039041211300200157 with 1 expected assertions.
Jun 01, 2018 6:23:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:23:17.943Z: Autoscaling is enabled for job 2018-06-01_11_23_17-6039041211300200157. The number of workers will be between 1 and 1000.
Jun 01, 2018 6:23:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:23:17.982Z: Autoscaling was automatically enabled for job 2018-06-01_11_23_17-6039041211300200157.
Jun 01, 2018 6:23:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:23:20.920Z: Checking required Cloud APIs are enabled.
Jun 01, 2018 6:23:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:23:21.246Z: Checking permissions granted to controller Service Account.
Jun 01, 2018 6:23:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:23:27.329Z: Worker configuration: n1-standard-1 in us-central1-b.
Jun 01, 2018 6:23:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:23:27.767Z: Expanding CoGroupByKey operations into optimizable parts.
Jun 01, 2018 6:23:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:23:27.952Z: Expanding GroupByKey operations into optimizable parts.
Jun 01, 2018 6:23:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:23:27.990Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
Jun 01, 2018 6:23:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:23:28.224Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
Jun 01, 2018 6:23:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:23:28.270Z: Elided trivial flatten
Jun 01, 2018 6:23:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:23:28.306Z: Elided trivial flatten
Jun 01, 2018 6:23:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:23:28.340Z: Elided trivial flatten
Jun 01, 2018 6:23:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:23:28.379Z: Unzipping flatten s24 for input s19.org.apache.beam.sdk.values.PCollection.<init>:329#8fd0f908e3ea90e3
Jun 01, 2018 6:23:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:23:28.424Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Reify, through flatten PAssert$33/GroupGlobally/FlattenDummyAndContents, into producer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map
Jun 01, 2018 6:23:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:23:28.460Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow into PAssert$33/GroupGlobally/GroupDummyAndContents/Read
Jun 01, 2018 6:23:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:23:28.504Z: Fusing consumer PAssert$33/GroupGlobally/ParDo(Concat) into PAssert$33/GroupGlobally/Values/Values/Map
Jun 01, 2018 6:23:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:23:28.550Z: Fusing consumer PAssert$33/GetPane/Map into PAssert$33/GroupGlobally/ParDo(Concat)
Jun 01, 2018 6:23:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:23:28.584Z: Fusing consumer PAssert$33/GroupGlobally/Values/Values/Map into PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow
Jun 01, 2018 6:23:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:23:28.630Z: Fusing consumer PAssert$33/RunChecks into PAssert$33/GetPane/Map
Jun 01, 2018 6:23:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:23:28.677Z: Fusing consumer PAssert$33/VerifyAssertions/ParDo(DefaultConclude) into PAssert$33/RunChecks
Jun 01, 2018 6:23:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:23:28.721Z: Unzipping flatten s24-u45 for input s26-reify-value18-c43
Jun 01, 2018 6:23:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:23:28.768Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Write, through flatten s24-u45, into producer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
Jun 01, 2018 6:23:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:23:28.815Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify into PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
Jun 01, 2018 6:23:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:23:28.853Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Write into PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
Jun 01, 2018 6:23:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:23:28.902Z: Fusing consumer PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)
Jun 01, 2018 6:23:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:23:28.949Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
Jun 01, 2018 6:23:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:23:28.998Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
Jun 01, 2018 6:23:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:23:29.048Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into PAssert$33/GroupGlobally/Window.Into()/Window.Assign
Jun 01, 2018 6:23:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:23:29.088Z: Fusing consumer OutputSideInputs into Create123/Read(CreateSource)
Jun 01, 2018 6:23:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:23:29.124Z: Fusing consumer PAssert$33/GroupGlobally/Window.Into()/Window.Assign into OutputSideInputs
Jun 01, 2018 6:23:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:23:29.163Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
Jun 01, 2018 6:23:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:23:29.209Z: Fusing consumer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map into PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
Jun 01, 2018 6:23:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:23:29.255Z: Fusing consumer PAssert$33/GroupGlobally/RewindowActuals/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map
Jun 01, 2018 6:23:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:23:29.304Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read
Jun 01, 2018 6:23:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:23:29.349Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
Jun 01, 2018 6:23:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:23:29.393Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
Jun 01, 2018 6:23:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:23:29.433Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
Jun 01, 2018 6:23:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:23:29.478Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
Jun 01, 2018 6:23:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:23:29.528Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
Jun 01, 2018 6:23:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:23:29.563Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into Create47/Read(CreateSource)
Jun 01, 2018 6:23:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:23:29.615Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
Jun 01, 2018 6:23:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:23:29.663Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
Jun 01, 2018 6:23:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:23:29.710Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
Jun 01, 2018 6:23:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:23:29.756Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
Jun 01, 2018 6:23:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:23:29.803Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
Jun 01, 2018 6:23:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:23:29.846Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
Jun 01, 2018 6:23:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:23:30.431Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Create
Jun 01, 2018 6:23:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:23:30.467Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Create
Jun 01, 2018 6:23:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:23:30.515Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
Jun 01, 2018 6:23:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:23:30.525Z: Starting 1 workers in us-central1-b...
Jun 01, 2018 6:23:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:23:30.561Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
Jun 01, 2018 6:23:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:23:30.815Z: Executing operation PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
Jun 01, 2018 6:23:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:23:30.861Z: Executing operation Create47/Read(CreateSource)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
Jun 01, 2018 6:23:40 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:23:40.519Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
Jun 01, 2018 6:23:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:23:51.246Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
Jun 01, 2018 6:23:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:23:51.275Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
Jun 01, 2018 6:24:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:24:07.301Z: Workers have started successfully.
Jun 01, 2018 6:24:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:24:38.218Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
Jun 01, 2018 6:24:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:24:38.308Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
Jun 01, 2018 6:24:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:24:44.730Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
Jun 01, 2018 6:24:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:24:44.823Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
Jun 01, 2018 6:24:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:24:57.677Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
Jun 01, 2018 6:24:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:24:57.867Z: Executing operation Create123/Read(CreateSource)+OutputSideInputs+PAssert$33/GroupGlobally/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write
Jun 01, 2018 6:25:03 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:25:01.799Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Close
Jun 01, 2018 6:25:03 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:25:01.911Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$33/GroupGlobally/RewindowActuals/Window.Assign+PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
Jun 01, 2018 6:25:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:25:07.740Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Close
Jun 01, 2018 6:25:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:25:07.859Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Read+PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$33/GroupGlobally/Values/Values/Map+PAssert$33/GroupGlobally/ParDo(Concat)+PAssert$33/GetPane/Map+PAssert$33/RunChecks+PAssert$33/VerifyAssertions/ParDo(DefaultConclude)
Jun 01, 2018 6:25:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:25:11.928Z: Cleaning up.
Jun 01, 2018 6:25:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:25:12.049Z: Stopping worker pool...
Jun 01, 2018 6:26:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:26:41.198Z: Autoscaling: Resized worker pool from 1 to 0.
Jun 01, 2018 6:26:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T18:26:41.237Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
Jun 01, 2018 6:26:50 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-06-01_11_23_17-6039041211300200157 finished with status DONE.
Jun 01, 2018 6:26:50 PM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-06-01_11_23_17-6039041211300200157. Found 1 success, 0 failures out of 1 expected assertions.
Gradle Test Executor 39 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest
209 tests completed, 34 failed, 2 skipped
Finished generating test XML results (0.812 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerTest>
Generating HTML test report...
Finished generating test html results (0.883 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest>
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest FAILED
:beam-runners-google-cloud-dataflow-java:validatesRunnerTest (Thread[Task worker for ':' Thread 46,5,main]) completed. Took 2 hrs 19 mins 16.805 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:validatesRunnerTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 20m 13s
38 actionable tasks: 34 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/4ar4jrxgtukha
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user katarzyna.kucharczyk@polidea.com
Not sending mail to unregistered user robbe.sneyders@ml6.eu
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user schroederc@google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user sidhom@google.com
Not sending mail to unregistered user cademarkegard@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ammons@google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user kedin@google.com
Build failed in Jenkins:
beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #396
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/396/display/redirect>
------------------------------------------
[...truncated 18.18 MB...]
Jun 01, 2018 3:50:56 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RewindowActuals/Window.Assign as step s18
Jun 01, 2018 3:50:56 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map as step s19
Jun 01, 2018 3:50:56 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveActualsTriggering/Flatten.PCollections as step s20
Jun 01, 2018 3:50:56 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Create.Values/Read(CreateSource) as step s21
Jun 01, 2018 3:50:56 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign as step s22
Jun 01, 2018 3:50:56 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveDummyTriggering/Flatten.PCollections as step s23
Jun 01, 2018 3:50:56 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/FlattenDummyAndContents as step s24
Jun 01, 2018 3:50:56 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/NeverTrigger/Flatten.PCollections as step s25
Jun 01, 2018 3:50:56 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GroupDummyAndContents as step s26
Jun 01, 2018 3:50:56 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Values/Values/Map as step s27
Jun 01, 2018 3:50:56 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/ParDo(Concat) as step s28
Jun 01, 2018 3:50:56 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GetPane/Map as step s29
Jun 01, 2018 3:50:56 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/RunChecks as step s30
Jun 01, 2018 3:50:56 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/VerifyAssertions/ParDo(DefaultConclude) as step s31
Jun 01, 2018 3:50:56 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0601155050-64af26cc/output/results/staging/
Jun 01, 2018 3:50:56 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <71120 bytes, hash 1yQc7RGPzIWzi7NspfUpQQ> to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0601155050-64af26cc/output/results/staging/pipeline-1yQc7RGPzIWzi7NspfUpQQ.pb
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
Jun 01, 2018 3:50:57 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-06-01_08_50_57-10907534992205857506?project=apache-beam-testing
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Submitted job: 2018-06-01_08_50_57-10907534992205857506
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
Jun 01, 2018 3:50:57 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-06-01_08_50_57-10907534992205857506
Jun 01, 2018 3:50:57 PM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-06-01_08_50_57-10907534992205857506 with 1 expected assertions.
Jun 01, 2018 3:51:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:50:57.188Z: Autoscaling is enabled for job 2018-06-01_08_50_57-10907534992205857506. The number of workers will be between 1 and 1000.
Jun 01, 2018 3:51:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:50:57.229Z: Autoscaling was automatically enabled for job 2018-06-01_08_50_57-10907534992205857506.
Jun 01, 2018 3:51:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:50:59.595Z: Checking required Cloud APIs are enabled.
Jun 01, 2018 3:51:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:50:59.909Z: Checking permissions granted to controller Service Account.
Jun 01, 2018 3:51:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:51:03.834Z: Worker configuration: n1-standard-1 in us-central1-b.
Jun 01, 2018 3:51:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:51:04.334Z: Expanding CoGroupByKey operations into optimizable parts.
Jun 01, 2018 3:51:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:51:04.518Z: Expanding GroupByKey operations into optimizable parts.
Jun 01, 2018 3:51:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:51:04.558Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
Jun 01, 2018 3:51:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:51:04.777Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
Jun 01, 2018 3:51:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:51:04.824Z: Elided trivial flatten
Jun 01, 2018 3:51:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:51:04.873Z: Elided trivial flatten
Jun 01, 2018 3:51:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:51:04.918Z: Elided trivial flatten
Jun 01, 2018 3:51:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:51:04.966Z: Unzipping flatten s24 for input s19.org.apache.beam.sdk.values.PCollection.<init>:329#8fd0f908e3ea90e3
Jun 01, 2018 3:51:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:51:05.012Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Reify, through flatten PAssert$33/GroupGlobally/FlattenDummyAndContents, into producer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map
Jun 01, 2018 3:51:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:51:05.058Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow into PAssert$33/GroupGlobally/GroupDummyAndContents/Read
Jun 01, 2018 3:51:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:51:05.093Z: Fusing consumer PAssert$33/GroupGlobally/ParDo(Concat) into PAssert$33/GroupGlobally/Values/Values/Map
Jun 01, 2018 3:51:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:51:05.121Z: Fusing consumer PAssert$33/GetPane/Map into PAssert$33/GroupGlobally/ParDo(Concat)
Jun 01, 2018 3:51:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:51:05.162Z: Fusing consumer PAssert$33/GroupGlobally/Values/Values/Map into PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow
Jun 01, 2018 3:51:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:51:05.195Z: Fusing consumer PAssert$33/RunChecks into PAssert$33/GetPane/Map
Jun 01, 2018 3:51:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:51:05.234Z: Fusing consumer PAssert$33/VerifyAssertions/ParDo(DefaultConclude) into PAssert$33/RunChecks
Jun 01, 2018 3:51:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:51:05.277Z: Unzipping flatten s24-u45 for input s26-reify-value18-c43
Jun 01, 2018 3:51:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:51:05.305Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Write, through flatten s24-u45, into producer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
Jun 01, 2018 3:51:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:51:05.352Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify into PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
Jun 01, 2018 3:51:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:51:05.390Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Write into PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
Jun 01, 2018 3:51:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:51:05.435Z: Fusing consumer PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)
Jun 01, 2018 3:51:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:51:05.472Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
Jun 01, 2018 3:51:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:51:05.510Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
Jun 01, 2018 3:51:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:51:05.555Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into PAssert$33/GroupGlobally/Window.Into()/Window.Assign
Jun 01, 2018 3:51:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:51:05.604Z: Fusing consumer OutputSideInputs into Create123/Read(CreateSource)
Jun 01, 2018 3:51:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:51:05.650Z: Fusing consumer PAssert$33/GroupGlobally/Window.Into()/Window.Assign into OutputSideInputs
Jun 01, 2018 3:51:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:51:05.680Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
Jun 01, 2018 3:51:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:51:05.723Z: Fusing consumer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map into PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
Jun 01, 2018 3:51:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:51:05.767Z: Fusing consumer PAssert$33/GroupGlobally/RewindowActuals/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map
Jun 01, 2018 3:51:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:51:05.810Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read
Jun 01, 2018 3:51:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:51:05.836Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
Jun 01, 2018 3:51:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:51:05.873Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
Jun 01, 2018 3:51:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:51:05.907Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
Jun 01, 2018 3:51:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:51:05.942Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
Jun 01, 2018 3:51:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:51:05.988Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
Jun 01, 2018 3:51:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:51:06.034Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into Create47/Read(CreateSource)
Jun 01, 2018 3:51:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:51:06.071Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
Jun 01, 2018 3:51:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:51:06.110Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
Jun 01, 2018 3:51:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:51:06.146Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
Jun 01, 2018 3:51:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:51:06.188Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
Jun 01, 2018 3:51:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:51:06.225Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
Jun 01, 2018 3:51:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:51:06.272Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
Jun 01, 2018 3:51:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:51:06.703Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Create
Jun 01, 2018 3:51:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:51:06.748Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Create
Jun 01, 2018 3:51:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:51:06.795Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
Jun 01, 2018 3:51:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:51:06.804Z: Starting 1 workers in us-central1-b...
Jun 01, 2018 3:51:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:51:06.835Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
Jun 01, 2018 3:51:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:51:07.074Z: Executing operation PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
Jun 01, 2018 3:51:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:51:07.121Z: Executing operation Create47/Read(CreateSource)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
Jun 01, 2018 3:51:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:51:17.550Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
Jun 01, 2018 3:51:29 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:51:28.229Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
Jun 01, 2018 3:51:29 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:51:28.267Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
Jun 01, 2018 3:51:50 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:51:49.753Z: Workers have started successfully.
Jun 01, 2018 3:52:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:52:11.978Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
Jun 01, 2018 3:52:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:52:12.072Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
Jun 01, 2018 3:52:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:52:22.122Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
Jun 01, 2018 3:52:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:52:22.211Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
Jun 01, 2018 3:52:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:52:35.363Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
Jun 01, 2018 3:52:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:52:35.572Z: Executing operation Create123/Read(CreateSource)+OutputSideInputs+PAssert$33/GroupGlobally/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write
Jun 01, 2018 3:52:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:52:43.395Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Close
Jun 01, 2018 3:52:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:52:43.492Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$33/GroupGlobally/RewindowActuals/Window.Assign+PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
Jun 01, 2018 3:52:48 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:52:48.643Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Close
Jun 01, 2018 3:52:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:52:48.719Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Read+PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$33/GroupGlobally/Values/Values/Map+PAssert$33/GroupGlobally/ParDo(Concat)+PAssert$33/GetPane/Map+PAssert$33/RunChecks+PAssert$33/VerifyAssertions/ParDo(DefaultConclude)
Jun 01, 2018 3:52:54 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:52:53.373Z: Cleaning up.
Jun 01, 2018 3:52:54 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:52:53.466Z: Stopping worker pool...
Jun 01, 2018 3:54:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:54:43.179Z: Autoscaling: Resized worker pool from 1 to 0.
Jun 01, 2018 3:54:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T15:54:43.213Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
Jun 01, 2018 3:54:53 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-06-01_08_50_57-10907534992205857506 finished with status DONE.
Jun 01, 2018 3:54:53 PM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-06-01_08_50_57-10907534992205857506. Found 1 success, 0 failures out of 1 expected assertions.
Gradle Test Executor 40 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest
209 tests completed, 34 failed, 2 skipped
Finished generating test XML results (0.684 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerTest>
Generating HTML test report...
Finished generating test html results (0.494 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest>
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest FAILED
:beam-runners-google-cloud-dataflow-java:validatesRunnerTest (Thread[Task worker for ':' Thread 7,5,main]) completed. Took 2 hrs 14 mins 51.964 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:validatesRunnerTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 15m 46s
38 actionable tasks: 34 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/ohfgtdzyae2ks
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user katarzyna.kucharczyk@polidea.com
Not sending mail to unregistered user robbe.sneyders@ml6.eu
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user schroederc@google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user sidhom@google.com
Not sending mail to unregistered user cademarkegard@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ammons@google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user kedin@google.com
Build failed in Jenkins:
beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #395
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/395/display/redirect?page=changes>
Changes:
[coheigea] Fixing some ErrorProne warnings
------------------------------------------
[...truncated 18.17 MB...]
Jun 01, 2018 1:35:09 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RewindowActuals/Window.Assign as step s18
Jun 01, 2018 1:35:09 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map as step s19
Jun 01, 2018 1:35:09 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveActualsTriggering/Flatten.PCollections as step s20
Jun 01, 2018 1:35:09 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Create.Values/Read(CreateSource) as step s21
Jun 01, 2018 1:35:09 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign as step s22
Jun 01, 2018 1:35:09 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveDummyTriggering/Flatten.PCollections as step s23
Jun 01, 2018 1:35:09 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/FlattenDummyAndContents as step s24
Jun 01, 2018 1:35:09 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/NeverTrigger/Flatten.PCollections as step s25
Jun 01, 2018 1:35:09 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GroupDummyAndContents as step s26
Jun 01, 2018 1:35:09 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Values/Values/Map as step s27
Jun 01, 2018 1:35:09 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/ParDo(Concat) as step s28
Jun 01, 2018 1:35:09 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GetPane/Map as step s29
Jun 01, 2018 1:35:09 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/RunChecks as step s30
Jun 01, 2018 1:35:09 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/VerifyAssertions/ParDo(DefaultConclude) as step s31
Jun 01, 2018 1:35:09 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0601133506-a6eed56e/output/results/staging/
Jun 01, 2018 1:35:09 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <71120 bytes, hash OC6DR4GCfkEHwmB7IqIMKw> to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0601133506-a6eed56e/output/results/staging/pipeline-OC6DR4GCfkEHwmB7IqIMKw.pb
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
Jun 01, 2018 1:35:10 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-06-01_06_35_09-2386285786239066800?project=apache-beam-testing
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Submitted job: 2018-06-01_06_35_09-2386285786239066800
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
Jun 01, 2018 1:35:10 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-06-01_06_35_09-2386285786239066800
Jun 01, 2018 1:35:10 PM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-06-01_06_35_09-2386285786239066800 with 1 expected assertions.
Jun 01, 2018 1:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:35:09.892Z: Autoscaling is enabled for job 2018-06-01_06_35_09-2386285786239066800. The number of workers will be between 1 and 1000.
Jun 01, 2018 1:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:35:09.929Z: Autoscaling was automatically enabled for job 2018-06-01_06_35_09-2386285786239066800.
Jun 01, 2018 1:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:35:13.015Z: Checking required Cloud APIs are enabled.
Jun 01, 2018 1:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:35:13.358Z: Checking permissions granted to controller Service Account.
Jun 01, 2018 1:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:35:18.276Z: Worker configuration: n1-standard-1 in us-central1-b.
Jun 01, 2018 1:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:35:18.762Z: Expanding CoGroupByKey operations into optimizable parts.
Jun 01, 2018 1:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:35:18.918Z: Expanding GroupByKey operations into optimizable parts.
Jun 01, 2018 1:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:35:18.965Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
Jun 01, 2018 1:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:35:19.222Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
Jun 01, 2018 1:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:35:19.265Z: Elided trivial flatten
Jun 01, 2018 1:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:35:19.305Z: Elided trivial flatten
Jun 01, 2018 1:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:35:19.351Z: Elided trivial flatten
Jun 01, 2018 1:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:35:19.393Z: Unzipping flatten s24 for input s19.org.apache.beam.sdk.values.PCollection.<init>:329#8fd0f908e3ea90e3
Jun 01, 2018 1:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:35:19.439Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Reify, through flatten PAssert$33/GroupGlobally/FlattenDummyAndContents, into producer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map
Jun 01, 2018 1:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:35:19.487Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow into PAssert$33/GroupGlobally/GroupDummyAndContents/Read
Jun 01, 2018 1:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:35:19.533Z: Fusing consumer PAssert$33/GroupGlobally/ParDo(Concat) into PAssert$33/GroupGlobally/Values/Values/Map
Jun 01, 2018 1:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:35:19.578Z: Fusing consumer PAssert$33/GetPane/Map into PAssert$33/GroupGlobally/ParDo(Concat)
Jun 01, 2018 1:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:35:19.623Z: Fusing consumer PAssert$33/GroupGlobally/Values/Values/Map into PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow
Jun 01, 2018 1:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:35:19.669Z: Fusing consumer PAssert$33/RunChecks into PAssert$33/GetPane/Map
Jun 01, 2018 1:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:35:19.712Z: Fusing consumer PAssert$33/VerifyAssertions/ParDo(DefaultConclude) into PAssert$33/RunChecks
Jun 01, 2018 1:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:35:19.758Z: Unzipping flatten s24-u45 for input s26-reify-value18-c43
Jun 01, 2018 1:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:35:19.796Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Write, through flatten s24-u45, into producer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
Jun 01, 2018 1:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:35:19.840Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify into PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
Jun 01, 2018 1:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:35:19.888Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Write into PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
Jun 01, 2018 1:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:35:19.948Z: Fusing consumer PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)
Jun 01, 2018 1:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:35:20.003Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
Jun 01, 2018 1:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:35:20.061Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
Jun 01, 2018 1:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:35:20.099Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into PAssert$33/GroupGlobally/Window.Into()/Window.Assign
Jun 01, 2018 1:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:35:20.150Z: Fusing consumer OutputSideInputs into Create123/Read(CreateSource)
Jun 01, 2018 1:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:35:20.190Z: Fusing consumer PAssert$33/GroupGlobally/Window.Into()/Window.Assign into OutputSideInputs
Jun 01, 2018 1:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:35:20.231Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
Jun 01, 2018 1:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:35:20.277Z: Fusing consumer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map into PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
Jun 01, 2018 1:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:35:20.317Z: Fusing consumer PAssert$33/GroupGlobally/RewindowActuals/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map
Jun 01, 2018 1:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:35:20.355Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read
Jun 01, 2018 1:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:35:20.405Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
Jun 01, 2018 1:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:35:20.449Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
Jun 01, 2018 1:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:35:20.488Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
Jun 01, 2018 1:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:35:20.535Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
Jun 01, 2018 1:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:35:20.580Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
Jun 01, 2018 1:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:35:20.618Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into Create47/Read(CreateSource)
Jun 01, 2018 1:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:35:20.666Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
Jun 01, 2018 1:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:35:20.715Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
Jun 01, 2018 1:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:35:20.755Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
Jun 01, 2018 1:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:35:20.794Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
Jun 01, 2018 1:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:35:20.833Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
Jun 01, 2018 1:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:35:20.874Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
Jun 01, 2018 1:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:35:21.350Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Create
Jun 01, 2018 1:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:35:21.398Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Create
Jun 01, 2018 1:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:35:21.443Z: Starting 1 workers in us-central1-b...
Jun 01, 2018 1:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:35:21.443Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
Jun 01, 2018 1:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:35:21.481Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
Jun 01, 2018 1:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:35:21.741Z: Executing operation PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
Jun 01, 2018 1:35:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:35:21.789Z: Executing operation Create47/Read(CreateSource)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
Jun 01, 2018 1:35:33 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:35:32.497Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
Jun 01, 2018 1:35:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:35:43.562Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
Jun 01, 2018 1:35:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:35:43.609Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
Jun 01, 2018 1:36:07 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:36:05.473Z: Workers have started successfully.
Jun 01, 2018 1:36:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:36:26.680Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
Jun 01, 2018 1:36:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:36:26.771Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
Jun 01, 2018 1:36:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:36:33.856Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
Jun 01, 2018 1:36:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:36:33.944Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
Jun 01, 2018 1:36:49 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:36:47.160Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
Jun 01, 2018 1:36:49 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:36:47.348Z: Executing operation Create123/Read(CreateSource)+OutputSideInputs+PAssert$33/GroupGlobally/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write
Jun 01, 2018 1:36:54 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:36:52.889Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Close
Jun 01, 2018 1:36:54 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:36:52.976Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$33/GroupGlobally/RewindowActuals/Window.Assign+PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
Jun 01, 2018 1:36:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:36:56.910Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Close
Jun 01, 2018 1:36:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:36:56.999Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Read+PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$33/GroupGlobally/Values/Values/Map+PAssert$33/GroupGlobally/ParDo(Concat)+PAssert$33/GetPane/Map+PAssert$33/RunChecks+PAssert$33/VerifyAssertions/ParDo(DefaultConclude)
Jun 01, 2018 1:37:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:37:01.165Z: Cleaning up.
Jun 01, 2018 1:37:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:37:01.287Z: Stopping worker pool...
Jun 01, 2018 1:38:46 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:38:44.673Z: Autoscaling: Resized worker pool from 1 to 0.
Jun 01, 2018 1:38:46 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T13:38:44.715Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
Jun 01, 2018 1:38:53 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-06-01_06_35_09-2386285786239066800 finished with status DONE.
Jun 01, 2018 1:38:53 PM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-06-01_06_35_09-2386285786239066800. Found 1 success, 0 failures out of 1 expected assertions.
Gradle Test Executor 39 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest
209 tests completed, 34 failed, 2 skipped
Finished generating test XML results (0.65 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerTest>
Generating HTML test report...
Finished generating test html results (0.495 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest>
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest FAILED
:beam-runners-google-cloud-dataflow-java:validatesRunnerTest (Thread[Task worker for ':' Thread 47,5,main]) completed. Took 2 hrs 13 mins 20.465 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:validatesRunnerTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 14m 10s
38 actionable tasks: 34 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/rbz5g4rhk4vdc
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user katarzyna.kucharczyk@polidea.com
Not sending mail to unregistered user robbe.sneyders@ml6.eu
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user schroederc@google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user sidhom@google.com
Not sending mail to unregistered user cademarkegard@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ammons@google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user kedin@google.com
Build failed in Jenkins:
beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #394
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/394/display/redirect?page=changes>
Changes:
[coheigea] Fixing ErrorProne MissingOverrides warnings
------------------------------------------
[...truncated 18.20 MB...]
Jun 01, 2018 11:20:49 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map as step s17
Jun 01, 2018 11:20:49 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RewindowActuals/Window.Assign as step s18
Jun 01, 2018 11:20:49 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map as step s19
Jun 01, 2018 11:20:49 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveActualsTriggering/Flatten.PCollections as step s20
Jun 01, 2018 11:20:49 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Create.Values/Read(CreateSource) as step s21
Jun 01, 2018 11:20:49 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign as step s22
Jun 01, 2018 11:20:49 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveDummyTriggering/Flatten.PCollections as step s23
Jun 01, 2018 11:20:49 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/FlattenDummyAndContents as step s24
Jun 01, 2018 11:20:49 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/NeverTrigger/Flatten.PCollections as step s25
Jun 01, 2018 11:20:49 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GroupDummyAndContents as step s26
Jun 01, 2018 11:20:49 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Values/Values/Map as step s27
Jun 01, 2018 11:20:49 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/ParDo(Concat) as step s28
Jun 01, 2018 11:20:49 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GetPane/Map as step s29
Jun 01, 2018 11:20:49 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/RunChecks as step s30
Jun 01, 2018 11:20:49 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/VerifyAssertions/ParDo(DefaultConclude) as step s31
Jun 01, 2018 11:20:49 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0601112045-a463d04/output/results/staging/
Jun 01, 2018 11:20:49 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <71120 bytes, hash ZMxlsdTjx4dzCPAu2ck6WQ> to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0601112045-a463d04/output/results/staging/pipeline-ZMxlsdTjx4dzCPAu2ck6WQ.pb
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
Jun 01, 2018 11:20:50 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-06-01_04_20_50-14078549324319580279?project=apache-beam-testing
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Submitted job: 2018-06-01_04_20_50-14078549324319580279
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
Jun 01, 2018 11:20:50 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-06-01_04_20_50-14078549324319580279
Jun 01, 2018 11:20:50 AM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-06-01_04_20_50-14078549324319580279 with 1 expected assertions.
Jun 01, 2018 11:21:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:20:50.141Z: Autoscaling is enabled for job 2018-06-01_04_20_50-14078549324319580279. The number of workers will be between 1 and 1000.
Jun 01, 2018 11:21:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:20:50.181Z: Autoscaling was automatically enabled for job 2018-06-01_04_20_50-14078549324319580279.
Jun 01, 2018 11:21:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:20:52.418Z: Checking required Cloud APIs are enabled.
Jun 01, 2018 11:21:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:20:52.609Z: Checking permissions granted to controller Service Account.
Jun 01, 2018 11:21:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:20:57.525Z: Worker configuration: n1-standard-1 in us-central1-b.
Jun 01, 2018 11:21:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:20:57.964Z: Expanding CoGroupByKey operations into optimizable parts.
Jun 01, 2018 11:21:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:20:58.113Z: Expanding GroupByKey operations into optimizable parts.
Jun 01, 2018 11:21:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:20:58.159Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
Jun 01, 2018 11:21:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:20:58.387Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
Jun 01, 2018 11:21:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:20:58.430Z: Elided trivial flatten
Jun 01, 2018 11:21:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:20:58.475Z: Elided trivial flatten
Jun 01, 2018 11:21:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:20:58.522Z: Elided trivial flatten
Jun 01, 2018 11:21:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:20:58.566Z: Unzipping flatten s24 for input s19.org.apache.beam.sdk.values.PCollection.<init>:329#8fd0f908e3ea90e3
Jun 01, 2018 11:21:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:20:58.609Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Reify, through flatten PAssert$33/GroupGlobally/FlattenDummyAndContents, into producer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map
Jun 01, 2018 11:21:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:20:58.649Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow into PAssert$33/GroupGlobally/GroupDummyAndContents/Read
Jun 01, 2018 11:21:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:20:58.692Z: Fusing consumer PAssert$33/GroupGlobally/ParDo(Concat) into PAssert$33/GroupGlobally/Values/Values/Map
Jun 01, 2018 11:21:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:20:58.729Z: Fusing consumer PAssert$33/GetPane/Map into PAssert$33/GroupGlobally/ParDo(Concat)
Jun 01, 2018 11:21:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:20:58.773Z: Fusing consumer PAssert$33/GroupGlobally/Values/Values/Map into PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow
Jun 01, 2018 11:21:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:20:58.813Z: Fusing consumer PAssert$33/RunChecks into PAssert$33/GetPane/Map
Jun 01, 2018 11:21:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:20:58.855Z: Fusing consumer PAssert$33/VerifyAssertions/ParDo(DefaultConclude) into PAssert$33/RunChecks
Jun 01, 2018 11:21:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:20:58.900Z: Unzipping flatten s24-u45 for input s26-reify-value18-c43
Jun 01, 2018 11:21:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:20:58.943Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Write, through flatten s24-u45, into producer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
Jun 01, 2018 11:21:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:20:58.982Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify into PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
Jun 01, 2018 11:21:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:20:59.027Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Write into PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
Jun 01, 2018 11:21:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:20:59.071Z: Fusing consumer PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)
Jun 01, 2018 11:21:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:20:59.109Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
Jun 01, 2018 11:21:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:20:59.152Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
Jun 01, 2018 11:21:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:20:59.197Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into PAssert$33/GroupGlobally/Window.Into()/Window.Assign
Jun 01, 2018 11:21:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:20:59.237Z: Fusing consumer OutputSideInputs into Create123/Read(CreateSource)
Jun 01, 2018 11:21:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:20:59.283Z: Fusing consumer PAssert$33/GroupGlobally/Window.Into()/Window.Assign into OutputSideInputs
Jun 01, 2018 11:21:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:20:59.322Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
Jun 01, 2018 11:21:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:20:59.354Z: Fusing consumer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map into PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
Jun 01, 2018 11:21:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:20:59.399Z: Fusing consumer PAssert$33/GroupGlobally/RewindowActuals/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map
Jun 01, 2018 11:21:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:20:59.444Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read
Jun 01, 2018 11:21:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:20:59.490Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
Jun 01, 2018 11:21:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:20:59.534Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
Jun 01, 2018 11:21:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:20:59.569Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
Jun 01, 2018 11:21:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:20:59.600Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
Jun 01, 2018 11:21:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:20:59.646Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
Jun 01, 2018 11:21:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:20:59.689Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into Create47/Read(CreateSource)
Jun 01, 2018 11:21:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:20:59.728Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
Jun 01, 2018 11:21:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:20:59.770Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
Jun 01, 2018 11:21:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:20:59.814Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
Jun 01, 2018 11:21:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:20:59.851Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
Jun 01, 2018 11:21:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:20:59.881Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
Jun 01, 2018 11:21:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:20:59.918Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
Jun 01, 2018 11:21:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:21:00.349Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Create
Jun 01, 2018 11:21:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:21:00.395Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Create
Jun 01, 2018 11:21:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:21:00.429Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
Jun 01, 2018 11:21:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:21:00.442Z: Starting 1 workers in us-central1-b...
Jun 01, 2018 11:21:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:21:00.468Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
Jun 01, 2018 11:21:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:21:00.697Z: Executing operation PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
Jun 01, 2018 11:21:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:21:00.732Z: Executing operation Create47/Read(CreateSource)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
Jun 01, 2018 11:21:12 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:21:10.442Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
Jun 01, 2018 11:21:23 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:21:21.310Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
Jun 01, 2018 11:21:23 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:21:21.353Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
Jun 01, 2018 11:21:44 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:21:43.578Z: Workers have started successfully.
Jun 01, 2018 11:22:06 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:22:05.566Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
Jun 01, 2018 11:22:06 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:22:05.647Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
Jun 01, 2018 11:22:15 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:22:14.641Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
Jun 01, 2018 11:22:15 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:22:14.728Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
Jun 01, 2018 11:22:27 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:22:26.552Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
Jun 01, 2018 11:22:27 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:22:26.754Z: Executing operation Create123/Read(CreateSource)+OutputSideInputs+PAssert$33/GroupGlobally/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write
Jun 01, 2018 11:22:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:22:32.150Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Close
Jun 01, 2018 11:22:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:22:32.236Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$33/GroupGlobally/RewindowActuals/Window.Assign+PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
Jun 01, 2018 11:22:39 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:22:38.965Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Close
Jun 01, 2018 11:22:39 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:22:39.055Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Read+PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$33/GroupGlobally/Values/Values/Map+PAssert$33/GroupGlobally/ParDo(Concat)+PAssert$33/GetPane/Map+PAssert$33/RunChecks+PAssert$33/VerifyAssertions/ParDo(DefaultConclude)
Jun 01, 2018 11:22:43 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:22:43.180Z: Cleaning up.
Jun 01, 2018 11:22:44 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:22:43.286Z: Stopping worker pool...
Jun 01, 2018 11:24:22 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:24:21.166Z: Autoscaling: Resized worker pool from 1 to 0.
Jun 01, 2018 11:24:22 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T11:24:21.212Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
Jun 01, 2018 11:24:28 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-06-01_04_20_50-14078549324319580279 finished with status DONE.
Jun 01, 2018 11:24:28 AM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-06-01_04_20_50-14078549324319580279. Found 1 success, 0 failures out of 1 expected assertions.
Gradle Test Executor 36 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest FAILED
209 tests completed, 34 failed, 2 skipped
Finished generating test XML results (0.235 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerTest>
Generating HTML test report...
Finished generating test html results (0.372 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest>
:beam-runners-google-cloud-dataflow-java:validatesRunnerTest (Thread[Task worker for ':' Thread 45,5,main]) completed. Took 2 hrs 9 mins 32.796 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:validatesRunnerTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 10m 22s
38 actionable tasks: 34 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/t4irh5y2d533k
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user katarzyna.kucharczyk@polidea.com
Not sending mail to unregistered user robbe.sneyders@ml6.eu
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user schroederc@google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user sidhom@google.com
Not sending mail to unregistered user cademarkegard@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ammons@google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user kedin@google.com
Build failed in Jenkins:
beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #393
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/393/display/redirect>
------------------------------------------
[...truncated 18.13 MB...]
Jun 01, 2018 8:12:45 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map as step s19
Jun 01, 2018 8:12:45 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveActualsTriggering/Flatten.PCollections as step s20
Jun 01, 2018 8:12:45 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Create.Values/Read(CreateSource) as step s21
Jun 01, 2018 8:12:45 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign as step s22
Jun 01, 2018 8:12:45 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveDummyTriggering/Flatten.PCollections as step s23
Jun 01, 2018 8:12:45 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/FlattenDummyAndContents as step s24
Jun 01, 2018 8:12:45 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/NeverTrigger/Flatten.PCollections as step s25
Jun 01, 2018 8:12:45 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GroupDummyAndContents as step s26
Jun 01, 2018 8:12:45 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Values/Values/Map as step s27
Jun 01, 2018 8:12:45 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/ParDo(Concat) as step s28
Jun 01, 2018 8:12:45 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GetPane/Map as step s29
Jun 01, 2018 8:12:45 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/RunChecks as step s30
Jun 01, 2018 8:12:45 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/VerifyAssertions/ParDo(DefaultConclude) as step s31
Jun 01, 2018 8:12:45 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0601081241-1b91a412/output/results/staging/
Jun 01, 2018 8:12:46 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <71120 bytes, hash lhS34R3CrevOB3whdH4pMw> to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0601081241-1b91a412/output/results/staging/pipeline-lhS34R3CrevOB3whdH4pMw.pb
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
Jun 01, 2018 8:12:47 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-06-01_01_12_46-6178573666444420630?project=apache-beam-testing
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Submitted job: 2018-06-01_01_12_46-6178573666444420630
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
Jun 01, 2018 8:12:47 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-06-01_01_12_46-6178573666444420630
Jun 01, 2018 8:12:47 AM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-06-01_01_12_46-6178573666444420630 with 1 expected assertions.
Jun 01, 2018 8:12:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:12:46.557Z: Autoscaling is enabled for job 2018-06-01_01_12_46-6178573666444420630. The number of workers will be between 1 and 1000.
Jun 01, 2018 8:12:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:12:46.603Z: Autoscaling was automatically enabled for job 2018-06-01_01_12_46-6178573666444420630.
Jun 01, 2018 8:12:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:12:49.446Z: Checking required Cloud APIs are enabled.
Jun 01, 2018 8:12:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:12:49.647Z: Checking permissions granted to controller Service Account.
Jun 01, 2018 8:12:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:12:55.495Z: Worker configuration: n1-standard-1 in us-central1-b.
Jun 01, 2018 8:12:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:12:55.887Z: Expanding CoGroupByKey operations into optimizable parts.
Jun 01, 2018 8:12:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:12:56.057Z: Expanding GroupByKey operations into optimizable parts.
Jun 01, 2018 8:12:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:12:56.098Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
Jun 01, 2018 8:12:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:12:56.329Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
Jun 01, 2018 8:12:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:12:56.377Z: Elided trivial flatten
Jun 01, 2018 8:12:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:12:56.420Z: Elided trivial flatten
Jun 01, 2018 8:12:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:12:56.463Z: Elided trivial flatten
Jun 01, 2018 8:12:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:12:56.511Z: Unzipping flatten s24 for input s19.org.apache.beam.sdk.values.PCollection.<init>:329#8fd0f908e3ea90e3
Jun 01, 2018 8:12:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:12:56.552Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Reify, through flatten PAssert$33/GroupGlobally/FlattenDummyAndContents, into producer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map
Jun 01, 2018 8:12:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:12:56.597Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow into PAssert$33/GroupGlobally/GroupDummyAndContents/Read
Jun 01, 2018 8:12:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:12:56.640Z: Fusing consumer PAssert$33/GroupGlobally/ParDo(Concat) into PAssert$33/GroupGlobally/Values/Values/Map
Jun 01, 2018 8:12:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:12:56.680Z: Fusing consumer PAssert$33/GetPane/Map into PAssert$33/GroupGlobally/ParDo(Concat)
Jun 01, 2018 8:12:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:12:56.727Z: Fusing consumer PAssert$33/GroupGlobally/Values/Values/Map into PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow
Jun 01, 2018 8:12:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:12:56.765Z: Fusing consumer PAssert$33/RunChecks into PAssert$33/GetPane/Map
Jun 01, 2018 8:12:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:12:56.810Z: Fusing consumer PAssert$33/VerifyAssertions/ParDo(DefaultConclude) into PAssert$33/RunChecks
Jun 01, 2018 8:12:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:12:56.851Z: Unzipping flatten s24-u45 for input s26-reify-value18-c43
Jun 01, 2018 8:12:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:12:56.897Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Write, through flatten s24-u45, into producer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
Jun 01, 2018 8:12:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:12:56.938Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify into PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
Jun 01, 2018 8:12:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:12:56.977Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Write into PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
Jun 01, 2018 8:12:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:12:57.013Z: Fusing consumer PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)
Jun 01, 2018 8:12:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:12:57.051Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
Jun 01, 2018 8:12:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:12:57.098Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
Jun 01, 2018 8:12:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:12:57.144Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into PAssert$33/GroupGlobally/Window.Into()/Window.Assign
Jun 01, 2018 8:12:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:12:57.190Z: Fusing consumer OutputSideInputs into Create123/Read(CreateSource)
Jun 01, 2018 8:12:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:12:57.233Z: Fusing consumer PAssert$33/GroupGlobally/Window.Into()/Window.Assign into OutputSideInputs
Jun 01, 2018 8:12:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:12:57.276Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
Jun 01, 2018 8:12:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:12:57.320Z: Fusing consumer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map into PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
Jun 01, 2018 8:12:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:12:57.363Z: Fusing consumer PAssert$33/GroupGlobally/RewindowActuals/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map
Jun 01, 2018 8:12:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:12:57.402Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read
Jun 01, 2018 8:12:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:12:57.447Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
Jun 01, 2018 8:12:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:12:57.496Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
Jun 01, 2018 8:12:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:12:57.539Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
Jun 01, 2018 8:12:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:12:57.575Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
Jun 01, 2018 8:12:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:12:57.609Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
Jun 01, 2018 8:12:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:12:57.651Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into Create47/Read(CreateSource)
Jun 01, 2018 8:12:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:12:57.707Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
Jun 01, 2018 8:12:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:12:57.743Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
Jun 01, 2018 8:12:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:12:57.790Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
Jun 01, 2018 8:12:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:12:57.825Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
Jun 01, 2018 8:12:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:12:57.862Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
Jun 01, 2018 8:12:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:12:57.904Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
Jun 01, 2018 8:12:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:12:58.363Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Create
Jun 01, 2018 8:12:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:12:58.409Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Create
Jun 01, 2018 8:12:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:12:58.455Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
Jun 01, 2018 8:12:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:12:58.467Z: Starting 1 workers in us-central1-b...
Jun 01, 2018 8:12:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:12:58.498Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
Jun 01, 2018 8:13:01 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:12:58.742Z: Executing operation PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
Jun 01, 2018 8:13:01 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:12:58.782Z: Executing operation Create47/Read(CreateSource)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
Jun 01, 2018 8:13:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:13:08.187Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
Jun 01, 2018 8:13:24 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:13:24.166Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
Jun 01, 2018 8:13:24 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:13:24.204Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
Jun 01, 2018 8:13:47 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:13:45.287Z: Workers have started successfully.
Jun 01, 2018 8:14:05 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:14:04.814Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
Jun 01, 2018 8:14:05 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:14:04.920Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
Jun 01, 2018 8:14:12 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:14:11.248Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
Jun 01, 2018 8:14:12 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:14:11.343Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
Jun 01, 2018 8:14:23 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:14:23.784Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
Jun 01, 2018 8:14:26 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:14:23.969Z: Executing operation Create123/Read(CreateSource)+OutputSideInputs+PAssert$33/GroupGlobally/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write
Jun 01, 2018 8:14:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:14:27.367Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Close
Jun 01, 2018 8:14:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:14:27.461Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$33/GroupGlobally/RewindowActuals/Window.Assign+PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
Jun 01, 2018 8:14:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:14:30.778Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Close
Jun 01, 2018 8:14:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:14:30.861Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Read+PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$33/GroupGlobally/Values/Values/Map+PAssert$33/GroupGlobally/ParDo(Concat)+PAssert$33/GetPane/Map+PAssert$33/RunChecks+PAssert$33/VerifyAssertions/ParDo(DefaultConclude)
Jun 01, 2018 8:14:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:14:35.776Z: Cleaning up.
Jun 01, 2018 8:14:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:14:35.878Z: Stopping worker pool...
Jun 01, 2018 8:16:19 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:16:19.698Z: Autoscaling: Resized worker pool from 1 to 0.
Jun 01, 2018 8:16:19 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:16:19.737Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
Jun 01, 2018 8:16:22 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T08:16:19.786Z: Worker pool stopped.
Jun 01, 2018 8:16:29 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-06-01_01_12_46-6178573666444420630 finished with status DONE.
Jun 01, 2018 8:16:29 AM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-06-01_01_12_46-6178573666444420630. Found 1 success, 0 failures out of 1 expected assertions.
Gradle Test Executor 18 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest
209 tests completed, 34 failed, 2 skipped
Finished generating test XML results (0.823 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerTest>
Generating HTML test report...
Finished generating test html results (0.387 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest>
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest FAILED
:beam-runners-google-cloud-dataflow-java:validatesRunnerTest (Thread[Task worker for ':' Thread 9,5,main]) completed. Took 2 hrs 14 mins 1.943 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:validatesRunnerTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 15m 23s
38 actionable tasks: 34 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/4mwf4cw2c4wkm
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user katarzyna.kucharczyk@polidea.com
Not sending mail to unregistered user robbe.sneyders@ml6.eu
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user schroederc@google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user sidhom@google.com
Not sending mail to unregistered user cademarkegard@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ammons@google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user kedin@google.com
Build failed in Jenkins:
beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #392
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/392/display/redirect>
------------------------------------------
[...truncated 18.17 MB...]
Jun 01, 2018 3:54:34 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RewindowActuals/Window.Assign as step s18
Jun 01, 2018 3:54:34 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map as step s19
Jun 01, 2018 3:54:34 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveActualsTriggering/Flatten.PCollections as step s20
Jun 01, 2018 3:54:34 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Create.Values/Read(CreateSource) as step s21
Jun 01, 2018 3:54:34 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign as step s22
Jun 01, 2018 3:54:34 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveDummyTriggering/Flatten.PCollections as step s23
Jun 01, 2018 3:54:34 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/FlattenDummyAndContents as step s24
Jun 01, 2018 3:54:34 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/NeverTrigger/Flatten.PCollections as step s25
Jun 01, 2018 3:54:34 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GroupDummyAndContents as step s26
Jun 01, 2018 3:54:34 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Values/Values/Map as step s27
Jun 01, 2018 3:54:34 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/ParDo(Concat) as step s28
Jun 01, 2018 3:54:34 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GetPane/Map as step s29
Jun 01, 2018 3:54:34 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/RunChecks as step s30
Jun 01, 2018 3:54:34 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/VerifyAssertions/ParDo(DefaultConclude) as step s31
Jun 01, 2018 3:54:34 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0601035416-e9485c2a/output/results/staging/
Jun 01, 2018 3:54:34 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <71120 bytes, hash CZ-qdMFMtAb5RBSf0QUBtw> to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0601035416-e9485c2a/output/results/staging/pipeline-CZ-qdMFMtAb5RBSf0QUBtw.pb
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
Jun 01, 2018 3:54:35 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-05-31_20_54_34-12575141298163203447?project=apache-beam-testing
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Submitted job: 2018-05-31_20_54_34-12575141298163203447
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
Jun 01, 2018 3:54:35 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-05-31_20_54_34-12575141298163203447
Jun 01, 2018 3:54:35 AM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-05-31_20_54_34-12575141298163203447 with 1 expected assertions.
Jun 01, 2018 3:54:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:54:34.853Z: Autoscaling is enabled for job 2018-05-31_20_54_34-12575141298163203447. The number of workers will be between 1 and 1000.
Jun 01, 2018 3:54:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:54:34.897Z: Autoscaling was automatically enabled for job 2018-05-31_20_54_34-12575141298163203447.
Jun 01, 2018 3:54:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:54:37.816Z: Checking required Cloud APIs are enabled.
Jun 01, 2018 3:54:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:54:38.172Z: Checking permissions granted to controller Service Account.
Jun 01, 2018 3:54:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:54:46.750Z: Worker configuration: n1-standard-1 in us-central1-b.
Jun 01, 2018 3:54:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:54:47.218Z: Expanding CoGroupByKey operations into optimizable parts.
Jun 01, 2018 3:54:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:54:47.385Z: Expanding GroupByKey operations into optimizable parts.
Jun 01, 2018 3:54:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:54:47.425Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
Jun 01, 2018 3:54:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:54:47.629Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
Jun 01, 2018 3:54:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:54:47.675Z: Elided trivial flatten
Jun 01, 2018 3:54:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:54:47.719Z: Elided trivial flatten
Jun 01, 2018 3:54:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:54:47.764Z: Elided trivial flatten
Jun 01, 2018 3:54:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:54:47.809Z: Unzipping flatten s24 for input s19.org.apache.beam.sdk.values.PCollection.<init>:329#8fd0f908e3ea90e3
Jun 01, 2018 3:54:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:54:47.851Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Reify, through flatten PAssert$33/GroupGlobally/FlattenDummyAndContents, into producer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map
Jun 01, 2018 3:54:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:54:47.880Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow into PAssert$33/GroupGlobally/GroupDummyAndContents/Read
Jun 01, 2018 3:54:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:54:47.919Z: Fusing consumer PAssert$33/GroupGlobally/ParDo(Concat) into PAssert$33/GroupGlobally/Values/Values/Map
Jun 01, 2018 3:54:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:54:47.956Z: Fusing consumer PAssert$33/GetPane/Map into PAssert$33/GroupGlobally/ParDo(Concat)
Jun 01, 2018 3:54:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:54:47.999Z: Fusing consumer PAssert$33/GroupGlobally/Values/Values/Map into PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow
Jun 01, 2018 3:54:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:54:48.043Z: Fusing consumer PAssert$33/RunChecks into PAssert$33/GetPane/Map
Jun 01, 2018 3:54:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:54:48.084Z: Fusing consumer PAssert$33/VerifyAssertions/ParDo(DefaultConclude) into PAssert$33/RunChecks
Jun 01, 2018 3:54:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:54:48.129Z: Unzipping flatten s24-u45 for input s26-reify-value18-c43
Jun 01, 2018 3:54:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:54:48.164Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Write, through flatten s24-u45, into producer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
Jun 01, 2018 3:54:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:54:48.208Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify into PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
Jun 01, 2018 3:54:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:54:48.245Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Write into PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
Jun 01, 2018 3:54:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:54:48.268Z: Fusing consumer PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)
Jun 01, 2018 3:54:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:54:48.312Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
Jun 01, 2018 3:54:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:54:48.345Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
Jun 01, 2018 3:54:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:54:48.382Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into PAssert$33/GroupGlobally/Window.Into()/Window.Assign
Jun 01, 2018 3:54:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:54:48.427Z: Fusing consumer OutputSideInputs into Create123/Read(CreateSource)
Jun 01, 2018 3:54:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:54:48.467Z: Fusing consumer PAssert$33/GroupGlobally/Window.Into()/Window.Assign into OutputSideInputs
Jun 01, 2018 3:54:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:54:48.510Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
Jun 01, 2018 3:54:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:54:48.556Z: Fusing consumer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map into PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
Jun 01, 2018 3:54:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:54:48.595Z: Fusing consumer PAssert$33/GroupGlobally/RewindowActuals/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map
Jun 01, 2018 3:54:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:54:48.621Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read
Jun 01, 2018 3:54:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:54:48.658Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
Jun 01, 2018 3:54:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:54:48.703Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
Jun 01, 2018 3:54:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:54:48.740Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
Jun 01, 2018 3:54:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:54:48.784Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
Jun 01, 2018 3:54:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:54:48.831Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
Jun 01, 2018 3:54:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:54:48.866Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into Create47/Read(CreateSource)
Jun 01, 2018 3:54:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:54:48.902Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
Jun 01, 2018 3:54:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:54:48.938Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
Jun 01, 2018 3:54:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:54:48.982Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
Jun 01, 2018 3:54:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:54:49.017Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
Jun 01, 2018 3:54:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:54:49.061Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
Jun 01, 2018 3:54:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:54:49.098Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
Jun 01, 2018 3:54:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:54:49.499Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Create
Jun 01, 2018 3:54:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:54:49.529Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Create
Jun 01, 2018 3:54:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:54:49.559Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
Jun 01, 2018 3:54:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:54:49.587Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
Jun 01, 2018 3:54:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:54:49.587Z: Starting 1 workers in us-central1-b...
Jun 01, 2018 3:54:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:54:49.818Z: Executing operation PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
Jun 01, 2018 3:54:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:54:49.852Z: Executing operation Create47/Read(CreateSource)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
Jun 01, 2018 3:54:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:54:57.668Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
Jun 01, 2018 3:55:09 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:55:08.257Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
Jun 01, 2018 3:55:09 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:55:08.281Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
Jun 01, 2018 3:55:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:55:33.259Z: Workers have started successfully.
Jun 01, 2018 3:55:57 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:55:55.983Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
Jun 01, 2018 3:55:57 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:55:56.051Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
Jun 01, 2018 3:56:06 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:56:06.224Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
Jun 01, 2018 3:56:06 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:56:06.267Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
Jun 01, 2018 3:56:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:56:19.582Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
Jun 01, 2018 3:56:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:56:19.738Z: Executing operation Create123/Read(CreateSource)+OutputSideInputs+PAssert$33/GroupGlobally/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write
Jun 01, 2018 3:56:24 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:56:24.315Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Close
Jun 01, 2018 3:56:24 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:56:24.391Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$33/GroupGlobally/RewindowActuals/Window.Assign+PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
Jun 01, 2018 3:56:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:56:31.177Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Close
Jun 01, 2018 3:56:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:56:31.248Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Read+PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$33/GroupGlobally/Values/Values/Map+PAssert$33/GroupGlobally/ParDo(Concat)+PAssert$33/GetPane/Map+PAssert$33/RunChecks+PAssert$33/VerifyAssertions/ParDo(DefaultConclude)
Jun 01, 2018 3:56:39 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:56:38.664Z: Cleaning up.
Jun 01, 2018 3:56:39 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:56:38.791Z: Stopping worker pool...
Jun 01, 2018 3:58:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:58:36.560Z: Autoscaling: Resized worker pool from 1 to 0.
Jun 01, 2018 3:58:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:58:36.593Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
Jun 01, 2018 3:58:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T03:58:36.634Z: Worker pool stopped.
Jun 01, 2018 3:58:45 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-05-31_20_54_34-12575141298163203447 finished with status DONE.
Jun 01, 2018 3:58:45 AM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-05-31_20_54_34-12575141298163203447. Found 1 success, 0 failures out of 1 expected assertions.
Gradle Test Executor 35 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest FAILED
209 tests completed, 34 failed, 2 skipped
Finished generating test XML results (0.509 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerTest>
Generating HTML test report...
Finished generating test html results (0.361 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest>
:beam-runners-google-cloud-dataflow-java:validatesRunnerTest (Thread[Task worker for ':' Thread 7,5,main]) completed. Took 2 hrs 18 mins 15.533 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:validatesRunnerTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 19m 6s
38 actionable tasks: 34 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/dglb6qddb5qzy
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user katarzyna.kucharczyk@polidea.com
Not sending mail to unregistered user robbe.sneyders@ml6.eu
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user schroederc@google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user sidhom@google.com
Not sending mail to unregistered user cademarkegard@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ammons@google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user kedin@google.com
Build failed in Jenkins:
beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #391
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/391/display/redirect?page=changes>
Changes:
[Pablo] clean generated files prior to lint
------------------------------------------
[...truncated 18.14 MB...]
Jun 01, 2018 1:35:30 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map as step s17
Jun 01, 2018 1:35:30 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RewindowActuals/Window.Assign as step s18
Jun 01, 2018 1:35:30 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map as step s19
Jun 01, 2018 1:35:30 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveActualsTriggering/Flatten.PCollections as step s20
Jun 01, 2018 1:35:30 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Create.Values/Read(CreateSource) as step s21
Jun 01, 2018 1:35:30 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign as step s22
Jun 01, 2018 1:35:30 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveDummyTriggering/Flatten.PCollections as step s23
Jun 01, 2018 1:35:30 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/FlattenDummyAndContents as step s24
Jun 01, 2018 1:35:30 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/NeverTrigger/Flatten.PCollections as step s25
Jun 01, 2018 1:35:30 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GroupDummyAndContents as step s26
Jun 01, 2018 1:35:30 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Values/Values/Map as step s27
Jun 01, 2018 1:35:30 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/ParDo(Concat) as step s28
Jun 01, 2018 1:35:30 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GetPane/Map as step s29
Jun 01, 2018 1:35:30 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/RunChecks as step s30
Jun 01, 2018 1:35:30 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/VerifyAssertions/ParDo(DefaultConclude) as step s31
Jun 01, 2018 1:35:30 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0601013523-66353730/output/results/staging/
Jun 01, 2018 1:35:30 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <71120 bytes, hash SnP71h8kBSh_iSqVgbqgIA> to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0601013523-66353730/output/results/staging/pipeline-SnP71h8kBSh_iSqVgbqgIA.pb
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
Jun 01, 2018 1:35:31 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-05-31_18_35_30-5508884847801583730?project=apache-beam-testing
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Submitted job: 2018-05-31_18_35_30-5508884847801583730
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
Jun 01, 2018 1:35:31 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-05-31_18_35_30-5508884847801583730
Jun 01, 2018 1:35:31 AM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-05-31_18_35_30-5508884847801583730 with 1 expected assertions.
Jun 01, 2018 1:35:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:35:30.745Z: Autoscaling is enabled for job 2018-05-31_18_35_30-5508884847801583730. The number of workers will be between 1 and 1000.
Jun 01, 2018 1:35:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:35:30.798Z: Autoscaling was automatically enabled for job 2018-05-31_18_35_30-5508884847801583730.
Jun 01, 2018 1:35:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:35:33.718Z: Checking required Cloud APIs are enabled.
Jun 01, 2018 1:35:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:35:33.884Z: Checking permissions granted to controller Service Account.
Jun 01, 2018 1:35:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:35:39.949Z: Worker configuration: n1-standard-1 in us-central1-b.
Jun 01, 2018 1:35:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:35:40.442Z: Expanding CoGroupByKey operations into optimizable parts.
Jun 01, 2018 1:35:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:35:40.623Z: Expanding GroupByKey operations into optimizable parts.
Jun 01, 2018 1:35:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:35:40.665Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
Jun 01, 2018 1:35:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:35:40.901Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
Jun 01, 2018 1:35:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:35:40.948Z: Elided trivial flatten
Jun 01, 2018 1:35:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:35:40.991Z: Elided trivial flatten
Jun 01, 2018 1:35:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:35:41.039Z: Elided trivial flatten
Jun 01, 2018 1:35:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:35:41.082Z: Unzipping flatten s24 for input s19.org.apache.beam.sdk.values.PCollection.<init>:329#8fd0f908e3ea90e3
Jun 01, 2018 1:35:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:35:41.127Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Reify, through flatten PAssert$33/GroupGlobally/FlattenDummyAndContents, into producer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map
Jun 01, 2018 1:35:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:35:41.175Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow into PAssert$33/GroupGlobally/GroupDummyAndContents/Read
Jun 01, 2018 1:35:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:35:41.207Z: Fusing consumer PAssert$33/GroupGlobally/ParDo(Concat) into PAssert$33/GroupGlobally/Values/Values/Map
Jun 01, 2018 1:35:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:35:41.251Z: Fusing consumer PAssert$33/GetPane/Map into PAssert$33/GroupGlobally/ParDo(Concat)
Jun 01, 2018 1:35:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:35:41.299Z: Fusing consumer PAssert$33/GroupGlobally/Values/Values/Map into PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow
Jun 01, 2018 1:35:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:35:41.343Z: Fusing consumer PAssert$33/RunChecks into PAssert$33/GetPane/Map
Jun 01, 2018 1:35:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:35:41.393Z: Fusing consumer PAssert$33/VerifyAssertions/ParDo(DefaultConclude) into PAssert$33/RunChecks
Jun 01, 2018 1:35:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:35:41.429Z: Unzipping flatten s24-u45 for input s26-reify-value18-c43
Jun 01, 2018 1:35:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:35:41.465Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Write, through flatten s24-u45, into producer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
Jun 01, 2018 1:35:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:35:41.505Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify into PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
Jun 01, 2018 1:35:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:35:41.542Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Write into PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
Jun 01, 2018 1:35:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:35:41.576Z: Fusing consumer PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)
Jun 01, 2018 1:35:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:35:41.610Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
Jun 01, 2018 1:35:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:35:41.632Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
Jun 01, 2018 1:35:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:35:41.667Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into PAssert$33/GroupGlobally/Window.Into()/Window.Assign
Jun 01, 2018 1:35:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:35:41.704Z: Fusing consumer OutputSideInputs into Create123/Read(CreateSource)
Jun 01, 2018 1:35:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:35:41.738Z: Fusing consumer PAssert$33/GroupGlobally/Window.Into()/Window.Assign into OutputSideInputs
Jun 01, 2018 1:35:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:35:41.780Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
Jun 01, 2018 1:35:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:35:41.816Z: Fusing consumer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map into PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
Jun 01, 2018 1:35:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:35:41.844Z: Fusing consumer PAssert$33/GroupGlobally/RewindowActuals/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map
Jun 01, 2018 1:35:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:35:41.868Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read
Jun 01, 2018 1:35:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:35:41.902Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
Jun 01, 2018 1:35:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:35:41.937Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
Jun 01, 2018 1:35:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:35:41.981Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
Jun 01, 2018 1:35:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:35:42.023Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
Jun 01, 2018 1:35:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:35:42.068Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
Jun 01, 2018 1:35:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:35:42.113Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into Create47/Read(CreateSource)
Jun 01, 2018 1:35:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:35:42.154Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
Jun 01, 2018 1:35:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:35:42.188Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
Jun 01, 2018 1:35:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:35:42.230Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
Jun 01, 2018 1:35:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:35:42.278Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
Jun 01, 2018 1:35:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:35:42.323Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
Jun 01, 2018 1:35:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:35:42.368Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
Jun 01, 2018 1:35:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:35:42.801Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Create
Jun 01, 2018 1:35:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:35:42.843Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Create
Jun 01, 2018 1:35:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:35:42.909Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
Jun 01, 2018 1:35:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:35:42.946Z: Starting 1 workers in us-central1-b...
Jun 01, 2018 1:35:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:35:42.958Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
Jun 01, 2018 1:35:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:35:43.226Z: Executing operation PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
Jun 01, 2018 1:35:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:35:43.274Z: Executing operation Create47/Read(CreateSource)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
Jun 01, 2018 1:35:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:35:51.723Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
Jun 01, 2018 1:36:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:36:02.240Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
Jun 01, 2018 1:36:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:36:02.284Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
Jun 01, 2018 1:36:26 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:36:25.363Z: Workers have started successfully.
Jun 01, 2018 1:36:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:36:49.977Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
Jun 01, 2018 1:36:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:36:50.076Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
Jun 01, 2018 1:37:00 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:37:00.003Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
Jun 01, 2018 1:37:00 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:37:00.095Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
Jun 01, 2018 1:37:12 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:37:11.961Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
Jun 01, 2018 1:37:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:37:12.148Z: Executing operation Create123/Read(CreateSource)+OutputSideInputs+PAssert$33/GroupGlobally/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write
Jun 01, 2018 1:37:20 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:37:19.926Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Close
Jun 01, 2018 1:37:20 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:37:20.012Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$33/GroupGlobally/RewindowActuals/Window.Assign+PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
Jun 01, 2018 1:37:23 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:37:22.641Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Close
Jun 01, 2018 1:37:23 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:37:22.729Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Read+PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$33/GroupGlobally/Values/Values/Map+PAssert$33/GroupGlobally/ParDo(Concat)+PAssert$33/GetPane/Map+PAssert$33/RunChecks+PAssert$33/VerifyAssertions/ParDo(DefaultConclude)
Jun 01, 2018 1:37:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:37:27.819Z: Cleaning up.
Jun 01, 2018 1:37:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:37:27.940Z: Stopping worker pool...
Jun 01, 2018 1:39:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:39:16.206Z: Autoscaling: Resized worker pool from 1 to 0.
Jun 01, 2018 1:39:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-06-01T01:39:16.252Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
Jun 01, 2018 1:39:24 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-05-31_18_35_30-5508884847801583730 finished with status DONE.
Jun 01, 2018 1:39:25 AM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-05-31_18_35_30-5508884847801583730. Found 1 success, 0 failures out of 1 expected assertions.
Gradle Test Executor 37 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest FAILED
209 tests completed, 34 failed, 2 skipped
Finished generating test XML results (0.405 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerTest>
Generating HTML test report...
Finished generating test html results (0.376 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest>
:beam-runners-google-cloud-dataflow-java:validatesRunnerTest (Thread[Task worker for ':' Thread 15,5,main]) completed. Took 2 hrs 22 mins 36.523 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:validatesRunnerTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 23m 31s
38 actionable tasks: 34 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/zp5luhwb5jwkk
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user katarzyna.kucharczyk@polidea.com
Not sending mail to unregistered user robbe.sneyders@ml6.eu
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user schroederc@google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user sidhom@google.com
Not sending mail to unregistered user cademarkegard@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ammons@google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user kedin@google.com
Build failed in Jenkins:
beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #390
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/390/display/redirect?page=changes>
Changes:
[kedin] [SQL] Fix PubsubsJsonIT
------------------------------------------
[...truncated 18.15 MB...]
May 31, 2018 11:11:52 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RewindowActuals/Window.Assign as step s18
May 31, 2018 11:11:52 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map as step s19
May 31, 2018 11:11:52 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveActualsTriggering/Flatten.PCollections as step s20
May 31, 2018 11:11:52 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Create.Values/Read(CreateSource) as step s21
May 31, 2018 11:11:52 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign as step s22
May 31, 2018 11:11:52 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveDummyTriggering/Flatten.PCollections as step s23
May 31, 2018 11:11:52 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/FlattenDummyAndContents as step s24
May 31, 2018 11:11:52 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/NeverTrigger/Flatten.PCollections as step s25
May 31, 2018 11:11:52 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GroupDummyAndContents as step s26
May 31, 2018 11:11:52 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Values/Values/Map as step s27
May 31, 2018 11:11:52 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/ParDo(Concat) as step s28
May 31, 2018 11:11:52 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GetPane/Map as step s29
May 31, 2018 11:11:52 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/RunChecks as step s30
May 31, 2018 11:11:52 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/VerifyAssertions/ParDo(DefaultConclude) as step s31
May 31, 2018 11:11:52 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0531231148-b98d9aef/output/results/staging/
May 31, 2018 11:11:52 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <71120 bytes, hash b0YayfVxt1YtO4aF2pH0Mg> to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0531231148-b98d9aef/output/results/staging/pipeline-b0YayfVxt1YtO4aF2pH0Mg.pb
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 31, 2018 11:11:54 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-05-31_16_11_53-17521423508217518915?project=apache-beam-testing
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Submitted job: 2018-05-31_16_11_53-17521423508217518915
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 31, 2018 11:11:54 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-05-31_16_11_53-17521423508217518915
May 31, 2018 11:11:54 PM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-05-31_16_11_53-17521423508217518915 with 1 expected assertions.
May 31, 2018 11:12:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:11:53.105Z: Autoscaling is enabled for job 2018-05-31_16_11_53-17521423508217518915. The number of workers will be between 1 and 1000.
May 31, 2018 11:12:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:11:53.165Z: Autoscaling was automatically enabled for job 2018-05-31_16_11_53-17521423508217518915.
May 31, 2018 11:12:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:11:56.257Z: Checking required Cloud APIs are enabled.
May 31, 2018 11:12:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:11:56.623Z: Checking permissions granted to controller Service Account.
May 31, 2018 11:12:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:12:03.761Z: Worker configuration: n1-standard-1 in us-central1-b.
May 31, 2018 11:12:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:12:04.161Z: Expanding CoGroupByKey operations into optimizable parts.
May 31, 2018 11:12:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:12:04.341Z: Expanding GroupByKey operations into optimizable parts.
May 31, 2018 11:12:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:12:04.398Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
May 31, 2018 11:12:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:12:04.672Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
May 31, 2018 11:12:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:12:04.721Z: Elided trivial flatten
May 31, 2018 11:12:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:12:04.771Z: Elided trivial flatten
May 31, 2018 11:12:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:12:04.825Z: Elided trivial flatten
May 31, 2018 11:12:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:12:04.880Z: Unzipping flatten s24 for input s19.org.apache.beam.sdk.values.PCollection.<init>:329#8fd0f908e3ea90e3
May 31, 2018 11:12:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:12:04.934Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Reify, through flatten PAssert$33/GroupGlobally/FlattenDummyAndContents, into producer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map
May 31, 2018 11:12:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:12:04.982Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow into PAssert$33/GroupGlobally/GroupDummyAndContents/Read
May 31, 2018 11:12:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:12:05.022Z: Fusing consumer PAssert$33/GroupGlobally/ParDo(Concat) into PAssert$33/GroupGlobally/Values/Values/Map
May 31, 2018 11:12:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:12:05.072Z: Fusing consumer PAssert$33/GetPane/Map into PAssert$33/GroupGlobally/ParDo(Concat)
May 31, 2018 11:12:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:12:05.132Z: Fusing consumer PAssert$33/GroupGlobally/Values/Values/Map into PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow
May 31, 2018 11:12:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:12:05.172Z: Fusing consumer PAssert$33/RunChecks into PAssert$33/GetPane/Map
May 31, 2018 11:12:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:12:05.223Z: Fusing consumer PAssert$33/VerifyAssertions/ParDo(DefaultConclude) into PAssert$33/RunChecks
May 31, 2018 11:12:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:12:05.274Z: Unzipping flatten s24-u45 for input s26-reify-value18-c43
May 31, 2018 11:12:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:12:05.334Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Write, through flatten s24-u45, into producer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 31, 2018 11:12:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:12:05.388Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify into PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
May 31, 2018 11:12:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:12:05.438Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Write into PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 31, 2018 11:12:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:12:05.487Z: Fusing consumer PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)
May 31, 2018 11:12:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:12:05.544Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
May 31, 2018 11:12:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:12:05.590Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
May 31, 2018 11:12:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:12:05.633Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into PAssert$33/GroupGlobally/Window.Into()/Window.Assign
May 31, 2018 11:12:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:12:05.687Z: Fusing consumer OutputSideInputs into Create123/Read(CreateSource)
May 31, 2018 11:12:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:12:05.734Z: Fusing consumer PAssert$33/GroupGlobally/Window.Into()/Window.Assign into OutputSideInputs
May 31, 2018 11:12:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:12:05.779Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
May 31, 2018 11:12:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:12:05.825Z: Fusing consumer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map into PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
May 31, 2018 11:12:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:12:05.876Z: Fusing consumer PAssert$33/GroupGlobally/RewindowActuals/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map
May 31, 2018 11:12:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:12:05.929Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read
May 31, 2018 11:12:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:12:05.985Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
May 31, 2018 11:12:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:12:06.022Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
May 31, 2018 11:12:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:12:06.072Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
May 31, 2018 11:12:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:12:06.114Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
May 31, 2018 11:12:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:12:06.158Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
May 31, 2018 11:12:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:12:06.213Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into Create47/Read(CreateSource)
May 31, 2018 11:12:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:12:06.255Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
May 31, 2018 11:12:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:12:06.304Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
May 31, 2018 11:12:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:12:06.339Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
May 31, 2018 11:12:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:12:06.395Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
May 31, 2018 11:12:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:12:06.445Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
May 31, 2018 11:12:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:12:06.493Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
May 31, 2018 11:12:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:12:06.998Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Create
May 31, 2018 11:12:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:12:07.047Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Create
May 31, 2018 11:12:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:12:07.094Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
May 31, 2018 11:12:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:12:07.105Z: Starting 1 workers in us-central1-b...
May 31, 2018 11:12:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:12:07.137Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
May 31, 2018 11:12:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:12:07.414Z: Executing operation Create47/Read(CreateSource)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
May 31, 2018 11:12:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:12:07.477Z: Executing operation PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 31, 2018 11:12:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:12:16.897Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
May 31, 2018 11:12:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:12:27.424Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
May 31, 2018 11:12:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:12:27.470Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 31, 2018 11:12:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:12:43.714Z: Workers have started successfully.
May 31, 2018 11:13:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:13:12.028Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
May 31, 2018 11:13:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:13:12.101Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
May 31, 2018 11:13:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:13:19.986Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
May 31, 2018 11:13:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:13:20.056Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
May 31, 2018 11:13:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:13:32.768Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
May 31, 2018 11:13:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:13:32.940Z: Executing operation Create123/Read(CreateSource)+OutputSideInputs+PAssert$33/GroupGlobally/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write
May 31, 2018 11:13:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:13:39.599Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Close
May 31, 2018 11:13:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:13:39.701Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$33/GroupGlobally/RewindowActuals/Window.Assign+PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 31, 2018 11:13:46 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:13:44.412Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Close
May 31, 2018 11:13:46 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:13:44.511Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Read+PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$33/GroupGlobally/Values/Values/Map+PAssert$33/GroupGlobally/ParDo(Concat)+PAssert$33/GetPane/Map+PAssert$33/RunChecks+PAssert$33/VerifyAssertions/ParDo(DefaultConclude)
May 31, 2018 11:13:49 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:13:48.574Z: Cleaning up.
May 31, 2018 11:13:49 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:13:48.761Z: Stopping worker pool...
May 31, 2018 11:15:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:15:33.316Z: Autoscaling: Resized worker pool from 1 to 0.
May 31, 2018 11:15:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:15:33.366Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 31, 2018 11:15:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T23:15:33.433Z: Worker pool stopped.
May 31, 2018 11:15:41 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-05-31_16_11_53-17521423508217518915 finished with status DONE.
May 31, 2018 11:15:41 PM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-05-31_16_11_53-17521423508217518915. Found 1 success, 0 failures out of 1 expected assertions.
Gradle Test Executor 28 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest FAILED
209 tests completed, 34 failed, 2 skipped
Finished generating test XML results (0.538 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerTest>
Generating HTML test report...
Finished generating test html results (0.269 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest>
:beam-runners-google-cloud-dataflow-java:validatesRunnerTest (Thread[Task worker for ':' Thread 37,5,main]) completed. Took 2 hrs 21 mins 28.362 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:validatesRunnerTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 22m 26s
38 actionable tasks: 34 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/wgnm2pwuozwaq
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user katarzyna.kucharczyk@polidea.com
Not sending mail to unregistered user robbe.sneyders@ml6.eu
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user schroederc@google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user sidhom@google.com
Not sending mail to unregistered user cademarkegard@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ammons@google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user kedin@google.com
Build failed in Jenkins:
beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #389
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/389/display/redirect?page=changes>
Changes:
[tgroh] Add a test to show Flatten Execution
[coheigea] Avoid fully qualified class names, when there is an existing (static)
------------------------------------------
[...truncated 18.23 MB...]
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey as step s16
May 31, 2018 8:48:39 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map as step s17
May 31, 2018 8:48:39 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RewindowActuals/Window.Assign as step s18
May 31, 2018 8:48:39 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map as step s19
May 31, 2018 8:48:39 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveActualsTriggering/Flatten.PCollections as step s20
May 31, 2018 8:48:39 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Create.Values/Read(CreateSource) as step s21
May 31, 2018 8:48:39 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign as step s22
May 31, 2018 8:48:39 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveDummyTriggering/Flatten.PCollections as step s23
May 31, 2018 8:48:39 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/FlattenDummyAndContents as step s24
May 31, 2018 8:48:39 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/NeverTrigger/Flatten.PCollections as step s25
May 31, 2018 8:48:39 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GroupDummyAndContents as step s26
May 31, 2018 8:48:39 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Values/Values/Map as step s27
May 31, 2018 8:48:39 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/ParDo(Concat) as step s28
May 31, 2018 8:48:39 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GetPane/Map as step s29
May 31, 2018 8:48:39 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/RunChecks as step s30
May 31, 2018 8:48:39 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/VerifyAssertions/ParDo(DefaultConclude) as step s31
May 31, 2018 8:48:39 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0531204836-e5ac48d6/output/results/staging/
May 31, 2018 8:48:40 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <71120 bytes, hash gtCwZ6-VzgnP_WjHV-ApCw> to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0531204836-e5ac48d6/output/results/staging/pipeline-gtCwZ6-VzgnP_WjHV-ApCw.pb
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 31, 2018 8:48:42 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-05-31_13_48_41-7093015371132528767?project=apache-beam-testing
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Submitted job: 2018-05-31_13_48_41-7093015371132528767
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 31, 2018 8:48:42 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-05-31_13_48_41-7093015371132528767
May 31, 2018 8:48:42 PM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-05-31_13_48_41-7093015371132528767 with 1 expected assertions.
May 31, 2018 8:49:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:48:41.251Z: Autoscaling is enabled for job 2018-05-31_13_48_41-7093015371132528767. The number of workers will be between 1 and 1000.
May 31, 2018 8:49:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:48:41.288Z: Autoscaling was automatically enabled for job 2018-05-31_13_48_41-7093015371132528767.
May 31, 2018 8:49:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:48:44.383Z: Checking required Cloud APIs are enabled.
May 31, 2018 8:49:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:48:44.657Z: Checking permissions granted to controller Service Account.
May 31, 2018 8:49:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:48:50.535Z: Worker configuration: n1-standard-1 in us-central1-b.
May 31, 2018 8:49:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:48:51.143Z: Expanding CoGroupByKey operations into optimizable parts.
May 31, 2018 8:49:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:48:51.308Z: Expanding GroupByKey operations into optimizable parts.
May 31, 2018 8:49:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:48:51.346Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
May 31, 2018 8:49:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:48:51.560Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
May 31, 2018 8:49:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:48:51.597Z: Elided trivial flatten
May 31, 2018 8:49:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:48:51.635Z: Elided trivial flatten
May 31, 2018 8:49:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:48:51.661Z: Elided trivial flatten
May 31, 2018 8:49:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:48:51.705Z: Unzipping flatten s24 for input s19.org.apache.beam.sdk.values.PCollection.<init>:329#8fd0f908e3ea90e3
May 31, 2018 8:49:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:48:51.747Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Reify, through flatten PAssert$33/GroupGlobally/FlattenDummyAndContents, into producer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map
May 31, 2018 8:49:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:48:51.776Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow into PAssert$33/GroupGlobally/GroupDummyAndContents/Read
May 31, 2018 8:49:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:48:51.815Z: Fusing consumer PAssert$33/GroupGlobally/ParDo(Concat) into PAssert$33/GroupGlobally/Values/Values/Map
May 31, 2018 8:49:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:48:51.865Z: Fusing consumer PAssert$33/GetPane/Map into PAssert$33/GroupGlobally/ParDo(Concat)
May 31, 2018 8:49:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:48:51.916Z: Fusing consumer PAssert$33/GroupGlobally/Values/Values/Map into PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow
May 31, 2018 8:49:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:48:51.966Z: Fusing consumer PAssert$33/RunChecks into PAssert$33/GetPane/Map
May 31, 2018 8:49:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:48:52.011Z: Fusing consumer PAssert$33/VerifyAssertions/ParDo(DefaultConclude) into PAssert$33/RunChecks
May 31, 2018 8:49:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:48:52.052Z: Unzipping flatten s24-u45 for input s26-reify-value18-c43
May 31, 2018 8:49:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:48:52.083Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Write, through flatten s24-u45, into producer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 31, 2018 8:49:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:48:52.118Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify into PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
May 31, 2018 8:49:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:48:52.155Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Write into PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 31, 2018 8:49:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:48:52.196Z: Fusing consumer PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)
May 31, 2018 8:49:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:48:52.231Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
May 31, 2018 8:49:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:48:52.264Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
May 31, 2018 8:49:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:48:52.313Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into PAssert$33/GroupGlobally/Window.Into()/Window.Assign
May 31, 2018 8:49:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:48:52.346Z: Fusing consumer OutputSideInputs into Create123/Read(CreateSource)
May 31, 2018 8:49:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:48:52.395Z: Fusing consumer PAssert$33/GroupGlobally/Window.Into()/Window.Assign into OutputSideInputs
May 31, 2018 8:49:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:48:52.432Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
May 31, 2018 8:49:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:48:52.474Z: Fusing consumer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map into PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
May 31, 2018 8:49:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:48:52.509Z: Fusing consumer PAssert$33/GroupGlobally/RewindowActuals/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map
May 31, 2018 8:49:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:48:52.569Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read
May 31, 2018 8:49:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:48:52.596Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
May 31, 2018 8:49:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:48:52.623Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
May 31, 2018 8:49:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:48:52.661Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
May 31, 2018 8:49:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:48:52.698Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
May 31, 2018 8:49:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:48:52.750Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
May 31, 2018 8:49:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:48:52.788Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into Create47/Read(CreateSource)
May 31, 2018 8:49:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:48:52.829Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
May 31, 2018 8:49:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:48:52.875Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
May 31, 2018 8:49:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:48:52.918Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
May 31, 2018 8:49:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:48:52.955Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
May 31, 2018 8:49:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:48:52.991Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
May 31, 2018 8:49:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:48:53.019Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
May 31, 2018 8:49:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:48:53.437Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Create
May 31, 2018 8:49:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:48:53.477Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Create
May 31, 2018 8:49:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:48:53.528Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
May 31, 2018 8:49:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:48:53.538Z: Starting 1 workers in us-central1-b...
May 31, 2018 8:49:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:48:53.582Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
May 31, 2018 8:49:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:48:53.857Z: Executing operation PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 31, 2018 8:49:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:48:53.914Z: Executing operation Create47/Read(CreateSource)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
May 31, 2018 8:49:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:49:03.562Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
May 31, 2018 8:49:15 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:49:14.373Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
May 31, 2018 8:49:15 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:49:14.431Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 31, 2018 8:49:43 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:49:41.515Z: Workers have started successfully.
May 31, 2018 8:50:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:50:06.525Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
May 31, 2018 8:50:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:50:06.684Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
May 31, 2018 8:50:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:50:12.079Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
May 31, 2018 8:50:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:50:12.155Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
May 31, 2018 8:50:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:50:24.577Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
May 31, 2018 8:50:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:50:24.808Z: Executing operation Create123/Read(CreateSource)+OutputSideInputs+PAssert$33/GroupGlobally/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write
May 31, 2018 8:50:32 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:50:32.538Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Close
May 31, 2018 8:50:32 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:50:32.663Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$33/GroupGlobally/RewindowActuals/Window.Assign+PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 31, 2018 8:50:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:50:37.596Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Close
May 31, 2018 8:50:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:50:37.735Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Read+PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$33/GroupGlobally/Values/Values/Map+PAssert$33/GroupGlobally/ParDo(Concat)+PAssert$33/GetPane/Map+PAssert$33/RunChecks+PAssert$33/VerifyAssertions/ParDo(DefaultConclude)
May 31, 2018 8:50:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:50:41.824Z: Cleaning up.
May 31, 2018 8:50:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:50:41.974Z: Stopping worker pool...
May 31, 2018 8:52:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:52:52.438Z: Autoscaling: Resized worker pool from 1 to 0.
May 31, 2018 8:52:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T20:52:52.482Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 31, 2018 8:53:00 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-05-31_13_48_41-7093015371132528767 finished with status DONE.
May 31, 2018 8:53:00 PM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-05-31_13_48_41-7093015371132528767. Found 1 success, 0 failures out of 1 expected assertions.
Gradle Test Executor 39 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest FAILED
209 tests completed, 34 failed, 2 skipped
Finished generating test XML results (0.535 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerTest>
Generating HTML test report...
Finished generating test html results (0.447 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest>
:beam-runners-google-cloud-dataflow-java:validatesRunnerTest (Thread[Task worker for ':' Thread 46,5,main]) completed. Took 2 hrs 24 mins 5.316 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:validatesRunnerTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 24m 58s
38 actionable tasks: 34 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/waikbocozksfm
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user katarzyna.kucharczyk@polidea.com
Not sending mail to unregistered user robbe.sneyders@ml6.eu
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user schroederc@google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user sidhom@google.com
Not sending mail to unregistered user cademarkegard@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ammons@google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Build failed in Jenkins:
beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #388
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/388/display/redirect?page=changes>
Changes:
[apilloud] Run test on shadowJar on a flag
[apilloud] [SQL] Build mega jar for JDBC
[apilloud] [SQL] JDBC Class Loader IT
------------------------------------------
[...truncated 18.20 MB...]
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey as step s16
May 31, 2018 6:23:47 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map as step s17
May 31, 2018 6:23:47 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RewindowActuals/Window.Assign as step s18
May 31, 2018 6:23:47 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map as step s19
May 31, 2018 6:23:47 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveActualsTriggering/Flatten.PCollections as step s20
May 31, 2018 6:23:47 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Create.Values/Read(CreateSource) as step s21
May 31, 2018 6:23:47 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign as step s22
May 31, 2018 6:23:47 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveDummyTriggering/Flatten.PCollections as step s23
May 31, 2018 6:23:47 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/FlattenDummyAndContents as step s24
May 31, 2018 6:23:47 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/NeverTrigger/Flatten.PCollections as step s25
May 31, 2018 6:23:47 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GroupDummyAndContents as step s26
May 31, 2018 6:23:47 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Values/Values/Map as step s27
May 31, 2018 6:23:47 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/ParDo(Concat) as step s28
May 31, 2018 6:23:47 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GetPane/Map as step s29
May 31, 2018 6:23:47 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/RunChecks as step s30
May 31, 2018 6:23:47 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/VerifyAssertions/ParDo(DefaultConclude) as step s31
May 31, 2018 6:23:47 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0531182344-49ebd836/output/results/staging/
May 31, 2018 6:23:47 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <71120 bytes, hash dv-AOICw_j8KuoCA3EikDQ> to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0531182344-49ebd836/output/results/staging/pipeline-dv-AOICw_j8KuoCA3EikDQ.pb
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 31, 2018 6:23:49 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-05-31_11_23_48-8467665149338201439?project=apache-beam-testing
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Submitted job: 2018-05-31_11_23_48-8467665149338201439
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 31, 2018 6:23:49 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-05-31_11_23_48-8467665149338201439
May 31, 2018 6:23:49 PM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-05-31_11_23_48-8467665149338201439 with 1 expected assertions.
May 31, 2018 6:24:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:23:48.554Z: Autoscaling is enabled for job 2018-05-31_11_23_48-8467665149338201439. The number of workers will be between 1 and 1000.
May 31, 2018 6:24:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:23:48.592Z: Autoscaling was automatically enabled for job 2018-05-31_11_23_48-8467665149338201439.
May 31, 2018 6:24:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:23:51.513Z: Checking required Cloud APIs are enabled.
May 31, 2018 6:24:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:23:51.721Z: Checking permissions granted to controller Service Account.
May 31, 2018 6:24:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:23:56.655Z: Worker configuration: n1-standard-1 in us-central1-b.
May 31, 2018 6:24:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:23:57.192Z: Expanding CoGroupByKey operations into optimizable parts.
May 31, 2018 6:24:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:23:57.417Z: Expanding GroupByKey operations into optimizable parts.
May 31, 2018 6:24:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:23:57.458Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
May 31, 2018 6:24:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:23:57.732Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
May 31, 2018 6:24:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:23:57.782Z: Elided trivial flatten
May 31, 2018 6:24:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:23:57.824Z: Elided trivial flatten
May 31, 2018 6:24:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:23:57.871Z: Elided trivial flatten
May 31, 2018 6:24:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:23:57.920Z: Unzipping flatten s24 for input s19.org.apache.beam.sdk.values.PCollection.<init>:329#8fd0f908e3ea90e3
May 31, 2018 6:24:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:23:57.976Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Reify, through flatten PAssert$33/GroupGlobally/FlattenDummyAndContents, into producer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map
May 31, 2018 6:24:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:23:58.027Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow into PAssert$33/GroupGlobally/GroupDummyAndContents/Read
May 31, 2018 6:24:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:23:58.076Z: Fusing consumer PAssert$33/GroupGlobally/ParDo(Concat) into PAssert$33/GroupGlobally/Values/Values/Map
May 31, 2018 6:24:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:23:58.116Z: Fusing consumer PAssert$33/GetPane/Map into PAssert$33/GroupGlobally/ParDo(Concat)
May 31, 2018 6:24:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:23:58.158Z: Fusing consumer PAssert$33/GroupGlobally/Values/Values/Map into PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow
May 31, 2018 6:24:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:23:58.214Z: Fusing consumer PAssert$33/RunChecks into PAssert$33/GetPane/Map
May 31, 2018 6:24:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:23:58.262Z: Fusing consumer PAssert$33/VerifyAssertions/ParDo(DefaultConclude) into PAssert$33/RunChecks
May 31, 2018 6:24:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:23:58.318Z: Unzipping flatten s24-u45 for input s26-reify-value18-c43
May 31, 2018 6:24:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:23:58.373Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Write, through flatten s24-u45, into producer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 31, 2018 6:24:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:23:58.420Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify into PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
May 31, 2018 6:24:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:23:58.474Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Write into PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 31, 2018 6:24:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:23:58.525Z: Fusing consumer PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)
May 31, 2018 6:24:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:23:58.573Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
May 31, 2018 6:24:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:23:58.630Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
May 31, 2018 6:24:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:23:58.676Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into PAssert$33/GroupGlobally/Window.Into()/Window.Assign
May 31, 2018 6:24:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:23:58.716Z: Fusing consumer OutputSideInputs into Create123/Read(CreateSource)
May 31, 2018 6:24:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:23:58.765Z: Fusing consumer PAssert$33/GroupGlobally/Window.Into()/Window.Assign into OutputSideInputs
May 31, 2018 6:24:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:23:58.817Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
May 31, 2018 6:24:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:23:58.866Z: Fusing consumer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map into PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
May 31, 2018 6:24:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:23:58.911Z: Fusing consumer PAssert$33/GroupGlobally/RewindowActuals/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map
May 31, 2018 6:24:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:23:58.954Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read
May 31, 2018 6:24:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:23:59.004Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
May 31, 2018 6:24:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:23:59.053Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
May 31, 2018 6:24:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:23:59.098Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
May 31, 2018 6:24:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:23:59.143Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
May 31, 2018 6:24:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:23:59.181Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
May 31, 2018 6:24:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:23:59.224Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into Create47/Read(CreateSource)
May 31, 2018 6:24:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:23:59.271Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
May 31, 2018 6:24:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:23:59.324Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
May 31, 2018 6:24:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:23:59.374Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
May 31, 2018 6:24:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:23:59.421Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
May 31, 2018 6:24:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:23:59.454Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
May 31, 2018 6:24:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:23:59.500Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
May 31, 2018 6:24:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:24:00.028Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Create
May 31, 2018 6:24:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:24:00.071Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Create
May 31, 2018 6:24:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:24:00.106Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
May 31, 2018 6:24:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:24:00.142Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
May 31, 2018 6:24:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:24:00.142Z: Starting 1 workers in us-central1-b...
May 31, 2018 6:24:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:24:00.380Z: Executing operation PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 31, 2018 6:24:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:24:00.410Z: Executing operation Create47/Read(CreateSource)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
May 31, 2018 6:24:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:24:09.935Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
May 31, 2018 6:24:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:24:20.547Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
May 31, 2018 6:24:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:24:20.605Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 31, 2018 6:24:46 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:24:46.182Z: Workers have started successfully.
May 31, 2018 6:25:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:25:09.460Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
May 31, 2018 6:25:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:25:09.596Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
May 31, 2018 6:25:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:25:18.408Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
May 31, 2018 6:25:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:25:18.511Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
May 31, 2018 6:25:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:25:31.519Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
May 31, 2018 6:25:33 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:25:31.732Z: Executing operation Create123/Read(CreateSource)+OutputSideInputs+PAssert$33/GroupGlobally/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write
May 31, 2018 6:25:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:25:37.243Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Close
May 31, 2018 6:25:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:25:37.326Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$33/GroupGlobally/RewindowActuals/Window.Assign+PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 31, 2018 6:25:43 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:25:40.998Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Close
May 31, 2018 6:25:43 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:25:41.103Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Read+PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$33/GroupGlobally/Values/Values/Map+PAssert$33/GroupGlobally/ParDo(Concat)+PAssert$33/GetPane/Map+PAssert$33/RunChecks+PAssert$33/VerifyAssertions/ParDo(DefaultConclude)
May 31, 2018 6:25:46 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:25:44.355Z: Cleaning up.
May 31, 2018 6:25:46 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:25:44.437Z: Stopping worker pool...
May 31, 2018 6:27:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:27:39.133Z: Autoscaling: Resized worker pool from 1 to 0.
May 31, 2018 6:27:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T18:27:39.170Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 31, 2018 6:27:46 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-05-31_11_23_48-8467665149338201439 finished with status DONE.
May 31, 2018 6:27:47 PM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-05-31_11_23_48-8467665149338201439. Found 1 success, 0 failures out of 1 expected assertions.
Gradle Test Executor 44 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest FAILED
209 tests completed, 34 failed, 2 skipped
Finished generating test XML results (0.369 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerTest>
Generating HTML test report...
Finished generating test html results (0.583 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest>
:beam-runners-google-cloud-dataflow-java:validatesRunnerTest (Thread[Task worker for ':' Thread 11,5,main]) completed. Took 2 hrs 19 mins 53.752 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:validatesRunnerTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 20m 53s
38 actionable tasks: 36 executed, 2 from cache
Publishing build scan...
https://gradle.com/s/2dnkcylzzu5bq
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user katarzyna.kucharczyk@polidea.com
Not sending mail to unregistered user robbe.sneyders@ml6.eu
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user schroederc@google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user sidhom@google.com
Not sending mail to unregistered user cademarkegard@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ammons@google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Build failed in Jenkins:
beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #387
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/387/display/redirect>
------------------------------------------
[...truncated 19.07 MB...]
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map as step s17
May 31, 2018 2:16:17 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RewindowActuals/Window.Assign as step s18
May 31, 2018 2:16:17 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map as step s19
May 31, 2018 2:16:17 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveActualsTriggering/Flatten.PCollections as step s20
May 31, 2018 2:16:17 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Create.Values/Read(CreateSource) as step s21
May 31, 2018 2:16:17 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign as step s22
May 31, 2018 2:16:17 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveDummyTriggering/Flatten.PCollections as step s23
May 31, 2018 2:16:17 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/FlattenDummyAndContents as step s24
May 31, 2018 2:16:17 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/NeverTrigger/Flatten.PCollections as step s25
May 31, 2018 2:16:17 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GroupDummyAndContents as step s26
May 31, 2018 2:16:17 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Values/Values/Map as step s27
May 31, 2018 2:16:17 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/ParDo(Concat) as step s28
May 31, 2018 2:16:17 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GetPane/Map as step s29
May 31, 2018 2:16:17 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/RunChecks as step s30
May 31, 2018 2:16:17 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/VerifyAssertions/ParDo(DefaultConclude) as step s31
May 31, 2018 2:16:17 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0531141607-c836e876/output/results/staging/
May 31, 2018 2:16:17 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <71120 bytes, hash RIBc-8xQ5bvXNy7D_iRjlg> to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0531141607-c836e876/output/results/staging/pipeline-RIBc-8xQ5bvXNy7D_iRjlg.pb
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 31, 2018 2:16:19 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-05-31_07_16_18-6991294240509845280?project=apache-beam-testing
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Submitted job: 2018-05-31_07_16_18-6991294240509845280
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 31, 2018 2:16:19 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-05-31_07_16_18-6991294240509845280
May 31, 2018 2:16:19 PM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-05-31_07_16_18-6991294240509845280 with 1 expected assertions.
May 31, 2018 2:16:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:16:18.205Z: Autoscaling is enabled for job 2018-05-31_07_16_18-6991294240509845280. The number of workers will be between 1 and 1000.
May 31, 2018 2:16:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:16:18.243Z: Autoscaling was automatically enabled for job 2018-05-31_07_16_18-6991294240509845280.
May 31, 2018 2:16:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:16:21.437Z: Checking required Cloud APIs are enabled.
May 31, 2018 2:16:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:16:21.657Z: Checking permissions granted to controller Service Account.
May 31, 2018 2:16:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:16:28.542Z: Worker configuration: n1-standard-1 in us-central1-b.
May 31, 2018 2:16:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:16:28.996Z: Expanding CoGroupByKey operations into optimizable parts.
May 31, 2018 2:16:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:16:29.164Z: Expanding GroupByKey operations into optimizable parts.
May 31, 2018 2:16:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:16:29.210Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
May 31, 2018 2:16:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:16:29.434Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
May 31, 2018 2:16:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:16:29.478Z: Elided trivial flatten
May 31, 2018 2:16:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:16:29.516Z: Elided trivial flatten
May 31, 2018 2:16:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:16:29.559Z: Elided trivial flatten
May 31, 2018 2:16:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:16:29.603Z: Unzipping flatten s24 for input s19.org.apache.beam.sdk.values.PCollection.<init>:329#8fd0f908e3ea90e3
May 31, 2018 2:16:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:16:29.650Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Reify, through flatten PAssert$33/GroupGlobally/FlattenDummyAndContents, into producer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map
May 31, 2018 2:16:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:16:29.687Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow into PAssert$33/GroupGlobally/GroupDummyAndContents/Read
May 31, 2018 2:16:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:16:29.723Z: Fusing consumer PAssert$33/GroupGlobally/ParDo(Concat) into PAssert$33/GroupGlobally/Values/Values/Map
May 31, 2018 2:16:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:16:29.771Z: Fusing consumer PAssert$33/GetPane/Map into PAssert$33/GroupGlobally/ParDo(Concat)
May 31, 2018 2:16:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:16:29.807Z: Fusing consumer PAssert$33/GroupGlobally/Values/Values/Map into PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow
May 31, 2018 2:16:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:16:29.842Z: Fusing consumer PAssert$33/RunChecks into PAssert$33/GetPane/Map
May 31, 2018 2:16:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:16:29.875Z: Fusing consumer PAssert$33/VerifyAssertions/ParDo(DefaultConclude) into PAssert$33/RunChecks
May 31, 2018 2:16:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:16:29.922Z: Unzipping flatten s24-u45 for input s26-reify-value18-c43
May 31, 2018 2:16:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:16:29.966Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Write, through flatten s24-u45, into producer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 31, 2018 2:16:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:16:30.008Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify into PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
May 31, 2018 2:16:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:16:30.053Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Write into PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 31, 2018 2:16:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:16:30.094Z: Fusing consumer PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)
May 31, 2018 2:16:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:16:30.137Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
May 31, 2018 2:16:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:16:30.181Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
May 31, 2018 2:16:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:16:30.227Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into PAssert$33/GroupGlobally/Window.Into()/Window.Assign
May 31, 2018 2:16:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:16:30.272Z: Fusing consumer OutputSideInputs into Create123/Read(CreateSource)
May 31, 2018 2:16:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:16:30.307Z: Fusing consumer PAssert$33/GroupGlobally/Window.Into()/Window.Assign into OutputSideInputs
May 31, 2018 2:16:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:16:30.345Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
May 31, 2018 2:16:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:16:30.381Z: Fusing consumer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map into PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
May 31, 2018 2:16:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:16:30.427Z: Fusing consumer PAssert$33/GroupGlobally/RewindowActuals/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map
May 31, 2018 2:16:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:16:30.479Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read
May 31, 2018 2:16:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:16:30.525Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
May 31, 2018 2:16:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:16:30.553Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
May 31, 2018 2:16:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:16:30.589Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
May 31, 2018 2:16:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:16:30.627Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
May 31, 2018 2:16:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:16:30.667Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
May 31, 2018 2:16:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:16:30.713Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into Create47/Read(CreateSource)
May 31, 2018 2:16:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:16:30.754Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
May 31, 2018 2:16:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:16:30.794Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
May 31, 2018 2:16:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:16:30.839Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
May 31, 2018 2:16:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:16:30.877Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
May 31, 2018 2:16:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:16:30.919Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
May 31, 2018 2:16:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:16:30.965Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
May 31, 2018 2:16:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:16:31.470Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Create
May 31, 2018 2:16:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:16:31.517Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Create
May 31, 2018 2:16:33 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:16:31.564Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
May 31, 2018 2:16:33 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:16:31.575Z: Starting 1 workers in us-central1-b...
May 31, 2018 2:16:33 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:16:31.614Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
May 31, 2018 2:16:33 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:16:31.858Z: Executing operation PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 31, 2018 2:16:33 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:16:31.908Z: Executing operation Create47/Read(CreateSource)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
May 31, 2018 2:16:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:16:41.526Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
May 31, 2018 2:16:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:16:57.646Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
May 31, 2018 2:16:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:16:57.690Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 31, 2018 2:17:22 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:17:22.378Z: Workers have started successfully.
May 31, 2018 2:17:50 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:17:50.123Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
May 31, 2018 2:17:50 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:17:50.234Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
May 31, 2018 2:17:56 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:17:55.903Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
May 31, 2018 2:17:56 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:17:56.010Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
May 31, 2018 2:18:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:18:08.162Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
May 31, 2018 2:18:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:18:08.364Z: Executing operation Create123/Read(CreateSource)+OutputSideInputs+PAssert$33/GroupGlobally/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write
May 31, 2018 2:18:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:18:13.088Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Close
May 31, 2018 2:18:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:18:13.222Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$33/GroupGlobally/RewindowActuals/Window.Assign+PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 31, 2018 2:18:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:18:17.048Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Close
May 31, 2018 2:18:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:18:17.219Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Read+PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$33/GroupGlobally/Values/Values/Map+PAssert$33/GroupGlobally/ParDo(Concat)+PAssert$33/GetPane/Map+PAssert$33/RunChecks+PAssert$33/VerifyAssertions/ParDo(DefaultConclude)
May 31, 2018 2:18:22 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:18:21.516Z: Cleaning up.
May 31, 2018 2:18:22 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:18:21.628Z: Stopping worker pool...
May 31, 2018 2:20:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:20:13.169Z: Autoscaling: Resized worker pool from 1 to 0.
May 31, 2018 2:20:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T14:20:13.217Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 31, 2018 2:20:21 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-05-31_07_16_18-6991294240509845280 finished with status DONE.
May 31, 2018 2:20:21 PM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-05-31_07_16_18-6991294240509845280. Found 1 success, 0 failures out of 1 expected assertions.
Gradle Test Executor 37 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest
209 tests completed, 35 failed, 2 skipped
Finished generating test XML results (0.88 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerTest>
Generating HTML test report...
Finished generating test html results (0.526 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest>
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest FAILED
:beam-runners-google-cloud-dataflow-java:validatesRunnerTest (Thread[Task worker for ':' Thread 37,5,main]) completed. Took 2 hrs 18 mins 34.949 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:validatesRunnerTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 19m 34s
38 actionable tasks: 34 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/giih4ktockzzq
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user katarzyna.kucharczyk@polidea.com
Not sending mail to unregistered user robbe.sneyders@ml6.eu
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user schroederc@google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user sidhom@google.com
Not sending mail to unregistered user cademarkegard@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ammons@google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Build failed in Jenkins:
beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #386
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/386/display/redirect?page=changes>
Changes:
[iemejia] [BEAM-4323] Enforce ErrorProne analysis in sketching extensions
[iemejia] [BEAM-4356] Enforce ErrorProne analysis in nexmark
------------------------------------------
[...truncated 18.23 MB...]
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey as step s16
May 31, 2018 11:05:13 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map as step s17
May 31, 2018 11:05:13 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RewindowActuals/Window.Assign as step s18
May 31, 2018 11:05:13 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map as step s19
May 31, 2018 11:05:13 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveActualsTriggering/Flatten.PCollections as step s20
May 31, 2018 11:05:13 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Create.Values/Read(CreateSource) as step s21
May 31, 2018 11:05:13 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign as step s22
May 31, 2018 11:05:13 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveDummyTriggering/Flatten.PCollections as step s23
May 31, 2018 11:05:13 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/FlattenDummyAndContents as step s24
May 31, 2018 11:05:13 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/NeverTrigger/Flatten.PCollections as step s25
May 31, 2018 11:05:13 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GroupDummyAndContents as step s26
May 31, 2018 11:05:13 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Values/Values/Map as step s27
May 31, 2018 11:05:13 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/ParDo(Concat) as step s28
May 31, 2018 11:05:13 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GetPane/Map as step s29
May 31, 2018 11:05:13 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/RunChecks as step s30
May 31, 2018 11:05:13 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/VerifyAssertions/ParDo(DefaultConclude) as step s31
May 31, 2018 11:05:13 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0531110509-daf4e307/output/results/staging/
May 31, 2018 11:05:13 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <71120 bytes, hash VCCegX3cP2HMMINVQemE5g> to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0531110509-daf4e307/output/results/staging/pipeline-VCCegX3cP2HMMINVQemE5g.pb
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 31, 2018 11:05:15 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-05-31_04_05_14-10093640796875245231?project=apache-beam-testing
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Submitted job: 2018-05-31_04_05_14-10093640796875245231
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 31, 2018 11:05:15 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-05-31_04_05_14-10093640796875245231
May 31, 2018 11:05:15 AM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-05-31_04_05_14-10093640796875245231 with 1 expected assertions.
May 31, 2018 11:05:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:05:14.145Z: Autoscaling is enabled for job 2018-05-31_04_05_14-10093640796875245231. The number of workers will be between 1 and 1000.
May 31, 2018 11:05:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:05:14.162Z: Autoscaling was automatically enabled for job 2018-05-31_04_05_14-10093640796875245231.
May 31, 2018 11:05:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:05:16.941Z: Checking required Cloud APIs are enabled.
May 31, 2018 11:05:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:05:17.122Z: Checking permissions granted to controller Service Account.
May 31, 2018 11:05:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:05:24.648Z: Worker configuration: n1-standard-1 in us-central1-b.
May 31, 2018 11:05:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:05:25.007Z: Expanding CoGroupByKey operations into optimizable parts.
May 31, 2018 11:05:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:05:25.168Z: Expanding GroupByKey operations into optimizable parts.
May 31, 2018 11:05:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:05:25.223Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
May 31, 2018 11:05:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:05:25.455Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
May 31, 2018 11:05:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:05:25.497Z: Elided trivial flatten
May 31, 2018 11:05:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:05:25.543Z: Elided trivial flatten
May 31, 2018 11:05:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:05:25.580Z: Elided trivial flatten
May 31, 2018 11:05:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:05:25.622Z: Unzipping flatten s24 for input s19.org.apache.beam.sdk.values.PCollection.<init>:329#8fd0f908e3ea90e3
May 31, 2018 11:05:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:05:25.666Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Reify, through flatten PAssert$33/GroupGlobally/FlattenDummyAndContents, into producer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map
May 31, 2018 11:05:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:05:25.711Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow into PAssert$33/GroupGlobally/GroupDummyAndContents/Read
May 31, 2018 11:05:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:05:25.755Z: Fusing consumer PAssert$33/GroupGlobally/ParDo(Concat) into PAssert$33/GroupGlobally/Values/Values/Map
May 31, 2018 11:05:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:05:25.800Z: Fusing consumer PAssert$33/GetPane/Map into PAssert$33/GroupGlobally/ParDo(Concat)
May 31, 2018 11:05:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:05:25.841Z: Fusing consumer PAssert$33/GroupGlobally/Values/Values/Map into PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow
May 31, 2018 11:05:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:05:25.880Z: Fusing consumer PAssert$33/RunChecks into PAssert$33/GetPane/Map
May 31, 2018 11:05:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:05:25.922Z: Fusing consumer PAssert$33/VerifyAssertions/ParDo(DefaultConclude) into PAssert$33/RunChecks
May 31, 2018 11:05:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:05:25.954Z: Unzipping flatten s24-u45 for input s26-reify-value18-c43
May 31, 2018 11:05:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:05:26.003Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Write, through flatten s24-u45, into producer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 31, 2018 11:05:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:05:26.049Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify into PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
May 31, 2018 11:05:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:05:26.091Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Write into PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 31, 2018 11:05:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:05:26.128Z: Fusing consumer PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)
May 31, 2018 11:05:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:05:26.162Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
May 31, 2018 11:05:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:05:26.199Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
May 31, 2018 11:05:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:05:26.242Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into PAssert$33/GroupGlobally/Window.Into()/Window.Assign
May 31, 2018 11:05:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:05:26.284Z: Fusing consumer OutputSideInputs into Create123/Read(CreateSource)
May 31, 2018 11:05:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:05:26.330Z: Fusing consumer PAssert$33/GroupGlobally/Window.Into()/Window.Assign into OutputSideInputs
May 31, 2018 11:05:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:05:26.378Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
May 31, 2018 11:05:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:05:26.408Z: Fusing consumer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map into PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
May 31, 2018 11:05:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:05:26.447Z: Fusing consumer PAssert$33/GroupGlobally/RewindowActuals/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map
May 31, 2018 11:05:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:05:26.490Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read
May 31, 2018 11:05:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:05:26.535Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
May 31, 2018 11:05:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:05:26.582Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
May 31, 2018 11:05:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:05:26.625Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
May 31, 2018 11:05:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:05:26.670Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
May 31, 2018 11:05:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:05:26.718Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
May 31, 2018 11:05:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:05:26.763Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into Create47/Read(CreateSource)
May 31, 2018 11:05:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:05:26.810Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
May 31, 2018 11:05:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:05:26.852Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
May 31, 2018 11:05:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:05:26.892Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
May 31, 2018 11:05:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:05:26.940Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
May 31, 2018 11:05:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:05:26.987Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
May 31, 2018 11:05:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:05:27.034Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
May 31, 2018 11:05:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:05:27.526Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Create
May 31, 2018 11:05:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:05:27.564Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Create
May 31, 2018 11:05:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:05:27.606Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
May 31, 2018 11:05:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:05:27.621Z: Starting 1 workers in us-central1-b...
May 31, 2018 11:05:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:05:27.641Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
May 31, 2018 11:05:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:05:27.917Z: Executing operation Create47/Read(CreateSource)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
May 31, 2018 11:05:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:05:27.963Z: Executing operation PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 31, 2018 11:05:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:05:37.166Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
May 31, 2018 11:05:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:05:47.621Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
May 31, 2018 11:05:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:05:47.662Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 31, 2018 11:06:11 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:06:10.904Z: Workers have started successfully.
May 31, 2018 11:06:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:06:35.919Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
May 31, 2018 11:06:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:06:36.013Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
May 31, 2018 11:06:46 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:06:45.099Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
May 31, 2018 11:06:46 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:06:45.189Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
May 31, 2018 11:06:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:06:58.272Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
May 31, 2018 11:07:01 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:06:58.465Z: Executing operation Create123/Read(CreateSource)+OutputSideInputs+PAssert$33/GroupGlobally/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write
May 31, 2018 11:07:06 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:07:03.969Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Close
May 31, 2018 11:07:06 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:07:04.055Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$33/GroupGlobally/RewindowActuals/Window.Assign+PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 31, 2018 11:07:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:07:08.703Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Close
May 31, 2018 11:07:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:07:08.778Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Read+PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$33/GroupGlobally/Values/Values/Map+PAssert$33/GroupGlobally/ParDo(Concat)+PAssert$33/GetPane/Map+PAssert$33/RunChecks+PAssert$33/VerifyAssertions/ParDo(DefaultConclude)
May 31, 2018 11:07:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:07:11.901Z: Cleaning up.
May 31, 2018 11:07:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:07:12.013Z: Stopping worker pool...
May 31, 2018 11:09:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:09:09.202Z: Autoscaling: Resized worker pool from 1 to 0.
May 31, 2018 11:09:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T11:09:09.231Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 31, 2018 11:09:17 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-05-31_04_05_14-10093640796875245231 finished with status DONE.
May 31, 2018 11:09:17 AM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-05-31_04_05_14-10093640796875245231. Found 1 success, 0 failures out of 1 expected assertions.
Gradle Test Executor 42 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest FAILED
209 tests completed, 34 failed, 2 skipped
Finished generating test XML results (0.576 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerTest>
Generating HTML test report...
Finished generating test html results (0.253 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest>
:beam-runners-google-cloud-dataflow-java:validatesRunnerTest (Thread[Task worker for ':' Thread 35,5,main]) completed. Took 2 hrs 16 mins 0.853 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:validatesRunnerTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 16m 50s
38 actionable tasks: 34 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/nelgqrkb7opve
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user katarzyna.kucharczyk@polidea.com
Not sending mail to unregistered user robbe.sneyders@ml6.eu
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user schroederc@google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user sidhom@google.com
Not sending mail to unregistered user cademarkegard@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ammons@google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Build failed in Jenkins:
beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #385
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/385/display/redirect>
------------------------------------------
[...truncated 18.22 MB...]
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map as step s17
May 31, 2018 8:48:34 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RewindowActuals/Window.Assign as step s18
May 31, 2018 8:48:34 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map as step s19
May 31, 2018 8:48:34 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveActualsTriggering/Flatten.PCollections as step s20
May 31, 2018 8:48:34 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Create.Values/Read(CreateSource) as step s21
May 31, 2018 8:48:34 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign as step s22
May 31, 2018 8:48:34 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveDummyTriggering/Flatten.PCollections as step s23
May 31, 2018 8:48:34 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/FlattenDummyAndContents as step s24
May 31, 2018 8:48:34 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/NeverTrigger/Flatten.PCollections as step s25
May 31, 2018 8:48:34 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GroupDummyAndContents as step s26
May 31, 2018 8:48:34 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Values/Values/Map as step s27
May 31, 2018 8:48:34 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/ParDo(Concat) as step s28
May 31, 2018 8:48:34 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GetPane/Map as step s29
May 31, 2018 8:48:34 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/RunChecks as step s30
May 31, 2018 8:48:34 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/VerifyAssertions/ParDo(DefaultConclude) as step s31
May 31, 2018 8:48:34 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0531084830-486a081/output/results/staging/
May 31, 2018 8:48:35 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <71120 bytes, hash Uy5OfkIByk5KVpTtPk77Lw> to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0531084830-486a081/output/results/staging/pipeline-Uy5OfkIByk5KVpTtPk77Lw.pb
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 31, 2018 8:48:36 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-05-31_01_48_35-1399331152337114576?project=apache-beam-testing
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Submitted job: 2018-05-31_01_48_35-1399331152337114576
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 31, 2018 8:48:36 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-05-31_01_48_35-1399331152337114576
May 31, 2018 8:48:36 AM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-05-31_01_48_35-1399331152337114576 with 1 expected assertions.
May 31, 2018 8:48:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:48:35.517Z: Autoscaling is enabled for job 2018-05-31_01_48_35-1399331152337114576. The number of workers will be between 1 and 1000.
May 31, 2018 8:48:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:48:35.559Z: Autoscaling was automatically enabled for job 2018-05-31_01_48_35-1399331152337114576.
May 31, 2018 8:48:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:48:37.942Z: Checking required Cloud APIs are enabled.
May 31, 2018 8:48:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:48:38.137Z: Checking permissions granted to controller Service Account.
May 31, 2018 8:48:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:48:43.497Z: Worker configuration: n1-standard-1 in us-central1-b.
May 31, 2018 8:48:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:48:43.995Z: Expanding CoGroupByKey operations into optimizable parts.
May 31, 2018 8:48:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:48:44.168Z: Expanding GroupByKey operations into optimizable parts.
May 31, 2018 8:48:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:48:44.216Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
May 31, 2018 8:48:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:48:44.429Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
May 31, 2018 8:48:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:48:44.473Z: Elided trivial flatten
May 31, 2018 8:48:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:48:44.509Z: Elided trivial flatten
May 31, 2018 8:48:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:48:44.544Z: Elided trivial flatten
May 31, 2018 8:48:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:48:44.594Z: Unzipping flatten s24 for input s19.org.apache.beam.sdk.values.PCollection.<init>:329#8fd0f908e3ea90e3
May 31, 2018 8:48:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:48:44.631Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Reify, through flatten PAssert$33/GroupGlobally/FlattenDummyAndContents, into producer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map
May 31, 2018 8:48:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:48:44.674Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow into PAssert$33/GroupGlobally/GroupDummyAndContents/Read
May 31, 2018 8:48:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:48:44.720Z: Fusing consumer PAssert$33/GroupGlobally/ParDo(Concat) into PAssert$33/GroupGlobally/Values/Values/Map
May 31, 2018 8:48:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:48:44.758Z: Fusing consumer PAssert$33/GetPane/Map into PAssert$33/GroupGlobally/ParDo(Concat)
May 31, 2018 8:48:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:48:44.805Z: Fusing consumer PAssert$33/GroupGlobally/Values/Values/Map into PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow
May 31, 2018 8:48:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:48:44.850Z: Fusing consumer PAssert$33/RunChecks into PAssert$33/GetPane/Map
May 31, 2018 8:48:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:48:44.890Z: Fusing consumer PAssert$33/VerifyAssertions/ParDo(DefaultConclude) into PAssert$33/RunChecks
May 31, 2018 8:48:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:48:44.930Z: Unzipping flatten s24-u45 for input s26-reify-value18-c43
May 31, 2018 8:48:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:48:44.973Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Write, through flatten s24-u45, into producer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 31, 2018 8:48:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:48:45.019Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify into PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
May 31, 2018 8:48:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:48:45.056Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Write into PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 31, 2018 8:48:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:48:45.102Z: Fusing consumer PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)
May 31, 2018 8:48:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:48:45.139Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
May 31, 2018 8:48:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:48:45.180Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
May 31, 2018 8:48:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:48:45.225Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into PAssert$33/GroupGlobally/Window.Into()/Window.Assign
May 31, 2018 8:48:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:48:45.267Z: Fusing consumer OutputSideInputs into Create123/Read(CreateSource)
May 31, 2018 8:48:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:48:45.309Z: Fusing consumer PAssert$33/GroupGlobally/Window.Into()/Window.Assign into OutputSideInputs
May 31, 2018 8:48:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:48:45.355Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
May 31, 2018 8:48:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:48:45.400Z: Fusing consumer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map into PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
May 31, 2018 8:48:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:48:45.448Z: Fusing consumer PAssert$33/GroupGlobally/RewindowActuals/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map
May 31, 2018 8:48:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:48:45.493Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read
May 31, 2018 8:48:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:48:45.538Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
May 31, 2018 8:48:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:48:45.583Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
May 31, 2018 8:48:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:48:45.621Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
May 31, 2018 8:48:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:48:45.665Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
May 31, 2018 8:48:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:48:45.711Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
May 31, 2018 8:48:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:48:45.757Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into Create47/Read(CreateSource)
May 31, 2018 8:48:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:48:45.796Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
May 31, 2018 8:48:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:48:45.877Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
May 31, 2018 8:48:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:48:45.915Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
May 31, 2018 8:48:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:48:45.960Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
May 31, 2018 8:48:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:48:45.995Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
May 31, 2018 8:48:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:48:46.040Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
May 31, 2018 8:48:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:48:46.499Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Create
May 31, 2018 8:48:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:48:46.538Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Create
May 31, 2018 8:48:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:48:46.581Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
May 31, 2018 8:48:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:48:46.593Z: Starting 1 workers in us-central1-b...
May 31, 2018 8:48:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:48:46.623Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
May 31, 2018 8:48:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:48:46.876Z: Executing operation PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 31, 2018 8:48:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:48:46.923Z: Executing operation Create47/Read(CreateSource)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
May 31, 2018 8:48:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:48:56.270Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
May 31, 2018 8:49:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:49:06.758Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
May 31, 2018 8:49:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:49:06.800Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 31, 2018 8:49:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:49:23.539Z: Workers have started successfully.
May 31, 2018 8:49:54 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:49:52.805Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
May 31, 2018 8:49:54 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:49:52.919Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
May 31, 2018 8:50:01 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:50:01.064Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
May 31, 2018 8:50:01 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:50:01.159Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
May 31, 2018 8:50:14 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:50:14.161Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
May 31, 2018 8:50:14 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:50:14.358Z: Executing operation Create123/Read(CreateSource)+OutputSideInputs+PAssert$33/GroupGlobally/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write
May 31, 2018 8:50:20 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:50:19.992Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Close
May 31, 2018 8:50:20 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:50:20.093Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$33/GroupGlobally/RewindowActuals/Window.Assign+PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 31, 2018 8:50:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:50:24.717Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Close
May 31, 2018 8:50:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:50:24.812Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Read+PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$33/GroupGlobally/Values/Values/Map+PAssert$33/GroupGlobally/ParDo(Concat)+PAssert$33/GetPane/Map+PAssert$33/RunChecks+PAssert$33/VerifyAssertions/ParDo(DefaultConclude)
May 31, 2018 8:50:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:50:29.151Z: Cleaning up.
May 31, 2018 8:50:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:50:29.254Z: Stopping worker pool...
May 31, 2018 8:52:02 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:52:01.570Z: Autoscaling: Resized worker pool from 1 to 0.
May 31, 2018 8:52:02 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:52:01.717Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 31, 2018 8:52:02 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T08:52:01.770Z: Worker pool stopped.
May 31, 2018 8:52:12 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-05-31_01_48_35-1399331152337114576 finished with status DONE.
May 31, 2018 8:52:12 AM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-05-31_01_48_35-1399331152337114576. Found 1 success, 0 failures out of 1 expected assertions.
Gradle Test Executor 36 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest FAILED
209 tests completed, 34 failed, 2 skipped
Finished generating test XML results (0.523 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerTest>
Generating HTML test report...
Finished generating test html results (0.432 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest>
:beam-runners-google-cloud-dataflow-java:validatesRunnerTest (Thread[Task worker for ':' Thread 47,5,main]) completed. Took 2 hrs 9 mins 33.007 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:validatesRunnerTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 10m 22s
38 actionable tasks: 34 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/he5o44ejbjtqq
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user katarzyna.kucharczyk@polidea.com
Not sending mail to unregistered user robbe.sneyders@ml6.eu
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user schroederc@google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user sidhom@google.com
Not sending mail to unregistered user cademarkegard@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ammons@google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Build failed in Jenkins:
beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #384
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/384/display/redirect?page=changes>
Changes:
[kenn] Remove Schema.TypeName.type()
[kenn] Remove unsafe builder methods from FieldType
------------------------------------------
[...truncated 18.18 MB...]
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey as step s16
May 31, 2018 6:36:27 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map as step s17
May 31, 2018 6:36:27 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RewindowActuals/Window.Assign as step s18
May 31, 2018 6:36:27 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map as step s19
May 31, 2018 6:36:27 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveActualsTriggering/Flatten.PCollections as step s20
May 31, 2018 6:36:27 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Create.Values/Read(CreateSource) as step s21
May 31, 2018 6:36:27 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign as step s22
May 31, 2018 6:36:27 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveDummyTriggering/Flatten.PCollections as step s23
May 31, 2018 6:36:27 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/FlattenDummyAndContents as step s24
May 31, 2018 6:36:27 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/NeverTrigger/Flatten.PCollections as step s25
May 31, 2018 6:36:27 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GroupDummyAndContents as step s26
May 31, 2018 6:36:27 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Values/Values/Map as step s27
May 31, 2018 6:36:27 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/ParDo(Concat) as step s28
May 31, 2018 6:36:27 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GetPane/Map as step s29
May 31, 2018 6:36:27 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/RunChecks as step s30
May 31, 2018 6:36:27 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/VerifyAssertions/ParDo(DefaultConclude) as step s31
May 31, 2018 6:36:27 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0531063621-fe0660b7/output/results/staging/
May 31, 2018 6:36:27 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <71120 bytes, hash D5ZTy77eB1SxK4pEF55Epw> to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0531063621-fe0660b7/output/results/staging/pipeline-D5ZTy77eB1SxK4pEF55Epw.pb
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 31, 2018 6:36:28 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-05-30_23_36_27-8374727479302907689?project=apache-beam-testing
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Submitted job: 2018-05-30_23_36_27-8374727479302907689
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 31, 2018 6:36:28 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-05-30_23_36_27-8374727479302907689
May 31, 2018 6:36:28 AM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-05-30_23_36_27-8374727479302907689 with 1 expected assertions.
May 31, 2018 6:36:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:36:27.731Z: Autoscaling is enabled for job 2018-05-30_23_36_27-8374727479302907689. The number of workers will be between 1 and 1000.
May 31, 2018 6:36:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:36:27.771Z: Autoscaling was automatically enabled for job 2018-05-30_23_36_27-8374727479302907689.
May 31, 2018 6:36:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:36:30.316Z: Checking required Cloud APIs are enabled.
May 31, 2018 6:36:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:36:30.495Z: Checking permissions granted to controller Service Account.
May 31, 2018 6:36:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:36:34.631Z: Worker configuration: n1-standard-1 in us-central1-b.
May 31, 2018 6:36:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:36:35.028Z: Expanding CoGroupByKey operations into optimizable parts.
May 31, 2018 6:36:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:36:35.176Z: Expanding GroupByKey operations into optimizable parts.
May 31, 2018 6:36:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:36:35.218Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
May 31, 2018 6:36:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:36:35.424Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
May 31, 2018 6:36:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:36:35.466Z: Elided trivial flatten
May 31, 2018 6:36:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:36:35.501Z: Elided trivial flatten
May 31, 2018 6:36:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:36:35.544Z: Elided trivial flatten
May 31, 2018 6:36:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:36:35.579Z: Unzipping flatten s24 for input s19.org.apache.beam.sdk.values.PCollection.<init>:329#8fd0f908e3ea90e3
May 31, 2018 6:36:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:36:35.624Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Reify, through flatten PAssert$33/GroupGlobally/FlattenDummyAndContents, into producer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map
May 31, 2018 6:36:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:36:35.672Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow into PAssert$33/GroupGlobally/GroupDummyAndContents/Read
May 31, 2018 6:36:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:36:35.707Z: Fusing consumer PAssert$33/GroupGlobally/ParDo(Concat) into PAssert$33/GroupGlobally/Values/Values/Map
May 31, 2018 6:36:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:36:35.735Z: Fusing consumer PAssert$33/GetPane/Map into PAssert$33/GroupGlobally/ParDo(Concat)
May 31, 2018 6:36:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:36:35.774Z: Fusing consumer PAssert$33/GroupGlobally/Values/Values/Map into PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow
May 31, 2018 6:36:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:36:35.815Z: Fusing consumer PAssert$33/RunChecks into PAssert$33/GetPane/Map
May 31, 2018 6:36:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:36:35.860Z: Fusing consumer PAssert$33/VerifyAssertions/ParDo(DefaultConclude) into PAssert$33/RunChecks
May 31, 2018 6:36:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:36:35.903Z: Unzipping flatten s24-u45 for input s26-reify-value18-c43
May 31, 2018 6:36:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:36:35.949Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Write, through flatten s24-u45, into producer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 31, 2018 6:36:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:36:35.995Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify into PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
May 31, 2018 6:36:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:36:36.042Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Write into PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 31, 2018 6:36:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:36:36.077Z: Fusing consumer PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)
May 31, 2018 6:36:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:36:36.119Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
May 31, 2018 6:36:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:36:36.165Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
May 31, 2018 6:36:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:36:36.210Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into PAssert$33/GroupGlobally/Window.Into()/Window.Assign
May 31, 2018 6:36:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:36:36.249Z: Fusing consumer OutputSideInputs into Create123/Read(CreateSource)
May 31, 2018 6:36:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:36:36.292Z: Fusing consumer PAssert$33/GroupGlobally/Window.Into()/Window.Assign into OutputSideInputs
May 31, 2018 6:36:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:36:36.330Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
May 31, 2018 6:36:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:36:36.374Z: Fusing consumer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map into PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
May 31, 2018 6:36:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:36:36.420Z: Fusing consumer PAssert$33/GroupGlobally/RewindowActuals/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map
May 31, 2018 6:36:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:36:36.455Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read
May 31, 2018 6:36:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:36:36.489Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
May 31, 2018 6:36:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:36:36.533Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
May 31, 2018 6:36:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:36:36.586Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
May 31, 2018 6:36:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:36:36.627Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
May 31, 2018 6:36:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:36:36.669Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
May 31, 2018 6:36:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:36:36.712Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into Create47/Read(CreateSource)
May 31, 2018 6:36:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:36:36.748Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
May 31, 2018 6:36:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:36:36.793Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
May 31, 2018 6:36:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:36:36.837Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
May 31, 2018 6:36:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:36:36.879Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
May 31, 2018 6:36:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:36:36.920Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
May 31, 2018 6:36:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:36:36.963Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
May 31, 2018 6:36:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:36:37.405Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Create
May 31, 2018 6:36:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:36:37.449Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Create
May 31, 2018 6:36:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:36:37.484Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
May 31, 2018 6:36:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:36:37.506Z: Starting 1 workers in us-central1-b...
May 31, 2018 6:36:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:36:37.531Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
May 31, 2018 6:36:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:36:37.746Z: Executing operation Create47/Read(CreateSource)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
May 31, 2018 6:36:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:36:37.782Z: Executing operation PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 31, 2018 6:36:46 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:36:45.304Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
May 31, 2018 6:36:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:36:55.840Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
May 31, 2018 6:36:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:36:55.874Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 31, 2018 6:37:19 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:37:17.864Z: Workers have started successfully.
May 31, 2018 6:37:44 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:37:42.715Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
May 31, 2018 6:37:44 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:37:42.790Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
May 31, 2018 6:37:45 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:37:44.997Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
May 31, 2018 6:37:45 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:37:45.076Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
May 31, 2018 6:38:00 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:37:58.167Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
May 31, 2018 6:38:00 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:37:58.323Z: Executing operation Create123/Read(CreateSource)+OutputSideInputs+PAssert$33/GroupGlobally/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write
May 31, 2018 6:38:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:38:07.206Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Close
May 31, 2018 6:38:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:38:07.275Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$33/GroupGlobally/RewindowActuals/Window.Assign+PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 31, 2018 6:38:12 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:38:10.078Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Close
May 31, 2018 6:38:12 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:38:10.146Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Read+PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$33/GroupGlobally/Values/Values/Map+PAssert$33/GroupGlobally/ParDo(Concat)+PAssert$33/GetPane/Map+PAssert$33/RunChecks+PAssert$33/VerifyAssertions/ParDo(DefaultConclude)
May 31, 2018 6:38:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:38:15.089Z: Cleaning up.
May 31, 2018 6:38:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:38:15.154Z: Stopping worker pool...
May 31, 2018 6:40:12 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:40:10.103Z: Autoscaling: Resized worker pool from 1 to 0.
May 31, 2018 6:40:12 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T06:40:10.152Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 31, 2018 6:41:36 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-05-30_23_36_27-8374727479302907689 finished with status DONE.
May 31, 2018 6:41:36 AM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-05-30_23_36_27-8374727479302907689. Found 1 success, 0 failures out of 1 expected assertions.
Gradle Test Executor 37 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest FAILED
209 tests completed, 34 failed, 2 skipped
Finished generating test XML results (0.393 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerTest>
Generating HTML test report...
Finished generating test html results (0.259 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest>
:beam-runners-google-cloud-dataflow-java:validatesRunnerTest (Thread[Task worker for ':' Thread 44,5,main]) completed. Took 2 hrs 15 mins 27.679 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:validatesRunnerTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 16m 30s
38 actionable tasks: 35 executed, 3 from cache
Publishing build scan...
https://gradle.com/s/yxpfkwvhlex32
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user katarzyna.kucharczyk@polidea.com
Not sending mail to unregistered user robbe.sneyders@ml6.eu
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user schroederc@google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user sidhom@google.com
Not sending mail to unregistered user cademarkegard@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ammons@google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Build failed in Jenkins:
beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #383
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/383/display/redirect>
------------------------------------------
[...truncated 18.18 MB...]
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map as step s17
May 31, 2018 4:20:55 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RewindowActuals/Window.Assign as step s18
May 31, 2018 4:20:55 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map as step s19
May 31, 2018 4:20:55 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveActualsTriggering/Flatten.PCollections as step s20
May 31, 2018 4:20:55 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Create.Values/Read(CreateSource) as step s21
May 31, 2018 4:20:55 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign as step s22
May 31, 2018 4:20:55 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveDummyTriggering/Flatten.PCollections as step s23
May 31, 2018 4:20:55 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/FlattenDummyAndContents as step s24
May 31, 2018 4:20:55 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/NeverTrigger/Flatten.PCollections as step s25
May 31, 2018 4:20:55 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GroupDummyAndContents as step s26
May 31, 2018 4:20:55 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Values/Values/Map as step s27
May 31, 2018 4:20:55 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/ParDo(Concat) as step s28
May 31, 2018 4:20:55 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GetPane/Map as step s29
May 31, 2018 4:20:55 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/RunChecks as step s30
May 31, 2018 4:20:55 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/VerifyAssertions/ParDo(DefaultConclude) as step s31
May 31, 2018 4:20:55 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0531042051-4614026e/output/results/staging/
May 31, 2018 4:20:55 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <71120 bytes, hash w5VQjF7Bfi4YhN1Ka4fPeg> to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0531042051-4614026e/output/results/staging/pipeline-w5VQjF7Bfi4YhN1Ka4fPeg.pb
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 31, 2018 4:20:56 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-05-30_21_20_55-1585668727997182911?project=apache-beam-testing
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Submitted job: 2018-05-30_21_20_55-1585668727997182911
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 31, 2018 4:20:56 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-05-30_21_20_55-1585668727997182911
May 31, 2018 4:20:56 AM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-05-30_21_20_55-1585668727997182911 with 1 expected assertions.
May 31, 2018 4:21:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:20:56.038Z: Autoscaling is enabled for job 2018-05-30_21_20_55-1585668727997182911. The number of workers will be between 1 and 1000.
May 31, 2018 4:21:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:20:56.074Z: Autoscaling was automatically enabled for job 2018-05-30_21_20_55-1585668727997182911.
May 31, 2018 4:21:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:20:58.456Z: Checking required Cloud APIs are enabled.
May 31, 2018 4:21:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:20:58.576Z: Checking permissions granted to controller Service Account.
May 31, 2018 4:21:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:21:03.595Z: Worker configuration: n1-standard-1 in us-central1-b.
May 31, 2018 4:21:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:21:04.021Z: Expanding CoGroupByKey operations into optimizable parts.
May 31, 2018 4:21:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:21:04.195Z: Expanding GroupByKey operations into optimizable parts.
May 31, 2018 4:21:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:21:04.228Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
May 31, 2018 4:21:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:21:04.452Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
May 31, 2018 4:21:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:21:04.487Z: Elided trivial flatten
May 31, 2018 4:21:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:21:04.539Z: Elided trivial flatten
May 31, 2018 4:21:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:21:04.587Z: Elided trivial flatten
May 31, 2018 4:21:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:21:04.631Z: Unzipping flatten s24 for input s19.org.apache.beam.sdk.values.PCollection.<init>:329#8fd0f908e3ea90e3
May 31, 2018 4:21:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:21:04.671Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Reify, through flatten PAssert$33/GroupGlobally/FlattenDummyAndContents, into producer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map
May 31, 2018 4:21:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:21:04.708Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow into PAssert$33/GroupGlobally/GroupDummyAndContents/Read
May 31, 2018 4:21:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:21:04.749Z: Fusing consumer PAssert$33/GroupGlobally/ParDo(Concat) into PAssert$33/GroupGlobally/Values/Values/Map
May 31, 2018 4:21:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:21:04.792Z: Fusing consumer PAssert$33/GetPane/Map into PAssert$33/GroupGlobally/ParDo(Concat)
May 31, 2018 4:21:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:21:04.833Z: Fusing consumer PAssert$33/GroupGlobally/Values/Values/Map into PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow
May 31, 2018 4:21:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:21:04.875Z: Fusing consumer PAssert$33/RunChecks into PAssert$33/GetPane/Map
May 31, 2018 4:21:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:21:04.912Z: Fusing consumer PAssert$33/VerifyAssertions/ParDo(DefaultConclude) into PAssert$33/RunChecks
May 31, 2018 4:21:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:21:04.958Z: Unzipping flatten s24-u45 for input s26-reify-value18-c43
May 31, 2018 4:21:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:21:05.000Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Write, through flatten s24-u45, into producer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 31, 2018 4:21:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:21:05.037Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify into PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
May 31, 2018 4:21:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:21:05.065Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Write into PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 31, 2018 4:21:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:21:05.105Z: Fusing consumer PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)
May 31, 2018 4:21:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:21:05.143Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
May 31, 2018 4:21:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:21:05.189Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
May 31, 2018 4:21:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:21:05.225Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into PAssert$33/GroupGlobally/Window.Into()/Window.Assign
May 31, 2018 4:21:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:21:05.263Z: Fusing consumer OutputSideInputs into Create123/Read(CreateSource)
May 31, 2018 4:21:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:21:05.301Z: Fusing consumer PAssert$33/GroupGlobally/Window.Into()/Window.Assign into OutputSideInputs
May 31, 2018 4:21:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:21:05.334Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
May 31, 2018 4:21:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:21:05.374Z: Fusing consumer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map into PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
May 31, 2018 4:21:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:21:05.419Z: Fusing consumer PAssert$33/GroupGlobally/RewindowActuals/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map
May 31, 2018 4:21:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:21:05.463Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read
May 31, 2018 4:21:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:21:05.502Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
May 31, 2018 4:21:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:21:05.541Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
May 31, 2018 4:21:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:21:05.586Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
May 31, 2018 4:21:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:21:05.620Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
May 31, 2018 4:21:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:21:05.652Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
May 31, 2018 4:21:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:21:05.682Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into Create47/Read(CreateSource)
May 31, 2018 4:21:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:21:05.725Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
May 31, 2018 4:21:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:21:05.763Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
May 31, 2018 4:21:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:21:05.802Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
May 31, 2018 4:21:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:21:05.845Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
May 31, 2018 4:21:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:21:05.876Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
May 31, 2018 4:21:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:21:05.919Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
May 31, 2018 4:21:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:21:06.398Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Create
May 31, 2018 4:21:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:21:06.437Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Create
May 31, 2018 4:21:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:21:06.482Z: Starting 1 workers in us-central1-b...
May 31, 2018 4:21:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:21:06.482Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
May 31, 2018 4:21:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:21:06.522Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
May 31, 2018 4:21:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:21:06.751Z: Executing operation PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 31, 2018 4:21:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:21:06.793Z: Executing operation Create47/Read(CreateSource)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
May 31, 2018 4:21:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:21:16.598Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
May 31, 2018 4:21:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:21:27.305Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
May 31, 2018 4:21:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:21:27.345Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 31, 2018 4:21:44 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:21:43.924Z: Workers have started successfully.
May 31, 2018 4:22:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:22:07.229Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
May 31, 2018 4:22:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:22:07.320Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
May 31, 2018 4:22:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:22:12.584Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
May 31, 2018 4:22:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:22:12.676Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
May 31, 2018 4:22:26 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:22:25.943Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
May 31, 2018 4:22:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:22:26.149Z: Executing operation Create123/Read(CreateSource)+OutputSideInputs+PAssert$33/GroupGlobally/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write
May 31, 2018 4:22:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:22:32.382Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Close
May 31, 2018 4:22:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:22:32.462Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$33/GroupGlobally/RewindowActuals/Window.Assign+PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 31, 2018 4:22:39 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:22:38.015Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Close
May 31, 2018 4:22:39 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:22:38.120Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Read+PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$33/GroupGlobally/Values/Values/Map+PAssert$33/GroupGlobally/ParDo(Concat)+PAssert$33/GetPane/Map+PAssert$33/RunChecks+PAssert$33/VerifyAssertions/ParDo(DefaultConclude)
May 31, 2018 4:22:40 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:22:39.267Z: Cleaning up.
May 31, 2018 4:22:40 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:22:39.373Z: Stopping worker pool...
May 31, 2018 4:24:39 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:24:38.843Z: Autoscaling: Resized worker pool from 1 to 0.
May 31, 2018 4:24:39 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:24:38.899Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 31, 2018 4:24:39 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T04:24:38.964Z: Worker pool stopped.
May 31, 2018 4:24:51 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-05-30_21_20_55-1585668727997182911 finished with status DONE.
May 31, 2018 4:24:51 AM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-05-30_21_20_55-1585668727997182911. Found 1 success, 0 failures out of 1 expected assertions.
Gradle Test Executor 38 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest FAILED
209 tests completed, 34 failed, 2 skipped
Finished generating test XML results (0.336 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerTest>
Generating HTML test report...
Finished generating test html results (0.274 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest>
:beam-runners-google-cloud-dataflow-java:validatesRunnerTest (Thread[Task worker for ':' Thread 40,5,main]) completed. Took 2 hrs 17 mins 8.986 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:validatesRunnerTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 18m 2s
38 actionable tasks: 34 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/mkh2yfnmqiwek
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user katarzyna.kucharczyk@polidea.com
Not sending mail to unregistered user robbe.sneyders@ml6.eu
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user schroederc@google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user sidhom@google.com
Not sending mail to unregistered user cademarkegard@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ammons@google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Build failed in Jenkins:
beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #382
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/382/display/redirect?page=changes>
Changes:
[szewinho] HDFS large cluster configuration. Jenkins job updated to use large
[kenn] Add more field conveniences to Schema.Builder
[kenn] Remove extraneous RowSqlTypes
------------------------------------------
[...truncated 18.18 MB...]
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey as step s16
May 31, 2018 2:01:58 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map as step s17
May 31, 2018 2:01:58 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RewindowActuals/Window.Assign as step s18
May 31, 2018 2:01:58 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map as step s19
May 31, 2018 2:01:58 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveActualsTriggering/Flatten.PCollections as step s20
May 31, 2018 2:01:58 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Create.Values/Read(CreateSource) as step s21
May 31, 2018 2:01:58 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign as step s22
May 31, 2018 2:01:58 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveDummyTriggering/Flatten.PCollections as step s23
May 31, 2018 2:01:58 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/FlattenDummyAndContents as step s24
May 31, 2018 2:01:58 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/NeverTrigger/Flatten.PCollections as step s25
May 31, 2018 2:01:58 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GroupDummyAndContents as step s26
May 31, 2018 2:01:58 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Values/Values/Map as step s27
May 31, 2018 2:01:58 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/ParDo(Concat) as step s28
May 31, 2018 2:01:58 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GetPane/Map as step s29
May 31, 2018 2:01:58 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/RunChecks as step s30
May 31, 2018 2:01:58 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/VerifyAssertions/ParDo(DefaultConclude) as step s31
May 31, 2018 2:01:58 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0531020154-cc573fc8/output/results/staging/
May 31, 2018 2:01:58 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <71120 bytes, hash RrnSHd9_lHxRiH5h19TQoQ> to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0531020154-cc573fc8/output/results/staging/pipeline-RrnSHd9_lHxRiH5h19TQoQ.pb
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 31, 2018 2:01:59 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-05-30_19_01_58-12536947499388639469?project=apache-beam-testing
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Submitted job: 2018-05-30_19_01_58-12536947499388639469
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 31, 2018 2:01:59 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-05-30_19_01_58-12536947499388639469
May 31, 2018 2:01:59 AM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-05-30_19_01_58-12536947499388639469 with 1 expected assertions.
May 31, 2018 2:02:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:01:58.949Z: Autoscaling is enabled for job 2018-05-30_19_01_58-12536947499388639469. The number of workers will be between 1 and 1000.
May 31, 2018 2:02:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:01:58.995Z: Autoscaling was automatically enabled for job 2018-05-30_19_01_58-12536947499388639469.
May 31, 2018 2:02:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:02:01.425Z: Checking required Cloud APIs are enabled.
May 31, 2018 2:02:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:02:01.519Z: Checking permissions granted to controller Service Account.
May 31, 2018 2:02:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:02:05.978Z: Worker configuration: n1-standard-1 in us-central1-b.
May 31, 2018 2:02:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:02:06.355Z: Expanding CoGroupByKey operations into optimizable parts.
May 31, 2018 2:02:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:02:06.494Z: Expanding GroupByKey operations into optimizable parts.
May 31, 2018 2:02:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:02:06.535Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
May 31, 2018 2:02:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:02:06.700Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
May 31, 2018 2:02:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:02:06.731Z: Elided trivial flatten
May 31, 2018 2:02:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:02:06.772Z: Elided trivial flatten
May 31, 2018 2:02:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:02:06.796Z: Elided trivial flatten
May 31, 2018 2:02:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:02:06.834Z: Unzipping flatten s24 for input s19.org.apache.beam.sdk.values.PCollection.<init>:329#8fd0f908e3ea90e3
May 31, 2018 2:02:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:02:06.901Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Reify, through flatten PAssert$33/GroupGlobally/FlattenDummyAndContents, into producer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map
May 31, 2018 2:02:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:02:06.929Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow into PAssert$33/GroupGlobally/GroupDummyAndContents/Read
May 31, 2018 2:02:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:02:06.952Z: Fusing consumer PAssert$33/GroupGlobally/ParDo(Concat) into PAssert$33/GroupGlobally/Values/Values/Map
May 31, 2018 2:02:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:02:06.970Z: Fusing consumer PAssert$33/GetPane/Map into PAssert$33/GroupGlobally/ParDo(Concat)
May 31, 2018 2:02:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:02:06.997Z: Fusing consumer PAssert$33/GroupGlobally/Values/Values/Map into PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow
May 31, 2018 2:02:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:02:07.018Z: Fusing consumer PAssert$33/RunChecks into PAssert$33/GetPane/Map
May 31, 2018 2:02:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:02:07.045Z: Fusing consumer PAssert$33/VerifyAssertions/ParDo(DefaultConclude) into PAssert$33/RunChecks
May 31, 2018 2:02:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:02:07.084Z: Unzipping flatten s24-u45 for input s26-reify-value18-c43
May 31, 2018 2:02:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:02:07.120Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Write, through flatten s24-u45, into producer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 31, 2018 2:02:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:02:07.161Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify into PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
May 31, 2018 2:02:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:02:07.197Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Write into PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 31, 2018 2:02:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:02:07.246Z: Fusing consumer PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)
May 31, 2018 2:02:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:02:07.285Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
May 31, 2018 2:02:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:02:07.329Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
May 31, 2018 2:02:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:02:07.367Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into PAssert$33/GroupGlobally/Window.Into()/Window.Assign
May 31, 2018 2:02:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:02:07.408Z: Fusing consumer OutputSideInputs into Create123/Read(CreateSource)
May 31, 2018 2:02:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:02:07.438Z: Fusing consumer PAssert$33/GroupGlobally/Window.Into()/Window.Assign into OutputSideInputs
May 31, 2018 2:02:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:02:07.473Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
May 31, 2018 2:02:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:02:07.495Z: Fusing consumer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map into PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
May 31, 2018 2:02:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:02:07.528Z: Fusing consumer PAssert$33/GroupGlobally/RewindowActuals/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map
May 31, 2018 2:02:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:02:07.563Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read
May 31, 2018 2:02:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:02:07.599Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
May 31, 2018 2:02:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:02:07.638Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
May 31, 2018 2:02:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:02:07.681Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
May 31, 2018 2:02:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:02:07.717Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
May 31, 2018 2:02:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:02:07.752Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
May 31, 2018 2:02:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:02:07.783Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into Create47/Read(CreateSource)
May 31, 2018 2:02:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:02:07.834Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
May 31, 2018 2:02:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:02:07.862Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
May 31, 2018 2:02:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:02:07.909Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
May 31, 2018 2:02:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:02:07.954Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
May 31, 2018 2:02:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:02:07.995Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
May 31, 2018 2:02:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:02:08.032Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
May 31, 2018 2:02:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:02:08.474Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Create
May 31, 2018 2:02:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:02:08.513Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Create
May 31, 2018 2:02:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:02:08.551Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
May 31, 2018 2:02:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:02:08.551Z: Starting 1 workers in us-central1-b...
May 31, 2018 2:02:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:02:08.580Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
May 31, 2018 2:02:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:02:08.779Z: Executing operation Create47/Read(CreateSource)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
May 31, 2018 2:02:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:02:08.820Z: Executing operation PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 31, 2018 2:02:18 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:02:17.155Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
May 31, 2018 2:02:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:02:27.879Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
May 31, 2018 2:02:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:02:27.913Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 31, 2018 2:03:04 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:03:03.050Z: Workers have started successfully.
May 31, 2018 2:03:50 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:03:48.477Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
May 31, 2018 2:03:50 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:03:48.557Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
May 31, 2018 2:03:56 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:03:55.727Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
May 31, 2018 2:03:56 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:03:55.819Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
May 31, 2018 2:04:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:04:07.925Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
May 31, 2018 2:04:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:04:08.119Z: Executing operation Create123/Read(CreateSource)+OutputSideInputs+PAssert$33/GroupGlobally/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write
May 31, 2018 2:04:19 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:04:18.862Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Close
May 31, 2018 2:04:19 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:04:18.954Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$33/GroupGlobally/RewindowActuals/Window.Assign+PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 31, 2018 2:04:22 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:04:21.728Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Close
May 31, 2018 2:04:22 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:04:21.825Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Read+PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$33/GroupGlobally/Values/Values/Map+PAssert$33/GroupGlobally/ParDo(Concat)+PAssert$33/GetPane/Map+PAssert$33/RunChecks+PAssert$33/VerifyAssertions/ParDo(DefaultConclude)
May 31, 2018 2:04:27 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:04:26.968Z: Cleaning up.
May 31, 2018 2:04:27 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:04:27.082Z: Stopping worker pool...
May 31, 2018 2:06:19 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:06:18.402Z: Autoscaling: Resized worker pool from 1 to 0.
May 31, 2018 2:06:19 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-31T02:06:18.426Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 31, 2018 2:06:35 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-05-30_19_01_58-12536947499388639469 finished with status DONE.
May 31, 2018 2:06:35 AM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-05-30_19_01_58-12536947499388639469. Found 1 success, 0 failures out of 1 expected assertions.
Gradle Test Executor 38 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest FAILED
209 tests completed, 34 failed, 2 skipped
Finished generating test XML results (0.488 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerTest>
Generating HTML test report...
Finished generating test html results (0.501 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest>
:beam-runners-google-cloud-dataflow-java:validatesRunnerTest (Thread[Task worker for ':' Thread 21,5,main]) completed. Took 2 hrs 27 mins 9.188 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:validatesRunnerTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 28m 13s
38 actionable tasks: 35 executed, 3 from cache
Publishing build scan...
https://gradle.com/s/2s7jq6yzd3ipu
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user katarzyna.kucharczyk@polidea.com
Not sending mail to unregistered user robbe.sneyders@ml6.eu
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user schroederc@google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user sidhom@google.com
Not sending mail to unregistered user cademarkegard@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ammons@google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Build failed in Jenkins:
beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #381
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/381/display/redirect?page=changes>
Changes:
[Pablo] [BEAM-4322] Enforce ErrorProne analysis in protobuf extensions project
------------------------------------------
[...truncated 18.19 MB...]
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map as step s17
May 30, 2018 11:34:24 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RewindowActuals/Window.Assign as step s18
May 30, 2018 11:34:24 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map as step s19
May 30, 2018 11:34:24 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveActualsTriggering/Flatten.PCollections as step s20
May 30, 2018 11:34:24 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Create.Values/Read(CreateSource) as step s21
May 30, 2018 11:34:24 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign as step s22
May 30, 2018 11:34:24 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveDummyTriggering/Flatten.PCollections as step s23
May 30, 2018 11:34:24 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/FlattenDummyAndContents as step s24
May 30, 2018 11:34:24 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/NeverTrigger/Flatten.PCollections as step s25
May 30, 2018 11:34:24 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GroupDummyAndContents as step s26
May 30, 2018 11:34:24 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Values/Values/Map as step s27
May 30, 2018 11:34:24 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/ParDo(Concat) as step s28
May 30, 2018 11:34:24 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GetPane/Map as step s29
May 30, 2018 11:34:24 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/RunChecks as step s30
May 30, 2018 11:34:24 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/VerifyAssertions/ParDo(DefaultConclude) as step s31
May 30, 2018 11:34:24 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0530233418-9f6b7e56/output/results/staging/
May 30, 2018 11:34:24 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <71120 bytes, hash uGBY4DcXS4SCrp6MxTttSQ> to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0530233418-9f6b7e56/output/results/staging/pipeline-uGBY4DcXS4SCrp6MxTttSQ.pb
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 30, 2018 11:34:25 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-05-30_16_34_24-5278481970277675436?project=apache-beam-testing
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Submitted job: 2018-05-30_16_34_24-5278481970277675436
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 30, 2018 11:34:25 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-05-30_16_34_24-5278481970277675436
May 30, 2018 11:34:25 PM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-05-30_16_34_24-5278481970277675436 with 1 expected assertions.
May 30, 2018 11:34:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:34:24.619Z: Autoscaling is enabled for job 2018-05-30_16_34_24-5278481970277675436. The number of workers will be between 1 and 1000.
May 30, 2018 11:34:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:34:24.667Z: Autoscaling was automatically enabled for job 2018-05-30_16_34_24-5278481970277675436.
May 30, 2018 11:34:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:34:27.448Z: Checking required Cloud APIs are enabled.
May 30, 2018 11:34:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:34:27.634Z: Checking permissions granted to controller Service Account.
May 30, 2018 11:34:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:34:32.570Z: Worker configuration: n1-standard-1 in us-central1-b.
May 30, 2018 11:34:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:34:32.987Z: Expanding CoGroupByKey operations into optimizable parts.
May 30, 2018 11:34:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:34:33.172Z: Expanding GroupByKey operations into optimizable parts.
May 30, 2018 11:34:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:34:33.207Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
May 30, 2018 11:34:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:34:33.529Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
May 30, 2018 11:34:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:34:33.610Z: Elided trivial flatten
May 30, 2018 11:34:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:34:33.657Z: Elided trivial flatten
May 30, 2018 11:34:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:34:33.706Z: Elided trivial flatten
May 30, 2018 11:34:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:34:33.746Z: Unzipping flatten s24 for input s19.org.apache.beam.sdk.values.PCollection.<init>:329#8fd0f908e3ea90e3
May 30, 2018 11:34:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:34:33.797Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Reify, through flatten PAssert$33/GroupGlobally/FlattenDummyAndContents, into producer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map
May 30, 2018 11:34:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:34:33.828Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow into PAssert$33/GroupGlobally/GroupDummyAndContents/Read
May 30, 2018 11:34:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:34:33.877Z: Fusing consumer PAssert$33/GroupGlobally/ParDo(Concat) into PAssert$33/GroupGlobally/Values/Values/Map
May 30, 2018 11:34:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:34:33.931Z: Fusing consumer PAssert$33/GetPane/Map into PAssert$33/GroupGlobally/ParDo(Concat)
May 30, 2018 11:34:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:34:33.981Z: Fusing consumer PAssert$33/GroupGlobally/Values/Values/Map into PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow
May 30, 2018 11:34:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:34:34.033Z: Fusing consumer PAssert$33/RunChecks into PAssert$33/GetPane/Map
May 30, 2018 11:34:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:34:34.084Z: Fusing consumer PAssert$33/VerifyAssertions/ParDo(DefaultConclude) into PAssert$33/RunChecks
May 30, 2018 11:34:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:34:34.125Z: Unzipping flatten s24-u45 for input s26-reify-value18-c43
May 30, 2018 11:34:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:34:34.181Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Write, through flatten s24-u45, into producer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 30, 2018 11:34:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:34:34.226Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify into PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
May 30, 2018 11:34:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:34:34.274Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Write into PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 30, 2018 11:34:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:34:34.331Z: Fusing consumer PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)
May 30, 2018 11:34:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:34:34.378Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
May 30, 2018 11:34:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:34:34.423Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
May 30, 2018 11:34:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:34:34.464Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into PAssert$33/GroupGlobally/Window.Into()/Window.Assign
May 30, 2018 11:34:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:34:34.516Z: Fusing consumer OutputSideInputs into Create123/Read(CreateSource)
May 30, 2018 11:34:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:34:34.565Z: Fusing consumer PAssert$33/GroupGlobally/Window.Into()/Window.Assign into OutputSideInputs
May 30, 2018 11:34:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:34:34.616Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
May 30, 2018 11:34:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:34:34.664Z: Fusing consumer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map into PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
May 30, 2018 11:34:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:34:34.711Z: Fusing consumer PAssert$33/GroupGlobally/RewindowActuals/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map
May 30, 2018 11:34:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:34:34.762Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read
May 30, 2018 11:34:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:34:34.805Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
May 30, 2018 11:34:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:34:34.847Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
May 30, 2018 11:34:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:34:34.886Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
May 30, 2018 11:34:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:34:34.940Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
May 30, 2018 11:34:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:34:34.980Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
May 30, 2018 11:34:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:34:35.030Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into Create47/Read(CreateSource)
May 30, 2018 11:34:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:34:35.062Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
May 30, 2018 11:34:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:34:35.108Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
May 30, 2018 11:34:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:34:35.152Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
May 30, 2018 11:34:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:34:35.199Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
May 30, 2018 11:34:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:34:35.249Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
May 30, 2018 11:34:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:34:35.300Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
May 30, 2018 11:34:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:34:35.868Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Create
May 30, 2018 11:34:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:34:35.916Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Create
May 30, 2018 11:34:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:34:35.953Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
May 30, 2018 11:34:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:34:35.971Z: Starting 1 workers in us-central1-b...
May 30, 2018 11:34:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:34:36.007Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
May 30, 2018 11:34:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:34:36.318Z: Executing operation Create47/Read(CreateSource)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
May 30, 2018 11:34:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:34:36.395Z: Executing operation PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 30, 2018 11:34:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:34:43.798Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
May 30, 2018 11:34:56 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:34:54.327Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
May 30, 2018 11:34:56 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:34:54.364Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 30, 2018 11:35:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:35:14.796Z: Workers have started successfully.
May 30, 2018 11:35:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:35:35.162Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
May 30, 2018 11:35:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:35:35.285Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
May 30, 2018 11:35:40 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:35:39.925Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
May 30, 2018 11:35:40 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:35:40.018Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
May 30, 2018 11:35:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:35:52.101Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
May 30, 2018 11:35:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:35:52.293Z: Executing operation Create123/Read(CreateSource)+OutputSideInputs+PAssert$33/GroupGlobally/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write
May 30, 2018 11:36:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:35:59.422Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Close
May 30, 2018 11:36:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:35:59.532Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$33/GroupGlobally/RewindowActuals/Window.Assign+PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 30, 2018 11:36:03 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:36:02.958Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Close
May 30, 2018 11:36:03 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:36:03.069Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Read+PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$33/GroupGlobally/Values/Values/Map+PAssert$33/GroupGlobally/ParDo(Concat)+PAssert$33/GetPane/Map+PAssert$33/RunChecks+PAssert$33/VerifyAssertions/ParDo(DefaultConclude)
May 30, 2018 11:36:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:36:06.288Z: Cleaning up.
May 30, 2018 11:36:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:36:06.444Z: Stopping worker pool...
May 30, 2018 11:37:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:37:45.129Z: Autoscaling: Resized worker pool from 1 to 0.
May 30, 2018 11:37:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:37:45.233Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 30, 2018 11:37:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T23:37:45.296Z: Worker pool stopped.
May 30, 2018 11:37:54 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-05-30_16_34_24-5278481970277675436 finished with status DONE.
May 30, 2018 11:37:54 PM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-05-30_16_34_24-5278481970277675436. Found 1 success, 0 failures out of 1 expected assertions.
Gradle Test Executor 39 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest FAILED
209 tests completed, 34 failed, 2 skipped
Finished generating test XML results (0.466 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerTest>
Generating HTML test report...
Finished generating test html results (0.367 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest>
:beam-runners-google-cloud-dataflow-java:validatesRunnerTest (Thread[Task worker for ':' Thread 12,5,main]) completed. Took 2 hrs 25 mins 25.132 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:validatesRunnerTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 26m 38s
38 actionable tasks: 35 executed, 3 from cache
Publishing build scan...
https://gradle.com/s/qlj72s3hrt6oe
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user katarzyna.kucharczyk@polidea.com
Not sending mail to unregistered user robbe.sneyders@ml6.eu
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user schroederc@google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user sidhom@google.com
Not sending mail to unregistered user cademarkegard@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ammons@google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Build failed in Jenkins:
beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #380
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/380/display/redirect?page=changes>
Changes:
[kenn] Add convenience aliases for nullary type constructors
[kenn] Add MAP field support to Schema.Builder
[kenn] Add static factories for array, row, map types
[kenn] Schema fields are non-null by default
[kenn] TestUtils.RowsBuilder to use FieldType instead of TypeName
[kenn] Clean up CalciteUtils conversions a bit
[Pablo] enable failOnWarning for build-tools
[apilloud] Run everything with shadowJar
[apilloud] guava is on kinesis public API
[apilloud] Fix direct runner shadow config
------------------------------------------
[...truncated 18.03 MB...]
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey as step s16
May 30, 2018 9:05:42 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map as step s17
May 30, 2018 9:05:42 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RewindowActuals/Window.Assign as step s18
May 30, 2018 9:05:42 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map as step s19
May 30, 2018 9:05:42 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveActualsTriggering/Flatten.PCollections as step s20
May 30, 2018 9:05:42 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Create.Values/Read(CreateSource) as step s21
May 30, 2018 9:05:42 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign as step s22
May 30, 2018 9:05:42 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveDummyTriggering/Flatten.PCollections as step s23
May 30, 2018 9:05:42 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/FlattenDummyAndContents as step s24
May 30, 2018 9:05:42 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/NeverTrigger/Flatten.PCollections as step s25
May 30, 2018 9:05:42 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GroupDummyAndContents as step s26
May 30, 2018 9:05:42 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Values/Values/Map as step s27
May 30, 2018 9:05:42 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/ParDo(Concat) as step s28
May 30, 2018 9:05:42 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GetPane/Map as step s29
May 30, 2018 9:05:42 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/RunChecks as step s30
May 30, 2018 9:05:42 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/VerifyAssertions/ParDo(DefaultConclude) as step s31
May 30, 2018 9:05:42 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0530210538-7cf065dc/output/results/staging/
May 30, 2018 9:05:42 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <71120 bytes, hash Bz8lBCxbTBs7p9Ai1N-i0w> to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0530210538-7cf065dc/output/results/staging/pipeline-Bz8lBCxbTBs7p9Ai1N-i0w.pb
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 30, 2018 9:05:44 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-05-30_14_05_43-16634236301899883333?project=apache-beam-testing
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Submitted job: 2018-05-30_14_05_43-16634236301899883333
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 30, 2018 9:05:44 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-05-30_14_05_43-16634236301899883333
May 30, 2018 9:05:44 PM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-05-30_14_05_43-16634236301899883333 with 1 expected assertions.
May 30, 2018 9:05:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:05:43.350Z: Autoscaling is enabled for job 2018-05-30_14_05_43-16634236301899883333. The number of workers will be between 1 and 1000.
May 30, 2018 9:05:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:05:43.385Z: Autoscaling was automatically enabled for job 2018-05-30_14_05_43-16634236301899883333.
May 30, 2018 9:05:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:05:46.243Z: Checking required Cloud APIs are enabled.
May 30, 2018 9:05:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:05:46.467Z: Checking permissions granted to controller Service Account.
May 30, 2018 9:05:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:05:51.745Z: Worker configuration: n1-standard-1 in us-central1-b.
May 30, 2018 9:05:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:05:52.125Z: Expanding CoGroupByKey operations into optimizable parts.
May 30, 2018 9:05:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:05:52.345Z: Expanding GroupByKey operations into optimizable parts.
May 30, 2018 9:05:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:05:52.392Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
May 30, 2018 9:05:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:05:52.665Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
May 30, 2018 9:05:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:05:52.713Z: Elided trivial flatten
May 30, 2018 9:05:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:05:52.761Z: Elided trivial flatten
May 30, 2018 9:05:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:05:52.829Z: Elided trivial flatten
May 30, 2018 9:05:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:05:52.889Z: Unzipping flatten s24 for input s19.org.apache.beam.sdk.values.PCollection.<init>:329#8fd0f908e3ea90e3
May 30, 2018 9:05:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:05:52.936Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Reify, through flatten PAssert$33/GroupGlobally/FlattenDummyAndContents, into producer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map
May 30, 2018 9:05:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:05:53.002Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow into PAssert$33/GroupGlobally/GroupDummyAndContents/Read
May 30, 2018 9:05:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:05:53.051Z: Fusing consumer PAssert$33/GroupGlobally/ParDo(Concat) into PAssert$33/GroupGlobally/Values/Values/Map
May 30, 2018 9:05:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:05:53.097Z: Fusing consumer PAssert$33/GetPane/Map into PAssert$33/GroupGlobally/ParDo(Concat)
May 30, 2018 9:05:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:05:53.151Z: Fusing consumer PAssert$33/GroupGlobally/Values/Values/Map into PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow
May 30, 2018 9:05:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:05:53.198Z: Fusing consumer PAssert$33/RunChecks into PAssert$33/GetPane/Map
May 30, 2018 9:05:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:05:53.248Z: Fusing consumer PAssert$33/VerifyAssertions/ParDo(DefaultConclude) into PAssert$33/RunChecks
May 30, 2018 9:05:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:05:53.297Z: Unzipping flatten s24-u45 for input s26-reify-value18-c43
May 30, 2018 9:05:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:05:53.344Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Write, through flatten s24-u45, into producer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 30, 2018 9:05:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:05:53.396Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify into PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
May 30, 2018 9:05:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:05:53.443Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Write into PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 30, 2018 9:05:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:05:53.483Z: Fusing consumer PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)
May 30, 2018 9:05:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:05:53.518Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
May 30, 2018 9:05:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:05:53.567Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
May 30, 2018 9:05:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:05:53.626Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into PAssert$33/GroupGlobally/Window.Into()/Window.Assign
May 30, 2018 9:05:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:05:53.681Z: Fusing consumer OutputSideInputs into Create123/Read(CreateSource)
May 30, 2018 9:05:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:05:53.735Z: Fusing consumer PAssert$33/GroupGlobally/Window.Into()/Window.Assign into OutputSideInputs
May 30, 2018 9:05:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:05:53.788Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
May 30, 2018 9:05:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:05:53.831Z: Fusing consumer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map into PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
May 30, 2018 9:05:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:05:53.891Z: Fusing consumer PAssert$33/GroupGlobally/RewindowActuals/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map
May 30, 2018 9:05:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:05:53.947Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read
May 30, 2018 9:05:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:05:54.000Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
May 30, 2018 9:05:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:05:54.042Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
May 30, 2018 9:05:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:05:54.106Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
May 30, 2018 9:05:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:05:54.156Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
May 30, 2018 9:05:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:05:54.214Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
May 30, 2018 9:05:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:05:54.269Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into Create47/Read(CreateSource)
May 30, 2018 9:05:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:05:54.317Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
May 30, 2018 9:05:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:05:54.369Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
May 30, 2018 9:05:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:05:54.429Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
May 30, 2018 9:05:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:05:54.463Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
May 30, 2018 9:05:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:05:54.508Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
May 30, 2018 9:05:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:05:54.547Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
May 30, 2018 9:05:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:05:55.101Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Create
May 30, 2018 9:05:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:05:55.151Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Create
May 30, 2018 9:05:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:05:55.207Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
May 30, 2018 9:05:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:05:55.207Z: Starting 1 workers in us-central1-b...
May 30, 2018 9:05:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:05:55.264Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
May 30, 2018 9:05:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:05:55.525Z: Executing operation PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 30, 2018 9:05:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:05:55.588Z: Executing operation Create47/Read(CreateSource)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
May 30, 2018 9:06:06 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:06:05.341Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
May 30, 2018 9:06:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:06:16.035Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
May 30, 2018 9:06:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:06:16.066Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 30, 2018 9:06:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:06:40.343Z: Workers have started successfully.
May 30, 2018 9:07:32 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:07:30.856Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
May 30, 2018 9:07:32 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:07:30.970Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
May 30, 2018 9:07:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:07:38.357Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
May 30, 2018 9:07:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:07:38.449Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
May 30, 2018 9:07:50 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:07:50.271Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
May 30, 2018 9:07:50 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:07:50.492Z: Executing operation Create123/Read(CreateSource)+OutputSideInputs+PAssert$33/GroupGlobally/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write
May 30, 2018 9:07:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:07:56.943Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Close
May 30, 2018 9:07:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:07:57.037Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$33/GroupGlobally/RewindowActuals/Window.Assign+PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 30, 2018 9:08:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:07:59.954Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Close
May 30, 2018 9:08:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:08:00.063Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Read+PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$33/GroupGlobally/Values/Values/Map+PAssert$33/GroupGlobally/ParDo(Concat)+PAssert$33/GetPane/Map+PAssert$33/RunChecks+PAssert$33/VerifyAssertions/ParDo(DefaultConclude)
May 30, 2018 9:08:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:08:04.337Z: Cleaning up.
May 30, 2018 9:08:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:08:04.489Z: Stopping worker pool...
May 30, 2018 9:10:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:10:19.259Z: Autoscaling: Resized worker pool from 1 to 0.
May 30, 2018 9:10:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T21:10:19.307Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 30, 2018 9:10:56 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-05-30_14_05_43-16634236301899883333 finished with status DONE.
May 30, 2018 9:10:56 PM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-05-30_14_05_43-16634236301899883333. Found 1 success, 0 failures out of 1 expected assertions.
Gradle Test Executor 43 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest FAILED
209 tests completed, 34 failed, 2 skipped
Finished generating test XML results (0.424 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerTest>
Generating HTML test report...
Finished generating test html results (0.453 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest>
:beam-runners-google-cloud-dataflow-java:validatesRunnerTest (Thread[Task worker for ':' Thread 5,5,main]) completed. Took 2 hrs 26 mins 42.316 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:validatesRunnerTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 27m 44s
38 actionable tasks: 34 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/fkq3kqm6bmukm
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user katarzyna.kucharczyk@polidea.com
Not sending mail to unregistered user robbe.sneyders@ml6.eu
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user schroederc@google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user sidhom@google.com
Not sending mail to unregistered user cademarkegard@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ammons@google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Build failed in Jenkins:
beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #379
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/379/display/redirect?page=changes>
Changes:
[iemejia] Update postgres version to 42.2.2 (Java 8)
[coheigea] Update README to include virtualenv in the build instructions
[kenn] Finish RowType -> Schema rename
------------------------------------------
[...truncated 18.18 MB...]
INFO: Adding PAssert$33/GroupGlobally/RewindowActuals/Window.Assign as step s18
May 30, 2018 6:38:48 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map as step s19
May 30, 2018 6:38:48 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveActualsTriggering/Flatten.PCollections as step s20
May 30, 2018 6:38:48 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Create.Values/Read(CreateSource) as step s21
May 30, 2018 6:38:48 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign as step s22
May 30, 2018 6:38:48 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveDummyTriggering/Flatten.PCollections as step s23
May 30, 2018 6:38:48 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/FlattenDummyAndContents as step s24
May 30, 2018 6:38:48 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/NeverTrigger/Flatten.PCollections as step s25
May 30, 2018 6:38:48 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GroupDummyAndContents as step s26
May 30, 2018 6:38:48 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Values/Values/Map as step s27
May 30, 2018 6:38:48 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/ParDo(Concat) as step s28
May 30, 2018 6:38:48 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GetPane/Map as step s29
May 30, 2018 6:38:48 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/RunChecks as step s30
May 30, 2018 6:38:48 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/VerifyAssertions/ParDo(DefaultConclude) as step s31
May 30, 2018 6:38:48 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0530183843-209d6c83/output/results/staging/
May 30, 2018 6:38:48 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <71120 bytes, hash JnySZQCa59O5XxzoZ7v5ug> to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0530183843-209d6c83/output/results/staging/pipeline-JnySZQCa59O5XxzoZ7v5ug.pb
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 30, 2018 6:38:49 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-05-30_11_38_48-8199330797739115718?project=apache-beam-testing
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Submitted job: 2018-05-30_11_38_48-8199330797739115718
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 30, 2018 6:38:49 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-05-30_11_38_48-8199330797739115718
May 30, 2018 6:38:49 PM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-05-30_11_38_48-8199330797739115718 with 1 expected assertions.
May 30, 2018 6:39:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:38:48.573Z: Autoscaling is enabled for job 2018-05-30_11_38_48-8199330797739115718. The number of workers will be between 1 and 1000.
May 30, 2018 6:39:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:38:48.587Z: Autoscaling was automatically enabled for job 2018-05-30_11_38_48-8199330797739115718.
May 30, 2018 6:39:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:38:51.218Z: Checking required Cloud APIs are enabled.
May 30, 2018 6:39:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:38:51.378Z: Checking permissions granted to controller Service Account.
May 30, 2018 6:39:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:39:01.994Z: Worker configuration: n1-standard-1 in us-central1-b.
May 30, 2018 6:39:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:39:02.378Z: Expanding CoGroupByKey operations into optimizable parts.
May 30, 2018 6:39:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:39:02.574Z: Expanding GroupByKey operations into optimizable parts.
May 30, 2018 6:39:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:39:02.611Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
May 30, 2018 6:39:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:39:02.887Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
May 30, 2018 6:39:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:39:02.935Z: Elided trivial flatten
May 30, 2018 6:39:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:39:02.983Z: Elided trivial flatten
May 30, 2018 6:39:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:39:03.027Z: Elided trivial flatten
May 30, 2018 6:39:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:39:03.074Z: Unzipping flatten s24 for input s19.org.apache.beam.sdk.values.PCollection.<init>:329#8fd0f908e3ea90e3
May 30, 2018 6:39:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:39:03.112Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Reify, through flatten PAssert$33/GroupGlobally/FlattenDummyAndContents, into producer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map
May 30, 2018 6:39:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:39:03.159Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow into PAssert$33/GroupGlobally/GroupDummyAndContents/Read
May 30, 2018 6:39:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:39:03.207Z: Fusing consumer PAssert$33/GroupGlobally/ParDo(Concat) into PAssert$33/GroupGlobally/Values/Values/Map
May 30, 2018 6:39:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:39:03.256Z: Fusing consumer PAssert$33/GetPane/Map into PAssert$33/GroupGlobally/ParDo(Concat)
May 30, 2018 6:39:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:39:03.301Z: Fusing consumer PAssert$33/GroupGlobally/Values/Values/Map into PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow
May 30, 2018 6:39:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:39:03.347Z: Fusing consumer PAssert$33/RunChecks into PAssert$33/GetPane/Map
May 30, 2018 6:39:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:39:03.394Z: Fusing consumer PAssert$33/VerifyAssertions/ParDo(DefaultConclude) into PAssert$33/RunChecks
May 30, 2018 6:39:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:39:03.442Z: Unzipping flatten s24-u45 for input s26-reify-value18-c43
May 30, 2018 6:39:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:39:03.480Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Write, through flatten s24-u45, into producer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 30, 2018 6:39:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:39:03.524Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify into PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
May 30, 2018 6:39:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:39:03.572Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Write into PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 30, 2018 6:39:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:39:03.618Z: Fusing consumer PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)
May 30, 2018 6:39:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:39:03.663Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
May 30, 2018 6:39:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:39:03.707Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
May 30, 2018 6:39:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:39:03.753Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into PAssert$33/GroupGlobally/Window.Into()/Window.Assign
May 30, 2018 6:39:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:39:03.798Z: Fusing consumer OutputSideInputs into Create123/Read(CreateSource)
May 30, 2018 6:39:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:39:03.852Z: Fusing consumer PAssert$33/GroupGlobally/Window.Into()/Window.Assign into OutputSideInputs
May 30, 2018 6:39:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:39:03.896Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
May 30, 2018 6:39:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:39:03.942Z: Fusing consumer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map into PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
May 30, 2018 6:39:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:39:03.982Z: Fusing consumer PAssert$33/GroupGlobally/RewindowActuals/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map
May 30, 2018 6:39:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:39:04.029Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read
May 30, 2018 6:39:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:39:04.072Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
May 30, 2018 6:39:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:39:04.128Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
May 30, 2018 6:39:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:39:04.172Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
May 30, 2018 6:39:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:39:04.217Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
May 30, 2018 6:39:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:39:04.260Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
May 30, 2018 6:39:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:39:04.307Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into Create47/Read(CreateSource)
May 30, 2018 6:39:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:39:04.357Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
May 30, 2018 6:39:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:39:04.392Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
May 30, 2018 6:39:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:39:04.433Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
May 30, 2018 6:39:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:39:04.481Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
May 30, 2018 6:39:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:39:04.533Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
May 30, 2018 6:39:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:39:04.573Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
May 30, 2018 6:39:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:39:05.092Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Create
May 30, 2018 6:39:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:39:05.128Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Create
May 30, 2018 6:39:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:39:05.175Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
May 30, 2018 6:39:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:39:05.199Z: Starting 1 workers in us-central1-b...
May 30, 2018 6:39:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:39:05.214Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
May 30, 2018 6:39:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:39:05.555Z: Executing operation Create47/Read(CreateSource)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
May 30, 2018 6:39:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:39:05.601Z: Executing operation PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 30, 2018 6:39:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:39:14.961Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
May 30, 2018 6:39:47 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:39:46.867Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
May 30, 2018 6:39:47 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:39:46.909Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 30, 2018 6:40:03 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:40:02.688Z: Workers have started successfully.
May 30, 2018 6:40:29 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:40:29.098Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
May 30, 2018 6:40:29 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:40:29.204Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
May 30, 2018 6:40:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:40:36.981Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
May 30, 2018 6:40:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:40:37.093Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
May 30, 2018 6:40:50 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:40:50.215Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
May 30, 2018 6:40:50 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:40:50.379Z: Executing operation Create123/Read(CreateSource)+OutputSideInputs+PAssert$33/GroupGlobally/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write
May 30, 2018 6:40:56 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:40:53.689Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Close
May 30, 2018 6:40:56 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:40:53.815Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$33/GroupGlobally/RewindowActuals/Window.Assign+PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 30, 2018 6:41:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:40:58.401Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Close
May 30, 2018 6:41:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:40:58.510Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Read+PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$33/GroupGlobally/Values/Values/Map+PAssert$33/GroupGlobally/ParDo(Concat)+PAssert$33/GetPane/Map+PAssert$33/RunChecks+PAssert$33/VerifyAssertions/ParDo(DefaultConclude)
May 30, 2018 6:41:02 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:41:01.695Z: Cleaning up.
May 30, 2018 6:41:02 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:41:01.920Z: Stopping worker pool...
May 30, 2018 6:42:50 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:42:49.766Z: Autoscaling: Resized worker pool from 1 to 0.
May 30, 2018 6:42:50 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:42:49.816Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 30, 2018 6:42:50 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T18:42:49.879Z: Worker pool stopped.
May 30, 2018 6:42:58 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-05-30_11_38_48-8199330797739115718 finished with status DONE.
May 30, 2018 6:42:58 PM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-05-30_11_38_48-8199330797739115718. Found 1 success, 0 failures out of 1 expected assertions.
Gradle Test Executor 37 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest
209 tests completed, 34 failed, 2 skipped
Finished generating test XML results (0.599 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerTest>
Generating HTML test report...
Finished generating test html results (0.483 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest>
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest FAILED
:beam-runners-google-cloud-dataflow-java:validatesRunnerTest (Thread[Task worker for ':',5,main]) completed. Took 2 hrs 21 mins 50.367 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:validatesRunnerTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 23m 9s
38 actionable tasks: 35 executed, 3 from cache
Publishing build scan...
https://gradle.com/s/44ltotfy6fefo
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user katarzyna.kucharczyk@polidea.com
Not sending mail to unregistered user robbe.sneyders@ml6.eu
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user schroederc@google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user sidhom@google.com
Not sending mail to unregistered user cademarkegard@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ammons@google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Build failed in Jenkins:
beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #378
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/378/display/redirect?page=changes>
Changes:
[kenn] Add equals, hashCode, and structuralValue to Nexmark model objects
[cademarkegard] fix errorprone annotations and enable failOnWarning
------------------------------------------
[...truncated 18.40 MB...]
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map as step s17
May 30, 2018 4:15:25 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RewindowActuals/Window.Assign as step s18
May 30, 2018 4:15:25 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map as step s19
May 30, 2018 4:15:25 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveActualsTriggering/Flatten.PCollections as step s20
May 30, 2018 4:15:25 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Create.Values/Read(CreateSource) as step s21
May 30, 2018 4:15:25 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign as step s22
May 30, 2018 4:15:25 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveDummyTriggering/Flatten.PCollections as step s23
May 30, 2018 4:15:25 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/FlattenDummyAndContents as step s24
May 30, 2018 4:15:25 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/NeverTrigger/Flatten.PCollections as step s25
May 30, 2018 4:15:25 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GroupDummyAndContents as step s26
May 30, 2018 4:15:25 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Values/Values/Map as step s27
May 30, 2018 4:15:25 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/ParDo(Concat) as step s28
May 30, 2018 4:15:25 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GetPane/Map as step s29
May 30, 2018 4:15:25 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/RunChecks as step s30
May 30, 2018 4:15:25 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/VerifyAssertions/ParDo(DefaultConclude) as step s31
May 30, 2018 4:15:25 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0530161523-ca7e1bed/output/results/staging/
May 30, 2018 4:15:26 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <71120 bytes, hash AUBBMuZMFnr3SgunDTJxTw> to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0530161523-ca7e1bed/output/results/staging/pipeline-AUBBMuZMFnr3SgunDTJxTw.pb
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 30, 2018 4:15:27 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-05-30_09_15_26-11653205633351778737?project=apache-beam-testing
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Submitted job: 2018-05-30_09_15_26-11653205633351778737
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 30, 2018 4:15:27 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-05-30_09_15_26-11653205633351778737
May 30, 2018 4:15:27 PM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-05-30_09_15_26-11653205633351778737 with 1 expected assertions.
May 30, 2018 4:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:15:26.583Z: Autoscaling is enabled for job 2018-05-30_09_15_26-11653205633351778737. The number of workers will be between 1 and 1000.
May 30, 2018 4:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:15:26.623Z: Autoscaling was automatically enabled for job 2018-05-30_09_15_26-11653205633351778737.
May 30, 2018 4:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:15:29.156Z: Checking required Cloud APIs are enabled.
May 30, 2018 4:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:15:29.369Z: Checking permissions granted to controller Service Account.
May 30, 2018 4:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:15:33.392Z: Worker configuration: n1-standard-1 in us-central1-b.
May 30, 2018 4:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:15:33.865Z: Expanding CoGroupByKey operations into optimizable parts.
May 30, 2018 4:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:15:34.028Z: Expanding GroupByKey operations into optimizable parts.
May 30, 2018 4:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:15:34.076Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
May 30, 2018 4:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:15:34.313Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
May 30, 2018 4:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:15:34.364Z: Elided trivial flatten
May 30, 2018 4:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:15:34.395Z: Elided trivial flatten
May 30, 2018 4:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:15:34.441Z: Elided trivial flatten
May 30, 2018 4:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:15:34.489Z: Unzipping flatten s24 for input s19.org.apache.beam.sdk.values.PCollection.<init>:329#8fd0f908e3ea90e3
May 30, 2018 4:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:15:34.534Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Reify, through flatten PAssert$33/GroupGlobally/FlattenDummyAndContents, into producer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map
May 30, 2018 4:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:15:34.573Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow into PAssert$33/GroupGlobally/GroupDummyAndContents/Read
May 30, 2018 4:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:15:34.621Z: Fusing consumer PAssert$33/GroupGlobally/ParDo(Concat) into PAssert$33/GroupGlobally/Values/Values/Map
May 30, 2018 4:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:15:34.666Z: Fusing consumer PAssert$33/GetPane/Map into PAssert$33/GroupGlobally/ParDo(Concat)
May 30, 2018 4:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:15:34.705Z: Fusing consumer PAssert$33/GroupGlobally/Values/Values/Map into PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow
May 30, 2018 4:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:15:34.745Z: Fusing consumer PAssert$33/RunChecks into PAssert$33/GetPane/Map
May 30, 2018 4:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:15:34.783Z: Fusing consumer PAssert$33/VerifyAssertions/ParDo(DefaultConclude) into PAssert$33/RunChecks
May 30, 2018 4:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:15:34.821Z: Unzipping flatten s24-u45 for input s26-reify-value18-c43
May 30, 2018 4:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:15:34.866Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Write, through flatten s24-u45, into producer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 30, 2018 4:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:15:34.910Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify into PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
May 30, 2018 4:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:15:34.961Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Write into PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 30, 2018 4:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:15:35.001Z: Fusing consumer PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)
May 30, 2018 4:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:15:35.047Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
May 30, 2018 4:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:15:35.095Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
May 30, 2018 4:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:15:35.142Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into PAssert$33/GroupGlobally/Window.Into()/Window.Assign
May 30, 2018 4:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:15:35.194Z: Fusing consumer OutputSideInputs into Create123/Read(CreateSource)
May 30, 2018 4:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:15:35.232Z: Fusing consumer PAssert$33/GroupGlobally/Window.Into()/Window.Assign into OutputSideInputs
May 30, 2018 4:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:15:35.276Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
May 30, 2018 4:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:15:35.322Z: Fusing consumer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map into PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
May 30, 2018 4:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:15:35.375Z: Fusing consumer PAssert$33/GroupGlobally/RewindowActuals/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map
May 30, 2018 4:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:15:35.418Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read
May 30, 2018 4:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:15:35.458Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
May 30, 2018 4:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:15:35.506Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
May 30, 2018 4:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:15:35.555Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
May 30, 2018 4:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:15:35.594Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
May 30, 2018 4:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:15:35.632Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
May 30, 2018 4:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:15:35.677Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into Create47/Read(CreateSource)
May 30, 2018 4:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:15:35.725Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
May 30, 2018 4:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:15:35.770Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
May 30, 2018 4:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:15:35.819Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
May 30, 2018 4:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:15:35.867Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
May 30, 2018 4:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:15:35.908Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
May 30, 2018 4:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:15:35.956Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
May 30, 2018 4:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:15:36.444Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Create
May 30, 2018 4:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:15:36.481Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Create
May 30, 2018 4:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:15:36.515Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
May 30, 2018 4:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:15:36.553Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
May 30, 2018 4:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:15:36.553Z: Starting 1 workers in us-central1-b...
May 30, 2018 4:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:15:36.856Z: Executing operation PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 30, 2018 4:15:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:15:36.913Z: Executing operation Create47/Read(CreateSource)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
May 30, 2018 4:15:46 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:15:44.558Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
May 30, 2018 4:15:56 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:15:55.178Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
May 30, 2018 4:15:56 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:15:55.219Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 30, 2018 4:16:21 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:16:18.625Z: Workers have started successfully.
May 30, 2018 4:16:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:16:43.715Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
May 30, 2018 4:16:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:16:43.801Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
May 30, 2018 4:16:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:16:50.085Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
May 30, 2018 4:16:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:16:50.172Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
May 30, 2018 4:17:02 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:17:01.922Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
May 30, 2018 4:17:02 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:17:02.102Z: Executing operation Create123/Read(CreateSource)+OutputSideInputs+PAssert$33/GroupGlobally/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write
May 30, 2018 4:17:07 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:17:06.630Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Close
May 30, 2018 4:17:07 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:17:06.768Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$33/GroupGlobally/RewindowActuals/Window.Assign+PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 30, 2018 4:17:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:17:10.758Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Close
May 30, 2018 4:17:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:17:10.829Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Read+PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$33/GroupGlobally/Values/Values/Map+PAssert$33/GroupGlobally/ParDo(Concat)+PAssert$33/GetPane/Map+PAssert$33/RunChecks+PAssert$33/VerifyAssertions/ParDo(DefaultConclude)
May 30, 2018 4:17:15 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:17:15.041Z: Cleaning up.
May 30, 2018 4:17:15 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:17:15.112Z: Stopping worker pool...
May 30, 2018 4:19:24 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:19:23.126Z: Autoscaling: Resized worker pool from 1 to 0.
May 30, 2018 4:19:24 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T16:19:23.257Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 30, 2018 4:19:31 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-05-30_09_15_26-11653205633351778737 finished with status DONE.
May 30, 2018 4:19:31 PM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-05-30_09_15_26-11653205633351778737. Found 1 success, 0 failures out of 1 expected assertions.
Gradle Test Executor 40 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest
209 tests completed, 34 failed, 2 skipped
Finished generating test XML results (0.73 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerTest>
Generating HTML test report...
Finished generating test html results (0.505 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest>
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest FAILED
:beam-runners-google-cloud-dataflow-java:validatesRunnerTest (Thread[Task worker for ':' Thread 15,5,main]) completed. Took 2 hrs 10 mins 4.051 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:validatesRunnerTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 11m 6s
38 actionable tasks: 34 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/l2et2kxd76sue
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user katarzyna.kucharczyk@polidea.com
Not sending mail to unregistered user robbe.sneyders@ml6.eu
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user schroederc@google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user sidhom@google.com
Not sending mail to unregistered user cademarkegard@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ammons@google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Build failed in Jenkins:
beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #377
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/377/display/redirect>
------------------------------------------
[...truncated 18.11 MB...]
May 30, 2018 2:04:55 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RewindowActuals/Window.Assign as step s18
May 30, 2018 2:04:55 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map as step s19
May 30, 2018 2:04:55 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveActualsTriggering/Flatten.PCollections as step s20
May 30, 2018 2:04:55 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Create.Values/Read(CreateSource) as step s21
May 30, 2018 2:04:55 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign as step s22
May 30, 2018 2:04:55 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveDummyTriggering/Flatten.PCollections as step s23
May 30, 2018 2:04:55 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/FlattenDummyAndContents as step s24
May 30, 2018 2:04:55 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/NeverTrigger/Flatten.PCollections as step s25
May 30, 2018 2:04:55 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GroupDummyAndContents as step s26
May 30, 2018 2:04:55 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Values/Values/Map as step s27
May 30, 2018 2:04:55 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/ParDo(Concat) as step s28
May 30, 2018 2:04:55 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GetPane/Map as step s29
May 30, 2018 2:04:55 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/RunChecks as step s30
May 30, 2018 2:04:55 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/VerifyAssertions/ParDo(DefaultConclude) as step s31
May 30, 2018 2:04:55 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0530140451-6aa55bca/output/results/staging/
May 30, 2018 2:04:55 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <71120 bytes, hash -0IZduv5cekB6xlZbFYW1A> to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0530140451-6aa55bca/output/results/staging/pipeline--0IZduv5cekB6xlZbFYW1A.pb
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 30, 2018 2:04:57 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-05-30_07_04_55-2692407867062046058?project=apache-beam-testing
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Submitted job: 2018-05-30_07_04_55-2692407867062046058
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 30, 2018 2:04:57 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-05-30_07_04_55-2692407867062046058
May 30, 2018 2:04:57 PM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-05-30_07_04_55-2692407867062046058 with 1 expected assertions.
May 30, 2018 2:05:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:04:55.971Z: Autoscaling is enabled for job 2018-05-30_07_04_55-2692407867062046058. The number of workers will be between 1 and 1000.
May 30, 2018 2:05:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:04:56.012Z: Autoscaling was automatically enabled for job 2018-05-30_07_04_55-2692407867062046058.
May 30, 2018 2:05:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:04:59.476Z: Checking required Cloud APIs are enabled.
May 30, 2018 2:05:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:04:59.931Z: Checking permissions granted to controller Service Account.
May 30, 2018 2:05:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:05:03.841Z: Worker configuration: n1-standard-1 in us-central1-b.
May 30, 2018 2:05:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:05:04.258Z: Expanding CoGroupByKey operations into optimizable parts.
May 30, 2018 2:05:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:05:04.427Z: Expanding GroupByKey operations into optimizable parts.
May 30, 2018 2:05:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:05:04.467Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
May 30, 2018 2:05:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:05:04.705Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
May 30, 2018 2:05:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:05:04.756Z: Elided trivial flatten
May 30, 2018 2:05:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:05:04.802Z: Elided trivial flatten
May 30, 2018 2:05:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:05:04.847Z: Elided trivial flatten
May 30, 2018 2:05:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:05:04.897Z: Unzipping flatten s24 for input s19.org.apache.beam.sdk.values.PCollection.<init>:329#8fd0f908e3ea90e3
May 30, 2018 2:05:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:05:04.942Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Reify, through flatten PAssert$33/GroupGlobally/FlattenDummyAndContents, into producer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map
May 30, 2018 2:05:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:05:04.977Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow into PAssert$33/GroupGlobally/GroupDummyAndContents/Read
May 30, 2018 2:05:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:05:05.026Z: Fusing consumer PAssert$33/GroupGlobally/ParDo(Concat) into PAssert$33/GroupGlobally/Values/Values/Map
May 30, 2018 2:05:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:05:05.073Z: Fusing consumer PAssert$33/GetPane/Map into PAssert$33/GroupGlobally/ParDo(Concat)
May 30, 2018 2:05:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:05:05.119Z: Fusing consumer PAssert$33/GroupGlobally/Values/Values/Map into PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow
May 30, 2018 2:05:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:05:05.167Z: Fusing consumer PAssert$33/RunChecks into PAssert$33/GetPane/Map
May 30, 2018 2:05:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:05:05.214Z: Fusing consumer PAssert$33/VerifyAssertions/ParDo(DefaultConclude) into PAssert$33/RunChecks
May 30, 2018 2:05:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:05:05.241Z: Unzipping flatten s24-u45 for input s26-reify-value18-c43
May 30, 2018 2:05:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:05:05.289Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Write, through flatten s24-u45, into producer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 30, 2018 2:05:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:05:05.325Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify into PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
May 30, 2018 2:05:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:05:05.368Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Write into PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 30, 2018 2:05:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:05:05.417Z: Fusing consumer PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)
May 30, 2018 2:05:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:05:05.464Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
May 30, 2018 2:05:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:05:05.512Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
May 30, 2018 2:05:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:05:05.558Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into PAssert$33/GroupGlobally/Window.Into()/Window.Assign
May 30, 2018 2:05:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:05:05.593Z: Fusing consumer OutputSideInputs into Create123/Read(CreateSource)
May 30, 2018 2:05:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:05:05.631Z: Fusing consumer PAssert$33/GroupGlobally/Window.Into()/Window.Assign into OutputSideInputs
May 30, 2018 2:05:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:05:05.671Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
May 30, 2018 2:05:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:05:05.718Z: Fusing consumer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map into PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
May 30, 2018 2:05:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:05:05.752Z: Fusing consumer PAssert$33/GroupGlobally/RewindowActuals/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map
May 30, 2018 2:05:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:05:05.793Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read
May 30, 2018 2:05:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:05:05.838Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
May 30, 2018 2:05:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:05:05.886Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
May 30, 2018 2:05:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:05:05.935Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
May 30, 2018 2:05:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:05:05.973Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
May 30, 2018 2:05:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:05:06.024Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
May 30, 2018 2:05:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:05:06.067Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into Create47/Read(CreateSource)
May 30, 2018 2:05:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:05:06.108Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
May 30, 2018 2:05:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:05:06.151Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
May 30, 2018 2:05:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:05:06.191Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
May 30, 2018 2:05:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:05:06.236Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
May 30, 2018 2:05:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:05:06.281Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
May 30, 2018 2:05:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:05:06.321Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
May 30, 2018 2:05:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:05:06.796Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Create
May 30, 2018 2:05:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:05:06.831Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Create
May 30, 2018 2:05:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:05:06.869Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
May 30, 2018 2:05:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:05:06.885Z: Starting 1 workers in us-central1-b...
May 30, 2018 2:05:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:05:06.907Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
May 30, 2018 2:05:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:05:07.120Z: Executing operation Create47/Read(CreateSource)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
May 30, 2018 2:05:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:05:07.155Z: Executing operation PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 30, 2018 2:05:15 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:05:14.756Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
May 30, 2018 2:05:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:05:25.393Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
May 30, 2018 2:05:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:05:25.436Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 30, 2018 2:05:47 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:05:46.461Z: Workers have started successfully.
May 30, 2018 2:05:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:05:58.700Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
May 30, 2018 2:05:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:05:58.805Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
May 30, 2018 2:06:06 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:06:05.565Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
May 30, 2018 2:06:06 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:06:05.674Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
May 30, 2018 2:06:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:06:16.957Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
May 30, 2018 2:06:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:06:17.137Z: Executing operation Create123/Read(CreateSource)+OutputSideInputs+PAssert$33/GroupGlobally/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write
May 30, 2018 2:06:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:06:22.558Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Close
May 30, 2018 2:06:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:06:22.663Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$33/GroupGlobally/RewindowActuals/Window.Assign+PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 30, 2018 2:06:29 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:06:27.304Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Close
May 30, 2018 2:06:29 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:06:27.408Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Read+PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$33/GroupGlobally/Values/Values/Map+PAssert$33/GroupGlobally/ParDo(Concat)+PAssert$33/GetPane/Map+PAssert$33/RunChecks+PAssert$33/VerifyAssertions/ParDo(DefaultConclude)
May 30, 2018 2:06:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:06:30.839Z: Cleaning up.
May 30, 2018 2:06:33 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:06:30.973Z: Stopping worker pool...
May 30, 2018 2:07:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:07:58.253Z: Autoscaling: Resized worker pool from 1 to 0.
May 30, 2018 2:07:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:07:58.279Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 30, 2018 2:07:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T14:07:58.313Z: Worker pool stopped.
May 30, 2018 2:08:06 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-05-30_07_04_55-2692407867062046058 finished with status DONE.
May 30, 2018 2:08:06 PM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-05-30_07_04_55-2692407867062046058. Found 1 success, 0 failures out of 1 expected assertions.
Gradle Test Executor 38 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest
209 tests completed, 34 failed, 2 skipped
Finished generating test XML results (0.535 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerTest>
Generating HTML test report...
Finished generating test html results (0.747 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest>
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest FAILED
:beam-runners-google-cloud-dataflow-java:validatesRunnerTest (Thread[Task worker for ':' Thread 29,5,main]) completed. Took 2 hrs 6 mins 31.99 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:validatesRunnerTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 7m 37s
38 actionable tasks: 34 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/cb54uutb3ovke
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user katarzyna.kucharczyk@polidea.com
Not sending mail to unregistered user robbe.sneyders@ml6.eu
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user schroederc@google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user sidhom@google.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ammons@google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Build failed in Jenkins:
beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #376
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/376/display/redirect?page=changes>
Changes:
[timrobertson100] [BEAM-4389] Enable partial updates in ElasticsearchIO
------------------------------------------
[...truncated 18.07 MB...]
May 30, 2018 10:14:15 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map as step s17
May 30, 2018 10:14:15 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RewindowActuals/Window.Assign as step s18
May 30, 2018 10:14:15 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map as step s19
May 30, 2018 10:14:15 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveActualsTriggering/Flatten.PCollections as step s20
May 30, 2018 10:14:15 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Create.Values/Read(CreateSource) as step s21
May 30, 2018 10:14:15 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign as step s22
May 30, 2018 10:14:15 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveDummyTriggering/Flatten.PCollections as step s23
May 30, 2018 10:14:15 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/FlattenDummyAndContents as step s24
May 30, 2018 10:14:15 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/NeverTrigger/Flatten.PCollections as step s25
May 30, 2018 10:14:15 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GroupDummyAndContents as step s26
May 30, 2018 10:14:15 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Values/Values/Map as step s27
May 30, 2018 10:14:15 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/ParDo(Concat) as step s28
May 30, 2018 10:14:15 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GetPane/Map as step s29
May 30, 2018 10:14:15 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/RunChecks as step s30
May 30, 2018 10:14:15 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/VerifyAssertions/ParDo(DefaultConclude) as step s31
May 30, 2018 10:14:15 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0530101410-4bacc57d/output/results/staging/
May 30, 2018 10:14:16 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <71120 bytes, hash GNGMtNFRhnRtQRBFqffYhg> to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0530101410-4bacc57d/output/results/staging/pipeline-GNGMtNFRhnRtQRBFqffYhg.pb
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 30, 2018 10:14:17 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-05-30_03_14_16-10078343783506532308?project=apache-beam-testing
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Submitted job: 2018-05-30_03_14_16-10078343783506532308
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 30, 2018 10:14:17 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-05-30_03_14_16-10078343783506532308
May 30, 2018 10:14:17 AM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-05-30_03_14_16-10078343783506532308 with 1 expected assertions.
May 30, 2018 10:14:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:14:16.623Z: Autoscaling is enabled for job 2018-05-30_03_14_16-10078343783506532308. The number of workers will be between 1 and 1000.
May 30, 2018 10:14:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:14:16.663Z: Autoscaling was automatically enabled for job 2018-05-30_03_14_16-10078343783506532308.
May 30, 2018 10:14:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:14:19.350Z: Checking required Cloud APIs are enabled.
May 30, 2018 10:14:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:14:19.541Z: Checking permissions granted to controller Service Account.
May 30, 2018 10:14:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:14:25.982Z: Worker configuration: n1-standard-1 in us-central1-b.
May 30, 2018 10:14:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:14:26.408Z: Expanding CoGroupByKey operations into optimizable parts.
May 30, 2018 10:14:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:14:26.585Z: Expanding GroupByKey operations into optimizable parts.
May 30, 2018 10:14:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:14:26.622Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
May 30, 2018 10:14:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:14:26.848Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
May 30, 2018 10:14:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:14:26.893Z: Elided trivial flatten
May 30, 2018 10:14:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:14:26.930Z: Elided trivial flatten
May 30, 2018 10:14:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:14:26.972Z: Elided trivial flatten
May 30, 2018 10:14:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:14:27.014Z: Unzipping flatten s24 for input s19.org.apache.beam.sdk.values.PCollection.<init>:329#8fd0f908e3ea90e3
May 30, 2018 10:14:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:14:27.056Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Reify, through flatten PAssert$33/GroupGlobally/FlattenDummyAndContents, into producer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map
May 30, 2018 10:14:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:14:27.101Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow into PAssert$33/GroupGlobally/GroupDummyAndContents/Read
May 30, 2018 10:14:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:14:27.146Z: Fusing consumer PAssert$33/GroupGlobally/ParDo(Concat) into PAssert$33/GroupGlobally/Values/Values/Map
May 30, 2018 10:14:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:14:27.186Z: Fusing consumer PAssert$33/GetPane/Map into PAssert$33/GroupGlobally/ParDo(Concat)
May 30, 2018 10:14:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:14:27.230Z: Fusing consumer PAssert$33/GroupGlobally/Values/Values/Map into PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow
May 30, 2018 10:14:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:14:27.268Z: Fusing consumer PAssert$33/RunChecks into PAssert$33/GetPane/Map
May 30, 2018 10:14:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:14:27.312Z: Fusing consumer PAssert$33/VerifyAssertions/ParDo(DefaultConclude) into PAssert$33/RunChecks
May 30, 2018 10:14:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:14:27.357Z: Unzipping flatten s24-u45 for input s26-reify-value18-c43
May 30, 2018 10:14:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:14:27.401Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Write, through flatten s24-u45, into producer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 30, 2018 10:14:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:14:27.428Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify into PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
May 30, 2018 10:14:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:14:27.475Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Write into PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 30, 2018 10:14:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:14:27.519Z: Fusing consumer PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)
May 30, 2018 10:14:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:14:27.556Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
May 30, 2018 10:14:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:14:27.600Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
May 30, 2018 10:14:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:14:27.645Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into PAssert$33/GroupGlobally/Window.Into()/Window.Assign
May 30, 2018 10:14:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:14:27.688Z: Fusing consumer OutputSideInputs into Create123/Read(CreateSource)
May 30, 2018 10:14:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:14:27.731Z: Fusing consumer PAssert$33/GroupGlobally/Window.Into()/Window.Assign into OutputSideInputs
May 30, 2018 10:14:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:14:27.771Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
May 30, 2018 10:14:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:14:27.814Z: Fusing consumer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map into PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
May 30, 2018 10:14:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:14:27.857Z: Fusing consumer PAssert$33/GroupGlobally/RewindowActuals/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map
May 30, 2018 10:14:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:14:27.895Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read
May 30, 2018 10:14:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:14:27.939Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
May 30, 2018 10:14:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:14:27.984Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
May 30, 2018 10:14:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:14:28.030Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
May 30, 2018 10:14:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:14:28.075Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
May 30, 2018 10:14:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:14:28.127Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
May 30, 2018 10:14:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:14:28.169Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into Create47/Read(CreateSource)
May 30, 2018 10:14:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:14:28.203Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
May 30, 2018 10:14:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:14:28.247Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
May 30, 2018 10:14:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:14:28.286Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
May 30, 2018 10:14:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:14:28.329Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
May 30, 2018 10:14:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:14:28.367Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
May 30, 2018 10:14:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:14:28.397Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
May 30, 2018 10:14:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:14:28.841Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Create
May 30, 2018 10:14:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:14:28.880Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Create
May 30, 2018 10:14:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:14:28.923Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
May 30, 2018 10:14:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:14:28.938Z: Starting 1 workers in us-central1-b...
May 30, 2018 10:14:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:14:28.965Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
May 30, 2018 10:14:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:14:29.186Z: Executing operation PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 30, 2018 10:14:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:14:29.227Z: Executing operation Create47/Read(CreateSource)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
May 30, 2018 10:14:40 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:14:39.128Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
May 30, 2018 10:14:55 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:14:55.020Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
May 30, 2018 10:14:55 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:14:55.056Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 30, 2018 10:15:15 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:15:14.935Z: Workers have started successfully.
May 30, 2018 10:15:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:15:33.746Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
May 30, 2018 10:15:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:15:33.816Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
May 30, 2018 10:15:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:15:36.627Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
May 30, 2018 10:15:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:15:36.705Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
May 30, 2018 10:15:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:15:52.221Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
May 30, 2018 10:15:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:15:52.404Z: Executing operation Create123/Read(CreateSource)+OutputSideInputs+PAssert$33/GroupGlobally/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write
May 30, 2018 10:15:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:15:56.473Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Close
May 30, 2018 10:15:58 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:15:56.569Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$33/GroupGlobally/RewindowActuals/Window.Assign+PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 30, 2018 10:16:01 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:16:01.121Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Close
May 30, 2018 10:16:01 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:16:01.207Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Read+PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$33/GroupGlobally/Values/Values/Map+PAssert$33/GroupGlobally/ParDo(Concat)+PAssert$33/GetPane/Map+PAssert$33/RunChecks+PAssert$33/VerifyAssertions/ParDo(DefaultConclude)
May 30, 2018 10:16:04 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:16:04.316Z: Cleaning up.
May 30, 2018 10:16:04 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:16:04.427Z: Stopping worker pool...
May 30, 2018 10:17:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:17:34.481Z: Autoscaling: Resized worker pool from 1 to 0.
May 30, 2018 10:17:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:17:34.523Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 30, 2018 10:17:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T10:17:34.577Z: Worker pool stopped.
May 30, 2018 10:17:44 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-05-30_03_14_16-10078343783506532308 finished with status DONE.
May 30, 2018 10:17:44 AM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-05-30_03_14_16-10078343783506532308. Found 1 success, 0 failures out of 1 expected assertions.
Gradle Test Executor 37 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest FAILED
209 tests completed, 34 failed, 2 skipped
Finished generating test XML results (0.217 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerTest>
Generating HTML test report...
Finished generating test html results (0.367 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest>
:beam-runners-google-cloud-dataflow-java:validatesRunnerTest (Thread[Task worker for ':' Thread 13,5,main]) completed. Took 2 hrs 6 mins 19.834 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:validatesRunnerTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 7m 10s
38 actionable tasks: 34 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/vesy4q4aeuqg4
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user katarzyna.kucharczyk@polidea.com
Not sending mail to unregistered user robbe.sneyders@ml6.eu
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user schroederc@google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user sidhom@google.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ammons@google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Build failed in Jenkins:
beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #375
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/375/display/redirect>
------------------------------------------
[...truncated 18.08 MB...]
May 30, 2018 8:06:37 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RewindowActuals/Window.Assign as step s18
May 30, 2018 8:06:37 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map as step s19
May 30, 2018 8:06:37 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveActualsTriggering/Flatten.PCollections as step s20
May 30, 2018 8:06:37 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Create.Values/Read(CreateSource) as step s21
May 30, 2018 8:06:37 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign as step s22
May 30, 2018 8:06:37 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveDummyTriggering/Flatten.PCollections as step s23
May 30, 2018 8:06:37 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/FlattenDummyAndContents as step s24
May 30, 2018 8:06:37 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/NeverTrigger/Flatten.PCollections as step s25
May 30, 2018 8:06:37 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GroupDummyAndContents as step s26
May 30, 2018 8:06:37 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Values/Values/Map as step s27
May 30, 2018 8:06:37 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/ParDo(Concat) as step s28
May 30, 2018 8:06:37 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GetPane/Map as step s29
May 30, 2018 8:06:37 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/RunChecks as step s30
May 30, 2018 8:06:37 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/VerifyAssertions/ParDo(DefaultConclude) as step s31
May 30, 2018 8:06:37 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0530080632-3f02cf21/output/results/staging/
May 30, 2018 8:06:37 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <71120 bytes, hash rcye9WJJfznqKATLeS6fGQ> to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0530080632-3f02cf21/output/results/staging/pipeline-rcye9WJJfznqKATLeS6fGQ.pb
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 30, 2018 8:06:38 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-05-30_01_06_37-15476053250376096158?project=apache-beam-testing
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Submitted job: 2018-05-30_01_06_37-15476053250376096158
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 30, 2018 8:06:38 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-05-30_01_06_37-15476053250376096158
May 30, 2018 8:06:38 AM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-05-30_01_06_37-15476053250376096158 with 1 expected assertions.
May 30, 2018 8:06:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:06:37.959Z: Autoscaling is enabled for job 2018-05-30_01_06_37-15476053250376096158. The number of workers will be between 1 and 1000.
May 30, 2018 8:06:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:06:37.994Z: Autoscaling was automatically enabled for job 2018-05-30_01_06_37-15476053250376096158.
May 30, 2018 8:06:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:06:40.759Z: Checking required Cloud APIs are enabled.
May 30, 2018 8:06:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:06:41.022Z: Checking permissions granted to controller Service Account.
May 30, 2018 8:06:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:06:47.288Z: Worker configuration: n1-standard-1 in us-central1-b.
May 30, 2018 8:06:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:06:48.009Z: Expanding CoGroupByKey operations into optimizable parts.
May 30, 2018 8:06:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:06:48.178Z: Expanding GroupByKey operations into optimizable parts.
May 30, 2018 8:06:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:06:48.220Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
May 30, 2018 8:06:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:06:48.441Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
May 30, 2018 8:06:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:06:48.484Z: Elided trivial flatten
May 30, 2018 8:06:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:06:48.531Z: Elided trivial flatten
May 30, 2018 8:06:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:06:48.581Z: Elided trivial flatten
May 30, 2018 8:06:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:06:48.630Z: Unzipping flatten s24 for input s19.org.apache.beam.sdk.values.PCollection.<init>:329#8fd0f908e3ea90e3
May 30, 2018 8:06:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:06:48.677Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Reify, through flatten PAssert$33/GroupGlobally/FlattenDummyAndContents, into producer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map
May 30, 2018 8:06:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:06:48.725Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow into PAssert$33/GroupGlobally/GroupDummyAndContents/Read
May 30, 2018 8:06:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:06:48.760Z: Fusing consumer PAssert$33/GroupGlobally/ParDo(Concat) into PAssert$33/GroupGlobally/Values/Values/Map
May 30, 2018 8:06:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:06:48.806Z: Fusing consumer PAssert$33/GetPane/Map into PAssert$33/GroupGlobally/ParDo(Concat)
May 30, 2018 8:06:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:06:48.855Z: Fusing consumer PAssert$33/GroupGlobally/Values/Values/Map into PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow
May 30, 2018 8:06:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:06:48.904Z: Fusing consumer PAssert$33/RunChecks into PAssert$33/GetPane/Map
May 30, 2018 8:06:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:06:48.950Z: Fusing consumer PAssert$33/VerifyAssertions/ParDo(DefaultConclude) into PAssert$33/RunChecks
May 30, 2018 8:06:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:06:48.989Z: Unzipping flatten s24-u45 for input s26-reify-value18-c43
May 30, 2018 8:06:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:06:49.034Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Write, through flatten s24-u45, into producer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 30, 2018 8:06:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:06:49.073Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify into PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
May 30, 2018 8:06:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:06:49.121Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Write into PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 30, 2018 8:06:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:06:49.157Z: Fusing consumer PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)
May 30, 2018 8:06:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:06:49.193Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
May 30, 2018 8:06:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:06:49.240Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
May 30, 2018 8:06:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:06:49.288Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into PAssert$33/GroupGlobally/Window.Into()/Window.Assign
May 30, 2018 8:06:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:06:49.326Z: Fusing consumer OutputSideInputs into Create123/Read(CreateSource)
May 30, 2018 8:06:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:06:49.373Z: Fusing consumer PAssert$33/GroupGlobally/Window.Into()/Window.Assign into OutputSideInputs
May 30, 2018 8:06:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:06:49.418Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
May 30, 2018 8:06:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:06:49.457Z: Fusing consumer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map into PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
May 30, 2018 8:06:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:06:49.497Z: Fusing consumer PAssert$33/GroupGlobally/RewindowActuals/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map
May 30, 2018 8:06:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:06:49.526Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read
May 30, 2018 8:06:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:06:49.569Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
May 30, 2018 8:06:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:06:49.616Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
May 30, 2018 8:06:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:06:49.659Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
May 30, 2018 8:06:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:06:49.692Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
May 30, 2018 8:06:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:06:49.728Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
May 30, 2018 8:06:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:06:49.773Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into Create47/Read(CreateSource)
May 30, 2018 8:06:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:06:49.808Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
May 30, 2018 8:06:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:06:49.853Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
May 30, 2018 8:06:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:06:49.900Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
May 30, 2018 8:06:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:06:49.944Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
May 30, 2018 8:06:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:06:49.988Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
May 30, 2018 8:06:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:06:50.022Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
May 30, 2018 8:06:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:06:50.483Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Create
May 30, 2018 8:06:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:06:50.528Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Create
May 30, 2018 8:06:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:06:50.578Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
May 30, 2018 8:06:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:06:50.589Z: Starting 1 workers in us-central1-b...
May 30, 2018 8:06:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:06:50.623Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
May 30, 2018 8:06:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:06:50.879Z: Executing operation Create47/Read(CreateSource)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
May 30, 2018 8:06:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:06:50.926Z: Executing operation PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 30, 2018 8:07:00 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:07:00.230Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
May 30, 2018 8:07:11 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:07:10.830Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
May 30, 2018 8:07:11 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:07:10.872Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 30, 2018 8:07:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:07:33.216Z: Workers have started successfully.
May 30, 2018 8:07:59 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:07:57.756Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
May 30, 2018 8:07:59 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:07:57.839Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
May 30, 2018 8:08:01 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:08:01.342Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
May 30, 2018 8:08:01 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:08:01.436Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
May 30, 2018 8:08:24 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:08:22.893Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
May 30, 2018 8:08:24 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:08:23.089Z: Executing operation Create123/Read(CreateSource)+OutputSideInputs+PAssert$33/GroupGlobally/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write
May 30, 2018 8:08:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:08:30.743Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Close
May 30, 2018 8:08:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:08:30.842Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$33/GroupGlobally/RewindowActuals/Window.Assign+PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 30, 2018 8:08:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:08:35.568Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Close
May 30, 2018 8:08:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:08:35.660Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Read+PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$33/GroupGlobally/Values/Values/Map+PAssert$33/GroupGlobally/ParDo(Concat)+PAssert$33/GetPane/Map+PAssert$33/RunChecks+PAssert$33/VerifyAssertions/ParDo(DefaultConclude)
May 30, 2018 8:08:40 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:08:38.850Z: Cleaning up.
May 30, 2018 8:08:40 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:08:38.954Z: Stopping worker pool...
May 30, 2018 8:10:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:10:07.034Z: Autoscaling: Resized worker pool from 1 to 0.
May 30, 2018 8:10:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:10:07.079Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 30, 2018 8:10:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T08:10:07.129Z: Worker pool stopped.
May 30, 2018 8:10:15 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-05-30_01_06_37-15476053250376096158 finished with status DONE.
May 30, 2018 8:10:15 AM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-05-30_01_06_37-15476053250376096158. Found 1 success, 0 failures out of 1 expected assertions.
Gradle Test Executor 39 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest
209 tests completed, 34 failed, 2 skipped
Finished generating test XML results (0.457 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerTest>
Generating HTML test report...
Finished generating test html results (0.644 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest>
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest FAILED
:beam-runners-google-cloud-dataflow-java:validatesRunnerTest (Thread[Task worker for ':' Thread 14,5,main]) completed. Took 2 hrs 8 mins 24.4 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:validatesRunnerTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 9m 39s
38 actionable tasks: 34 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/xwqdjny2rv264
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user katarzyna.kucharczyk@polidea.com
Not sending mail to unregistered user robbe.sneyders@ml6.eu
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user schroederc@google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user sidhom@google.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ammons@google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Build failed in Jenkins:
beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #374
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/374/display/redirect?page=changes>
Changes:
[github] Make hash function in Coder base class more conservative.
[Pablo] [BEAM-4426]: Addressed DataflowDistributionAccumulatorTest failure on
[aaltay] Support installing Beam SDK from a wheel distribution in SDK containers.
------------------------------------------
[...truncated 18.08 MB...]
May 30, 2018 2:43:37 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map as step s17
May 30, 2018 2:43:37 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RewindowActuals/Window.Assign as step s18
May 30, 2018 2:43:37 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map as step s19
May 30, 2018 2:43:37 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveActualsTriggering/Flatten.PCollections as step s20
May 30, 2018 2:43:37 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Create.Values/Read(CreateSource) as step s21
May 30, 2018 2:43:37 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign as step s22
May 30, 2018 2:43:37 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveDummyTriggering/Flatten.PCollections as step s23
May 30, 2018 2:43:37 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/FlattenDummyAndContents as step s24
May 30, 2018 2:43:37 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/NeverTrigger/Flatten.PCollections as step s25
May 30, 2018 2:43:37 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GroupDummyAndContents as step s26
May 30, 2018 2:43:37 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Values/Values/Map as step s27
May 30, 2018 2:43:37 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/ParDo(Concat) as step s28
May 30, 2018 2:43:37 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GetPane/Map as step s29
May 30, 2018 2:43:37 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/RunChecks as step s30
May 30, 2018 2:43:37 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/VerifyAssertions/ParDo(DefaultConclude) as step s31
May 30, 2018 2:43:37 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0530024334-dfd74c47/output/results/staging/
May 30, 2018 2:43:38 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <71120 bytes, hash P7UZub7p_vEPIRM6Vr4jKA> to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0530024334-dfd74c47/output/results/staging/pipeline-P7UZub7p_vEPIRM6Vr4jKA.pb
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 30, 2018 2:43:39 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-05-29_19_43_38-2258109928401773665?project=apache-beam-testing
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Submitted job: 2018-05-29_19_43_38-2258109928401773665
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 30, 2018 2:43:39 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-05-29_19_43_38-2258109928401773665
May 30, 2018 2:43:39 AM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-05-29_19_43_38-2258109928401773665 with 1 expected assertions.
May 30, 2018 2:43:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:43:38.496Z: Autoscaling is enabled for job 2018-05-29_19_43_38-2258109928401773665. The number of workers will be between 1 and 1000.
May 30, 2018 2:43:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:43:38.522Z: Autoscaling was automatically enabled for job 2018-05-29_19_43_38-2258109928401773665.
May 30, 2018 2:43:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:43:41.638Z: Checking required Cloud APIs are enabled.
May 30, 2018 2:43:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:43:42.089Z: Checking permissions granted to controller Service Account.
May 30, 2018 2:43:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:43:47.280Z: Worker configuration: n1-standard-1 in us-central1-b.
May 30, 2018 2:43:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:43:47.733Z: Expanding CoGroupByKey operations into optimizable parts.
May 30, 2018 2:43:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:43:47.961Z: Expanding GroupByKey operations into optimizable parts.
May 30, 2018 2:43:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:43:47.981Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
May 30, 2018 2:43:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:43:48.237Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
May 30, 2018 2:43:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:43:48.325Z: Elided trivial flatten
May 30, 2018 2:43:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:43:48.349Z: Elided trivial flatten
May 30, 2018 2:43:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:43:48.422Z: Elided trivial flatten
May 30, 2018 2:43:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:43:48.450Z: Unzipping flatten s24 for input s19.org.apache.beam.sdk.values.PCollection.<init>:329#8fd0f908e3ea90e3
May 30, 2018 2:43:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:43:48.471Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Reify, through flatten PAssert$33/GroupGlobally/FlattenDummyAndContents, into producer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map
May 30, 2018 2:43:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:43:48.493Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow into PAssert$33/GroupGlobally/GroupDummyAndContents/Read
May 30, 2018 2:43:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:43:48.548Z: Fusing consumer PAssert$33/GroupGlobally/ParDo(Concat) into PAssert$33/GroupGlobally/Values/Values/Map
May 30, 2018 2:43:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:43:48.576Z: Fusing consumer PAssert$33/GetPane/Map into PAssert$33/GroupGlobally/ParDo(Concat)
May 30, 2018 2:43:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:43:48.602Z: Fusing consumer PAssert$33/GroupGlobally/Values/Values/Map into PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow
May 30, 2018 2:43:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:43:48.625Z: Fusing consumer PAssert$33/RunChecks into PAssert$33/GetPane/Map
May 30, 2018 2:43:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:43:48.650Z: Fusing consumer PAssert$33/VerifyAssertions/ParDo(DefaultConclude) into PAssert$33/RunChecks
May 30, 2018 2:43:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:43:48.677Z: Unzipping flatten s24-u45 for input s26-reify-value18-c43
May 30, 2018 2:43:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:43:48.702Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Write, through flatten s24-u45, into producer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 30, 2018 2:43:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:43:48.725Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify into PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
May 30, 2018 2:43:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:43:48.747Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Write into PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 30, 2018 2:43:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:43:48.770Z: Fusing consumer PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)
May 30, 2018 2:43:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:43:48.793Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
May 30, 2018 2:43:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:43:48.817Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
May 30, 2018 2:43:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:43:48.843Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into PAssert$33/GroupGlobally/Window.Into()/Window.Assign
May 30, 2018 2:43:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:43:48.876Z: Fusing consumer OutputSideInputs into Create123/Read(CreateSource)
May 30, 2018 2:43:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:43:48.899Z: Fusing consumer PAssert$33/GroupGlobally/Window.Into()/Window.Assign into OutputSideInputs
May 30, 2018 2:43:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:43:48.923Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
May 30, 2018 2:43:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:43:48.947Z: Fusing consumer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map into PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
May 30, 2018 2:43:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:43:48.968Z: Fusing consumer PAssert$33/GroupGlobally/RewindowActuals/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map
May 30, 2018 2:43:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:43:48.992Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read
May 30, 2018 2:43:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:43:49.025Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
May 30, 2018 2:43:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:43:49.053Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
May 30, 2018 2:43:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:43:49.079Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
May 30, 2018 2:43:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:43:49.102Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
May 30, 2018 2:43:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:43:49.125Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
May 30, 2018 2:43:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:43:49.158Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into Create47/Read(CreateSource)
May 30, 2018 2:43:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:43:49.185Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
May 30, 2018 2:43:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:43:49.222Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
May 30, 2018 2:43:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:43:49.255Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
May 30, 2018 2:43:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:43:49.280Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
May 30, 2018 2:43:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:43:49.315Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
May 30, 2018 2:43:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:43:49.351Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
May 30, 2018 2:43:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:43:49.750Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Create
May 30, 2018 2:43:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:43:49.786Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Create
May 30, 2018 2:43:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:43:49.815Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
May 30, 2018 2:43:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:43:49.832Z: Starting 1 workers in us-central1-b...
May 30, 2018 2:43:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:43:49.845Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
May 30, 2018 2:43:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:43:50.045Z: Executing operation Create47/Read(CreateSource)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
May 30, 2018 2:43:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:43:50.079Z: Executing operation PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 30, 2018 2:44:00 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:44:00.026Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
May 30, 2018 2:44:11 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:44:10.784Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
May 30, 2018 2:44:11 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:44:10.817Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 30, 2018 2:44:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:44:28.164Z: Workers have started successfully.
May 30, 2018 2:44:55 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:44:54.735Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
May 30, 2018 2:44:55 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:44:54.786Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
May 30, 2018 2:45:04 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:45:02.773Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
May 30, 2018 2:45:04 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:45:02.841Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
May 30, 2018 2:45:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:45:15.906Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
May 30, 2018 2:45:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:45:16.064Z: Executing operation Create123/Read(CreateSource)+OutputSideInputs+PAssert$33/GroupGlobally/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write
May 30, 2018 2:45:22 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:45:22.548Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Close
May 30, 2018 2:45:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:45:22.618Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$33/GroupGlobally/RewindowActuals/Window.Assign+PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 30, 2018 2:45:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:45:28.373Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Close
May 30, 2018 2:45:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:45:28.453Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Read+PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$33/GroupGlobally/Values/Values/Map+PAssert$33/GroupGlobally/ParDo(Concat)+PAssert$33/GetPane/Map+PAssert$33/RunChecks+PAssert$33/VerifyAssertions/ParDo(DefaultConclude)
May 30, 2018 2:45:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:45:33.772Z: Cleaning up.
May 30, 2018 2:45:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:45:33.863Z: Stopping worker pool...
May 30, 2018 2:47:15 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:47:15.737Z: Autoscaling: Resized worker pool from 1 to 0.
May 30, 2018 2:47:15 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T02:47:15.761Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 30, 2018 2:47:24 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-05-29_19_43_38-2258109928401773665 finished with status DONE.
May 30, 2018 2:47:24 AM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-05-29_19_43_38-2258109928401773665. Found 1 success, 0 failures out of 1 expected assertions.
Gradle Test Executor 40 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest
209 tests completed, 34 failed, 2 skipped
Finished generating test XML results (0.639 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerTest>
Generating HTML test report...
Finished generating test html results (0.672 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest>
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest FAILED
:beam-runners-google-cloud-dataflow-java:validatesRunnerTest (Thread[Task worker for ':' Thread 21,5,main]) completed. Took 2 hrs 10 mins 32.383 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:validatesRunnerTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 11m 24s
38 actionable tasks: 34 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/xuq3w77hikoqa
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user katarzyna.kucharczyk@polidea.com
Not sending mail to unregistered user robbe.sneyders@ml6.eu
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user schroederc@google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user sidhom@google.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ammons@google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Build failed in Jenkins:
beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #373
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/373/display/redirect?page=changes>
Changes:
[iemejia] [BEAM-4321] Enforce ErrorProne analysis in join-library extensions
[kenn] Force load of Calcite JDBC driver (avoids internal error)
[kenn] Explicitly load Beam JDBC driver before test
[iemejia] [BEAM-3813] Support (de)serialization of S3 encryption options via JSON
------------------------------------------
[...truncated 18.07 MB...]
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey as step s16
May 30, 2018 12:32:03 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map as step s17
May 30, 2018 12:32:03 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RewindowActuals/Window.Assign as step s18
May 30, 2018 12:32:03 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map as step s19
May 30, 2018 12:32:03 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveActualsTriggering/Flatten.PCollections as step s20
May 30, 2018 12:32:03 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Create.Values/Read(CreateSource) as step s21
May 30, 2018 12:32:03 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign as step s22
May 30, 2018 12:32:03 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveDummyTriggering/Flatten.PCollections as step s23
May 30, 2018 12:32:03 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/FlattenDummyAndContents as step s24
May 30, 2018 12:32:03 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/NeverTrigger/Flatten.PCollections as step s25
May 30, 2018 12:32:03 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GroupDummyAndContents as step s26
May 30, 2018 12:32:03 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Values/Values/Map as step s27
May 30, 2018 12:32:03 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/ParDo(Concat) as step s28
May 30, 2018 12:32:03 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GetPane/Map as step s29
May 30, 2018 12:32:03 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/RunChecks as step s30
May 30, 2018 12:32:03 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/VerifyAssertions/ParDo(DefaultConclude) as step s31
May 30, 2018 12:32:03 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0530003200-c24eab01/output/results/staging/
May 30, 2018 12:32:03 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <71120 bytes, hash b_zNLaHolvyo0u-4X5aOLg> to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0530003200-c24eab01/output/results/staging/pipeline-b_zNLaHolvyo0u-4X5aOLg.pb
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 30, 2018 12:32:04 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-05-29_17_32_03-14153637180621451680?project=apache-beam-testing
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Submitted job: 2018-05-29_17_32_03-14153637180621451680
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 30, 2018 12:32:04 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-05-29_17_32_03-14153637180621451680
May 30, 2018 12:32:04 AM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-05-29_17_32_03-14153637180621451680 with 1 expected assertions.
May 30, 2018 12:32:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:32:03.810Z: Autoscaling is enabled for job 2018-05-29_17_32_03-14153637180621451680. The number of workers will be between 1 and 1000.
May 30, 2018 12:32:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:32:03.839Z: Autoscaling was automatically enabled for job 2018-05-29_17_32_03-14153637180621451680.
May 30, 2018 12:32:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:32:06.764Z: Checking required Cloud APIs are enabled.
May 30, 2018 12:32:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:32:06.890Z: Checking permissions granted to controller Service Account.
May 30, 2018 12:32:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:32:12.129Z: Worker configuration: n1-standard-1 in us-central1-f.
May 30, 2018 12:32:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:32:12.524Z: Expanding CoGroupByKey operations into optimizable parts.
May 30, 2018 12:32:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:32:12.718Z: Expanding GroupByKey operations into optimizable parts.
May 30, 2018 12:32:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:32:12.762Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
May 30, 2018 12:32:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:32:13.001Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
May 30, 2018 12:32:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:32:13.036Z: Elided trivial flatten
May 30, 2018 12:32:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:32:13.077Z: Elided trivial flatten
May 30, 2018 12:32:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:32:13.110Z: Elided trivial flatten
May 30, 2018 12:32:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:32:13.160Z: Unzipping flatten s24 for input s19.org.apache.beam.sdk.values.PCollection.<init>:329#8fd0f908e3ea90e3
May 30, 2018 12:32:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:32:13.197Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Reify, through flatten PAssert$33/GroupGlobally/FlattenDummyAndContents, into producer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map
May 30, 2018 12:32:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:32:13.244Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow into PAssert$33/GroupGlobally/GroupDummyAndContents/Read
May 30, 2018 12:32:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:32:13.288Z: Fusing consumer PAssert$33/GroupGlobally/ParDo(Concat) into PAssert$33/GroupGlobally/Values/Values/Map
May 30, 2018 12:32:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:32:13.325Z: Fusing consumer PAssert$33/GetPane/Map into PAssert$33/GroupGlobally/ParDo(Concat)
May 30, 2018 12:32:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:32:13.375Z: Fusing consumer PAssert$33/GroupGlobally/Values/Values/Map into PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow
May 30, 2018 12:32:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:32:13.421Z: Fusing consumer PAssert$33/RunChecks into PAssert$33/GetPane/Map
May 30, 2018 12:32:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:32:13.447Z: Fusing consumer PAssert$33/VerifyAssertions/ParDo(DefaultConclude) into PAssert$33/RunChecks
May 30, 2018 12:32:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:32:13.495Z: Unzipping flatten s24-u45 for input s26-reify-value18-c43
May 30, 2018 12:32:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:32:13.546Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Write, through flatten s24-u45, into producer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 30, 2018 12:32:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:32:13.593Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify into PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
May 30, 2018 12:32:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:32:13.639Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Write into PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 30, 2018 12:32:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:32:13.687Z: Fusing consumer PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)
May 30, 2018 12:32:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:32:13.737Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
May 30, 2018 12:32:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:32:13.785Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
May 30, 2018 12:32:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:32:13.827Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into PAssert$33/GroupGlobally/Window.Into()/Window.Assign
May 30, 2018 12:32:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:32:13.874Z: Fusing consumer OutputSideInputs into Create123/Read(CreateSource)
May 30, 2018 12:32:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:32:13.919Z: Fusing consumer PAssert$33/GroupGlobally/Window.Into()/Window.Assign into OutputSideInputs
May 30, 2018 12:32:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:32:13.965Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
May 30, 2018 12:32:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:32:14.001Z: Fusing consumer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map into PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
May 30, 2018 12:32:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:32:14.049Z: Fusing consumer PAssert$33/GroupGlobally/RewindowActuals/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map
May 30, 2018 12:32:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:32:14.095Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read
May 30, 2018 12:32:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:32:14.132Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
May 30, 2018 12:32:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:32:14.178Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
May 30, 2018 12:32:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:32:14.215Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
May 30, 2018 12:32:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:32:14.259Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
May 30, 2018 12:32:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:32:14.305Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
May 30, 2018 12:32:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:32:14.344Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into Create47/Read(CreateSource)
May 30, 2018 12:32:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:32:14.385Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
May 30, 2018 12:32:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:32:14.430Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
May 30, 2018 12:32:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:32:14.468Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
May 30, 2018 12:32:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:32:14.514Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
May 30, 2018 12:32:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:32:14.558Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
May 30, 2018 12:32:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:32:14.596Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
May 30, 2018 12:32:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:32:15.085Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Create
May 30, 2018 12:32:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:32:15.110Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Create
May 30, 2018 12:32:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:32:15.155Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
May 30, 2018 12:32:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:32:15.180Z: Starting 1 workers in us-central1-f...
May 30, 2018 12:32:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:32:15.193Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
May 30, 2018 12:32:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:32:15.516Z: Executing operation PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 30, 2018 12:32:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:32:15.570Z: Executing operation Create47/Read(CreateSource)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
May 30, 2018 12:32:23 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:32:21.775Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
May 30, 2018 12:32:33 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:32:32.198Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
May 30, 2018 12:32:33 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:32:32.239Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 30, 2018 12:32:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:32:51.348Z: Workers have started successfully.
May 30, 2018 12:33:22 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:33:21.804Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
May 30, 2018 12:33:22 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:33:21.896Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
May 30, 2018 12:33:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:33:31.688Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
May 30, 2018 12:33:32 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:33:31.798Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
May 30, 2018 12:33:44 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:33:42.525Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
May 30, 2018 12:33:44 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:33:42.728Z: Executing operation Create123/Read(CreateSource)+OutputSideInputs+PAssert$33/GroupGlobally/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write
May 30, 2018 12:33:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:33:49.300Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Close
May 30, 2018 12:33:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:33:49.388Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$33/GroupGlobally/RewindowActuals/Window.Assign+PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 30, 2018 12:33:54 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:33:54.125Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Close
May 30, 2018 12:33:54 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:33:54.212Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Read+PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$33/GroupGlobally/Values/Values/Map+PAssert$33/GroupGlobally/ParDo(Concat)+PAssert$33/GetPane/Map+PAssert$33/RunChecks+PAssert$33/VerifyAssertions/ParDo(DefaultConclude)
May 30, 2018 12:34:00 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:33:58.376Z: Cleaning up.
May 30, 2018 12:34:00 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:33:58.498Z: Stopping worker pool...
May 30, 2018 12:35:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:35:33.197Z: Autoscaling: Resized worker pool from 1 to 0.
May 30, 2018 12:35:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-30T00:35:33.245Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 30, 2018 12:35:44 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-05-29_17_32_03-14153637180621451680 finished with status DONE.
May 30, 2018 12:35:44 AM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-05-29_17_32_03-14153637180621451680. Found 1 success, 0 failures out of 1 expected assertions.
Gradle Test Executor 38 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest
209 tests completed, 34 failed, 2 skipped
Finished generating test XML results (0.839 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerTest>
Generating HTML test report...
Finished generating test html results (0.859 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest>
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest FAILED
:beam-runners-google-cloud-dataflow-java:validatesRunnerTest (Thread[Task worker for ':' Thread 14,5,main]) completed. Took 2 hrs 53 mins 30.028 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:validatesRunnerTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 54m 29s
38 actionable tasks: 34 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/se37dayllyw6k
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user katarzyna.kucharczyk@polidea.com
Not sending mail to unregistered user robbe.sneyders@ml6.eu
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user schroederc@google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ammons@google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user sidhom@google.com
Build failed in Jenkins:
beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #372
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/372/display/redirect?page=changes>
Changes:
[thw] [BEAM-4297] Streaming executable stage translation and operator for
[thw] [BEAM-4297] Add serialization test and make output mapping stable.
------------------------------------------
[...truncated 18.08 MB...]
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign as step s15
May 29, 2018 9:36:57 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey as step s16
May 29, 2018 9:36:57 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map as step s17
May 29, 2018 9:36:57 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RewindowActuals/Window.Assign as step s18
May 29, 2018 9:36:57 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map as step s19
May 29, 2018 9:36:57 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveActualsTriggering/Flatten.PCollections as step s20
May 29, 2018 9:36:57 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Create.Values/Read(CreateSource) as step s21
May 29, 2018 9:36:57 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign as step s22
May 29, 2018 9:36:57 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveDummyTriggering/Flatten.PCollections as step s23
May 29, 2018 9:36:57 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/FlattenDummyAndContents as step s24
May 29, 2018 9:36:57 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/NeverTrigger/Flatten.PCollections as step s25
May 29, 2018 9:36:57 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GroupDummyAndContents as step s26
May 29, 2018 9:36:57 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Values/Values/Map as step s27
May 29, 2018 9:36:57 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/ParDo(Concat) as step s28
May 29, 2018 9:36:57 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GetPane/Map as step s29
May 29, 2018 9:36:57 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/RunChecks as step s30
May 29, 2018 9:36:57 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/VerifyAssertions/ParDo(DefaultConclude) as step s31
May 29, 2018 9:36:57 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0529213647-68a6e217/output/results/staging/
May 29, 2018 9:36:57 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <71120 bytes, hash jqGEnVDvrOYV-8AXuFUeZw> to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0529213647-68a6e217/output/results/staging/pipeline-jqGEnVDvrOYV-8AXuFUeZw.pb
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 29, 2018 9:36:59 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-05-29_14_36_58-2427693626167930636?project=apache-beam-testing
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Submitted job: 2018-05-29_14_36_58-2427693626167930636
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 29, 2018 9:36:59 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-05-29_14_36_58-2427693626167930636
May 29, 2018 9:36:59 PM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-05-29_14_36_58-2427693626167930636 with 1 expected assertions.
May 29, 2018 9:37:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:36:58.128Z: Autoscaling is enabled for job 2018-05-29_14_36_58-2427693626167930636. The number of workers will be between 1 and 1000.
May 29, 2018 9:37:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:36:58.173Z: Autoscaling was automatically enabled for job 2018-05-29_14_36_58-2427693626167930636.
May 29, 2018 9:37:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:37:00.872Z: Checking required Cloud APIs are enabled.
May 29, 2018 9:37:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:37:01.090Z: Checking permissions granted to controller Service Account.
May 29, 2018 9:37:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:37:07.854Z: Worker configuration: n1-standard-1 in us-central1-b.
May 29, 2018 9:37:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:37:08.365Z: Expanding CoGroupByKey operations into optimizable parts.
May 29, 2018 9:37:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:37:08.535Z: Expanding GroupByKey operations into optimizable parts.
May 29, 2018 9:37:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:37:08.585Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
May 29, 2018 9:37:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:37:08.827Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
May 29, 2018 9:37:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:37:08.870Z: Elided trivial flatten
May 29, 2018 9:37:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:37:08.914Z: Elided trivial flatten
May 29, 2018 9:37:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:37:08.962Z: Elided trivial flatten
May 29, 2018 9:37:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:37:09.000Z: Unzipping flatten s24 for input s19.org.apache.beam.sdk.values.PCollection.<init>:329#8fd0f908e3ea90e3
May 29, 2018 9:37:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:37:09.057Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Reify, through flatten PAssert$33/GroupGlobally/FlattenDummyAndContents, into producer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map
May 29, 2018 9:37:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:37:09.102Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow into PAssert$33/GroupGlobally/GroupDummyAndContents/Read
May 29, 2018 9:37:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:37:09.153Z: Fusing consumer PAssert$33/GroupGlobally/ParDo(Concat) into PAssert$33/GroupGlobally/Values/Values/Map
May 29, 2018 9:37:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:37:09.194Z: Fusing consumer PAssert$33/GetPane/Map into PAssert$33/GroupGlobally/ParDo(Concat)
May 29, 2018 9:37:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:37:09.243Z: Fusing consumer PAssert$33/GroupGlobally/Values/Values/Map into PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow
May 29, 2018 9:37:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:37:09.278Z: Fusing consumer PAssert$33/RunChecks into PAssert$33/GetPane/Map
May 29, 2018 9:37:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:37:09.328Z: Fusing consumer PAssert$33/VerifyAssertions/ParDo(DefaultConclude) into PAssert$33/RunChecks
May 29, 2018 9:37:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:37:09.369Z: Unzipping flatten s24-u45 for input s26-reify-value18-c43
May 29, 2018 9:37:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:37:09.417Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Write, through flatten s24-u45, into producer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 29, 2018 9:37:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:37:09.465Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify into PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
May 29, 2018 9:37:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:37:09.511Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Write into PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 29, 2018 9:37:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:37:09.559Z: Fusing consumer PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)
May 29, 2018 9:37:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:37:09.608Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
May 29, 2018 9:37:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:37:09.658Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
May 29, 2018 9:37:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:37:09.699Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into PAssert$33/GroupGlobally/Window.Into()/Window.Assign
May 29, 2018 9:37:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:37:09.746Z: Fusing consumer OutputSideInputs into Create123/Read(CreateSource)
May 29, 2018 9:37:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:37:09.790Z: Fusing consumer PAssert$33/GroupGlobally/Window.Into()/Window.Assign into OutputSideInputs
May 29, 2018 9:37:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:37:09.835Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
May 29, 2018 9:37:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:37:09.873Z: Fusing consumer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map into PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
May 29, 2018 9:37:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:37:09.919Z: Fusing consumer PAssert$33/GroupGlobally/RewindowActuals/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map
May 29, 2018 9:37:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:37:09.963Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read
May 29, 2018 9:37:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:37:10.000Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
May 29, 2018 9:37:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:37:10.048Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
May 29, 2018 9:37:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:37:10.099Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
May 29, 2018 9:37:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:37:10.142Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
May 29, 2018 9:37:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:37:10.183Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
May 29, 2018 9:37:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:37:10.230Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into Create47/Read(CreateSource)
May 29, 2018 9:37:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:37:10.272Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
May 29, 2018 9:37:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:37:10.316Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
May 29, 2018 9:37:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:37:10.349Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
May 29, 2018 9:37:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:37:10.399Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
May 29, 2018 9:37:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:37:10.444Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
May 29, 2018 9:37:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:37:10.491Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
May 29, 2018 9:37:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:37:10.998Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Create
May 29, 2018 9:37:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:37:11.048Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Create
May 29, 2018 9:37:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:37:11.096Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
May 29, 2018 9:37:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:37:11.106Z: Starting 1 workers in us-central1-b...
May 29, 2018 9:37:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:37:11.143Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
May 29, 2018 9:37:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:37:11.384Z: Executing operation PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 29, 2018 9:37:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:37:11.431Z: Executing operation Create47/Read(CreateSource)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
May 29, 2018 9:37:22 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:37:21.259Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
May 29, 2018 9:37:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:37:32.013Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
May 29, 2018 9:37:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:37:32.040Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 29, 2018 9:37:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:37:52.246Z: Workers have started successfully.
May 29, 2018 9:38:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:38:27.048Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
May 29, 2018 9:38:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:38:27.112Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
May 29, 2018 9:38:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:38:33.754Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
May 29, 2018 9:38:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:38:33.815Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
May 29, 2018 9:38:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:38:44.485Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
May 29, 2018 9:38:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:38:44.661Z: Executing operation Create123/Read(CreateSource)+OutputSideInputs+PAssert$33/GroupGlobally/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write
May 29, 2018 9:38:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:38:50.623Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Close
May 29, 2018 9:38:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:38:50.712Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$33/GroupGlobally/RewindowActuals/Window.Assign+PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 29, 2018 9:38:56 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:38:55.468Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Close
May 29, 2018 9:38:56 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:38:55.535Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Read+PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$33/GroupGlobally/Values/Values/Map+PAssert$33/GroupGlobally/ParDo(Concat)+PAssert$33/GetPane/Map+PAssert$33/RunChecks+PAssert$33/VerifyAssertions/ParDo(DefaultConclude)
May 29, 2018 9:38:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:38:57.900Z: Cleaning up.
May 29, 2018 9:38:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:38:57.991Z: Stopping worker pool...
May 29, 2018 9:40:50 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:40:48.878Z: Autoscaling: Resized worker pool from 1 to 0.
May 29, 2018 9:40:50 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T21:40:48.903Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 29, 2018 9:40:59 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-05-29_14_36_58-2427693626167930636 finished with status DONE.
May 29, 2018 9:40:59 PM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-05-29_14_36_58-2427693626167930636. Found 1 success, 0 failures out of 1 expected assertions.
Gradle Test Executor 39 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest FAILED
209 tests completed, 34 failed, 2 skipped
Finished generating test XML results (0.403 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerTest>
Generating HTML test report...
Finished generating test html results (0.513 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest>
:beam-runners-google-cloud-dataflow-java:validatesRunnerTest (Thread[Task worker for ':' Thread 35,5,main]) completed. Took 2 hrs 24 mins 52.343 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:validatesRunnerTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 25m 48s
38 actionable tasks: 34 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/j63lqecqhli3u
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user katarzyna.kucharczyk@polidea.com
Not sending mail to unregistered user robbe.sneyders@ml6.eu
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user schroederc@google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ammons@google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user sidhom@google.com
Build failed in Jenkins:
beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #371
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/371/display/redirect?page=changes>
Changes:
[iemejia] [BEAM-4324] Enforce ErrorProne analysis in sorter extensions
------------------------------------------
[...truncated 18.14 MB...]
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey as step s16
May 29, 2018 7:10:00 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map as step s17
May 29, 2018 7:10:00 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RewindowActuals/Window.Assign as step s18
May 29, 2018 7:10:00 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map as step s19
May 29, 2018 7:10:00 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveActualsTriggering/Flatten.PCollections as step s20
May 29, 2018 7:10:00 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Create.Values/Read(CreateSource) as step s21
May 29, 2018 7:10:00 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign as step s22
May 29, 2018 7:10:00 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveDummyTriggering/Flatten.PCollections as step s23
May 29, 2018 7:10:00 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/FlattenDummyAndContents as step s24
May 29, 2018 7:10:00 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/NeverTrigger/Flatten.PCollections as step s25
May 29, 2018 7:10:00 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GroupDummyAndContents as step s26
May 29, 2018 7:10:00 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Values/Values/Map as step s27
May 29, 2018 7:10:00 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/ParDo(Concat) as step s28
May 29, 2018 7:10:00 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GetPane/Map as step s29
May 29, 2018 7:10:00 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/RunChecks as step s30
May 29, 2018 7:10:00 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/VerifyAssertions/ParDo(DefaultConclude) as step s31
May 29, 2018 7:10:00 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0529190957-2afa90aa/output/results/staging/
May 29, 2018 7:10:00 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <71120 bytes, hash 0wFuvcysJBGRJbA4-YL_Fw> to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0529190957-2afa90aa/output/results/staging/pipeline-0wFuvcysJBGRJbA4-YL_Fw.pb
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 29, 2018 7:10:01 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-05-29_12_10_01-11318241648254347114?project=apache-beam-testing
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Submitted job: 2018-05-29_12_10_01-11318241648254347114
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 29, 2018 7:10:01 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-05-29_12_10_01-11318241648254347114
May 29, 2018 7:10:01 PM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-05-29_12_10_01-11318241648254347114 with 1 expected assertions.
May 29, 2018 7:10:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:10:01.139Z: Autoscaling is enabled for job 2018-05-29_12_10_01-11318241648254347114. The number of workers will be between 1 and 1000.
May 29, 2018 7:10:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:10:01.181Z: Autoscaling was automatically enabled for job 2018-05-29_12_10_01-11318241648254347114.
May 29, 2018 7:10:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:10:03.712Z: Checking required Cloud APIs are enabled.
May 29, 2018 7:10:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:10:03.898Z: Checking permissions granted to controller Service Account.
May 29, 2018 7:10:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:10:08.803Z: Worker configuration: n1-standard-1 in us-central1-b.
May 29, 2018 7:10:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:10:09.214Z: Expanding CoGroupByKey operations into optimizable parts.
May 29, 2018 7:10:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:10:09.382Z: Expanding GroupByKey operations into optimizable parts.
May 29, 2018 7:10:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:10:09.418Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
May 29, 2018 7:10:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:10:09.662Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
May 29, 2018 7:10:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:10:09.707Z: Elided trivial flatten
May 29, 2018 7:10:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:10:09.752Z: Elided trivial flatten
May 29, 2018 7:10:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:10:09.800Z: Elided trivial flatten
May 29, 2018 7:10:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:10:09.843Z: Unzipping flatten s24 for input s19.org.apache.beam.sdk.values.PCollection.<init>:329#8fd0f908e3ea90e3
May 29, 2018 7:10:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:10:09.880Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Reify, through flatten PAssert$33/GroupGlobally/FlattenDummyAndContents, into producer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map
May 29, 2018 7:10:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:10:09.926Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow into PAssert$33/GroupGlobally/GroupDummyAndContents/Read
May 29, 2018 7:10:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:10:09.974Z: Fusing consumer PAssert$33/GroupGlobally/ParDo(Concat) into PAssert$33/GroupGlobally/Values/Values/Map
May 29, 2018 7:10:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:10:10.024Z: Fusing consumer PAssert$33/GetPane/Map into PAssert$33/GroupGlobally/ParDo(Concat)
May 29, 2018 7:10:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:10:10.060Z: Fusing consumer PAssert$33/GroupGlobally/Values/Values/Map into PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow
May 29, 2018 7:10:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:10:10.102Z: Fusing consumer PAssert$33/RunChecks into PAssert$33/GetPane/Map
May 29, 2018 7:10:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:10:10.133Z: Fusing consumer PAssert$33/VerifyAssertions/ParDo(DefaultConclude) into PAssert$33/RunChecks
May 29, 2018 7:10:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:10:10.180Z: Unzipping flatten s24-u45 for input s26-reify-value18-c43
May 29, 2018 7:10:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:10:10.224Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Write, through flatten s24-u45, into producer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 29, 2018 7:10:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:10:10.269Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify into PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
May 29, 2018 7:10:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:10:10.316Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Write into PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 29, 2018 7:10:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:10:10.370Z: Fusing consumer PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)
May 29, 2018 7:10:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:10:10.413Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
May 29, 2018 7:10:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:10:10.459Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
May 29, 2018 7:10:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:10:10.508Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into PAssert$33/GroupGlobally/Window.Into()/Window.Assign
May 29, 2018 7:10:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:10:10.552Z: Fusing consumer OutputSideInputs into Create123/Read(CreateSource)
May 29, 2018 7:10:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:10:10.590Z: Fusing consumer PAssert$33/GroupGlobally/Window.Into()/Window.Assign into OutputSideInputs
May 29, 2018 7:10:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:10:10.632Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
May 29, 2018 7:10:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:10:10.679Z: Fusing consumer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map into PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
May 29, 2018 7:10:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:10:10.725Z: Fusing consumer PAssert$33/GroupGlobally/RewindowActuals/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map
May 29, 2018 7:10:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:10:10.771Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read
May 29, 2018 7:10:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:10:10.817Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
May 29, 2018 7:10:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:10:10.862Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
May 29, 2018 7:10:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:10:10.913Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
May 29, 2018 7:10:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:10:10.956Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
May 29, 2018 7:10:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:10:10.992Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
May 29, 2018 7:10:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:10:11.029Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into Create47/Read(CreateSource)
May 29, 2018 7:10:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:10:11.073Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
May 29, 2018 7:10:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:10:11.112Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
May 29, 2018 7:10:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:10:11.159Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
May 29, 2018 7:10:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:10:11.193Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
May 29, 2018 7:10:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:10:11.238Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
May 29, 2018 7:10:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:10:11.287Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
May 29, 2018 7:10:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:10:11.770Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Create
May 29, 2018 7:10:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:10:11.807Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Create
May 29, 2018 7:10:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:10:11.846Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
May 29, 2018 7:10:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:10:11.868Z: Starting 1 workers in us-central1-b...
May 29, 2018 7:10:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:10:11.887Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
May 29, 2018 7:10:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:10:12.191Z: Executing operation PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 29, 2018 7:10:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:10:12.233Z: Executing operation Create47/Read(CreateSource)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
May 29, 2018 7:10:21 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:10:19.584Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
May 29, 2018 7:10:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:10:40.770Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
May 29, 2018 7:10:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:10:40.817Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 29, 2018 7:11:02 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:11:01.503Z: Workers have started successfully.
May 29, 2018 7:11:57 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:11:57.657Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
May 29, 2018 7:11:57 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:11:57.740Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
May 29, 2018 7:12:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:12:02.869Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
May 29, 2018 7:12:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:12:02.965Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
May 29, 2018 7:12:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:12:16.632Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
May 29, 2018 7:12:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:12:16.822Z: Executing operation Create123/Read(CreateSource)+OutputSideInputs+PAssert$33/GroupGlobally/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write
May 29, 2018 7:12:22 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:12:21.528Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Close
May 29, 2018 7:12:22 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:12:21.619Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$33/GroupGlobally/RewindowActuals/Window.Assign+PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 29, 2018 7:12:24 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:12:23.348Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Close
May 29, 2018 7:12:24 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:12:23.431Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Read+PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$33/GroupGlobally/Values/Values/Map+PAssert$33/GroupGlobally/ParDo(Concat)+PAssert$33/GetPane/Map+PAssert$33/RunChecks+PAssert$33/VerifyAssertions/ParDo(DefaultConclude)
May 29, 2018 7:12:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:12:26.624Z: Cleaning up.
May 29, 2018 7:12:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:12:26.722Z: Stopping worker pool...
May 29, 2018 7:14:46 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:14:45.646Z: Autoscaling: Resized worker pool from 1 to 0.
May 29, 2018 7:14:46 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T19:14:45.672Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 29, 2018 7:14:53 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-05-29_12_10_01-11318241648254347114 finished with status DONE.
May 29, 2018 7:14:53 PM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-05-29_12_10_01-11318241648254347114. Found 1 success, 0 failures out of 1 expected assertions.
Gradle Test Executor 34 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest
209 tests completed, 34 failed, 2 skipped
Finished generating test XML results (0.663 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerTest>
Generating HTML test report...
Finished generating test html results (0.717 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest>
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest FAILED
:beam-runners-google-cloud-dataflow-java:validatesRunnerTest (Thread[Task worker for ':' Thread 18,5,main]) completed. Took 2 hrs 21 mins 28.766 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:validatesRunnerTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 22m 26s
38 actionable tasks: 34 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/kwz7ckgbieule
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user katarzyna.kucharczyk@polidea.com
Not sending mail to unregistered user robbe.sneyders@ml6.eu
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user schroederc@google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ammons@google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user sidhom@google.com
Build failed in Jenkins:
beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #370
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/370/display/redirect>
------------------------------------------
[...truncated 18.10 MB...]
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map as step s17
May 29, 2018 2:03:06 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RewindowActuals/Window.Assign as step s18
May 29, 2018 2:03:06 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map as step s19
May 29, 2018 2:03:06 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveActualsTriggering/Flatten.PCollections as step s20
May 29, 2018 2:03:06 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Create.Values/Read(CreateSource) as step s21
May 29, 2018 2:03:06 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign as step s22
May 29, 2018 2:03:06 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveDummyTriggering/Flatten.PCollections as step s23
May 29, 2018 2:03:06 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/FlattenDummyAndContents as step s24
May 29, 2018 2:03:06 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/NeverTrigger/Flatten.PCollections as step s25
May 29, 2018 2:03:06 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GroupDummyAndContents as step s26
May 29, 2018 2:03:06 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Values/Values/Map as step s27
May 29, 2018 2:03:06 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/ParDo(Concat) as step s28
May 29, 2018 2:03:06 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GetPane/Map as step s29
May 29, 2018 2:03:06 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/RunChecks as step s30
May 29, 2018 2:03:06 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/VerifyAssertions/ParDo(DefaultConclude) as step s31
May 29, 2018 2:03:06 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0529140303-1444dfc0/output/results/staging/
May 29, 2018 2:03:07 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <71120 bytes, hash Tna8S9mfsmJwhjjgQkvC8g> to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0529140303-1444dfc0/output/results/staging/pipeline-Tna8S9mfsmJwhjjgQkvC8g.pb
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 29, 2018 2:03:08 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-05-29_07_03_07-14990210872142790360?project=apache-beam-testing
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Submitted job: 2018-05-29_07_03_07-14990210872142790360
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 29, 2018 2:03:08 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-05-29_07_03_07-14990210872142790360
May 29, 2018 2:03:08 PM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-05-29_07_03_07-14990210872142790360 with 1 expected assertions.
May 29, 2018 2:03:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:03:07.683Z: Autoscaling is enabled for job 2018-05-29_07_03_07-14990210872142790360. The number of workers will be between 1 and 1000.
May 29, 2018 2:03:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:03:07.707Z: Autoscaling was automatically enabled for job 2018-05-29_07_03_07-14990210872142790360.
May 29, 2018 2:03:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:03:10.305Z: Checking required Cloud APIs are enabled.
May 29, 2018 2:03:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:03:10.480Z: Checking permissions granted to controller Service Account.
May 29, 2018 2:03:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:03:15.957Z: Worker configuration: n1-standard-1 in us-central1-f.
May 29, 2018 2:03:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:03:16.400Z: Expanding CoGroupByKey operations into optimizable parts.
May 29, 2018 2:03:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:03:16.591Z: Expanding GroupByKey operations into optimizable parts.
May 29, 2018 2:03:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:03:16.627Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
May 29, 2018 2:03:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:03:16.851Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
May 29, 2018 2:03:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:03:16.897Z: Elided trivial flatten
May 29, 2018 2:03:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:03:16.943Z: Elided trivial flatten
May 29, 2018 2:03:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:03:16.990Z: Elided trivial flatten
May 29, 2018 2:03:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:03:17.040Z: Unzipping flatten s24 for input s19.org.apache.beam.sdk.values.PCollection.<init>:329#8fd0f908e3ea90e3
May 29, 2018 2:03:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:03:17.076Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Reify, through flatten PAssert$33/GroupGlobally/FlattenDummyAndContents, into producer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map
May 29, 2018 2:03:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:03:17.124Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow into PAssert$33/GroupGlobally/GroupDummyAndContents/Read
May 29, 2018 2:03:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:03:17.170Z: Fusing consumer PAssert$33/GroupGlobally/ParDo(Concat) into PAssert$33/GroupGlobally/Values/Values/Map
May 29, 2018 2:03:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:03:17.213Z: Fusing consumer PAssert$33/GetPane/Map into PAssert$33/GroupGlobally/ParDo(Concat)
May 29, 2018 2:03:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:03:17.256Z: Fusing consumer PAssert$33/GroupGlobally/Values/Values/Map into PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow
May 29, 2018 2:03:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:03:17.301Z: Fusing consumer PAssert$33/RunChecks into PAssert$33/GetPane/Map
May 29, 2018 2:03:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:03:17.351Z: Fusing consumer PAssert$33/VerifyAssertions/ParDo(DefaultConclude) into PAssert$33/RunChecks
May 29, 2018 2:03:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:03:17.397Z: Unzipping flatten s24-u45 for input s26-reify-value18-c43
May 29, 2018 2:03:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:03:17.443Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Write, through flatten s24-u45, into producer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 29, 2018 2:03:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:03:17.488Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify into PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
May 29, 2018 2:03:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:03:17.516Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Write into PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 29, 2018 2:03:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:03:17.562Z: Fusing consumer PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)
May 29, 2018 2:03:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:03:17.606Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
May 29, 2018 2:03:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:03:17.642Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
May 29, 2018 2:03:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:03:17.688Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into PAssert$33/GroupGlobally/Window.Into()/Window.Assign
May 29, 2018 2:03:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:03:17.724Z: Fusing consumer OutputSideInputs into Create123/Read(CreateSource)
May 29, 2018 2:03:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:03:17.758Z: Fusing consumer PAssert$33/GroupGlobally/Window.Into()/Window.Assign into OutputSideInputs
May 29, 2018 2:03:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:03:17.803Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
May 29, 2018 2:03:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:03:17.849Z: Fusing consumer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map into PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
May 29, 2018 2:03:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:03:17.896Z: Fusing consumer PAssert$33/GroupGlobally/RewindowActuals/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map
May 29, 2018 2:03:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:03:17.933Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read
May 29, 2018 2:03:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:03:17.969Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
May 29, 2018 2:03:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:03:18.017Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
May 29, 2018 2:03:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:03:18.061Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
May 29, 2018 2:03:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:03:18.106Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
May 29, 2018 2:03:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:03:18.149Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
May 29, 2018 2:03:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:03:18.187Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into Create47/Read(CreateSource)
May 29, 2018 2:03:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:03:18.232Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
May 29, 2018 2:03:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:03:18.261Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
May 29, 2018 2:03:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:03:18.305Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
May 29, 2018 2:03:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:03:18.343Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
May 29, 2018 2:03:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:03:18.377Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
May 29, 2018 2:03:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:03:18.422Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
May 29, 2018 2:03:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:03:18.869Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Create
May 29, 2018 2:03:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:03:18.905Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Create
May 29, 2018 2:03:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:03:18.942Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
May 29, 2018 2:03:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:03:18.975Z: Starting 1 workers in us-central1-f...
May 29, 2018 2:03:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:03:18.975Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
May 29, 2018 2:03:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:03:19.242Z: Executing operation PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 29, 2018 2:03:19 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:03:19.280Z: Executing operation Create47/Read(CreateSource)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
May 29, 2018 2:03:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:03:28.647Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
May 29, 2018 2:03:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:03:39.111Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
May 29, 2018 2:03:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:03:39.159Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 29, 2018 2:03:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:03:56.569Z: Workers have started successfully.
May 29, 2018 2:04:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:04:27.403Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
May 29, 2018 2:04:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:04:27.491Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
May 29, 2018 2:04:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:04:37.127Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
May 29, 2018 2:04:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:04:37.216Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
May 29, 2018 2:04:50 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:04:49.052Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
May 29, 2018 2:04:50 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:04:49.234Z: Executing operation Create123/Read(CreateSource)+OutputSideInputs+PAssert$33/GroupGlobally/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write
May 29, 2018 2:04:55 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:04:54.267Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Close
May 29, 2018 2:04:55 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:04:54.351Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$33/GroupGlobally/RewindowActuals/Window.Assign+PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 29, 2018 2:05:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:05:00.005Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Close
May 29, 2018 2:05:00 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:05:00.101Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Read+PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$33/GroupGlobally/Values/Values/Map+PAssert$33/GroupGlobally/ParDo(Concat)+PAssert$33/GetPane/Map+PAssert$33/RunChecks+PAssert$33/VerifyAssertions/ParDo(DefaultConclude)
May 29, 2018 2:05:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:05:05.219Z: Cleaning up.
May 29, 2018 2:05:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:05:05.324Z: Stopping worker pool...
May 29, 2018 2:06:43 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:06:42.340Z: Autoscaling: Resized worker pool from 1 to 0.
May 29, 2018 2:06:43 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:06:42.380Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 29, 2018 2:06:43 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T14:06:42.436Z: Worker pool stopped.
May 29, 2018 2:06:50 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-05-29_07_03_07-14990210872142790360 finished with status DONE.
May 29, 2018 2:06:50 PM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-05-29_07_03_07-14990210872142790360. Found 1 success, 0 failures out of 1 expected assertions.
Gradle Test Executor 42 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest
209 tests completed, 34 failed, 2 skipped
Finished generating test XML results (0.654 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerTest>
Generating HTML test report...
Finished generating test html results (0.575 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest>
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest FAILED
:beam-runners-google-cloud-dataflow-java:validatesRunnerTest (Thread[Task worker for ':' Thread 16,5,main]) completed. Took 2 hrs 4 mins 57.127 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:validatesRunnerTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 6m 12s
38 actionable tasks: 34 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/r675bon5liogu
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user katarzyna.kucharczyk@polidea.com
Not sending mail to unregistered user robbe.sneyders@ml6.eu
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user schroederc@google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ammons@google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user sidhom@google.com
Build failed in Jenkins:
beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #369
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/369/display/redirect>
------------------------------------------
[...truncated 18.08 MB...]
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map as step s17
May 29, 2018 8:03:13 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RewindowActuals/Window.Assign as step s18
May 29, 2018 8:03:13 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map as step s19
May 29, 2018 8:03:13 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveActualsTriggering/Flatten.PCollections as step s20
May 29, 2018 8:03:13 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Create.Values/Read(CreateSource) as step s21
May 29, 2018 8:03:13 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign as step s22
May 29, 2018 8:03:13 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveDummyTriggering/Flatten.PCollections as step s23
May 29, 2018 8:03:13 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/FlattenDummyAndContents as step s24
May 29, 2018 8:03:13 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/NeverTrigger/Flatten.PCollections as step s25
May 29, 2018 8:03:13 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GroupDummyAndContents as step s26
May 29, 2018 8:03:13 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Values/Values/Map as step s27
May 29, 2018 8:03:13 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/ParDo(Concat) as step s28
May 29, 2018 8:03:13 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GetPane/Map as step s29
May 29, 2018 8:03:13 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/RunChecks as step s30
May 29, 2018 8:03:13 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/VerifyAssertions/ParDo(DefaultConclude) as step s31
May 29, 2018 8:03:13 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0529080310-283d4146/output/results/staging/
May 29, 2018 8:03:13 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <71120 bytes, hash G4mu3dXGCbDDe6BQUL5xRg> to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0529080310-283d4146/output/results/staging/pipeline-G4mu3dXGCbDDe6BQUL5xRg.pb
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 29, 2018 8:03:14 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-05-29_01_03_13-12526082984653603654?project=apache-beam-testing
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Submitted job: 2018-05-29_01_03_13-12526082984653603654
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 29, 2018 8:03:14 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-05-29_01_03_13-12526082984653603654
May 29, 2018 8:03:14 AM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-05-29_01_03_13-12526082984653603654 with 1 expected assertions.
May 29, 2018 8:03:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:03:13.561Z: Autoscaling is enabled for job 2018-05-29_01_03_13-12526082984653603654. The number of workers will be between 1 and 1000.
May 29, 2018 8:03:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:03:13.603Z: Autoscaling was automatically enabled for job 2018-05-29_01_03_13-12526082984653603654.
May 29, 2018 8:03:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:03:16.029Z: Checking required Cloud APIs are enabled.
May 29, 2018 8:03:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:03:16.339Z: Checking permissions granted to controller Service Account.
May 29, 2018 8:03:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:03:20.579Z: Worker configuration: n1-standard-1 in us-central1-b.
May 29, 2018 8:03:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:03:21.023Z: Expanding CoGroupByKey operations into optimizable parts.
May 29, 2018 8:03:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:03:21.203Z: Expanding GroupByKey operations into optimizable parts.
May 29, 2018 8:03:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:03:21.239Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
May 29, 2018 8:03:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:03:21.474Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
May 29, 2018 8:03:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:03:21.513Z: Elided trivial flatten
May 29, 2018 8:03:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:03:21.561Z: Elided trivial flatten
May 29, 2018 8:03:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:03:21.608Z: Elided trivial flatten
May 29, 2018 8:03:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:03:21.655Z: Unzipping flatten s24 for input s19.org.apache.beam.sdk.values.PCollection.<init>:329#8fd0f908e3ea90e3
May 29, 2018 8:03:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:03:21.701Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Reify, through flatten PAssert$33/GroupGlobally/FlattenDummyAndContents, into producer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map
May 29, 2018 8:03:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:03:21.737Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow into PAssert$33/GroupGlobally/GroupDummyAndContents/Read
May 29, 2018 8:03:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:03:21.778Z: Fusing consumer PAssert$33/GroupGlobally/ParDo(Concat) into PAssert$33/GroupGlobally/Values/Values/Map
May 29, 2018 8:03:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:03:21.809Z: Fusing consumer PAssert$33/GetPane/Map into PAssert$33/GroupGlobally/ParDo(Concat)
May 29, 2018 8:03:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:03:21.852Z: Fusing consumer PAssert$33/GroupGlobally/Values/Values/Map into PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow
May 29, 2018 8:03:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:03:21.893Z: Fusing consumer PAssert$33/RunChecks into PAssert$33/GetPane/Map
May 29, 2018 8:03:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:03:21.935Z: Fusing consumer PAssert$33/VerifyAssertions/ParDo(DefaultConclude) into PAssert$33/RunChecks
May 29, 2018 8:03:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:03:21.977Z: Unzipping flatten s24-u45 for input s26-reify-value18-c43
May 29, 2018 8:03:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:03:22.022Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Write, through flatten s24-u45, into producer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 29, 2018 8:03:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:03:22.069Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify into PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
May 29, 2018 8:03:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:03:22.105Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Write into PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 29, 2018 8:03:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:03:22.146Z: Fusing consumer PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)
May 29, 2018 8:03:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:03:22.191Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
May 29, 2018 8:03:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:03:22.238Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
May 29, 2018 8:03:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:03:22.277Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into PAssert$33/GroupGlobally/Window.Into()/Window.Assign
May 29, 2018 8:03:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:03:22.322Z: Fusing consumer OutputSideInputs into Create123/Read(CreateSource)
May 29, 2018 8:03:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:03:22.363Z: Fusing consumer PAssert$33/GroupGlobally/Window.Into()/Window.Assign into OutputSideInputs
May 29, 2018 8:03:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:03:22.400Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
May 29, 2018 8:03:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:03:22.444Z: Fusing consumer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map into PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
May 29, 2018 8:03:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:03:22.484Z: Fusing consumer PAssert$33/GroupGlobally/RewindowActuals/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map
May 29, 2018 8:03:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:03:22.530Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read
May 29, 2018 8:03:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:03:22.574Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
May 29, 2018 8:03:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:03:22.618Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
May 29, 2018 8:03:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:03:22.665Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
May 29, 2018 8:03:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:03:22.709Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
May 29, 2018 8:03:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:03:22.746Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
May 29, 2018 8:03:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:03:22.793Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into Create47/Read(CreateSource)
May 29, 2018 8:03:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:03:22.838Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
May 29, 2018 8:03:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:03:22.880Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
May 29, 2018 8:03:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:03:22.923Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
May 29, 2018 8:03:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:03:22.968Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
May 29, 2018 8:03:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:03:23.012Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
May 29, 2018 8:03:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:03:23.051Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
May 29, 2018 8:03:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:03:23.513Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Create
May 29, 2018 8:03:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:03:23.543Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Create
May 29, 2018 8:03:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:03:23.582Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
May 29, 2018 8:03:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:03:23.593Z: Starting 1 workers in us-central1-b...
May 29, 2018 8:03:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:03:23.624Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
May 29, 2018 8:03:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:03:23.853Z: Executing operation Create47/Read(CreateSource)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
May 29, 2018 8:03:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:03:23.899Z: Executing operation PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 29, 2018 8:03:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:03:33.875Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
May 29, 2018 8:03:45 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:03:44.598Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
May 29, 2018 8:03:45 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:03:44.648Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 29, 2018 8:04:04 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:04:03.880Z: Workers have started successfully.
May 29, 2018 8:04:39 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:04:37.559Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
May 29, 2018 8:04:39 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:04:37.650Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
May 29, 2018 8:04:47 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:04:45.925Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
May 29, 2018 8:04:47 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:04:46.013Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
May 29, 2018 8:04:59 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:04:57.911Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
May 29, 2018 8:04:59 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:04:58.112Z: Executing operation Create123/Read(CreateSource)+OutputSideInputs+PAssert$33/GroupGlobally/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write
May 29, 2018 8:05:05 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:05:04.028Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Close
May 29, 2018 8:05:05 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:05:04.111Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$33/GroupGlobally/RewindowActuals/Window.Assign+PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 29, 2018 8:05:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:05:06.996Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Close
May 29, 2018 8:05:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:05:07.105Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Read+PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$33/GroupGlobally/Values/Values/Map+PAssert$33/GroupGlobally/ParDo(Concat)+PAssert$33/GetPane/Map+PAssert$33/RunChecks+PAssert$33/VerifyAssertions/ParDo(DefaultConclude)
May 29, 2018 8:05:11 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:05:10.290Z: Cleaning up.
May 29, 2018 8:05:11 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:05:10.410Z: Stopping worker pool...
May 29, 2018 8:06:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:06:52.521Z: Autoscaling: Resized worker pool from 1 to 0.
May 29, 2018 8:06:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:06:52.566Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 29, 2018 8:06:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T08:06:52.613Z: Worker pool stopped.
May 29, 2018 8:07:02 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-05-29_01_03_13-12526082984653603654 finished with status DONE.
May 29, 2018 8:07:02 AM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-05-29_01_03_13-12526082984653603654. Found 1 success, 0 failures out of 1 expected assertions.
Gradle Test Executor 39 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest
209 tests completed, 34 failed, 2 skipped
Finished generating test XML results (0.632 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerTest>
Generating HTML test report...
Finished generating test html results (0.519 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest>
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest FAILED
:beam-runners-google-cloud-dataflow-java:validatesRunnerTest (Thread[Task worker for ':' Thread 19,5,main]) completed. Took 2 hrs 5 mins 2.429 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:validatesRunnerTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 6m 21s
38 actionable tasks: 34 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/d6z3rx6nsxzra
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user katarzyna.kucharczyk@polidea.com
Not sending mail to unregistered user robbe.sneyders@ml6.eu
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user schroederc@google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ammons@google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user sidhom@google.com
Build failed in Jenkins:
beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #368
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/368/display/redirect>
------------------------------------------
[...truncated 18.07 MB...]
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign as step s15
May 29, 2018 2:03:00 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey as step s16
May 29, 2018 2:03:00 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map as step s17
May 29, 2018 2:03:00 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RewindowActuals/Window.Assign as step s18
May 29, 2018 2:03:00 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map as step s19
May 29, 2018 2:03:00 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveActualsTriggering/Flatten.PCollections as step s20
May 29, 2018 2:03:00 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Create.Values/Read(CreateSource) as step s21
May 29, 2018 2:03:00 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign as step s22
May 29, 2018 2:03:00 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveDummyTriggering/Flatten.PCollections as step s23
May 29, 2018 2:03:00 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/FlattenDummyAndContents as step s24
May 29, 2018 2:03:00 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/NeverTrigger/Flatten.PCollections as step s25
May 29, 2018 2:03:00 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GroupDummyAndContents as step s26
May 29, 2018 2:03:00 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Values/Values/Map as step s27
May 29, 2018 2:03:00 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/ParDo(Concat) as step s28
May 29, 2018 2:03:00 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GetPane/Map as step s29
May 29, 2018 2:03:00 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/RunChecks as step s30
May 29, 2018 2:03:00 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/VerifyAssertions/ParDo(DefaultConclude) as step s31
May 29, 2018 2:03:00 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0529020257-87622d4f/output/results/staging/
May 29, 2018 2:03:00 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <71120 bytes, hash DaNaYyuZ7dtjiV3nJHuKhA> to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0529020257-87622d4f/output/results/staging/pipeline-DaNaYyuZ7dtjiV3nJHuKhA.pb
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 29, 2018 2:03:02 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-05-28_19_03_01-13697804118624917740?project=apache-beam-testing
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Submitted job: 2018-05-28_19_03_01-13697804118624917740
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 29, 2018 2:03:02 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-05-28_19_03_01-13697804118624917740
May 29, 2018 2:03:02 AM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-05-28_19_03_01-13697804118624917740 with 1 expected assertions.
May 29, 2018 2:03:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:03:01.262Z: Autoscaling is enabled for job 2018-05-28_19_03_01-13697804118624917740. The number of workers will be between 1 and 1000.
May 29, 2018 2:03:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:03:01.308Z: Autoscaling was automatically enabled for job 2018-05-28_19_03_01-13697804118624917740.
May 29, 2018 2:03:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:03:04.641Z: Checking required Cloud APIs are enabled.
May 29, 2018 2:03:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:03:04.830Z: Checking permissions granted to controller Service Account.
May 29, 2018 2:03:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:03:10.036Z: Worker configuration: n1-standard-1 in us-central1-b.
May 29, 2018 2:03:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:03:10.440Z: Expanding CoGroupByKey operations into optimizable parts.
May 29, 2018 2:03:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:03:10.615Z: Expanding GroupByKey operations into optimizable parts.
May 29, 2018 2:03:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:03:10.657Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
May 29, 2018 2:03:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:03:10.885Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
May 29, 2018 2:03:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:03:10.923Z: Elided trivial flatten
May 29, 2018 2:03:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:03:10.962Z: Elided trivial flatten
May 29, 2018 2:03:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:03:11.007Z: Elided trivial flatten
May 29, 2018 2:03:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:03:11.057Z: Unzipping flatten s24 for input s19.org.apache.beam.sdk.values.PCollection.<init>:329#8fd0f908e3ea90e3
May 29, 2018 2:03:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:03:11.097Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Reify, through flatten PAssert$33/GroupGlobally/FlattenDummyAndContents, into producer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map
May 29, 2018 2:03:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:03:11.139Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow into PAssert$33/GroupGlobally/GroupDummyAndContents/Read
May 29, 2018 2:03:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:03:11.177Z: Fusing consumer PAssert$33/GroupGlobally/ParDo(Concat) into PAssert$33/GroupGlobally/Values/Values/Map
May 29, 2018 2:03:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:03:11.217Z: Fusing consumer PAssert$33/GetPane/Map into PAssert$33/GroupGlobally/ParDo(Concat)
May 29, 2018 2:03:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:03:11.255Z: Fusing consumer PAssert$33/GroupGlobally/Values/Values/Map into PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow
May 29, 2018 2:03:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:03:11.306Z: Fusing consumer PAssert$33/RunChecks into PAssert$33/GetPane/Map
May 29, 2018 2:03:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:03:11.354Z: Fusing consumer PAssert$33/VerifyAssertions/ParDo(DefaultConclude) into PAssert$33/RunChecks
May 29, 2018 2:03:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:03:11.394Z: Unzipping flatten s24-u45 for input s26-reify-value18-c43
May 29, 2018 2:03:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:03:11.445Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Write, through flatten s24-u45, into producer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 29, 2018 2:03:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:03:11.495Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify into PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
May 29, 2018 2:03:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:03:11.541Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Write into PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 29, 2018 2:03:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:03:11.586Z: Fusing consumer PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)
May 29, 2018 2:03:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:03:11.620Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
May 29, 2018 2:03:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:03:11.674Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
May 29, 2018 2:03:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:03:11.721Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into PAssert$33/GroupGlobally/Window.Into()/Window.Assign
May 29, 2018 2:03:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:03:11.765Z: Fusing consumer OutputSideInputs into Create123/Read(CreateSource)
May 29, 2018 2:03:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:03:11.801Z: Fusing consumer PAssert$33/GroupGlobally/Window.Into()/Window.Assign into OutputSideInputs
May 29, 2018 2:03:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:03:11.848Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
May 29, 2018 2:03:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:03:11.894Z: Fusing consumer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map into PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
May 29, 2018 2:03:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:03:11.942Z: Fusing consumer PAssert$33/GroupGlobally/RewindowActuals/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map
May 29, 2018 2:03:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:03:11.979Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read
May 29, 2018 2:03:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:03:12.019Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
May 29, 2018 2:03:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:03:12.053Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
May 29, 2018 2:03:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:03:12.105Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
May 29, 2018 2:03:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:03:12.152Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
May 29, 2018 2:03:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:03:12.203Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
May 29, 2018 2:03:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:03:12.244Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into Create47/Read(CreateSource)
May 29, 2018 2:03:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:03:12.297Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
May 29, 2018 2:03:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:03:12.342Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
May 29, 2018 2:03:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:03:12.388Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
May 29, 2018 2:03:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:03:12.436Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
May 29, 2018 2:03:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:03:12.480Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
May 29, 2018 2:03:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:03:12.524Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
May 29, 2018 2:03:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:03:13.051Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Create
May 29, 2018 2:03:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:03:13.105Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Create
May 29, 2018 2:03:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:03:13.152Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
May 29, 2018 2:03:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:03:13.164Z: Starting 1 workers in us-central1-b...
May 29, 2018 2:03:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:03:13.200Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
May 29, 2018 2:03:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:03:13.459Z: Executing operation Create47/Read(CreateSource)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
May 29, 2018 2:03:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:03:13.514Z: Executing operation PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 29, 2018 2:03:24 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:03:23.261Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
May 29, 2018 2:03:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:03:33.995Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
May 29, 2018 2:03:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:03:34.026Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 29, 2018 2:03:57 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:03:56.284Z: Workers have started successfully.
May 29, 2018 2:04:20 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:04:18.920Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
May 29, 2018 2:04:20 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:04:19.010Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
May 29, 2018 2:04:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:04:37.805Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
May 29, 2018 2:04:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:04:37.889Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
May 29, 2018 2:04:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:04:50.446Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
May 29, 2018 2:04:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:04:50.606Z: Executing operation Create123/Read(CreateSource)+OutputSideInputs+PAssert$33/GroupGlobally/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write
May 29, 2018 2:04:56 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:04:56.152Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Close
May 29, 2018 2:04:56 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:04:56.228Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$33/GroupGlobally/RewindowActuals/Window.Assign+PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 29, 2018 2:05:01 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:05:00.904Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Close
May 29, 2018 2:05:01 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:05:00.985Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Read+PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$33/GroupGlobally/Values/Values/Map+PAssert$33/GroupGlobally/ParDo(Concat)+PAssert$33/GetPane/Map+PAssert$33/RunChecks+PAssert$33/VerifyAssertions/ParDo(DefaultConclude)
May 29, 2018 2:05:06 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:05:05.011Z: Cleaning up.
May 29, 2018 2:05:06 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:05:05.101Z: Stopping worker pool...
May 29, 2018 2:06:45 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:06:45.273Z: Autoscaling: Resized worker pool from 1 to 0.
May 29, 2018 2:06:45 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-29T02:06:45.312Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 29, 2018 2:06:54 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-05-28_19_03_01-13697804118624917740 finished with status DONE.
May 29, 2018 2:06:54 AM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-05-28_19_03_01-13697804118624917740. Found 1 success, 0 failures out of 1 expected assertions.
Gradle Test Executor 38 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest FAILED
209 tests completed, 34 failed, 2 skipped
Finished generating test XML results (0.652 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerTest>
Generating HTML test report...
Finished generating test html results (0.499 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest>
:beam-runners-google-cloud-dataflow-java:validatesRunnerTest (Thread[Task worker for ':' Thread 12,5,main]) completed. Took 2 hrs 5 mins 24.297 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:validatesRunnerTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 6m 18s
38 actionable tasks: 34 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/th4x6sigixm6y
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user katarzyna.kucharczyk@polidea.com
Not sending mail to unregistered user robbe.sneyders@ml6.eu
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user schroederc@google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ammons@google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user sidhom@google.com
Build failed in Jenkins:
beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #367
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/367/display/redirect>
------------------------------------------
[...truncated 18.09 MB...]
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey as step s16
May 28, 2018 8:08:52 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map as step s17
May 28, 2018 8:08:52 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RewindowActuals/Window.Assign as step s18
May 28, 2018 8:08:52 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map as step s19
May 28, 2018 8:08:52 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveActualsTriggering/Flatten.PCollections as step s20
May 28, 2018 8:08:52 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Create.Values/Read(CreateSource) as step s21
May 28, 2018 8:08:52 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign as step s22
May 28, 2018 8:08:52 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveDummyTriggering/Flatten.PCollections as step s23
May 28, 2018 8:08:52 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/FlattenDummyAndContents as step s24
May 28, 2018 8:08:52 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/NeverTrigger/Flatten.PCollections as step s25
May 28, 2018 8:08:52 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GroupDummyAndContents as step s26
May 28, 2018 8:08:52 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Values/Values/Map as step s27
May 28, 2018 8:08:52 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/ParDo(Concat) as step s28
May 28, 2018 8:08:52 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GetPane/Map as step s29
May 28, 2018 8:08:52 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/RunChecks as step s30
May 28, 2018 8:08:52 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/VerifyAssertions/ParDo(DefaultConclude) as step s31
May 28, 2018 8:08:52 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0528200849-6c33f46e/output/results/staging/
May 28, 2018 8:08:53 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <71120 bytes, hash 313FhuBZZQAMjIw226tldw> to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0528200849-6c33f46e/output/results/staging/pipeline-313FhuBZZQAMjIw226tldw.pb
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 28, 2018 8:08:54 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-05-28_13_08_53-1729043576820431779?project=apache-beam-testing
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Submitted job: 2018-05-28_13_08_53-1729043576820431779
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 28, 2018 8:08:54 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-05-28_13_08_53-1729043576820431779
May 28, 2018 8:08:54 PM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-05-28_13_08_53-1729043576820431779 with 1 expected assertions.
May 28, 2018 8:09:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:08:53.839Z: Autoscaling is enabled for job 2018-05-28_13_08_53-1729043576820431779. The number of workers will be between 1 and 1000.
May 28, 2018 8:09:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:08:53.883Z: Autoscaling was automatically enabled for job 2018-05-28_13_08_53-1729043576820431779.
May 28, 2018 8:09:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:08:56.295Z: Checking required Cloud APIs are enabled.
May 28, 2018 8:09:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:08:56.487Z: Checking permissions granted to controller Service Account.
May 28, 2018 8:09:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:09:10.278Z: Worker configuration: n1-standard-1 in us-central1-b.
May 28, 2018 8:09:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:09:10.817Z: Expanding CoGroupByKey operations into optimizable parts.
May 28, 2018 8:09:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:09:10.967Z: Expanding GroupByKey operations into optimizable parts.
May 28, 2018 8:09:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:09:11.013Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
May 28, 2018 8:09:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:09:11.246Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
May 28, 2018 8:09:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:09:11.287Z: Elided trivial flatten
May 28, 2018 8:09:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:09:11.326Z: Elided trivial flatten
May 28, 2018 8:09:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:09:11.365Z: Elided trivial flatten
May 28, 2018 8:09:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:09:11.411Z: Unzipping flatten s24 for input s19.org.apache.beam.sdk.values.PCollection.<init>:329#8fd0f908e3ea90e3
May 28, 2018 8:09:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:09:11.461Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Reify, through flatten PAssert$33/GroupGlobally/FlattenDummyAndContents, into producer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map
May 28, 2018 8:09:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:09:11.500Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow into PAssert$33/GroupGlobally/GroupDummyAndContents/Read
May 28, 2018 8:09:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:09:11.530Z: Fusing consumer PAssert$33/GroupGlobally/ParDo(Concat) into PAssert$33/GroupGlobally/Values/Values/Map
May 28, 2018 8:09:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:09:11.576Z: Fusing consumer PAssert$33/GetPane/Map into PAssert$33/GroupGlobally/ParDo(Concat)
May 28, 2018 8:09:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:09:11.615Z: Fusing consumer PAssert$33/GroupGlobally/Values/Values/Map into PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow
May 28, 2018 8:09:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:09:11.659Z: Fusing consumer PAssert$33/RunChecks into PAssert$33/GetPane/Map
May 28, 2018 8:09:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:09:11.686Z: Fusing consumer PAssert$33/VerifyAssertions/ParDo(DefaultConclude) into PAssert$33/RunChecks
May 28, 2018 8:09:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:09:11.733Z: Unzipping flatten s24-u45 for input s26-reify-value18-c43
May 28, 2018 8:09:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:09:11.779Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Write, through flatten s24-u45, into producer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 28, 2018 8:09:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:09:11.823Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify into PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
May 28, 2018 8:09:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:09:11.860Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Write into PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 28, 2018 8:09:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:09:11.909Z: Fusing consumer PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)
May 28, 2018 8:09:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:09:11.950Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
May 28, 2018 8:09:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:09:11.986Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
May 28, 2018 8:09:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:09:12.023Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into PAssert$33/GroupGlobally/Window.Into()/Window.Assign
May 28, 2018 8:09:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:09:12.044Z: Fusing consumer OutputSideInputs into Create123/Read(CreateSource)
May 28, 2018 8:09:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:09:12.081Z: Fusing consumer PAssert$33/GroupGlobally/Window.Into()/Window.Assign into OutputSideInputs
May 28, 2018 8:09:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:09:12.124Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
May 28, 2018 8:09:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:09:12.167Z: Fusing consumer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map into PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
May 28, 2018 8:09:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:09:12.209Z: Fusing consumer PAssert$33/GroupGlobally/RewindowActuals/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map
May 28, 2018 8:09:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:09:12.255Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read
May 28, 2018 8:09:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:09:12.301Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
May 28, 2018 8:09:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:09:12.335Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
May 28, 2018 8:09:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:09:12.375Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
May 28, 2018 8:09:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:09:12.412Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
May 28, 2018 8:09:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:09:12.447Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
May 28, 2018 8:09:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:09:12.483Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into Create47/Read(CreateSource)
May 28, 2018 8:09:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:09:12.515Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
May 28, 2018 8:09:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:09:12.560Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
May 28, 2018 8:09:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:09:12.606Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
May 28, 2018 8:09:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:09:12.644Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
May 28, 2018 8:09:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:09:12.688Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
May 28, 2018 8:09:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:09:12.735Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
May 28, 2018 8:09:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:09:13.168Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Create
May 28, 2018 8:09:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:09:13.208Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Create
May 28, 2018 8:09:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:09:13.255Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
May 28, 2018 8:09:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:09:13.267Z: Starting 1 workers in us-central1-b...
May 28, 2018 8:09:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:09:13.299Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
May 28, 2018 8:09:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:09:13.550Z: Executing operation PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 28, 2018 8:09:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:09:13.591Z: Executing operation Create47/Read(CreateSource)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
May 28, 2018 8:09:25 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:09:24.141Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
May 28, 2018 8:09:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:09:34.703Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
May 28, 2018 8:09:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:09:34.741Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 28, 2018 8:09:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:09:58.975Z: Workers have started successfully.
May 28, 2018 8:10:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:10:16.810Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
May 28, 2018 8:10:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:10:16.863Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
May 28, 2018 8:10:24 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:10:22.588Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
May 28, 2018 8:10:24 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:10:22.643Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
May 28, 2018 8:10:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:10:36.044Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
May 28, 2018 8:10:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:10:36.220Z: Executing operation Create123/Read(CreateSource)+OutputSideInputs+PAssert$33/GroupGlobally/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write
May 28, 2018 8:10:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:10:41.746Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Close
May 28, 2018 8:10:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:10:41.847Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$33/GroupGlobally/RewindowActuals/Window.Assign+PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 28, 2018 8:10:46 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:10:46.282Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Close
May 28, 2018 8:10:46 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:10:46.360Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Read+PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$33/GroupGlobally/Values/Values/Map+PAssert$33/GroupGlobally/ParDo(Concat)+PAssert$33/GetPane/Map+PAssert$33/RunChecks+PAssert$33/VerifyAssertions/ParDo(DefaultConclude)
May 28, 2018 8:10:50 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:10:50.087Z: Cleaning up.
May 28, 2018 8:10:50 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:10:50.222Z: Stopping worker pool...
May 28, 2018 8:12:50 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:12:48.782Z: Autoscaling: Resized worker pool from 1 to 0.
May 28, 2018 8:12:50 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:12:48.907Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 28, 2018 8:12:50 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T20:12:48.957Z: Worker pool stopped.
May 28, 2018 8:12:56 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-05-28_13_08_53-1729043576820431779 finished with status DONE.
May 28, 2018 8:12:57 PM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-05-28_13_08_53-1729043576820431779. Found 1 success, 0 failures out of 1 expected assertions.
Gradle Test Executor 35 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest FAILED
209 tests completed, 34 failed, 2 skipped
Finished generating test XML results (0.73 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerTest>
Generating HTML test report...
Finished generating test html results (0.436 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest>
:beam-runners-google-cloud-dataflow-java:validatesRunnerTest (Thread[Task worker for ':' Thread 40,5,main]) completed. Took 2 hrs 11 mins 9.03 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:validatesRunnerTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 12m 20s
38 actionable tasks: 34 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/v5vwr5ojtlmim
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user katarzyna.kucharczyk@polidea.com
Not sending mail to unregistered user robbe.sneyders@ml6.eu
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user schroederc@google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ammons@google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user sidhom@google.com
Build failed in Jenkins:
beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #366
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/366/display/redirect?page=changes>
Changes:
[iemejia] Refine dependencies, make new ones explicit and minor maven plugins
------------------------------------------
[...truncated 18.07 MB...]
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign as step s15
May 28, 2018 4:04:44 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey as step s16
May 28, 2018 4:04:44 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map as step s17
May 28, 2018 4:04:44 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RewindowActuals/Window.Assign as step s18
May 28, 2018 4:04:44 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map as step s19
May 28, 2018 4:04:44 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveActualsTriggering/Flatten.PCollections as step s20
May 28, 2018 4:04:44 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Create.Values/Read(CreateSource) as step s21
May 28, 2018 4:04:44 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign as step s22
May 28, 2018 4:04:44 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveDummyTriggering/Flatten.PCollections as step s23
May 28, 2018 4:04:44 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/FlattenDummyAndContents as step s24
May 28, 2018 4:04:44 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/NeverTrigger/Flatten.PCollections as step s25
May 28, 2018 4:04:44 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GroupDummyAndContents as step s26
May 28, 2018 4:04:44 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Values/Values/Map as step s27
May 28, 2018 4:04:44 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/ParDo(Concat) as step s28
May 28, 2018 4:04:44 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GetPane/Map as step s29
May 28, 2018 4:04:44 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/RunChecks as step s30
May 28, 2018 4:04:44 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/VerifyAssertions/ParDo(DefaultConclude) as step s31
May 28, 2018 4:04:44 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0528160441-aad7a812/output/results/staging/
May 28, 2018 4:04:44 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <71120 bytes, hash sDO54lzHnncWqfW3Uzb7-A> to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0528160441-aad7a812/output/results/staging/pipeline-sDO54lzHnncWqfW3Uzb7-A.pb
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 28, 2018 4:04:45 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-05-28_09_04_44-10792389488258178972?project=apache-beam-testing
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Submitted job: 2018-05-28_09_04_44-10792389488258178972
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 28, 2018 4:04:45 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-05-28_09_04_44-10792389488258178972
May 28, 2018 4:04:45 PM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-05-28_09_04_44-10792389488258178972 with 1 expected assertions.
May 28, 2018 4:05:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:04:44.776Z: Autoscaling is enabled for job 2018-05-28_09_04_44-10792389488258178972. The number of workers will be between 1 and 1000.
May 28, 2018 4:05:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:04:44.816Z: Autoscaling was automatically enabled for job 2018-05-28_09_04_44-10792389488258178972.
May 28, 2018 4:05:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:04:47.151Z: Checking required Cloud APIs are enabled.
May 28, 2018 4:05:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:04:47.451Z: Checking permissions granted to controller Service Account.
May 28, 2018 4:05:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:04:54.907Z: Worker configuration: n1-standard-1 in us-central1-b.
May 28, 2018 4:05:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:04:55.279Z: Expanding CoGroupByKey operations into optimizable parts.
May 28, 2018 4:05:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:04:55.451Z: Expanding GroupByKey operations into optimizable parts.
May 28, 2018 4:05:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:04:55.492Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
May 28, 2018 4:05:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:04:55.702Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
May 28, 2018 4:05:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:04:55.748Z: Elided trivial flatten
May 28, 2018 4:05:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:04:55.780Z: Elided trivial flatten
May 28, 2018 4:05:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:04:55.821Z: Elided trivial flatten
May 28, 2018 4:05:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:04:55.868Z: Unzipping flatten s24 for input s19.org.apache.beam.sdk.values.PCollection.<init>:329#8fd0f908e3ea90e3
May 28, 2018 4:05:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:04:55.916Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Reify, through flatten PAssert$33/GroupGlobally/FlattenDummyAndContents, into producer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map
May 28, 2018 4:05:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:04:55.963Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow into PAssert$33/GroupGlobally/GroupDummyAndContents/Read
May 28, 2018 4:05:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:04:55.997Z: Fusing consumer PAssert$33/GroupGlobally/ParDo(Concat) into PAssert$33/GroupGlobally/Values/Values/Map
May 28, 2018 4:05:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:04:56.042Z: Fusing consumer PAssert$33/GetPane/Map into PAssert$33/GroupGlobally/ParDo(Concat)
May 28, 2018 4:05:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:04:56.080Z: Fusing consumer PAssert$33/GroupGlobally/Values/Values/Map into PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow
May 28, 2018 4:05:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:04:56.125Z: Fusing consumer PAssert$33/RunChecks into PAssert$33/GetPane/Map
May 28, 2018 4:05:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:04:56.174Z: Fusing consumer PAssert$33/VerifyAssertions/ParDo(DefaultConclude) into PAssert$33/RunChecks
May 28, 2018 4:05:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:04:56.215Z: Unzipping flatten s24-u45 for input s26-reify-value18-c43
May 28, 2018 4:05:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:04:56.257Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Write, through flatten s24-u45, into producer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 28, 2018 4:05:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:04:56.295Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify into PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
May 28, 2018 4:05:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:04:56.333Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Write into PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 28, 2018 4:05:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:04:56.378Z: Fusing consumer PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)
May 28, 2018 4:05:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:04:56.416Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
May 28, 2018 4:05:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:04:56.450Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
May 28, 2018 4:05:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:04:56.488Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into PAssert$33/GroupGlobally/Window.Into()/Window.Assign
May 28, 2018 4:05:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:04:56.533Z: Fusing consumer OutputSideInputs into Create123/Read(CreateSource)
May 28, 2018 4:05:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:04:56.578Z: Fusing consumer PAssert$33/GroupGlobally/Window.Into()/Window.Assign into OutputSideInputs
May 28, 2018 4:05:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:04:56.624Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
May 28, 2018 4:05:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:04:56.665Z: Fusing consumer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map into PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
May 28, 2018 4:05:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:04:56.706Z: Fusing consumer PAssert$33/GroupGlobally/RewindowActuals/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map
May 28, 2018 4:05:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:04:56.751Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read
May 28, 2018 4:05:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:04:56.797Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
May 28, 2018 4:05:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:04:56.832Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
May 28, 2018 4:05:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:04:56.876Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
May 28, 2018 4:05:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:04:56.923Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
May 28, 2018 4:05:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:04:56.957Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
May 28, 2018 4:05:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:04:56.998Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into Create47/Read(CreateSource)
May 28, 2018 4:05:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:04:57.035Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
May 28, 2018 4:05:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:04:57.080Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
May 28, 2018 4:05:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:04:57.128Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
May 28, 2018 4:05:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:04:57.175Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
May 28, 2018 4:05:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:04:57.212Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
May 28, 2018 4:05:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:04:57.259Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
May 28, 2018 4:05:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:04:57.673Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Create
May 28, 2018 4:05:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:04:57.704Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Create
May 28, 2018 4:05:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:04:57.739Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
May 28, 2018 4:05:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:04:57.773Z: Starting 1 workers in us-central1-b...
May 28, 2018 4:05:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:04:57.773Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
May 28, 2018 4:05:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:04:57.961Z: Executing operation PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 28, 2018 4:05:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:04:58.016Z: Executing operation Create47/Read(CreateSource)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
May 28, 2018 4:05:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:05:05.573Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
May 28, 2018 4:05:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:05:16.156Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
May 28, 2018 4:05:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:05:16.194Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 28, 2018 4:05:43 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:05:42.603Z: Workers have started successfully.
May 28, 2018 4:05:57 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:05:57.423Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
May 28, 2018 4:05:57 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:05:57.516Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
May 28, 2018 4:06:07 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:06:06.268Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
May 28, 2018 4:06:07 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:06:06.356Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
May 28, 2018 4:06:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:06:19.952Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
May 28, 2018 4:06:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:06:20.137Z: Executing operation Create123/Read(CreateSource)+OutputSideInputs+PAssert$33/GroupGlobally/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write
May 28, 2018 4:06:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:06:24.728Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Close
May 28, 2018 4:06:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:06:24.823Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$33/GroupGlobally/RewindowActuals/Window.Assign+PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 28, 2018 4:06:29 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:06:28.506Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Close
May 28, 2018 4:06:29 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:06:28.593Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Read+PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$33/GroupGlobally/Values/Values/Map+PAssert$33/GroupGlobally/ParDo(Concat)+PAssert$33/GetPane/Map+PAssert$33/RunChecks+PAssert$33/VerifyAssertions/ParDo(DefaultConclude)
May 28, 2018 4:06:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:06:32.819Z: Cleaning up.
May 28, 2018 4:06:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:06:32.923Z: Stopping worker pool...
May 28, 2018 4:08:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:08:15.497Z: Autoscaling: Resized worker pool from 1 to 0.
May 28, 2018 4:08:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T16:08:15.543Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 28, 2018 4:08:25 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-05-28_09_04_44-10792389488258178972 finished with status DONE.
May 28, 2018 4:08:25 PM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-05-28_09_04_44-10792389488258178972. Found 1 success, 0 failures out of 1 expected assertions.
Gradle Test Executor 36 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest FAILED
209 tests completed, 34 failed, 2 skipped
Finished generating test XML results (0.731 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerTest>
Generating HTML test report...
Finished generating test html results (0.367 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest>
:beam-runners-google-cloud-dataflow-java:validatesRunnerTest (Thread[Task worker for ':' Thread 2,5,main]) completed. Took 2 hrs 3 mins 47.444 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:validatesRunnerTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 4m 41s
38 actionable tasks: 34 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/pw7ehlqxaf6kw
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user katarzyna.kucharczyk@polidea.com
Not sending mail to unregistered user robbe.sneyders@ml6.eu
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user schroederc@google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ammons@google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user sidhom@google.com
Build failed in Jenkins:
beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #365
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/365/display/redirect>
------------------------------------------
[...truncated 18.13 MB...]
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey as step s16
May 28, 2018 1:59:58 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map as step s17
May 28, 2018 1:59:58 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RewindowActuals/Window.Assign as step s18
May 28, 2018 1:59:58 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map as step s19
May 28, 2018 1:59:58 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveActualsTriggering/Flatten.PCollections as step s20
May 28, 2018 1:59:58 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Create.Values/Read(CreateSource) as step s21
May 28, 2018 1:59:58 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign as step s22
May 28, 2018 1:59:58 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveDummyTriggering/Flatten.PCollections as step s23
May 28, 2018 1:59:58 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/FlattenDummyAndContents as step s24
May 28, 2018 1:59:58 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/NeverTrigger/Flatten.PCollections as step s25
May 28, 2018 1:59:58 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GroupDummyAndContents as step s26
May 28, 2018 1:59:58 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Values/Values/Map as step s27
May 28, 2018 1:59:58 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/ParDo(Concat) as step s28
May 28, 2018 1:59:58 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GetPane/Map as step s29
May 28, 2018 1:59:58 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/RunChecks as step s30
May 28, 2018 1:59:58 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/VerifyAssertions/ParDo(DefaultConclude) as step s31
May 28, 2018 1:59:58 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0528135954-c31ceaa/output/results/staging/
May 28, 2018 1:59:58 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <71120 bytes, hash uezJoAtHowg_kN_E2rXRdQ> to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0528135954-c31ceaa/output/results/staging/pipeline-uezJoAtHowg_kN_E2rXRdQ.pb
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 28, 2018 1:59:59 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-05-28_06_59_58-18180271460954501526?project=apache-beam-testing
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Submitted job: 2018-05-28_06_59_58-18180271460954501526
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 28, 2018 1:59:59 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-05-28_06_59_58-18180271460954501526
May 28, 2018 1:59:59 PM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-05-28_06_59_58-18180271460954501526 with 1 expected assertions.
May 28, 2018 2:00:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T13:59:58.646Z: Autoscaling is enabled for job 2018-05-28_06_59_58-18180271460954501526. The number of workers will be between 1 and 1000.
May 28, 2018 2:00:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T13:59:58.693Z: Autoscaling was automatically enabled for job 2018-05-28_06_59_58-18180271460954501526.
May 28, 2018 2:00:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:00:01.628Z: Checking required Cloud APIs are enabled.
May 28, 2018 2:00:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:00:01.805Z: Checking permissions granted to controller Service Account.
May 28, 2018 2:00:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:00:08.373Z: Worker configuration: n1-standard-1 in us-central1-f.
May 28, 2018 2:00:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:00:08.841Z: Expanding CoGroupByKey operations into optimizable parts.
May 28, 2018 2:00:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:00:09.021Z: Expanding GroupByKey operations into optimizable parts.
May 28, 2018 2:00:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:00:09.060Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
May 28, 2018 2:00:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:00:09.286Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
May 28, 2018 2:00:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:00:09.330Z: Elided trivial flatten
May 28, 2018 2:00:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:00:09.374Z: Elided trivial flatten
May 28, 2018 2:00:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:00:09.414Z: Elided trivial flatten
May 28, 2018 2:00:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:00:09.463Z: Unzipping flatten s24 for input s19.org.apache.beam.sdk.values.PCollection.<init>:329#8fd0f908e3ea90e3
May 28, 2018 2:00:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:00:09.507Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Reify, through flatten PAssert$33/GroupGlobally/FlattenDummyAndContents, into producer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map
May 28, 2018 2:00:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:00:09.553Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow into PAssert$33/GroupGlobally/GroupDummyAndContents/Read
May 28, 2018 2:00:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:00:09.599Z: Fusing consumer PAssert$33/GroupGlobally/ParDo(Concat) into PAssert$33/GroupGlobally/Values/Values/Map
May 28, 2018 2:00:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:00:09.642Z: Fusing consumer PAssert$33/GetPane/Map into PAssert$33/GroupGlobally/ParDo(Concat)
May 28, 2018 2:00:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:00:09.688Z: Fusing consumer PAssert$33/GroupGlobally/Values/Values/Map into PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow
May 28, 2018 2:00:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:00:09.732Z: Fusing consumer PAssert$33/RunChecks into PAssert$33/GetPane/Map
May 28, 2018 2:00:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:00:09.801Z: Fusing consumer PAssert$33/VerifyAssertions/ParDo(DefaultConclude) into PAssert$33/RunChecks
May 28, 2018 2:00:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:00:09.836Z: Unzipping flatten s24-u45 for input s26-reify-value18-c43
May 28, 2018 2:00:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:00:09.869Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Write, through flatten s24-u45, into producer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 28, 2018 2:00:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:00:09.913Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify into PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
May 28, 2018 2:00:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:00:09.953Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Write into PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 28, 2018 2:00:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:00:09.977Z: Fusing consumer PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)
May 28, 2018 2:00:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:00:10.016Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
May 28, 2018 2:00:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:00:10.058Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
May 28, 2018 2:00:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:00:10.103Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into PAssert$33/GroupGlobally/Window.Into()/Window.Assign
May 28, 2018 2:00:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:00:10.148Z: Fusing consumer OutputSideInputs into Create123/Read(CreateSource)
May 28, 2018 2:00:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:00:10.187Z: Fusing consumer PAssert$33/GroupGlobally/Window.Into()/Window.Assign into OutputSideInputs
May 28, 2018 2:00:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:00:10.236Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
May 28, 2018 2:00:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:00:10.276Z: Fusing consumer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map into PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
May 28, 2018 2:00:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:00:10.303Z: Fusing consumer PAssert$33/GroupGlobally/RewindowActuals/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map
May 28, 2018 2:00:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:00:10.348Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read
May 28, 2018 2:00:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:00:10.400Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
May 28, 2018 2:00:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:00:10.447Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
May 28, 2018 2:00:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:00:10.486Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
May 28, 2018 2:00:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:00:10.534Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
May 28, 2018 2:00:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:00:10.580Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
May 28, 2018 2:00:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:00:10.627Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into Create47/Read(CreateSource)
May 28, 2018 2:00:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:00:10.673Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
May 28, 2018 2:00:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:00:10.718Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
May 28, 2018 2:00:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:00:10.764Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
May 28, 2018 2:00:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:00:10.813Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
May 28, 2018 2:00:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:00:10.858Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
May 28, 2018 2:00:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:00:10.904Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
May 28, 2018 2:00:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:00:11.360Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Create
May 28, 2018 2:00:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:00:11.406Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Create
May 28, 2018 2:00:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:00:11.453Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
May 28, 2018 2:00:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:00:11.462Z: Starting 1 workers in us-central1-f...
May 28, 2018 2:00:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:00:11.490Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
May 28, 2018 2:00:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:00:11.733Z: Executing operation PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 28, 2018 2:00:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:00:11.776Z: Executing operation Create47/Read(CreateSource)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
May 28, 2018 2:00:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:00:18.729Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
May 28, 2018 2:00:29 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:00:29.230Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
May 28, 2018 2:00:29 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:00:29.277Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 28, 2018 2:00:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:00:49.777Z: Workers have started successfully.
May 28, 2018 2:01:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:01:09.666Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
May 28, 2018 2:01:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:01:09.751Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
May 28, 2018 2:01:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:01:16.127Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
May 28, 2018 2:01:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:01:16.220Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
May 28, 2018 2:01:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:01:28.310Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
May 28, 2018 2:01:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:01:28.492Z: Executing operation Create123/Read(CreateSource)+OutputSideInputs+PAssert$33/GroupGlobally/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write
May 28, 2018 2:01:33 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:01:32.860Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Close
May 28, 2018 2:01:33 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:01:32.955Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$33/GroupGlobally/RewindowActuals/Window.Assign+PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 28, 2018 2:01:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:01:36.489Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Close
May 28, 2018 2:01:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:01:36.583Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Read+PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$33/GroupGlobally/Values/Values/Map+PAssert$33/GroupGlobally/ParDo(Concat)+PAssert$33/GetPane/Map+PAssert$33/RunChecks+PAssert$33/VerifyAssertions/ParDo(DefaultConclude)
May 28, 2018 2:01:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:01:41.529Z: Cleaning up.
May 28, 2018 2:01:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:01:41.681Z: Stopping worker pool...
May 28, 2018 2:03:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:03:20.878Z: Autoscaling: Resized worker pool from 1 to 0.
May 28, 2018 2:03:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T14:03:20.918Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 28, 2018 2:03:30 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-05-28_06_59_58-18180271460954501526 finished with status DONE.
May 28, 2018 2:03:31 PM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-05-28_06_59_58-18180271460954501526. Found 1 success, 0 failures out of 1 expected assertions.
Gradle Test Executor 3 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest
209 tests completed, 34 failed, 2 skipped
Finished generating test XML results (0.682 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerTest>
Generating HTML test report...
Finished generating test html results (0.491 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest>
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest FAILED
:beam-runners-google-cloud-dataflow-java:validatesRunnerTest (Thread[Task worker for ':' Thread 4,5,main]) completed. Took 2 hrs 1 mins 13.527 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:validatesRunnerTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 2m 34s
38 actionable tasks: 34 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/lrhbnnlclfjvk
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user katarzyna.kucharczyk@polidea.com
Not sending mail to unregistered user robbe.sneyders@ml6.eu
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user schroederc@google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ammons@google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user sidhom@google.com
Build failed in Jenkins:
beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #364
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/364/display/redirect>
------------------------------------------
[...truncated 18.07 MB...]
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey as step s16
May 28, 2018 7:57:17 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map as step s17
May 28, 2018 7:57:17 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RewindowActuals/Window.Assign as step s18
May 28, 2018 7:57:17 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map as step s19
May 28, 2018 7:57:17 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveActualsTriggering/Flatten.PCollections as step s20
May 28, 2018 7:57:17 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Create.Values/Read(CreateSource) as step s21
May 28, 2018 7:57:17 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign as step s22
May 28, 2018 7:57:17 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveDummyTriggering/Flatten.PCollections as step s23
May 28, 2018 7:57:17 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/FlattenDummyAndContents as step s24
May 28, 2018 7:57:17 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/NeverTrigger/Flatten.PCollections as step s25
May 28, 2018 7:57:17 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GroupDummyAndContents as step s26
May 28, 2018 7:57:17 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Values/Values/Map as step s27
May 28, 2018 7:57:17 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/ParDo(Concat) as step s28
May 28, 2018 7:57:17 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GetPane/Map as step s29
May 28, 2018 7:57:17 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/RunChecks as step s30
May 28, 2018 7:57:17 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/VerifyAssertions/ParDo(DefaultConclude) as step s31
May 28, 2018 7:57:17 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0528075714-8a33e07e/output/results/staging/
May 28, 2018 7:57:18 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <71120 bytes, hash Jz1m661l_C30RpWGrXUVUQ> to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0528075714-8a33e07e/output/results/staging/pipeline-Jz1m661l_C30RpWGrXUVUQ.pb
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 28, 2018 7:57:19 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-05-28_00_57_18-10301430768425555556?project=apache-beam-testing
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Submitted job: 2018-05-28_00_57_18-10301430768425555556
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 28, 2018 7:57:19 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-05-28_00_57_18-10301430768425555556
May 28, 2018 7:57:19 AM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-05-28_00_57_18-10301430768425555556 with 1 expected assertions.
May 28, 2018 7:57:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:57:18.554Z: Autoscaling is enabled for job 2018-05-28_00_57_18-10301430768425555556. The number of workers will be between 1 and 1000.
May 28, 2018 7:57:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:57:18.588Z: Autoscaling was automatically enabled for job 2018-05-28_00_57_18-10301430768425555556.
May 28, 2018 7:57:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:57:21.099Z: Checking required Cloud APIs are enabled.
May 28, 2018 7:57:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:57:21.348Z: Checking permissions granted to controller Service Account.
May 28, 2018 7:57:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:57:26.250Z: Worker configuration: n1-standard-1 in us-central1-f.
May 28, 2018 7:57:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:57:26.653Z: Expanding CoGroupByKey operations into optimizable parts.
May 28, 2018 7:57:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:57:26.787Z: Expanding GroupByKey operations into optimizable parts.
May 28, 2018 7:57:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:57:26.818Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
May 28, 2018 7:57:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:57:26.980Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
May 28, 2018 7:57:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:57:27.017Z: Elided trivial flatten
May 28, 2018 7:57:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:57:27.042Z: Elided trivial flatten
May 28, 2018 7:57:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:57:27.073Z: Elided trivial flatten
May 28, 2018 7:57:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:57:27.109Z: Unzipping flatten s24 for input s19.org.apache.beam.sdk.values.PCollection.<init>:329#8fd0f908e3ea90e3
May 28, 2018 7:57:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:57:27.139Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Reify, through flatten PAssert$33/GroupGlobally/FlattenDummyAndContents, into producer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map
May 28, 2018 7:57:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:57:27.173Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow into PAssert$33/GroupGlobally/GroupDummyAndContents/Read
May 28, 2018 7:57:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:57:27.207Z: Fusing consumer PAssert$33/GroupGlobally/ParDo(Concat) into PAssert$33/GroupGlobally/Values/Values/Map
May 28, 2018 7:57:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:57:27.240Z: Fusing consumer PAssert$33/GetPane/Map into PAssert$33/GroupGlobally/ParDo(Concat)
May 28, 2018 7:57:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:57:27.274Z: Fusing consumer PAssert$33/GroupGlobally/Values/Values/Map into PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow
May 28, 2018 7:57:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:57:27.309Z: Fusing consumer PAssert$33/RunChecks into PAssert$33/GetPane/Map
May 28, 2018 7:57:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:57:27.339Z: Fusing consumer PAssert$33/VerifyAssertions/ParDo(DefaultConclude) into PAssert$33/RunChecks
May 28, 2018 7:57:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:57:27.385Z: Unzipping flatten s24-u45 for input s26-reify-value18-c43
May 28, 2018 7:57:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:57:27.429Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Write, through flatten s24-u45, into producer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 28, 2018 7:57:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:57:27.464Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify into PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
May 28, 2018 7:57:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:57:27.510Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Write into PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 28, 2018 7:57:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:57:27.555Z: Fusing consumer PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)
May 28, 2018 7:57:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:57:27.592Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
May 28, 2018 7:57:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:57:27.633Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
May 28, 2018 7:57:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:57:27.670Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into PAssert$33/GroupGlobally/Window.Into()/Window.Assign
May 28, 2018 7:57:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:57:27.718Z: Fusing consumer OutputSideInputs into Create123/Read(CreateSource)
May 28, 2018 7:57:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:57:27.763Z: Fusing consumer PAssert$33/GroupGlobally/Window.Into()/Window.Assign into OutputSideInputs
May 28, 2018 7:57:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:57:27.804Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
May 28, 2018 7:57:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:57:27.849Z: Fusing consumer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map into PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
May 28, 2018 7:57:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:57:27.891Z: Fusing consumer PAssert$33/GroupGlobally/RewindowActuals/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map
May 28, 2018 7:57:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:57:27.929Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read
May 28, 2018 7:57:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:57:27.970Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
May 28, 2018 7:57:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:57:28.012Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
May 28, 2018 7:57:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:57:28.061Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
May 28, 2018 7:57:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:57:28.097Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
May 28, 2018 7:57:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:57:28.141Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
May 28, 2018 7:57:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:57:28.178Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into Create47/Read(CreateSource)
May 28, 2018 7:57:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:57:28.216Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
May 28, 2018 7:57:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:57:28.261Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
May 28, 2018 7:57:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:57:28.303Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
May 28, 2018 7:57:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:57:28.338Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
May 28, 2018 7:57:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:57:28.382Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
May 28, 2018 7:57:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:57:28.420Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
May 28, 2018 7:57:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:57:28.851Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Create
May 28, 2018 7:57:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:57:28.889Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Create
May 28, 2018 7:57:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:57:28.922Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
May 28, 2018 7:57:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:57:28.946Z: Starting 1 workers in us-central1-f...
May 28, 2018 7:57:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:57:28.958Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
May 28, 2018 7:57:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:57:29.176Z: Executing operation PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 28, 2018 7:57:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:57:29.201Z: Executing operation Create47/Read(CreateSource)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
May 28, 2018 7:57:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:57:36.177Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
May 28, 2018 7:57:54 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:57:51.816Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
May 28, 2018 7:57:54 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:57:51.851Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 28, 2018 7:58:12 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:58:12.093Z: Workers have started successfully.
May 28, 2018 7:58:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:58:35.943Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
May 28, 2018 7:58:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:58:36.038Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
May 28, 2018 7:58:41 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:58:41.154Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
May 28, 2018 7:58:41 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:58:41.244Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
May 28, 2018 7:58:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:58:53.274Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
May 28, 2018 7:58:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:58:53.473Z: Executing operation Create123/Read(CreateSource)+OutputSideInputs+PAssert$33/GroupGlobally/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write
May 28, 2018 7:59:00 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:58:59.837Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Close
May 28, 2018 7:59:00 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:58:59.914Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$33/GroupGlobally/RewindowActuals/Window.Assign+PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 28, 2018 7:59:06 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:59:04.610Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Close
May 28, 2018 7:59:06 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:59:04.687Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Read+PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$33/GroupGlobally/Values/Values/Map+PAssert$33/GroupGlobally/ParDo(Concat)+PAssert$33/GetPane/Map+PAssert$33/RunChecks+PAssert$33/VerifyAssertions/ParDo(DefaultConclude)
May 28, 2018 7:59:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:59:07.704Z: Cleaning up.
May 28, 2018 7:59:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T07:59:07.805Z: Stopping worker pool...
May 28, 2018 8:00:41 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T08:00:40.125Z: Autoscaling: Resized worker pool from 1 to 0.
May 28, 2018 8:00:41 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T08:00:40.168Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 28, 2018 8:00:51 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-05-28_00_57_18-10301430768425555556 finished with status DONE.
May 28, 2018 8:00:51 AM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-05-28_00_57_18-10301430768425555556. Found 1 success, 0 failures out of 1 expected assertions.
Gradle Test Executor 28 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest
209 tests completed, 41 failed, 2 skipped
Finished generating test XML results (0.563 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerTest>
Generating HTML test report...
Finished generating test html results (0.631 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest>
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest FAILED
:beam-runners-google-cloud-dataflow-java:validatesRunnerTest (Thread[Task worker for ':' Thread 42,5,main]) completed. Took 1 hrs 59 mins 4.403 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:validatesRunnerTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 0m 15s
38 actionable tasks: 34 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/2yjk5pt7wtsag
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user katarzyna.kucharczyk@polidea.com
Not sending mail to unregistered user robbe.sneyders@ml6.eu
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user schroederc@google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ammons@google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user sidhom@google.com
Build failed in Jenkins:
beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #363
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/363/display/redirect>
------------------------------------------
[...truncated 18.16 MB...]
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign as step s15
May 28, 2018 2:00:35 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey as step s16
May 28, 2018 2:00:35 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map as step s17
May 28, 2018 2:00:35 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RewindowActuals/Window.Assign as step s18
May 28, 2018 2:00:35 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map as step s19
May 28, 2018 2:00:35 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveActualsTriggering/Flatten.PCollections as step s20
May 28, 2018 2:00:35 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Create.Values/Read(CreateSource) as step s21
May 28, 2018 2:00:35 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign as step s22
May 28, 2018 2:00:35 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveDummyTriggering/Flatten.PCollections as step s23
May 28, 2018 2:00:35 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/FlattenDummyAndContents as step s24
May 28, 2018 2:00:35 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/NeverTrigger/Flatten.PCollections as step s25
May 28, 2018 2:00:35 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GroupDummyAndContents as step s26
May 28, 2018 2:00:35 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Values/Values/Map as step s27
May 28, 2018 2:00:35 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/ParDo(Concat) as step s28
May 28, 2018 2:00:35 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GetPane/Map as step s29
May 28, 2018 2:00:35 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/RunChecks as step s30
May 28, 2018 2:00:35 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/VerifyAssertions/ParDo(DefaultConclude) as step s31
May 28, 2018 2:00:35 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0528020004-7604cd4c/output/results/staging/
May 28, 2018 2:00:35 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <71120 bytes, hash x-NUCKBFZScYOjG2EovYWw> to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0528020004-7604cd4c/output/results/staging/pipeline-x-NUCKBFZScYOjG2EovYWw.pb
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 28, 2018 2:00:36 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-05-27_19_00_36-1106837276470209947?project=apache-beam-testing
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Submitted job: 2018-05-27_19_00_36-1106837276470209947
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 28, 2018 2:00:36 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-05-27_19_00_36-1106837276470209947
May 28, 2018 2:00:36 AM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-05-27_19_00_36-1106837276470209947 with 1 expected assertions.
May 28, 2018 2:00:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:00:36.166Z: Autoscaling is enabled for job 2018-05-27_19_00_36-1106837276470209947. The number of workers will be between 1 and 1000.
May 28, 2018 2:00:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:00:36.205Z: Autoscaling was automatically enabled for job 2018-05-27_19_00_36-1106837276470209947.
May 28, 2018 2:00:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:00:38.737Z: Checking required Cloud APIs are enabled.
May 28, 2018 2:00:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:00:38.926Z: Checking permissions granted to controller Service Account.
May 28, 2018 2:00:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:00:45.195Z: Worker configuration: n1-standard-1 in us-central1-c.
May 28, 2018 2:00:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:00:45.665Z: Expanding CoGroupByKey operations into optimizable parts.
May 28, 2018 2:00:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:00:45.816Z: Expanding GroupByKey operations into optimizable parts.
May 28, 2018 2:00:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:00:45.856Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
May 28, 2018 2:00:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:00:46.078Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
May 28, 2018 2:00:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:00:46.122Z: Elided trivial flatten
May 28, 2018 2:00:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:00:46.161Z: Elided trivial flatten
May 28, 2018 2:00:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:00:46.207Z: Elided trivial flatten
May 28, 2018 2:00:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:00:46.244Z: Unzipping flatten s24 for input s19.org.apache.beam.sdk.values.PCollection.<init>:329#8fd0f908e3ea90e3
May 28, 2018 2:00:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:00:46.287Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Reify, through flatten PAssert$33/GroupGlobally/FlattenDummyAndContents, into producer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map
May 28, 2018 2:00:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:00:46.331Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow into PAssert$33/GroupGlobally/GroupDummyAndContents/Read
May 28, 2018 2:00:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:00:46.375Z: Fusing consumer PAssert$33/GroupGlobally/ParDo(Concat) into PAssert$33/GroupGlobally/Values/Values/Map
May 28, 2018 2:00:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:00:46.412Z: Fusing consumer PAssert$33/GetPane/Map into PAssert$33/GroupGlobally/ParDo(Concat)
May 28, 2018 2:00:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:00:46.457Z: Fusing consumer PAssert$33/GroupGlobally/Values/Values/Map into PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow
May 28, 2018 2:00:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:00:46.500Z: Fusing consumer PAssert$33/RunChecks into PAssert$33/GetPane/Map
May 28, 2018 2:00:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:00:46.544Z: Fusing consumer PAssert$33/VerifyAssertions/ParDo(DefaultConclude) into PAssert$33/RunChecks
May 28, 2018 2:00:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:00:46.585Z: Unzipping flatten s24-u45 for input s26-reify-value18-c43
May 28, 2018 2:00:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:00:46.628Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Write, through flatten s24-u45, into producer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 28, 2018 2:00:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:00:46.670Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify into PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
May 28, 2018 2:00:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:00:46.716Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Write into PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 28, 2018 2:00:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:00:46.761Z: Fusing consumer PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)
May 28, 2018 2:00:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:00:46.803Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
May 28, 2018 2:00:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:00:46.847Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
May 28, 2018 2:00:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:00:46.890Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into PAssert$33/GroupGlobally/Window.Into()/Window.Assign
May 28, 2018 2:00:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:00:46.933Z: Fusing consumer OutputSideInputs into Create123/Read(CreateSource)
May 28, 2018 2:00:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:00:46.976Z: Fusing consumer PAssert$33/GroupGlobally/Window.Into()/Window.Assign into OutputSideInputs
May 28, 2018 2:00:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:00:47.021Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
May 28, 2018 2:00:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:00:47.058Z: Fusing consumer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map into PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
May 28, 2018 2:00:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:00:47.100Z: Fusing consumer PAssert$33/GroupGlobally/RewindowActuals/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map
May 28, 2018 2:00:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:00:47.140Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read
May 28, 2018 2:00:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:00:47.178Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
May 28, 2018 2:00:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:00:47.222Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
May 28, 2018 2:00:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:00:47.266Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
May 28, 2018 2:00:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:00:47.311Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
May 28, 2018 2:00:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:00:47.357Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
May 28, 2018 2:00:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:00:47.396Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into Create47/Read(CreateSource)
May 28, 2018 2:00:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:00:47.440Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
May 28, 2018 2:00:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:00:47.474Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
May 28, 2018 2:00:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:00:47.517Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
May 28, 2018 2:00:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:00:47.556Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
May 28, 2018 2:00:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:00:47.589Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
May 28, 2018 2:00:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:00:47.632Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
May 28, 2018 2:00:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:00:48.080Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Create
May 28, 2018 2:00:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:00:48.124Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Create
May 28, 2018 2:00:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:00:48.163Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
May 28, 2018 2:00:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:00:48.176Z: Starting 1 workers in us-central1-c...
May 28, 2018 2:00:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:00:48.203Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
May 28, 2018 2:00:50 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:00:48.411Z: Executing operation Create47/Read(CreateSource)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
May 28, 2018 2:00:50 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:00:48.456Z: Executing operation PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 28, 2018 2:00:56 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:00:56.013Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
May 28, 2018 2:01:07 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:01:06.560Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
May 28, 2018 2:01:07 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:01:06.599Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 28, 2018 2:01:25 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:01:25.565Z: Workers have started successfully.
May 28, 2018 2:02:02 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:02:00.205Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
May 28, 2018 2:02:02 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:02:00.294Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
May 28, 2018 2:02:09 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:02:07.025Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
May 28, 2018 2:02:09 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:02:07.111Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
May 28, 2018 2:02:19 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:02:19.045Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
May 28, 2018 2:02:19 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:02:19.222Z: Executing operation Create123/Read(CreateSource)+OutputSideInputs+PAssert$33/GroupGlobally/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write
May 28, 2018 2:02:27 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:02:25.182Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Close
May 28, 2018 2:02:27 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:02:25.257Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$33/GroupGlobally/RewindowActuals/Window.Assign+PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 28, 2018 2:02:31 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:02:29.236Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Close
May 28, 2018 2:02:31 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:02:29.323Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Read+PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$33/GroupGlobally/Values/Values/Map+PAssert$33/GroupGlobally/ParDo(Concat)+PAssert$33/GetPane/Map+PAssert$33/RunChecks+PAssert$33/VerifyAssertions/ParDo(DefaultConclude)
May 28, 2018 2:02:34 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:02:34.801Z: Cleaning up.
May 28, 2018 2:02:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:02:34.895Z: Stopping worker pool...
May 28, 2018 2:03:42 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:03:40.339Z: Autoscaling: Resized worker pool from 1 to 0.
May 28, 2018 2:03:42 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-28T02:03:40.387Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 28, 2018 2:03:48 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-05-27_19_00_36-1106837276470209947 finished with status DONE.
May 28, 2018 2:03:49 AM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-05-27_19_00_36-1106837276470209947. Found 1 success, 0 failures out of 1 expected assertions.
Gradle Test Executor 36 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest FAILED
209 tests completed, 34 failed, 2 skipped
Finished generating test XML results (0.424 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerTest>
Generating HTML test report...
Finished generating test html results (0.202 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest>
:beam-runners-google-cloud-dataflow-java:validatesRunnerTest (Thread[Task worker for ':' Thread 31,5,main]) completed. Took 2 hrs 1 mins 27.679 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:validatesRunnerTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 2m 43s
38 actionable tasks: 34 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/jpn4v2jkksqpw
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user katarzyna.kucharczyk@polidea.com
Not sending mail to unregistered user robbe.sneyders@ml6.eu
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user schroederc@google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ammons@google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user sidhom@google.com
Build failed in Jenkins:
beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle #362
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/362/display/redirect>
------------------------------------------
[...truncated 18.05 MB...]
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign as step s15
May 27, 2018 8:01:03 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey as step s16
May 27, 2018 8:01:03 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map as step s17
May 27, 2018 8:01:03 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RewindowActuals/Window.Assign as step s18
May 27, 2018 8:01:03 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map as step s19
May 27, 2018 8:01:03 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveActualsTriggering/Flatten.PCollections as step s20
May 27, 2018 8:01:03 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Create.Values/Read(CreateSource) as step s21
May 27, 2018 8:01:03 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign as step s22
May 27, 2018 8:01:03 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/RemoveDummyTriggering/Flatten.PCollections as step s23
May 27, 2018 8:01:03 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/FlattenDummyAndContents as step s24
May 27, 2018 8:01:03 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/NeverTrigger/Flatten.PCollections as step s25
May 27, 2018 8:01:03 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/GroupDummyAndContents as step s26
May 27, 2018 8:01:03 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/Values/Values/Map as step s27
May 27, 2018 8:01:03 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GroupGlobally/ParDo(Concat) as step s28
May 27, 2018 8:01:03 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/GetPane/Map as step s29
May 27, 2018 8:01:03 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/RunChecks as step s30
May 27, 2018 8:01:03 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding PAssert$33/VerifyAssertions/ParDo(DefaultConclude) as step s31
May 27, 2018 8:01:03 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0527200100-c753ef01/output/results/staging/
May 27, 2018 8:01:03 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <71120 bytes, hash y2p6K1gfdl2gKEwcLOCv1g> to gs://temp-storage-for-validates-runner-tests//viewtest0testsingletonsideinput-jenkins-0527200100-c753ef01/output/results/staging/pipeline-y2p6K1gfdl2gKEwcLOCv1g.pb
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 27, 2018 8:01:05 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-05-27_13_01_04-315167547435459851?project=apache-beam-testing
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_OUT
Submitted job: 2018-05-27_13_01_04-315167547435459851
org.apache.beam.sdk.transforms.ViewTest > testSingletonSideInput STANDARD_ERROR
May 27, 2018 8:01:05 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-05-27_13_01_04-315167547435459851
May 27, 2018 8:01:05 PM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-05-27_13_01_04-315167547435459851 with 1 expected assertions.
May 27, 2018 8:01:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:01:04.236Z: Autoscaling is enabled for job 2018-05-27_13_01_04-315167547435459851. The number of workers will be between 1 and 1000.
May 27, 2018 8:01:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:01:04.288Z: Autoscaling was automatically enabled for job 2018-05-27_13_01_04-315167547435459851.
May 27, 2018 8:01:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:01:06.783Z: Checking required Cloud APIs are enabled.
May 27, 2018 8:01:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:01:06.970Z: Checking permissions granted to controller Service Account.
May 27, 2018 8:01:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:01:11.711Z: Worker configuration: n1-standard-1 in us-central1-b.
May 27, 2018 8:01:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:01:12.192Z: Expanding CoGroupByKey operations into optimizable parts.
May 27, 2018 8:01:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:01:12.425Z: Expanding GroupByKey operations into optimizable parts.
May 27, 2018 8:01:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:01:12.479Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
May 27, 2018 8:01:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:01:12.735Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
May 27, 2018 8:01:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:01:12.774Z: Elided trivial flatten
May 27, 2018 8:01:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:01:12.820Z: Elided trivial flatten
May 27, 2018 8:01:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:01:12.873Z: Elided trivial flatten
May 27, 2018 8:01:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:01:12.927Z: Unzipping flatten s24 for input s19.org.apache.beam.sdk.values.PCollection.<init>:329#8fd0f908e3ea90e3
May 27, 2018 8:01:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:01:12.975Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Reify, through flatten PAssert$33/GroupGlobally/FlattenDummyAndContents, into producer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map
May 27, 2018 8:01:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:01:13.016Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow into PAssert$33/GroupGlobally/GroupDummyAndContents/Read
May 27, 2018 8:01:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:01:13.061Z: Fusing consumer PAssert$33/GroupGlobally/ParDo(Concat) into PAssert$33/GroupGlobally/Values/Values/Map
May 27, 2018 8:01:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:01:13.093Z: Fusing consumer PAssert$33/GetPane/Map into PAssert$33/GroupGlobally/ParDo(Concat)
May 27, 2018 8:01:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:01:13.150Z: Fusing consumer PAssert$33/GroupGlobally/Values/Values/Map into PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow
May 27, 2018 8:01:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:01:13.203Z: Fusing consumer PAssert$33/RunChecks into PAssert$33/GetPane/Map
May 27, 2018 8:01:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:01:13.255Z: Fusing consumer PAssert$33/VerifyAssertions/ParDo(DefaultConclude) into PAssert$33/RunChecks
May 27, 2018 8:01:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:01:13.305Z: Unzipping flatten s24-u45 for input s26-reify-value18-c43
May 27, 2018 8:01:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:01:13.340Z: Fusing unzipped copy of PAssert$33/GroupGlobally/GroupDummyAndContents/Write, through flatten s24-u45, into producer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 27, 2018 8:01:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:01:13.388Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Reify into PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign
May 27, 2018 8:01:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:01:13.450Z: Fusing consumer PAssert$33/GroupGlobally/GroupDummyAndContents/Write into PAssert$33/GroupGlobally/GroupDummyAndContents/Reify
May 27, 2018 8:01:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:01:13.482Z: Fusing consumer PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)
May 27, 2018 8:01:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:01:13.520Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map into PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)
May 27, 2018 8:01:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:01:13.569Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
May 27, 2018 8:01:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:01:13.620Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into PAssert$33/GroupGlobally/Window.Into()/Window.Assign
May 27, 2018 8:01:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:01:13.674Z: Fusing consumer OutputSideInputs into Create123/Read(CreateSource)
May 27, 2018 8:01:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:01:13.722Z: Fusing consumer PAssert$33/GroupGlobally/Window.Into()/Window.Assign into OutputSideInputs
May 27, 2018 8:01:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:01:13.776Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow
May 27, 2018 8:01:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:01:13.828Z: Fusing consumer PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map into PAssert$33/GroupGlobally/RewindowActuals/Window.Assign
May 27, 2018 8:01:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:01:13.881Z: Fusing consumer PAssert$33/GroupGlobally/RewindowActuals/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map
May 27, 2018 8:01:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:01:13.930Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow into PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read
May 27, 2018 8:01:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:01:13.987Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
May 27, 2018 8:01:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:01:14.035Z: Fusing consumer PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
May 27, 2018 8:01:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:01:14.085Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
May 27, 2018 8:01:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:01:14.134Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
May 27, 2018 8:01:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:01:14.205Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
May 27, 2018 8:01:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:01:14.241Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into Create47/Read(CreateSource)
May 27, 2018 8:01:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:01:14.297Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
May 27, 2018 8:01:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:01:14.336Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
May 27, 2018 8:01:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:01:14.386Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
May 27, 2018 8:01:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:01:14.425Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
May 27, 2018 8:01:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:01:14.466Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
May 27, 2018 8:01:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:01:14.506Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
May 27, 2018 8:01:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:01:15.051Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Create
May 27, 2018 8:01:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:01:15.090Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Create
May 27, 2018 8:01:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:01:15.138Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
May 27, 2018 8:01:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:01:15.167Z: Starting 1 workers in us-central1-b...
May 27, 2018 8:01:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:01:15.189Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
May 27, 2018 8:01:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:01:15.475Z: Executing operation PAssert$33/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$33/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 27, 2018 8:01:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:01:15.537Z: Executing operation Create47/Read(CreateSource)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
May 27, 2018 8:01:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:01:25.720Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
May 27, 2018 8:01:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:01:52.253Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
May 27, 2018 8:01:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:01:52.298Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 27, 2018 8:02:21 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:02:19.704Z: Workers have started successfully.
May 27, 2018 8:02:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:02:44.405Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
May 27, 2018 8:02:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:02:44.519Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
May 27, 2018 8:02:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:02:51.022Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
May 27, 2018 8:02:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:02:51.126Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
May 27, 2018 8:03:02 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:03:02.523Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
May 27, 2018 8:03:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:03:02.748Z: Executing operation Create123/Read(CreateSource)+OutputSideInputs+PAssert$33/GroupGlobally/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$33/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$33/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Write
May 27, 2018 8:03:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:03:07.714Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Close
May 27, 2018 8:03:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:03:07.806Z: Executing operation PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$33/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$33/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$33/GroupGlobally/RewindowActuals/Window.Assign+PAssert$33/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$33/GroupGlobally/GroupDummyAndContents/Reify+PAssert$33/GroupGlobally/GroupDummyAndContents/Write
May 27, 2018 8:03:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:03:11.810Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Close
May 27, 2018 8:03:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:03:11.919Z: Executing operation PAssert$33/GroupGlobally/GroupDummyAndContents/Read+PAssert$33/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$33/GroupGlobally/Values/Values/Map+PAssert$33/GroupGlobally/ParDo(Concat)+PAssert$33/GetPane/Map+PAssert$33/RunChecks+PAssert$33/VerifyAssertions/ParDo(DefaultConclude)
May 27, 2018 8:03:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:03:16.314Z: Cleaning up.
May 27, 2018 8:03:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:03:16.430Z: Stopping worker pool...
May 27, 2018 8:04:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:04:51.058Z: Autoscaling: Resized worker pool from 1 to 0.
May 27, 2018 8:04:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-05-27T20:04:51.106Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
May 27, 2018 8:04:59 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-05-27_13_01_04-315167547435459851 finished with status DONE.
May 27, 2018 8:04:59 PM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-05-27_13_01_04-315167547435459851. Found 1 success, 0 failures out of 1 expected assertions.
Gradle Test Executor 39 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:validatesRunnerTest FAILED
209 tests completed, 34 failed, 2 skipped
Finished generating test XML results (0.374 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/test-results/validatesRunnerTest>
Generating HTML test report...
Finished generating test html results (0.302 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest>
:beam-runners-google-cloud-dataflow-java:validatesRunnerTest (Thread[Task worker for ':' Thread 21,5,main]) completed. Took 2 hrs 3 mins 3.254 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:validatesRunnerTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/validatesRunnerTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 4m 21s
38 actionable tasks: 34 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/5pud4kdxlyals
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user katarzyna.kucharczyk@polidea.com
Not sending mail to unregistered user robbe.sneyders@ml6.eu
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user schroederc@google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ammons@google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user sidhom@google.com