You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2018/11/02 18:16:26 UTC
Build failed in Jenkins:
beam_PostCommit_Java_PortabilityApi_GradleBuild #36
See <https://builds.apache.org/job/beam_PostCommit_Java_PortabilityApi_GradleBuild/36/display/redirect?page=changes>
Changes:
[lcwik] Dataflow Worker: Fix to report millis for couple processing times
------------------------------------------
[...truncated 1.61 MB...]
Nov 02, 2018 5:42:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-02T17:42:24.527Z: Executing operation BigQueryIO.Read/BigQueryIO.TypedRead/TriggerIdCreation/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Create
Nov 02, 2018 5:42:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-02T17:42:24.563Z: Executing operation BigQueryIO.Write/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/View.CreatePCollectionView/GroupByKeyHashAndSortByKeyAndWindow/Create
Nov 02, 2018 5:42:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-02T17:42:24.610Z: Executing operation BigQueryIO.Write/BatchLoads/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Create
Nov 02, 2018 5:42:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-02T17:42:24.658Z: Executing operation BigQueryIO.Write/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
Nov 02, 2018 5:42:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-02T17:42:24.698Z: Executing operation BigQueryIO.Write/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/View.CreatePCollectionView/GroupByKeyHashAndSortByKeyAndWindow/Create
Nov 02, 2018 5:42:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-02T17:42:24.745Z: Executing operation BigQueryIO.Write/BatchLoads/GroupByDestination/Create
Nov 02, 2018 5:42:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-02T17:42:24.792Z: Executing operation BigQueryIO.Write/BatchLoads/ReifyResults/View.AsIterable/View.CreatePCollectionView/GroupByKeyHashAndSortByKeyAndWindow/Create
Nov 02, 2018 5:42:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-02T17:42:24.834Z: Executing operation BigQueryIO.Write/BatchLoads/ReifyResults/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Create
Nov 02, 2018 5:42:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-02T17:42:24.871Z: Executing operation BigQueryIO.Write/BatchLoads/MultiPartitionsReshuffle/GroupByKey/Create
Nov 02, 2018 5:42:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-02T17:42:24.907Z: Executing operation BigQueryIO.Write/BatchLoads/MultiPartitionsWriteTables/GroupByKey/Create
Nov 02, 2018 5:42:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-02T17:42:24.947Z: Executing operation BigQueryIO.Write/BatchLoads/ReifyRenameInput/View.AsIterable/View.CreatePCollectionView/GroupByKeyHashAndSortByKeyAndWindow/Create
Nov 02, 2018 5:42:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-02T17:42:24.986Z: Executing operation BigQueryIO.Write/BatchLoads/ReifyRenameInput/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Create
Nov 02, 2018 5:42:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-02T17:42:25.997Z: Executing operation BigQueryIO.Write/BatchLoads/CreateEmptyFailedInserts/Read(CreateSource)/Impulse+BigQueryIO.Write/BatchLoads/CreateEmptyFailedInserts/Read(CreateSource)/ParDo(SplitBoundedSource)+BigQueryIO.Write/BatchLoads/CreateEmptyFailedInserts/Read(CreateSource)/Reshuffle.ViaRandomKey/Pair with random key+BigQueryIO.Write/BatchLoads/CreateEmptyFailedInserts/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign+BigQueryIO.Write/BatchLoads/CreateEmptyFailedInserts/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify+BigQueryIO.Write/BatchLoads/CreateEmptyFailedInserts/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write
Nov 02, 2018 5:42:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-02T17:42:26.036Z: Executing operation BigQueryIO.Read/BigQueryIO.TypedRead/Read(BigQueryQuerySource)/Impulse+BigQueryIO.Read/BigQueryIO.TypedRead/Read(BigQueryQuerySource)/ParDo(SplitBoundedSource)+BigQueryIO.Read/BigQueryIO.TypedRead/Read(BigQueryQuerySource)/Reshuffle.ViaRandomKey/Pair with random key+BigQueryIO.Read/BigQueryIO.TypedRead/Read(BigQueryQuerySource)/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign+BigQueryIO.Read/BigQueryIO.TypedRead/Read(BigQueryQuerySource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify+BigQueryIO.Read/BigQueryIO.TypedRead/Read(BigQueryQuerySource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write
Nov 02, 2018 5:42:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-02T17:42:26.086Z: Executing operation BigQueryIO.Read/BigQueryIO.TypedRead/PassThroughThenCleanup/Create(CleanupOperation)/Read(CreateSource)/Impulse+BigQueryIO.Read/BigQueryIO.TypedRead/PassThroughThenCleanup/Create(CleanupOperation)/Read(CreateSource)/ParDo(SplitBoundedSource)+BigQueryIO.Read/BigQueryIO.TypedRead/PassThroughThenCleanup/Create(CleanupOperation)/Read(CreateSource)/Reshuffle.ViaRandomKey/Pair with random key+BigQueryIO.Read/BigQueryIO.TypedRead/PassThroughThenCleanup/Create(CleanupOperation)/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign+BigQueryIO.Read/BigQueryIO.TypedRead/PassThroughThenCleanup/Create(CleanupOperation)/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify+BigQueryIO.Read/BigQueryIO.TypedRead/PassThroughThenCleanup/Create(CleanupOperation)/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write
Nov 02, 2018 5:42:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-02T17:42:26.126Z: Executing operation BigQueryIO.Write/BatchLoads/JobIdCreationRoot/Read(CreateSource)/Impulse+BigQueryIO.Write/BatchLoads/JobIdCreationRoot/Read(CreateSource)/ParDo(SplitBoundedSource)+BigQueryIO.Write/BatchLoads/JobIdCreationRoot/Read(CreateSource)/Reshuffle.ViaRandomKey/Pair with random key+BigQueryIO.Write/BatchLoads/JobIdCreationRoot/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign+BigQueryIO.Write/BatchLoads/JobIdCreationRoot/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify+BigQueryIO.Write/BatchLoads/JobIdCreationRoot/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write
Nov 02, 2018 5:42:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-02T17:42:26.175Z: Executing operation BigQueryIO.Read/BigQueryIO.TypedRead/TriggerIdCreation/Read(CreateSource)/Impulse+BigQueryIO.Read/BigQueryIO.TypedRead/TriggerIdCreation/Read(CreateSource)/ParDo(SplitBoundedSource)+BigQueryIO.Read/BigQueryIO.TypedRead/TriggerIdCreation/Read(CreateSource)/Reshuffle.ViaRandomKey/Pair with random key+BigQueryIO.Read/BigQueryIO.TypedRead/TriggerIdCreation/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign+BigQueryIO.Read/BigQueryIO.TypedRead/TriggerIdCreation/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify+BigQueryIO.Read/BigQueryIO.TypedRead/TriggerIdCreation/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write
Nov 02, 2018 5:42:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-02T17:42:26.220Z: Executing operation BigQueryIO.Write/BatchLoads/Create.Values/Read(CreateSource)/Impulse+BigQueryIO.Write/BatchLoads/Create.Values/Read(CreateSource)/ParDo(SplitBoundedSource)+BigQueryIO.Write/BatchLoads/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Pair with random key+BigQueryIO.Write/BatchLoads/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign+BigQueryIO.Write/BatchLoads/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify+BigQueryIO.Write/BatchLoads/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write
Nov 02, 2018 5:42:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-02T17:42:26.270Z: Executing operation BigQueryIO.Write/BatchLoads/ReifyResults/Create.Values/Read(CreateSource)/Impulse+BigQueryIO.Write/BatchLoads/ReifyResults/Create.Values/Read(CreateSource)/ParDo(SplitBoundedSource)+BigQueryIO.Write/BatchLoads/ReifyResults/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Pair with random key+BigQueryIO.Write/BatchLoads/ReifyResults/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign+BigQueryIO.Write/BatchLoads/ReifyResults/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify+BigQueryIO.Write/BatchLoads/ReifyResults/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write
Nov 02, 2018 5:42:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-02T17:42:26.315Z: Executing operation BigQueryIO.Write/BatchLoads/ReifyRenameInput/Create.Values/Read(CreateSource)/Impulse+BigQueryIO.Write/BatchLoads/ReifyRenameInput/Create.Values/Read(CreateSource)/ParDo(SplitBoundedSource)+BigQueryIO.Write/BatchLoads/ReifyRenameInput/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Pair with random key+BigQueryIO.Write/BatchLoads/ReifyRenameInput/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign+BigQueryIO.Write/BatchLoads/ReifyRenameInput/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify+BigQueryIO.Write/BatchLoads/ReifyRenameInput/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write
Nov 02, 2018 5:42:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-02T17:42:35.589Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
Nov 02, 2018 5:43:48 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-02T17:43:46.284Z: Workers have started successfully.
Nov 02, 2018 5:43:48 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-02T17:43:48.333Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
Nov 02, 2018 5:43:48 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-02T17:43:48.380Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
Nov 02, 2018 5:44:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-02T17:44:09.641Z: Executing operation BigQueryIO.Read/BigQueryIO.TypedRead/PassThroughThenCleanup/Create(CleanupOperation)/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Close
Nov 02, 2018 5:44:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-02T17:44:17.348Z: Workers have started successfully.
Nov 02, 2018 5:47:46 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-02T17:47:45.968Z: Autoscaling: Resizing worker pool from 1 to 2.
Nov 02, 2018 5:47:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-02T17:47:50.499Z: Executing operation BigQueryIO.Read/BigQueryIO.TypedRead/Read(BigQueryQuerySource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Close
Nov 02, 2018 5:47:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-02T17:47:51.723Z: Executing operation BigQueryIO.Write/BatchLoads/ReifyResults/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Close
Nov 02, 2018 5:47:54 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-02T17:47:53.927Z: Executing operation BigQueryIO.Write/BatchLoads/ReifyRenameInput/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Close
Nov 02, 2018 5:47:57 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-02T17:47:56.122Z: Executing operation BigQueryIO.Write/BatchLoads/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Close
Nov 02, 2018 5:47:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-02T17:47:58.337Z: Executing operation BigQueryIO.Write/BatchLoads/JobIdCreationRoot/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Close
Nov 02, 2018 5:47:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-02T17:47:58.422Z: Executing operation BigQueryIO.Write/BatchLoads/JobIdCreationRoot/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read+BigQueryIO.Write/BatchLoads/JobIdCreationRoot/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow+BigQueryIO.Write/BatchLoads/JobIdCreationRoot/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable+BigQueryIO.Write/BatchLoads/JobIdCreationRoot/Read(CreateSource)/Reshuffle.ViaRandomKey/Values/Values/Map+BigQueryIO.Write/BatchLoads/JobIdCreationRoot/Read(CreateSource)/ParDo(ReadFromBoundedSource)+BigQueryIO.Write/BatchLoads/CreateJobId+BigQueryIO.Write/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+BigQueryIO.Write/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+BigQueryIO.Write/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+BigQueryIO.Write/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+BigQueryIO.Write/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
Nov 02, 2018 5:48:20 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-02T17:48:19.507Z: Autoscaling: Raised the number of workers to 2 based on the rate of progress in the currently running step(s).
Nov 02, 2018 5:48:25 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-02T17:48:23.581Z: Executing operation BigQueryIO.Write/BatchLoads/CreateEmptyFailedInserts/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Close
Nov 02, 2018 5:48:25 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-02T17:48:23.749Z: Executing operation BigQueryIO.Write/BatchLoads/CreateEmptyFailedInserts/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read+BigQueryIO.Write/BatchLoads/CreateEmptyFailedInserts/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow+BigQueryIO.Write/BatchLoads/CreateEmptyFailedInserts/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable+BigQueryIO.Write/BatchLoads/CreateEmptyFailedInserts/Read(CreateSource)/Reshuffle.ViaRandomKey/Values/Values/Map+BigQueryIO.Write/BatchLoads/CreateEmptyFailedInserts/Read(CreateSource)/ParDo(ReadFromBoundedSource)+DropInputs
Nov 02, 2018 5:48:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-02T17:48:28.095Z: Executing operation BigQueryIO.Write/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
Nov 02, 2018 5:48:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-02T17:48:28.185Z: Executing operation BigQueryIO.Write/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+BigQueryIO.Write/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/GroupByWindow+BigQueryIO.Write/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+BigQueryIO.Write/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+BigQueryIO.Write/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+BigQueryIO.Write/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/View.VoidKeyToMultimapMaterialization/ParDo(VoidKeyToMultimapMaterialization)+BigQueryIO.Write/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/View.CreatePCollectionView/CreateIsmShardKeyAndSortKey+BigQueryIO.Write/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/View.CreatePCollectionView/GroupByKeyHashAndSortByKeyAndWindow/Write
Nov 02, 2018 5:48:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-02T17:48:33.687Z: Executing operation BigQueryIO.Write/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/View.CreatePCollectionView/GroupByKeyHashAndSortByKeyAndWindow/Close
Nov 02, 2018 5:48:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-02T17:48:33.778Z: Executing operation BigQueryIO.Write/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/View.CreatePCollectionView/GroupByKeyHashAndSortByKeyAndWindow/Read+BigQueryIO.Write/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/View.CreatePCollectionView/ToIsmRecordForMultimap
Nov 02, 2018 5:48:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-02T17:48:35.875Z: Executing operation BigQueryIO.Read/BigQueryIO.TypedRead/TriggerIdCreation/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Close
Nov 02, 2018 5:48:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-02T17:48:35.975Z: Executing operation BigQueryIO.Read/BigQueryIO.TypedRead/TriggerIdCreation/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read+BigQueryIO.Read/BigQueryIO.TypedRead/TriggerIdCreation/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow+BigQueryIO.Read/BigQueryIO.TypedRead/TriggerIdCreation/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable+BigQueryIO.Read/BigQueryIO.TypedRead/TriggerIdCreation/Read(CreateSource)/Reshuffle.ViaRandomKey/Values/Values/Map+BigQueryIO.Read/BigQueryIO.TypedRead/TriggerIdCreation/Read(CreateSource)/ParDo(ReadFromBoundedSource)+BigQueryIO.Read/BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+BigQueryIO.Read/BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+BigQueryIO.Read/BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+BigQueryIO.Read/BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+BigQueryIO.Read/BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
Nov 02, 2018 5:49:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-02T17:49:00.678Z: Executing operation BigQueryIO.Read/BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
Nov 02, 2018 5:49:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-02T17:49:00.761Z: Executing operation BigQueryIO.Read/BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+BigQueryIO.Read/BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/GroupByWindow+BigQueryIO.Read/BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+BigQueryIO.Read/BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+BigQueryIO.Read/BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+BigQueryIO.Read/BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/View.VoidKeyToMultimapMaterialization/ParDo(VoidKeyToMultimapMaterialization)+BigQueryIO.Read/BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/View.CreatePCollectionView/CreateIsmShardKeyAndSortKey+BigQueryIO.Read/BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/View.CreatePCollectionView/GroupByKeyHashAndSortByKeyAndWindow/Write
Nov 02, 2018 5:49:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-02T17:49:01.167Z: Executing operation BigQueryIO.Write/BatchLoads/View.AsSingleton/Combine.GloballyAsSingletonView/View.CreatePCollectionView/Materialize
Nov 02, 2018 5:49:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-02T17:49:01.370Z: Executing operation BigQueryIO.Write/BatchLoads/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read+BigQueryIO.Write/BatchLoads/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow+BigQueryIO.Write/BatchLoads/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable+BigQueryIO.Write/BatchLoads/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Values/Values/Map+BigQueryIO.Write/BatchLoads/Create.Values/Read(CreateSource)/ParDo(ReadFromBoundedSource)+BigQueryIO.Write/BatchLoads/GetTempFilePrefix+BigQueryIO.Write/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+BigQueryIO.Write/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+BigQueryIO.Write/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+BigQueryIO.Write/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+BigQueryIO.Write/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
Nov 02, 2018 5:49:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-02T17:49:07.324Z: Executing operation BigQueryIO.Write/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
Nov 02, 2018 5:49:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-02T17:49:07.421Z: Executing operation BigQueryIO.Write/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+BigQueryIO.Write/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/GroupByWindow+BigQueryIO.Write/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+BigQueryIO.Write/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+BigQueryIO.Write/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+BigQueryIO.Write/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/View.VoidKeyToMultimapMaterialization/ParDo(VoidKeyToMultimapMaterialization)+BigQueryIO.Write/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/View.CreatePCollectionView/CreateIsmShardKeyAndSortKey+BigQueryIO.Write/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/View.CreatePCollectionView/GroupByKeyHashAndSortByKeyAndWindow/Write
Nov 02, 2018 5:49:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-02T17:49:13.092Z: Executing operation BigQueryIO.Read/BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/View.CreatePCollectionView/GroupByKeyHashAndSortByKeyAndWindow/Close
Nov 02, 2018 5:49:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-02T17:49:13.191Z: Executing operation BigQueryIO.Read/BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/View.CreatePCollectionView/GroupByKeyHashAndSortByKeyAndWindow/Read+BigQueryIO.Read/BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/View.CreatePCollectionView/ToIsmRecordForMultimap
Nov 02, 2018 5:49:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-02T17:49:16.961Z: Executing operation BigQueryIO.Read/BigQueryIO.TypedRead/ViewId/Combine.GloballyAsSingletonView/View.CreatePCollectionView/Materialize
Nov 02, 2018 5:49:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-02T17:49:17.993Z: Executing operation BigQueryIO.Write/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/View.CreatePCollectionView/GroupByKeyHashAndSortByKeyAndWindow/Close
Nov 02, 2018 5:49:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-02T17:49:18.080Z: Executing operation BigQueryIO.Write/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/View.CreatePCollectionView/GroupByKeyHashAndSortByKeyAndWindow/Read+BigQueryIO.Write/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/View.CreatePCollectionView/ToIsmRecordForMultimap
Nov 02, 2018 5:49:24 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-02T17:49:22.940Z: Executing operation BigQueryIO.Write/BatchLoads/TempFilePrefixView/Combine.GloballyAsSingletonView/View.CreatePCollectionView/Materialize
Nov 02, 2018 5:49:24 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-02T17:49:23.136Z: Executing operation BigQueryIO.Read/BigQueryIO.TypedRead/Read(BigQueryQuerySource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read+BigQueryIO.Read/BigQueryIO.TypedRead/Read(BigQueryQuerySource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow+BigQueryIO.Read/BigQueryIO.TypedRead/Read(BigQueryQuerySource)/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable+BigQueryIO.Read/BigQueryIO.TypedRead/Read(BigQueryQuerySource)/Reshuffle.ViaRandomKey/Values/Values/Map+BigQueryIO.Read/BigQueryIO.TypedRead/Read(BigQueryQuerySource)/ParDo(ReadFromBoundedSource)+BigQueryIO.Read/BigQueryIO.TypedRead/PassThroughThenCleanup/ParMultiDo(Identity)+BigQueryIO.Read/BigQueryIO.TypedRead/PassThroughThenCleanup/View.AsIterable/View.VoidKeyToMultimapMaterialization/ParDo(VoidKeyToMultimapMaterialization)+BigQueryIO.Read/BigQueryIO.TypedRead/PassThroughThenCleanup/View.AsIterable/View.CreatePCollectionView/CreateIsmShardKeyAndSortKey+BigQueryIO.Read/BigQueryIO.TypedRead/PassThroughThenCleanup/View.AsIterable/View.CreatePCollectionView/GroupByKeyHashAndSortByKeyAndWindow/Write+BigQueryIO.Write/PrepareWrite/ParDo(Anonymous)+BigQueryIO.Write/BatchLoads/rewindowIntoGlobal/Window.Assign+BigQueryIO.Write/BatchLoads/WriteBundlesToFiles+BigQueryIO.Write/BatchLoads/ReifyResults/View.AsIterable/View.VoidKeyToMultimapMaterialization/ParDo(VoidKeyToMultimapMaterialization)+BigQueryIO.Write/BatchLoads/ReifyResults/View.AsIterable/View.CreatePCollectionView/CreateIsmShardKeyAndSortKey+BigQueryIO.Write/BatchLoads/ReifyResults/View.AsIterable/View.CreatePCollectionView/GroupByKeyHashAndSortByKeyAndWindow/Write+BigQueryIO.Write/BatchLoads/GroupByDestination/Reify+BigQueryIO.Write/BatchLoads/GroupByDestination/Write
Nov 02, 2018 5:49:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-02T17:49:44.698Z: Executing operation BigQueryIO.Write/BatchLoads/GroupByDestination/Close
Nov 02, 2018 5:49:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-02T17:49:44.746Z: Executing operation BigQueryIO.Read/BigQueryIO.TypedRead/PassThroughThenCleanup/View.AsIterable/View.CreatePCollectionView/GroupByKeyHashAndSortByKeyAndWindow/Close
Nov 02, 2018 5:49:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-02T17:49:44.796Z: Executing operation BigQueryIO.Write/BatchLoads/GroupByDestination/Read+BigQueryIO.Write/BatchLoads/GroupByDestination/GroupByWindow+BigQueryIO.Write/BatchLoads/WriteGroupedRecords+BigQueryIO.Write/BatchLoads/ReifyResults/View.AsIterable/View.VoidKeyToMultimapMaterialization/ParDo(VoidKeyToMultimapMaterialization)+BigQueryIO.Write/BatchLoads/ReifyResults/View.AsIterable/View.CreatePCollectionView/CreateIsmShardKeyAndSortKey+BigQueryIO.Write/BatchLoads/ReifyResults/View.AsIterable/View.CreatePCollectionView/GroupByKeyHashAndSortByKeyAndWindow/Write
Nov 02, 2018 5:49:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-02T17:49:44.848Z: Executing operation BigQueryIO.Read/BigQueryIO.TypedRead/PassThroughThenCleanup/View.AsIterable/View.CreatePCollectionView/GroupByKeyHashAndSortByKeyAndWindow/Read+BigQueryIO.Read/BigQueryIO.TypedRead/PassThroughThenCleanup/View.AsIterable/View.CreatePCollectionView/ToIsmRecordForMultimap
Nov 02, 2018 5:49:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-02T17:49:45.206Z: Executing operation BigQueryIO.Write/BatchLoads/ReifyResults/View.AsIterable/View.CreatePCollectionView/GroupByKeyHashAndSortByKeyAndWindow/Close
Nov 02, 2018 5:49:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-02T17:49:45.301Z: Executing operation BigQueryIO.Write/BatchLoads/ReifyResults/View.AsIterable/View.CreatePCollectionView/GroupByKeyHashAndSortByKeyAndWindow/Read+BigQueryIO.Write/BatchLoads/ReifyResults/View.AsIterable/View.CreatePCollectionView/ToIsmRecordForMultimap
Nov 02, 2018 5:49:48 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-02T17:49:48.066Z: Executing operation BigQueryIO.Read/BigQueryIO.TypedRead/PassThroughThenCleanup/View.AsIterable/View.CreatePCollectionView/Materialize
Nov 02, 2018 5:49:48 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-02T17:49:48.527Z: Executing operation BigQueryIO.Read/BigQueryIO.TypedRead/PassThroughThenCleanup/Create(CleanupOperation)/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read+BigQueryIO.Read/BigQueryIO.TypedRead/PassThroughThenCleanup/Create(CleanupOperation)/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow+BigQueryIO.Read/BigQueryIO.TypedRead/PassThroughThenCleanup/Create(CleanupOperation)/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable+BigQueryIO.Read/BigQueryIO.TypedRead/PassThroughThenCleanup/Create(CleanupOperation)/Read(CreateSource)/Reshuffle.ViaRandomKey/Values/Values/Map+BigQueryIO.Read/BigQueryIO.TypedRead/PassThroughThenCleanup/Create(CleanupOperation)/Read(CreateSource)/ParDo(ReadFromBoundedSource)+BigQueryIO.Read/BigQueryIO.TypedRead/PassThroughThenCleanup/Cleanup
Nov 02, 2018 5:49:50 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-02T17:49:50.037Z: Executing operation BigQueryIO.Write/BatchLoads/ReifyResults/View.AsIterable/View.CreatePCollectionView/Materialize
Nov 02, 2018 5:49:50 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-02T17:49:50.250Z: Executing operation BigQueryIO.Write/BatchLoads/ReifyResults/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read+BigQueryIO.Write/BatchLoads/ReifyResults/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow+BigQueryIO.Write/BatchLoads/ReifyResults/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable+BigQueryIO.Write/BatchLoads/ReifyResults/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Values/Values/Map+BigQueryIO.Write/BatchLoads/ReifyResults/Create.Values/Read(CreateSource)/ParDo(ReadFromBoundedSource)+BigQueryIO.Write/BatchLoads/ReifyResults/ParDo(Anonymous)+BigQueryIO.Write/BatchLoads/WritePartitionUntriggered+BigQueryIO.Write/BatchLoads/SinglePartitionsReshuffle/Window.Into()/Window.Assign+BigQueryIO.Write/BatchLoads/SinglePartitionsReshuffle/GroupByKey/Reify+BigQueryIO.Write/BatchLoads/SinglePartitionsReshuffle/GroupByKey/Write+BigQueryIO.Write/BatchLoads/MultiPartitionsReshuffle/Window.Into()/Window.Assign+BigQueryIO.Write/BatchLoads/MultiPartitionsReshuffle/GroupByKey/Reify+BigQueryIO.Write/BatchLoads/MultiPartitionsReshuffle/GroupByKey/Write
Nov 02, 2018 5:49:54 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-02T17:49:54.656Z: Executing operation BigQueryIO.Write/BatchLoads/MultiPartitionsReshuffle/GroupByKey/Close
Nov 02, 2018 5:49:54 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-02T17:49:54.707Z: Executing operation BigQueryIO.Write/BatchLoads/SinglePartitionsReshuffle/GroupByKey/Close
Nov 02, 2018 5:49:54 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-02T17:49:54.753Z: Executing operation BigQueryIO.Write/BatchLoads/MultiPartitionsReshuffle/GroupByKey/Read+BigQueryIO.Write/BatchLoads/MultiPartitionsReshuffle/GroupByKey/GroupByWindow+BigQueryIO.Write/BatchLoads/MultiPartitionsReshuffle/ExpandIterable+BigQueryIO.Write/BatchLoads/MultiPartitionsWriteTables/ParMultiDo(WriteTables)+BigQueryIO.Write/BatchLoads/MultiPartitionsWriteTables/WithKeys/AddKeys/Map+BigQueryIO.Write/BatchLoads/MultiPartitionsWriteTables/Window.Into()/Window.Assign+BigQueryIO.Write/BatchLoads/MultiPartitionsWriteTables/GroupByKey/Reify+BigQueryIO.Write/BatchLoads/MultiPartitionsWriteTables/GroupByKey/Write+BigQueryIO.Write/BatchLoads/ReifyRenameInput/View.AsIterable/View.VoidKeyToMultimapMaterialization/ParDo(VoidKeyToMultimapMaterialization)+BigQueryIO.Write/BatchLoads/ReifyRenameInput/View.AsIterable/View.CreatePCollectionView/CreateIsmShardKeyAndSortKey+BigQueryIO.Write/BatchLoads/ReifyRenameInput/View.AsIterable/View.CreatePCollectionView/GroupByKeyHashAndSortByKeyAndWindow/Write
Nov 02, 2018 5:49:57 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-02T17:49:54.801Z: Executing operation BigQueryIO.Write/BatchLoads/SinglePartitionsReshuffle/GroupByKey/Read+BigQueryIO.Write/BatchLoads/SinglePartitionsReshuffle/GroupByKey/GroupByWindow+BigQueryIO.Write/BatchLoads/SinglePartitionsReshuffle/ExpandIterable+BigQueryIO.Write/BatchLoads/SinglePartitionWriteTables/ParMultiDo(WriteTables)+BigQueryIO.Write/BatchLoads/SinglePartitionWriteTables/WithKeys/AddKeys/Map+BigQueryIO.Write/BatchLoads/SinglePartitionWriteTables/Window.Into()/Window.Assign+BigQueryIO.Write/BatchLoads/SinglePartitionWriteTables/GroupByKey/Reify+BigQueryIO.Write/BatchLoads/SinglePartitionWriteTables/GroupByKey/Write
Nov 02, 2018 5:50:03 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-02T17:50:02.980Z: Executing operation BigQueryIO.Write/BatchLoads/SinglePartitionWriteTables/GroupByKey/Close
Nov 02, 2018 5:50:03 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-02T17:50:03.090Z: Executing operation BigQueryIO.Write/BatchLoads/SinglePartitionWriteTables/GroupByKey/Read+BigQueryIO.Write/BatchLoads/SinglePartitionWriteTables/GroupByKey/GroupByWindow+BigQueryIO.Write/BatchLoads/SinglePartitionWriteTables/Values/Values/Map+BigQueryIO.Write/BatchLoads/SinglePartitionWriteTables/ParDo(GarbageCollectTemporaryFiles)
Nov 02, 2018 5:50:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-02T17:50:04.275Z: Executing operation BigQueryIO.Write/BatchLoads/MultiPartitionsWriteTables/GroupByKey/Close
Nov 02, 2018 5:50:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-02T17:50:04.322Z: Executing operation BigQueryIO.Write/BatchLoads/ReifyRenameInput/View.AsIterable/View.CreatePCollectionView/GroupByKeyHashAndSortByKeyAndWindow/Close
Nov 02, 2018 5:50:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-02T17:50:04.381Z: Executing operation BigQueryIO.Write/BatchLoads/MultiPartitionsWriteTables/GroupByKey/Read+BigQueryIO.Write/BatchLoads/MultiPartitionsWriteTables/GroupByKey/GroupByWindow+BigQueryIO.Write/BatchLoads/MultiPartitionsWriteTables/Values/Values/Map+BigQueryIO.Write/BatchLoads/MultiPartitionsWriteTables/ParDo(GarbageCollectTemporaryFiles)
Nov 02, 2018 5:50:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-02T17:50:04.428Z: Executing operation BigQueryIO.Write/BatchLoads/ReifyRenameInput/View.AsIterable/View.CreatePCollectionView/GroupByKeyHashAndSortByKeyAndWindow/Read+BigQueryIO.Write/BatchLoads/ReifyRenameInput/View.AsIterable/View.CreatePCollectionView/ToIsmRecordForMultimap
Nov 02, 2018 5:50:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-02T17:50:09.177Z: Executing operation BigQueryIO.Write/BatchLoads/ReifyRenameInput/View.AsIterable/View.CreatePCollectionView/Materialize
Nov 02, 2018 5:50:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-02T17:50:09.392Z: Executing operation BigQueryIO.Write/BatchLoads/ReifyRenameInput/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read+BigQueryIO.Write/BatchLoads/ReifyRenameInput/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow+BigQueryIO.Write/BatchLoads/ReifyRenameInput/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable+BigQueryIO.Write/BatchLoads/ReifyRenameInput/Create.Values/Read(CreateSource)/Reshuffle.ViaRandomKey/Values/Values/Map+BigQueryIO.Write/BatchLoads/ReifyRenameInput/Create.Values/Read(CreateSource)/ParDo(ReadFromBoundedSource)+BigQueryIO.Write/BatchLoads/ReifyRenameInput/ParDo(Anonymous)+BigQueryIO.Write/BatchLoads/WriteRenameUntriggered
Nov 02, 2018 5:50:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-02T17:50:13.145Z: Cleaning up.
Nov 02, 2018 5:50:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-02T17:50:13.257Z: Stopping worker pool...
Nov 02, 2018 5:54:35 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-02T17:54:34.175Z: Autoscaling: Resized worker pool from 2 to 0.
Nov 02, 2018 5:54:35 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-02T17:54:34.220Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
Nov 02, 2018 5:54:35 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-02T17:54:34.279Z: Worker pool stopped.
Nov 02, 2018 5:54:41 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-11-02_10_42_06-17492643737726418305 finished with status DONE.
Nov 02, 2018 5:54:41 PM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-11-02_10_42_06-17492643737726418305. Found 0 success, 0 failures out of 0 expected assertions.
Nov 02, 2018 5:54:41 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-11-02_10_42_06-17492643737726418305 finished with status DONE.
Nov 02, 2018 5:54:41 PM org.apache.beam.sdk.io.gcp.bigquery.BigQueryToTableIT verifyLegacyQueryRes
INFO: Starting verifyLegacyQueryRes in outputTable apache-beam-testing:bq_query_to_table_1541180515748_681.output_table
Nov 02, 2018 5:54:41 PM org.apache.beam.sdk.io.gcp.bigquery.BigQueryToTableIT verifyLegacyQueryRes
INFO: Finished to query result table apache-beam-testing:bq_query_to_table_1541180515748_681.output_table
Nov 02, 2018 5:54:41 PM org.apache.beam.sdk.io.gcp.bigquery.BigQueryToTableIT cleanBqEnvironment
INFO: Start to clean up tables and datasets.
Nov 02, 2018 5:54:42 PM org.apache.beam.sdk.io.gcp.testing.BigqueryClient deleteTable
INFO: Successfully deleted table: output_table
Nov 02, 2018 5:54:42 PM org.apache.beam.sdk.io.gcp.testing.BigqueryClient deleteDataset
INFO: Successfully deleted dataset: bq_query_to_table_1541180515748_681
Gradle Test Executor 3 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:googleCloudPlatformFnApiWorkerIntegrationTest
org.apache.beam.sdk.io.gcp.bigtable.BigtableWriteIT > testE2EBigtableWrite STANDARD_ERROR
Nov 02, 2018 6:12:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2018-11-02T18:12:37.831Z: Workflow failed. Causes: The Dataflow job appears to be stuck because no worker activity has been seen in the last 1h. You can get help with Cloud Dataflow at https://cloud.google.com/dataflow/support.
Nov 02, 2018 6:12:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-02T18:12:37.961Z: Cancel request is committed for workflow job: 2018-11-02_10_12_25-1208641077748136565.
Nov 02, 2018 6:12:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-02T18:12:38.091Z: Cleaning up.
Nov 02, 2018 6:12:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-02T18:12:38.243Z: Stopping worker pool...
Nov 02, 2018 6:12:38 PM org.apache.beam.runners.dataflow.TestDataflowRunner$ErrorMonitorMessagesHandler process
INFO: Dataflow job 2018-11-02_10_12_25-1208641077748136565 threw exception. Failure message was: Workflow failed. Causes: The Dataflow job appears to be stuck because no worker activity has been seen in the last 1h. You can get help with Cloud Dataflow at https://cloud.google.com/dataflow/support.
Nov 02, 2018 6:16:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-02T18:16:16.769Z: Autoscaling: Reduced the number of workers to 0 based on the rate of progress in the currently running step(s).
Nov 02, 2018 6:16:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-11-02T18:16:16.821Z: Worker pool stopped.
Nov 02, 2018 6:16:23 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-11-02_10_12_25-1208641077748136565 failed with status FAILED.
Nov 02, 2018 6:16:23 PM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-11-02_10_12_25-1208641077748136565. Found 0 success, 0 failures out of 0 expected assertions.
Nov 02, 2018 6:16:23 PM com.google.cloud.bigtable.grpc.io.OAuthCredentialsCache info
INFO: Refreshing the OAuth token
Gradle Test Executor 4 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:googleCloudPlatformFnApiWorkerIntegrationTest FAILED
org.apache.beam.sdk.io.gcp.bigtable.BigtableWriteIT > testE2EBigtableWrite FAILED
java.lang.RuntimeException: Workflow failed. Causes: The Dataflow job appears to be stuck because no worker activity has been seen in the last 1h. You can get help with Cloud Dataflow at https://cloud.google.com/dataflow/support.
at org.apache.beam.runners.dataflow.TestDataflowRunner.run(TestDataflowRunner.java:134)
at org.apache.beam.runners.dataflow.TestDataflowRunner.run(TestDataflowRunner.java:90)
at org.apache.beam.runners.dataflow.TestDataflowRunner.run(TestDataflowRunner.java:55)
at org.apache.beam.sdk.Pipeline.run(Pipeline.java:313)
at org.apache.beam.sdk.Pipeline.run(Pipeline.java:299)
at org.apache.beam.sdk.io.gcp.bigtable.BigtableWriteIT.testE2EBigtableWrite(BigtableWriteIT.java:130)
7 tests completed, 1 failed
Finished generating test XML results (0.028 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_PortabilityApi_GradleBuild/ws/src/runners/google-cloud-dataflow-java/build/test-results/googleCloudPlatformFnApiWorkerIntegrationTest>
Generating HTML test report...
Finished generating test html results (0.028 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_PortabilityApi_GradleBuild/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/googleCloudPlatformFnApiWorkerIntegrationTest>
:beam-runners-google-cloud-dataflow-java:googleCloudPlatformFnApiWorkerIntegrationTest (Thread[Task worker for ':' Thread 10,5,main]) completed. Took 1 hrs 4 mins 17.315 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:googleCloudPlatformFnApiWorkerIntegrationTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_PortabilityApi_GradleBuild/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/googleCloudPlatformFnApiWorkerIntegrationTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/4.10.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1h 23m 59s
90 actionable tasks: 84 executed, 5 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/2i7mfgmccoeay
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal :
beam_PostCommit_Java_PortabilityApi_GradleBuild #37
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_PortabilityApi_GradleBuild/37/display/redirect?page=changes>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org