You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2018/04/26 02:38:32 UTC
Build failed in Jenkins: beam_PostCommit_Java_GradleBuild #193
See <https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/193/display/redirect?page=changes>
Changes:
[swegner] Upgrade Gradle protobuf plugin to latest.
------------------------------------------
[...truncated 17.98 MB...]
Apr 26, 2018 2:34:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:34:35.160Z: Fusing unzipped copy of PAssert$3/CreateActual/GatherPanes/Reify.Window/ParDo(Anonymous), through flatten s18-u63, into producer PAssert$3/CreateActual/FilterActuals/Window.Assign
Apr 26, 2018 2:34:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:34:35.191Z: Fusing consumer PAssert$3/CreateActual/GatherPanes/Reify.Window/ParDo(Anonymous) into PAssert$3/CreateActual/FilterActuals/Window.Assign
Apr 26, 2018 2:34:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:34:35.214Z: Fusing consumer PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
Apr 26, 2018 2:34:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:34:35.242Z: Fusing consumer PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
Apr 26, 2018 2:34:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:34:35.275Z: Fusing consumer PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
Apr 26, 2018 2:34:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:34:35.294Z: Fusing consumer PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
Apr 26, 2018 2:34:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:34:35.358Z: Fusing consumer PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
Apr 26, 2018 2:34:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:34:35.394Z: Fusing consumer PAssert$3/CreateActual/RewindowActuals/Window.Assign into PAssert$3/CreateActual/Flatten.Iterables/FlattenIterables/FlatMap
Apr 26, 2018 2:34:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:34:35.423Z: Fusing consumer PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
Apr 26, 2018 2:34:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:34:35.458Z: Fusing consumer PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
Apr 26, 2018 2:34:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:34:35.485Z: Fusing consumer PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
Apr 26, 2018 2:34:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:34:35.522Z: Fusing consumer PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
Apr 26, 2018 2:34:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:34:35.553Z: Fusing consumer PAssert$3/CreateActual/ParDo(Anonymous) into PAssert$3/CreateActual/RewindowActuals/Window.Assign
Apr 26, 2018 2:34:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:34:35.588Z: Fusing consumer PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into PAssert$3/CreateActual/ParDo(Anonymous)
Apr 26, 2018 2:34:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:34:35.623Z: Fusing consumer Combine.globally(Count)/ProduceDefault into Combine.globally(Count)/CreateVoid/Read(CreateSource)
Apr 26, 2018 2:34:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:34:35.648Z: Fusing consumer Combine.globally(Count)/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow) into Combine.globally(Count)/Values/Values/Map
Apr 26, 2018 2:34:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:34:35.683Z: Fusing consumer Combine.globally(Count)/Combine.perKey(Count)/Combine.GroupedValues into Combine.globally(Count)/Combine.perKey(Count)/GroupByKey/Read
Apr 26, 2018 2:34:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:34:35.718Z: Fusing consumer Combine.globally(Count)/Combine.perKey(Count)/GroupByKey+Combine.globally(Count)/Combine.perKey(Count)/Combine.GroupedValues/Partial into Combine.globally(Count)/WithKeys/AddKeys/Map
Apr 26, 2018 2:34:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:34:35.755Z: Fusing consumer DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/GroupByWindow into DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/Read
Apr 26, 2018 2:34:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:34:35.815Z: Fusing consumer Combine.globally(Count)/Combine.perKey(Count)/GroupByKey/Reify into Combine.globally(Count)/Combine.perKey(Count)/GroupByKey+Combine.globally(Count)/Combine.perKey(Count)/Combine.GroupedValues/Partial
Apr 26, 2018 2:34:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:34:35.853Z: Fusing consumer Combine.globally(Count)/WithKeys/AddKeys/Map into DatastoreV1.Read/Read
Apr 26, 2018 2:34:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:34:35.880Z: Fusing consumer DatastoreV1.Read/Reshuffle/Pair with random key into DatastoreV1.Read/Split
Apr 26, 2018 2:34:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:34:35.909Z: Fusing consumer DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/Write into DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/Reify
Apr 26, 2018 2:34:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:34:35.952Z: Fusing consumer DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/Reify into DatastoreV1.Read/Reshuffle/Reshuffle/Window.Into()/Window.Assign
Apr 26, 2018 2:34:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:34:35.977Z: Fusing consumer Combine.globally(Count)/Values/Values/Map into Combine.globally(Count)/Combine.perKey(Count)/Combine.GroupedValues/Extract
Apr 26, 2018 2:34:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:34:36.020Z: Fusing consumer DatastoreV1.Read/Split into DatastoreV1.Read/ParDo(GqlQueryTranslate)
Apr 26, 2018 2:34:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:34:36.062Z: Fusing consumer DatastoreV1.Read/Reshuffle/Reshuffle/Window.Into()/Window.Assign into DatastoreV1.Read/Reshuffle/Pair with random key
Apr 26, 2018 2:34:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:34:36.086Z: Fusing consumer Combine.globally(Count)/Combine.perKey(Count)/GroupByKey/Write into Combine.globally(Count)/Combine.perKey(Count)/GroupByKey/Reify
Apr 26, 2018 2:34:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:34:36.113Z: Fusing consumer DatastoreV1.Read/ParDo(GqlQueryTranslate) into DatastoreV1.Read/Create.OfValueProvider/Create.Values/Read(CreateSource)
Apr 26, 2018 2:34:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:34:36.147Z: Fusing consumer DatastoreV1.Read/Read into DatastoreV1.Read/Reshuffle/Values/Values/Map
Apr 26, 2018 2:34:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:34:36.170Z: Fusing consumer DatastoreV1.Read/Reshuffle/Values/Values/Map into DatastoreV1.Read/Reshuffle/Reshuffle/ExpandIterable
Apr 26, 2018 2:34:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:34:36.199Z: Fusing consumer DatastoreV1.Read/Reshuffle/Reshuffle/ExpandIterable into DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/GroupByWindow
Apr 26, 2018 2:34:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:34:36.233Z: Fusing consumer Combine.globally(Count)/Combine.perKey(Count)/Combine.GroupedValues/Extract into Combine.globally(Count)/Combine.perKey(Count)/Combine.GroupedValues
Apr 26, 2018 2:34:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:34:36.283Z: Fusing consumer PAssert$3/RunChecks into PAssert$3/WindowToken/Window.Assign
Apr 26, 2018 2:34:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:34:36.317Z: Fusing consumer PAssert$3/WindowToken/Window.Assign into PAssert$3/Create.Values/Read(CreateSource)
Apr 26, 2018 2:34:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:34:36.357Z: Fusing consumer PAssert$3/VerifyAssertions/ParDo(DefaultConclude) into PAssert$3/RunChecks
Apr 26, 2018 2:34:39 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:34:36.783Z: Executing operation Combine.globally(Count)/Combine.perKey(Count)/GroupByKey/Create
Apr 26, 2018 2:34:39 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:34:36.820Z: Executing operation PAssert$3/CreateActual/GatherPanes/GroupByKey/Create
Apr 26, 2018 2:34:39 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:34:36.866Z: Starting 1 workers in us-central1-f...
Apr 26, 2018 2:34:39 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:34:36.866Z: Executing operation PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
Apr 26, 2018 2:34:39 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:34:36.902Z: Executing operation PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
Apr 26, 2018 2:34:39 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:34:36.939Z: Executing operation DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/Create
Apr 26, 2018 2:34:45 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:34:44.102Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
Apr 26, 2018 2:34:45 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:34:44.503Z: Executing operation DatastoreV1.Read/Create.OfValueProvider/Create.Values/Read(CreateSource)+DatastoreV1.Read/ParDo(GqlQueryTranslate)+DatastoreV1.Read/Split+DatastoreV1.Read/Reshuffle/Pair with random key+DatastoreV1.Read/Reshuffle/Reshuffle/Window.Into()/Window.Assign+DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/Reify+DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/Write
Apr 26, 2018 2:34:50 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:34:49.776Z: Autoscaling: Resizing worker pool from 1 to 5.
Apr 26, 2018 2:34:56 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:34:56.118Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
Apr 26, 2018 2:34:56 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:34:56.156Z: Resized worker pool to 1, though goal was 5. This could be a quota issue.
Apr 26, 2018 2:35:11 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:35:10.899Z: Workers have started successfully.
Apr 26, 2018 2:35:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:35:11.806Z: Autoscaling: Raised the number of workers to 4 based on the rate of progress in the currently running step(s).
Apr 26, 2018 2:35:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:35:11.843Z: Resized worker pool to 4, though goal was 5. This could be a quota issue.
Apr 26, 2018 2:35:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:35:27.462Z: Autoscaling: Raised the number of workers to 5 based on the rate of progress in the currently running step(s).
Apr 26, 2018 2:35:41 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:35:41.365Z: Executing operation DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/Close
Apr 26, 2018 2:35:41 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:35:41.449Z: Executing operation DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/Read+DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/GroupByWindow+DatastoreV1.Read/Reshuffle/Reshuffle/ExpandIterable+DatastoreV1.Read/Reshuffle/Values/Values/Map+DatastoreV1.Read/Read+Combine.globally(Count)/WithKeys/AddKeys/Map+Combine.globally(Count)/Combine.perKey(Count)/GroupByKey+Combine.globally(Count)/Combine.perKey(Count)/Combine.GroupedValues/Partial+Combine.globally(Count)/Combine.perKey(Count)/GroupByKey/Reify+Combine.globally(Count)/Combine.perKey(Count)/GroupByKey/Write
Apr 26, 2018 2:35:55 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:35:54.310Z: Executing operation Combine.globally(Count)/Combine.perKey(Count)/GroupByKey/Close
Apr 26, 2018 2:35:55 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:35:54.400Z: Executing operation Combine.globally(Count)/Combine.perKey(Count)/GroupByKey/Read+Combine.globally(Count)/Combine.perKey(Count)/Combine.GroupedValues+Combine.globally(Count)/Combine.perKey(Count)/Combine.GroupedValues/Extract+Combine.globally(Count)/Values/Values/Map+PAssert$3/CreateActual/FilterActuals/Window.Assign+PAssert$3/CreateActual/GatherPanes/Reify.Window/ParDo(Anonymous)+PAssert$3/CreateActual/GatherPanes/WithKeys/AddKeys/Map+PAssert$3/CreateActual/GatherPanes/Window.Into()/Window.Assign+PAssert$3/CreateActual/GatherPanes/GroupByKey/Reify+PAssert$3/CreateActual/GatherPanes/GroupByKey/Write+Combine.globally(Count)/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow)
Apr 26, 2018 2:36:05 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:36:04.519Z: Executing operation Combine.globally(Count)/View.AsIterable/CreateDataflowView
Apr 26, 2018 2:36:05 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:36:04.701Z: Executing operation Combine.globally(Count)/CreateVoid/Read(CreateSource)+Combine.globally(Count)/ProduceDefault+PAssert$3/CreateActual/FilterActuals/Window.Assign+PAssert$3/CreateActual/GatherPanes/Reify.Window/ParDo(Anonymous)+PAssert$3/CreateActual/GatherPanes/WithKeys/AddKeys/Map+PAssert$3/CreateActual/GatherPanes/Window.Into()/Window.Assign+PAssert$3/CreateActual/GatherPanes/GroupByKey/Reify+PAssert$3/CreateActual/GatherPanes/GroupByKey/Write
Apr 26, 2018 2:36:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:36:06.623Z: Executing operation PAssert$3/CreateActual/GatherPanes/GroupByKey/Close
Apr 26, 2018 2:36:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:36:06.750Z: Executing operation PAssert$3/CreateActual/GatherPanes/GroupByKey/Read+PAssert$3/CreateActual/GatherPanes/GroupByKey/GroupByWindow+PAssert$3/CreateActual/GatherPanes/Values/Values/Map+PAssert$3/CreateActual/ExtractPane/Map+PAssert$3/CreateActual/Flatten.Iterables/FlattenIterables/FlatMap+PAssert$3/CreateActual/RewindowActuals/Window.Assign+PAssert$3/CreateActual/ParDo(Anonymous)+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
Apr 26, 2018 2:36:12 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:36:12.684Z: Executing operation PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
Apr 26, 2018 2:36:12 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:36:12.853Z: Executing operation PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
Apr 26, 2018 2:36:15 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:36:13.375Z: Executing operation PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
Apr 26, 2018 2:36:15 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:36:13.491Z: Executing operation PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
Apr 26, 2018 2:36:18 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:36:18.300Z: Executing operation PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
Apr 26, 2018 2:36:18 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:36:18.542Z: Executing operation PAssert$3/Create.Values/Read(CreateSource)+PAssert$3/WindowToken/Window.Assign+PAssert$3/RunChecks+PAssert$3/VerifyAssertions/ParDo(DefaultConclude)
Apr 26, 2018 2:36:24 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:36:22.590Z: Cleaning up.
Apr 26, 2018 2:36:24 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:36:22.854Z: Stopping worker pool...
Apr 26, 2018 2:38:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:38:06.793Z: Autoscaling: Resized worker pool from 5 to 0.
Apr 26, 2018 2:38:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:38:06.826Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
Apr 26, 2018 2:38:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:38:06.880Z: Worker pool stopped.
Apr 26, 2018 2:38:15 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-04-25_19_34_26-6209329338364366862 finished with status DONE.
Apr 26, 2018 2:38:15 AM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-04-25_19_34_26-6209329338364366862. Found 1 success, 0 failures out of 1 expected assertions.
Apr 26, 2018 2:38:15 AM org.apache.beam.sdk.io.gcp.datastore.V1TestUtil$V1TestWriter flushBatch
INFO: Writing batch of 500 entities
Apr 26, 2018 2:38:16 AM org.apache.beam.sdk.io.gcp.datastore.V1TestUtil$V1TestWriter flushBatch
INFO: Successfully wrote 500 entities
Apr 26, 2018 2:38:16 AM org.apache.beam.sdk.io.gcp.datastore.V1TestUtil$V1TestWriter flushBatch
INFO: Writing batch of 500 entities
Apr 26, 2018 2:38:16 AM org.apache.beam.sdk.io.gcp.datastore.V1TestUtil$V1TestWriter flushBatch
INFO: Successfully wrote 500 entities
Apr 26, 2018 2:38:16 AM org.apache.beam.sdk.io.gcp.datastore.V1TestUtil deleteAllEntities
INFO: Successfully deleted 1000 entities
org.apache.beam.sdk.io.gcp.datastore.SplitQueryFnIT > testSplitQueryFnWithLargeDataset STANDARD_ERROR
Apr 26, 2018 2:38:16 AM org.apache.beam.sdk.transforms.DoFnTester of
WARNING: Your tests use DoFnTester, which may not exercise DoFns correctly. Please use TestPipeline instead.
Apr 26, 2018 2:38:17 AM org.apache.beam.sdk.io.gcp.datastore.DatastoreV1$Read getEstimatedSizeBytes
INFO: Latest stats timestamp for kind sort_1G is 1524555829000000
Apr 26, 2018 2:38:17 AM org.apache.beam.sdk.io.gcp.datastore.DatastoreV1$Read getEstimatedNumSplits
INFO: Estimated size bytes for the query is: 2130000000
Apr 26, 2018 2:38:17 AM org.apache.beam.sdk.io.gcp.datastore.DatastoreV1$Read$SplitQueryFn processElement
INFO: Splitting the query into 32 splits
org.apache.beam.sdk.io.gcp.datastore.SplitQueryFnIT > testSplitQueryFnWithSmallDataset STANDARD_ERROR
Apr 26, 2018 2:38:17 AM org.apache.beam.sdk.transforms.DoFnTester of
WARNING: Your tests use DoFnTester, which may not exercise DoFns correctly. Please use TestPipeline instead.
Apr 26, 2018 2:38:17 AM org.apache.beam.sdk.io.gcp.datastore.DatastoreV1$Read getEstimatedSizeBytes
INFO: Latest stats timestamp for kind shakespeare is 1524555829000000
Apr 26, 2018 2:38:17 AM org.apache.beam.sdk.io.gcp.datastore.DatastoreV1$Read getEstimatedNumSplits
INFO: Estimated size bytes for the query is: 26383451
Apr 26, 2018 2:38:17 AM org.apache.beam.sdk.io.gcp.datastore.DatastoreV1$Read$SplitQueryFn processElement
INFO: Splitting the query into 12 splits
Gradle Test Executor 130 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:googleCloudPlatformIntegrationTest FAILED
org.apache.beam.sdk.io.gcp.spanner.SpannerWriteIT > testWrite FAILED
java.lang.NoClassDefFoundError: com/google/api/gax/retrying/ExceptionRetryAlgorithm
at java.lang.ClassLoader.defineClass1(Native Method)
at java.lang.ClassLoader.defineClass(ClassLoader.java:763)
at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)
at java.net.URLClassLoader.defineClass(URLClassLoader.java:467)
at java.net.URLClassLoader.access$100(URLClassLoader.java:73)
at java.net.URLClassLoader$1.run(URLClassLoader.java:368)
at java.net.URLClassLoader$1.run(URLClassLoader.java:362)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:361)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:338)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
at com.google.cloud.BaseService.<clinit>(BaseService.java:48)
at com.google.cloud.spanner.SpannerOptions$DefaultSpannerFactory.create(SpannerOptions.java:60)
at com.google.cloud.spanner.SpannerOptions$DefaultSpannerFactory.create(SpannerOptions.java:55)
at com.google.cloud.ServiceOptions.getService(ServiceOptions.java:426)
at org.apache.beam.sdk.io.gcp.spanner.SpannerWriteIT.setUp(SpannerWriteIT.java:91)
Caused by:
java.lang.ClassNotFoundException: com.google.api.gax.retrying.ExceptionRetryAlgorithm
at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:338)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
... 17 more
java.lang.NullPointerException
at org.apache.beam.sdk.io.gcp.spanner.SpannerWriteIT.tearDown(SpannerWriteIT.java:148)
12 tests completed, 3 failed
Finished generating test XML results (0.006 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/ws/src/runners/google-cloud-dataflow-java/build/test-results/googleCloudPlatformIntegrationTest>
Generating HTML test report...
Finished generating test html results (0.008 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/googleCloudPlatformIntegrationTest>
:beam-runners-google-cloud-dataflow-java:googleCloudPlatformIntegrationTest (Thread[main,5,main]) completed. Took 16 mins 2.383 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:googleCloudPlatformIntegrationTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/googleCloudPlatformIntegrationTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 50m 48s
546 actionable tasks: 546 executed
Publishing build scan...
https://gradle.com/s/kwds4gp7p3tg6
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user sidhom@google.com
Not sending mail to unregistered user swegner@google.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user kedin@google.com
Not sending mail to unregistered user kirpichov@google.com
Not sending mail to unregistered user relax@relax-macbookpro2.roam.corp.google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Build failed in Jenkins: beam_PostCommit_Java_GradleBuild #198
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/198/display/redirect?page=changes>
Changes:
[tgroh] For the DirectRunner implementation into a "Portable" package
[tgroh] Clean up Portable Direct Runner package
------------------------------------------
[...truncated 18.02 MB...]
Apr 26, 2018 5:02:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T17:02:05.427Z: Unzipping flatten s18-u63 for input s19.output-c61
Apr 26, 2018 5:02:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T17:02:05.466Z: Fusing unzipped copy of PAssert$3/CreateActual/GatherPanes/Reify.Window/ParDo(Anonymous), through flatten s18-u63, into producer PAssert$3/CreateActual/FilterActuals/Window.Assign
Apr 26, 2018 5:02:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T17:02:05.490Z: Fusing consumer PAssert$3/CreateActual/GatherPanes/Reify.Window/ParDo(Anonymous) into PAssert$3/CreateActual/FilterActuals/Window.Assign
Apr 26, 2018 5:02:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T17:02:05.523Z: Fusing consumer PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
Apr 26, 2018 5:02:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T17:02:05.551Z: Fusing consumer PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
Apr 26, 2018 5:02:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T17:02:05.576Z: Fusing consumer PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
Apr 26, 2018 5:02:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T17:02:05.598Z: Fusing consumer PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
Apr 26, 2018 5:02:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T17:02:05.623Z: Fusing consumer PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
Apr 26, 2018 5:02:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T17:02:05.656Z: Fusing consumer PAssert$3/CreateActual/RewindowActuals/Window.Assign into PAssert$3/CreateActual/Flatten.Iterables/FlattenIterables/FlatMap
Apr 26, 2018 5:02:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T17:02:05.680Z: Fusing consumer PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
Apr 26, 2018 5:02:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T17:02:05.702Z: Fusing consumer PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
Apr 26, 2018 5:02:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T17:02:05.734Z: Fusing consumer PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
Apr 26, 2018 5:02:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T17:02:05.758Z: Fusing consumer PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
Apr 26, 2018 5:02:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T17:02:05.789Z: Fusing consumer PAssert$3/CreateActual/ParDo(Anonymous) into PAssert$3/CreateActual/RewindowActuals/Window.Assign
Apr 26, 2018 5:02:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T17:02:05.818Z: Fusing consumer PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into PAssert$3/CreateActual/ParDo(Anonymous)
Apr 26, 2018 5:02:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T17:02:05.832Z: Fusing consumer Combine.globally(Count)/ProduceDefault into Combine.globally(Count)/CreateVoid/Read(CreateSource)
Apr 26, 2018 5:02:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T17:02:05.859Z: Fusing consumer Combine.globally(Count)/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow) into Combine.globally(Count)/Values/Values/Map
Apr 26, 2018 5:02:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T17:02:05.880Z: Fusing consumer Combine.globally(Count)/Combine.perKey(Count)/Combine.GroupedValues into Combine.globally(Count)/Combine.perKey(Count)/GroupByKey/Read
Apr 26, 2018 5:02:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T17:02:05.893Z: Fusing consumer Combine.globally(Count)/Combine.perKey(Count)/GroupByKey+Combine.globally(Count)/Combine.perKey(Count)/Combine.GroupedValues/Partial into Combine.globally(Count)/WithKeys/AddKeys/Map
Apr 26, 2018 5:02:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T17:02:05.927Z: Fusing consumer DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/GroupByWindow into DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/Read
Apr 26, 2018 5:02:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T17:02:05.961Z: Fusing consumer Combine.globally(Count)/Combine.perKey(Count)/GroupByKey/Reify into Combine.globally(Count)/Combine.perKey(Count)/GroupByKey+Combine.globally(Count)/Combine.perKey(Count)/Combine.GroupedValues/Partial
Apr 26, 2018 5:02:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T17:02:05.993Z: Fusing consumer Combine.globally(Count)/WithKeys/AddKeys/Map into DatastoreV1.Read/Read
Apr 26, 2018 5:02:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T17:02:06.008Z: Fusing consumer DatastoreV1.Read/Reshuffle/Pair with random key into DatastoreV1.Read/Split
Apr 26, 2018 5:02:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T17:02:06.038Z: Fusing consumer DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/Write into DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/Reify
Apr 26, 2018 5:02:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T17:02:06.068Z: Fusing consumer DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/Reify into DatastoreV1.Read/Reshuffle/Reshuffle/Window.Into()/Window.Assign
Apr 26, 2018 5:02:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T17:02:06.099Z: Fusing consumer Combine.globally(Count)/Values/Values/Map into Combine.globally(Count)/Combine.perKey(Count)/Combine.GroupedValues/Extract
Apr 26, 2018 5:02:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T17:02:06.113Z: Fusing consumer DatastoreV1.Read/Split into DatastoreV1.Read/ParDo(GqlQueryTranslate)
Apr 26, 2018 5:02:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T17:02:06.145Z: Fusing consumer DatastoreV1.Read/Reshuffle/Reshuffle/Window.Into()/Window.Assign into DatastoreV1.Read/Reshuffle/Pair with random key
Apr 26, 2018 5:02:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T17:02:06.167Z: Fusing consumer Combine.globally(Count)/Combine.perKey(Count)/GroupByKey/Write into Combine.globally(Count)/Combine.perKey(Count)/GroupByKey/Reify
Apr 26, 2018 5:02:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T17:02:06.199Z: Fusing consumer DatastoreV1.Read/ParDo(GqlQueryTranslate) into DatastoreV1.Read/Create.OfValueProvider/Create.Values/Read(CreateSource)
Apr 26, 2018 5:02:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T17:02:06.231Z: Fusing consumer DatastoreV1.Read/Read into DatastoreV1.Read/Reshuffle/Values/Values/Map
Apr 26, 2018 5:02:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T17:02:06.264Z: Fusing consumer DatastoreV1.Read/Reshuffle/Values/Values/Map into DatastoreV1.Read/Reshuffle/Reshuffle/ExpandIterable
Apr 26, 2018 5:02:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T17:02:06.292Z: Fusing consumer DatastoreV1.Read/Reshuffle/Reshuffle/ExpandIterable into DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/GroupByWindow
Apr 26, 2018 5:02:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T17:02:06.320Z: Fusing consumer Combine.globally(Count)/Combine.perKey(Count)/Combine.GroupedValues/Extract into Combine.globally(Count)/Combine.perKey(Count)/Combine.GroupedValues
Apr 26, 2018 5:02:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T17:02:06.346Z: Fusing consumer PAssert$3/RunChecks into PAssert$3/WindowToken/Window.Assign
Apr 26, 2018 5:02:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T17:02:06.370Z: Fusing consumer PAssert$3/WindowToken/Window.Assign into PAssert$3/Create.Values/Read(CreateSource)
Apr 26, 2018 5:02:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T17:02:06.404Z: Fusing consumer PAssert$3/VerifyAssertions/ParDo(DefaultConclude) into PAssert$3/RunChecks
Apr 26, 2018 5:02:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T17:02:06.736Z: Executing operation Combine.globally(Count)/Combine.perKey(Count)/GroupByKey/Create
Apr 26, 2018 5:02:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T17:02:06.771Z: Executing operation PAssert$3/CreateActual/GatherPanes/GroupByKey/Create
Apr 26, 2018 5:02:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T17:02:06.802Z: Starting 1 workers in us-central1-f...
Apr 26, 2018 5:02:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T17:02:06.802Z: Executing operation PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
Apr 26, 2018 5:02:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T17:02:06.833Z: Executing operation PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
Apr 26, 2018 5:02:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T17:02:06.859Z: Executing operation DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/Create
Apr 26, 2018 5:02:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T17:02:13.946Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
Apr 26, 2018 5:02:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T17:02:14.333Z: Executing operation DatastoreV1.Read/Create.OfValueProvider/Create.Values/Read(CreateSource)+DatastoreV1.Read/ParDo(GqlQueryTranslate)+DatastoreV1.Read/Split+DatastoreV1.Read/Reshuffle/Pair with random key+DatastoreV1.Read/Reshuffle/Reshuffle/Window.Into()/Window.Assign+DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/Reify+DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/Write
Apr 26, 2018 5:02:21 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T17:02:19.614Z: Autoscaling: Resizing worker pool from 1 to 5.
Apr 26, 2018 5:02:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T17:02:25.817Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
Apr 26, 2018 5:02:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T17:02:25.850Z: Resized worker pool to 1, though goal was 5. This could be a quota issue.
Apr 26, 2018 5:02:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T17:02:36.313Z: Autoscaling: Raised the number of workers to 4 based on the rate of progress in the currently running step(s).
Apr 26, 2018 5:02:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T17:02:36.341Z: Resized worker pool to 4, though goal was 5. This could be a quota issue.
Apr 26, 2018 5:02:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T17:02:41.586Z: Autoscaling: Raised the number of workers to 5 based on the rate of progress in the currently running step(s).
Apr 26, 2018 5:02:54 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T17:02:54.038Z: Workers have started successfully.
Apr 26, 2018 5:03:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T17:03:16.029Z: Executing operation DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/Close
Apr 26, 2018 5:03:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T17:03:16.082Z: Executing operation DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/Read+DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/GroupByWindow+DatastoreV1.Read/Reshuffle/Reshuffle/ExpandIterable+DatastoreV1.Read/Reshuffle/Values/Values/Map+DatastoreV1.Read/Read+Combine.globally(Count)/WithKeys/AddKeys/Map+Combine.globally(Count)/Combine.perKey(Count)/GroupByKey+Combine.globally(Count)/Combine.perKey(Count)/Combine.GroupedValues/Partial+Combine.globally(Count)/Combine.perKey(Count)/GroupByKey/Reify+Combine.globally(Count)/Combine.perKey(Count)/GroupByKey/Write
Apr 26, 2018 5:03:24 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T17:03:22.211Z: Executing operation Combine.globally(Count)/Combine.perKey(Count)/GroupByKey/Close
Apr 26, 2018 5:03:24 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T17:03:22.276Z: Executing operation Combine.globally(Count)/Combine.perKey(Count)/GroupByKey/Read+Combine.globally(Count)/Combine.perKey(Count)/Combine.GroupedValues+Combine.globally(Count)/Combine.perKey(Count)/Combine.GroupedValues/Extract+Combine.globally(Count)/Values/Values/Map+PAssert$3/CreateActual/FilterActuals/Window.Assign+PAssert$3/CreateActual/GatherPanes/Reify.Window/ParDo(Anonymous)+PAssert$3/CreateActual/GatherPanes/WithKeys/AddKeys/Map+PAssert$3/CreateActual/GatherPanes/Window.Into()/Window.Assign+PAssert$3/CreateActual/GatherPanes/GroupByKey/Reify+PAssert$3/CreateActual/GatherPanes/GroupByKey/Write+Combine.globally(Count)/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow)
Apr 26, 2018 5:03:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T17:03:33.170Z: Executing operation Combine.globally(Count)/View.AsIterable/CreateDataflowView
Apr 26, 2018 5:03:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T17:03:33.321Z: Executing operation Combine.globally(Count)/CreateVoid/Read(CreateSource)+Combine.globally(Count)/ProduceDefault+PAssert$3/CreateActual/FilterActuals/Window.Assign+PAssert$3/CreateActual/GatherPanes/Reify.Window/ParDo(Anonymous)+PAssert$3/CreateActual/GatherPanes/WithKeys/AddKeys/Map+PAssert$3/CreateActual/GatherPanes/Window.Into()/Window.Assign+PAssert$3/CreateActual/GatherPanes/GroupByKey/Reify+PAssert$3/CreateActual/GatherPanes/GroupByKey/Write
Apr 26, 2018 5:03:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T17:03:36.580Z: Executing operation PAssert$3/CreateActual/GatherPanes/GroupByKey/Close
Apr 26, 2018 5:03:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T17:03:36.643Z: Executing operation PAssert$3/CreateActual/GatherPanes/GroupByKey/Read+PAssert$3/CreateActual/GatherPanes/GroupByKey/GroupByWindow+PAssert$3/CreateActual/GatherPanes/Values/Values/Map+PAssert$3/CreateActual/ExtractPane/Map+PAssert$3/CreateActual/Flatten.Iterables/FlattenIterables/FlatMap+PAssert$3/CreateActual/RewindowActuals/Window.Assign+PAssert$3/CreateActual/ParDo(Anonymous)+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
Apr 26, 2018 5:03:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T17:03:38.539Z: Executing operation PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
Apr 26, 2018 5:03:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T17:03:38.598Z: Executing operation PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
Apr 26, 2018 5:03:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T17:03:39.980Z: Executing operation PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
Apr 26, 2018 5:03:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T17:03:40.035Z: Executing operation PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
Apr 26, 2018 5:03:43 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T17:03:43.067Z: Executing operation PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
Apr 26, 2018 5:03:43 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T17:03:43.223Z: Executing operation PAssert$3/Create.Values/Read(CreateSource)+PAssert$3/WindowToken/Window.Assign+PAssert$3/RunChecks+PAssert$3/VerifyAssertions/ParDo(DefaultConclude)
Apr 26, 2018 5:03:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T17:03:43.938Z: Cleaning up.
Apr 26, 2018 5:03:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T17:03:44.181Z: Stopping worker pool...
Apr 26, 2018 5:05:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T17:05:10.444Z: Autoscaling: Resized worker pool from 5 to 0.
Apr 26, 2018 5:05:11 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T17:05:10.569Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
Apr 26, 2018 5:05:20 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-04-26_10_01_57-8090162413961538233 finished with status DONE.
Apr 26, 2018 5:05:20 PM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-04-26_10_01_57-8090162413961538233. Found 1 success, 0 failures out of 1 expected assertions.
Apr 26, 2018 5:05:21 PM org.apache.beam.sdk.io.gcp.datastore.V1TestUtil$V1TestWriter flushBatch
INFO: Writing batch of 500 entities
Apr 26, 2018 5:05:21 PM org.apache.beam.sdk.io.gcp.datastore.V1TestUtil$V1TestWriter flushBatch
INFO: Successfully wrote 500 entities
Apr 26, 2018 5:05:22 PM org.apache.beam.sdk.io.gcp.datastore.V1TestUtil$V1TestWriter flushBatch
INFO: Writing batch of 500 entities
Apr 26, 2018 5:05:22 PM org.apache.beam.sdk.io.gcp.datastore.V1TestUtil$V1TestWriter flushBatch
INFO: Successfully wrote 500 entities
Apr 26, 2018 5:05:22 PM org.apache.beam.sdk.io.gcp.datastore.V1TestUtil deleteAllEntities
INFO: Successfully deleted 1000 entities
org.apache.beam.sdk.io.gcp.datastore.SplitQueryFnIT > testSplitQueryFnWithLargeDataset STANDARD_ERROR
Apr 26, 2018 5:05:22 PM org.apache.beam.sdk.transforms.DoFnTester of
WARNING: Your tests use DoFnTester, which may not exercise DoFns correctly. Please use TestPipeline instead.
Apr 26, 2018 5:05:22 PM org.apache.beam.sdk.io.gcp.datastore.DatastoreV1$Read getEstimatedSizeBytes
INFO: Latest stats timestamp for kind sort_1G is 1524555829000000
Apr 26, 2018 5:05:22 PM org.apache.beam.sdk.io.gcp.datastore.DatastoreV1$Read getEstimatedNumSplits
INFO: Estimated size bytes for the query is: 2130000000
Apr 26, 2018 5:05:22 PM org.apache.beam.sdk.io.gcp.datastore.DatastoreV1$Read$SplitQueryFn processElement
INFO: Splitting the query into 32 splits
org.apache.beam.sdk.io.gcp.datastore.SplitQueryFnIT > testSplitQueryFnWithSmallDataset STANDARD_ERROR
Apr 26, 2018 5:05:23 PM org.apache.beam.sdk.transforms.DoFnTester of
WARNING: Your tests use DoFnTester, which may not exercise DoFns correctly. Please use TestPipeline instead.
Apr 26, 2018 5:05:23 PM org.apache.beam.sdk.io.gcp.datastore.DatastoreV1$Read getEstimatedSizeBytes
INFO: Latest stats timestamp for kind shakespeare is 1524555829000000
Apr 26, 2018 5:05:23 PM org.apache.beam.sdk.io.gcp.datastore.DatastoreV1$Read getEstimatedNumSplits
INFO: Estimated size bytes for the query is: 26383451
Apr 26, 2018 5:05:23 PM org.apache.beam.sdk.io.gcp.datastore.DatastoreV1$Read$SplitQueryFn processElement
INFO: Splitting the query into 12 splits
Gradle Test Executor 130 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:googleCloudPlatformIntegrationTest FAILED
org.apache.beam.sdk.io.gcp.spanner.SpannerWriteIT > testWrite FAILED
java.lang.NoClassDefFoundError: com/google/api/gax/retrying/ExceptionRetryAlgorithm
at java.lang.ClassLoader.defineClass1(Native Method)
at java.lang.ClassLoader.defineClass(ClassLoader.java:763)
at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)
at java.net.URLClassLoader.defineClass(URLClassLoader.java:467)
at java.net.URLClassLoader.access$100(URLClassLoader.java:73)
at java.net.URLClassLoader$1.run(URLClassLoader.java:368)
at java.net.URLClassLoader$1.run(URLClassLoader.java:362)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:361)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:338)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
at com.google.cloud.BaseService.<clinit>(BaseService.java:48)
at com.google.cloud.spanner.SpannerOptions$DefaultSpannerFactory.create(SpannerOptions.java:60)
at com.google.cloud.spanner.SpannerOptions$DefaultSpannerFactory.create(SpannerOptions.java:55)
at com.google.cloud.ServiceOptions.getService(ServiceOptions.java:426)
at org.apache.beam.sdk.io.gcp.spanner.SpannerWriteIT.setUp(SpannerWriteIT.java:91)
Caused by:
java.lang.ClassNotFoundException: com.google.api.gax.retrying.ExceptionRetryAlgorithm
at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:338)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
... 17 more
java.lang.NullPointerException
at org.apache.beam.sdk.io.gcp.spanner.SpannerWriteIT.tearDown(SpannerWriteIT.java:148)
12 tests completed, 3 failed
Finished generating test XML results (0.007 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/ws/src/runners/google-cloud-dataflow-java/build/test-results/googleCloudPlatformIntegrationTest>
Generating HTML test report...
Finished generating test html results (0.009 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/googleCloudPlatformIntegrationTest>
:beam-runners-google-cloud-dataflow-java:googleCloudPlatformIntegrationTest (Thread[Task worker for ':',5,main]) completed. Took 15 mins 38.13 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:googleCloudPlatformIntegrationTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/googleCloudPlatformIntegrationTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 49m 58s
546 actionable tasks: 543 executed, 3 from cache
Publishing build scan...
https://gradle.com/s/ahrlsgzzqacca
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user kirpichov@google.com
Not sending mail to unregistered user kedin@google.com
Not sending mail to unregistered user sidhom@google.com
Not sending mail to unregistered user swegner@google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user relax@relax-macbookpro2.roam.corp.google.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user wcn@google.com
Build failed in Jenkins: beam_PostCommit_Java_GradleBuild #197
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/197/display/redirect>
------------------------------------------
[...truncated 18.10 MB...]
Apr 26, 2018 12:46:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:46:24.961Z: Unzipping flatten s18-u63 for input s19.output-c61
Apr 26, 2018 12:46:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:46:24.983Z: Fusing unzipped copy of PAssert$3/CreateActual/GatherPanes/Reify.Window/ParDo(Anonymous), through flatten s18-u63, into producer PAssert$3/CreateActual/FilterActuals/Window.Assign
Apr 26, 2018 12:46:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:46:25.012Z: Fusing consumer PAssert$3/CreateActual/GatherPanes/Reify.Window/ParDo(Anonymous) into PAssert$3/CreateActual/FilterActuals/Window.Assign
Apr 26, 2018 12:46:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:46:25.039Z: Fusing consumer PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
Apr 26, 2018 12:46:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:46:25.060Z: Fusing consumer PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
Apr 26, 2018 12:46:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:46:25.084Z: Fusing consumer PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
Apr 26, 2018 12:46:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:46:25.106Z: Fusing consumer PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
Apr 26, 2018 12:46:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:46:25.128Z: Fusing consumer PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
Apr 26, 2018 12:46:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:46:25.153Z: Fusing consumer PAssert$3/CreateActual/RewindowActuals/Window.Assign into PAssert$3/CreateActual/Flatten.Iterables/FlattenIterables/FlatMap
Apr 26, 2018 12:46:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:46:25.175Z: Fusing consumer PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
Apr 26, 2018 12:46:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:46:25.186Z: Fusing consumer PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
Apr 26, 2018 12:46:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:46:25.197Z: Fusing consumer PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
Apr 26, 2018 12:46:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:46:25.218Z: Fusing consumer PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
Apr 26, 2018 12:46:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:46:25.240Z: Fusing consumer PAssert$3/CreateActual/ParDo(Anonymous) into PAssert$3/CreateActual/RewindowActuals/Window.Assign
Apr 26, 2018 12:46:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:46:25.261Z: Fusing consumer PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into PAssert$3/CreateActual/ParDo(Anonymous)
Apr 26, 2018 12:46:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:46:25.283Z: Fusing consumer Combine.globally(Count)/ProduceDefault into Combine.globally(Count)/CreateVoid/Read(CreateSource)
Apr 26, 2018 12:46:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:46:25.313Z: Fusing consumer Combine.globally(Count)/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow) into Combine.globally(Count)/Values/Values/Map
Apr 26, 2018 12:46:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:46:25.342Z: Fusing consumer Combine.globally(Count)/Combine.perKey(Count)/Combine.GroupedValues into Combine.globally(Count)/Combine.perKey(Count)/GroupByKey/Read
Apr 26, 2018 12:46:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:46:25.363Z: Fusing consumer Combine.globally(Count)/Combine.perKey(Count)/GroupByKey+Combine.globally(Count)/Combine.perKey(Count)/Combine.GroupedValues/Partial into Combine.globally(Count)/WithKeys/AddKeys/Map
Apr 26, 2018 12:46:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:46:25.387Z: Fusing consumer DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/GroupByWindow into DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/Read
Apr 26, 2018 12:46:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:46:25.416Z: Fusing consumer Combine.globally(Count)/Combine.perKey(Count)/GroupByKey/Reify into Combine.globally(Count)/Combine.perKey(Count)/GroupByKey+Combine.globally(Count)/Combine.perKey(Count)/Combine.GroupedValues/Partial
Apr 26, 2018 12:46:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:46:25.440Z: Fusing consumer Combine.globally(Count)/WithKeys/AddKeys/Map into DatastoreV1.Read/Read
Apr 26, 2018 12:46:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:46:25.463Z: Fusing consumer DatastoreV1.Read/Reshuffle/Pair with random key into DatastoreV1.Read/Split
Apr 26, 2018 12:46:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:46:25.488Z: Fusing consumer DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/Write into DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/Reify
Apr 26, 2018 12:46:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:46:25.522Z: Fusing consumer DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/Reify into DatastoreV1.Read/Reshuffle/Reshuffle/Window.Into()/Window.Assign
Apr 26, 2018 12:46:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:46:25.533Z: Fusing consumer Combine.globally(Count)/Values/Values/Map into Combine.globally(Count)/Combine.perKey(Count)/Combine.GroupedValues/Extract
Apr 26, 2018 12:46:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:46:25.554Z: Fusing consumer DatastoreV1.Read/Split into DatastoreV1.Read/ParDo(GqlQueryTranslate)
Apr 26, 2018 12:46:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:46:25.576Z: Fusing consumer DatastoreV1.Read/Reshuffle/Reshuffle/Window.Into()/Window.Assign into DatastoreV1.Read/Reshuffle/Pair with random key
Apr 26, 2018 12:46:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:46:25.587Z: Fusing consumer Combine.globally(Count)/Combine.perKey(Count)/GroupByKey/Write into Combine.globally(Count)/Combine.perKey(Count)/GroupByKey/Reify
Apr 26, 2018 12:46:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:46:25.607Z: Fusing consumer DatastoreV1.Read/ParDo(GqlQueryTranslate) into DatastoreV1.Read/Create.OfValueProvider/Create.Values/Read(CreateSource)
Apr 26, 2018 12:46:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:46:25.630Z: Fusing consumer DatastoreV1.Read/Read into DatastoreV1.Read/Reshuffle/Values/Values/Map
Apr 26, 2018 12:46:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:46:25.652Z: Fusing consumer DatastoreV1.Read/Reshuffle/Values/Values/Map into DatastoreV1.Read/Reshuffle/Reshuffle/ExpandIterable
Apr 26, 2018 12:46:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:46:25.672Z: Fusing consumer DatastoreV1.Read/Reshuffle/Reshuffle/ExpandIterable into DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/GroupByWindow
Apr 26, 2018 12:46:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:46:25.696Z: Fusing consumer Combine.globally(Count)/Combine.perKey(Count)/Combine.GroupedValues/Extract into Combine.globally(Count)/Combine.perKey(Count)/Combine.GroupedValues
Apr 26, 2018 12:46:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:46:25.729Z: Fusing consumer PAssert$3/RunChecks into PAssert$3/WindowToken/Window.Assign
Apr 26, 2018 12:46:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:46:25.740Z: Fusing consumer PAssert$3/WindowToken/Window.Assign into PAssert$3/Create.Values/Read(CreateSource)
Apr 26, 2018 12:46:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:46:25.771Z: Fusing consumer PAssert$3/VerifyAssertions/ParDo(DefaultConclude) into PAssert$3/RunChecks
Apr 26, 2018 12:46:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:46:26.078Z: Executing operation Combine.globally(Count)/Combine.perKey(Count)/GroupByKey/Create
Apr 26, 2018 12:46:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:46:26.107Z: Executing operation PAssert$3/CreateActual/GatherPanes/GroupByKey/Create
Apr 26, 2018 12:46:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:46:26.138Z: Executing operation PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
Apr 26, 2018 12:46:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:46:26.149Z: Starting 1 workers in us-central1-b...
Apr 26, 2018 12:46:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:46:26.170Z: Executing operation PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
Apr 26, 2018 12:46:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:46:26.195Z: Executing operation DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/Create
Apr 26, 2018 12:46:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:46:35.658Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
Apr 26, 2018 12:46:37 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:46:36.039Z: Executing operation DatastoreV1.Read/Create.OfValueProvider/Create.Values/Read(CreateSource)+DatastoreV1.Read/ParDo(GqlQueryTranslate)+DatastoreV1.Read/Split+DatastoreV1.Read/Reshuffle/Pair with random key+DatastoreV1.Read/Reshuffle/Reshuffle/Window.Into()/Window.Assign+DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/Reify+DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/Write
Apr 26, 2018 12:46:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:46:41.439Z: Autoscaling: Resizing worker pool from 1 to 5.
Apr 26, 2018 12:46:49 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:46:48.188Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
Apr 26, 2018 12:46:49 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:46:48.215Z: Resized worker pool to 1, though goal was 5. This could be a quota issue.
Apr 26, 2018 12:47:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:47:14.925Z: Workers have started successfully.
Apr 26, 2018 12:47:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:47:35.467Z: Executing operation DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/Close
Apr 26, 2018 12:47:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:47:35.546Z: Executing operation DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/Read+DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/GroupByWindow+DatastoreV1.Read/Reshuffle/Reshuffle/ExpandIterable+DatastoreV1.Read/Reshuffle/Values/Values/Map+DatastoreV1.Read/Read+Combine.globally(Count)/WithKeys/AddKeys/Map+Combine.globally(Count)/Combine.perKey(Count)/GroupByKey+Combine.globally(Count)/Combine.perKey(Count)/Combine.GroupedValues/Partial+Combine.globally(Count)/Combine.perKey(Count)/GroupByKey/Reify+Combine.globally(Count)/Combine.perKey(Count)/GroupByKey/Write
Apr 26, 2018 12:47:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:47:41.124Z: Autoscaling: Raised the number of workers to 3 based on the rate of progress in the currently running step(s).
Apr 26, 2018 12:47:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:47:41.157Z: Resized worker pool to 3, though goal was 5. This could be a quota issue.
Apr 26, 2018 12:47:43 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:47:42.892Z: Executing operation Combine.globally(Count)/Combine.perKey(Count)/GroupByKey/Close
Apr 26, 2018 12:47:43 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:47:42.969Z: Executing operation Combine.globally(Count)/Combine.perKey(Count)/GroupByKey/Read+Combine.globally(Count)/Combine.perKey(Count)/Combine.GroupedValues+Combine.globally(Count)/Combine.perKey(Count)/Combine.GroupedValues/Extract+Combine.globally(Count)/Values/Values/Map+PAssert$3/CreateActual/FilterActuals/Window.Assign+PAssert$3/CreateActual/GatherPanes/Reify.Window/ParDo(Anonymous)+PAssert$3/CreateActual/GatherPanes/WithKeys/AddKeys/Map+PAssert$3/CreateActual/GatherPanes/Window.Into()/Window.Assign+PAssert$3/CreateActual/GatherPanes/GroupByKey/Reify+PAssert$3/CreateActual/GatherPanes/GroupByKey/Write+Combine.globally(Count)/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow)
Apr 26, 2018 12:47:47 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:47:46.461Z: Autoscaling: Raised the number of workers to 5 based on the rate of progress in the currently running step(s).
Apr 26, 2018 12:47:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:47:53.197Z: Executing operation Combine.globally(Count)/View.AsIterable/CreateDataflowView
Apr 26, 2018 12:47:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:47:53.352Z: Executing operation Combine.globally(Count)/CreateVoid/Read(CreateSource)+Combine.globally(Count)/ProduceDefault+PAssert$3/CreateActual/FilterActuals/Window.Assign+PAssert$3/CreateActual/GatherPanes/Reify.Window/ParDo(Anonymous)+PAssert$3/CreateActual/GatherPanes/WithKeys/AddKeys/Map+PAssert$3/CreateActual/GatherPanes/Window.Into()/Window.Assign+PAssert$3/CreateActual/GatherPanes/GroupByKey/Reify+PAssert$3/CreateActual/GatherPanes/GroupByKey/Write
Apr 26, 2018 12:47:56 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:47:56.094Z: Executing operation PAssert$3/CreateActual/GatherPanes/GroupByKey/Close
Apr 26, 2018 12:47:56 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:47:56.167Z: Executing operation PAssert$3/CreateActual/GatherPanes/GroupByKey/Read+PAssert$3/CreateActual/GatherPanes/GroupByKey/GroupByWindow+PAssert$3/CreateActual/GatherPanes/Values/Values/Map+PAssert$3/CreateActual/ExtractPane/Map+PAssert$3/CreateActual/Flatten.Iterables/FlattenIterables/FlatMap+PAssert$3/CreateActual/RewindowActuals/Window.Assign+PAssert$3/CreateActual/ParDo(Anonymous)+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
Apr 26, 2018 12:48:02 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:48:00.931Z: Executing operation PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
Apr 26, 2018 12:48:02 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:48:00.988Z: Executing operation PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
Apr 26, 2018 12:48:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:48:07.497Z: Executing operation PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
Apr 26, 2018 12:48:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:48:07.552Z: Executing operation PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
Apr 26, 2018 12:48:15 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:48:14.182Z: Executing operation PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
Apr 26, 2018 12:48:15 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:48:14.312Z: Executing operation PAssert$3/Create.Values/Read(CreateSource)+PAssert$3/WindowToken/Window.Assign+PAssert$3/RunChecks+PAssert$3/VerifyAssertions/ParDo(DefaultConclude)
Apr 26, 2018 12:48:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:48:16.157Z: Cleaning up.
Apr 26, 2018 12:48:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:48:16.510Z: Stopping worker pool...
Apr 26, 2018 12:50:03 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:50:02.434Z: Autoscaling: Resized worker pool from 5 to 0.
Apr 26, 2018 12:50:03 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:50:02.462Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
Apr 26, 2018 12:50:10 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-04-26_05_46_17-2164920387613623560 finished with status DONE.
Apr 26, 2018 12:50:10 PM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-04-26_05_46_17-2164920387613623560. Found 1 success, 0 failures out of 1 expected assertions.
Apr 26, 2018 12:50:10 PM org.apache.beam.sdk.io.gcp.datastore.V1TestUtil$V1TestWriter flushBatch
INFO: Writing batch of 500 entities
Apr 26, 2018 12:50:10 PM org.apache.beam.sdk.io.gcp.datastore.V1TestUtil$V1TestWriter flushBatch
INFO: Successfully wrote 500 entities
Apr 26, 2018 12:50:11 PM org.apache.beam.sdk.io.gcp.datastore.V1TestUtil$V1TestWriter flushBatch
INFO: Writing batch of 500 entities
Apr 26, 2018 12:50:11 PM org.apache.beam.sdk.io.gcp.datastore.V1TestUtil$V1TestWriter flushBatch
INFO: Successfully wrote 500 entities
Apr 26, 2018 12:50:11 PM org.apache.beam.sdk.io.gcp.datastore.V1TestUtil deleteAllEntities
INFO: Successfully deleted 1000 entities
org.apache.beam.sdk.io.gcp.datastore.SplitQueryFnIT > testSplitQueryFnWithLargeDataset STANDARD_ERROR
Apr 26, 2018 12:50:11 PM org.apache.beam.sdk.transforms.DoFnTester of
WARNING: Your tests use DoFnTester, which may not exercise DoFns correctly. Please use TestPipeline instead.
Apr 26, 2018 12:50:12 PM org.apache.beam.sdk.io.gcp.datastore.DatastoreV1$Read getEstimatedSizeBytes
INFO: Latest stats timestamp for kind sort_1G is 1524555829000000
Apr 26, 2018 12:50:12 PM org.apache.beam.sdk.io.gcp.datastore.DatastoreV1$Read getEstimatedNumSplits
INFO: Estimated size bytes for the query is: 2130000000
Apr 26, 2018 12:50:12 PM org.apache.beam.sdk.io.gcp.datastore.DatastoreV1$Read$SplitQueryFn processElement
INFO: Splitting the query into 32 splits
org.apache.beam.sdk.io.gcp.datastore.SplitQueryFnIT > testSplitQueryFnWithSmallDataset STANDARD_ERROR
Apr 26, 2018 12:50:12 PM org.apache.beam.sdk.transforms.DoFnTester of
WARNING: Your tests use DoFnTester, which may not exercise DoFns correctly. Please use TestPipeline instead.
Apr 26, 2018 12:50:12 PM org.apache.beam.sdk.io.gcp.datastore.DatastoreV1$Read getEstimatedSizeBytes
INFO: Latest stats timestamp for kind shakespeare is 1524555829000000
Apr 26, 2018 12:50:12 PM org.apache.beam.sdk.io.gcp.datastore.DatastoreV1$Read getEstimatedNumSplits
INFO: Estimated size bytes for the query is: 26383451
Apr 26, 2018 12:50:12 PM org.apache.beam.sdk.io.gcp.datastore.DatastoreV1$Read$SplitQueryFn processElement
INFO: Splitting the query into 12 splits
Gradle Test Executor 128 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:googleCloudPlatformIntegrationTest FAILED
org.apache.beam.sdk.io.gcp.spanner.SpannerWriteIT > testWrite FAILED
java.lang.NoClassDefFoundError: com/google/api/gax/retrying/ExceptionRetryAlgorithm
at java.lang.ClassLoader.defineClass1(Native Method)
at java.lang.ClassLoader.defineClass(ClassLoader.java:763)
at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)
at java.net.URLClassLoader.defineClass(URLClassLoader.java:467)
at java.net.URLClassLoader.access$100(URLClassLoader.java:73)
at java.net.URLClassLoader$1.run(URLClassLoader.java:368)
at java.net.URLClassLoader$1.run(URLClassLoader.java:362)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:361)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:338)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
at com.google.cloud.BaseService.<clinit>(BaseService.java:48)
at com.google.cloud.spanner.SpannerOptions$DefaultSpannerFactory.create(SpannerOptions.java:60)
at com.google.cloud.spanner.SpannerOptions$DefaultSpannerFactory.create(SpannerOptions.java:55)
at com.google.cloud.ServiceOptions.getService(ServiceOptions.java:426)
at org.apache.beam.sdk.io.gcp.spanner.SpannerWriteIT.setUp(SpannerWriteIT.java:91)
Caused by:
java.lang.ClassNotFoundException: com.google.api.gax.retrying.ExceptionRetryAlgorithm
at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:338)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
... 17 more
java.lang.NullPointerException
at org.apache.beam.sdk.io.gcp.spanner.SpannerWriteIT.tearDown(SpannerWriteIT.java:148)
12 tests completed, 3 failed
Finished generating test XML results (0.008 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/ws/src/runners/google-cloud-dataflow-java/build/test-results/googleCloudPlatformIntegrationTest>
Generating HTML test report...
Finished generating test html results (0.009 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/googleCloudPlatformIntegrationTest>
:beam-runners-google-cloud-dataflow-java:googleCloudPlatformIntegrationTest (Thread[Task worker for ':',5,main]) completed. Took 16 mins 37.873 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:googleCloudPlatformIntegrationTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/googleCloudPlatformIntegrationTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 49m 22s
546 actionable tasks: 546 executed
Publishing build scan...
https://gradle.com/s/wsyh3qdarb5w2
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user kirpichov@google.com
Not sending mail to unregistered user kedin@google.com
Not sending mail to unregistered user sidhom@google.com
Not sending mail to unregistered user swegner@google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user relax@relax-macbookpro2.roam.corp.google.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user wcn@google.com
Build failed in Jenkins: beam_PostCommit_Java_GradleBuild #196
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/196/display/redirect?page=changes>
Changes:
[coheigea] Use Collections.emptyList() instead of Collections.EMPTY_LIST
------------------------------------------
[...truncated 18.78 MB...]
Apr 26, 2018 12:33:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:33:35.744Z: Fusing consumer PAssert$3/CreateActual/GatherPanes/GroupByKey/Write into PAssert$3/CreateActual/GatherPanes/GroupByKey/Reify
Apr 26, 2018 12:33:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:33:35.772Z: Fusing consumer PAssert$3/CreateActual/GatherPanes/Window.Into()/Window.Assign into PAssert$3/CreateActual/GatherPanes/WithKeys/AddKeys/Map
Apr 26, 2018 12:33:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:33:35.800Z: Unzipping flatten s18-u63 for input s19.output-c61
Apr 26, 2018 12:33:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:33:35.822Z: Fusing unzipped copy of PAssert$3/CreateActual/GatherPanes/Reify.Window/ParDo(Anonymous), through flatten s18-u63, into producer PAssert$3/CreateActual/FilterActuals/Window.Assign
Apr 26, 2018 12:33:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:33:35.852Z: Fusing consumer PAssert$3/CreateActual/GatherPanes/Reify.Window/ParDo(Anonymous) into PAssert$3/CreateActual/FilterActuals/Window.Assign
Apr 26, 2018 12:33:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:33:35.883Z: Fusing consumer PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
Apr 26, 2018 12:33:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:33:35.908Z: Fusing consumer PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
Apr 26, 2018 12:33:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:33:35.930Z: Fusing consumer PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
Apr 26, 2018 12:33:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:33:35.951Z: Fusing consumer PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
Apr 26, 2018 12:33:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:33:35.979Z: Fusing consumer PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
Apr 26, 2018 12:33:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:33:36.007Z: Fusing consumer PAssert$3/CreateActual/RewindowActuals/Window.Assign into PAssert$3/CreateActual/Flatten.Iterables/FlattenIterables/FlatMap
Apr 26, 2018 12:33:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:33:36.037Z: Fusing consumer PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
Apr 26, 2018 12:33:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:33:36.062Z: Fusing consumer PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
Apr 26, 2018 12:33:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:33:36.085Z: Fusing consumer PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
Apr 26, 2018 12:33:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:33:36.114Z: Fusing consumer PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
Apr 26, 2018 12:33:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:33:36.147Z: Fusing consumer PAssert$3/CreateActual/ParDo(Anonymous) into PAssert$3/CreateActual/RewindowActuals/Window.Assign
Apr 26, 2018 12:33:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:33:36.176Z: Fusing consumer PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into PAssert$3/CreateActual/ParDo(Anonymous)
Apr 26, 2018 12:33:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:33:36.208Z: Fusing consumer Combine.globally(Count)/ProduceDefault into Combine.globally(Count)/CreateVoid/Read(CreateSource)
Apr 26, 2018 12:33:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:33:36.235Z: Fusing consumer Combine.globally(Count)/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow) into Combine.globally(Count)/Values/Values/Map
Apr 26, 2018 12:33:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:33:36.262Z: Fusing consumer Combine.globally(Count)/Combine.perKey(Count)/Combine.GroupedValues into Combine.globally(Count)/Combine.perKey(Count)/GroupByKey/Read
Apr 26, 2018 12:33:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:33:36.292Z: Fusing consumer Combine.globally(Count)/Combine.perKey(Count)/GroupByKey+Combine.globally(Count)/Combine.perKey(Count)/Combine.GroupedValues/Partial into Combine.globally(Count)/WithKeys/AddKeys/Map
Apr 26, 2018 12:33:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:33:36.313Z: Fusing consumer DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/GroupByWindow into DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/Read
Apr 26, 2018 12:33:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:33:36.343Z: Fusing consumer Combine.globally(Count)/Combine.perKey(Count)/GroupByKey/Reify into Combine.globally(Count)/Combine.perKey(Count)/GroupByKey+Combine.globally(Count)/Combine.perKey(Count)/Combine.GroupedValues/Partial
Apr 26, 2018 12:33:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:33:36.369Z: Fusing consumer Combine.globally(Count)/WithKeys/AddKeys/Map into DatastoreV1.Read/Read
Apr 26, 2018 12:33:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:33:36.394Z: Fusing consumer DatastoreV1.Read/Reshuffle/Pair with random key into DatastoreV1.Read/Split
Apr 26, 2018 12:33:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:33:36.424Z: Fusing consumer DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/Write into DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/Reify
Apr 26, 2018 12:33:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:33:36.453Z: Fusing consumer DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/Reify into DatastoreV1.Read/Reshuffle/Reshuffle/Window.Into()/Window.Assign
Apr 26, 2018 12:33:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:33:36.481Z: Fusing consumer Combine.globally(Count)/Values/Values/Map into Combine.globally(Count)/Combine.perKey(Count)/Combine.GroupedValues/Extract
Apr 26, 2018 12:33:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:33:36.510Z: Fusing consumer DatastoreV1.Read/Split into DatastoreV1.Read/ParDo(GqlQueryTranslate)
Apr 26, 2018 12:33:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:33:36.539Z: Fusing consumer DatastoreV1.Read/Reshuffle/Reshuffle/Window.Into()/Window.Assign into DatastoreV1.Read/Reshuffle/Pair with random key
Apr 26, 2018 12:33:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:33:36.568Z: Fusing consumer Combine.globally(Count)/Combine.perKey(Count)/GroupByKey/Write into Combine.globally(Count)/Combine.perKey(Count)/GroupByKey/Reify
Apr 26, 2018 12:33:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:33:36.596Z: Fusing consumer DatastoreV1.Read/ParDo(GqlQueryTranslate) into DatastoreV1.Read/Create.OfValueProvider/Create.Values/Read(CreateSource)
Apr 26, 2018 12:33:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:33:36.626Z: Fusing consumer DatastoreV1.Read/Read into DatastoreV1.Read/Reshuffle/Values/Values/Map
Apr 26, 2018 12:33:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:33:36.652Z: Fusing consumer DatastoreV1.Read/Reshuffle/Values/Values/Map into DatastoreV1.Read/Reshuffle/Reshuffle/ExpandIterable
Apr 26, 2018 12:33:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:33:36.682Z: Fusing consumer DatastoreV1.Read/Reshuffle/Reshuffle/ExpandIterable into DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/GroupByWindow
Apr 26, 2018 12:33:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:33:36.708Z: Fusing consumer Combine.globally(Count)/Combine.perKey(Count)/Combine.GroupedValues/Extract into Combine.globally(Count)/Combine.perKey(Count)/Combine.GroupedValues
Apr 26, 2018 12:33:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:33:36.728Z: Fusing consumer PAssert$3/RunChecks into PAssert$3/WindowToken/Window.Assign
Apr 26, 2018 12:33:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:33:36.748Z: Fusing consumer PAssert$3/WindowToken/Window.Assign into PAssert$3/Create.Values/Read(CreateSource)
Apr 26, 2018 12:33:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:33:36.775Z: Fusing consumer PAssert$3/VerifyAssertions/ParDo(DefaultConclude) into PAssert$3/RunChecks
Apr 26, 2018 12:33:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:33:37.089Z: Executing operation Combine.globally(Count)/Combine.perKey(Count)/GroupByKey/Create
Apr 26, 2018 12:33:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:33:37.114Z: Executing operation PAssert$3/CreateActual/GatherPanes/GroupByKey/Create
Apr 26, 2018 12:33:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:33:37.143Z: Executing operation PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
Apr 26, 2018 12:33:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:33:37.154Z: Starting 1 workers in us-central1-f...
Apr 26, 2018 12:33:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:33:37.176Z: Executing operation PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
Apr 26, 2018 12:33:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:33:37.188Z: Executing operation DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/Create
Apr 26, 2018 12:33:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:33:44.280Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
Apr 26, 2018 12:33:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:33:44.481Z: Executing operation DatastoreV1.Read/Create.OfValueProvider/Create.Values/Read(CreateSource)+DatastoreV1.Read/ParDo(GqlQueryTranslate)+DatastoreV1.Read/Split+DatastoreV1.Read/Reshuffle/Pair with random key+DatastoreV1.Read/Reshuffle/Reshuffle/Window.Into()/Window.Assign+DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/Reify+DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/Write
Apr 26, 2018 12:33:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:33:49.851Z: Autoscaling: Resizing worker pool from 1 to 5.
Apr 26, 2018 12:34:02 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:34:01.326Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
Apr 26, 2018 12:34:02 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:34:01.348Z: Resized worker pool to 1, though goal was 5. This could be a quota issue.
Apr 26, 2018 12:34:22 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:34:20.771Z: Workers have started successfully.
Apr 26, 2018 12:34:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:34:53.121Z: Executing operation DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/Close
Apr 26, 2018 12:34:54 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:34:53.194Z: Executing operation DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/Read+DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/GroupByWindow+DatastoreV1.Read/Reshuffle/Reshuffle/ExpandIterable+DatastoreV1.Read/Reshuffle/Values/Values/Map+DatastoreV1.Read/Read+Combine.globally(Count)/WithKeys/AddKeys/Map+Combine.globally(Count)/Combine.perKey(Count)/GroupByKey+Combine.globally(Count)/Combine.perKey(Count)/Combine.GroupedValues/Partial+Combine.globally(Count)/Combine.perKey(Count)/GroupByKey/Reify+Combine.globally(Count)/Combine.perKey(Count)/GroupByKey/Write
Apr 26, 2018 12:34:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:34:58.717Z: Autoscaling: Raised the number of workers to 5 based on the rate of progress in the currently running step(s).
Apr 26, 2018 12:35:03 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:35:03.175Z: Executing operation Combine.globally(Count)/Combine.perKey(Count)/GroupByKey/Close
Apr 26, 2018 12:35:03 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:35:03.232Z: Executing operation Combine.globally(Count)/Combine.perKey(Count)/GroupByKey/Read+Combine.globally(Count)/Combine.perKey(Count)/Combine.GroupedValues+Combine.globally(Count)/Combine.perKey(Count)/Combine.GroupedValues/Extract+Combine.globally(Count)/Values/Values/Map+PAssert$3/CreateActual/FilterActuals/Window.Assign+PAssert$3/CreateActual/GatherPanes/Reify.Window/ParDo(Anonymous)+PAssert$3/CreateActual/GatherPanes/WithKeys/AddKeys/Map+PAssert$3/CreateActual/GatherPanes/Window.Into()/Window.Assign+PAssert$3/CreateActual/GatherPanes/GroupByKey/Reify+PAssert$3/CreateActual/GatherPanes/GroupByKey/Write+Combine.globally(Count)/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow)
Apr 26, 2018 12:35:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:35:10.786Z: Executing operation Combine.globally(Count)/View.AsIterable/CreateDataflowView
Apr 26, 2018 12:35:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:35:10.900Z: Executing operation Combine.globally(Count)/CreateVoid/Read(CreateSource)+Combine.globally(Count)/ProduceDefault+PAssert$3/CreateActual/FilterActuals/Window.Assign+PAssert$3/CreateActual/GatherPanes/Reify.Window/ParDo(Anonymous)+PAssert$3/CreateActual/GatherPanes/WithKeys/AddKeys/Map+PAssert$3/CreateActual/GatherPanes/Window.Into()/Window.Assign+PAssert$3/CreateActual/GatherPanes/GroupByKey/Reify+PAssert$3/CreateActual/GatherPanes/GroupByKey/Write
Apr 26, 2018 12:35:15 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:35:14.815Z: Executing operation PAssert$3/CreateActual/GatherPanes/GroupByKey/Close
Apr 26, 2018 12:35:15 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:35:14.869Z: Executing operation PAssert$3/CreateActual/GatherPanes/GroupByKey/Read+PAssert$3/CreateActual/GatherPanes/GroupByKey/GroupByWindow+PAssert$3/CreateActual/GatherPanes/Values/Values/Map+PAssert$3/CreateActual/ExtractPane/Map+PAssert$3/CreateActual/Flatten.Iterables/FlattenIterables/FlatMap+PAssert$3/CreateActual/RewindowActuals/Window.Assign+PAssert$3/CreateActual/ParDo(Anonymous)+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
Apr 26, 2018 12:35:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:35:21.706Z: Executing operation PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
Apr 26, 2018 12:35:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:35:21.756Z: Executing operation PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
Apr 26, 2018 12:35:24 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:35:24.388Z: Executing operation PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
Apr 26, 2018 12:35:24 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:35:24.435Z: Executing operation PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
Apr 26, 2018 12:35:33 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:35:31.439Z: Executing operation PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
Apr 26, 2018 12:35:33 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:35:31.541Z: Executing operation PAssert$3/Create.Values/Read(CreateSource)+PAssert$3/WindowToken/Window.Assign+PAssert$3/RunChecks+PAssert$3/VerifyAssertions/ParDo(DefaultConclude)
Apr 26, 2018 12:35:33 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:35:32.324Z: Cleaning up.
Apr 26, 2018 12:35:33 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:35:32.701Z: Stopping worker pool...
Apr 26, 2018 12:37:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:37:25.760Z: Autoscaling: Resized worker pool from 5 to 0.
Apr 26, 2018 12:37:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T12:37:25.780Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
Apr 26, 2018 12:37:33 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-04-26_05_33_28-1520893041287086180 finished with status DONE.
Apr 26, 2018 12:37:33 PM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-04-26_05_33_28-1520893041287086180. Found 1 success, 0 failures out of 1 expected assertions.
Apr 26, 2018 12:37:34 PM org.apache.beam.sdk.io.gcp.datastore.V1TestUtil$V1TestWriter flushBatch
INFO: Writing batch of 500 entities
Apr 26, 2018 12:37:34 PM org.apache.beam.sdk.io.gcp.datastore.V1TestUtil$V1TestWriter flushBatch
INFO: Successfully wrote 500 entities
Apr 26, 2018 12:37:34 PM org.apache.beam.sdk.io.gcp.datastore.V1TestUtil$V1TestWriter flushBatch
INFO: Writing batch of 500 entities
Apr 26, 2018 12:37:35 PM org.apache.beam.sdk.io.gcp.datastore.V1TestUtil$V1TestWriter flushBatch
INFO: Successfully wrote 500 entities
Apr 26, 2018 12:37:35 PM org.apache.beam.sdk.io.gcp.datastore.V1TestUtil deleteAllEntities
INFO: Successfully deleted 1000 entities
org.apache.beam.sdk.io.gcp.datastore.SplitQueryFnIT > testSplitQueryFnWithLargeDataset STANDARD_ERROR
Apr 26, 2018 12:37:35 PM org.apache.beam.sdk.transforms.DoFnTester of
WARNING: Your tests use DoFnTester, which may not exercise DoFns correctly. Please use TestPipeline instead.
Apr 26, 2018 12:37:35 PM org.apache.beam.sdk.io.gcp.datastore.DatastoreV1$Read getEstimatedSizeBytes
INFO: Latest stats timestamp for kind sort_1G is 1524555829000000
Apr 26, 2018 12:37:36 PM org.apache.beam.sdk.io.gcp.datastore.DatastoreV1$Read getEstimatedNumSplits
INFO: Estimated size bytes for the query is: 2130000000
Apr 26, 2018 12:37:36 PM org.apache.beam.sdk.io.gcp.datastore.DatastoreV1$Read$SplitQueryFn processElement
INFO: Splitting the query into 32 splits
org.apache.beam.sdk.io.gcp.datastore.SplitQueryFnIT > testSplitQueryFnWithSmallDataset STANDARD_ERROR
Apr 26, 2018 12:37:36 PM org.apache.beam.sdk.transforms.DoFnTester of
WARNING: Your tests use DoFnTester, which may not exercise DoFns correctly. Please use TestPipeline instead.
Apr 26, 2018 12:37:37 PM org.apache.beam.sdk.io.gcp.datastore.DatastoreV1$Read getEstimatedSizeBytes
INFO: Latest stats timestamp for kind shakespeare is 1524555829000000
Apr 26, 2018 12:37:37 PM org.apache.beam.sdk.io.gcp.datastore.DatastoreV1$Read getEstimatedNumSplits
INFO: Estimated size bytes for the query is: 26383451
Apr 26, 2018 12:37:37 PM org.apache.beam.sdk.io.gcp.datastore.DatastoreV1$Read$SplitQueryFn processElement
INFO: Splitting the query into 12 splits
Gradle Test Executor 123 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:googleCloudPlatformIntegrationTest FAILED
org.apache.beam.sdk.io.gcp.spanner.SpannerWriteIT > testWrite FAILED
java.lang.NoClassDefFoundError: com/google/api/gax/retrying/ExceptionRetryAlgorithm
at java.lang.ClassLoader.defineClass1(Native Method)
at java.lang.ClassLoader.defineClass(ClassLoader.java:763)
at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)
at java.net.URLClassLoader.defineClass(URLClassLoader.java:467)
at java.net.URLClassLoader.access$100(URLClassLoader.java:73)
at java.net.URLClassLoader$1.run(URLClassLoader.java:368)
at java.net.URLClassLoader$1.run(URLClassLoader.java:362)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:361)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:338)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
at com.google.cloud.BaseService.<clinit>(BaseService.java:48)
at com.google.cloud.spanner.SpannerOptions$DefaultSpannerFactory.create(SpannerOptions.java:60)
at com.google.cloud.spanner.SpannerOptions$DefaultSpannerFactory.create(SpannerOptions.java:55)
at com.google.cloud.ServiceOptions.getService(ServiceOptions.java:426)
at org.apache.beam.sdk.io.gcp.spanner.SpannerWriteIT.setUp(SpannerWriteIT.java:91)
Caused by:
java.lang.ClassNotFoundException: com.google.api.gax.retrying.ExceptionRetryAlgorithm
at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:338)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
... 17 more
java.lang.NullPointerException
at org.apache.beam.sdk.io.gcp.spanner.SpannerWriteIT.tearDown(SpannerWriteIT.java:148)
12 tests completed, 3 failed
Finished generating test XML results (0.007 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/ws/src/runners/google-cloud-dataflow-java/build/test-results/googleCloudPlatformIntegrationTest>
Generating HTML test report...
Finished generating test html results (0.009 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/googleCloudPlatformIntegrationTest>
:beam-runners-google-cloud-dataflow-java:googleCloudPlatformIntegrationTest (Thread[main,5,main]) completed. Took 17 mins 52.96 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:googleCloudPlatformIntegrationTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/googleCloudPlatformIntegrationTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 48m 20s
546 actionable tasks: 542 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/2kgwtm667dzeu
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user kirpichov@google.com
Not sending mail to unregistered user kedin@google.com
Not sending mail to unregistered user sidhom@google.com
Not sending mail to unregistered user swegner@google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user relax@relax-macbookpro2.roam.corp.google.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user wcn@google.com
Build failed in Jenkins: beam_PostCommit_Java_GradleBuild #195
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/195/display/redirect>
------------------------------------------
[...truncated 18.89 MB...]
Apr 26, 2018 6:47:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T06:47:20.293Z: Fusing consumer PAssert$3/CreateActual/GatherPanes/GroupByKey/Write into PAssert$3/CreateActual/GatherPanes/GroupByKey/Reify
Apr 26, 2018 6:47:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T06:47:20.318Z: Fusing consumer PAssert$3/CreateActual/GatherPanes/Window.Into()/Window.Assign into PAssert$3/CreateActual/GatherPanes/WithKeys/AddKeys/Map
Apr 26, 2018 6:47:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T06:47:20.346Z: Unzipping flatten s18-u63 for input s19.output-c61
Apr 26, 2018 6:47:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T06:47:20.375Z: Fusing unzipped copy of PAssert$3/CreateActual/GatherPanes/Reify.Window/ParDo(Anonymous), through flatten s18-u63, into producer PAssert$3/CreateActual/FilterActuals/Window.Assign
Apr 26, 2018 6:47:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T06:47:20.400Z: Fusing consumer PAssert$3/CreateActual/GatherPanes/Reify.Window/ParDo(Anonymous) into PAssert$3/CreateActual/FilterActuals/Window.Assign
Apr 26, 2018 6:47:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T06:47:20.427Z: Fusing consumer PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
Apr 26, 2018 6:47:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T06:47:20.457Z: Fusing consumer PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
Apr 26, 2018 6:47:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T06:47:20.480Z: Fusing consumer PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
Apr 26, 2018 6:47:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T06:47:20.508Z: Fusing consumer PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
Apr 26, 2018 6:47:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T06:47:20.531Z: Fusing consumer PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
Apr 26, 2018 6:47:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T06:47:20.554Z: Fusing consumer PAssert$3/CreateActual/RewindowActuals/Window.Assign into PAssert$3/CreateActual/Flatten.Iterables/FlattenIterables/FlatMap
Apr 26, 2018 6:47:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T06:47:20.582Z: Fusing consumer PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
Apr 26, 2018 6:47:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T06:47:20.605Z: Fusing consumer PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
Apr 26, 2018 6:47:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T06:47:20.626Z: Fusing consumer PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
Apr 26, 2018 6:47:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T06:47:20.655Z: Fusing consumer PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
Apr 26, 2018 6:47:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T06:47:20.680Z: Fusing consumer PAssert$3/CreateActual/ParDo(Anonymous) into PAssert$3/CreateActual/RewindowActuals/Window.Assign
Apr 26, 2018 6:47:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T06:47:20.710Z: Fusing consumer PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into PAssert$3/CreateActual/ParDo(Anonymous)
Apr 26, 2018 6:47:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T06:47:20.740Z: Fusing consumer Combine.globally(Count)/ProduceDefault into Combine.globally(Count)/CreateVoid/Read(CreateSource)
Apr 26, 2018 6:47:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T06:47:20.763Z: Fusing consumer Combine.globally(Count)/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow) into Combine.globally(Count)/Values/Values/Map
Apr 26, 2018 6:47:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T06:47:20.791Z: Fusing consumer Combine.globally(Count)/Combine.perKey(Count)/Combine.GroupedValues into Combine.globally(Count)/Combine.perKey(Count)/GroupByKey/Read
Apr 26, 2018 6:47:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T06:47:20.820Z: Fusing consumer Combine.globally(Count)/Combine.perKey(Count)/GroupByKey+Combine.globally(Count)/Combine.perKey(Count)/Combine.GroupedValues/Partial into Combine.globally(Count)/WithKeys/AddKeys/Map
Apr 26, 2018 6:47:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T06:47:20.846Z: Fusing consumer DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/GroupByWindow into DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/Read
Apr 26, 2018 6:47:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T06:47:20.874Z: Fusing consumer Combine.globally(Count)/Combine.perKey(Count)/GroupByKey/Reify into Combine.globally(Count)/Combine.perKey(Count)/GroupByKey+Combine.globally(Count)/Combine.perKey(Count)/Combine.GroupedValues/Partial
Apr 26, 2018 6:47:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T06:47:20.907Z: Fusing consumer Combine.globally(Count)/WithKeys/AddKeys/Map into DatastoreV1.Read/Read
Apr 26, 2018 6:47:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T06:47:20.941Z: Fusing consumer DatastoreV1.Read/Reshuffle/Pair with random key into DatastoreV1.Read/Split
Apr 26, 2018 6:47:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T06:47:20.969Z: Fusing consumer DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/Write into DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/Reify
Apr 26, 2018 6:47:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T06:47:20.994Z: Fusing consumer DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/Reify into DatastoreV1.Read/Reshuffle/Reshuffle/Window.Into()/Window.Assign
Apr 26, 2018 6:47:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T06:47:21.024Z: Fusing consumer Combine.globally(Count)/Values/Values/Map into Combine.globally(Count)/Combine.perKey(Count)/Combine.GroupedValues/Extract
Apr 26, 2018 6:47:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T06:47:21.050Z: Fusing consumer DatastoreV1.Read/Split into DatastoreV1.Read/ParDo(GqlQueryTranslate)
Apr 26, 2018 6:47:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T06:47:21.074Z: Fusing consumer DatastoreV1.Read/Reshuffle/Reshuffle/Window.Into()/Window.Assign into DatastoreV1.Read/Reshuffle/Pair with random key
Apr 26, 2018 6:47:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T06:47:21.099Z: Fusing consumer Combine.globally(Count)/Combine.perKey(Count)/GroupByKey/Write into Combine.globally(Count)/Combine.perKey(Count)/GroupByKey/Reify
Apr 26, 2018 6:47:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T06:47:21.123Z: Fusing consumer DatastoreV1.Read/ParDo(GqlQueryTranslate) into DatastoreV1.Read/Create.OfValueProvider/Create.Values/Read(CreateSource)
Apr 26, 2018 6:47:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T06:47:21.148Z: Fusing consumer DatastoreV1.Read/Read into DatastoreV1.Read/Reshuffle/Values/Values/Map
Apr 26, 2018 6:47:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T06:47:21.177Z: Fusing consumer DatastoreV1.Read/Reshuffle/Values/Values/Map into DatastoreV1.Read/Reshuffle/Reshuffle/ExpandIterable
Apr 26, 2018 6:47:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T06:47:21.207Z: Fusing consumer DatastoreV1.Read/Reshuffle/Reshuffle/ExpandIterable into DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/GroupByWindow
Apr 26, 2018 6:47:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T06:47:21.239Z: Fusing consumer Combine.globally(Count)/Combine.perKey(Count)/Combine.GroupedValues/Extract into Combine.globally(Count)/Combine.perKey(Count)/Combine.GroupedValues
Apr 26, 2018 6:47:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T06:47:21.260Z: Fusing consumer PAssert$3/RunChecks into PAssert$3/WindowToken/Window.Assign
Apr 26, 2018 6:47:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T06:47:21.285Z: Fusing consumer PAssert$3/WindowToken/Window.Assign into PAssert$3/Create.Values/Read(CreateSource)
Apr 26, 2018 6:47:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T06:47:21.314Z: Fusing consumer PAssert$3/VerifyAssertions/ParDo(DefaultConclude) into PAssert$3/RunChecks
Apr 26, 2018 6:47:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T06:47:21.630Z: Executing operation Combine.globally(Count)/Combine.perKey(Count)/GroupByKey/Create
Apr 26, 2018 6:47:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T06:47:21.651Z: Executing operation PAssert$3/CreateActual/GatherPanes/GroupByKey/Create
Apr 26, 2018 6:47:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T06:47:21.672Z: Executing operation PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
Apr 26, 2018 6:47:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T06:47:21.694Z: Starting 1 workers in us-central1-f...
Apr 26, 2018 6:47:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T06:47:21.703Z: Executing operation PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
Apr 26, 2018 6:47:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T06:47:21.735Z: Executing operation DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/Create
Apr 26, 2018 6:47:29 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T06:47:28.640Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
Apr 26, 2018 6:47:29 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T06:47:28.964Z: Executing operation DatastoreV1.Read/Create.OfValueProvider/Create.Values/Read(CreateSource)+DatastoreV1.Read/ParDo(GqlQueryTranslate)+DatastoreV1.Read/Split+DatastoreV1.Read/Reshuffle/Pair with random key+DatastoreV1.Read/Reshuffle/Reshuffle/Window.Into()/Window.Assign+DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/Reify+DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/Write
Apr 26, 2018 6:47:35 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T06:47:34.226Z: Autoscaling: Resizing worker pool from 1 to 5.
Apr 26, 2018 6:47:46 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T06:47:45.836Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
Apr 26, 2018 6:47:46 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T06:47:45.859Z: Resized worker pool to 1, though goal was 5. This could be a quota issue.
Apr 26, 2018 6:47:56 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T06:47:56.280Z: Autoscaling: Raised the number of workers to 5 based on the rate of progress in the currently running step(s).
Apr 26, 2018 6:48:07 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T06:48:06.671Z: Workers have started successfully.
Apr 26, 2018 6:48:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T06:48:30.129Z: Executing operation DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/Close
Apr 26, 2018 6:48:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T06:48:30.184Z: Executing operation DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/Read+DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/GroupByWindow+DatastoreV1.Read/Reshuffle/Reshuffle/ExpandIterable+DatastoreV1.Read/Reshuffle/Values/Values/Map+DatastoreV1.Read/Read+Combine.globally(Count)/WithKeys/AddKeys/Map+Combine.globally(Count)/Combine.perKey(Count)/GroupByKey+Combine.globally(Count)/Combine.perKey(Count)/Combine.GroupedValues/Partial+Combine.globally(Count)/Combine.perKey(Count)/GroupByKey/Reify+Combine.globally(Count)/Combine.perKey(Count)/GroupByKey/Write
Apr 26, 2018 6:48:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T06:48:36.421Z: Executing operation Combine.globally(Count)/Combine.perKey(Count)/GroupByKey/Close
Apr 26, 2018 6:48:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T06:48:36.481Z: Executing operation Combine.globally(Count)/Combine.perKey(Count)/GroupByKey/Read+Combine.globally(Count)/Combine.perKey(Count)/Combine.GroupedValues+Combine.globally(Count)/Combine.perKey(Count)/Combine.GroupedValues/Extract+Combine.globally(Count)/Values/Values/Map+PAssert$3/CreateActual/FilterActuals/Window.Assign+PAssert$3/CreateActual/GatherPanes/Reify.Window/ParDo(Anonymous)+PAssert$3/CreateActual/GatherPanes/WithKeys/AddKeys/Map+PAssert$3/CreateActual/GatherPanes/Window.Into()/Window.Assign+PAssert$3/CreateActual/GatherPanes/GroupByKey/Reify+PAssert$3/CreateActual/GatherPanes/GroupByKey/Write+Combine.globally(Count)/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow)
Apr 26, 2018 6:48:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T06:48:46.567Z: Executing operation Combine.globally(Count)/View.AsIterable/CreateDataflowView
Apr 26, 2018 6:48:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T06:48:46.736Z: Executing operation Combine.globally(Count)/CreateVoid/Read(CreateSource)+Combine.globally(Count)/ProduceDefault+PAssert$3/CreateActual/FilterActuals/Window.Assign+PAssert$3/CreateActual/GatherPanes/Reify.Window/ParDo(Anonymous)+PAssert$3/CreateActual/GatherPanes/WithKeys/AddKeys/Map+PAssert$3/CreateActual/GatherPanes/Window.Into()/Window.Assign+PAssert$3/CreateActual/GatherPanes/GroupByKey/Reify+PAssert$3/CreateActual/GatherPanes/GroupByKey/Write
Apr 26, 2018 6:48:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T06:48:48.285Z: Executing operation PAssert$3/CreateActual/GatherPanes/GroupByKey/Close
Apr 26, 2018 6:48:48 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T06:48:48.340Z: Executing operation PAssert$3/CreateActual/GatherPanes/GroupByKey/Read+PAssert$3/CreateActual/GatherPanes/GroupByKey/GroupByWindow+PAssert$3/CreateActual/GatherPanes/Values/Values/Map+PAssert$3/CreateActual/ExtractPane/Map+PAssert$3/CreateActual/Flatten.Iterables/FlattenIterables/FlatMap+PAssert$3/CreateActual/RewindowActuals/Window.Assign+PAssert$3/CreateActual/ParDo(Anonymous)+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
Apr 26, 2018 6:48:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T06:48:50.104Z: Executing operation PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
Apr 26, 2018 6:48:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T06:48:50.158Z: Executing operation PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
Apr 26, 2018 6:48:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T06:48:50.666Z: Executing operation PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
Apr 26, 2018 6:48:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T06:48:50.729Z: Executing operation PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
Apr 26, 2018 6:48:55 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T06:48:54.611Z: Executing operation PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
Apr 26, 2018 6:48:55 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T06:48:54.808Z: Executing operation PAssert$3/Create.Values/Read(CreateSource)+PAssert$3/WindowToken/Window.Assign+PAssert$3/RunChecks+PAssert$3/VerifyAssertions/ParDo(DefaultConclude)
Apr 26, 2018 6:48:57 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T06:48:56.810Z: Cleaning up.
Apr 26, 2018 6:48:57 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T06:48:57.318Z: Stopping worker pool...
Apr 26, 2018 6:50:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T06:50:33.715Z: Autoscaling: Resized worker pool from 5 to 0.
Apr 26, 2018 6:50:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T06:50:33.744Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
Apr 26, 2018 6:50:44 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-04-25_23_47_11-2161690399072276526 finished with status DONE.
Apr 26, 2018 6:50:44 AM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-04-25_23_47_11-2161690399072276526. Found 1 success, 0 failures out of 1 expected assertions.
Apr 26, 2018 6:50:44 AM org.apache.beam.sdk.io.gcp.datastore.V1TestUtil$V1TestWriter flushBatch
INFO: Writing batch of 500 entities
Apr 26, 2018 6:50:45 AM org.apache.beam.sdk.io.gcp.datastore.V1TestUtil$V1TestWriter flushBatch
INFO: Successfully wrote 500 entities
Apr 26, 2018 6:50:45 AM org.apache.beam.sdk.io.gcp.datastore.V1TestUtil$V1TestWriter flushBatch
INFO: Writing batch of 500 entities
Apr 26, 2018 6:50:45 AM org.apache.beam.sdk.io.gcp.datastore.V1TestUtil$V1TestWriter flushBatch
INFO: Successfully wrote 500 entities
Apr 26, 2018 6:50:45 AM org.apache.beam.sdk.io.gcp.datastore.V1TestUtil deleteAllEntities
INFO: Successfully deleted 1000 entities
org.apache.beam.sdk.io.gcp.datastore.SplitQueryFnIT > testSplitQueryFnWithLargeDataset STANDARD_ERROR
Apr 26, 2018 6:50:45 AM org.apache.beam.sdk.transforms.DoFnTester of
WARNING: Your tests use DoFnTester, which may not exercise DoFns correctly. Please use TestPipeline instead.
Apr 26, 2018 6:50:46 AM org.apache.beam.sdk.io.gcp.datastore.DatastoreV1$Read getEstimatedSizeBytes
INFO: Latest stats timestamp for kind sort_1G is 1524555829000000
Apr 26, 2018 6:50:46 AM org.apache.beam.sdk.io.gcp.datastore.DatastoreV1$Read getEstimatedNumSplits
INFO: Estimated size bytes for the query is: 2130000000
Apr 26, 2018 6:50:46 AM org.apache.beam.sdk.io.gcp.datastore.DatastoreV1$Read$SplitQueryFn processElement
INFO: Splitting the query into 32 splits
org.apache.beam.sdk.io.gcp.datastore.SplitQueryFnIT > testSplitQueryFnWithSmallDataset STANDARD_ERROR
Apr 26, 2018 6:50:46 AM org.apache.beam.sdk.transforms.DoFnTester of
WARNING: Your tests use DoFnTester, which may not exercise DoFns correctly. Please use TestPipeline instead.
Apr 26, 2018 6:50:46 AM org.apache.beam.sdk.io.gcp.datastore.DatastoreV1$Read getEstimatedSizeBytes
INFO: Latest stats timestamp for kind shakespeare is 1524555829000000
Apr 26, 2018 6:50:46 AM org.apache.beam.sdk.io.gcp.datastore.DatastoreV1$Read getEstimatedNumSplits
INFO: Estimated size bytes for the query is: 26383451
Apr 26, 2018 6:50:46 AM org.apache.beam.sdk.io.gcp.datastore.DatastoreV1$Read$SplitQueryFn processElement
INFO: Splitting the query into 12 splits
Gradle Test Executor 131 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:googleCloudPlatformIntegrationTest FAILED
org.apache.beam.sdk.io.gcp.spanner.SpannerWriteIT > testWrite FAILED
java.lang.NoClassDefFoundError: com/google/api/gax/retrying/ExceptionRetryAlgorithm
at java.lang.ClassLoader.defineClass1(Native Method)
at java.lang.ClassLoader.defineClass(ClassLoader.java:763)
at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)
at java.net.URLClassLoader.defineClass(URLClassLoader.java:467)
at java.net.URLClassLoader.access$100(URLClassLoader.java:73)
at java.net.URLClassLoader$1.run(URLClassLoader.java:368)
at java.net.URLClassLoader$1.run(URLClassLoader.java:362)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:361)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:338)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
at com.google.cloud.BaseService.<clinit>(BaseService.java:48)
at com.google.cloud.spanner.SpannerOptions$DefaultSpannerFactory.create(SpannerOptions.java:60)
at com.google.cloud.spanner.SpannerOptions$DefaultSpannerFactory.create(SpannerOptions.java:55)
at com.google.cloud.ServiceOptions.getService(ServiceOptions.java:426)
at org.apache.beam.sdk.io.gcp.spanner.SpannerWriteIT.setUp(SpannerWriteIT.java:91)
Caused by:
java.lang.ClassNotFoundException: com.google.api.gax.retrying.ExceptionRetryAlgorithm
at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:338)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
... 17 more
java.lang.NullPointerException
at org.apache.beam.sdk.io.gcp.spanner.SpannerWriteIT.tearDown(SpannerWriteIT.java:148)
12 tests completed, 3 failed
Finished generating test XML results (0.007 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/ws/src/runners/google-cloud-dataflow-java/build/test-results/googleCloudPlatformIntegrationTest>
Generating HTML test report...
Finished generating test html results (0.008 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/googleCloudPlatformIntegrationTest>
:beam-runners-google-cloud-dataflow-java:googleCloudPlatformIntegrationTest (Thread[Task worker for ':',5,main]) completed. Took 15 mins 24.114 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:googleCloudPlatformIntegrationTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/googleCloudPlatformIntegrationTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 50m 8s
546 actionable tasks: 539 executed, 7 from cache
Publishing build scan...
https://gradle.com/s/ywbur5x3c2rba
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user kirpichov@google.com
Not sending mail to unregistered user kedin@google.com
Not sending mail to unregistered user sidhom@google.com
Not sending mail to unregistered user swegner@google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user relax@relax-macbookpro2.roam.corp.google.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user wcn@google.com
Build failed in Jenkins: beam_PostCommit_Java_GradleBuild #194
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/194/display/redirect?page=changes>
Changes:
[tgroh] Add OutputDeduplicator
[tgroh] Update ExecutableStageMatcher to accept Matchers
[tgroh] Use OutputDeduplicator in GreedyPipelineFuser
[tgroh] fixup! Add OutputDeduplicator
------------------------------------------
[...truncated 18.03 MB...]
INFO: Uploading /home/jenkins/.m2/repository/org/apache/httpcomponents/httpclient/4.0.1/httpclient-4.0.1.jar to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0426025604-3c8f0099/output/results/staging/httpclient-4.0.1-nKmHdIYBAcBsqQEO_WIkoQ.jar
Apr 26, 2018 2:56:06 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.m2/repository/com/google/protobuf/protobuf-java/3.2.0/protobuf-java-3.2.0.jar to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0426025604-3c8f0099/output/results/staging/protobuf-java-3.2.0-fh30Gescj5k_IhxJOGxriw.jar
Apr 26, 2018 2:56:06 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.m2/repository/org/tukaani/xz/1.5/xz-1.5.jar to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0426025604-3c8f0099/output/results/staging/xz-1.5-UQUOWVswjErsisMU9m4YvA.jar
Apr 26, 2018 2:56:06 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.m2/repository/com/google/errorprone/error_prone_annotations/2.0.15/error_prone_annotations-2.0.15.jar to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0426025604-3c8f0099/output/results/staging/error_prone_annotations-2.0.15-npnuyJrjs2dF75GdvUBIvQ.jar
Apr 26, 2018 2:56:06 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.gradle/caches/modules-2/files-2.1/io.grpc/grpc-context/1.9.0/28b0836f48c9705abf73829bbc536dba29a1329a/grpc-context-1.9.0.jar to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0426025604-3c8f0099/output/results/staging/grpc-context-1.9.0-atYmq4r_lax8i7-0BRHcCg.jar
Apr 26, 2018 2:56:06 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.m2/repository/org/json/json/20160810/json-20160810.jar to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0426025604-3c8f0099/output/results/staging/json-20160810-L3-Jnwdm5lAXdEpMT8FNRg.jar
Apr 26, 2018 2:56:06 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.m2/repository/org/codehaus/jackson/jackson-mapper-asl/1.9.13/jackson-mapper-asl-1.9.13.jar to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0426025604-3c8f0099/output/results/staging/jackson-mapper-asl-1.9.13-F1D5wzk1L8S3KNYbVxcWEw.jar
Apr 26, 2018 2:56:06 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.m2/repository/org/mockito/mockito-core/1.9.5/mockito-core-1.9.5.jar to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0426025604-3c8f0099/output/results/staging/mockito-core-1.9.5-b3PPBKVutgqqmWUG58EPxw.jar
Apr 26, 2018 2:56:06 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.m2/repository/io/netty/netty-handler-proxy/4.1.8.Final/netty-handler-proxy-4.1.8.Final.jar to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0426025604-3c8f0099/output/results/staging/netty-handler-proxy-4.1.8.Final-Zey48Fj4mlWtgpwIc7Osgg.jar
Apr 26, 2018 2:56:06 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.m2/repository/io/netty/netty-codec-socks/4.1.8.Final/netty-codec-socks-4.1.8.Final.jar to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0426025604-3c8f0099/output/results/staging/netty-codec-socks-4.1.8.Final-dfbCpCpgkEl1iwscd6OVeQ.jar
Apr 26, 2018 2:56:06 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.m2/repository/io/netty/netty-codec/4.1.8.Final/netty-codec-4.1.8.Final.jar to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0426025604-3c8f0099/output/results/staging/netty-codec-4.1.8.Final-Og5DJ4MB-fn1oSzjKqVU_w.jar
Apr 26, 2018 2:56:06 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.m2/repository/org/apache/commons/commons-compress/1.16.1/commons-compress-1.16.1.jar to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0426025604-3c8f0099/output/results/staging/commons-compress-1.16.1-NAljjWtr0jBC7qxc2X4lbA.jar
Apr 26, 2018 2:56:06 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.m2/repository/org/xerial/snappy/snappy-java/1.1.4/snappy-java-1.1.4.jar to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0426025604-3c8f0099/output/results/staging/snappy-java-1.1.4-SFNwbMuGq13aaoKVzeS1Tw.jar
Apr 26, 2018 2:56:06 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.m2/repository/org/threeten/threetenbp/1.3.3/threetenbp-1.3.3.jar to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0426025604-3c8f0099/output/results/staging/threetenbp-1.3.3-bEXFSgaAYiXSdUtR-98IjQ.jar
Apr 26, 2018 2:56:06 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.m2/repository/io/netty/netty-transport/4.1.8.Final/netty-transport-4.1.8.Final.jar to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0426025604-3c8f0099/output/results/staging/netty-transport-4.1.8.Final-PXWj5ZmqlznhCnqhkcOwDA.jar
Apr 26, 2018 2:56:06 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.m2/repository/commons-codec/commons-codec/1.3/commons-codec-1.3.jar to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0426025604-3c8f0099/output/results/staging/commons-codec-1.3-jhScEFN0HANzalLfg5dNzA.jar
Apr 26, 2018 2:56:06 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.m2/repository/io/netty/netty-buffer/4.1.8.Final/netty-buffer-4.1.8.Final.jar to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0426025604-3c8f0099/output/results/staging/netty-buffer-4.1.8.Final-iwny8IFMu0G1ln10Yx5VrA.jar
Apr 26, 2018 2:56:06 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.m2/repository/io/netty/netty-codec-http/4.1.8.Final/netty-codec-http-4.1.8.Final.jar to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0426025604-3c8f0099/output/results/staging/netty-codec-http-4.1.8.Final-uBsfxiZeL3IeVQNS0QTHUw.jar
Apr 26, 2018 2:56:06 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.m2/repository/commons-logging/commons-logging/1.2/commons-logging-1.2.jar to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0426025604-3c8f0099/output/results/staging/commons-logging-1.2-BAtLTY6siG9rSio70vMbAA.jar
Apr 26, 2018 2:56:06 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.m2/repository/org/objenesis/objenesis/2.6/objenesis-2.6.jar to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0426025604-3c8f0099/output/results/staging/objenesis-2.6-X_rD9RQFypspFZcKIks-jw.jar
Apr 26, 2018 2:56:06 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.m2/repository/com/google/protobuf/nano/protobuf-javanano/3.0.0-alpha-5/protobuf-javanano-3.0.0-alpha-5.jar to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0426025604-3c8f0099/output/results/staging/protobuf-javanano-3.0.0-alpha-5-SsS7fZe7brffHbAGUgRrnw.jar
Apr 26, 2018 2:56:06 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.m2/repository/io/netty/netty-resolver/4.1.8.Final/netty-resolver-4.1.8.Final.jar to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0426025604-3c8f0099/output/results/staging/netty-resolver-4.1.8.Final-ZBELwscrxRZgRR5DKH9siA.jar
Apr 26, 2018 2:56:06 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.gradle/caches/modules-2/files-2.1/com.esotericsoftware.reflectasm/reflectasm/1.07/76f11c94a53ee975a0d9154b325c408b210155bd/reflectasm-1.07-shaded.jar to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0426025604-3c8f0099/output/results/staging/reflectasm-1.07-shaded-IELCIoQPsh49E873w5ZYMQ.jar
Apr 26, 2018 2:56:06 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.m2/repository/com/google/code/gson/gson/2.7/gson-2.7.jar to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0426025604-3c8f0099/output/results/staging/gson-2.7-UTSiNQ9YiQ_7nbC0AEcZXQ.jar
Apr 26, 2018 2:56:06 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.m2/repository/org/apache/httpcomponents/httpcore/4.0.1/httpcore-4.0.1.jar to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0426025604-3c8f0099/output/results/staging/httpcore-4.0.1-bBlj_YrAxAwATJ6JLg13Aw.jar
Apr 26, 2018 2:56:06 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.m2/repository/com/esotericsoftware/minlog/minlog/1.2/minlog-1.2.jar to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0426025604-3c8f0099/output/results/staging/minlog-1.2-98-99jtn3wu_pMfLJgiFvA.jar
Apr 26, 2018 2:56:06 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.m2/repository/com/squareup/okio/okio/1.6.0/okio-1.6.0.jar to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0426025604-3c8f0099/output/results/staging/okio-1.6.0-Fk0cKMMjz24qkX1gN0xXGA.jar
Apr 26, 2018 2:56:06 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.m2/repository/org/yaml/snakeyaml/1.17/snakeyaml-1.17.jar to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0426025604-3c8f0099/output/results/staging/snakeyaml-1.17-q2IcPO4xYjatBKbw_k3RfA.jar
Apr 26, 2018 2:56:06 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.m2/repository/io/grpc/grpc-protobuf-nano/1.2.0/grpc-protobuf-nano-1.2.0.jar to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0426025604-3c8f0099/output/results/staging/grpc-protobuf-nano-1.2.0-_Q87bBdV6P9enz9PnkbLQg.jar
Apr 26, 2018 2:56:06 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/ws/src/sdks/java/io/google-cloud-platform/build/libs/beam-sdks-java-io-google-cloud-platform-2.5.0-SNAPSHOT-shaded.jar> to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0426025604-3c8f0099/output/results/staging/beam-sdks-java-io-google-cloud-platform-2.5.0-SNAPSHOT-shaded-jkQKGqo0UDlb1e2qtz2QqQ.jar
Apr 26, 2018 2:56:06 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.m2/repository/io/netty/netty-common/4.1.8.Final/netty-common-4.1.8.Final.jar to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0426025604-3c8f0099/output/results/staging/netty-common-4.1.8.Final-lafOW8vGsI6SRwZSmXNClg.jar
Apr 26, 2018 2:56:06 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/ws/src/sdks/java/io/google-cloud-platform/build/libs/beam-sdks-java-io-google-cloud-platform-2.5.0-SNAPSHOT-shaded-tests.jar> to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0426025604-3c8f0099/output/results/staging/beam-sdks-java-io-google-cloud-platform-2.5.0-SNAPSHOT-shaded-tests-LZ0ZNNIhNedCZgg5nS-a9A.jar
Apr 26, 2018 2:56:06 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.m2/repository/com/google/auto/value/auto-value/1.4/auto-value-1.4.jar to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0426025604-3c8f0099/output/results/staging/auto-value-1.4-_7tYdqNvCowycFIDpBenFw.jar
Apr 26, 2018 2:56:06 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.m2/repository/com/esotericsoftware/kryo/kryo/2.21/kryo-2.21.jar to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0426025604-3c8f0099/output/results/staging/kryo-2.21-olkSUBNMYGe-WXkdlwcytQ.jar
Apr 26, 2018 2:56:06 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.m2/repository/org/ow2/asm/asm/4.0/asm-4.0.jar to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0426025604-3c8f0099/output/results/staging/asm-4.0-Mi2PiMURGvYS34OMAZHNfg.jar
Apr 26, 2018 2:56:06 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.m2/repository/io/netty/netty-tcnative-boringssl-static/1.1.33.Fork26/netty-tcnative-boringssl-static-1.1.33.Fork26.jar to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0426025604-3c8f0099/output/results/staging/netty-tcnative-boringssl-static-1.1.33.Fork26-29XB0C44MyezMyoCB5cCbw.jar
Apr 26, 2018 2:56:06 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.m2/repository/com/google/guava/guava/20.0/guava-20.0.jar to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0426025604-3c8f0099/output/results/staging/guava-20.0-8yqKJSRiDb7Mn2v2ogwpPw.jar
Apr 26, 2018 2:56:06 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.m2/repository/com/squareup/okhttp/okhttp/2.5.0/okhttp-2.5.0.jar to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0426025604-3c8f0099/output/results/staging/okhttp-2.5.0-64v0X4G_nxfR_PsuymOqpg.jar
Apr 26, 2018 2:59:05 AM org.apache.beam.runners.dataflow.util.PackageUtil stageClasspathElements
INFO: Still staging 128 files
Apr 26, 2018 3:01:43 AM org.apache.beam.runners.dataflow.util.PackageUtil stageClasspathElements
INFO: Staging files complete: 0 files cached, 128 files newly uploaded
Apr 26, 2018 3:01:43 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding GenerateSequence/Read(BoundedCountingSource) as step s1
Apr 26, 2018 3:01:43 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding ParDo(CreateEntity) as step s2
Apr 26, 2018 3:01:43 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding DatastoreV1.Write/Convert to Mutation/Map as step s3
Apr 26, 2018 3:01:43 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding DatastoreV1.Write/Write Mutation to Datastore as step s4
Apr 26, 2018 3:01:43 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0426025604-3c8f0099/output/results/staging/
Apr 26, 2018 3:01:43 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <8775 bytes, hash GyGXNgJE7v7E2o6lVl8knA> to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0426025604-3c8f0099/output/results/staging/pipeline-GyGXNgJE7v7E2o6lVl8knA.pb
org.apache.beam.sdk.io.gcp.datastore.V1WriteIT > testE2EV1Write STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT
org.apache.beam.sdk.io.gcp.datastore.V1WriteIT > testE2EV1Write STANDARD_ERROR
Apr 26, 2018 3:01:44 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-04-25_20_01_43-6770291931397405151?project=apache-beam-testing
org.apache.beam.sdk.io.gcp.datastore.V1WriteIT > testE2EV1Write STANDARD_OUT
Submitted job: 2018-04-25_20_01_43-6770291931397405151
org.apache.beam.sdk.io.gcp.datastore.V1WriteIT > testE2EV1Write STANDARD_ERROR
Apr 26, 2018 3:01:44 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-04-25_20_01_43-6770291931397405151
Apr 26, 2018 3:01:44 AM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-04-25_20_01_43-6770291931397405151 with 0 expected assertions.
Apr 26, 2018 3:01:54 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T03:01:43.755Z: Autoscaling is enabled for job 2018-04-25_20_01_43-6770291931397405151. The number of workers will be between 1 and 1000.
Apr 26, 2018 3:01:54 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T03:01:43.785Z: Autoscaling was automatically enabled for job 2018-04-25_20_01_43-6770291931397405151.
Apr 26, 2018 3:01:54 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T03:01:46.945Z: Checking required Cloud APIs are enabled.
Apr 26, 2018 3:01:54 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T03:01:47.120Z: Checking permissions granted to controller Service Account.
Apr 26, 2018 3:01:54 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T03:01:51.295Z: Worker configuration: n1-standard-1 in us-central1-f.
Apr 26, 2018 3:01:54 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T03:01:51.634Z: Expanding CoGroupByKey operations into optimizable parts.
Apr 26, 2018 3:01:54 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T03:01:51.668Z: Expanding GroupByKey operations into optimizable parts.
Apr 26, 2018 3:01:54 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T03:01:51.694Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
Apr 26, 2018 3:01:54 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T03:01:51.775Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
Apr 26, 2018 3:01:54 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T03:01:51.801Z: Fusing consumer ParDo(CreateEntity) into GenerateSequence/Read(BoundedCountingSource)
Apr 26, 2018 3:01:54 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T03:01:51.829Z: Fusing consumer DatastoreV1.Write/Write Mutation to Datastore into DatastoreV1.Write/Convert to Mutation/Map
Apr 26, 2018 3:01:54 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T03:01:51.862Z: Fusing consumer DatastoreV1.Write/Convert to Mutation/Map into ParDo(CreateEntity)
Apr 26, 2018 3:01:54 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T03:01:52.167Z: Executing operation GenerateSequence/Read(BoundedCountingSource)+ParDo(CreateEntity)+DatastoreV1.Write/Convert to Mutation/Map+DatastoreV1.Write/Write Mutation to Datastore
Apr 26, 2018 3:01:54 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T03:01:52.236Z: Starting 1 workers in us-central1-f...
Apr 26, 2018 3:02:02 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T03:02:01.662Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
Apr 26, 2018 3:02:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T03:02:12.185Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
Apr 26, 2018 3:02:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T03:02:28.694Z: Workers have started successfully.
Apr 26, 2018 3:03:01 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T03:03:01.526Z: Cleaning up.
Apr 26, 2018 3:03:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T03:03:01.620Z: Stopping worker pool...
Apr 26, 2018 3:04:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T03:04:27.548Z: Autoscaling: Resized worker pool from 1 to 0.
Apr 26, 2018 3:04:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T03:04:27.572Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
Apr 26, 2018 3:04:35 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-04-25_20_01_43-6770291931397405151 finished with status DONE.
Apr 26, 2018 3:04:35 AM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-04-25_20_01_43-6770291931397405151. Found 0 success, 0 failures out of 0 expected assertions.
Apr 26, 2018 3:04:36 AM org.apache.beam.sdk.io.gcp.datastore.V1TestUtil$V1TestWriter flushBatch
INFO: Writing batch of 500 entities
Apr 26, 2018 3:04:36 AM org.apache.beam.sdk.io.gcp.datastore.V1TestUtil$V1TestWriter flushBatch
INFO: Successfully wrote 500 entities
Apr 26, 2018 3:04:37 AM org.apache.beam.sdk.io.gcp.datastore.V1TestUtil$V1TestWriter flushBatch
INFO: Writing batch of 500 entities
Apr 26, 2018 3:04:37 AM org.apache.beam.sdk.io.gcp.datastore.V1TestUtil$V1TestWriter flushBatch
INFO: Successfully wrote 500 entities
Apr 26, 2018 3:04:37 AM org.apache.beam.sdk.io.gcp.datastore.V1TestUtil deleteAllEntities
INFO: Successfully deleted 1000 entities
org.apache.beam.sdk.io.gcp.spanner.SpannerReadIT > testQuery FAILED
java.lang.NoClassDefFoundError: com/google/api/gax/retrying/ExceptionRetryAlgorithm
at java.lang.ClassLoader.defineClass1(Native Method)
at java.lang.ClassLoader.defineClass(ClassLoader.java:763)
at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)
at java.net.URLClassLoader.defineClass(URLClassLoader.java:467)
at java.net.URLClassLoader.access$100(URLClassLoader.java:73)
at java.net.URLClassLoader$1.run(URLClassLoader.java:368)
at java.net.URLClassLoader$1.run(URLClassLoader.java:362)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:361)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:338)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
at com.google.cloud.BaseService.<clinit>(BaseService.java:48)
at com.google.cloud.spanner.SpannerOptions$DefaultSpannerFactory.create(SpannerOptions.java:60)
at com.google.cloud.spanner.SpannerOptions$DefaultSpannerFactory.create(SpannerOptions.java:55)
at com.google.cloud.ServiceOptions.getService(ServiceOptions.java:426)
at org.apache.beam.sdk.io.gcp.spanner.SpannerReadIT.setUp(SpannerReadIT.java:90)
Caused by:
java.lang.ClassNotFoundException: com.google.api.gax.retrying.ExceptionRetryAlgorithm
at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:338)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
... 17 more
java.lang.NullPointerException
at org.apache.beam.sdk.io.gcp.spanner.SpannerReadIT.tearDown(SpannerReadIT.java:198)
Gradle Test Executor 130 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:googleCloudPlatformIntegrationTest FAILED
org.apache.beam.sdk.io.gcp.spanner.SpannerReadIT > testRead FAILED
java.lang.NoClassDefFoundError: Could not initialize class com.google.cloud.spanner.SpannerImpl
at com.google.cloud.spanner.SpannerOptions$DefaultSpannerFactory.create(SpannerOptions.java:60)
at com.google.cloud.spanner.SpannerOptions$DefaultSpannerFactory.create(SpannerOptions.java:55)
at com.google.cloud.ServiceOptions.getService(ServiceOptions.java:426)
at org.apache.beam.sdk.io.gcp.spanner.SpannerReadIT.setUp(SpannerReadIT.java:90)
java.lang.NullPointerException
at org.apache.beam.sdk.io.gcp.spanner.SpannerReadIT.tearDown(SpannerReadIT.java:198)
12 tests completed, 3 failed
Finished generating test XML results (0.006 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/ws/src/runners/google-cloud-dataflow-java/build/test-results/googleCloudPlatformIntegrationTest>
Generating HTML test report...
Finished generating test html results (0.006 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/googleCloudPlatformIntegrationTest>
:beam-runners-google-cloud-dataflow-java:googleCloudPlatformIntegrationTest (Thread[Task worker for ':',5,main]) completed. Took 28 mins 0.975 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:googleCloudPlatformIntegrationTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/googleCloudPlatformIntegrationTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 57m 4s
546 actionable tasks: 541 executed, 5 from cache
Publishing build scan...
https://gradle.com/s/ou6foqlnjrm42
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user sidhom@google.com
Not sending mail to unregistered user swegner@google.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user kedin@google.com
Not sending mail to unregistered user kirpichov@google.com
Not sending mail to unregistered user relax@relax-macbookpro2.roam.corp.google.com
Not sending mail to unregistered user ekirpichov@gmail.com