You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2018/04/25 20:55:17 UTC
Build failed in Jenkins: beam_PostCommit_Java_GradleBuild #188
See <https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/188/display/redirect?page=changes>
Changes:
[aaltay] [BEAM-3255] Enabling gradle-based release process (#5187)
------------------------------------------
[...truncated 19.20 MB...]
Apr 25, 2018 8:51:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:51:26.205Z: Fusing consumer PAssert$3/CreateActual/GatherPanes/GroupByKey/GroupByWindow into PAssert$3/CreateActual/GatherPanes/GroupByKey/Read
Apr 25, 2018 8:51:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:51:26.238Z: Fusing consumer PAssert$3/CreateActual/GatherPanes/GroupByKey/Reify into PAssert$3/CreateActual/GatherPanes/Window.Into()/Window.Assign
Apr 25, 2018 8:51:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:51:26.270Z: Fusing consumer PAssert$3/CreateActual/GatherPanes/GroupByKey/Write into PAssert$3/CreateActual/GatherPanes/GroupByKey/Reify
Apr 25, 2018 8:51:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:51:26.315Z: Fusing consumer PAssert$3/CreateActual/GatherPanes/Window.Into()/Window.Assign into PAssert$3/CreateActual/GatherPanes/WithKeys/AddKeys/Map
Apr 25, 2018 8:51:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:51:26.340Z: Unzipping flatten s18-u63 for input s19.output-c61
Apr 25, 2018 8:51:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:51:26.390Z: Fusing unzipped copy of PAssert$3/CreateActual/GatherPanes/Reify.Window/ParDo(Anonymous), through flatten s18-u63, into producer PAssert$3/CreateActual/FilterActuals/Window.Assign
Apr 25, 2018 8:51:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:51:26.415Z: Fusing consumer PAssert$3/CreateActual/GatherPanes/Reify.Window/ParDo(Anonymous) into PAssert$3/CreateActual/FilterActuals/Window.Assign
Apr 25, 2018 8:51:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:51:26.447Z: Fusing consumer PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
Apr 25, 2018 8:51:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:51:26.487Z: Fusing consumer PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
Apr 25, 2018 8:51:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:51:26.514Z: Fusing consumer PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
Apr 25, 2018 8:51:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:51:26.543Z: Fusing consumer PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
Apr 25, 2018 8:51:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:51:26.579Z: Fusing consumer PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
Apr 25, 2018 8:51:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:51:26.615Z: Fusing consumer PAssert$3/CreateActual/RewindowActuals/Window.Assign into PAssert$3/CreateActual/Flatten.Iterables/FlattenIterables/FlatMap
Apr 25, 2018 8:51:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:51:26.643Z: Fusing consumer PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
Apr 25, 2018 8:51:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:51:26.670Z: Fusing consumer PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
Apr 25, 2018 8:51:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:51:26.704Z: Fusing consumer PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
Apr 25, 2018 8:51:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:51:26.730Z: Fusing consumer PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
Apr 25, 2018 8:51:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:51:26.759Z: Fusing consumer PAssert$3/CreateActual/ParDo(Anonymous) into PAssert$3/CreateActual/RewindowActuals/Window.Assign
Apr 25, 2018 8:51:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:51:26.790Z: Fusing consumer PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into PAssert$3/CreateActual/ParDo(Anonymous)
Apr 25, 2018 8:51:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:51:26.847Z: Fusing consumer Combine.globally(Count)/ProduceDefault into Combine.globally(Count)/CreateVoid/Read(CreateSource)
Apr 25, 2018 8:51:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:51:26.874Z: Fusing consumer Combine.globally(Count)/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow) into Combine.globally(Count)/Values/Values/Map
Apr 25, 2018 8:51:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:51:26.908Z: Fusing consumer Combine.globally(Count)/Combine.perKey(Count)/Combine.GroupedValues into Combine.globally(Count)/Combine.perKey(Count)/GroupByKey/Read
Apr 25, 2018 8:51:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:51:26.937Z: Fusing consumer Combine.globally(Count)/Combine.perKey(Count)/GroupByKey+Combine.globally(Count)/Combine.perKey(Count)/Combine.GroupedValues/Partial into Combine.globally(Count)/WithKeys/AddKeys/Map
Apr 25, 2018 8:51:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:51:26.967Z: Fusing consumer DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/GroupByWindow into DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/Read
Apr 25, 2018 8:51:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:51:26.998Z: Fusing consumer Combine.globally(Count)/Combine.perKey(Count)/GroupByKey/Reify into Combine.globally(Count)/Combine.perKey(Count)/GroupByKey+Combine.globally(Count)/Combine.perKey(Count)/Combine.GroupedValues/Partial
Apr 25, 2018 8:51:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:51:27.033Z: Fusing consumer Combine.globally(Count)/WithKeys/AddKeys/Map into DatastoreV1.Read/Read
Apr 25, 2018 8:51:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:51:27.064Z: Fusing consumer DatastoreV1.Read/Reshuffle/Pair with random key into DatastoreV1.Read/Split
Apr 25, 2018 8:51:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:51:27.093Z: Fusing consumer DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/Write into DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/Reify
Apr 25, 2018 8:51:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:51:27.123Z: Fusing consumer DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/Reify into DatastoreV1.Read/Reshuffle/Reshuffle/Window.Into()/Window.Assign
Apr 25, 2018 8:51:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:51:27.157Z: Fusing consumer Combine.globally(Count)/Values/Values/Map into Combine.globally(Count)/Combine.perKey(Count)/Combine.GroupedValues/Extract
Apr 25, 2018 8:51:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:51:27.189Z: Fusing consumer DatastoreV1.Read/Split into DatastoreV1.Read/ParDo(GqlQueryTranslate)
Apr 25, 2018 8:51:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:51:27.219Z: Fusing consumer DatastoreV1.Read/Reshuffle/Reshuffle/Window.Into()/Window.Assign into DatastoreV1.Read/Reshuffle/Pair with random key
Apr 25, 2018 8:51:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:51:27.259Z: Fusing consumer Combine.globally(Count)/Combine.perKey(Count)/GroupByKey/Write into Combine.globally(Count)/Combine.perKey(Count)/GroupByKey/Reify
Apr 25, 2018 8:51:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:51:27.297Z: Fusing consumer DatastoreV1.Read/ParDo(GqlQueryTranslate) into DatastoreV1.Read/Create.OfValueProvider/Create.Values/Read(CreateSource)
Apr 25, 2018 8:51:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:51:27.332Z: Fusing consumer DatastoreV1.Read/Read into DatastoreV1.Read/Reshuffle/Values/Values/Map
Apr 25, 2018 8:51:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:51:27.364Z: Fusing consumer DatastoreV1.Read/Reshuffle/Values/Values/Map into DatastoreV1.Read/Reshuffle/Reshuffle/ExpandIterable
Apr 25, 2018 8:51:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:51:27.412Z: Fusing consumer DatastoreV1.Read/Reshuffle/Reshuffle/ExpandIterable into DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/GroupByWindow
Apr 25, 2018 8:51:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:51:27.480Z: Fusing consumer Combine.globally(Count)/Combine.perKey(Count)/Combine.GroupedValues/Extract into Combine.globally(Count)/Combine.perKey(Count)/Combine.GroupedValues
Apr 25, 2018 8:51:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:51:27.540Z: Fusing consumer PAssert$3/RunChecks into PAssert$3/WindowToken/Window.Assign
Apr 25, 2018 8:51:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:51:27.574Z: Fusing consumer PAssert$3/WindowToken/Window.Assign into PAssert$3/Create.Values/Read(CreateSource)
Apr 25, 2018 8:51:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:51:27.619Z: Fusing consumer PAssert$3/VerifyAssertions/ParDo(DefaultConclude) into PAssert$3/RunChecks
Apr 25, 2018 8:51:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:51:28.019Z: Executing operation Combine.globally(Count)/Combine.perKey(Count)/GroupByKey/Create
Apr 25, 2018 8:51:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:51:28.051Z: Executing operation PAssert$3/CreateActual/GatherPanes/GroupByKey/Create
Apr 25, 2018 8:51:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:51:28.093Z: Executing operation PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
Apr 25, 2018 8:51:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:51:28.101Z: Starting 1 workers in us-central1-f...
Apr 25, 2018 8:51:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:51:28.127Z: Executing operation PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
Apr 25, 2018 8:51:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:51:28.147Z: Executing operation DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/Create
Apr 25, 2018 8:51:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:51:35.508Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
Apr 25, 2018 8:51:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:51:35.702Z: Executing operation DatastoreV1.Read/Create.OfValueProvider/Create.Values/Read(CreateSource)+DatastoreV1.Read/ParDo(GqlQueryTranslate)+DatastoreV1.Read/Split+DatastoreV1.Read/Reshuffle/Pair with random key+DatastoreV1.Read/Reshuffle/Reshuffle/Window.Into()/Window.Assign+DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/Reify+DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/Write
Apr 25, 2018 8:51:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:51:41.078Z: Autoscaling: Resizing worker pool from 1 to 5.
Apr 25, 2018 8:51:55 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:51:52.883Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
Apr 25, 2018 8:51:55 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:51:52.909Z: Resized worker pool to 1, though goal was 5. This could be a quota issue.
Apr 25, 2018 8:52:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:52:03.442Z: Autoscaling: Raised the number of workers to 5 based on the rate of progress in the currently running step(s).
Apr 25, 2018 8:52:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:52:09.417Z: Workers have started successfully.
Apr 25, 2018 8:52:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:52:32.360Z: Executing operation DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/Close
Apr 25, 2018 8:52:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:52:32.450Z: Executing operation DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/Read+DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/GroupByWindow+DatastoreV1.Read/Reshuffle/Reshuffle/ExpandIterable+DatastoreV1.Read/Reshuffle/Values/Values/Map+DatastoreV1.Read/Read+Combine.globally(Count)/WithKeys/AddKeys/Map+Combine.globally(Count)/Combine.perKey(Count)/GroupByKey+Combine.globally(Count)/Combine.perKey(Count)/Combine.GroupedValues/Partial+Combine.globally(Count)/Combine.perKey(Count)/GroupByKey/Reify+Combine.globally(Count)/Combine.perKey(Count)/GroupByKey/Write
Apr 25, 2018 8:52:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:52:40.171Z: Executing operation Combine.globally(Count)/Combine.perKey(Count)/GroupByKey/Close
Apr 25, 2018 8:52:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:52:40.256Z: Executing operation Combine.globally(Count)/Combine.perKey(Count)/GroupByKey/Read+Combine.globally(Count)/Combine.perKey(Count)/Combine.GroupedValues+Combine.globally(Count)/Combine.perKey(Count)/Combine.GroupedValues/Extract+Combine.globally(Count)/Values/Values/Map+PAssert$3/CreateActual/FilterActuals/Window.Assign+PAssert$3/CreateActual/GatherPanes/Reify.Window/ParDo(Anonymous)+PAssert$3/CreateActual/GatherPanes/WithKeys/AddKeys/Map+PAssert$3/CreateActual/GatherPanes/Window.Into()/Window.Assign+PAssert$3/CreateActual/GatherPanes/GroupByKey/Reify+PAssert$3/CreateActual/GatherPanes/GroupByKey/Write+Combine.globally(Count)/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow)
Apr 25, 2018 8:52:47 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:52:46.397Z: Executing operation Combine.globally(Count)/View.AsIterable/CreateDataflowView
Apr 25, 2018 8:52:47 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:52:46.570Z: Executing operation Combine.globally(Count)/CreateVoid/Read(CreateSource)+Combine.globally(Count)/ProduceDefault+PAssert$3/CreateActual/FilterActuals/Window.Assign+PAssert$3/CreateActual/GatherPanes/Reify.Window/ParDo(Anonymous)+PAssert$3/CreateActual/GatherPanes/WithKeys/AddKeys/Map+PAssert$3/CreateActual/GatherPanes/Window.Into()/Window.Assign+PAssert$3/CreateActual/GatherPanes/GroupByKey/Reify+PAssert$3/CreateActual/GatherPanes/GroupByKey/Write
Apr 25, 2018 8:52:50 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:52:49.460Z: Executing operation PAssert$3/CreateActual/GatherPanes/GroupByKey/Close
Apr 25, 2018 8:52:50 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:52:49.554Z: Executing operation PAssert$3/CreateActual/GatherPanes/GroupByKey/Read+PAssert$3/CreateActual/GatherPanes/GroupByKey/GroupByWindow+PAssert$3/CreateActual/GatherPanes/Values/Values/Map+PAssert$3/CreateActual/ExtractPane/Map+PAssert$3/CreateActual/Flatten.Iterables/FlattenIterables/FlatMap+PAssert$3/CreateActual/RewindowActuals/Window.Assign+PAssert$3/CreateActual/ParDo(Anonymous)+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
Apr 25, 2018 8:52:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:52:51.088Z: Executing operation PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
Apr 25, 2018 8:52:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:52:51.180Z: Executing operation PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
Apr 25, 2018 8:52:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:52:52.606Z: Executing operation PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
Apr 25, 2018 8:52:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:52:52.698Z: Executing operation PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
Apr 25, 2018 8:52:57 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:52:56.443Z: Executing operation PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
Apr 25, 2018 8:52:57 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:52:56.586Z: Executing operation PAssert$3/Create.Values/Read(CreateSource)+PAssert$3/WindowToken/Window.Assign+PAssert$3/RunChecks+PAssert$3/VerifyAssertions/ParDo(DefaultConclude)
Apr 25, 2018 8:52:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:52:57.876Z: Cleaning up.
Apr 25, 2018 8:52:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:52:58.046Z: Stopping worker pool...
Apr 25, 2018 8:54:35 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:54:33.204Z: Autoscaling: Resized worker pool from 5 to 0.
Apr 25, 2018 8:54:35 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:54:33.314Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
Apr 25, 2018 8:54:43 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-04-25_13_51_16-6592967258341647802 finished with status DONE.
Apr 25, 2018 8:54:43 PM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-04-25_13_51_16-6592967258341647802. Found 1 success, 0 failures out of 1 expected assertions.
Apr 25, 2018 8:54:43 PM org.apache.beam.sdk.io.gcp.datastore.V1TestUtil$V1TestWriter flushBatch
INFO: Writing batch of 500 entities
Apr 25, 2018 8:54:44 PM org.apache.beam.sdk.io.gcp.datastore.V1TestUtil$V1TestWriter flushBatch
INFO: Successfully wrote 500 entities
Apr 25, 2018 8:54:44 PM org.apache.beam.sdk.io.gcp.datastore.V1TestUtil$V1TestWriter flushBatch
INFO: Writing batch of 500 entities
Apr 25, 2018 8:54:45 PM org.apache.beam.sdk.io.gcp.datastore.V1TestUtil$V1TestWriter flushBatch
INFO: Successfully wrote 500 entities
Apr 25, 2018 8:54:45 PM org.apache.beam.sdk.io.gcp.datastore.V1TestUtil deleteAllEntities
INFO: Successfully deleted 1000 entities
org.apache.beam.sdk.io.gcp.datastore.SplitQueryFnIT > testSplitQueryFnWithLargeDataset STANDARD_ERROR
Apr 25, 2018 8:54:45 PM org.apache.beam.sdk.transforms.DoFnTester of
WARNING: Your tests use DoFnTester, which may not exercise DoFns correctly. Please use TestPipeline instead.
Apr 25, 2018 8:54:45 PM org.apache.beam.sdk.io.gcp.datastore.DatastoreV1$Read getEstimatedSizeBytes
INFO: Latest stats timestamp for kind sort_1G is 1524555829000000
Apr 25, 2018 8:54:46 PM org.apache.beam.sdk.io.gcp.datastore.DatastoreV1$Read getEstimatedNumSplits
INFO: Estimated size bytes for the query is: 2130000000
Apr 25, 2018 8:54:46 PM org.apache.beam.sdk.io.gcp.datastore.DatastoreV1$Read$SplitQueryFn processElement
INFO: Splitting the query into 32 splits
org.apache.beam.sdk.io.gcp.datastore.SplitQueryFnIT > testSplitQueryFnWithSmallDataset STANDARD_ERROR
Apr 25, 2018 8:54:46 PM org.apache.beam.sdk.transforms.DoFnTester of
WARNING: Your tests use DoFnTester, which may not exercise DoFns correctly. Please use TestPipeline instead.
Apr 25, 2018 8:54:46 PM org.apache.beam.sdk.io.gcp.datastore.DatastoreV1$Read getEstimatedSizeBytes
INFO: Latest stats timestamp for kind shakespeare is 1524555829000000
Apr 25, 2018 8:54:46 PM org.apache.beam.sdk.io.gcp.datastore.DatastoreV1$Read getEstimatedNumSplits
INFO: Estimated size bytes for the query is: 26383451
Apr 25, 2018 8:54:46 PM org.apache.beam.sdk.io.gcp.datastore.DatastoreV1$Read$SplitQueryFn processElement
INFO: Splitting the query into 12 splits
Gradle Test Executor 128 finished executing tests.
org.apache.beam.sdk.io.gcp.spanner.SpannerWriteIT > testWrite FAILED
java.lang.NoClassDefFoundError: com/google/api/gax/retrying/ExceptionRetryAlgorithm
at java.lang.ClassLoader.defineClass1(Native Method)
at java.lang.ClassLoader.defineClass(ClassLoader.java:763)
at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)
at java.net.URLClassLoader.defineClass(URLClassLoader.java:467)
at java.net.URLClassLoader.access$100(URLClassLoader.java:73)
at java.net.URLClassLoader$1.run(URLClassLoader.java:368)
at java.net.URLClassLoader$1.run(URLClassLoader.java:362)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:361)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:338)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
at com.google.cloud.BaseService.<clinit>(BaseService.java:48)
at com.google.cloud.spanner.SpannerOptions$DefaultSpannerFactory.create(SpannerOptions.java:60)
at com.google.cloud.spanner.SpannerOptions$DefaultSpannerFactory.create(SpannerOptions.java:55)
at com.google.cloud.ServiceOptions.getService(ServiceOptions.java:426)
at org.apache.beam.sdk.io.gcp.spanner.SpannerWriteIT.setUp(SpannerWriteIT.java:91)
Caused by:
java.lang.ClassNotFoundException: com.google.api.gax.retrying.ExceptionRetryAlgorithm
at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:338)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
... 17 more
java.lang.NullPointerException
at org.apache.beam.sdk.io.gcp.spanner.SpannerWriteIT.tearDown(SpannerWriteIT.java:148)
12 tests completed, 3 failed
Finished generating test XML results (0.007 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/ws/src/runners/google-cloud-dataflow-java/build/test-results/googleCloudPlatformIntegrationTest>
Generating HTML test report...
Finished generating test html results (0.009 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/googleCloudPlatformIntegrationTest>
:beam-runners-google-cloud-dataflow-java:googleCloudPlatformIntegrationTest FAILED
:beam-runners-google-cloud-dataflow-java:googleCloudPlatformIntegrationTest (Thread[Task worker for ':',5,main]) completed. Took 16 mins 36.672 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:googleCloudPlatformIntegrationTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/googleCloudPlatformIntegrationTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.6/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 54m 14s
541 actionable tasks: 536 executed, 5 from cache
Publishing build scan...
https://gradle.com/s/w5lodlqj7qfv4
Build cache (/home/jenkins/.gradle/caches/build-cache-1) has not been cleaned up in 1 days
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user kedin@google.com
Not sending mail to unregistered user kirpichov@google.com
Not sending mail to unregistered user relax@relax-macbookpro2.roam.corp.google.com
Not sending mail to unregistered user aaltay@gmail.com
Build failed in Jenkins: beam_PostCommit_Java_GradleBuild #192
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/192/display/redirect?page=changes>
Changes:
[swegner] Upgrade Gradle to 4.7
------------------------------------------
[...truncated 19.83 MB...]
Apr 26, 2018 2:52:00 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:51:56.072Z: Fusing consumer PAssert$3/CreateActual/GatherPanes/Reify.Window/ParDo(Anonymous) into PAssert$3/CreateActual/FilterActuals/Window.Assign
Apr 26, 2018 2:52:00 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:51:56.106Z: Fusing consumer PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
Apr 26, 2018 2:52:00 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:51:56.144Z: Fusing consumer PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
Apr 26, 2018 2:52:00 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:51:56.178Z: Fusing consumer PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
Apr 26, 2018 2:52:00 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:51:56.222Z: Fusing consumer PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
Apr 26, 2018 2:52:00 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:51:56.257Z: Fusing consumer PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
Apr 26, 2018 2:52:00 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:51:56.285Z: Fusing consumer PAssert$3/CreateActual/RewindowActuals/Window.Assign into PAssert$3/CreateActual/Flatten.Iterables/FlattenIterables/FlatMap
Apr 26, 2018 2:52:00 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:51:56.323Z: Fusing consumer PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
Apr 26, 2018 2:52:00 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:51:56.352Z: Fusing consumer PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
Apr 26, 2018 2:52:00 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:51:56.386Z: Fusing consumer PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
Apr 26, 2018 2:52:00 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:51:56.420Z: Fusing consumer PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
Apr 26, 2018 2:52:00 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:51:56.461Z: Fusing consumer PAssert$3/CreateActual/ParDo(Anonymous) into PAssert$3/CreateActual/RewindowActuals/Window.Assign
Apr 26, 2018 2:52:00 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:51:56.500Z: Fusing consumer PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into PAssert$3/CreateActual/ParDo(Anonymous)
Apr 26, 2018 2:52:00 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:51:56.534Z: Fusing consumer Combine.globally(Count)/ProduceDefault into Combine.globally(Count)/CreateVoid/Read(CreateSource)
Apr 26, 2018 2:52:00 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:51:56.558Z: Fusing consumer Combine.globally(Count)/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow) into Combine.globally(Count)/Values/Values/Map
Apr 26, 2018 2:52:00 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:51:56.598Z: Fusing consumer Combine.globally(Count)/Combine.perKey(Count)/Combine.GroupedValues into Combine.globally(Count)/Combine.perKey(Count)/GroupByKey/Read
Apr 26, 2018 2:52:00 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:51:56.634Z: Fusing consumer Combine.globally(Count)/Combine.perKey(Count)/GroupByKey+Combine.globally(Count)/Combine.perKey(Count)/Combine.GroupedValues/Partial into Combine.globally(Count)/WithKeys/AddKeys/Map
Apr 26, 2018 2:52:00 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:51:56.661Z: Fusing consumer DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/GroupByWindow into DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/Read
Apr 26, 2018 2:52:00 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:51:56.696Z: Fusing consumer Combine.globally(Count)/Combine.perKey(Count)/GroupByKey/Reify into Combine.globally(Count)/Combine.perKey(Count)/GroupByKey+Combine.globally(Count)/Combine.perKey(Count)/Combine.GroupedValues/Partial
Apr 26, 2018 2:52:00 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:51:56.741Z: Fusing consumer Combine.globally(Count)/WithKeys/AddKeys/Map into DatastoreV1.Read/Read
Apr 26, 2018 2:52:00 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:51:56.774Z: Fusing consumer DatastoreV1.Read/Reshuffle/Pair with random key into DatastoreV1.Read/Split
Apr 26, 2018 2:52:00 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:51:56.806Z: Fusing consumer DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/Write into DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/Reify
Apr 26, 2018 2:52:00 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:51:56.834Z: Fusing consumer DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/Reify into DatastoreV1.Read/Reshuffle/Reshuffle/Window.Into()/Window.Assign
Apr 26, 2018 2:52:00 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:51:56.863Z: Fusing consumer Combine.globally(Count)/Values/Values/Map into Combine.globally(Count)/Combine.perKey(Count)/Combine.GroupedValues/Extract
Apr 26, 2018 2:52:00 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:51:56.884Z: Fusing consumer DatastoreV1.Read/Split into DatastoreV1.Read/ParDo(GqlQueryTranslate)
Apr 26, 2018 2:52:00 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:51:56.915Z: Fusing consumer DatastoreV1.Read/Reshuffle/Reshuffle/Window.Into()/Window.Assign into DatastoreV1.Read/Reshuffle/Pair with random key
Apr 26, 2018 2:52:00 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:51:56.942Z: Fusing consumer Combine.globally(Count)/Combine.perKey(Count)/GroupByKey/Write into Combine.globally(Count)/Combine.perKey(Count)/GroupByKey/Reify
Apr 26, 2018 2:52:00 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:51:56.976Z: Fusing consumer DatastoreV1.Read/ParDo(GqlQueryTranslate) into DatastoreV1.Read/Create.OfValueProvider/Create.Values/Read(CreateSource)
Apr 26, 2018 2:52:00 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:51:57.012Z: Fusing consumer DatastoreV1.Read/Read into DatastoreV1.Read/Reshuffle/Values/Values/Map
Apr 26, 2018 2:52:00 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:51:57.038Z: Fusing consumer DatastoreV1.Read/Reshuffle/Values/Values/Map into DatastoreV1.Read/Reshuffle/Reshuffle/ExpandIterable
Apr 26, 2018 2:52:00 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:51:57.073Z: Fusing consumer DatastoreV1.Read/Reshuffle/Reshuffle/ExpandIterable into DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/GroupByWindow
Apr 26, 2018 2:52:00 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:51:57.102Z: Fusing consumer Combine.globally(Count)/Combine.perKey(Count)/Combine.GroupedValues/Extract into Combine.globally(Count)/Combine.perKey(Count)/Combine.GroupedValues
Apr 26, 2018 2:52:00 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:51:57.139Z: Fusing consumer PAssert$3/RunChecks into PAssert$3/WindowToken/Window.Assign
Apr 26, 2018 2:52:00 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:51:57.170Z: Fusing consumer PAssert$3/WindowToken/Window.Assign into PAssert$3/Create.Values/Read(CreateSource)
Apr 26, 2018 2:52:00 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:51:57.200Z: Fusing consumer PAssert$3/VerifyAssertions/ParDo(DefaultConclude) into PAssert$3/RunChecks
Apr 26, 2018 2:52:00 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:51:57.592Z: Executing operation Combine.globally(Count)/Combine.perKey(Count)/GroupByKey/Create
Apr 26, 2018 2:52:00 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:51:57.623Z: Executing operation PAssert$3/CreateActual/GatherPanes/GroupByKey/Create
Apr 26, 2018 2:52:00 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:51:57.655Z: Executing operation PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
Apr 26, 2018 2:52:00 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:51:57.666Z: Starting 1 workers in us-central1-f...
Apr 26, 2018 2:52:00 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:51:57.690Z: Executing operation PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
Apr 26, 2018 2:52:00 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:51:57.713Z: Executing operation DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/Create
Apr 26, 2018 2:52:07 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:52:06.676Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
Apr 26, 2018 2:52:07 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:52:06.909Z: Executing operation DatastoreV1.Read/Create.OfValueProvider/Create.Values/Read(CreateSource)+DatastoreV1.Read/ParDo(GqlQueryTranslate)+DatastoreV1.Read/Split+DatastoreV1.Read/Reshuffle/Pair with random key+DatastoreV1.Read/Reshuffle/Reshuffle/Window.Into()/Window.Assign+DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/Reify+DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/Write
Apr 26, 2018 2:52:14 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:52:12.259Z: Autoscaling: Resizing worker pool from 1 to 5.
Apr 26, 2018 2:52:20 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:52:18.938Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
Apr 26, 2018 2:52:20 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:52:18.978Z: Resized worker pool to 1, though goal was 5. This could be a quota issue.
Apr 26, 2018 2:52:29 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:52:29.567Z: Autoscaling: Raised the number of workers to 3 based on the rate of progress in the currently running step(s).
Apr 26, 2018 2:52:29 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:52:29.598Z: Resized worker pool to 3, though goal was 5. This could be a quota issue.
Apr 26, 2018 2:52:41 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:52:40.209Z: Autoscaling: Raised the number of workers to 4 based on the rate of progress in the currently running step(s).
Apr 26, 2018 2:52:41 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:52:40.397Z: Resized worker pool to 4, though goal was 5. This could be a quota issue.
Apr 26, 2018 2:52:41 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:52:40.979Z: Workers have started successfully.
Apr 26, 2018 2:52:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:52:50.936Z: Autoscaling: Raised the number of workers to 5 based on the rate of progress in the currently running step(s).
Apr 26, 2018 2:53:04 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:53:03.345Z: Executing operation DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/Close
Apr 26, 2018 2:53:04 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:53:03.450Z: Executing operation DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/Read+DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/GroupByWindow+DatastoreV1.Read/Reshuffle/Reshuffle/ExpandIterable+DatastoreV1.Read/Reshuffle/Values/Values/Map+DatastoreV1.Read/Read+Combine.globally(Count)/WithKeys/AddKeys/Map+Combine.globally(Count)/Combine.perKey(Count)/GroupByKey+Combine.globally(Count)/Combine.perKey(Count)/Combine.GroupedValues/Partial+Combine.globally(Count)/Combine.perKey(Count)/GroupByKey/Reify+Combine.globally(Count)/Combine.perKey(Count)/GroupByKey/Write
Apr 26, 2018 2:53:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:53:13.256Z: Executing operation Combine.globally(Count)/Combine.perKey(Count)/GroupByKey/Close
Apr 26, 2018 2:53:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:53:13.386Z: Executing operation Combine.globally(Count)/Combine.perKey(Count)/GroupByKey/Read+Combine.globally(Count)/Combine.perKey(Count)/Combine.GroupedValues+Combine.globally(Count)/Combine.perKey(Count)/Combine.GroupedValues/Extract+Combine.globally(Count)/Values/Values/Map+PAssert$3/CreateActual/FilterActuals/Window.Assign+PAssert$3/CreateActual/GatherPanes/Reify.Window/ParDo(Anonymous)+PAssert$3/CreateActual/GatherPanes/WithKeys/AddKeys/Map+PAssert$3/CreateActual/GatherPanes/Window.Into()/Window.Assign+PAssert$3/CreateActual/GatherPanes/GroupByKey/Reify+PAssert$3/CreateActual/GatherPanes/GroupByKey/Write+Combine.globally(Count)/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow)
Apr 26, 2018 2:53:18 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:53:17.714Z: Executing operation Combine.globally(Count)/View.AsIterable/CreateDataflowView
Apr 26, 2018 2:53:18 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:53:17.887Z: Executing operation Combine.globally(Count)/CreateVoid/Read(CreateSource)+Combine.globally(Count)/ProduceDefault+PAssert$3/CreateActual/FilterActuals/Window.Assign+PAssert$3/CreateActual/GatherPanes/Reify.Window/ParDo(Anonymous)+PAssert$3/CreateActual/GatherPanes/WithKeys/AddKeys/Map+PAssert$3/CreateActual/GatherPanes/Window.Into()/Window.Assign+PAssert$3/CreateActual/GatherPanes/GroupByKey/Reify+PAssert$3/CreateActual/GatherPanes/GroupByKey/Write
Apr 26, 2018 2:53:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:53:20.740Z: Executing operation PAssert$3/CreateActual/GatherPanes/GroupByKey/Close
Apr 26, 2018 2:53:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:53:20.823Z: Executing operation PAssert$3/CreateActual/GatherPanes/GroupByKey/Read+PAssert$3/CreateActual/GatherPanes/GroupByKey/GroupByWindow+PAssert$3/CreateActual/GatherPanes/Values/Values/Map+PAssert$3/CreateActual/ExtractPane/Map+PAssert$3/CreateActual/Flatten.Iterables/FlattenIterables/FlatMap+PAssert$3/CreateActual/RewindowActuals/Window.Assign+PAssert$3/CreateActual/ParDo(Anonymous)+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
Apr 26, 2018 2:53:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:53:26.150Z: Executing operation PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
Apr 26, 2018 2:53:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:53:26.238Z: Executing operation PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
Apr 26, 2018 2:53:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:53:26.763Z: Executing operation PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
Apr 26, 2018 2:53:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:53:26.851Z: Executing operation PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
Apr 26, 2018 2:53:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:53:30.629Z: Executing operation PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
Apr 26, 2018 2:53:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:53:30.815Z: Executing operation PAssert$3/Create.Values/Read(CreateSource)+PAssert$3/WindowToken/Window.Assign+PAssert$3/RunChecks+PAssert$3/VerifyAssertions/ParDo(DefaultConclude)
Apr 26, 2018 2:53:33 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:53:32.882Z: Cleaning up.
Apr 26, 2018 2:53:33 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:53:33.158Z: Stopping worker pool...
Apr 26, 2018 2:55:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:55:15.738Z: Autoscaling: Resized worker pool from 5 to 0.
Apr 26, 2018 2:55:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:55:15.884Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
Apr 26, 2018 2:55:25 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-04-25_19_51_47-7337937995686721741 finished with status DONE.
Apr 26, 2018 2:55:25 AM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-04-25_19_51_47-7337937995686721741. Found 1 success, 0 failures out of 1 expected assertions.
Apr 26, 2018 2:55:26 AM org.apache.beam.sdk.io.gcp.datastore.V1TestUtil$V1TestWriter flushBatch
INFO: Writing batch of 500 entities
Apr 26, 2018 2:55:26 AM org.apache.beam.sdk.io.gcp.datastore.V1TestUtil$V1TestWriter flushBatch
INFO: Successfully wrote 500 entities
Apr 26, 2018 2:55:27 AM org.apache.beam.sdk.io.gcp.datastore.V1TestUtil$V1TestWriter flushBatch
INFO: Writing batch of 500 entities
Apr 26, 2018 2:55:27 AM org.apache.beam.sdk.io.gcp.datastore.V1TestUtil$V1TestWriter flushBatch
INFO: Successfully wrote 500 entities
Apr 26, 2018 2:55:27 AM org.apache.beam.sdk.io.gcp.datastore.V1TestUtil deleteAllEntities
INFO: Successfully deleted 1000 entities
org.apache.beam.sdk.io.gcp.datastore.SplitQueryFnIT > testSplitQueryFnWithLargeDataset STANDARD_ERROR
Apr 26, 2018 2:55:27 AM org.apache.beam.sdk.transforms.DoFnTester of
WARNING: Your tests use DoFnTester, which may not exercise DoFns correctly. Please use TestPipeline instead.
Apr 26, 2018 2:55:27 AM org.apache.beam.sdk.io.gcp.datastore.DatastoreV1$Read getEstimatedSizeBytes
INFO: Latest stats timestamp for kind sort_1G is 1524555829000000
Apr 26, 2018 2:55:27 AM org.apache.beam.sdk.io.gcp.datastore.DatastoreV1$Read getEstimatedNumSplits
INFO: Estimated size bytes for the query is: 2130000000
Apr 26, 2018 2:55:27 AM org.apache.beam.sdk.io.gcp.datastore.DatastoreV1$Read$SplitQueryFn processElement
INFO: Splitting the query into 32 splits
org.apache.beam.sdk.io.gcp.datastore.SplitQueryFnIT > testSplitQueryFnWithSmallDataset STANDARD_ERROR
Apr 26, 2018 2:55:28 AM org.apache.beam.sdk.transforms.DoFnTester of
WARNING: Your tests use DoFnTester, which may not exercise DoFns correctly. Please use TestPipeline instead.
Apr 26, 2018 2:55:28 AM org.apache.beam.sdk.io.gcp.datastore.DatastoreV1$Read getEstimatedSizeBytes
INFO: Latest stats timestamp for kind shakespeare is 1524555829000000
Apr 26, 2018 2:55:28 AM org.apache.beam.sdk.io.gcp.datastore.DatastoreV1$Read getEstimatedNumSplits
INFO: Estimated size bytes for the query is: 26383451
Apr 26, 2018 2:55:28 AM org.apache.beam.sdk.io.gcp.datastore.DatastoreV1$Read$SplitQueryFn processElement
INFO: Splitting the query into 12 splits
Gradle Test Executor 123 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:googleCloudPlatformIntegrationTest FAILED
org.apache.beam.sdk.io.gcp.spanner.SpannerWriteIT > testWrite FAILED
java.lang.NoClassDefFoundError: com/google/api/gax/retrying/ExceptionRetryAlgorithm
at java.lang.ClassLoader.defineClass1(Native Method)
at java.lang.ClassLoader.defineClass(ClassLoader.java:763)
at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)
at java.net.URLClassLoader.defineClass(URLClassLoader.java:467)
at java.net.URLClassLoader.access$100(URLClassLoader.java:73)
at java.net.URLClassLoader$1.run(URLClassLoader.java:368)
at java.net.URLClassLoader$1.run(URLClassLoader.java:362)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:361)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:338)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
at com.google.cloud.BaseService.<clinit>(BaseService.java:48)
at com.google.cloud.spanner.SpannerOptions$DefaultSpannerFactory.create(SpannerOptions.java:60)
at com.google.cloud.spanner.SpannerOptions$DefaultSpannerFactory.create(SpannerOptions.java:55)
at com.google.cloud.ServiceOptions.getService(ServiceOptions.java:426)
at org.apache.beam.sdk.io.gcp.spanner.SpannerWriteIT.setUp(SpannerWriteIT.java:91)
Caused by:
java.lang.ClassNotFoundException: com.google.api.gax.retrying.ExceptionRetryAlgorithm
at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:338)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
... 17 more
java.lang.NullPointerException
at org.apache.beam.sdk.io.gcp.spanner.SpannerWriteIT.tearDown(SpannerWriteIT.java:148)
12 tests completed, 3 failed
Finished generating test XML results (0.007 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/ws/src/runners/google-cloud-dataflow-java/build/test-results/googleCloudPlatformIntegrationTest>
Generating HTML test report...
Finished generating test html results (0.009 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/googleCloudPlatformIntegrationTest>
:beam-runners-google-cloud-dataflow-java:googleCloudPlatformIntegrationTest (Thread[Task worker for ':',5,main]) completed. Took 37 mins 36.07 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:googleCloudPlatformIntegrationTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/googleCloudPlatformIntegrationTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1h 11m 23s
546 actionable tasks: 546 executed
Publishing build scan...
https://gradle.com/s/3mlk5zvsljg6i
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user sidhom@google.com
Not sending mail to unregistered user swegner@google.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user kedin@google.com
Not sending mail to unregistered user kirpichov@google.com
Not sending mail to unregistered user relax@relax-macbookpro2.roam.corp.google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Build failed in Jenkins: beam_PostCommit_Java_GradleBuild #191
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/191/display/redirect>
------------------------------------------
[...truncated 19.45 MB...]
org.apache.beam.examples.cookbook.FilterExamplesTest > testFilterSingleMonthDataFn STANDARD_ERROR
Apr 26, 2018 12:40:07 AM org.apache.beam.sdk.transforms.DoFnTester of
WARNING: Your tests use DoFnTester, which may not exercise DoFns correctly. Please use TestPipeline instead.
org.apache.beam.examples.cookbook.FilterExamplesTest > testProjectionFn STANDARD_ERROR
Apr 26, 2018 12:40:07 AM org.apache.beam.sdk.transforms.DoFnTester of
WARNING: Your tests use DoFnTester, which may not exercise DoFns correctly. Please use TestPipeline instead.
org.apache.beam.examples.cookbook.JoinExamplesTest > testExtractCountryInfoFn STANDARD_ERROR
Apr 26, 2018 12:40:07 AM org.apache.beam.sdk.transforms.DoFnTester of
WARNING: Your tests use DoFnTester, which may not exercise DoFns correctly. Please use TestPipeline instead.
org.apache.beam.examples.cookbook.JoinExamplesTest > testExtractEventDataFn STANDARD_ERROR
Apr 26, 2018 12:40:07 AM org.apache.beam.sdk.transforms.DoFnTester of
WARNING: Your tests use DoFnTester, which may not exercise DoFns correctly. Please use TestPipeline instead.
org.apache.beam.examples.DebuggingWordCountTest > testDebuggingWordCount STANDARD_ERROR
Apr 26, 2018 12:40:08 AM org.apache.beam.sdk.io.FileBasedSource getEstimatedSizeBytes
INFO: Filepattern /tmp/junit2685520963253068630/junit6928613568339758149.tmp matched 1 files with total size 54
Apr 26, 2018 12:40:08 AM org.apache.beam.sdk.io.FileBasedSource split
INFO: Splitting filepattern /tmp/junit2685520963253068630/junit6928613568339758149.tmp into bundles of size 3 took 1 ms and produced 1 files and 18 bundles
org.apache.beam.examples.WordCountTest > testExtractWordsFn STANDARD_ERROR
Apr 26, 2018 12:40:08 AM org.apache.beam.sdk.transforms.DoFnTester of
WARNING: Your tests use DoFnTester, which may not exercise DoFns correctly. Please use TestPipeline instead.
org.apache.beam.examples.subprocess.ExampleEchoPipelineTest > testExampleEchoPipeline STANDARD_ERROR
Apr 26, 2018 12:40:09 AM org.apache.beam.examples.subprocess.utils.CallingSubProcessUtils initSemaphore
INFO: Initialized Semaphore for binary test-Echo703898095940123218.sh
Apr 26, 2018 12:40:09 AM org.apache.beam.examples.subprocess.utils.CallingSubProcessUtils setUp
INFO: Calling filesetup to move Executables to worker.
Apr 26, 2018 12:40:09 AM org.apache.beam.examples.subprocess.utils.FileUtils copyFileFromGCSToWorker
INFO: Moving File /tmp/test-Echo703898095940123218.sh to /tmp/test-Echoo3635545603389323111/test-Echo703898095940123218.sh
Apr 26, 2018 12:40:09 AM org.apache.beam.examples.subprocess.utils.CallingSubProcessUtils initSemaphore
INFO: Initialized Semaphore for binary test-EchoAgain2330251932287909884.sh
Apr 26, 2018 12:40:09 AM org.apache.beam.examples.subprocess.utils.CallingSubProcessUtils setUp
INFO: Calling filesetup to move Executables to worker.
Apr 26, 2018 12:40:09 AM org.apache.beam.examples.subprocess.utils.FileUtils copyFileFromGCSToWorker
INFO: Moving File /tmp/test-EchoAgain2330251932287909884.sh to /tmp/test-Echoo3635545603389323111/test-EchoAgain2330251932287909884.sh
org.apache.beam.examples.complete.game.HourlyTeamScoreTest > testUserScoresFilter STANDARD_OUT
GOT user18_BananaEmu,BananaEmu,1,1447965690000,2015-11-19 12:41:31.053
GOT user7_AlmondWallaby,AlmondWallaby,15,1447955630000,2015-11-19 09:53:53.444
GOT user3_BananaEmu,BananaEmu,17,1447965690000,2015-11-19 12:41:31.053
GOT user0_AndroidGreenEchidna,AndroidGreenEchidna,0,1447965690000,2015-11-19 12:41:31.053
GOT user6_AmberNumbat,AmberNumbat,11,1447955630000,2015-11-19 09:53:53.444
GOT user18_ApricotCaneToad,ApricotCaneToad,14,1447965690000,2015-11-19 12:41:31.053
GOT user2_AmberCockatoo,AmberCockatoo,13,1447965690000,2015-11-19 12:41:31.053
GOT user18_BananaEmu,BananaEmu,7,1447965690000,2015-11-19 12:41:31.053
GOT user19_BisqueBilby,BisqueBilby,6,1447955630000,2015-11-19 09:53:53.444
GOT user7_AndroidGreenKookaburra,AndroidGreenKookaburra,12,1447955630000,2015-11-19 09:53:53.444
GOT user0_MagentaKangaroo,MagentaKangaroo,3,1447955630000,2015-11-19 09:53:53.444
GOT user7_AndroidGreenKookaburra,AndroidGreenKookaburra,11,1447955630000,2015-11-19 09:53:53.444
GOT user13_ApricotQuokka,ApricotQuokka,15,1447955630000,2015-11-19 09:53:53.444
GOT user0_MagentaKangaroo,MagentaKangaroo,4,1447965690000,2015-11-19 12:41:31.053
GOT user19_BisqueBilby,BisqueBilby,8,1447955630000,2015-11-19 09:53:53.444
org.apache.beam.examples.complete.game.UserScoreTest > testTeamScoreSums STANDARD_OUT
GOT THIS IS A PARSE ERROR,2015-11-19 09:53:53.444
GOT user13_ApricotQuokka,ApricotQuokka,15,1447955630000,2015-11-19 09:53:53.444
GOT user6_AliceBlueDingo,AliceBlueDingo,4,xxxxxxx,2015-11-19 09:53:53.444
GOT user7_AlmondWallaby,AlmondWallaby,15,1447955630000,2015-11-19 09:53:53.444
GOT user6_AmberNumbat,AmberNumbat,11,1447955630000,2015-11-19 09:53:53.444
GOT user0_MagentaKangaroo,MagentaKangaroo,3,1447955630000,2015-11-19 09:53:53.444
GOT user19_BisqueBilby,BisqueBilby,8,1447955630000,2015-11-19 09:53:53.444
GOT user7_AndroidGreenKookaburra,AndroidGreenKookaburra,12,1447955630000,2015-11-19 09:53:53.444
GOT user19_BisqueBilby,BisqueBilby,6,1447955630000,2015-11-19 09:53:53.444
GOT user7_AndroidGreenKookaburra,AndroidGreenKookaburra,11,1447955630000,2015-11-19 09:53:53.444
org.apache.beam.examples.complete.game.UserScoreTest > testTeamScoreSums STANDARD_ERROR
Apr 26, 2018 12:40:10 AM org.apache.beam.examples.complete.game.UserScore$ParseEventFn processElement
INFO: Parse error on user6_AliceBlueDingo,AliceBlueDingo,4,xxxxxxx,2015-11-19 09:53:53.444, For input string: "xxxxxxx"
Apr 26, 2018 12:40:10 AM org.apache.beam.examples.complete.game.UserScore$ParseEventFn processElement
INFO: Parse error on THIS IS A PARSE ERROR,2015-11-19 09:53:53.444, 2
org.apache.beam.examples.complete.game.UserScoreTest > testUserScoresBadInput STANDARD_OUT
GOT user6_AliceBlueDingo,AliceBlueDingo,4,xxxxxxx,2015-11-19 09:53:53.444
GOT user13_BisqueBilby,BisqueBilby,xxx,1447955630000,2015-11-19 09:53:53.444
org.apache.beam.examples.complete.game.UserScoreTest > testUserScoresBadInput STANDARD_ERROR
Apr 26, 2018 12:40:11 AM org.apache.beam.examples.complete.game.UserScore$ParseEventFn processElement
INFO: Parse error on user6_AliceBlueDingo,AliceBlueDingo,4,xxxxxxx,2015-11-19 09:53:53.444, For input string: "xxxxxxx"
org.apache.beam.examples.complete.game.UserScoreTest > testUserScoresBadInput STANDARD_OUT
GOT THIS IS A PARSE ERROR,2015-11-19 09:53:53.444
org.apache.beam.examples.complete.game.UserScoreTest > testUserScoresBadInput STANDARD_ERROR
Apr 26, 2018 12:40:11 AM org.apache.beam.examples.complete.game.UserScore$ParseEventFn processElement
INFO: Parse error on THIS IS A PARSE ERROR,2015-11-19 09:53:53.444, 2
Apr 26, 2018 12:40:11 AM org.apache.beam.examples.complete.game.UserScore$ParseEventFn processElement
INFO: Parse error on user13_BisqueBilby,BisqueBilby,xxx,1447955630000,2015-11-19 09:53:53.444, For input string: "xxx"
org.apache.beam.examples.complete.game.UserScoreTest > testUserScoreSums STANDARD_OUT
GOT user6_AliceBlueDingo,AliceBlueDingo,4,xxxxxxx,2015-11-19 09:53:53.444
GOT user0_MagentaKangaroo,MagentaKangaroo,3,1447955630000,2015-11-19 09:53:53.444
GOT user6_AmberNumbat,AmberNumbat,11,1447955630000,2015-11-19 09:53:53.444
GOT user19_BisqueBilby,BisqueBilby,6,1447955630000,2015-11-19 09:53:53.444
GOT user13_ApricotQuokka,ApricotQuokka,15,1447955630000,2015-11-19 09:53:53.444
GOT THIS IS A PARSE ERROR,2015-11-19 09:53:53.444
GOT user19_BisqueBilby,BisqueBilby,8,1447955630000,2015-11-19 09:53:53.444
GOT user7_AlmondWallaby,AlmondWallaby,15,1447955630000,2015-11-19 09:53:53.444
GOT user7_AndroidGreenKookaburra,AndroidGreenKookaburra,11,1447955630000,2015-11-19 09:53:53.444
GOT user7_AndroidGreenKookaburra,AndroidGreenKookaburra,12,1447955630000,2015-11-19 09:53:53.444
org.apache.beam.examples.complete.game.UserScoreTest > testUserScoreSums STANDARD_ERROR
Apr 26, 2018 12:40:11 AM org.apache.beam.examples.complete.game.UserScore$ParseEventFn processElement
INFO: Parse error on THIS IS A PARSE ERROR,2015-11-19 09:53:53.444, 2
Apr 26, 2018 12:40:11 AM org.apache.beam.examples.complete.game.UserScore$ParseEventFn processElement
INFO: Parse error on user6_AliceBlueDingo,AliceBlueDingo,4,xxxxxxx,2015-11-19 09:53:53.444, For input string: "xxxxxxx"
org.apache.beam.examples.complete.game.UserScoreTest > testParseEventFn STANDARD_ERROR
Apr 26, 2018 12:40:11 AM org.apache.beam.sdk.transforms.DoFnTester of
WARNING: Your tests use DoFnTester, which may not exercise DoFns correctly. Please use TestPipeline instead.
org.apache.beam.examples.complete.game.UserScoreTest > testParseEventFn STANDARD_OUT
GOT user0_MagentaKangaroo,MagentaKangaroo,3,1447955630000,2015-11-19 09:53:53.444
GOT user13_ApricotQuokka,ApricotQuokka,15,1447955630000,2015-11-19 09:53:53.444
GOT user6_AmberNumbat,AmberNumbat,11,1447955630000,2015-11-19 09:53:53.444
GOT user7_AlmondWallaby,AlmondWallaby,15,1447955630000,2015-11-19 09:53:53.444
GOT user7_AndroidGreenKookaburra,AndroidGreenKookaburra,12,1447955630000,2015-11-19 09:53:53.444
GOT user6_AliceBlueDingo,AliceBlueDingo,4,xxxxxxx,2015-11-19 09:53:53.444
org.apache.beam.examples.complete.game.UserScoreTest > testParseEventFn STANDARD_ERROR
Apr 26, 2018 12:40:11 AM org.apache.beam.examples.complete.game.UserScore$ParseEventFn processElement
INFO: Parse error on user6_AliceBlueDingo,AliceBlueDingo,4,xxxxxxx,2015-11-19 09:53:53.444, For input string: "xxxxxxx"
org.apache.beam.examples.complete.game.UserScoreTest > testParseEventFn STANDARD_OUT
GOT user7_AndroidGreenKookaburra,AndroidGreenKookaburra,11,1447955630000,2015-11-19 09:53:53.444
GOT THIS IS A PARSE ERROR,2015-11-19 09:53:53.444
org.apache.beam.examples.complete.game.UserScoreTest > testParseEventFn STANDARD_ERROR
Apr 26, 2018 12:40:11 AM org.apache.beam.examples.complete.game.UserScore$ParseEventFn processElement
INFO: Parse error on THIS IS A PARSE ERROR,2015-11-19 09:53:53.444, 2
org.apache.beam.examples.complete.game.UserScoreTest > testParseEventFn STANDARD_OUT
GOT user19_BisqueBilby,BisqueBilby,6,1447955630000,2015-11-19 09:53:53.444
GOT user19_BisqueBilby,BisqueBilby,8,1447955630000,2015-11-19 09:53:53.444
org.apache.beam.examples.complete.game.GameStatsTest > testCalculateSpammyUsers STANDARD_ERROR
Apr 26, 2018 12:40:11 AM org.apache.beam.examples.complete.game.GameStats$CalculateSpammyUsers$1 processElement
INFO: user Robot-1 spammer score 116 with mean 24.923076923076923
Apr 26, 2018 12:40:11 AM org.apache.beam.examples.complete.game.GameStats$CalculateSpammyUsers$1 processElement
INFO: user Robot-2 spammer score 66 with mean 24.923076923076923
Gradle Test Executor 133 finished executing tests.
Finished generating test XML results (0.001 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/ws/src/examples/java/build/test-results/test>
Generating HTML test report...
Finished generating test html results (0.002 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/ws/src/examples/java/build/reports/tests/test>
Packing task ':beam-examples-java:test'
:beam-examples-java:test (Thread[Task worker for ':' Thread 10,5,main]) completed. Took 10.232 secs.
:beam-examples-java:check (Thread[Task worker for ':' Thread 10,5,main]) started.
:beam-examples-java:check
Skipping task ':beam-examples-java:check' as it has no actions.
:beam-examples-java:check (Thread[Task worker for ':' Thread 10,5,main]) completed. Took 0.0 secs.
:beam-examples-java:build (Thread[Task worker for ':' Thread 10,5,main]) started.
:beam-examples-java:build
Skipping task ':beam-examples-java:build' as it has no actions.
:beam-examples-java:build (Thread[Task worker for ':' Thread 10,5,main]) completed. Took 0.0 secs.
:beam-examples-java:buildDependents (Thread[Task worker for ':' Thread 10,5,main]) started.
:beam-examples-java:buildDependents
Caching disabled for task ':beam-examples-java:buildDependents': Caching has not been enabled for the task
Task ':beam-examples-java:buildDependents' is not up-to-date because:
Task has not declared any outputs.
:beam-examples-java:buildDependents (Thread[Task worker for ':' Thread 10,5,main]) completed. Took 0.0 secs.
:beam-sdks-java-io-google-cloud-platform:buildDependents (Thread[Task worker for ':' Thread 10,5,main]) started.
:beam-sdks-java-io-google-cloud-platform:buildDependents
Caching disabled for task ':beam-sdks-java-io-google-cloud-platform:buildDependents': Caching has not been enabled for the task
Task ':beam-sdks-java-io-google-cloud-platform:buildDependents' is not up-to-date because:
Task has not declared any outputs.
:beam-sdks-java-io-google-cloud-platform:buildDependents (Thread[Task worker for ':' Thread 10,5,main]) completed. Took 0.0 secs.
:beam-runners-direct-java:buildDependents (Thread[Task worker for ':' Thread 10,5,main]) started.
:beam-sdks-java-extensions-google-cloud-platform-core:buildDependents (Thread[Task worker for ':',5,main]) started.
:beam-runners-direct-java:buildDependents
:beam-sdks-java-extensions-protobuf:buildDependents (Thread[Task worker for ':' Thread 3,5,main]) started.
:beam-sdks-java-extensions-google-cloud-platform-core:buildDependents
:beam-sdks-java-extensions-protobuf:buildDependents
Caching disabled for task ':beam-runners-direct-java:buildDependents': Caching has not been enabled for the task
Caching disabled for task ':beam-sdks-java-extensions-google-cloud-platform-core:buildDependents': Caching has not been enabled for the task
Caching disabled for task ':beam-sdks-java-extensions-protobuf:buildDependents': Caching has not been enabled for the task
Task ':beam-sdks-java-extensions-google-cloud-platform-core:buildDependents' is not up-to-date because:
Task has not declared any outputs.
Task ':beam-runners-direct-java:buildDependents' is not up-to-date because:
Task has not declared any outputs.
Task ':beam-sdks-java-extensions-protobuf:buildDependents' is not up-to-date because:
Task has not declared any outputs.
:beam-runners-direct-java:buildDependents (Thread[Task worker for ':' Thread 10,5,main]) completed. Took 0.0 secs.
:beam-sdks-java-extensions-protobuf:buildDependents (Thread[Task worker for ':' Thread 3,5,main]) completed. Took 0.0 secs.
:beam-sdks-java-extensions-google-cloud-platform-core:buildDependents (Thread[Task worker for ':',5,main]) completed. Took 0.0 secs.
:beam-runners-core-java:buildDependents (Thread[Task worker for ':' Thread 10,5,main]) started.
:beam-runners-local-java-core:buildDependents (Thread[Task worker for ':' Thread 11,5,main]) started.
:beam-runners-core-java:buildDependents
:beam-runners-local-java-core:buildDependents
Caching disabled for task ':beam-runners-core-java:buildDependents': Caching has not been enabled for the task
Task ':beam-runners-core-java:buildDependents' is not up-to-date because:
Task has not declared any outputs.
Caching disabled for task ':beam-runners-local-java-core:buildDependents': Caching has not been enabled for the task
Task ':beam-runners-local-java-core:buildDependents' is not up-to-date because:
Task has not declared any outputs.
:beam-runners-core-java:buildDependents (Thread[Task worker for ':' Thread 10,5,main]) completed. Took 0.0 secs.
:beam-runners-core-construction-java:buildDependents (Thread[Task worker for ':' Thread 14,5,main]) started.
:beam-runners-core-construction-java:buildDependents
Caching disabled for task ':beam-runners-core-construction-java:buildDependents': Caching has not been enabled for the task
Task ':beam-runners-core-construction-java:buildDependents' is not up-to-date because:
Task has not declared any outputs.
:beam-runners-core-construction-java:buildDependents (Thread[Task worker for ':' Thread 14,5,main]) completed. Took 0.0 secs.
:beam-runners-local-java-core:buildDependents (Thread[Task worker for ':' Thread 11,5,main]) completed. Took 0.0 secs.
:beam-sdks-java-core:buildDependents (Thread[Task worker for ':' Thread 14,5,main]) started.
:beam-sdks-java-core:buildDependents
Caching disabled for task ':beam-sdks-java-core:buildDependents': Caching has not been enabled for the task
Task ':beam-sdks-java-core:buildDependents' is not up-to-date because:
Task has not declared any outputs.
:beam-sdks-java-core:buildDependents (Thread[Task worker for ':' Thread 14,5,main]) completed. Took 0.0 secs.
:javaPreCommit (Thread[Task worker for ':' Thread 12,5,main]) started.
:javaPreCommit
Skipping task ':javaPreCommit' as it has no actions.
:javaPreCommit (Thread[Task worker for ':' Thread 12,5,main]) completed. Took 0.0 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:googleCloudPlatformIntegrationTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/googleCloudPlatformIntegrationTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.6/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 32m 49s
546 actionable tasks: 539 executed, 7 from cache
Publishing build scan...
https://gradle.com/s/yvm4jyvonuuro
Build cache (/home/jenkins/.gradle/caches/build-cache-1) has not been cleaned up in 1 days
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user sidhom@google.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user kedin@google.com
Not sending mail to unregistered user kirpichov@google.com
Not sending mail to unregistered user relax@relax-macbookpro2.roam.corp.google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Build failed in Jenkins: beam_PostCommit_Java_GradleBuild #190
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/190/display/redirect?page=changes>
Changes:
[ekirpichov] Moves standard URNs into .proto files
[ekirpichov] Refactors common_urns.py
[ekirpichov] Fixes pylint errors
[ekirpichov] Fixes compile errors
[ekirpichov] Workaround for protobuf compiler bug
[ekirpichov] Fixes more references to common_urns
------------------------------------------
[...truncated 19.18 MB...]
org.apache.beam.examples.cookbook.FilterExamplesTest > testProjectionFn STANDARD_ERROR
Apr 25, 2018 11:41:07 PM org.apache.beam.sdk.transforms.DoFnTester of
WARNING: Your tests use DoFnTester, which may not exercise DoFns correctly. Please use TestPipeline instead.
org.apache.beam.examples.cookbook.JoinExamplesTest > testExtractCountryInfoFn STANDARD_ERROR
Apr 25, 2018 11:41:07 PM org.apache.beam.sdk.transforms.DoFnTester of
WARNING: Your tests use DoFnTester, which may not exercise DoFns correctly. Please use TestPipeline instead.
org.apache.beam.examples.cookbook.JoinExamplesTest > testExtractEventDataFn STANDARD_ERROR
Apr 25, 2018 11:41:07 PM org.apache.beam.sdk.transforms.DoFnTester of
WARNING: Your tests use DoFnTester, which may not exercise DoFns correctly. Please use TestPipeline instead.
org.apache.beam.examples.DebuggingWordCountTest > testDebuggingWordCount STANDARD_ERROR
Apr 25, 2018 11:41:08 PM org.apache.beam.sdk.io.FileBasedSource getEstimatedSizeBytes
INFO: Filepattern /tmp/junit3542244491470037721/junit6723968775814615438.tmp matched 1 files with total size 54
Apr 25, 2018 11:41:08 PM org.apache.beam.sdk.io.FileBasedSource split
INFO: Splitting filepattern /tmp/junit3542244491470037721/junit6723968775814615438.tmp into bundles of size 3 took 1 ms and produced 1 files and 18 bundles
org.apache.beam.examples.WordCountTest > testExtractWordsFn STANDARD_ERROR
Apr 25, 2018 11:41:08 PM org.apache.beam.sdk.transforms.DoFnTester of
WARNING: Your tests use DoFnTester, which may not exercise DoFns correctly. Please use TestPipeline instead.
org.apache.beam.examples.subprocess.ExampleEchoPipelineTest > testExampleEchoPipeline STANDARD_ERROR
Apr 25, 2018 11:41:10 PM org.apache.beam.examples.subprocess.utils.CallingSubProcessUtils initSemaphore
INFO: Initialized Semaphore for binary test-Echo3575475036455062336.sh
Apr 25, 2018 11:41:10 PM org.apache.beam.examples.subprocess.utils.CallingSubProcessUtils setUp
INFO: Calling filesetup to move Executables to worker.
Apr 25, 2018 11:41:10 PM org.apache.beam.examples.subprocess.utils.FileUtils copyFileFromGCSToWorker
INFO: Moving File /tmp/test-Echo3575475036455062336.sh to /tmp/test-Echoo360632392480774011/test-Echo3575475036455062336.sh
Apr 25, 2018 11:41:10 PM org.apache.beam.examples.subprocess.utils.CallingSubProcessUtils initSemaphore
INFO: Initialized Semaphore for binary test-EchoAgain648595034353412101.sh
Apr 25, 2018 11:41:10 PM org.apache.beam.examples.subprocess.utils.CallingSubProcessUtils setUp
INFO: Calling filesetup to move Executables to worker.
Apr 25, 2018 11:41:10 PM org.apache.beam.examples.subprocess.utils.FileUtils copyFileFromGCSToWorker
INFO: Moving File /tmp/test-EchoAgain648595034353412101.sh to /tmp/test-Echoo360632392480774011/test-EchoAgain648595034353412101.sh
org.apache.beam.examples.complete.game.HourlyTeamScoreTest > testUserScoresFilter STANDARD_OUT
GOT user18_ApricotCaneToad,ApricotCaneToad,14,1447965690000,2015-11-19 12:41:31.053
GOT user18_BananaEmu,BananaEmu,1,1447965690000,2015-11-19 12:41:31.053
GOT user19_BisqueBilby,BisqueBilby,8,1447955630000,2015-11-19 09:53:53.444
GOT user18_BananaEmu,BananaEmu,7,1447965690000,2015-11-19 12:41:31.053
GOT user7_AndroidGreenKookaburra,AndroidGreenKookaburra,12,1447955630000,2015-11-19 09:53:53.444
GOT user7_AndroidGreenKookaburra,AndroidGreenKookaburra,11,1447955630000,2015-11-19 09:53:53.444
GOT user7_AlmondWallaby,AlmondWallaby,15,1447955630000,2015-11-19 09:53:53.444
GOT user13_ApricotQuokka,ApricotQuokka,15,1447955630000,2015-11-19 09:53:53.444
GOT user2_AmberCockatoo,AmberCockatoo,13,1447965690000,2015-11-19 12:41:31.053
GOT user19_BisqueBilby,BisqueBilby,6,1447955630000,2015-11-19 09:53:53.444
GOT user6_AmberNumbat,AmberNumbat,11,1447955630000,2015-11-19 09:53:53.444
GOT user0_MagentaKangaroo,MagentaKangaroo,3,1447955630000,2015-11-19 09:53:53.444
GOT user3_BananaEmu,BananaEmu,17,1447965690000,2015-11-19 12:41:31.053
GOT user0_MagentaKangaroo,MagentaKangaroo,4,1447965690000,2015-11-19 12:41:31.053
GOT user0_AndroidGreenEchidna,AndroidGreenEchidna,0,1447965690000,2015-11-19 12:41:31.053
org.apache.beam.examples.complete.game.UserScoreTest > testTeamScoreSums STANDARD_OUT
GOT user0_MagentaKangaroo,MagentaKangaroo,3,1447955630000,2015-11-19 09:53:53.444
GOT user7_AndroidGreenKookaburra,AndroidGreenKookaburra,12,1447955630000,2015-11-19 09:53:53.444
GOT user13_ApricotQuokka,ApricotQuokka,15,1447955630000,2015-11-19 09:53:53.444
GOT user6_AliceBlueDingo,AliceBlueDingo,4,xxxxxxx,2015-11-19 09:53:53.444
GOT user7_AndroidGreenKookaburra,AndroidGreenKookaburra,11,1447955630000,2015-11-19 09:53:53.444
GOT user7_AlmondWallaby,AlmondWallaby,15,1447955630000,2015-11-19 09:53:53.444
GOT user6_AmberNumbat,AmberNumbat,11,1447955630000,2015-11-19 09:53:53.444
GOT user19_BisqueBilby,BisqueBilby,6,1447955630000,2015-11-19 09:53:53.444
GOT user19_BisqueBilby,BisqueBilby,8,1447955630000,2015-11-19 09:53:53.444
org.apache.beam.examples.complete.game.UserScoreTest > testTeamScoreSums STANDARD_ERROR
Apr 25, 2018 11:41:11 PM org.apache.beam.examples.complete.game.UserScore$ParseEventFn processElement
INFO: Parse error on user6_AliceBlueDingo,AliceBlueDingo,4,xxxxxxx,2015-11-19 09:53:53.444, For input string: "xxxxxxx"
org.apache.beam.examples.complete.game.UserScoreTest > testTeamScoreSums STANDARD_OUT
GOT THIS IS A PARSE ERROR,2015-11-19 09:53:53.444
org.apache.beam.examples.complete.game.UserScoreTest > testTeamScoreSums STANDARD_ERROR
Apr 25, 2018 11:41:11 PM org.apache.beam.examples.complete.game.UserScore$ParseEventFn processElement
INFO: Parse error on THIS IS A PARSE ERROR,2015-11-19 09:53:53.444, 2
org.apache.beam.examples.complete.game.UserScoreTest > testUserScoresBadInput STANDARD_OUT
GOT user6_AliceBlueDingo,AliceBlueDingo,4,xxxxxxx,2015-11-19 09:53:53.444
GOT THIS IS A PARSE ERROR,2015-11-19 09:53:53.444
GOT user13_BisqueBilby,BisqueBilby,xxx,1447955630000,2015-11-19 09:53:53.444
org.apache.beam.examples.complete.game.UserScoreTest > testUserScoresBadInput STANDARD_ERROR
Apr 25, 2018 11:41:11 PM org.apache.beam.examples.complete.game.UserScore$ParseEventFn processElement
INFO: Parse error on THIS IS A PARSE ERROR,2015-11-19 09:53:53.444, 2
Apr 25, 2018 11:41:11 PM org.apache.beam.examples.complete.game.UserScore$ParseEventFn processElement
INFO: Parse error on user13_BisqueBilby,BisqueBilby,xxx,1447955630000,2015-11-19 09:53:53.444, For input string: "xxx"
Apr 25, 2018 11:41:11 PM org.apache.beam.examples.complete.game.UserScore$ParseEventFn processElement
INFO: Parse error on user6_AliceBlueDingo,AliceBlueDingo,4,xxxxxxx,2015-11-19 09:53:53.444, For input string: "xxxxxxx"
org.apache.beam.examples.complete.game.UserScoreTest > testUserScoreSums STANDARD_OUT
GOT user7_AndroidGreenKookaburra,AndroidGreenKookaburra,12,1447955630000,2015-11-19 09:53:53.444
GOT user0_MagentaKangaroo,MagentaKangaroo,3,1447955630000,2015-11-19 09:53:53.444
GOT user6_AmberNumbat,AmberNumbat,11,1447955630000,2015-11-19 09:53:53.444
GOT user6_AliceBlueDingo,AliceBlueDingo,4,xxxxxxx,2015-11-19 09:53:53.444
GOT THIS IS A PARSE ERROR,2015-11-19 09:53:53.444
GOT user19_BisqueBilby,BisqueBilby,6,1447955630000,2015-11-19 09:53:53.444
GOT user7_AndroidGreenKookaburra,AndroidGreenKookaburra,11,1447955630000,2015-11-19 09:53:53.444
org.apache.beam.examples.complete.game.UserScoreTest > testUserScoreSums STANDARD_ERROR
Apr 25, 2018 11:41:11 PM org.apache.beam.examples.complete.game.UserScore$ParseEventFn processElement
org.apache.beam.examples.complete.game.UserScoreTest > testUserScoreSums STANDARD_OUT
GOT user19_BisqueBilby,BisqueBilby,8,1447955630000,2015-11-19 09:53:53.444
GOT user13_ApricotQuokka,ApricotQuokka,15,1447955630000,2015-11-19 09:53:53.444
GOT user7_AlmondWallaby,AlmondWallaby,15,1447955630000,2015-11-19 09:53:53.444
org.apache.beam.examples.complete.game.UserScoreTest > testUserScoreSums STANDARD_ERROR
INFO: Parse error on user6_AliceBlueDingo,AliceBlueDingo,4,xxxxxxx,2015-11-19 09:53:53.444, For input string: "xxxxxxx"
Apr 25, 2018 11:41:11 PM org.apache.beam.examples.complete.game.UserScore$ParseEventFn processElement
INFO: Parse error on THIS IS A PARSE ERROR,2015-11-19 09:53:53.444, 2
org.apache.beam.examples.complete.game.UserScoreTest > testParseEventFn STANDARD_ERROR
Apr 25, 2018 11:41:11 PM org.apache.beam.sdk.transforms.DoFnTester of
WARNING: Your tests use DoFnTester, which may not exercise DoFns correctly. Please use TestPipeline instead.
org.apache.beam.examples.complete.game.UserScoreTest > testParseEventFn STANDARD_OUT
GOT user0_MagentaKangaroo,MagentaKangaroo,3,1447955630000,2015-11-19 09:53:53.444
GOT user13_ApricotQuokka,ApricotQuokka,15,1447955630000,2015-11-19 09:53:53.444
GOT user6_AmberNumbat,AmberNumbat,11,1447955630000,2015-11-19 09:53:53.444
GOT user7_AlmondWallaby,AlmondWallaby,15,1447955630000,2015-11-19 09:53:53.444
GOT user7_AndroidGreenKookaburra,AndroidGreenKookaburra,12,1447955630000,2015-11-19 09:53:53.444
GOT user6_AliceBlueDingo,AliceBlueDingo,4,xxxxxxx,2015-11-19 09:53:53.444
org.apache.beam.examples.complete.game.UserScoreTest > testParseEventFn STANDARD_ERROR
Apr 25, 2018 11:41:11 PM org.apache.beam.examples.complete.game.UserScore$ParseEventFn processElement
INFO: Parse error on user6_AliceBlueDingo,AliceBlueDingo,4,xxxxxxx,2015-11-19 09:53:53.444, For input string: "xxxxxxx"
org.apache.beam.examples.complete.game.UserScoreTest > testParseEventFn STANDARD_OUT
GOT user7_AndroidGreenKookaburra,AndroidGreenKookaburra,11,1447955630000,2015-11-19 09:53:53.444
GOT THIS IS A PARSE ERROR,2015-11-19 09:53:53.444
org.apache.beam.examples.complete.game.UserScoreTest > testParseEventFn STANDARD_ERROR
Apr 25, 2018 11:41:11 PM org.apache.beam.examples.complete.game.UserScore$ParseEventFn processElement
INFO: Parse error on THIS IS A PARSE ERROR,2015-11-19 09:53:53.444, 2
org.apache.beam.examples.complete.game.UserScoreTest > testParseEventFn STANDARD_OUT
GOT user19_BisqueBilby,BisqueBilby,6,1447955630000,2015-11-19 09:53:53.444
GOT user19_BisqueBilby,BisqueBilby,8,1447955630000,2015-11-19 09:53:53.444
org.apache.beam.examples.complete.game.GameStatsTest > testCalculateSpammyUsers STANDARD_ERROR
Apr 25, 2018 11:41:11 PM org.apache.beam.examples.complete.game.GameStats$CalculateSpammyUsers$1 processElement
INFO: user Robot-2 spammer score 66 with mean 24.923076923076923
Apr 25, 2018 11:41:11 PM org.apache.beam.examples.complete.game.GameStats$CalculateSpammyUsers$1 processElement
INFO: user Robot-1 spammer score 116 with mean 24.923076923076923
Gradle Test Executor 133 finished executing tests.
Finished generating test XML results (0.002 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/ws/src/examples/java/build/test-results/test>
Generating HTML test report...
Finished generating test html results (0.003 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/ws/src/examples/java/build/reports/tests/test>
Packing task ':beam-examples-java:test'
:beam-examples-java:test (Thread[Task worker for ':' Thread 11,5,main]) completed. Took 11.87 secs.
:beam-examples-java:check (Thread[Task worker for ':' Thread 11,5,main]) started.
:beam-examples-java:check
Skipping task ':beam-examples-java:check' as it has no actions.
:beam-examples-java:check (Thread[Task worker for ':' Thread 11,5,main]) completed. Took 0.0 secs.
:beam-examples-java:build (Thread[Task worker for ':' Thread 9,5,main]) started.
:beam-examples-java:build
Skipping task ':beam-examples-java:build' as it has no actions.
:beam-examples-java:build (Thread[Task worker for ':' Thread 9,5,main]) completed. Took 0.0 secs.
:beam-examples-java:buildDependents (Thread[Task worker for ':' Thread 9,5,main]) started.
:beam-examples-java:buildDependents
Caching disabled for task ':beam-examples-java:buildDependents': Caching has not been enabled for the task
Task ':beam-examples-java:buildDependents' is not up-to-date because:
Task has not declared any outputs.
:beam-examples-java:buildDependents (Thread[Task worker for ':' Thread 9,5,main]) completed. Took 0.0 secs.
:beam-sdks-java-io-google-cloud-platform:buildDependents (Thread[Task worker for ':' Thread 9,5,main]) started.
:beam-sdks-java-io-google-cloud-platform:buildDependents
Caching disabled for task ':beam-sdks-java-io-google-cloud-platform:buildDependents': Caching has not been enabled for the task
Task ':beam-sdks-java-io-google-cloud-platform:buildDependents' is not up-to-date because:
Task has not declared any outputs.
:beam-sdks-java-io-google-cloud-platform:buildDependents (Thread[Task worker for ':' Thread 9,5,main]) completed. Took 0.0 secs.
:beam-runners-direct-java:buildDependents (Thread[Task worker for ':' Thread 7,5,main]) started.
:beam-sdks-java-extensions-google-cloud-platform-core:buildDependents (Thread[Task worker for ':' Thread 4,5,main]) started.
:beam-runners-direct-java:buildDependents
:beam-sdks-java-extensions-protobuf:buildDependents (Thread[Task worker for ':',5,main]) started.
:beam-sdks-java-extensions-google-cloud-platform-core:buildDependents
:beam-sdks-java-extensions-protobuf:buildDependents
Caching disabled for task ':beam-runners-direct-java:buildDependents': Caching has not been enabled for the task
Task ':beam-runners-direct-java:buildDependents' is not up-to-date because:
Task has not declared any outputs.
Caching disabled for task ':beam-sdks-java-extensions-protobuf:buildDependents': Caching has not been enabled for the task
Caching disabled for task ':beam-sdks-java-extensions-google-cloud-platform-core:buildDependents': Caching has not been enabled for the task
Task ':beam-sdks-java-extensions-protobuf:buildDependents' is not up-to-date because:
Task has not declared any outputs.
Task ':beam-sdks-java-extensions-google-cloud-platform-core:buildDependents' is not up-to-date because:
Task has not declared any outputs.
:beam-runners-direct-java:buildDependents (Thread[Task worker for ':' Thread 7,5,main]) completed. Took 0.001 secs.
:beam-sdks-java-extensions-protobuf:buildDependents (Thread[Task worker for ':',5,main]) completed. Took 0.0 secs.
:beam-runners-core-java:buildDependents (Thread[Task worker for ':' Thread 7,5,main]) started.
:beam-runners-core-java:buildDependents
:beam-runners-local-java-core:buildDependents (Thread[Task worker for ':' Thread 11,5,main]) started.
:beam-runners-local-java-core:buildDependents
Caching disabled for task ':beam-runners-core-java:buildDependents': Caching has not been enabled for the task
Task ':beam-runners-core-java:buildDependents' is not up-to-date because:
Task has not declared any outputs.
Caching disabled for task ':beam-runners-local-java-core:buildDependents': Caching has not been enabled for the task
Task ':beam-runners-local-java-core:buildDependents' is not up-to-date because:
Task has not declared any outputs.
:beam-runners-core-java:buildDependents (Thread[Task worker for ':' Thread 7,5,main]) completed. Took 0.0 secs.
:beam-runners-core-construction-java:buildDependents (Thread[Task worker for ':',5,main]) started.
:beam-sdks-java-extensions-google-cloud-platform-core:buildDependents (Thread[Task worker for ':' Thread 4,5,main]) completed. Took 0.001 secs.
:beam-runners-core-construction-java:buildDependents
:beam-runners-local-java-core:buildDependents (Thread[Task worker for ':' Thread 11,5,main]) completed. Took 0.0 secs.
Caching disabled for task ':beam-runners-core-construction-java:buildDependents': Caching has not been enabled for the task
Task ':beam-runners-core-construction-java:buildDependents' is not up-to-date because:
Task has not declared any outputs.
:beam-runners-core-construction-java:buildDependents (Thread[Task worker for ':',5,main]) completed. Took 0.0 secs.
:beam-sdks-java-core:buildDependents (Thread[Task worker for ':' Thread 14,5,main]) started.
:beam-sdks-java-core:buildDependents
Caching disabled for task ':beam-sdks-java-core:buildDependents': Caching has not been enabled for the task
Task ':beam-sdks-java-core:buildDependents' is not up-to-date because:
Task has not declared any outputs.
:beam-sdks-java-core:buildDependents (Thread[Task worker for ':' Thread 14,5,main]) completed. Took 0.0 secs.
:javaPreCommit (Thread[Task worker for ':' Thread 2,5,main]) started.
:javaPreCommit
Skipping task ':javaPreCommit' as it has no actions.
:javaPreCommit (Thread[Task worker for ':' Thread 2,5,main]) completed. Took 0.0 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:googleCloudPlatformIntegrationTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/googleCloudPlatformIntegrationTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.6/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 31m 56s
546 actionable tasks: 546 executed
Publishing build scan...
https://gradle.com/s/5v25v5supd5sm
Build cache (/home/jenkins/.gradle/caches/build-cache-1) has not been cleaned up in 1 days
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user sidhom@google.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user kedin@google.com
Not sending mail to unregistered user kirpichov@google.com
Not sending mail to unregistered user relax@relax-macbookpro2.roam.corp.google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Build failed in Jenkins: beam_PostCommit_Java_GradleBuild #189
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/189/display/redirect?page=changes>
Changes:
[sidhom] Add in-process ManagedChannelFactory and update tests to use it
[sidhom] Add common pipeline options for portable runners
[sidhom] Set artifact names explicitly while staging to service
[sidhom] Add CloseableResource to wrap non-closeable resources that must be
[sidhom] [BEAM-4071] Add Portable Runner Job API shim
------------------------------------------
[...truncated 20.11 MB...]
Apr 25, 2018 10:55:15 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.m2/repository/io/netty/netty-common/4.1.8.Final/netty-common-4.1.8.Final.jar to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0425225513-56bd4e2e/output/results/staging/netty-common-4.1.8.Final-lafOW8vGsI6SRwZSmXNClg.jar
Apr 25, 2018 10:55:15 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.m2/repository/com/google/auto/value/auto-value/1.4/auto-value-1.4.jar to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0425225513-56bd4e2e/output/results/staging/auto-value-1.4-_7tYdqNvCowycFIDpBenFw.jar
Apr 25, 2018 10:55:15 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/ws/src/sdks/java/io/google-cloud-platform/build/libs/beam-sdks-java-io-google-cloud-platform-2.5.0-SNAPSHOT-shaded-tests.jar> to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0425225513-56bd4e2e/output/results/staging/beam-sdks-java-io-google-cloud-platform-2.5.0-SNAPSHOT-shaded-tests-0H_bINqh474db9AuqdxujA.jar
Apr 25, 2018 10:55:15 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.m2/repository/io/netty/netty-handler-proxy/4.1.8.Final/netty-handler-proxy-4.1.8.Final.jar to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0425225513-56bd4e2e/output/results/staging/netty-handler-proxy-4.1.8.Final-Zey48Fj4mlWtgpwIc7Osgg.jar
Apr 25, 2018 10:55:15 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.m2/repository/com/squareup/okhttp/okhttp/2.5.0/okhttp-2.5.0.jar to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0425225513-56bd4e2e/output/results/staging/okhttp-2.5.0-64v0X4G_nxfR_PsuymOqpg.jar
Apr 25, 2018 10:55:20 PM org.apache.beam.runners.dataflow.util.PackageUtil stageClasspathElements
INFO: Staging files complete: 0 files cached, 127 files newly uploaded
Apr 25, 2018 10:55:20 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding GenerateSequence/Read(BoundedCountingSource) as step s1
Apr 25, 2018 10:55:20 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding ParDo(CreateEntity) as step s2
Apr 25, 2018 10:55:20 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding DatastoreV1.Write/Convert to Mutation/Map as step s3
Apr 25, 2018 10:55:20 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding DatastoreV1.Write/Write Mutation to Datastore as step s4
Apr 25, 2018 10:55:20 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0425225513-56bd4e2e/output/results/staging/
Apr 25, 2018 10:55:20 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <8774 bytes, hash c-CZlcnyOzIczDEKFLuWYQ> to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0425225513-56bd4e2e/output/results/staging/pipeline-c-CZlcnyOzIczDEKFLuWYQ.pb
org.apache.beam.sdk.io.gcp.datastore.V1WriteIT > testE2EV1Write STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT
org.apache.beam.sdk.io.gcp.datastore.V1WriteIT > testE2EV1Write STANDARD_ERROR
Apr 25, 2018 10:55:22 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-04-25_15_55_21-10465330941772867377?project=apache-beam-testing
org.apache.beam.sdk.io.gcp.datastore.V1WriteIT > testE2EV1Write STANDARD_OUT
Submitted job: 2018-04-25_15_55_21-10465330941772867377
org.apache.beam.sdk.io.gcp.datastore.V1WriteIT > testE2EV1Write STANDARD_ERROR
Apr 25, 2018 10:55:22 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-04-25_15_55_21-10465330941772867377
Apr 25, 2018 10:55:22 PM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-04-25_15_55_21-10465330941772867377 with 0 expected assertions.
org.apache.beam.sdk.io.gcp.datastore.V1ReadIT > testE2EV1ReadWithGQLQueryWithNoLimit STANDARD_ERROR
Apr 25, 2018 10:55:22 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-04-25_15_51_45-16629068779300950722 finished with status DONE.
Apr 25, 2018 10:55:22 PM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-04-25_15_51_45-16629068779300950722. Found 1 success, 0 failures out of 1 expected assertions.
Apr 25, 2018 10:55:23 PM org.apache.beam.sdk.io.gcp.datastore.V1TestUtil$V1TestWriter flushBatch
INFO: Writing batch of 500 entities
Apr 25, 2018 10:55:23 PM org.apache.beam.sdk.io.gcp.datastore.V1TestUtil$V1TestWriter flushBatch
INFO: Successfully wrote 500 entities
Apr 25, 2018 10:55:23 PM org.apache.beam.sdk.io.gcp.datastore.V1TestUtil$V1TestWriter flushBatch
INFO: Writing batch of 500 entities
Apr 25, 2018 10:55:24 PM org.apache.beam.sdk.io.gcp.datastore.V1TestUtil$V1TestWriter flushBatch
INFO: Successfully wrote 500 entities
Apr 25, 2018 10:55:24 PM org.apache.beam.sdk.io.gcp.datastore.V1TestUtil deleteAllEntities
INFO: Successfully deleted 1000 entities
org.apache.beam.sdk.io.gcp.datastore.SplitQueryFnIT > testSplitQueryFnWithLargeDataset STANDARD_ERROR
Apr 25, 2018 10:55:24 PM org.apache.beam.sdk.transforms.DoFnTester of
WARNING: Your tests use DoFnTester, which may not exercise DoFns correctly. Please use TestPipeline instead.
Apr 25, 2018 10:55:24 PM org.apache.beam.sdk.io.gcp.datastore.DatastoreV1$Read getEstimatedSizeBytes
INFO: Latest stats timestamp for kind sort_1G is 1524555829000000
Apr 25, 2018 10:55:24 PM org.apache.beam.sdk.io.gcp.datastore.DatastoreV1$Read getEstimatedNumSplits
INFO: Estimated size bytes for the query is: 2130000000
Apr 25, 2018 10:55:24 PM org.apache.beam.sdk.io.gcp.datastore.DatastoreV1$Read$SplitQueryFn processElement
INFO: Splitting the query into 32 splits
org.apache.beam.sdk.io.gcp.datastore.SplitQueryFnIT > testSplitQueryFnWithSmallDataset STANDARD_ERROR
Apr 25, 2018 10:55:25 PM org.apache.beam.sdk.transforms.DoFnTester of
WARNING: Your tests use DoFnTester, which may not exercise DoFns correctly. Please use TestPipeline instead.
Apr 25, 2018 10:55:25 PM org.apache.beam.sdk.io.gcp.datastore.DatastoreV1$Read getEstimatedSizeBytes
INFO: Latest stats timestamp for kind shakespeare is 1524555829000000
Apr 25, 2018 10:55:25 PM org.apache.beam.sdk.io.gcp.datastore.DatastoreV1$Read getEstimatedNumSplits
INFO: Estimated size bytes for the query is: 26383451
Apr 25, 2018 10:55:25 PM org.apache.beam.sdk.io.gcp.datastore.DatastoreV1$Read$SplitQueryFn processElement
INFO: Splitting the query into 12 splits
Gradle Test Executor 122 finished executing tests.
org.apache.beam.sdk.io.gcp.spanner.SpannerWriteIT > testWrite FAILED
java.lang.NoClassDefFoundError: com/google/api/gax/retrying/ExceptionRetryAlgorithm
at java.lang.ClassLoader.defineClass1(Native Method)
at java.lang.ClassLoader.defineClass(ClassLoader.java:763)
at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)
at java.net.URLClassLoader.defineClass(URLClassLoader.java:467)
at java.net.URLClassLoader.access$100(URLClassLoader.java:73)
at java.net.URLClassLoader$1.run(URLClassLoader.java:368)
at java.net.URLClassLoader$1.run(URLClassLoader.java:362)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:361)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:338)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
at com.google.cloud.BaseService.<clinit>(BaseService.java:48)
at com.google.cloud.spanner.SpannerOptions$DefaultSpannerFactory.create(SpannerOptions.java:60)
at com.google.cloud.spanner.SpannerOptions$DefaultSpannerFactory.create(SpannerOptions.java:55)
at com.google.cloud.ServiceOptions.getService(ServiceOptions.java:426)
at org.apache.beam.sdk.io.gcp.spanner.SpannerWriteIT.setUp(SpannerWriteIT.java:91)
Caused by:
java.lang.ClassNotFoundException: com.google.api.gax.retrying.ExceptionRetryAlgorithm
at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:338)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
... 17 more
java.lang.NullPointerException
at org.apache.beam.sdk.io.gcp.spanner.SpannerWriteIT.tearDown(SpannerWriteIT.java:148)
org.apache.beam.sdk.io.gcp.datastore.V1WriteIT > testE2EV1Write STANDARD_ERROR
Apr 25, 2018 10:55:32 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T22:55:21.282Z: Autoscaling is enabled for job 2018-04-25_15_55_21-10465330941772867377. The number of workers will be between 1 and 1000.
Apr 25, 2018 10:55:32 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T22:55:21.306Z: Autoscaling was automatically enabled for job 2018-04-25_15_55_21-10465330941772867377.
Apr 25, 2018 10:55:32 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T22:55:23.825Z: Checking required Cloud APIs are enabled.
Apr 25, 2018 10:55:32 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T22:55:23.989Z: Checking permissions granted to controller Service Account.
Apr 25, 2018 10:55:32 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T22:55:28.381Z: Worker configuration: n1-standard-1 in us-central1-c.
Apr 25, 2018 10:55:32 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T22:55:28.723Z: Expanding CoGroupByKey operations into optimizable parts.
Apr 25, 2018 10:55:32 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T22:55:28.752Z: Expanding GroupByKey operations into optimizable parts.
Apr 25, 2018 10:55:32 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T22:55:28.789Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
Apr 25, 2018 10:55:32 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T22:55:28.847Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
Apr 25, 2018 10:55:32 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T22:55:28.874Z: Fusing consumer ParDo(CreateEntity) into GenerateSequence/Read(BoundedCountingSource)
Apr 25, 2018 10:55:32 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T22:55:28.899Z: Fusing consumer DatastoreV1.Write/Write Mutation to Datastore into DatastoreV1.Write/Convert to Mutation/Map
Apr 25, 2018 10:55:32 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T22:55:28.923Z: Fusing consumer DatastoreV1.Write/Convert to Mutation/Map into ParDo(CreateEntity)
Apr 25, 2018 10:55:32 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T22:55:29.249Z: Executing operation GenerateSequence/Read(BoundedCountingSource)+ParDo(CreateEntity)+DatastoreV1.Write/Convert to Mutation/Map+DatastoreV1.Write/Write Mutation to Datastore
Apr 25, 2018 10:55:32 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T22:55:29.323Z: Starting 1 workers in us-central1-c...
Apr 25, 2018 10:55:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T22:55:36.630Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
Apr 25, 2018 10:55:47 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T22:55:47.078Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
Apr 25, 2018 10:56:22 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T22:56:21.441Z: Workers have started successfully.
Apr 25, 2018 10:56:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T22:56:57.677Z: Cleaning up.
Apr 25, 2018 10:56:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T22:56:57.741Z: Stopping worker pool...
Apr 25, 2018 10:58:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T22:58:32.031Z: Autoscaling: Resized worker pool from 1 to 0.
Apr 25, 2018 10:58:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T22:58:32.055Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
Apr 25, 2018 10:58:40 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-04-25_15_55_21-10465330941772867377 finished with status DONE.
Apr 25, 2018 10:58:40 PM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-04-25_15_55_21-10465330941772867377. Found 0 success, 0 failures out of 0 expected assertions.
Apr 25, 2018 10:58:41 PM org.apache.beam.sdk.io.gcp.datastore.V1TestUtil$V1TestWriter flushBatch
INFO: Writing batch of 500 entities
Apr 25, 2018 10:58:41 PM org.apache.beam.sdk.io.gcp.datastore.V1TestUtil$V1TestWriter flushBatch
INFO: Successfully wrote 500 entities
Apr 25, 2018 10:58:42 PM org.apache.beam.sdk.io.gcp.datastore.V1TestUtil$V1TestWriter flushBatch
INFO: Writing batch of 500 entities
Apr 25, 2018 10:58:42 PM org.apache.beam.sdk.io.gcp.datastore.V1TestUtil$V1TestWriter flushBatch
INFO: Successfully wrote 500 entities
Apr 25, 2018 10:58:42 PM org.apache.beam.sdk.io.gcp.datastore.V1TestUtil deleteAllEntities
INFO: Successfully deleted 1000 entities
org.apache.beam.sdk.io.gcp.spanner.SpannerReadIT > testQuery FAILED
java.lang.NoClassDefFoundError: com/google/api/gax/retrying/ExceptionRetryAlgorithm
at java.lang.ClassLoader.defineClass1(Native Method)
at java.lang.ClassLoader.defineClass(ClassLoader.java:763)
at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)
at java.net.URLClassLoader.defineClass(URLClassLoader.java:467)
at java.net.URLClassLoader.access$100(URLClassLoader.java:73)
at java.net.URLClassLoader$1.run(URLClassLoader.java:368)
at java.net.URLClassLoader$1.run(URLClassLoader.java:362)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:361)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:338)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
at com.google.cloud.BaseService.<clinit>(BaseService.java:48)
at com.google.cloud.spanner.SpannerOptions$DefaultSpannerFactory.create(SpannerOptions.java:60)
at com.google.cloud.spanner.SpannerOptions$DefaultSpannerFactory.create(SpannerOptions.java:55)
at com.google.cloud.ServiceOptions.getService(ServiceOptions.java:426)
at org.apache.beam.sdk.io.gcp.spanner.SpannerReadIT.setUp(SpannerReadIT.java:90)
Caused by:
java.lang.ClassNotFoundException: com.google.api.gax.retrying.ExceptionRetryAlgorithm
at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:338)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
... 17 more
java.lang.NullPointerException
at org.apache.beam.sdk.io.gcp.spanner.SpannerReadIT.tearDown(SpannerReadIT.java:198)
Gradle Test Executor 131 finished executing tests.
org.apache.beam.sdk.io.gcp.spanner.SpannerReadIT > testRead FAILED
java.lang.NoClassDefFoundError: Could not initialize class com.google.cloud.spanner.SpannerImpl
at com.google.cloud.spanner.SpannerOptions$DefaultSpannerFactory.create(SpannerOptions.java:60)
at com.google.cloud.spanner.SpannerOptions$DefaultSpannerFactory.create(SpannerOptions.java:55)
at com.google.cloud.ServiceOptions.getService(ServiceOptions.java:426)
at org.apache.beam.sdk.io.gcp.spanner.SpannerReadIT.setUp(SpannerReadIT.java:90)
java.lang.NullPointerException
at org.apache.beam.sdk.io.gcp.spanner.SpannerReadIT.tearDown(SpannerReadIT.java:198)
12 tests completed, 3 failed
Finished generating test XML results (0.008 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/ws/src/runners/google-cloud-dataflow-java/build/test-results/googleCloudPlatformIntegrationTest>
Generating HTML test report...
Finished generating test html results (0.007 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/googleCloudPlatformIntegrationTest>
:beam-runners-google-cloud-dataflow-java:googleCloudPlatformIntegrationTest FAILED
:beam-runners-google-cloud-dataflow-java:googleCloudPlatformIntegrationTest (Thread[Task worker for ':',5,main]) completed. Took 20 mins 27.714 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:googleCloudPlatformIntegrationTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/googleCloudPlatformIntegrationTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.6/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 48m 21s
545 actionable tasks: 542 executed, 3 from cache
Publishing build scan...
https://gradle.com/s/j2hiyu7dsra3g
Build cache (/home/jenkins/.gradle/caches/build-cache-1) has not been cleaned up in 0 days
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user sidhom@google.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user kedin@google.com
Not sending mail to unregistered user kirpichov@google.com
Not sending mail to unregistered user relax@relax-macbookpro2.roam.corp.google.com