You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2018/04/25 02:40:34 UTC
Build failed in Jenkins: beam_PostCommit_Java_GradleBuild #182
See <https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/182/display/redirect?page=changes>
Changes:
[kedin] Add JsonToRow Transform
[kedin] Convert JsonToRow from MapElements.via() to ParDo
------------------------------------------
[...truncated 19.37 MB...]
org.apache.beam.examples.cookbook.TriggerExampleTest > testExtractTotalFlow STANDARD_ERROR
Apr 25, 2018 2:40:23 AM org.apache.beam.sdk.transforms.DoFnTester of
WARNING: Your tests use DoFnTester, which may not exercise DoFns correctly. Please use TestPipeline instead.
org.apache.beam.examples.cookbook.FilterExamplesTest > testFilterSingleMonthDataFn STANDARD_ERROR
Apr 25, 2018 2:40:24 AM org.apache.beam.sdk.transforms.DoFnTester of
WARNING: Your tests use DoFnTester, which may not exercise DoFns correctly. Please use TestPipeline instead.
org.apache.beam.examples.cookbook.FilterExamplesTest > testProjectionFn STANDARD_ERROR
Apr 25, 2018 2:40:24 AM org.apache.beam.sdk.transforms.DoFnTester of
WARNING: Your tests use DoFnTester, which may not exercise DoFns correctly. Please use TestPipeline instead.
org.apache.beam.examples.cookbook.JoinExamplesTest > testExtractCountryInfoFn STANDARD_ERROR
Apr 25, 2018 2:40:24 AM org.apache.beam.sdk.transforms.DoFnTester of
WARNING: Your tests use DoFnTester, which may not exercise DoFns correctly. Please use TestPipeline instead.
org.apache.beam.examples.cookbook.JoinExamplesTest > testExtractEventDataFn STANDARD_ERROR
Apr 25, 2018 2:40:24 AM org.apache.beam.sdk.transforms.DoFnTester of
WARNING: Your tests use DoFnTester, which may not exercise DoFns correctly. Please use TestPipeline instead.
org.apache.beam.examples.DebuggingWordCountTest > testDebuggingWordCount STANDARD_ERROR
Apr 25, 2018 2:40:24 AM org.apache.beam.sdk.io.FileBasedSource getEstimatedSizeBytes
INFO: Filepattern /tmp/junit120444639599036259/junit192480798379155287.tmp matched 1 files with total size 54
Apr 25, 2018 2:40:24 AM org.apache.beam.sdk.io.FileBasedSource split
INFO: Splitting filepattern /tmp/junit120444639599036259/junit192480798379155287.tmp into bundles of size 3 took 1 ms and produced 1 files and 18 bundles
org.apache.beam.examples.WordCountTest > testExtractWordsFn STANDARD_ERROR
Apr 25, 2018 2:40:24 AM org.apache.beam.sdk.transforms.DoFnTester of
WARNING: Your tests use DoFnTester, which may not exercise DoFns correctly. Please use TestPipeline instead.
org.apache.beam.examples.subprocess.ExampleEchoPipelineTest > testExampleEchoPipeline STANDARD_ERROR
Apr 25, 2018 2:40:26 AM org.apache.beam.examples.subprocess.utils.CallingSubProcessUtils initSemaphore
INFO: Initialized Semaphore for binary test-Echo7195164603381926811.sh
Apr 25, 2018 2:40:26 AM org.apache.beam.examples.subprocess.utils.CallingSubProcessUtils setUp
INFO: Calling filesetup to move Executables to worker.
Apr 25, 2018 2:40:26 AM org.apache.beam.examples.subprocess.utils.FileUtils copyFileFromGCSToWorker
INFO: Moving File /tmp/test-Echo7195164603381926811.sh to /tmp/test-Echoo8917452202130660514/test-Echo7195164603381926811.sh
Apr 25, 2018 2:40:26 AM org.apache.beam.examples.subprocess.utils.CallingSubProcessUtils initSemaphore
INFO: Initialized Semaphore for binary test-EchoAgain591204249350566431.sh
Apr 25, 2018 2:40:26 AM org.apache.beam.examples.subprocess.utils.CallingSubProcessUtils setUp
INFO: Calling filesetup to move Executables to worker.
Apr 25, 2018 2:40:26 AM org.apache.beam.examples.subprocess.utils.FileUtils copyFileFromGCSToWorker
INFO: Moving File /tmp/test-EchoAgain591204249350566431.sh to /tmp/test-Echoo8917452202130660514/test-EchoAgain591204249350566431.sh
org.apache.beam.examples.complete.game.HourlyTeamScoreTest > testUserScoresFilter STANDARD_OUT
GOT user3_BananaEmu,BananaEmu,17,1447965690000,2015-11-19 12:41:31.053
GOT user0_MagentaKangaroo,MagentaKangaroo,4,1447965690000,2015-11-19 12:41:31.053
GOT user18_BananaEmu,BananaEmu,1,1447965690000,2015-11-19 12:41:31.053
GOT user2_AmberCockatoo,AmberCockatoo,13,1447965690000,2015-11-19 12:41:31.053
GOT user0_MagentaKangaroo,MagentaKangaroo,3,1447955630000,2015-11-19 09:53:53.444
GOT user18_ApricotCaneToad,ApricotCaneToad,14,1447965690000,2015-11-19 12:41:31.053
GOT user19_BisqueBilby,BisqueBilby,6,1447955630000,2015-11-19 09:53:53.444
GOT user18_BananaEmu,BananaEmu,7,1447965690000,2015-11-19 12:41:31.053
GOT user7_AndroidGreenKookaburra,AndroidGreenKookaburra,11,1447955630000,2015-11-19 09:53:53.444
GOT user7_AndroidGreenKookaburra,AndroidGreenKookaburra,12,1447955630000,2015-11-19 09:53:53.444
GOT user19_BisqueBilby,BisqueBilby,8,1447955630000,2015-11-19 09:53:53.444
GOT user13_ApricotQuokka,ApricotQuokka,15,1447955630000,2015-11-19 09:53:53.444
GOT user7_AlmondWallaby,AlmondWallaby,15,1447955630000,2015-11-19 09:53:53.444
GOT user0_AndroidGreenEchidna,AndroidGreenEchidna,0,1447965690000,2015-11-19 12:41:31.053
GOT user6_AmberNumbat,AmberNumbat,11,1447955630000,2015-11-19 09:53:53.444
org.apache.beam.examples.complete.game.UserScoreTest > testTeamScoreSums STANDARD_OUT
GOT user13_ApricotQuokka,ApricotQuokka,15,1447955630000,2015-11-19 09:53:53.444
GOT user6_AliceBlueDingo,AliceBlueDingo,4,xxxxxxx,2015-11-19 09:53:53.444
GOT user7_AlmondWallaby,AlmondWallaby,15,1447955630000,2015-11-19 09:53:53.444
GOT user7_AndroidGreenKookaburra,AndroidGreenKookaburra,11,1447955630000,2015-11-19 09:53:53.444
GOT user7_AndroidGreenKookaburra,AndroidGreenKookaburra,12,1447955630000,2015-11-19 09:53:53.444
GOT user19_BisqueBilby,BisqueBilby,8,1447955630000,2015-11-19 09:53:53.444
GOT user6_AmberNumbat,AmberNumbat,11,1447955630000,2015-11-19 09:53:53.444
GOT THIS IS A PARSE ERROR,2015-11-19 09:53:53.444
org.apache.beam.examples.complete.game.UserScoreTest > testTeamScoreSums STANDARD_ERROR
Apr 25, 2018 2:40:27 AM org.apache.beam.examples.complete.game.UserScore$ParseEventFn processElement
INFO: Parse error on user6_AliceBlueDingo,AliceBlueDingo,4,xxxxxxx,2015-11-19 09:53:53.444, For input string: "xxxxxxx"
org.apache.beam.examples.complete.game.UserScoreTest > testTeamScoreSums STANDARD_OUT
GOT user19_BisqueBilby,BisqueBilby,6,1447955630000,2015-11-19 09:53:53.444
GOT user0_MagentaKangaroo,MagentaKangaroo,3,1447955630000,2015-11-19 09:53:53.444
org.apache.beam.examples.complete.game.UserScoreTest > testTeamScoreSums STANDARD_ERROR
Apr 25, 2018 2:40:27 AM org.apache.beam.examples.complete.game.UserScore$ParseEventFn processElement
INFO: Parse error on THIS IS A PARSE ERROR,2015-11-19 09:53:53.444, 2
org.apache.beam.examples.complete.game.UserScoreTest > testUserScoresBadInput STANDARD_OUT
GOT user13_BisqueBilby,BisqueBilby,xxx,1447955630000,2015-11-19 09:53:53.444
GOT THIS IS A PARSE ERROR,2015-11-19 09:53:53.444
GOT user6_AliceBlueDingo,AliceBlueDingo,4,xxxxxxx,2015-11-19 09:53:53.444
org.apache.beam.examples.complete.game.UserScoreTest > testUserScoresBadInput STANDARD_ERROR
Apr 25, 2018 2:40:27 AM org.apache.beam.examples.complete.game.UserScore$ParseEventFn processElement
INFO: Parse error on THIS IS A PARSE ERROR,2015-11-19 09:53:53.444, 2
Apr 25, 2018 2:40:27 AM org.apache.beam.examples.complete.game.UserScore$ParseEventFn processElement
INFO: Parse error on user6_AliceBlueDingo,AliceBlueDingo,4,xxxxxxx,2015-11-19 09:53:53.444, For input string: "xxxxxxx"
Apr 25, 2018 2:40:27 AM org.apache.beam.examples.complete.game.UserScore$ParseEventFn processElement
INFO: Parse error on user13_BisqueBilby,BisqueBilby,xxx,1447955630000,2015-11-19 09:53:53.444, For input string: "xxx"
org.apache.beam.examples.complete.game.UserScoreTest > testUserScoreSums STANDARD_OUT
GOT user6_AliceBlueDingo,AliceBlueDingo,4,xxxxxxx,2015-11-19 09:53:53.444
GOT user7_AndroidGreenKookaburra,AndroidGreenKookaburra,12,1447955630000,2015-11-19 09:53:53.444
GOT user7_AndroidGreenKookaburra,AndroidGreenKookaburra,11,1447955630000,2015-11-19 09:53:53.444
GOT user6_AmberNumbat,AmberNumbat,11,1447955630000,2015-11-19 09:53:53.444
GOT user13_ApricotQuokka,ApricotQuokka,15,1447955630000,2015-11-19 09:53:53.444
GOT user19_BisqueBilby,BisqueBilby,8,1447955630000,2015-11-19 09:53:53.444
GOT user19_BisqueBilby,BisqueBilby,6,1447955630000,2015-11-19 09:53:53.444
GOT user0_MagentaKangaroo,MagentaKangaroo,3,1447955630000,2015-11-19 09:53:53.444
GOT user7_AlmondWallaby,AlmondWallaby,15,1447955630000,2015-11-19 09:53:53.444
GOT THIS IS A PARSE ERROR,2015-11-19 09:53:53.444
org.apache.beam.examples.complete.game.UserScoreTest > testUserScoreSums STANDARD_ERROR
Apr 25, 2018 2:40:27 AM org.apache.beam.examples.complete.game.UserScore$ParseEventFn processElement
INFO: Parse error on user6_AliceBlueDingo,AliceBlueDingo,4,xxxxxxx,2015-11-19 09:53:53.444, For input string: "xxxxxxx"
Apr 25, 2018 2:40:27 AM org.apache.beam.examples.complete.game.UserScore$ParseEventFn processElement
INFO: Parse error on THIS IS A PARSE ERROR,2015-11-19 09:53:53.444, 2
org.apache.beam.examples.complete.game.UserScoreTest > testParseEventFn STANDARD_ERROR
Apr 25, 2018 2:40:27 AM org.apache.beam.sdk.transforms.DoFnTester of
WARNING: Your tests use DoFnTester, which may not exercise DoFns correctly. Please use TestPipeline instead.
org.apache.beam.examples.complete.game.UserScoreTest > testParseEventFn STANDARD_OUT
GOT user0_MagentaKangaroo,MagentaKangaroo,3,1447955630000,2015-11-19 09:53:53.444
GOT user13_ApricotQuokka,ApricotQuokka,15,1447955630000,2015-11-19 09:53:53.444
GOT user6_AmberNumbat,AmberNumbat,11,1447955630000,2015-11-19 09:53:53.444
GOT user7_AlmondWallaby,AlmondWallaby,15,1447955630000,2015-11-19 09:53:53.444
GOT user7_AndroidGreenKookaburra,AndroidGreenKookaburra,12,1447955630000,2015-11-19 09:53:53.444
GOT user6_AliceBlueDingo,AliceBlueDingo,4,xxxxxxx,2015-11-19 09:53:53.444
org.apache.beam.examples.complete.game.UserScoreTest > testParseEventFn STANDARD_ERROR
Apr 25, 2018 2:40:27 AM org.apache.beam.examples.complete.game.UserScore$ParseEventFn processElement
INFO: Parse error on user6_AliceBlueDingo,AliceBlueDingo,4,xxxxxxx,2015-11-19 09:53:53.444, For input string: "xxxxxxx"
org.apache.beam.examples.complete.game.UserScoreTest > testParseEventFn STANDARD_OUT
GOT user7_AndroidGreenKookaburra,AndroidGreenKookaburra,11,1447955630000,2015-11-19 09:53:53.444
GOT THIS IS A PARSE ERROR,2015-11-19 09:53:53.444
org.apache.beam.examples.complete.game.UserScoreTest > testParseEventFn STANDARD_ERROR
Apr 25, 2018 2:40:27 AM org.apache.beam.examples.complete.game.UserScore$ParseEventFn processElement
INFO: Parse error on THIS IS A PARSE ERROR,2015-11-19 09:53:53.444, 2
org.apache.beam.examples.complete.game.UserScoreTest > testParseEventFn STANDARD_OUT
GOT user19_BisqueBilby,BisqueBilby,6,1447955630000,2015-11-19 09:53:53.444
GOT user19_BisqueBilby,BisqueBilby,8,1447955630000,2015-11-19 09:53:53.444
org.apache.beam.examples.complete.game.GameStatsTest > testCalculateSpammyUsers STANDARD_ERROR
Apr 25, 2018 2:40:27 AM org.apache.beam.examples.complete.game.GameStats$CalculateSpammyUsers$1 processElement
INFO: user Robot-2 spammer score 66 with mean 24.923076923076923
Apr 25, 2018 2:40:27 AM org.apache.beam.examples.complete.game.GameStats$CalculateSpammyUsers$1 processElement
INFO: user Robot-1 spammer score 116 with mean 24.923076923076923
Gradle Test Executor 132 finished executing tests.
Finished generating test XML results (0.001 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/ws/src/examples/java/build/test-results/test>
Generating HTML test report...
Finished generating test html results (0.002 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/ws/src/examples/java/build/reports/tests/test>
Packing task ':beam-examples-java:test'
:beam-examples-java:test (Thread[Task worker for ':' Thread 3,5,main]) completed. Took 9.874 secs.
:beam-examples-java:check (Thread[Task worker for ':' Thread 3,5,main]) started.
:beam-examples-java:check
Skipping task ':beam-examples-java:check' as it has no actions.
:beam-examples-java:check (Thread[Task worker for ':' Thread 3,5,main]) completed. Took 0.0 secs.
:beam-examples-java:build (Thread[Task worker for ':' Thread 3,5,main]) started.
:beam-examples-java:build
Skipping task ':beam-examples-java:build' as it has no actions.
:beam-examples-java:build (Thread[Task worker for ':' Thread 3,5,main]) completed. Took 0.0 secs.
:beam-examples-java:buildDependents (Thread[Task worker for ':' Thread 3,5,main]) started.
:beam-examples-java:buildDependents
Caching disabled for task ':beam-examples-java:buildDependents': Caching has not been enabled for the task
Task ':beam-examples-java:buildDependents' is not up-to-date because:
Task has not declared any outputs.
:beam-examples-java:buildDependents (Thread[Task worker for ':' Thread 3,5,main]) completed. Took 0.0 secs.
:beam-sdks-java-io-google-cloud-platform:buildDependents (Thread[Task worker for ':' Thread 3,5,main]) started.
:beam-sdks-java-io-google-cloud-platform:buildDependents
Caching disabled for task ':beam-sdks-java-io-google-cloud-platform:buildDependents': Caching has not been enabled for the task
Task ':beam-sdks-java-io-google-cloud-platform:buildDependents' is not up-to-date because:
Task has not declared any outputs.
:beam-sdks-java-io-google-cloud-platform:buildDependents (Thread[Task worker for ':' Thread 3,5,main]) completed. Took 0.0 secs.
:beam-runners-direct-java:buildDependents (Thread[Task worker for ':' Thread 8,5,main]) started.
:beam-sdks-java-extensions-google-cloud-platform-core:buildDependents (Thread[Task worker for ':' Thread 2,5,main]) started.
:beam-runners-direct-java:buildDependents
:beam-sdks-java-extensions-google-cloud-platform-core:buildDependents
:beam-sdks-java-extensions-protobuf:buildDependents (Thread[Task worker for ':',5,main]) started.
:beam-sdks-java-extensions-protobuf:buildDependents
Caching disabled for task ':beam-sdks-java-extensions-google-cloud-platform-core:buildDependents': Caching has not been enabled for the task
Caching disabled for task ':beam-runners-direct-java:buildDependents': Caching has not been enabled for the task
Caching disabled for task ':beam-sdks-java-extensions-protobuf:buildDependents': Caching has not been enabled for the task
Task ':beam-sdks-java-extensions-protobuf:buildDependents' is not up-to-date because:
Task has not declared any outputs.
Task ':beam-sdks-java-extensions-google-cloud-platform-core:buildDependents' is not up-to-date because:
Task has not declared any outputs.
Task ':beam-runners-direct-java:buildDependents' is not up-to-date because:
Task has not declared any outputs.
:beam-sdks-java-extensions-protobuf:buildDependents (Thread[Task worker for ':',5,main]) completed. Took 0.0 secs.
:beam-sdks-java-extensions-google-cloud-platform-core:buildDependents (Thread[Task worker for ':' Thread 2,5,main]) completed. Took 0.0 secs.
:beam-runners-direct-java:buildDependents (Thread[Task worker for ':' Thread 8,5,main]) completed. Took 0.0 secs.
:beam-runners-core-java:buildDependents (Thread[Task worker for ':' Thread 2,5,main]) started.
:beam-runners-core-java:buildDependents
:beam-runners-local-java-core:buildDependents (Thread[Task worker for ':' Thread 8,5,main]) started.
:beam-runners-local-java-core:buildDependents
Caching disabled for task ':beam-runners-core-java:buildDependents': Caching has not been enabled for the task
Task ':beam-runners-core-java:buildDependents' is not up-to-date because:
Task has not declared any outputs.
Caching disabled for task ':beam-runners-local-java-core:buildDependents': Caching has not been enabled for the task
Task ':beam-runners-local-java-core:buildDependents' is not up-to-date because:
Task has not declared any outputs.
:beam-runners-core-java:buildDependents (Thread[Task worker for ':' Thread 2,5,main]) completed. Took 0.0 secs.
:beam-runners-core-construction-java:buildDependents (Thread[Task worker for ':' Thread 2,5,main]) started.
:beam-runners-local-java-core:buildDependents (Thread[Task worker for ':' Thread 8,5,main]) completed. Took 0.0 secs.
:beam-runners-core-construction-java:buildDependents
Caching disabled for task ':beam-runners-core-construction-java:buildDependents': Caching has not been enabled for the task
Task ':beam-runners-core-construction-java:buildDependents' is not up-to-date because:
Task has not declared any outputs.
:beam-runners-core-construction-java:buildDependents (Thread[Task worker for ':' Thread 2,5,main]) completed. Took 0.0 secs.
:beam-sdks-java-core:buildDependents (Thread[Task worker for ':' Thread 12,5,main]) started.
:beam-sdks-java-core:buildDependents
Caching disabled for task ':beam-sdks-java-core:buildDependents': Caching has not been enabled for the task
Task ':beam-sdks-java-core:buildDependents' is not up-to-date because:
Task has not declared any outputs.
:beam-sdks-java-core:buildDependents (Thread[Task worker for ':' Thread 12,5,main]) completed. Took 0.0 secs.
:javaPreCommit (Thread[Task worker for ':' Thread 12,5,main]) started.
:javaPreCommit
Skipping task ':javaPreCommit' as it has no actions.
:javaPreCommit (Thread[Task worker for ':' Thread 12,5,main]) completed. Took 0.0 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:googleCloudPlatformIntegrationTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/googleCloudPlatformIntegrationTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.6/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 30m 7s
541 actionable tasks: 538 executed, 3 from cache
Publishing build scan...
https://gradle.com/s/aeoxadctfs3sw
Build cache (/home/jenkins/.gradle/caches/build-cache-1) has not been cleaned up in 0 days
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user kedin@google.com
Not sending mail to unregistered user kirpichov@google.com
Build failed in Jenkins: beam_PostCommit_Java_GradleBuild #192
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/192/display/redirect?page=changes>
Changes:
[swegner] Upgrade Gradle to 4.7
------------------------------------------
[...truncated 19.83 MB...]
Apr 26, 2018 2:52:00 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:51:56.072Z: Fusing consumer PAssert$3/CreateActual/GatherPanes/Reify.Window/ParDo(Anonymous) into PAssert$3/CreateActual/FilterActuals/Window.Assign
Apr 26, 2018 2:52:00 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:51:56.106Z: Fusing consumer PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
Apr 26, 2018 2:52:00 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:51:56.144Z: Fusing consumer PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
Apr 26, 2018 2:52:00 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:51:56.178Z: Fusing consumer PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
Apr 26, 2018 2:52:00 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:51:56.222Z: Fusing consumer PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
Apr 26, 2018 2:52:00 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:51:56.257Z: Fusing consumer PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
Apr 26, 2018 2:52:00 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:51:56.285Z: Fusing consumer PAssert$3/CreateActual/RewindowActuals/Window.Assign into PAssert$3/CreateActual/Flatten.Iterables/FlattenIterables/FlatMap
Apr 26, 2018 2:52:00 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:51:56.323Z: Fusing consumer PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
Apr 26, 2018 2:52:00 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:51:56.352Z: Fusing consumer PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
Apr 26, 2018 2:52:00 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:51:56.386Z: Fusing consumer PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
Apr 26, 2018 2:52:00 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:51:56.420Z: Fusing consumer PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
Apr 26, 2018 2:52:00 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:51:56.461Z: Fusing consumer PAssert$3/CreateActual/ParDo(Anonymous) into PAssert$3/CreateActual/RewindowActuals/Window.Assign
Apr 26, 2018 2:52:00 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:51:56.500Z: Fusing consumer PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into PAssert$3/CreateActual/ParDo(Anonymous)
Apr 26, 2018 2:52:00 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:51:56.534Z: Fusing consumer Combine.globally(Count)/ProduceDefault into Combine.globally(Count)/CreateVoid/Read(CreateSource)
Apr 26, 2018 2:52:00 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:51:56.558Z: Fusing consumer Combine.globally(Count)/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow) into Combine.globally(Count)/Values/Values/Map
Apr 26, 2018 2:52:00 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:51:56.598Z: Fusing consumer Combine.globally(Count)/Combine.perKey(Count)/Combine.GroupedValues into Combine.globally(Count)/Combine.perKey(Count)/GroupByKey/Read
Apr 26, 2018 2:52:00 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:51:56.634Z: Fusing consumer Combine.globally(Count)/Combine.perKey(Count)/GroupByKey+Combine.globally(Count)/Combine.perKey(Count)/Combine.GroupedValues/Partial into Combine.globally(Count)/WithKeys/AddKeys/Map
Apr 26, 2018 2:52:00 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:51:56.661Z: Fusing consumer DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/GroupByWindow into DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/Read
Apr 26, 2018 2:52:00 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:51:56.696Z: Fusing consumer Combine.globally(Count)/Combine.perKey(Count)/GroupByKey/Reify into Combine.globally(Count)/Combine.perKey(Count)/GroupByKey+Combine.globally(Count)/Combine.perKey(Count)/Combine.GroupedValues/Partial
Apr 26, 2018 2:52:00 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:51:56.741Z: Fusing consumer Combine.globally(Count)/WithKeys/AddKeys/Map into DatastoreV1.Read/Read
Apr 26, 2018 2:52:00 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:51:56.774Z: Fusing consumer DatastoreV1.Read/Reshuffle/Pair with random key into DatastoreV1.Read/Split
Apr 26, 2018 2:52:00 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:51:56.806Z: Fusing consumer DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/Write into DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/Reify
Apr 26, 2018 2:52:00 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:51:56.834Z: Fusing consumer DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/Reify into DatastoreV1.Read/Reshuffle/Reshuffle/Window.Into()/Window.Assign
Apr 26, 2018 2:52:00 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:51:56.863Z: Fusing consumer Combine.globally(Count)/Values/Values/Map into Combine.globally(Count)/Combine.perKey(Count)/Combine.GroupedValues/Extract
Apr 26, 2018 2:52:00 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:51:56.884Z: Fusing consumer DatastoreV1.Read/Split into DatastoreV1.Read/ParDo(GqlQueryTranslate)
Apr 26, 2018 2:52:00 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:51:56.915Z: Fusing consumer DatastoreV1.Read/Reshuffle/Reshuffle/Window.Into()/Window.Assign into DatastoreV1.Read/Reshuffle/Pair with random key
Apr 26, 2018 2:52:00 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:51:56.942Z: Fusing consumer Combine.globally(Count)/Combine.perKey(Count)/GroupByKey/Write into Combine.globally(Count)/Combine.perKey(Count)/GroupByKey/Reify
Apr 26, 2018 2:52:00 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:51:56.976Z: Fusing consumer DatastoreV1.Read/ParDo(GqlQueryTranslate) into DatastoreV1.Read/Create.OfValueProvider/Create.Values/Read(CreateSource)
Apr 26, 2018 2:52:00 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:51:57.012Z: Fusing consumer DatastoreV1.Read/Read into DatastoreV1.Read/Reshuffle/Values/Values/Map
Apr 26, 2018 2:52:00 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:51:57.038Z: Fusing consumer DatastoreV1.Read/Reshuffle/Values/Values/Map into DatastoreV1.Read/Reshuffle/Reshuffle/ExpandIterable
Apr 26, 2018 2:52:00 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:51:57.073Z: Fusing consumer DatastoreV1.Read/Reshuffle/Reshuffle/ExpandIterable into DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/GroupByWindow
Apr 26, 2018 2:52:00 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:51:57.102Z: Fusing consumer Combine.globally(Count)/Combine.perKey(Count)/Combine.GroupedValues/Extract into Combine.globally(Count)/Combine.perKey(Count)/Combine.GroupedValues
Apr 26, 2018 2:52:00 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:51:57.139Z: Fusing consumer PAssert$3/RunChecks into PAssert$3/WindowToken/Window.Assign
Apr 26, 2018 2:52:00 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:51:57.170Z: Fusing consumer PAssert$3/WindowToken/Window.Assign into PAssert$3/Create.Values/Read(CreateSource)
Apr 26, 2018 2:52:00 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:51:57.200Z: Fusing consumer PAssert$3/VerifyAssertions/ParDo(DefaultConclude) into PAssert$3/RunChecks
Apr 26, 2018 2:52:00 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:51:57.592Z: Executing operation Combine.globally(Count)/Combine.perKey(Count)/GroupByKey/Create
Apr 26, 2018 2:52:00 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:51:57.623Z: Executing operation PAssert$3/CreateActual/GatherPanes/GroupByKey/Create
Apr 26, 2018 2:52:00 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:51:57.655Z: Executing operation PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
Apr 26, 2018 2:52:00 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:51:57.666Z: Starting 1 workers in us-central1-f...
Apr 26, 2018 2:52:00 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:51:57.690Z: Executing operation PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
Apr 26, 2018 2:52:00 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:51:57.713Z: Executing operation DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/Create
Apr 26, 2018 2:52:07 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:52:06.676Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
Apr 26, 2018 2:52:07 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:52:06.909Z: Executing operation DatastoreV1.Read/Create.OfValueProvider/Create.Values/Read(CreateSource)+DatastoreV1.Read/ParDo(GqlQueryTranslate)+DatastoreV1.Read/Split+DatastoreV1.Read/Reshuffle/Pair with random key+DatastoreV1.Read/Reshuffle/Reshuffle/Window.Into()/Window.Assign+DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/Reify+DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/Write
Apr 26, 2018 2:52:14 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:52:12.259Z: Autoscaling: Resizing worker pool from 1 to 5.
Apr 26, 2018 2:52:20 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:52:18.938Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
Apr 26, 2018 2:52:20 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:52:18.978Z: Resized worker pool to 1, though goal was 5. This could be a quota issue.
Apr 26, 2018 2:52:29 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:52:29.567Z: Autoscaling: Raised the number of workers to 3 based on the rate of progress in the currently running step(s).
Apr 26, 2018 2:52:29 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:52:29.598Z: Resized worker pool to 3, though goal was 5. This could be a quota issue.
Apr 26, 2018 2:52:41 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:52:40.209Z: Autoscaling: Raised the number of workers to 4 based on the rate of progress in the currently running step(s).
Apr 26, 2018 2:52:41 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:52:40.397Z: Resized worker pool to 4, though goal was 5. This could be a quota issue.
Apr 26, 2018 2:52:41 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:52:40.979Z: Workers have started successfully.
Apr 26, 2018 2:52:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:52:50.936Z: Autoscaling: Raised the number of workers to 5 based on the rate of progress in the currently running step(s).
Apr 26, 2018 2:53:04 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:53:03.345Z: Executing operation DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/Close
Apr 26, 2018 2:53:04 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:53:03.450Z: Executing operation DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/Read+DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/GroupByWindow+DatastoreV1.Read/Reshuffle/Reshuffle/ExpandIterable+DatastoreV1.Read/Reshuffle/Values/Values/Map+DatastoreV1.Read/Read+Combine.globally(Count)/WithKeys/AddKeys/Map+Combine.globally(Count)/Combine.perKey(Count)/GroupByKey+Combine.globally(Count)/Combine.perKey(Count)/Combine.GroupedValues/Partial+Combine.globally(Count)/Combine.perKey(Count)/GroupByKey/Reify+Combine.globally(Count)/Combine.perKey(Count)/GroupByKey/Write
Apr 26, 2018 2:53:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:53:13.256Z: Executing operation Combine.globally(Count)/Combine.perKey(Count)/GroupByKey/Close
Apr 26, 2018 2:53:13 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:53:13.386Z: Executing operation Combine.globally(Count)/Combine.perKey(Count)/GroupByKey/Read+Combine.globally(Count)/Combine.perKey(Count)/Combine.GroupedValues+Combine.globally(Count)/Combine.perKey(Count)/Combine.GroupedValues/Extract+Combine.globally(Count)/Values/Values/Map+PAssert$3/CreateActual/FilterActuals/Window.Assign+PAssert$3/CreateActual/GatherPanes/Reify.Window/ParDo(Anonymous)+PAssert$3/CreateActual/GatherPanes/WithKeys/AddKeys/Map+PAssert$3/CreateActual/GatherPanes/Window.Into()/Window.Assign+PAssert$3/CreateActual/GatherPanes/GroupByKey/Reify+PAssert$3/CreateActual/GatherPanes/GroupByKey/Write+Combine.globally(Count)/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow)
Apr 26, 2018 2:53:18 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:53:17.714Z: Executing operation Combine.globally(Count)/View.AsIterable/CreateDataflowView
Apr 26, 2018 2:53:18 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:53:17.887Z: Executing operation Combine.globally(Count)/CreateVoid/Read(CreateSource)+Combine.globally(Count)/ProduceDefault+PAssert$3/CreateActual/FilterActuals/Window.Assign+PAssert$3/CreateActual/GatherPanes/Reify.Window/ParDo(Anonymous)+PAssert$3/CreateActual/GatherPanes/WithKeys/AddKeys/Map+PAssert$3/CreateActual/GatherPanes/Window.Into()/Window.Assign+PAssert$3/CreateActual/GatherPanes/GroupByKey/Reify+PAssert$3/CreateActual/GatherPanes/GroupByKey/Write
Apr 26, 2018 2:53:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:53:20.740Z: Executing operation PAssert$3/CreateActual/GatherPanes/GroupByKey/Close
Apr 26, 2018 2:53:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:53:20.823Z: Executing operation PAssert$3/CreateActual/GatherPanes/GroupByKey/Read+PAssert$3/CreateActual/GatherPanes/GroupByKey/GroupByWindow+PAssert$3/CreateActual/GatherPanes/Values/Values/Map+PAssert$3/CreateActual/ExtractPane/Map+PAssert$3/CreateActual/Flatten.Iterables/FlattenIterables/FlatMap+PAssert$3/CreateActual/RewindowActuals/Window.Assign+PAssert$3/CreateActual/ParDo(Anonymous)+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
Apr 26, 2018 2:53:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:53:26.150Z: Executing operation PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
Apr 26, 2018 2:53:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:53:26.238Z: Executing operation PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
Apr 26, 2018 2:53:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:53:26.763Z: Executing operation PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
Apr 26, 2018 2:53:28 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:53:26.851Z: Executing operation PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
Apr 26, 2018 2:53:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:53:30.629Z: Executing operation PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
Apr 26, 2018 2:53:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:53:30.815Z: Executing operation PAssert$3/Create.Values/Read(CreateSource)+PAssert$3/WindowToken/Window.Assign+PAssert$3/RunChecks+PAssert$3/VerifyAssertions/ParDo(DefaultConclude)
Apr 26, 2018 2:53:33 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:53:32.882Z: Cleaning up.
Apr 26, 2018 2:53:33 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:53:33.158Z: Stopping worker pool...
Apr 26, 2018 2:55:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:55:15.738Z: Autoscaling: Resized worker pool from 5 to 0.
Apr 26, 2018 2:55:17 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-26T02:55:15.884Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
Apr 26, 2018 2:55:25 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-04-25_19_51_47-7337937995686721741 finished with status DONE.
Apr 26, 2018 2:55:25 AM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-04-25_19_51_47-7337937995686721741. Found 1 success, 0 failures out of 1 expected assertions.
Apr 26, 2018 2:55:26 AM org.apache.beam.sdk.io.gcp.datastore.V1TestUtil$V1TestWriter flushBatch
INFO: Writing batch of 500 entities
Apr 26, 2018 2:55:26 AM org.apache.beam.sdk.io.gcp.datastore.V1TestUtil$V1TestWriter flushBatch
INFO: Successfully wrote 500 entities
Apr 26, 2018 2:55:27 AM org.apache.beam.sdk.io.gcp.datastore.V1TestUtil$V1TestWriter flushBatch
INFO: Writing batch of 500 entities
Apr 26, 2018 2:55:27 AM org.apache.beam.sdk.io.gcp.datastore.V1TestUtil$V1TestWriter flushBatch
INFO: Successfully wrote 500 entities
Apr 26, 2018 2:55:27 AM org.apache.beam.sdk.io.gcp.datastore.V1TestUtil deleteAllEntities
INFO: Successfully deleted 1000 entities
org.apache.beam.sdk.io.gcp.datastore.SplitQueryFnIT > testSplitQueryFnWithLargeDataset STANDARD_ERROR
Apr 26, 2018 2:55:27 AM org.apache.beam.sdk.transforms.DoFnTester of
WARNING: Your tests use DoFnTester, which may not exercise DoFns correctly. Please use TestPipeline instead.
Apr 26, 2018 2:55:27 AM org.apache.beam.sdk.io.gcp.datastore.DatastoreV1$Read getEstimatedSizeBytes
INFO: Latest stats timestamp for kind sort_1G is 1524555829000000
Apr 26, 2018 2:55:27 AM org.apache.beam.sdk.io.gcp.datastore.DatastoreV1$Read getEstimatedNumSplits
INFO: Estimated size bytes for the query is: 2130000000
Apr 26, 2018 2:55:27 AM org.apache.beam.sdk.io.gcp.datastore.DatastoreV1$Read$SplitQueryFn processElement
INFO: Splitting the query into 32 splits
org.apache.beam.sdk.io.gcp.datastore.SplitQueryFnIT > testSplitQueryFnWithSmallDataset STANDARD_ERROR
Apr 26, 2018 2:55:28 AM org.apache.beam.sdk.transforms.DoFnTester of
WARNING: Your tests use DoFnTester, which may not exercise DoFns correctly. Please use TestPipeline instead.
Apr 26, 2018 2:55:28 AM org.apache.beam.sdk.io.gcp.datastore.DatastoreV1$Read getEstimatedSizeBytes
INFO: Latest stats timestamp for kind shakespeare is 1524555829000000
Apr 26, 2018 2:55:28 AM org.apache.beam.sdk.io.gcp.datastore.DatastoreV1$Read getEstimatedNumSplits
INFO: Estimated size bytes for the query is: 26383451
Apr 26, 2018 2:55:28 AM org.apache.beam.sdk.io.gcp.datastore.DatastoreV1$Read$SplitQueryFn processElement
INFO: Splitting the query into 12 splits
Gradle Test Executor 123 finished executing tests.
> Task :beam-runners-google-cloud-dataflow-java:googleCloudPlatformIntegrationTest FAILED
org.apache.beam.sdk.io.gcp.spanner.SpannerWriteIT > testWrite FAILED
java.lang.NoClassDefFoundError: com/google/api/gax/retrying/ExceptionRetryAlgorithm
at java.lang.ClassLoader.defineClass1(Native Method)
at java.lang.ClassLoader.defineClass(ClassLoader.java:763)
at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)
at java.net.URLClassLoader.defineClass(URLClassLoader.java:467)
at java.net.URLClassLoader.access$100(URLClassLoader.java:73)
at java.net.URLClassLoader$1.run(URLClassLoader.java:368)
at java.net.URLClassLoader$1.run(URLClassLoader.java:362)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:361)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:338)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
at com.google.cloud.BaseService.<clinit>(BaseService.java:48)
at com.google.cloud.spanner.SpannerOptions$DefaultSpannerFactory.create(SpannerOptions.java:60)
at com.google.cloud.spanner.SpannerOptions$DefaultSpannerFactory.create(SpannerOptions.java:55)
at com.google.cloud.ServiceOptions.getService(ServiceOptions.java:426)
at org.apache.beam.sdk.io.gcp.spanner.SpannerWriteIT.setUp(SpannerWriteIT.java:91)
Caused by:
java.lang.ClassNotFoundException: com.google.api.gax.retrying.ExceptionRetryAlgorithm
at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:338)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
... 17 more
java.lang.NullPointerException
at org.apache.beam.sdk.io.gcp.spanner.SpannerWriteIT.tearDown(SpannerWriteIT.java:148)
12 tests completed, 3 failed
Finished generating test XML results (0.007 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/ws/src/runners/google-cloud-dataflow-java/build/test-results/googleCloudPlatformIntegrationTest>
Generating HTML test report...
Finished generating test html results (0.009 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/googleCloudPlatformIntegrationTest>
:beam-runners-google-cloud-dataflow-java:googleCloudPlatformIntegrationTest (Thread[Task worker for ':',5,main]) completed. Took 37 mins 36.07 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:googleCloudPlatformIntegrationTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/googleCloudPlatformIntegrationTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.7/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1h 11m 23s
546 actionable tasks: 546 executed
Publishing build scan...
https://gradle.com/s/3mlk5zvsljg6i
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user sidhom@google.com
Not sending mail to unregistered user swegner@google.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user kedin@google.com
Not sending mail to unregistered user kirpichov@google.com
Not sending mail to unregistered user relax@relax-macbookpro2.roam.corp.google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Build failed in Jenkins: beam_PostCommit_Java_GradleBuild #191
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/191/display/redirect>
------------------------------------------
[...truncated 19.45 MB...]
org.apache.beam.examples.cookbook.FilterExamplesTest > testFilterSingleMonthDataFn STANDARD_ERROR
Apr 26, 2018 12:40:07 AM org.apache.beam.sdk.transforms.DoFnTester of
WARNING: Your tests use DoFnTester, which may not exercise DoFns correctly. Please use TestPipeline instead.
org.apache.beam.examples.cookbook.FilterExamplesTest > testProjectionFn STANDARD_ERROR
Apr 26, 2018 12:40:07 AM org.apache.beam.sdk.transforms.DoFnTester of
WARNING: Your tests use DoFnTester, which may not exercise DoFns correctly. Please use TestPipeline instead.
org.apache.beam.examples.cookbook.JoinExamplesTest > testExtractCountryInfoFn STANDARD_ERROR
Apr 26, 2018 12:40:07 AM org.apache.beam.sdk.transforms.DoFnTester of
WARNING: Your tests use DoFnTester, which may not exercise DoFns correctly. Please use TestPipeline instead.
org.apache.beam.examples.cookbook.JoinExamplesTest > testExtractEventDataFn STANDARD_ERROR
Apr 26, 2018 12:40:07 AM org.apache.beam.sdk.transforms.DoFnTester of
WARNING: Your tests use DoFnTester, which may not exercise DoFns correctly. Please use TestPipeline instead.
org.apache.beam.examples.DebuggingWordCountTest > testDebuggingWordCount STANDARD_ERROR
Apr 26, 2018 12:40:08 AM org.apache.beam.sdk.io.FileBasedSource getEstimatedSizeBytes
INFO: Filepattern /tmp/junit2685520963253068630/junit6928613568339758149.tmp matched 1 files with total size 54
Apr 26, 2018 12:40:08 AM org.apache.beam.sdk.io.FileBasedSource split
INFO: Splitting filepattern /tmp/junit2685520963253068630/junit6928613568339758149.tmp into bundles of size 3 took 1 ms and produced 1 files and 18 bundles
org.apache.beam.examples.WordCountTest > testExtractWordsFn STANDARD_ERROR
Apr 26, 2018 12:40:08 AM org.apache.beam.sdk.transforms.DoFnTester of
WARNING: Your tests use DoFnTester, which may not exercise DoFns correctly. Please use TestPipeline instead.
org.apache.beam.examples.subprocess.ExampleEchoPipelineTest > testExampleEchoPipeline STANDARD_ERROR
Apr 26, 2018 12:40:09 AM org.apache.beam.examples.subprocess.utils.CallingSubProcessUtils initSemaphore
INFO: Initialized Semaphore for binary test-Echo703898095940123218.sh
Apr 26, 2018 12:40:09 AM org.apache.beam.examples.subprocess.utils.CallingSubProcessUtils setUp
INFO: Calling filesetup to move Executables to worker.
Apr 26, 2018 12:40:09 AM org.apache.beam.examples.subprocess.utils.FileUtils copyFileFromGCSToWorker
INFO: Moving File /tmp/test-Echo703898095940123218.sh to /tmp/test-Echoo3635545603389323111/test-Echo703898095940123218.sh
Apr 26, 2018 12:40:09 AM org.apache.beam.examples.subprocess.utils.CallingSubProcessUtils initSemaphore
INFO: Initialized Semaphore for binary test-EchoAgain2330251932287909884.sh
Apr 26, 2018 12:40:09 AM org.apache.beam.examples.subprocess.utils.CallingSubProcessUtils setUp
INFO: Calling filesetup to move Executables to worker.
Apr 26, 2018 12:40:09 AM org.apache.beam.examples.subprocess.utils.FileUtils copyFileFromGCSToWorker
INFO: Moving File /tmp/test-EchoAgain2330251932287909884.sh to /tmp/test-Echoo3635545603389323111/test-EchoAgain2330251932287909884.sh
org.apache.beam.examples.complete.game.HourlyTeamScoreTest > testUserScoresFilter STANDARD_OUT
GOT user18_BananaEmu,BananaEmu,1,1447965690000,2015-11-19 12:41:31.053
GOT user7_AlmondWallaby,AlmondWallaby,15,1447955630000,2015-11-19 09:53:53.444
GOT user3_BananaEmu,BananaEmu,17,1447965690000,2015-11-19 12:41:31.053
GOT user0_AndroidGreenEchidna,AndroidGreenEchidna,0,1447965690000,2015-11-19 12:41:31.053
GOT user6_AmberNumbat,AmberNumbat,11,1447955630000,2015-11-19 09:53:53.444
GOT user18_ApricotCaneToad,ApricotCaneToad,14,1447965690000,2015-11-19 12:41:31.053
GOT user2_AmberCockatoo,AmberCockatoo,13,1447965690000,2015-11-19 12:41:31.053
GOT user18_BananaEmu,BananaEmu,7,1447965690000,2015-11-19 12:41:31.053
GOT user19_BisqueBilby,BisqueBilby,6,1447955630000,2015-11-19 09:53:53.444
GOT user7_AndroidGreenKookaburra,AndroidGreenKookaburra,12,1447955630000,2015-11-19 09:53:53.444
GOT user0_MagentaKangaroo,MagentaKangaroo,3,1447955630000,2015-11-19 09:53:53.444
GOT user7_AndroidGreenKookaburra,AndroidGreenKookaburra,11,1447955630000,2015-11-19 09:53:53.444
GOT user13_ApricotQuokka,ApricotQuokka,15,1447955630000,2015-11-19 09:53:53.444
GOT user0_MagentaKangaroo,MagentaKangaroo,4,1447965690000,2015-11-19 12:41:31.053
GOT user19_BisqueBilby,BisqueBilby,8,1447955630000,2015-11-19 09:53:53.444
org.apache.beam.examples.complete.game.UserScoreTest > testTeamScoreSums STANDARD_OUT
GOT THIS IS A PARSE ERROR,2015-11-19 09:53:53.444
GOT user13_ApricotQuokka,ApricotQuokka,15,1447955630000,2015-11-19 09:53:53.444
GOT user6_AliceBlueDingo,AliceBlueDingo,4,xxxxxxx,2015-11-19 09:53:53.444
GOT user7_AlmondWallaby,AlmondWallaby,15,1447955630000,2015-11-19 09:53:53.444
GOT user6_AmberNumbat,AmberNumbat,11,1447955630000,2015-11-19 09:53:53.444
GOT user0_MagentaKangaroo,MagentaKangaroo,3,1447955630000,2015-11-19 09:53:53.444
GOT user19_BisqueBilby,BisqueBilby,8,1447955630000,2015-11-19 09:53:53.444
GOT user7_AndroidGreenKookaburra,AndroidGreenKookaburra,12,1447955630000,2015-11-19 09:53:53.444
GOT user19_BisqueBilby,BisqueBilby,6,1447955630000,2015-11-19 09:53:53.444
GOT user7_AndroidGreenKookaburra,AndroidGreenKookaburra,11,1447955630000,2015-11-19 09:53:53.444
org.apache.beam.examples.complete.game.UserScoreTest > testTeamScoreSums STANDARD_ERROR
Apr 26, 2018 12:40:10 AM org.apache.beam.examples.complete.game.UserScore$ParseEventFn processElement
INFO: Parse error on user6_AliceBlueDingo,AliceBlueDingo,4,xxxxxxx,2015-11-19 09:53:53.444, For input string: "xxxxxxx"
Apr 26, 2018 12:40:10 AM org.apache.beam.examples.complete.game.UserScore$ParseEventFn processElement
INFO: Parse error on THIS IS A PARSE ERROR,2015-11-19 09:53:53.444, 2
org.apache.beam.examples.complete.game.UserScoreTest > testUserScoresBadInput STANDARD_OUT
GOT user6_AliceBlueDingo,AliceBlueDingo,4,xxxxxxx,2015-11-19 09:53:53.444
GOT user13_BisqueBilby,BisqueBilby,xxx,1447955630000,2015-11-19 09:53:53.444
org.apache.beam.examples.complete.game.UserScoreTest > testUserScoresBadInput STANDARD_ERROR
Apr 26, 2018 12:40:11 AM org.apache.beam.examples.complete.game.UserScore$ParseEventFn processElement
INFO: Parse error on user6_AliceBlueDingo,AliceBlueDingo,4,xxxxxxx,2015-11-19 09:53:53.444, For input string: "xxxxxxx"
org.apache.beam.examples.complete.game.UserScoreTest > testUserScoresBadInput STANDARD_OUT
GOT THIS IS A PARSE ERROR,2015-11-19 09:53:53.444
org.apache.beam.examples.complete.game.UserScoreTest > testUserScoresBadInput STANDARD_ERROR
Apr 26, 2018 12:40:11 AM org.apache.beam.examples.complete.game.UserScore$ParseEventFn processElement
INFO: Parse error on THIS IS A PARSE ERROR,2015-11-19 09:53:53.444, 2
Apr 26, 2018 12:40:11 AM org.apache.beam.examples.complete.game.UserScore$ParseEventFn processElement
INFO: Parse error on user13_BisqueBilby,BisqueBilby,xxx,1447955630000,2015-11-19 09:53:53.444, For input string: "xxx"
org.apache.beam.examples.complete.game.UserScoreTest > testUserScoreSums STANDARD_OUT
GOT user6_AliceBlueDingo,AliceBlueDingo,4,xxxxxxx,2015-11-19 09:53:53.444
GOT user0_MagentaKangaroo,MagentaKangaroo,3,1447955630000,2015-11-19 09:53:53.444
GOT user6_AmberNumbat,AmberNumbat,11,1447955630000,2015-11-19 09:53:53.444
GOT user19_BisqueBilby,BisqueBilby,6,1447955630000,2015-11-19 09:53:53.444
GOT user13_ApricotQuokka,ApricotQuokka,15,1447955630000,2015-11-19 09:53:53.444
GOT THIS IS A PARSE ERROR,2015-11-19 09:53:53.444
GOT user19_BisqueBilby,BisqueBilby,8,1447955630000,2015-11-19 09:53:53.444
GOT user7_AlmondWallaby,AlmondWallaby,15,1447955630000,2015-11-19 09:53:53.444
GOT user7_AndroidGreenKookaburra,AndroidGreenKookaburra,11,1447955630000,2015-11-19 09:53:53.444
GOT user7_AndroidGreenKookaburra,AndroidGreenKookaburra,12,1447955630000,2015-11-19 09:53:53.444
org.apache.beam.examples.complete.game.UserScoreTest > testUserScoreSums STANDARD_ERROR
Apr 26, 2018 12:40:11 AM org.apache.beam.examples.complete.game.UserScore$ParseEventFn processElement
INFO: Parse error on THIS IS A PARSE ERROR,2015-11-19 09:53:53.444, 2
Apr 26, 2018 12:40:11 AM org.apache.beam.examples.complete.game.UserScore$ParseEventFn processElement
INFO: Parse error on user6_AliceBlueDingo,AliceBlueDingo,4,xxxxxxx,2015-11-19 09:53:53.444, For input string: "xxxxxxx"
org.apache.beam.examples.complete.game.UserScoreTest > testParseEventFn STANDARD_ERROR
Apr 26, 2018 12:40:11 AM org.apache.beam.sdk.transforms.DoFnTester of
WARNING: Your tests use DoFnTester, which may not exercise DoFns correctly. Please use TestPipeline instead.
org.apache.beam.examples.complete.game.UserScoreTest > testParseEventFn STANDARD_OUT
GOT user0_MagentaKangaroo,MagentaKangaroo,3,1447955630000,2015-11-19 09:53:53.444
GOT user13_ApricotQuokka,ApricotQuokka,15,1447955630000,2015-11-19 09:53:53.444
GOT user6_AmberNumbat,AmberNumbat,11,1447955630000,2015-11-19 09:53:53.444
GOT user7_AlmondWallaby,AlmondWallaby,15,1447955630000,2015-11-19 09:53:53.444
GOT user7_AndroidGreenKookaburra,AndroidGreenKookaburra,12,1447955630000,2015-11-19 09:53:53.444
GOT user6_AliceBlueDingo,AliceBlueDingo,4,xxxxxxx,2015-11-19 09:53:53.444
org.apache.beam.examples.complete.game.UserScoreTest > testParseEventFn STANDARD_ERROR
Apr 26, 2018 12:40:11 AM org.apache.beam.examples.complete.game.UserScore$ParseEventFn processElement
INFO: Parse error on user6_AliceBlueDingo,AliceBlueDingo,4,xxxxxxx,2015-11-19 09:53:53.444, For input string: "xxxxxxx"
org.apache.beam.examples.complete.game.UserScoreTest > testParseEventFn STANDARD_OUT
GOT user7_AndroidGreenKookaburra,AndroidGreenKookaburra,11,1447955630000,2015-11-19 09:53:53.444
GOT THIS IS A PARSE ERROR,2015-11-19 09:53:53.444
org.apache.beam.examples.complete.game.UserScoreTest > testParseEventFn STANDARD_ERROR
Apr 26, 2018 12:40:11 AM org.apache.beam.examples.complete.game.UserScore$ParseEventFn processElement
INFO: Parse error on THIS IS A PARSE ERROR,2015-11-19 09:53:53.444, 2
org.apache.beam.examples.complete.game.UserScoreTest > testParseEventFn STANDARD_OUT
GOT user19_BisqueBilby,BisqueBilby,6,1447955630000,2015-11-19 09:53:53.444
GOT user19_BisqueBilby,BisqueBilby,8,1447955630000,2015-11-19 09:53:53.444
org.apache.beam.examples.complete.game.GameStatsTest > testCalculateSpammyUsers STANDARD_ERROR
Apr 26, 2018 12:40:11 AM org.apache.beam.examples.complete.game.GameStats$CalculateSpammyUsers$1 processElement
INFO: user Robot-1 spammer score 116 with mean 24.923076923076923
Apr 26, 2018 12:40:11 AM org.apache.beam.examples.complete.game.GameStats$CalculateSpammyUsers$1 processElement
INFO: user Robot-2 spammer score 66 with mean 24.923076923076923
Gradle Test Executor 133 finished executing tests.
Finished generating test XML results (0.001 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/ws/src/examples/java/build/test-results/test>
Generating HTML test report...
Finished generating test html results (0.002 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/ws/src/examples/java/build/reports/tests/test>
Packing task ':beam-examples-java:test'
:beam-examples-java:test (Thread[Task worker for ':' Thread 10,5,main]) completed. Took 10.232 secs.
:beam-examples-java:check (Thread[Task worker for ':' Thread 10,5,main]) started.
:beam-examples-java:check
Skipping task ':beam-examples-java:check' as it has no actions.
:beam-examples-java:check (Thread[Task worker for ':' Thread 10,5,main]) completed. Took 0.0 secs.
:beam-examples-java:build (Thread[Task worker for ':' Thread 10,5,main]) started.
:beam-examples-java:build
Skipping task ':beam-examples-java:build' as it has no actions.
:beam-examples-java:build (Thread[Task worker for ':' Thread 10,5,main]) completed. Took 0.0 secs.
:beam-examples-java:buildDependents (Thread[Task worker for ':' Thread 10,5,main]) started.
:beam-examples-java:buildDependents
Caching disabled for task ':beam-examples-java:buildDependents': Caching has not been enabled for the task
Task ':beam-examples-java:buildDependents' is not up-to-date because:
Task has not declared any outputs.
:beam-examples-java:buildDependents (Thread[Task worker for ':' Thread 10,5,main]) completed. Took 0.0 secs.
:beam-sdks-java-io-google-cloud-platform:buildDependents (Thread[Task worker for ':' Thread 10,5,main]) started.
:beam-sdks-java-io-google-cloud-platform:buildDependents
Caching disabled for task ':beam-sdks-java-io-google-cloud-platform:buildDependents': Caching has not been enabled for the task
Task ':beam-sdks-java-io-google-cloud-platform:buildDependents' is not up-to-date because:
Task has not declared any outputs.
:beam-sdks-java-io-google-cloud-platform:buildDependents (Thread[Task worker for ':' Thread 10,5,main]) completed. Took 0.0 secs.
:beam-runners-direct-java:buildDependents (Thread[Task worker for ':' Thread 10,5,main]) started.
:beam-sdks-java-extensions-google-cloud-platform-core:buildDependents (Thread[Task worker for ':',5,main]) started.
:beam-runners-direct-java:buildDependents
:beam-sdks-java-extensions-protobuf:buildDependents (Thread[Task worker for ':' Thread 3,5,main]) started.
:beam-sdks-java-extensions-google-cloud-platform-core:buildDependents
:beam-sdks-java-extensions-protobuf:buildDependents
Caching disabled for task ':beam-runners-direct-java:buildDependents': Caching has not been enabled for the task
Caching disabled for task ':beam-sdks-java-extensions-google-cloud-platform-core:buildDependents': Caching has not been enabled for the task
Caching disabled for task ':beam-sdks-java-extensions-protobuf:buildDependents': Caching has not been enabled for the task
Task ':beam-sdks-java-extensions-google-cloud-platform-core:buildDependents' is not up-to-date because:
Task has not declared any outputs.
Task ':beam-runners-direct-java:buildDependents' is not up-to-date because:
Task has not declared any outputs.
Task ':beam-sdks-java-extensions-protobuf:buildDependents' is not up-to-date because:
Task has not declared any outputs.
:beam-runners-direct-java:buildDependents (Thread[Task worker for ':' Thread 10,5,main]) completed. Took 0.0 secs.
:beam-sdks-java-extensions-protobuf:buildDependents (Thread[Task worker for ':' Thread 3,5,main]) completed. Took 0.0 secs.
:beam-sdks-java-extensions-google-cloud-platform-core:buildDependents (Thread[Task worker for ':',5,main]) completed. Took 0.0 secs.
:beam-runners-core-java:buildDependents (Thread[Task worker for ':' Thread 10,5,main]) started.
:beam-runners-local-java-core:buildDependents (Thread[Task worker for ':' Thread 11,5,main]) started.
:beam-runners-core-java:buildDependents
:beam-runners-local-java-core:buildDependents
Caching disabled for task ':beam-runners-core-java:buildDependents': Caching has not been enabled for the task
Task ':beam-runners-core-java:buildDependents' is not up-to-date because:
Task has not declared any outputs.
Caching disabled for task ':beam-runners-local-java-core:buildDependents': Caching has not been enabled for the task
Task ':beam-runners-local-java-core:buildDependents' is not up-to-date because:
Task has not declared any outputs.
:beam-runners-core-java:buildDependents (Thread[Task worker for ':' Thread 10,5,main]) completed. Took 0.0 secs.
:beam-runners-core-construction-java:buildDependents (Thread[Task worker for ':' Thread 14,5,main]) started.
:beam-runners-core-construction-java:buildDependents
Caching disabled for task ':beam-runners-core-construction-java:buildDependents': Caching has not been enabled for the task
Task ':beam-runners-core-construction-java:buildDependents' is not up-to-date because:
Task has not declared any outputs.
:beam-runners-core-construction-java:buildDependents (Thread[Task worker for ':' Thread 14,5,main]) completed. Took 0.0 secs.
:beam-runners-local-java-core:buildDependents (Thread[Task worker for ':' Thread 11,5,main]) completed. Took 0.0 secs.
:beam-sdks-java-core:buildDependents (Thread[Task worker for ':' Thread 14,5,main]) started.
:beam-sdks-java-core:buildDependents
Caching disabled for task ':beam-sdks-java-core:buildDependents': Caching has not been enabled for the task
Task ':beam-sdks-java-core:buildDependents' is not up-to-date because:
Task has not declared any outputs.
:beam-sdks-java-core:buildDependents (Thread[Task worker for ':' Thread 14,5,main]) completed. Took 0.0 secs.
:javaPreCommit (Thread[Task worker for ':' Thread 12,5,main]) started.
:javaPreCommit
Skipping task ':javaPreCommit' as it has no actions.
:javaPreCommit (Thread[Task worker for ':' Thread 12,5,main]) completed. Took 0.0 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:googleCloudPlatformIntegrationTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/googleCloudPlatformIntegrationTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.6/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 32m 49s
546 actionable tasks: 539 executed, 7 from cache
Publishing build scan...
https://gradle.com/s/yvm4jyvonuuro
Build cache (/home/jenkins/.gradle/caches/build-cache-1) has not been cleaned up in 1 days
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user sidhom@google.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user kedin@google.com
Not sending mail to unregistered user kirpichov@google.com
Not sending mail to unregistered user relax@relax-macbookpro2.roam.corp.google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Build failed in Jenkins: beam_PostCommit_Java_GradleBuild #190
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/190/display/redirect?page=changes>
Changes:
[ekirpichov] Moves standard URNs into .proto files
[ekirpichov] Refactors common_urns.py
[ekirpichov] Fixes pylint errors
[ekirpichov] Fixes compile errors
[ekirpichov] Workaround for protobuf compiler bug
[ekirpichov] Fixes more references to common_urns
------------------------------------------
[...truncated 19.18 MB...]
org.apache.beam.examples.cookbook.FilterExamplesTest > testProjectionFn STANDARD_ERROR
Apr 25, 2018 11:41:07 PM org.apache.beam.sdk.transforms.DoFnTester of
WARNING: Your tests use DoFnTester, which may not exercise DoFns correctly. Please use TestPipeline instead.
org.apache.beam.examples.cookbook.JoinExamplesTest > testExtractCountryInfoFn STANDARD_ERROR
Apr 25, 2018 11:41:07 PM org.apache.beam.sdk.transforms.DoFnTester of
WARNING: Your tests use DoFnTester, which may not exercise DoFns correctly. Please use TestPipeline instead.
org.apache.beam.examples.cookbook.JoinExamplesTest > testExtractEventDataFn STANDARD_ERROR
Apr 25, 2018 11:41:07 PM org.apache.beam.sdk.transforms.DoFnTester of
WARNING: Your tests use DoFnTester, which may not exercise DoFns correctly. Please use TestPipeline instead.
org.apache.beam.examples.DebuggingWordCountTest > testDebuggingWordCount STANDARD_ERROR
Apr 25, 2018 11:41:08 PM org.apache.beam.sdk.io.FileBasedSource getEstimatedSizeBytes
INFO: Filepattern /tmp/junit3542244491470037721/junit6723968775814615438.tmp matched 1 files with total size 54
Apr 25, 2018 11:41:08 PM org.apache.beam.sdk.io.FileBasedSource split
INFO: Splitting filepattern /tmp/junit3542244491470037721/junit6723968775814615438.tmp into bundles of size 3 took 1 ms and produced 1 files and 18 bundles
org.apache.beam.examples.WordCountTest > testExtractWordsFn STANDARD_ERROR
Apr 25, 2018 11:41:08 PM org.apache.beam.sdk.transforms.DoFnTester of
WARNING: Your tests use DoFnTester, which may not exercise DoFns correctly. Please use TestPipeline instead.
org.apache.beam.examples.subprocess.ExampleEchoPipelineTest > testExampleEchoPipeline STANDARD_ERROR
Apr 25, 2018 11:41:10 PM org.apache.beam.examples.subprocess.utils.CallingSubProcessUtils initSemaphore
INFO: Initialized Semaphore for binary test-Echo3575475036455062336.sh
Apr 25, 2018 11:41:10 PM org.apache.beam.examples.subprocess.utils.CallingSubProcessUtils setUp
INFO: Calling filesetup to move Executables to worker.
Apr 25, 2018 11:41:10 PM org.apache.beam.examples.subprocess.utils.FileUtils copyFileFromGCSToWorker
INFO: Moving File /tmp/test-Echo3575475036455062336.sh to /tmp/test-Echoo360632392480774011/test-Echo3575475036455062336.sh
Apr 25, 2018 11:41:10 PM org.apache.beam.examples.subprocess.utils.CallingSubProcessUtils initSemaphore
INFO: Initialized Semaphore for binary test-EchoAgain648595034353412101.sh
Apr 25, 2018 11:41:10 PM org.apache.beam.examples.subprocess.utils.CallingSubProcessUtils setUp
INFO: Calling filesetup to move Executables to worker.
Apr 25, 2018 11:41:10 PM org.apache.beam.examples.subprocess.utils.FileUtils copyFileFromGCSToWorker
INFO: Moving File /tmp/test-EchoAgain648595034353412101.sh to /tmp/test-Echoo360632392480774011/test-EchoAgain648595034353412101.sh
org.apache.beam.examples.complete.game.HourlyTeamScoreTest > testUserScoresFilter STANDARD_OUT
GOT user18_ApricotCaneToad,ApricotCaneToad,14,1447965690000,2015-11-19 12:41:31.053
GOT user18_BananaEmu,BananaEmu,1,1447965690000,2015-11-19 12:41:31.053
GOT user19_BisqueBilby,BisqueBilby,8,1447955630000,2015-11-19 09:53:53.444
GOT user18_BananaEmu,BananaEmu,7,1447965690000,2015-11-19 12:41:31.053
GOT user7_AndroidGreenKookaburra,AndroidGreenKookaburra,12,1447955630000,2015-11-19 09:53:53.444
GOT user7_AndroidGreenKookaburra,AndroidGreenKookaburra,11,1447955630000,2015-11-19 09:53:53.444
GOT user7_AlmondWallaby,AlmondWallaby,15,1447955630000,2015-11-19 09:53:53.444
GOT user13_ApricotQuokka,ApricotQuokka,15,1447955630000,2015-11-19 09:53:53.444
GOT user2_AmberCockatoo,AmberCockatoo,13,1447965690000,2015-11-19 12:41:31.053
GOT user19_BisqueBilby,BisqueBilby,6,1447955630000,2015-11-19 09:53:53.444
GOT user6_AmberNumbat,AmberNumbat,11,1447955630000,2015-11-19 09:53:53.444
GOT user0_MagentaKangaroo,MagentaKangaroo,3,1447955630000,2015-11-19 09:53:53.444
GOT user3_BananaEmu,BananaEmu,17,1447965690000,2015-11-19 12:41:31.053
GOT user0_MagentaKangaroo,MagentaKangaroo,4,1447965690000,2015-11-19 12:41:31.053
GOT user0_AndroidGreenEchidna,AndroidGreenEchidna,0,1447965690000,2015-11-19 12:41:31.053
org.apache.beam.examples.complete.game.UserScoreTest > testTeamScoreSums STANDARD_OUT
GOT user0_MagentaKangaroo,MagentaKangaroo,3,1447955630000,2015-11-19 09:53:53.444
GOT user7_AndroidGreenKookaburra,AndroidGreenKookaburra,12,1447955630000,2015-11-19 09:53:53.444
GOT user13_ApricotQuokka,ApricotQuokka,15,1447955630000,2015-11-19 09:53:53.444
GOT user6_AliceBlueDingo,AliceBlueDingo,4,xxxxxxx,2015-11-19 09:53:53.444
GOT user7_AndroidGreenKookaburra,AndroidGreenKookaburra,11,1447955630000,2015-11-19 09:53:53.444
GOT user7_AlmondWallaby,AlmondWallaby,15,1447955630000,2015-11-19 09:53:53.444
GOT user6_AmberNumbat,AmberNumbat,11,1447955630000,2015-11-19 09:53:53.444
GOT user19_BisqueBilby,BisqueBilby,6,1447955630000,2015-11-19 09:53:53.444
GOT user19_BisqueBilby,BisqueBilby,8,1447955630000,2015-11-19 09:53:53.444
org.apache.beam.examples.complete.game.UserScoreTest > testTeamScoreSums STANDARD_ERROR
Apr 25, 2018 11:41:11 PM org.apache.beam.examples.complete.game.UserScore$ParseEventFn processElement
INFO: Parse error on user6_AliceBlueDingo,AliceBlueDingo,4,xxxxxxx,2015-11-19 09:53:53.444, For input string: "xxxxxxx"
org.apache.beam.examples.complete.game.UserScoreTest > testTeamScoreSums STANDARD_OUT
GOT THIS IS A PARSE ERROR,2015-11-19 09:53:53.444
org.apache.beam.examples.complete.game.UserScoreTest > testTeamScoreSums STANDARD_ERROR
Apr 25, 2018 11:41:11 PM org.apache.beam.examples.complete.game.UserScore$ParseEventFn processElement
INFO: Parse error on THIS IS A PARSE ERROR,2015-11-19 09:53:53.444, 2
org.apache.beam.examples.complete.game.UserScoreTest > testUserScoresBadInput STANDARD_OUT
GOT user6_AliceBlueDingo,AliceBlueDingo,4,xxxxxxx,2015-11-19 09:53:53.444
GOT THIS IS A PARSE ERROR,2015-11-19 09:53:53.444
GOT user13_BisqueBilby,BisqueBilby,xxx,1447955630000,2015-11-19 09:53:53.444
org.apache.beam.examples.complete.game.UserScoreTest > testUserScoresBadInput STANDARD_ERROR
Apr 25, 2018 11:41:11 PM org.apache.beam.examples.complete.game.UserScore$ParseEventFn processElement
INFO: Parse error on THIS IS A PARSE ERROR,2015-11-19 09:53:53.444, 2
Apr 25, 2018 11:41:11 PM org.apache.beam.examples.complete.game.UserScore$ParseEventFn processElement
INFO: Parse error on user13_BisqueBilby,BisqueBilby,xxx,1447955630000,2015-11-19 09:53:53.444, For input string: "xxx"
Apr 25, 2018 11:41:11 PM org.apache.beam.examples.complete.game.UserScore$ParseEventFn processElement
INFO: Parse error on user6_AliceBlueDingo,AliceBlueDingo,4,xxxxxxx,2015-11-19 09:53:53.444, For input string: "xxxxxxx"
org.apache.beam.examples.complete.game.UserScoreTest > testUserScoreSums STANDARD_OUT
GOT user7_AndroidGreenKookaburra,AndroidGreenKookaburra,12,1447955630000,2015-11-19 09:53:53.444
GOT user0_MagentaKangaroo,MagentaKangaroo,3,1447955630000,2015-11-19 09:53:53.444
GOT user6_AmberNumbat,AmberNumbat,11,1447955630000,2015-11-19 09:53:53.444
GOT user6_AliceBlueDingo,AliceBlueDingo,4,xxxxxxx,2015-11-19 09:53:53.444
GOT THIS IS A PARSE ERROR,2015-11-19 09:53:53.444
GOT user19_BisqueBilby,BisqueBilby,6,1447955630000,2015-11-19 09:53:53.444
GOT user7_AndroidGreenKookaburra,AndroidGreenKookaburra,11,1447955630000,2015-11-19 09:53:53.444
org.apache.beam.examples.complete.game.UserScoreTest > testUserScoreSums STANDARD_ERROR
Apr 25, 2018 11:41:11 PM org.apache.beam.examples.complete.game.UserScore$ParseEventFn processElement
org.apache.beam.examples.complete.game.UserScoreTest > testUserScoreSums STANDARD_OUT
GOT user19_BisqueBilby,BisqueBilby,8,1447955630000,2015-11-19 09:53:53.444
GOT user13_ApricotQuokka,ApricotQuokka,15,1447955630000,2015-11-19 09:53:53.444
GOT user7_AlmondWallaby,AlmondWallaby,15,1447955630000,2015-11-19 09:53:53.444
org.apache.beam.examples.complete.game.UserScoreTest > testUserScoreSums STANDARD_ERROR
INFO: Parse error on user6_AliceBlueDingo,AliceBlueDingo,4,xxxxxxx,2015-11-19 09:53:53.444, For input string: "xxxxxxx"
Apr 25, 2018 11:41:11 PM org.apache.beam.examples.complete.game.UserScore$ParseEventFn processElement
INFO: Parse error on THIS IS A PARSE ERROR,2015-11-19 09:53:53.444, 2
org.apache.beam.examples.complete.game.UserScoreTest > testParseEventFn STANDARD_ERROR
Apr 25, 2018 11:41:11 PM org.apache.beam.sdk.transforms.DoFnTester of
WARNING: Your tests use DoFnTester, which may not exercise DoFns correctly. Please use TestPipeline instead.
org.apache.beam.examples.complete.game.UserScoreTest > testParseEventFn STANDARD_OUT
GOT user0_MagentaKangaroo,MagentaKangaroo,3,1447955630000,2015-11-19 09:53:53.444
GOT user13_ApricotQuokka,ApricotQuokka,15,1447955630000,2015-11-19 09:53:53.444
GOT user6_AmberNumbat,AmberNumbat,11,1447955630000,2015-11-19 09:53:53.444
GOT user7_AlmondWallaby,AlmondWallaby,15,1447955630000,2015-11-19 09:53:53.444
GOT user7_AndroidGreenKookaburra,AndroidGreenKookaburra,12,1447955630000,2015-11-19 09:53:53.444
GOT user6_AliceBlueDingo,AliceBlueDingo,4,xxxxxxx,2015-11-19 09:53:53.444
org.apache.beam.examples.complete.game.UserScoreTest > testParseEventFn STANDARD_ERROR
Apr 25, 2018 11:41:11 PM org.apache.beam.examples.complete.game.UserScore$ParseEventFn processElement
INFO: Parse error on user6_AliceBlueDingo,AliceBlueDingo,4,xxxxxxx,2015-11-19 09:53:53.444, For input string: "xxxxxxx"
org.apache.beam.examples.complete.game.UserScoreTest > testParseEventFn STANDARD_OUT
GOT user7_AndroidGreenKookaburra,AndroidGreenKookaburra,11,1447955630000,2015-11-19 09:53:53.444
GOT THIS IS A PARSE ERROR,2015-11-19 09:53:53.444
org.apache.beam.examples.complete.game.UserScoreTest > testParseEventFn STANDARD_ERROR
Apr 25, 2018 11:41:11 PM org.apache.beam.examples.complete.game.UserScore$ParseEventFn processElement
INFO: Parse error on THIS IS A PARSE ERROR,2015-11-19 09:53:53.444, 2
org.apache.beam.examples.complete.game.UserScoreTest > testParseEventFn STANDARD_OUT
GOT user19_BisqueBilby,BisqueBilby,6,1447955630000,2015-11-19 09:53:53.444
GOT user19_BisqueBilby,BisqueBilby,8,1447955630000,2015-11-19 09:53:53.444
org.apache.beam.examples.complete.game.GameStatsTest > testCalculateSpammyUsers STANDARD_ERROR
Apr 25, 2018 11:41:11 PM org.apache.beam.examples.complete.game.GameStats$CalculateSpammyUsers$1 processElement
INFO: user Robot-2 spammer score 66 with mean 24.923076923076923
Apr 25, 2018 11:41:11 PM org.apache.beam.examples.complete.game.GameStats$CalculateSpammyUsers$1 processElement
INFO: user Robot-1 spammer score 116 with mean 24.923076923076923
Gradle Test Executor 133 finished executing tests.
Finished generating test XML results (0.002 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/ws/src/examples/java/build/test-results/test>
Generating HTML test report...
Finished generating test html results (0.003 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/ws/src/examples/java/build/reports/tests/test>
Packing task ':beam-examples-java:test'
:beam-examples-java:test (Thread[Task worker for ':' Thread 11,5,main]) completed. Took 11.87 secs.
:beam-examples-java:check (Thread[Task worker for ':' Thread 11,5,main]) started.
:beam-examples-java:check
Skipping task ':beam-examples-java:check' as it has no actions.
:beam-examples-java:check (Thread[Task worker for ':' Thread 11,5,main]) completed. Took 0.0 secs.
:beam-examples-java:build (Thread[Task worker for ':' Thread 9,5,main]) started.
:beam-examples-java:build
Skipping task ':beam-examples-java:build' as it has no actions.
:beam-examples-java:build (Thread[Task worker for ':' Thread 9,5,main]) completed. Took 0.0 secs.
:beam-examples-java:buildDependents (Thread[Task worker for ':' Thread 9,5,main]) started.
:beam-examples-java:buildDependents
Caching disabled for task ':beam-examples-java:buildDependents': Caching has not been enabled for the task
Task ':beam-examples-java:buildDependents' is not up-to-date because:
Task has not declared any outputs.
:beam-examples-java:buildDependents (Thread[Task worker for ':' Thread 9,5,main]) completed. Took 0.0 secs.
:beam-sdks-java-io-google-cloud-platform:buildDependents (Thread[Task worker for ':' Thread 9,5,main]) started.
:beam-sdks-java-io-google-cloud-platform:buildDependents
Caching disabled for task ':beam-sdks-java-io-google-cloud-platform:buildDependents': Caching has not been enabled for the task
Task ':beam-sdks-java-io-google-cloud-platform:buildDependents' is not up-to-date because:
Task has not declared any outputs.
:beam-sdks-java-io-google-cloud-platform:buildDependents (Thread[Task worker for ':' Thread 9,5,main]) completed. Took 0.0 secs.
:beam-runners-direct-java:buildDependents (Thread[Task worker for ':' Thread 7,5,main]) started.
:beam-sdks-java-extensions-google-cloud-platform-core:buildDependents (Thread[Task worker for ':' Thread 4,5,main]) started.
:beam-runners-direct-java:buildDependents
:beam-sdks-java-extensions-protobuf:buildDependents (Thread[Task worker for ':',5,main]) started.
:beam-sdks-java-extensions-google-cloud-platform-core:buildDependents
:beam-sdks-java-extensions-protobuf:buildDependents
Caching disabled for task ':beam-runners-direct-java:buildDependents': Caching has not been enabled for the task
Task ':beam-runners-direct-java:buildDependents' is not up-to-date because:
Task has not declared any outputs.
Caching disabled for task ':beam-sdks-java-extensions-protobuf:buildDependents': Caching has not been enabled for the task
Caching disabled for task ':beam-sdks-java-extensions-google-cloud-platform-core:buildDependents': Caching has not been enabled for the task
Task ':beam-sdks-java-extensions-protobuf:buildDependents' is not up-to-date because:
Task has not declared any outputs.
Task ':beam-sdks-java-extensions-google-cloud-platform-core:buildDependents' is not up-to-date because:
Task has not declared any outputs.
:beam-runners-direct-java:buildDependents (Thread[Task worker for ':' Thread 7,5,main]) completed. Took 0.001 secs.
:beam-sdks-java-extensions-protobuf:buildDependents (Thread[Task worker for ':',5,main]) completed. Took 0.0 secs.
:beam-runners-core-java:buildDependents (Thread[Task worker for ':' Thread 7,5,main]) started.
:beam-runners-core-java:buildDependents
:beam-runners-local-java-core:buildDependents (Thread[Task worker for ':' Thread 11,5,main]) started.
:beam-runners-local-java-core:buildDependents
Caching disabled for task ':beam-runners-core-java:buildDependents': Caching has not been enabled for the task
Task ':beam-runners-core-java:buildDependents' is not up-to-date because:
Task has not declared any outputs.
Caching disabled for task ':beam-runners-local-java-core:buildDependents': Caching has not been enabled for the task
Task ':beam-runners-local-java-core:buildDependents' is not up-to-date because:
Task has not declared any outputs.
:beam-runners-core-java:buildDependents (Thread[Task worker for ':' Thread 7,5,main]) completed. Took 0.0 secs.
:beam-runners-core-construction-java:buildDependents (Thread[Task worker for ':',5,main]) started.
:beam-sdks-java-extensions-google-cloud-platform-core:buildDependents (Thread[Task worker for ':' Thread 4,5,main]) completed. Took 0.001 secs.
:beam-runners-core-construction-java:buildDependents
:beam-runners-local-java-core:buildDependents (Thread[Task worker for ':' Thread 11,5,main]) completed. Took 0.0 secs.
Caching disabled for task ':beam-runners-core-construction-java:buildDependents': Caching has not been enabled for the task
Task ':beam-runners-core-construction-java:buildDependents' is not up-to-date because:
Task has not declared any outputs.
:beam-runners-core-construction-java:buildDependents (Thread[Task worker for ':',5,main]) completed. Took 0.0 secs.
:beam-sdks-java-core:buildDependents (Thread[Task worker for ':' Thread 14,5,main]) started.
:beam-sdks-java-core:buildDependents
Caching disabled for task ':beam-sdks-java-core:buildDependents': Caching has not been enabled for the task
Task ':beam-sdks-java-core:buildDependents' is not up-to-date because:
Task has not declared any outputs.
:beam-sdks-java-core:buildDependents (Thread[Task worker for ':' Thread 14,5,main]) completed. Took 0.0 secs.
:javaPreCommit (Thread[Task worker for ':' Thread 2,5,main]) started.
:javaPreCommit
Skipping task ':javaPreCommit' as it has no actions.
:javaPreCommit (Thread[Task worker for ':' Thread 2,5,main]) completed. Took 0.0 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:googleCloudPlatformIntegrationTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/googleCloudPlatformIntegrationTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.6/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 31m 56s
546 actionable tasks: 546 executed
Publishing build scan...
https://gradle.com/s/5v25v5supd5sm
Build cache (/home/jenkins/.gradle/caches/build-cache-1) has not been cleaned up in 1 days
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user sidhom@google.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user kedin@google.com
Not sending mail to unregistered user kirpichov@google.com
Not sending mail to unregistered user relax@relax-macbookpro2.roam.corp.google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Build failed in Jenkins: beam_PostCommit_Java_GradleBuild #189
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/189/display/redirect?page=changes>
Changes:
[sidhom] Add in-process ManagedChannelFactory and update tests to use it
[sidhom] Add common pipeline options for portable runners
[sidhom] Set artifact names explicitly while staging to service
[sidhom] Add CloseableResource to wrap non-closeable resources that must be
[sidhom] [BEAM-4071] Add Portable Runner Job API shim
------------------------------------------
[...truncated 20.11 MB...]
Apr 25, 2018 10:55:15 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.m2/repository/io/netty/netty-common/4.1.8.Final/netty-common-4.1.8.Final.jar to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0425225513-56bd4e2e/output/results/staging/netty-common-4.1.8.Final-lafOW8vGsI6SRwZSmXNClg.jar
Apr 25, 2018 10:55:15 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.m2/repository/com/google/auto/value/auto-value/1.4/auto-value-1.4.jar to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0425225513-56bd4e2e/output/results/staging/auto-value-1.4-_7tYdqNvCowycFIDpBenFw.jar
Apr 25, 2018 10:55:15 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/ws/src/sdks/java/io/google-cloud-platform/build/libs/beam-sdks-java-io-google-cloud-platform-2.5.0-SNAPSHOT-shaded-tests.jar> to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0425225513-56bd4e2e/output/results/staging/beam-sdks-java-io-google-cloud-platform-2.5.0-SNAPSHOT-shaded-tests-0H_bINqh474db9AuqdxujA.jar
Apr 25, 2018 10:55:15 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.m2/repository/io/netty/netty-handler-proxy/4.1.8.Final/netty-handler-proxy-4.1.8.Final.jar to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0425225513-56bd4e2e/output/results/staging/netty-handler-proxy-4.1.8.Final-Zey48Fj4mlWtgpwIc7Osgg.jar
Apr 25, 2018 10:55:15 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.m2/repository/com/squareup/okhttp/okhttp/2.5.0/okhttp-2.5.0.jar to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0425225513-56bd4e2e/output/results/staging/okhttp-2.5.0-64v0X4G_nxfR_PsuymOqpg.jar
Apr 25, 2018 10:55:20 PM org.apache.beam.runners.dataflow.util.PackageUtil stageClasspathElements
INFO: Staging files complete: 0 files cached, 127 files newly uploaded
Apr 25, 2018 10:55:20 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding GenerateSequence/Read(BoundedCountingSource) as step s1
Apr 25, 2018 10:55:20 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding ParDo(CreateEntity) as step s2
Apr 25, 2018 10:55:20 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding DatastoreV1.Write/Convert to Mutation/Map as step s3
Apr 25, 2018 10:55:20 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding DatastoreV1.Write/Write Mutation to Datastore as step s4
Apr 25, 2018 10:55:20 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0425225513-56bd4e2e/output/results/staging/
Apr 25, 2018 10:55:20 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <8774 bytes, hash c-CZlcnyOzIczDEKFLuWYQ> to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0425225513-56bd4e2e/output/results/staging/pipeline-c-CZlcnyOzIczDEKFLuWYQ.pb
org.apache.beam.sdk.io.gcp.datastore.V1WriteIT > testE2EV1Write STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT
org.apache.beam.sdk.io.gcp.datastore.V1WriteIT > testE2EV1Write STANDARD_ERROR
Apr 25, 2018 10:55:22 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-04-25_15_55_21-10465330941772867377?project=apache-beam-testing
org.apache.beam.sdk.io.gcp.datastore.V1WriteIT > testE2EV1Write STANDARD_OUT
Submitted job: 2018-04-25_15_55_21-10465330941772867377
org.apache.beam.sdk.io.gcp.datastore.V1WriteIT > testE2EV1Write STANDARD_ERROR
Apr 25, 2018 10:55:22 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-04-25_15_55_21-10465330941772867377
Apr 25, 2018 10:55:22 PM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-04-25_15_55_21-10465330941772867377 with 0 expected assertions.
org.apache.beam.sdk.io.gcp.datastore.V1ReadIT > testE2EV1ReadWithGQLQueryWithNoLimit STANDARD_ERROR
Apr 25, 2018 10:55:22 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-04-25_15_51_45-16629068779300950722 finished with status DONE.
Apr 25, 2018 10:55:22 PM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-04-25_15_51_45-16629068779300950722. Found 1 success, 0 failures out of 1 expected assertions.
Apr 25, 2018 10:55:23 PM org.apache.beam.sdk.io.gcp.datastore.V1TestUtil$V1TestWriter flushBatch
INFO: Writing batch of 500 entities
Apr 25, 2018 10:55:23 PM org.apache.beam.sdk.io.gcp.datastore.V1TestUtil$V1TestWriter flushBatch
INFO: Successfully wrote 500 entities
Apr 25, 2018 10:55:23 PM org.apache.beam.sdk.io.gcp.datastore.V1TestUtil$V1TestWriter flushBatch
INFO: Writing batch of 500 entities
Apr 25, 2018 10:55:24 PM org.apache.beam.sdk.io.gcp.datastore.V1TestUtil$V1TestWriter flushBatch
INFO: Successfully wrote 500 entities
Apr 25, 2018 10:55:24 PM org.apache.beam.sdk.io.gcp.datastore.V1TestUtil deleteAllEntities
INFO: Successfully deleted 1000 entities
org.apache.beam.sdk.io.gcp.datastore.SplitQueryFnIT > testSplitQueryFnWithLargeDataset STANDARD_ERROR
Apr 25, 2018 10:55:24 PM org.apache.beam.sdk.transforms.DoFnTester of
WARNING: Your tests use DoFnTester, which may not exercise DoFns correctly. Please use TestPipeline instead.
Apr 25, 2018 10:55:24 PM org.apache.beam.sdk.io.gcp.datastore.DatastoreV1$Read getEstimatedSizeBytes
INFO: Latest stats timestamp for kind sort_1G is 1524555829000000
Apr 25, 2018 10:55:24 PM org.apache.beam.sdk.io.gcp.datastore.DatastoreV1$Read getEstimatedNumSplits
INFO: Estimated size bytes for the query is: 2130000000
Apr 25, 2018 10:55:24 PM org.apache.beam.sdk.io.gcp.datastore.DatastoreV1$Read$SplitQueryFn processElement
INFO: Splitting the query into 32 splits
org.apache.beam.sdk.io.gcp.datastore.SplitQueryFnIT > testSplitQueryFnWithSmallDataset STANDARD_ERROR
Apr 25, 2018 10:55:25 PM org.apache.beam.sdk.transforms.DoFnTester of
WARNING: Your tests use DoFnTester, which may not exercise DoFns correctly. Please use TestPipeline instead.
Apr 25, 2018 10:55:25 PM org.apache.beam.sdk.io.gcp.datastore.DatastoreV1$Read getEstimatedSizeBytes
INFO: Latest stats timestamp for kind shakespeare is 1524555829000000
Apr 25, 2018 10:55:25 PM org.apache.beam.sdk.io.gcp.datastore.DatastoreV1$Read getEstimatedNumSplits
INFO: Estimated size bytes for the query is: 26383451
Apr 25, 2018 10:55:25 PM org.apache.beam.sdk.io.gcp.datastore.DatastoreV1$Read$SplitQueryFn processElement
INFO: Splitting the query into 12 splits
Gradle Test Executor 122 finished executing tests.
org.apache.beam.sdk.io.gcp.spanner.SpannerWriteIT > testWrite FAILED
java.lang.NoClassDefFoundError: com/google/api/gax/retrying/ExceptionRetryAlgorithm
at java.lang.ClassLoader.defineClass1(Native Method)
at java.lang.ClassLoader.defineClass(ClassLoader.java:763)
at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)
at java.net.URLClassLoader.defineClass(URLClassLoader.java:467)
at java.net.URLClassLoader.access$100(URLClassLoader.java:73)
at java.net.URLClassLoader$1.run(URLClassLoader.java:368)
at java.net.URLClassLoader$1.run(URLClassLoader.java:362)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:361)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:338)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
at com.google.cloud.BaseService.<clinit>(BaseService.java:48)
at com.google.cloud.spanner.SpannerOptions$DefaultSpannerFactory.create(SpannerOptions.java:60)
at com.google.cloud.spanner.SpannerOptions$DefaultSpannerFactory.create(SpannerOptions.java:55)
at com.google.cloud.ServiceOptions.getService(ServiceOptions.java:426)
at org.apache.beam.sdk.io.gcp.spanner.SpannerWriteIT.setUp(SpannerWriteIT.java:91)
Caused by:
java.lang.ClassNotFoundException: com.google.api.gax.retrying.ExceptionRetryAlgorithm
at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:338)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
... 17 more
java.lang.NullPointerException
at org.apache.beam.sdk.io.gcp.spanner.SpannerWriteIT.tearDown(SpannerWriteIT.java:148)
org.apache.beam.sdk.io.gcp.datastore.V1WriteIT > testE2EV1Write STANDARD_ERROR
Apr 25, 2018 10:55:32 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T22:55:21.282Z: Autoscaling is enabled for job 2018-04-25_15_55_21-10465330941772867377. The number of workers will be between 1 and 1000.
Apr 25, 2018 10:55:32 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T22:55:21.306Z: Autoscaling was automatically enabled for job 2018-04-25_15_55_21-10465330941772867377.
Apr 25, 2018 10:55:32 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T22:55:23.825Z: Checking required Cloud APIs are enabled.
Apr 25, 2018 10:55:32 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T22:55:23.989Z: Checking permissions granted to controller Service Account.
Apr 25, 2018 10:55:32 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T22:55:28.381Z: Worker configuration: n1-standard-1 in us-central1-c.
Apr 25, 2018 10:55:32 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T22:55:28.723Z: Expanding CoGroupByKey operations into optimizable parts.
Apr 25, 2018 10:55:32 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T22:55:28.752Z: Expanding GroupByKey operations into optimizable parts.
Apr 25, 2018 10:55:32 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T22:55:28.789Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
Apr 25, 2018 10:55:32 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T22:55:28.847Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
Apr 25, 2018 10:55:32 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T22:55:28.874Z: Fusing consumer ParDo(CreateEntity) into GenerateSequence/Read(BoundedCountingSource)
Apr 25, 2018 10:55:32 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T22:55:28.899Z: Fusing consumer DatastoreV1.Write/Write Mutation to Datastore into DatastoreV1.Write/Convert to Mutation/Map
Apr 25, 2018 10:55:32 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T22:55:28.923Z: Fusing consumer DatastoreV1.Write/Convert to Mutation/Map into ParDo(CreateEntity)
Apr 25, 2018 10:55:32 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T22:55:29.249Z: Executing operation GenerateSequence/Read(BoundedCountingSource)+ParDo(CreateEntity)+DatastoreV1.Write/Convert to Mutation/Map+DatastoreV1.Write/Write Mutation to Datastore
Apr 25, 2018 10:55:32 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T22:55:29.323Z: Starting 1 workers in us-central1-c...
Apr 25, 2018 10:55:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T22:55:36.630Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
Apr 25, 2018 10:55:47 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T22:55:47.078Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
Apr 25, 2018 10:56:22 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T22:56:21.441Z: Workers have started successfully.
Apr 25, 2018 10:56:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T22:56:57.677Z: Cleaning up.
Apr 25, 2018 10:56:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T22:56:57.741Z: Stopping worker pool...
Apr 25, 2018 10:58:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T22:58:32.031Z: Autoscaling: Resized worker pool from 1 to 0.
Apr 25, 2018 10:58:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T22:58:32.055Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
Apr 25, 2018 10:58:40 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-04-25_15_55_21-10465330941772867377 finished with status DONE.
Apr 25, 2018 10:58:40 PM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-04-25_15_55_21-10465330941772867377. Found 0 success, 0 failures out of 0 expected assertions.
Apr 25, 2018 10:58:41 PM org.apache.beam.sdk.io.gcp.datastore.V1TestUtil$V1TestWriter flushBatch
INFO: Writing batch of 500 entities
Apr 25, 2018 10:58:41 PM org.apache.beam.sdk.io.gcp.datastore.V1TestUtil$V1TestWriter flushBatch
INFO: Successfully wrote 500 entities
Apr 25, 2018 10:58:42 PM org.apache.beam.sdk.io.gcp.datastore.V1TestUtil$V1TestWriter flushBatch
INFO: Writing batch of 500 entities
Apr 25, 2018 10:58:42 PM org.apache.beam.sdk.io.gcp.datastore.V1TestUtil$V1TestWriter flushBatch
INFO: Successfully wrote 500 entities
Apr 25, 2018 10:58:42 PM org.apache.beam.sdk.io.gcp.datastore.V1TestUtil deleteAllEntities
INFO: Successfully deleted 1000 entities
org.apache.beam.sdk.io.gcp.spanner.SpannerReadIT > testQuery FAILED
java.lang.NoClassDefFoundError: com/google/api/gax/retrying/ExceptionRetryAlgorithm
at java.lang.ClassLoader.defineClass1(Native Method)
at java.lang.ClassLoader.defineClass(ClassLoader.java:763)
at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)
at java.net.URLClassLoader.defineClass(URLClassLoader.java:467)
at java.net.URLClassLoader.access$100(URLClassLoader.java:73)
at java.net.URLClassLoader$1.run(URLClassLoader.java:368)
at java.net.URLClassLoader$1.run(URLClassLoader.java:362)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:361)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:338)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
at com.google.cloud.BaseService.<clinit>(BaseService.java:48)
at com.google.cloud.spanner.SpannerOptions$DefaultSpannerFactory.create(SpannerOptions.java:60)
at com.google.cloud.spanner.SpannerOptions$DefaultSpannerFactory.create(SpannerOptions.java:55)
at com.google.cloud.ServiceOptions.getService(ServiceOptions.java:426)
at org.apache.beam.sdk.io.gcp.spanner.SpannerReadIT.setUp(SpannerReadIT.java:90)
Caused by:
java.lang.ClassNotFoundException: com.google.api.gax.retrying.ExceptionRetryAlgorithm
at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:338)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
... 17 more
java.lang.NullPointerException
at org.apache.beam.sdk.io.gcp.spanner.SpannerReadIT.tearDown(SpannerReadIT.java:198)
Gradle Test Executor 131 finished executing tests.
org.apache.beam.sdk.io.gcp.spanner.SpannerReadIT > testRead FAILED
java.lang.NoClassDefFoundError: Could not initialize class com.google.cloud.spanner.SpannerImpl
at com.google.cloud.spanner.SpannerOptions$DefaultSpannerFactory.create(SpannerOptions.java:60)
at com.google.cloud.spanner.SpannerOptions$DefaultSpannerFactory.create(SpannerOptions.java:55)
at com.google.cloud.ServiceOptions.getService(ServiceOptions.java:426)
at org.apache.beam.sdk.io.gcp.spanner.SpannerReadIT.setUp(SpannerReadIT.java:90)
java.lang.NullPointerException
at org.apache.beam.sdk.io.gcp.spanner.SpannerReadIT.tearDown(SpannerReadIT.java:198)
12 tests completed, 3 failed
Finished generating test XML results (0.008 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/ws/src/runners/google-cloud-dataflow-java/build/test-results/googleCloudPlatformIntegrationTest>
Generating HTML test report...
Finished generating test html results (0.007 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/googleCloudPlatformIntegrationTest>
:beam-runners-google-cloud-dataflow-java:googleCloudPlatformIntegrationTest FAILED
:beam-runners-google-cloud-dataflow-java:googleCloudPlatformIntegrationTest (Thread[Task worker for ':',5,main]) completed. Took 20 mins 27.714 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:googleCloudPlatformIntegrationTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/googleCloudPlatformIntegrationTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.6/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 48m 21s
545 actionable tasks: 542 executed, 3 from cache
Publishing build scan...
https://gradle.com/s/j2hiyu7dsra3g
Build cache (/home/jenkins/.gradle/caches/build-cache-1) has not been cleaned up in 0 days
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user sidhom@google.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user kedin@google.com
Not sending mail to unregistered user kirpichov@google.com
Not sending mail to unregistered user relax@relax-macbookpro2.roam.corp.google.com
Build failed in Jenkins: beam_PostCommit_Java_GradleBuild #188
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/188/display/redirect?page=changes>
Changes:
[aaltay] [BEAM-3255] Enabling gradle-based release process (#5187)
------------------------------------------
[...truncated 19.20 MB...]
Apr 25, 2018 8:51:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:51:26.205Z: Fusing consumer PAssert$3/CreateActual/GatherPanes/GroupByKey/GroupByWindow into PAssert$3/CreateActual/GatherPanes/GroupByKey/Read
Apr 25, 2018 8:51:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:51:26.238Z: Fusing consumer PAssert$3/CreateActual/GatherPanes/GroupByKey/Reify into PAssert$3/CreateActual/GatherPanes/Window.Into()/Window.Assign
Apr 25, 2018 8:51:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:51:26.270Z: Fusing consumer PAssert$3/CreateActual/GatherPanes/GroupByKey/Write into PAssert$3/CreateActual/GatherPanes/GroupByKey/Reify
Apr 25, 2018 8:51:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:51:26.315Z: Fusing consumer PAssert$3/CreateActual/GatherPanes/Window.Into()/Window.Assign into PAssert$3/CreateActual/GatherPanes/WithKeys/AddKeys/Map
Apr 25, 2018 8:51:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:51:26.340Z: Unzipping flatten s18-u63 for input s19.output-c61
Apr 25, 2018 8:51:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:51:26.390Z: Fusing unzipped copy of PAssert$3/CreateActual/GatherPanes/Reify.Window/ParDo(Anonymous), through flatten s18-u63, into producer PAssert$3/CreateActual/FilterActuals/Window.Assign
Apr 25, 2018 8:51:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:51:26.415Z: Fusing consumer PAssert$3/CreateActual/GatherPanes/Reify.Window/ParDo(Anonymous) into PAssert$3/CreateActual/FilterActuals/Window.Assign
Apr 25, 2018 8:51:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:51:26.447Z: Fusing consumer PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
Apr 25, 2018 8:51:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:51:26.487Z: Fusing consumer PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
Apr 25, 2018 8:51:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:51:26.514Z: Fusing consumer PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
Apr 25, 2018 8:51:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:51:26.543Z: Fusing consumer PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
Apr 25, 2018 8:51:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:51:26.579Z: Fusing consumer PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
Apr 25, 2018 8:51:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:51:26.615Z: Fusing consumer PAssert$3/CreateActual/RewindowActuals/Window.Assign into PAssert$3/CreateActual/Flatten.Iterables/FlattenIterables/FlatMap
Apr 25, 2018 8:51:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:51:26.643Z: Fusing consumer PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
Apr 25, 2018 8:51:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:51:26.670Z: Fusing consumer PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
Apr 25, 2018 8:51:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:51:26.704Z: Fusing consumer PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
Apr 25, 2018 8:51:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:51:26.730Z: Fusing consumer PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
Apr 25, 2018 8:51:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:51:26.759Z: Fusing consumer PAssert$3/CreateActual/ParDo(Anonymous) into PAssert$3/CreateActual/RewindowActuals/Window.Assign
Apr 25, 2018 8:51:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:51:26.790Z: Fusing consumer PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into PAssert$3/CreateActual/ParDo(Anonymous)
Apr 25, 2018 8:51:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:51:26.847Z: Fusing consumer Combine.globally(Count)/ProduceDefault into Combine.globally(Count)/CreateVoid/Read(CreateSource)
Apr 25, 2018 8:51:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:51:26.874Z: Fusing consumer Combine.globally(Count)/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow) into Combine.globally(Count)/Values/Values/Map
Apr 25, 2018 8:51:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:51:26.908Z: Fusing consumer Combine.globally(Count)/Combine.perKey(Count)/Combine.GroupedValues into Combine.globally(Count)/Combine.perKey(Count)/GroupByKey/Read
Apr 25, 2018 8:51:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:51:26.937Z: Fusing consumer Combine.globally(Count)/Combine.perKey(Count)/GroupByKey+Combine.globally(Count)/Combine.perKey(Count)/Combine.GroupedValues/Partial into Combine.globally(Count)/WithKeys/AddKeys/Map
Apr 25, 2018 8:51:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:51:26.967Z: Fusing consumer DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/GroupByWindow into DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/Read
Apr 25, 2018 8:51:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:51:26.998Z: Fusing consumer Combine.globally(Count)/Combine.perKey(Count)/GroupByKey/Reify into Combine.globally(Count)/Combine.perKey(Count)/GroupByKey+Combine.globally(Count)/Combine.perKey(Count)/Combine.GroupedValues/Partial
Apr 25, 2018 8:51:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:51:27.033Z: Fusing consumer Combine.globally(Count)/WithKeys/AddKeys/Map into DatastoreV1.Read/Read
Apr 25, 2018 8:51:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:51:27.064Z: Fusing consumer DatastoreV1.Read/Reshuffle/Pair with random key into DatastoreV1.Read/Split
Apr 25, 2018 8:51:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:51:27.093Z: Fusing consumer DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/Write into DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/Reify
Apr 25, 2018 8:51:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:51:27.123Z: Fusing consumer DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/Reify into DatastoreV1.Read/Reshuffle/Reshuffle/Window.Into()/Window.Assign
Apr 25, 2018 8:51:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:51:27.157Z: Fusing consumer Combine.globally(Count)/Values/Values/Map into Combine.globally(Count)/Combine.perKey(Count)/Combine.GroupedValues/Extract
Apr 25, 2018 8:51:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:51:27.189Z: Fusing consumer DatastoreV1.Read/Split into DatastoreV1.Read/ParDo(GqlQueryTranslate)
Apr 25, 2018 8:51:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:51:27.219Z: Fusing consumer DatastoreV1.Read/Reshuffle/Reshuffle/Window.Into()/Window.Assign into DatastoreV1.Read/Reshuffle/Pair with random key
Apr 25, 2018 8:51:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:51:27.259Z: Fusing consumer Combine.globally(Count)/Combine.perKey(Count)/GroupByKey/Write into Combine.globally(Count)/Combine.perKey(Count)/GroupByKey/Reify
Apr 25, 2018 8:51:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:51:27.297Z: Fusing consumer DatastoreV1.Read/ParDo(GqlQueryTranslate) into DatastoreV1.Read/Create.OfValueProvider/Create.Values/Read(CreateSource)
Apr 25, 2018 8:51:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:51:27.332Z: Fusing consumer DatastoreV1.Read/Read into DatastoreV1.Read/Reshuffle/Values/Values/Map
Apr 25, 2018 8:51:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:51:27.364Z: Fusing consumer DatastoreV1.Read/Reshuffle/Values/Values/Map into DatastoreV1.Read/Reshuffle/Reshuffle/ExpandIterable
Apr 25, 2018 8:51:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:51:27.412Z: Fusing consumer DatastoreV1.Read/Reshuffle/Reshuffle/ExpandIterable into DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/GroupByWindow
Apr 25, 2018 8:51:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:51:27.480Z: Fusing consumer Combine.globally(Count)/Combine.perKey(Count)/Combine.GroupedValues/Extract into Combine.globally(Count)/Combine.perKey(Count)/Combine.GroupedValues
Apr 25, 2018 8:51:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:51:27.540Z: Fusing consumer PAssert$3/RunChecks into PAssert$3/WindowToken/Window.Assign
Apr 25, 2018 8:51:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:51:27.574Z: Fusing consumer PAssert$3/WindowToken/Window.Assign into PAssert$3/Create.Values/Read(CreateSource)
Apr 25, 2018 8:51:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:51:27.619Z: Fusing consumer PAssert$3/VerifyAssertions/ParDo(DefaultConclude) into PAssert$3/RunChecks
Apr 25, 2018 8:51:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:51:28.019Z: Executing operation Combine.globally(Count)/Combine.perKey(Count)/GroupByKey/Create
Apr 25, 2018 8:51:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:51:28.051Z: Executing operation PAssert$3/CreateActual/GatherPanes/GroupByKey/Create
Apr 25, 2018 8:51:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:51:28.093Z: Executing operation PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
Apr 25, 2018 8:51:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:51:28.101Z: Starting 1 workers in us-central1-f...
Apr 25, 2018 8:51:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:51:28.127Z: Executing operation PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
Apr 25, 2018 8:51:30 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:51:28.147Z: Executing operation DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/Create
Apr 25, 2018 8:51:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:51:35.508Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
Apr 25, 2018 8:51:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:51:35.702Z: Executing operation DatastoreV1.Read/Create.OfValueProvider/Create.Values/Read(CreateSource)+DatastoreV1.Read/ParDo(GqlQueryTranslate)+DatastoreV1.Read/Split+DatastoreV1.Read/Reshuffle/Pair with random key+DatastoreV1.Read/Reshuffle/Reshuffle/Window.Into()/Window.Assign+DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/Reify+DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/Write
Apr 25, 2018 8:51:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:51:41.078Z: Autoscaling: Resizing worker pool from 1 to 5.
Apr 25, 2018 8:51:55 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:51:52.883Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
Apr 25, 2018 8:51:55 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:51:52.909Z: Resized worker pool to 1, though goal was 5. This could be a quota issue.
Apr 25, 2018 8:52:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:52:03.442Z: Autoscaling: Raised the number of workers to 5 based on the rate of progress in the currently running step(s).
Apr 25, 2018 8:52:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:52:09.417Z: Workers have started successfully.
Apr 25, 2018 8:52:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:52:32.360Z: Executing operation DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/Close
Apr 25, 2018 8:52:34 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:52:32.450Z: Executing operation DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/Read+DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/GroupByWindow+DatastoreV1.Read/Reshuffle/Reshuffle/ExpandIterable+DatastoreV1.Read/Reshuffle/Values/Values/Map+DatastoreV1.Read/Read+Combine.globally(Count)/WithKeys/AddKeys/Map+Combine.globally(Count)/Combine.perKey(Count)/GroupByKey+Combine.globally(Count)/Combine.perKey(Count)/Combine.GroupedValues/Partial+Combine.globally(Count)/Combine.perKey(Count)/GroupByKey/Reify+Combine.globally(Count)/Combine.perKey(Count)/GroupByKey/Write
Apr 25, 2018 8:52:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:52:40.171Z: Executing operation Combine.globally(Count)/Combine.perKey(Count)/GroupByKey/Close
Apr 25, 2018 8:52:41 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:52:40.256Z: Executing operation Combine.globally(Count)/Combine.perKey(Count)/GroupByKey/Read+Combine.globally(Count)/Combine.perKey(Count)/Combine.GroupedValues+Combine.globally(Count)/Combine.perKey(Count)/Combine.GroupedValues/Extract+Combine.globally(Count)/Values/Values/Map+PAssert$3/CreateActual/FilterActuals/Window.Assign+PAssert$3/CreateActual/GatherPanes/Reify.Window/ParDo(Anonymous)+PAssert$3/CreateActual/GatherPanes/WithKeys/AddKeys/Map+PAssert$3/CreateActual/GatherPanes/Window.Into()/Window.Assign+PAssert$3/CreateActual/GatherPanes/GroupByKey/Reify+PAssert$3/CreateActual/GatherPanes/GroupByKey/Write+Combine.globally(Count)/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow)
Apr 25, 2018 8:52:47 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:52:46.397Z: Executing operation Combine.globally(Count)/View.AsIterable/CreateDataflowView
Apr 25, 2018 8:52:47 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:52:46.570Z: Executing operation Combine.globally(Count)/CreateVoid/Read(CreateSource)+Combine.globally(Count)/ProduceDefault+PAssert$3/CreateActual/FilterActuals/Window.Assign+PAssert$3/CreateActual/GatherPanes/Reify.Window/ParDo(Anonymous)+PAssert$3/CreateActual/GatherPanes/WithKeys/AddKeys/Map+PAssert$3/CreateActual/GatherPanes/Window.Into()/Window.Assign+PAssert$3/CreateActual/GatherPanes/GroupByKey/Reify+PAssert$3/CreateActual/GatherPanes/GroupByKey/Write
Apr 25, 2018 8:52:50 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:52:49.460Z: Executing operation PAssert$3/CreateActual/GatherPanes/GroupByKey/Close
Apr 25, 2018 8:52:50 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:52:49.554Z: Executing operation PAssert$3/CreateActual/GatherPanes/GroupByKey/Read+PAssert$3/CreateActual/GatherPanes/GroupByKey/GroupByWindow+PAssert$3/CreateActual/GatherPanes/Values/Values/Map+PAssert$3/CreateActual/ExtractPane/Map+PAssert$3/CreateActual/Flatten.Iterables/FlattenIterables/FlatMap+PAssert$3/CreateActual/RewindowActuals/Window.Assign+PAssert$3/CreateActual/ParDo(Anonymous)+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
Apr 25, 2018 8:52:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:52:51.088Z: Executing operation PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
Apr 25, 2018 8:52:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:52:51.180Z: Executing operation PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
Apr 25, 2018 8:52:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:52:52.606Z: Executing operation PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
Apr 25, 2018 8:52:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:52:52.698Z: Executing operation PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
Apr 25, 2018 8:52:57 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:52:56.443Z: Executing operation PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
Apr 25, 2018 8:52:57 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:52:56.586Z: Executing operation PAssert$3/Create.Values/Read(CreateSource)+PAssert$3/WindowToken/Window.Assign+PAssert$3/RunChecks+PAssert$3/VerifyAssertions/ParDo(DefaultConclude)
Apr 25, 2018 8:52:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:52:57.876Z: Cleaning up.
Apr 25, 2018 8:52:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:52:58.046Z: Stopping worker pool...
Apr 25, 2018 8:54:35 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:54:33.204Z: Autoscaling: Resized worker pool from 5 to 0.
Apr 25, 2018 8:54:35 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T20:54:33.314Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
Apr 25, 2018 8:54:43 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-04-25_13_51_16-6592967258341647802 finished with status DONE.
Apr 25, 2018 8:54:43 PM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-04-25_13_51_16-6592967258341647802. Found 1 success, 0 failures out of 1 expected assertions.
Apr 25, 2018 8:54:43 PM org.apache.beam.sdk.io.gcp.datastore.V1TestUtil$V1TestWriter flushBatch
INFO: Writing batch of 500 entities
Apr 25, 2018 8:54:44 PM org.apache.beam.sdk.io.gcp.datastore.V1TestUtil$V1TestWriter flushBatch
INFO: Successfully wrote 500 entities
Apr 25, 2018 8:54:44 PM org.apache.beam.sdk.io.gcp.datastore.V1TestUtil$V1TestWriter flushBatch
INFO: Writing batch of 500 entities
Apr 25, 2018 8:54:45 PM org.apache.beam.sdk.io.gcp.datastore.V1TestUtil$V1TestWriter flushBatch
INFO: Successfully wrote 500 entities
Apr 25, 2018 8:54:45 PM org.apache.beam.sdk.io.gcp.datastore.V1TestUtil deleteAllEntities
INFO: Successfully deleted 1000 entities
org.apache.beam.sdk.io.gcp.datastore.SplitQueryFnIT > testSplitQueryFnWithLargeDataset STANDARD_ERROR
Apr 25, 2018 8:54:45 PM org.apache.beam.sdk.transforms.DoFnTester of
WARNING: Your tests use DoFnTester, which may not exercise DoFns correctly. Please use TestPipeline instead.
Apr 25, 2018 8:54:45 PM org.apache.beam.sdk.io.gcp.datastore.DatastoreV1$Read getEstimatedSizeBytes
INFO: Latest stats timestamp for kind sort_1G is 1524555829000000
Apr 25, 2018 8:54:46 PM org.apache.beam.sdk.io.gcp.datastore.DatastoreV1$Read getEstimatedNumSplits
INFO: Estimated size bytes for the query is: 2130000000
Apr 25, 2018 8:54:46 PM org.apache.beam.sdk.io.gcp.datastore.DatastoreV1$Read$SplitQueryFn processElement
INFO: Splitting the query into 32 splits
org.apache.beam.sdk.io.gcp.datastore.SplitQueryFnIT > testSplitQueryFnWithSmallDataset STANDARD_ERROR
Apr 25, 2018 8:54:46 PM org.apache.beam.sdk.transforms.DoFnTester of
WARNING: Your tests use DoFnTester, which may not exercise DoFns correctly. Please use TestPipeline instead.
Apr 25, 2018 8:54:46 PM org.apache.beam.sdk.io.gcp.datastore.DatastoreV1$Read getEstimatedSizeBytes
INFO: Latest stats timestamp for kind shakespeare is 1524555829000000
Apr 25, 2018 8:54:46 PM org.apache.beam.sdk.io.gcp.datastore.DatastoreV1$Read getEstimatedNumSplits
INFO: Estimated size bytes for the query is: 26383451
Apr 25, 2018 8:54:46 PM org.apache.beam.sdk.io.gcp.datastore.DatastoreV1$Read$SplitQueryFn processElement
INFO: Splitting the query into 12 splits
Gradle Test Executor 128 finished executing tests.
org.apache.beam.sdk.io.gcp.spanner.SpannerWriteIT > testWrite FAILED
java.lang.NoClassDefFoundError: com/google/api/gax/retrying/ExceptionRetryAlgorithm
at java.lang.ClassLoader.defineClass1(Native Method)
at java.lang.ClassLoader.defineClass(ClassLoader.java:763)
at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)
at java.net.URLClassLoader.defineClass(URLClassLoader.java:467)
at java.net.URLClassLoader.access$100(URLClassLoader.java:73)
at java.net.URLClassLoader$1.run(URLClassLoader.java:368)
at java.net.URLClassLoader$1.run(URLClassLoader.java:362)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:361)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:338)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
at com.google.cloud.BaseService.<clinit>(BaseService.java:48)
at com.google.cloud.spanner.SpannerOptions$DefaultSpannerFactory.create(SpannerOptions.java:60)
at com.google.cloud.spanner.SpannerOptions$DefaultSpannerFactory.create(SpannerOptions.java:55)
at com.google.cloud.ServiceOptions.getService(ServiceOptions.java:426)
at org.apache.beam.sdk.io.gcp.spanner.SpannerWriteIT.setUp(SpannerWriteIT.java:91)
Caused by:
java.lang.ClassNotFoundException: com.google.api.gax.retrying.ExceptionRetryAlgorithm
at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:338)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
... 17 more
java.lang.NullPointerException
at org.apache.beam.sdk.io.gcp.spanner.SpannerWriteIT.tearDown(SpannerWriteIT.java:148)
12 tests completed, 3 failed
Finished generating test XML results (0.007 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/ws/src/runners/google-cloud-dataflow-java/build/test-results/googleCloudPlatformIntegrationTest>
Generating HTML test report...
Finished generating test html results (0.009 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/googleCloudPlatformIntegrationTest>
:beam-runners-google-cloud-dataflow-java:googleCloudPlatformIntegrationTest FAILED
:beam-runners-google-cloud-dataflow-java:googleCloudPlatformIntegrationTest (Thread[Task worker for ':',5,main]) completed. Took 16 mins 36.672 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:googleCloudPlatformIntegrationTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/googleCloudPlatformIntegrationTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.6/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 54m 14s
541 actionable tasks: 536 executed, 5 from cache
Publishing build scan...
https://gradle.com/s/w5lodlqj7qfv4
Build cache (/home/jenkins/.gradle/caches/build-cache-1) has not been cleaned up in 1 days
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user kedin@google.com
Not sending mail to unregistered user kirpichov@google.com
Not sending mail to unregistered user relax@relax-macbookpro2.roam.corp.google.com
Not sending mail to unregistered user aaltay@gmail.com
Build failed in Jenkins: beam_PostCommit_Java_GradleBuild #187
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/187/display/redirect>
------------------------------------------
[...truncated 19.52 MB...]
Apr 25, 2018 6:49:51 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.m2/repository/org/codehaus/jackson/jackson-core-asl/1.9.13/jackson-core-asl-1.9.13.jar to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0425184949-d372b40a/output/results/staging/jackson-core-asl-1.9.13-MZxJpDBOP6n-PNjc_ACdNw.jar
Apr 25, 2018 6:49:51 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.m2/repository/com/thoughtworks/paranamer/paranamer/2.7/paranamer-2.7.jar to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0425184949-d372b40a/output/results/staging/paranamer-2.7-VweilzYySf_-OOgYnNb5yw.jar
Apr 25, 2018 6:49:51 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.m2/repository/org/codehaus/jackson/jackson-mapper-asl/1.9.13/jackson-mapper-asl-1.9.13.jar to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0425184949-d372b40a/output/results/staging/jackson-mapper-asl-1.9.13-F1D5wzk1L8S3KNYbVxcWEw.jar
Apr 25, 2018 6:49:51 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.gradle/caches/modules-2/files-2.1/io.grpc/grpc-context/1.9.0/28b0836f48c9705abf73829bbc536dba29a1329a/grpc-context-1.9.0.jar to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0425184949-d372b40a/output/results/staging/grpc-context-1.9.0-atYmq4r_lax8i7-0BRHcCg.jar
Apr 25, 2018 6:49:51 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.m2/repository/com/google/protobuf/protobuf-java/3.2.0/protobuf-java-3.2.0.jar to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0425184949-d372b40a/output/results/staging/protobuf-java-3.2.0-fh30Gescj5k_IhxJOGxriw.jar
Apr 25, 2018 6:49:51 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.m2/repository/org/mockito/mockito-core/1.9.5/mockito-core-1.9.5.jar to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0425184949-d372b40a/output/results/staging/mockito-core-1.9.5-b3PPBKVutgqqmWUG58EPxw.jar
Apr 25, 2018 6:49:51 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.m2/repository/org/apache/httpcomponents/httpclient/4.0.1/httpclient-4.0.1.jar to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0425184949-d372b40a/output/results/staging/httpclient-4.0.1-nKmHdIYBAcBsqQEO_WIkoQ.jar
Apr 25, 2018 6:49:51 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.m2/repository/org/xerial/snappy/snappy-java/1.1.4/snappy-java-1.1.4.jar to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0425184949-d372b40a/output/results/staging/snappy-java-1.1.4-SFNwbMuGq13aaoKVzeS1Tw.jar
Apr 25, 2018 6:49:51 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.m2/repository/junit/junit/4.12/junit-4.12.jar to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0425184949-d372b40a/output/results/staging/junit-4.12-WzjEDJf70K3uKfkeYEBVhA.jar
Apr 25, 2018 6:49:51 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.m2/repository/io/netty/netty-handler-proxy/4.1.8.Final/netty-handler-proxy-4.1.8.Final.jar to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0425184949-d372b40a/output/results/staging/netty-handler-proxy-4.1.8.Final-Zey48Fj4mlWtgpwIc7Osgg.jar
Apr 25, 2018 6:49:51 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.m2/repository/com/google/errorprone/error_prone_annotations/2.0.15/error_prone_annotations-2.0.15.jar to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0425184949-d372b40a/output/results/staging/error_prone_annotations-2.0.15-npnuyJrjs2dF75GdvUBIvQ.jar
Apr 25, 2018 6:49:51 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.m2/repository/io/netty/netty-codec-http/4.1.8.Final/netty-codec-http-4.1.8.Final.jar to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0425184949-d372b40a/output/results/staging/netty-codec-http-4.1.8.Final-uBsfxiZeL3IeVQNS0QTHUw.jar
Apr 25, 2018 6:49:51 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.m2/repository/io/netty/netty-codec-socks/4.1.8.Final/netty-codec-socks-4.1.8.Final.jar to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0425184949-d372b40a/output/results/staging/netty-codec-socks-4.1.8.Final-dfbCpCpgkEl1iwscd6OVeQ.jar
Apr 25, 2018 6:49:51 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.m2/repository/org/apache/commons/commons-compress/1.16.1/commons-compress-1.16.1.jar to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0425184949-d372b40a/output/results/staging/commons-compress-1.16.1-NAljjWtr0jBC7qxc2X4lbA.jar
Apr 25, 2018 6:49:51 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.m2/repository/org/threeten/threetenbp/1.3.3/threetenbp-1.3.3.jar to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0425184949-d372b40a/output/results/staging/threetenbp-1.3.3-bEXFSgaAYiXSdUtR-98IjQ.jar
Apr 25, 2018 6:49:51 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.m2/repository/io/netty/netty-codec/4.1.8.Final/netty-codec-4.1.8.Final.jar to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0425184949-d372b40a/output/results/staging/netty-codec-4.1.8.Final-Og5DJ4MB-fn1oSzjKqVU_w.jar
Apr 25, 2018 6:49:51 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.m2/repository/io/netty/netty-tcnative-boringssl-static/1.1.33.Fork26/netty-tcnative-boringssl-static-1.1.33.Fork26.jar to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0425184949-d372b40a/output/results/staging/netty-tcnative-boringssl-static-1.1.33.Fork26-29XB0C44MyezMyoCB5cCbw.jar
Apr 25, 2018 6:49:51 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.m2/repository/org/json/json/20160810/json-20160810.jar to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0425184949-d372b40a/output/results/staging/json-20160810-L3-Jnwdm5lAXdEpMT8FNRg.jar
Apr 25, 2018 6:49:51 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.m2/repository/io/netty/netty-transport/4.1.8.Final/netty-transport-4.1.8.Final.jar to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0425184949-d372b40a/output/results/staging/netty-transport-4.1.8.Final-PXWj5ZmqlznhCnqhkcOwDA.jar
Apr 25, 2018 6:49:51 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.m2/repository/commons-logging/commons-logging/1.2/commons-logging-1.2.jar to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0425184949-d372b40a/output/results/staging/commons-logging-1.2-BAtLTY6siG9rSio70vMbAA.jar
Apr 25, 2018 6:49:51 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.m2/repository/org/objenesis/objenesis/2.6/objenesis-2.6.jar to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0425184949-d372b40a/output/results/staging/objenesis-2.6-X_rD9RQFypspFZcKIks-jw.jar
Apr 25, 2018 6:49:51 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.gradle/caches/modules-2/files-2.1/com.google.auto.value/auto-value/1.4/6d1448fcd13074bd3658ef915022410b7c48343b/auto-value-1.4.jar to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0425184949-d372b40a/output/results/staging/auto-value-1.4-_7tYdqNvCowycFIDpBenFw.jar
Apr 25, 2018 6:49:51 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.m2/repository/io/netty/netty-buffer/4.1.8.Final/netty-buffer-4.1.8.Final.jar to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0425184949-d372b40a/output/results/staging/netty-buffer-4.1.8.Final-iwny8IFMu0G1ln10Yx5VrA.jar
Apr 25, 2018 6:49:51 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.m2/repository/com/google/code/gson/gson/2.7/gson-2.7.jar to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0425184949-d372b40a/output/results/staging/gson-2.7-UTSiNQ9YiQ_7nbC0AEcZXQ.jar
Apr 25, 2018 6:49:51 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.m2/repository/com/squareup/okio/okio/1.6.0/okio-1.6.0.jar to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0425184949-d372b40a/output/results/staging/okio-1.6.0-Fk0cKMMjz24qkX1gN0xXGA.jar
Apr 25, 2018 6:49:51 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.m2/repository/org/apache/httpcomponents/httpcore/4.0.1/httpcore-4.0.1.jar to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0425184949-d372b40a/output/results/staging/httpcore-4.0.1-bBlj_YrAxAwATJ6JLg13Aw.jar
Apr 25, 2018 6:49:51 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.m2/repository/io/netty/netty-resolver/4.1.8.Final/netty-resolver-4.1.8.Final.jar to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0425184949-d372b40a/output/results/staging/netty-resolver-4.1.8.Final-ZBELwscrxRZgRR5DKH9siA.jar
Apr 25, 2018 6:49:51 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.gradle/caches/modules-2/files-2.1/com.esotericsoftware.kryo/kryo/2.21/9a4e69cff8d225729656f7e97e40893b23bffef/kryo-2.21.jar to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0425184949-d372b40a/output/results/staging/kryo-2.21-olkSUBNMYGe-WXkdlwcytQ.jar
Apr 25, 2018 6:49:51 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.m2/repository/com/squareup/okhttp/okhttp/2.5.0/okhttp-2.5.0.jar to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0425184949-d372b40a/output/results/staging/okhttp-2.5.0-64v0X4G_nxfR_PsuymOqpg.jar
Apr 25, 2018 6:49:51 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.gradle/caches/modules-2/files-2.1/com.esotericsoftware.reflectasm/reflectasm/1.07/76f11c94a53ee975a0d9154b325c408b210155bd/reflectasm-1.07-shaded.jar to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0425184949-d372b40a/output/results/staging/reflectasm-1.07-shaded-IELCIoQPsh49E873w5ZYMQ.jar
Apr 25, 2018 6:49:51 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.gradle/caches/modules-2/files-2.1/org.ow2.asm/asm/4.0/659add6efc75a4715d738e73f07505246edf4d66/asm-4.0.jar to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0425184949-d372b40a/output/results/staging/asm-4.0-Mi2PiMURGvYS34OMAZHNfg.jar
Apr 25, 2018 6:49:51 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.gradle/caches/modules-2/files-2.1/com.esotericsoftware.minlog/minlog/1.2/59bfcd171d82f9981a5e242b9e840191f650e209/minlog-1.2.jar to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0425184949-d372b40a/output/results/staging/minlog-1.2-98-99jtn3wu_pMfLJgiFvA.jar
Apr 25, 2018 6:49:51 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.m2/repository/com/google/protobuf/nano/protobuf-javanano/3.0.0-alpha-5/protobuf-javanano-3.0.0-alpha-5.jar to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0425184949-d372b40a/output/results/staging/protobuf-javanano-3.0.0-alpha-5-SsS7fZe7brffHbAGUgRrnw.jar
Apr 25, 2018 6:49:51 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.gradle/caches/modules-2/files-2.1/org.yaml/snakeyaml/1.17/7a27ea250c5130b2922b86dea63cbb1cc10a660c/snakeyaml-1.17.jar to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0425184949-d372b40a/output/results/staging/snakeyaml-1.17-q2IcPO4xYjatBKbw_k3RfA.jar
Apr 25, 2018 6:49:51 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/ws/src/sdks/java/io/google-cloud-platform/build/libs/beam-sdks-java-io-google-cloud-platform-2.5.0-SNAPSHOT-shaded.jar> to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0425184949-d372b40a/output/results/staging/beam-sdks-java-io-google-cloud-platform-2.5.0-SNAPSHOT-shaded--VgNB4BVWWlwJCgMz6LqTw.jar
Apr 25, 2018 6:49:51 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.m2/repository/joda-time/joda-time/2.4/joda-time-2.4.jar to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0425184949-d372b40a/output/results/staging/joda-time-2.4-EjHD4J3mql1rbZmCwCJOIA.jar
Apr 25, 2018 6:49:51 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.m2/repository/io/netty/netty-common/4.1.8.Final/netty-common-4.1.8.Final.jar to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0425184949-d372b40a/output/results/staging/netty-common-4.1.8.Final-lafOW8vGsI6SRwZSmXNClg.jar
Apr 25, 2018 6:49:51 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.m2/repository/com/google/cloud/bigtable/bigtable-client-core/1.0.0/bigtable-client-core-1.0.0.jar to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0425184949-d372b40a/output/results/staging/bigtable-client-core-1.0.0-krEvsGXi2mdIqxm6h_-QdA.jar
Apr 25, 2018 6:49:51 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.m2/repository/commons-codec/commons-codec/1.3/commons-codec-1.3.jar to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0425184949-d372b40a/output/results/staging/commons-codec-1.3-jhScEFN0HANzalLfg5dNzA.jar
Apr 25, 2018 6:49:51 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/ws/src/sdks/java/io/google-cloud-platform/build/libs/beam-sdks-java-io-google-cloud-platform-2.5.0-SNAPSHOT-shaded-tests.jar> to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0425184949-d372b40a/output/results/staging/beam-sdks-java-io-google-cloud-platform-2.5.0-SNAPSHOT-shaded-tests-pLMUfn5z_ZSnoA4FYLbGJQ.jar
Apr 25, 2018 6:52:24 PM org.apache.beam.runners.dataflow.util.PackageUtil stageClasspathElements
INFO: Staging files complete: 0 files cached, 127 files newly uploaded
Apr 25, 2018 6:52:24 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding GenerateSequence/Read(BoundedCountingSource) as step s1
Apr 25, 2018 6:52:24 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding ParDo(CreateEntity) as step s2
Apr 25, 2018 6:52:24 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding DatastoreV1.Write/Convert to Mutation/Map as step s3
Apr 25, 2018 6:52:24 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding DatastoreV1.Write/Write Mutation to Datastore as step s4
Apr 25, 2018 6:52:24 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0425184949-d372b40a/output/results/staging/
Apr 25, 2018 6:52:25 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <8772 bytes, hash bnvSRHgZ0LgoOXeodBJF3A> to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0425184949-d372b40a/output/results/staging/pipeline-bnvSRHgZ0LgoOXeodBJF3A.pb
org.apache.beam.sdk.io.gcp.datastore.V1WriteIT > testE2EV1Write STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT
org.apache.beam.sdk.io.gcp.datastore.V1WriteIT > testE2EV1Write STANDARD_ERROR
Apr 25, 2018 6:52:26 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-04-25_11_52_25-17568505060621468987?project=apache-beam-testing
org.apache.beam.sdk.io.gcp.datastore.V1WriteIT > testE2EV1Write STANDARD_OUT
Submitted job: 2018-04-25_11_52_25-17568505060621468987
org.apache.beam.sdk.io.gcp.datastore.V1WriteIT > testE2EV1Write STANDARD_ERROR
Apr 25, 2018 6:52:26 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-04-25_11_52_25-17568505060621468987
Apr 25, 2018 6:52:26 PM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-04-25_11_52_25-17568505060621468987 with 0 expected assertions.
Apr 25, 2018 6:52:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T18:52:25.316Z: Autoscaling is enabled for job 2018-04-25_11_52_25-17568505060621468987. The number of workers will be between 1 and 1000.
Apr 25, 2018 6:52:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T18:52:25.330Z: Autoscaling was automatically enabled for job 2018-04-25_11_52_25-17568505060621468987.
Apr 25, 2018 6:52:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T18:52:28.312Z: Checking required Cloud APIs are enabled.
Apr 25, 2018 6:52:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T18:52:28.598Z: Checking permissions granted to controller Service Account.
Apr 25, 2018 6:52:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T18:52:34.780Z: Worker configuration: n1-standard-1 in us-central1-f.
Apr 25, 2018 6:52:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T18:52:35.171Z: Expanding CoGroupByKey operations into optimizable parts.
Apr 25, 2018 6:52:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T18:52:35.208Z: Expanding GroupByKey operations into optimizable parts.
Apr 25, 2018 6:52:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T18:52:35.227Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
Apr 25, 2018 6:52:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T18:52:35.286Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
Apr 25, 2018 6:52:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T18:52:35.305Z: Fusing consumer ParDo(CreateEntity) into GenerateSequence/Read(BoundedCountingSource)
Apr 25, 2018 6:52:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T18:52:35.327Z: Fusing consumer DatastoreV1.Write/Write Mutation to Datastore into DatastoreV1.Write/Convert to Mutation/Map
Apr 25, 2018 6:52:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T18:52:35.348Z: Fusing consumer DatastoreV1.Write/Convert to Mutation/Map into ParDo(CreateEntity)
Apr 25, 2018 6:52:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T18:52:35.629Z: Executing operation GenerateSequence/Read(BoundedCountingSource)+ParDo(CreateEntity)+DatastoreV1.Write/Convert to Mutation/Map+DatastoreV1.Write/Write Mutation to Datastore
Apr 25, 2018 6:52:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T18:52:35.688Z: Starting 1 workers in us-central1-f...
Apr 25, 2018 6:52:44 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T18:52:42.803Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
Apr 25, 2018 6:52:55 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T18:52:54.347Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
Apr 25, 2018 6:53:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T18:53:10.820Z: Workers have started successfully.
Apr 25, 2018 6:53:48 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T18:53:47.398Z: Cleaning up.
Apr 25, 2018 6:53:48 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T18:53:47.559Z: Stopping worker pool...
Apr 25, 2018 6:55:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T18:55:16.123Z: Autoscaling: Resized worker pool from 1 to 0.
Apr 25, 2018 6:55:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T18:55:16.147Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
Apr 25, 2018 6:55:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T18:55:16.190Z: Worker pool stopped.
Apr 25, 2018 6:55:24 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-04-25_11_52_25-17568505060621468987 finished with status DONE.
Apr 25, 2018 6:55:24 PM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-04-25_11_52_25-17568505060621468987. Found 0 success, 0 failures out of 0 expected assertions.
Apr 25, 2018 6:55:26 PM org.apache.beam.sdk.io.gcp.datastore.V1TestUtil$V1TestWriter flushBatch
INFO: Writing batch of 500 entities
Apr 25, 2018 6:55:26 PM org.apache.beam.sdk.io.gcp.datastore.V1TestUtil$V1TestWriter flushBatch
INFO: Successfully wrote 500 entities
Apr 25, 2018 6:55:27 PM org.apache.beam.sdk.io.gcp.datastore.V1TestUtil$V1TestWriter flushBatch
INFO: Writing batch of 500 entities
Apr 25, 2018 6:55:27 PM org.apache.beam.sdk.io.gcp.datastore.V1TestUtil$V1TestWriter flushBatch
INFO: Successfully wrote 500 entities
Apr 25, 2018 6:55:27 PM org.apache.beam.sdk.io.gcp.datastore.V1TestUtil deleteAllEntities
INFO: Successfully deleted 1000 entities
org.apache.beam.sdk.io.gcp.spanner.SpannerReadIT > testQuery FAILED
java.lang.NoClassDefFoundError: com/google/api/gax/retrying/ExceptionRetryAlgorithm
at java.lang.ClassLoader.defineClass1(Native Method)
at java.lang.ClassLoader.defineClass(ClassLoader.java:763)
at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)
at java.net.URLClassLoader.defineClass(URLClassLoader.java:467)
at java.net.URLClassLoader.access$100(URLClassLoader.java:73)
at java.net.URLClassLoader$1.run(URLClassLoader.java:368)
at java.net.URLClassLoader$1.run(URLClassLoader.java:362)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:361)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:338)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
at com.google.cloud.BaseService.<clinit>(BaseService.java:48)
at com.google.cloud.spanner.SpannerOptions$DefaultSpannerFactory.create(SpannerOptions.java:60)
at com.google.cloud.spanner.SpannerOptions$DefaultSpannerFactory.create(SpannerOptions.java:55)
at com.google.cloud.ServiceOptions.getService(ServiceOptions.java:426)
at org.apache.beam.sdk.io.gcp.spanner.SpannerReadIT.setUp(SpannerReadIT.java:90)
Caused by:
java.lang.ClassNotFoundException: com.google.api.gax.retrying.ExceptionRetryAlgorithm
at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:338)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
... 17 more
java.lang.NullPointerException
at org.apache.beam.sdk.io.gcp.spanner.SpannerReadIT.tearDown(SpannerReadIT.java:198)
Gradle Test Executor 129 finished executing tests.
org.apache.beam.sdk.io.gcp.spanner.SpannerReadIT > testRead FAILED
java.lang.NoClassDefFoundError: Could not initialize class com.google.cloud.spanner.SpannerImpl
at com.google.cloud.spanner.SpannerOptions$DefaultSpannerFactory.create(SpannerOptions.java:60)
at com.google.cloud.spanner.SpannerOptions$DefaultSpannerFactory.create(SpannerOptions.java:55)
at com.google.cloud.ServiceOptions.getService(ServiceOptions.java:426)
at org.apache.beam.sdk.io.gcp.spanner.SpannerReadIT.setUp(SpannerReadIT.java:90)
java.lang.NullPointerException
at org.apache.beam.sdk.io.gcp.spanner.SpannerReadIT.tearDown(SpannerReadIT.java:198)
12 tests completed, 3 failed
Finished generating test XML results (0.013 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/ws/src/runners/google-cloud-dataflow-java/build/test-results/googleCloudPlatformIntegrationTest>
Generating HTML test report...
Finished generating test html results (0.009 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/googleCloudPlatformIntegrationTest>
:beam-runners-google-cloud-dataflow-java:googleCloudPlatformIntegrationTest FAILED
:beam-runners-google-cloud-dataflow-java:googleCloudPlatformIntegrationTest (Thread[main,5,main]) completed. Took 25 mins 13.418 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:googleCloudPlatformIntegrationTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/googleCloudPlatformIntegrationTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.6/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 53m 36s
541 actionable tasks: 536 executed, 5 from cache
Publishing build scan...
https://gradle.com/s/u6fvt6lqu7nqo
Build cache (/home/jenkins/.gradle/caches/build-cache-1) has not been cleaned up in 1 days
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user kedin@google.com
Not sending mail to unregistered user kirpichov@google.com
Not sending mail to unregistered user relax@relax-macbookpro2.roam.corp.google.com
Build failed in Jenkins: beam_PostCommit_Java_GradleBuild #186
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/186/display/redirect?page=changes>
Changes:
[relax] Add support for @Element injection in NewDoFn.
[relax] Add @Timestamp annotation to NewDoFn
[relax] Add support for OutputReceiver and MultiOutputReceiver. Currently we
[relax] Add support for timestamp and time domain to timers. Convert word count
[relax] Add some more tests.
[relax] Rewrite MapElements to use new-style.
[relax] Port common transforms to new style, excluding those that use
[relax] Fix javadoc.
[relax] Fix compilation error.
[relax] Fix CheckStyle errors.
[relax] Add proper downcast for element type.
[relax] Fix CheckStyle error.
[relax] Change MultiOutputReceiver to vend OutputReceivers.
[relax] Fix ParDoTest
[relax] Fix DoFnTester
[relax] Address CR comments.
[relax] Don't allow splitting a restriction into a different timestamp.
[relax] Add @Nullable annotations to DoFnTester.
[relax] Usage of the new parameters will break on Dataflow until Dataflow's
------------------------------------------
[...truncated 19.60 MB...]
INFO: 2018-04-25T17:12:34.260Z: Fusing consumer PAssert$3/CreateActual/GatherPanes/GroupByKey/Write into PAssert$3/CreateActual/GatherPanes/GroupByKey/Reify
Apr 25, 2018 5:12:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T17:12:34.282Z: Fusing consumer PAssert$3/CreateActual/GatherPanes/Window.Into()/Window.Assign into PAssert$3/CreateActual/GatherPanes/WithKeys/AddKeys/Map
Apr 25, 2018 5:12:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T17:12:34.308Z: Unzipping flatten s18-u63 for input s19.output-c61
Apr 25, 2018 5:12:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T17:12:34.342Z: Fusing unzipped copy of PAssert$3/CreateActual/GatherPanes/Reify.Window/ParDo(Anonymous), through flatten s18-u63, into producer PAssert$3/CreateActual/FilterActuals/Window.Assign
Apr 25, 2018 5:12:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T17:12:34.370Z: Fusing consumer PAssert$3/CreateActual/GatherPanes/Reify.Window/ParDo(Anonymous) into PAssert$3/CreateActual/FilterActuals/Window.Assign
Apr 25, 2018 5:12:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T17:12:34.399Z: Fusing consumer PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
Apr 25, 2018 5:12:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T17:12:34.430Z: Fusing consumer PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
Apr 25, 2018 5:12:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T17:12:34.455Z: Fusing consumer PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
Apr 25, 2018 5:12:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T17:12:34.487Z: Fusing consumer PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
Apr 25, 2018 5:12:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T17:12:34.518Z: Fusing consumer PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
Apr 25, 2018 5:12:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T17:12:34.535Z: Fusing consumer PAssert$3/CreateActual/RewindowActuals/Window.Assign into PAssert$3/CreateActual/Flatten.Iterables/FlattenIterables/FlatMap
Apr 25, 2018 5:12:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T17:12:34.565Z: Fusing consumer PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
Apr 25, 2018 5:12:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T17:12:34.597Z: Fusing consumer PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
Apr 25, 2018 5:12:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T17:12:34.625Z: Fusing consumer PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
Apr 25, 2018 5:12:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T17:12:34.653Z: Fusing consumer PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
Apr 25, 2018 5:12:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T17:12:34.669Z: Fusing consumer PAssert$3/CreateActual/ParDo(Anonymous) into PAssert$3/CreateActual/RewindowActuals/Window.Assign
Apr 25, 2018 5:12:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T17:12:34.700Z: Fusing consumer PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into PAssert$3/CreateActual/ParDo(Anonymous)
Apr 25, 2018 5:12:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T17:12:34.724Z: Fusing consumer Combine.globally(Count)/ProduceDefault into Combine.globally(Count)/CreateVoid/Read(CreateSource)
Apr 25, 2018 5:12:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T17:12:34.756Z: Fusing consumer Combine.globally(Count)/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow) into Combine.globally(Count)/Values/Values/Map
Apr 25, 2018 5:12:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T17:12:34.785Z: Fusing consumer Combine.globally(Count)/Combine.perKey(Count)/Combine.GroupedValues into Combine.globally(Count)/Combine.perKey(Count)/GroupByKey/Read
Apr 25, 2018 5:12:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T17:12:34.823Z: Fusing consumer Combine.globally(Count)/Combine.perKey(Count)/GroupByKey+Combine.globally(Count)/Combine.perKey(Count)/Combine.GroupedValues/Partial into Combine.globally(Count)/WithKeys/AddKeys/Map
Apr 25, 2018 5:12:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T17:12:34.865Z: Fusing consumer DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/GroupByWindow into DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/Read
Apr 25, 2018 5:12:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T17:12:34.900Z: Fusing consumer Combine.globally(Count)/Combine.perKey(Count)/GroupByKey/Reify into Combine.globally(Count)/Combine.perKey(Count)/GroupByKey+Combine.globally(Count)/Combine.perKey(Count)/Combine.GroupedValues/Partial
Apr 25, 2018 5:12:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T17:12:34.931Z: Fusing consumer Combine.globally(Count)/WithKeys/AddKeys/Map into DatastoreV1.Read/Read
Apr 25, 2018 5:12:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T17:12:34.957Z: Fusing consumer DatastoreV1.Read/Reshuffle/Pair with random key into DatastoreV1.Read/Split
Apr 25, 2018 5:12:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T17:12:34.989Z: Fusing consumer DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/Write into DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/Reify
Apr 25, 2018 5:12:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T17:12:35.034Z: Fusing consumer DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/Reify into DatastoreV1.Read/Reshuffle/Reshuffle/Window.Into()/Window.Assign
Apr 25, 2018 5:12:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T17:12:35.070Z: Fusing consumer Combine.globally(Count)/Values/Values/Map into Combine.globally(Count)/Combine.perKey(Count)/Combine.GroupedValues/Extract
Apr 25, 2018 5:12:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T17:12:35.100Z: Fusing consumer DatastoreV1.Read/Split into DatastoreV1.Read/ParDo(GqlQueryTranslate)
Apr 25, 2018 5:12:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T17:12:35.124Z: Fusing consumer DatastoreV1.Read/Reshuffle/Reshuffle/Window.Into()/Window.Assign into DatastoreV1.Read/Reshuffle/Pair with random key
Apr 25, 2018 5:12:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T17:12:35.148Z: Fusing consumer Combine.globally(Count)/Combine.perKey(Count)/GroupByKey/Write into Combine.globally(Count)/Combine.perKey(Count)/GroupByKey/Reify
Apr 25, 2018 5:12:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T17:12:35.180Z: Fusing consumer DatastoreV1.Read/ParDo(GqlQueryTranslate) into DatastoreV1.Read/Create.OfValueProvider/Create.Values/Read(CreateSource)
Apr 25, 2018 5:12:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T17:12:35.212Z: Fusing consumer DatastoreV1.Read/Read into DatastoreV1.Read/Reshuffle/Values/Values/Map
Apr 25, 2018 5:12:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T17:12:35.244Z: Fusing consumer DatastoreV1.Read/Reshuffle/Values/Values/Map into DatastoreV1.Read/Reshuffle/Reshuffle/ExpandIterable
Apr 25, 2018 5:12:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T17:12:35.267Z: Fusing consumer DatastoreV1.Read/Reshuffle/Reshuffle/ExpandIterable into DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/GroupByWindow
Apr 25, 2018 5:12:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T17:12:35.298Z: Fusing consumer Combine.globally(Count)/Combine.perKey(Count)/Combine.GroupedValues/Extract into Combine.globally(Count)/Combine.perKey(Count)/Combine.GroupedValues
Apr 25, 2018 5:12:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T17:12:35.336Z: Fusing consumer PAssert$3/RunChecks into PAssert$3/WindowToken/Window.Assign
Apr 25, 2018 5:12:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T17:12:35.370Z: Fusing consumer PAssert$3/WindowToken/Window.Assign into PAssert$3/Create.Values/Read(CreateSource)
Apr 25, 2018 5:12:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T17:12:35.402Z: Fusing consumer PAssert$3/VerifyAssertions/ParDo(DefaultConclude) into PAssert$3/RunChecks
Apr 25, 2018 5:12:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T17:12:35.749Z: Executing operation Combine.globally(Count)/Combine.perKey(Count)/GroupByKey/Create
Apr 25, 2018 5:12:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T17:12:35.773Z: Executing operation PAssert$3/CreateActual/GatherPanes/GroupByKey/Create
Apr 25, 2018 5:12:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T17:12:35.804Z: Executing operation PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
Apr 25, 2018 5:12:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T17:12:35.816Z: Starting 1 workers in us-central1-f...
Apr 25, 2018 5:12:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T17:12:35.829Z: Executing operation PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
Apr 25, 2018 5:12:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T17:12:35.862Z: Executing operation DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/Create
Apr 25, 2018 5:12:46 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T17:12:45.545Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
Apr 25, 2018 5:12:46 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T17:12:45.992Z: Executing operation DatastoreV1.Read/Create.OfValueProvider/Create.Values/Read(CreateSource)+DatastoreV1.Read/ParDo(GqlQueryTranslate)+DatastoreV1.Read/Split+DatastoreV1.Read/Reshuffle/Pair with random key+DatastoreV1.Read/Reshuffle/Reshuffle/Window.Into()/Window.Assign+DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/Reify+DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/Write
Apr 25, 2018 5:12:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T17:12:51.437Z: Autoscaling: Resizing worker pool from 1 to 5.
Apr 25, 2018 5:12:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T17:12:57.858Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
Apr 25, 2018 5:12:58 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T17:12:57.897Z: Resized worker pool to 1, though goal was 5. This could be a quota issue.
Apr 25, 2018 5:13:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T17:13:08.390Z: Autoscaling: Raised the number of workers to 4 based on the rate of progress in the currently running step(s).
Apr 25, 2018 5:13:09 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T17:13:08.411Z: Resized worker pool to 4, though goal was 5. This could be a quota issue.
Apr 25, 2018 5:13:14 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T17:13:13.720Z: Autoscaling: Raised the number of workers to 5 based on the rate of progress in the currently running step(s).
Apr 25, 2018 5:13:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T17:13:20.592Z: Workers have started successfully.
Apr 25, 2018 5:13:43 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T17:13:41.738Z: Executing operation DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/Close
Apr 25, 2018 5:13:43 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T17:13:41.817Z: Executing operation DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/Read+DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/GroupByWindow+DatastoreV1.Read/Reshuffle/Reshuffle/ExpandIterable+DatastoreV1.Read/Reshuffle/Values/Values/Map+DatastoreV1.Read/Read+Combine.globally(Count)/WithKeys/AddKeys/Map+Combine.globally(Count)/Combine.perKey(Count)/GroupByKey+Combine.globally(Count)/Combine.perKey(Count)/Combine.GroupedValues/Partial+Combine.globally(Count)/Combine.perKey(Count)/GroupByKey/Reify+Combine.globally(Count)/Combine.perKey(Count)/GroupByKey/Write
Apr 25, 2018 5:13:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T17:13:51.953Z: Executing operation Combine.globally(Count)/Combine.perKey(Count)/GroupByKey/Close
Apr 25, 2018 5:13:53 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T17:13:52.014Z: Executing operation Combine.globally(Count)/Combine.perKey(Count)/GroupByKey/Read+Combine.globally(Count)/Combine.perKey(Count)/Combine.GroupedValues+Combine.globally(Count)/Combine.perKey(Count)/Combine.GroupedValues/Extract+Combine.globally(Count)/Values/Values/Map+PAssert$3/CreateActual/FilterActuals/Window.Assign+PAssert$3/CreateActual/GatherPanes/Reify.Window/ParDo(Anonymous)+PAssert$3/CreateActual/GatherPanes/WithKeys/AddKeys/Map+PAssert$3/CreateActual/GatherPanes/Window.Into()/Window.Assign+PAssert$3/CreateActual/GatherPanes/GroupByKey/Reify+PAssert$3/CreateActual/GatherPanes/GroupByKey/Write+Combine.globally(Count)/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow)
Apr 25, 2018 5:14:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T17:14:03.302Z: Executing operation Combine.globally(Count)/View.AsIterable/CreateDataflowView
Apr 25, 2018 5:14:05 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T17:14:03.450Z: Executing operation Combine.globally(Count)/CreateVoid/Read(CreateSource)+Combine.globally(Count)/ProduceDefault+PAssert$3/CreateActual/FilterActuals/Window.Assign+PAssert$3/CreateActual/GatherPanes/Reify.Window/ParDo(Anonymous)+PAssert$3/CreateActual/GatherPanes/WithKeys/AddKeys/Map+PAssert$3/CreateActual/GatherPanes/Window.Into()/Window.Assign+PAssert$3/CreateActual/GatherPanes/GroupByKey/Reify+PAssert$3/CreateActual/GatherPanes/GroupByKey/Write
Apr 25, 2018 5:14:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T17:14:11.833Z: Executing operation PAssert$3/CreateActual/GatherPanes/GroupByKey/Close
Apr 25, 2018 5:14:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T17:14:11.927Z: Executing operation PAssert$3/CreateActual/GatherPanes/GroupByKey/Read+PAssert$3/CreateActual/GatherPanes/GroupByKey/GroupByWindow+PAssert$3/CreateActual/GatherPanes/Values/Values/Map+PAssert$3/CreateActual/ExtractPane/Map+PAssert$3/CreateActual/Flatten.Iterables/FlattenIterables/FlatMap+PAssert$3/CreateActual/RewindowActuals/Window.Assign+PAssert$3/CreateActual/ParDo(Anonymous)+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
Apr 25, 2018 5:14:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T17:14:13.829Z: Executing operation PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
Apr 25, 2018 5:14:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T17:14:13.883Z: Executing operation PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
Apr 25, 2018 5:14:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T17:14:16.691Z: Executing operation PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
Apr 25, 2018 5:14:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T17:14:16.760Z: Executing operation PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
Apr 25, 2018 5:14:22 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T17:14:21.294Z: Executing operation PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
Apr 25, 2018 5:14:22 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T17:14:21.443Z: Executing operation PAssert$3/Create.Values/Read(CreateSource)+PAssert$3/WindowToken/Window.Assign+PAssert$3/RunChecks+PAssert$3/VerifyAssertions/ParDo(DefaultConclude)
Apr 25, 2018 5:14:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T17:14:22.490Z: Cleaning up.
Apr 25, 2018 5:14:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T17:14:22.798Z: Stopping worker pool...
Apr 25, 2018 5:16:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T17:16:12.756Z: Autoscaling: Resized worker pool from 5 to 0.
Apr 25, 2018 5:16:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T17:16:12.784Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
Apr 25, 2018 5:16:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T17:16:12.829Z: Worker pool stopped.
Apr 25, 2018 5:16:22 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-04-25_10_12_24-11012651769843925840 finished with status DONE.
Apr 25, 2018 5:16:22 PM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-04-25_10_12_24-11012651769843925840. Found 1 success, 0 failures out of 1 expected assertions.
Apr 25, 2018 5:16:22 PM org.apache.beam.sdk.io.gcp.datastore.V1TestUtil$V1TestWriter flushBatch
INFO: Writing batch of 500 entities
Apr 25, 2018 5:16:22 PM org.apache.beam.sdk.io.gcp.datastore.V1TestUtil$V1TestWriter flushBatch
INFO: Successfully wrote 500 entities
Apr 25, 2018 5:16:23 PM org.apache.beam.sdk.io.gcp.datastore.V1TestUtil$V1TestWriter flushBatch
INFO: Writing batch of 500 entities
Apr 25, 2018 5:16:23 PM org.apache.beam.sdk.io.gcp.datastore.V1TestUtil$V1TestWriter flushBatch
INFO: Successfully wrote 500 entities
Apr 25, 2018 5:16:23 PM org.apache.beam.sdk.io.gcp.datastore.V1TestUtil deleteAllEntities
INFO: Successfully deleted 1000 entities
org.apache.beam.sdk.io.gcp.datastore.SplitQueryFnIT > testSplitQueryFnWithLargeDataset STANDARD_ERROR
Apr 25, 2018 5:16:23 PM org.apache.beam.sdk.transforms.DoFnTester of
WARNING: Your tests use DoFnTester, which may not exercise DoFns correctly. Please use TestPipeline instead.
Apr 25, 2018 5:16:24 PM org.apache.beam.sdk.io.gcp.datastore.DatastoreV1$Read getEstimatedSizeBytes
INFO: Latest stats timestamp for kind sort_1G is 1524123813000000
Apr 25, 2018 5:16:24 PM org.apache.beam.sdk.io.gcp.datastore.DatastoreV1$Read getEstimatedNumSplits
INFO: Estimated size bytes for the query is: 2130000000
Apr 25, 2018 5:16:24 PM org.apache.beam.sdk.io.gcp.datastore.DatastoreV1$Read$SplitQueryFn processElement
INFO: Splitting the query into 32 splits
org.apache.beam.sdk.io.gcp.datastore.SplitQueryFnIT > testSplitQueryFnWithSmallDataset STANDARD_ERROR
Apr 25, 2018 5:16:24 PM org.apache.beam.sdk.transforms.DoFnTester of
WARNING: Your tests use DoFnTester, which may not exercise DoFns correctly. Please use TestPipeline instead.
Apr 25, 2018 5:16:24 PM org.apache.beam.sdk.io.gcp.datastore.DatastoreV1$Read getEstimatedSizeBytes
INFO: Latest stats timestamp for kind shakespeare is 1524123813000000
Apr 25, 2018 5:16:24 PM org.apache.beam.sdk.io.gcp.datastore.DatastoreV1$Read getEstimatedNumSplits
INFO: Estimated size bytes for the query is: 26383451
Apr 25, 2018 5:16:24 PM org.apache.beam.sdk.io.gcp.datastore.DatastoreV1$Read$SplitQueryFn processElement
INFO: Splitting the query into 12 splits
Gradle Test Executor 129 finished executing tests.
org.apache.beam.sdk.io.gcp.spanner.SpannerWriteIT > testWrite FAILED
java.lang.NoClassDefFoundError: com/google/api/gax/retrying/ExceptionRetryAlgorithm
at java.lang.ClassLoader.defineClass1(Native Method)
at java.lang.ClassLoader.defineClass(ClassLoader.java:763)
at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)
at java.net.URLClassLoader.defineClass(URLClassLoader.java:467)
at java.net.URLClassLoader.access$100(URLClassLoader.java:73)
at java.net.URLClassLoader$1.run(URLClassLoader.java:368)
at java.net.URLClassLoader$1.run(URLClassLoader.java:362)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:361)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:338)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
at com.google.cloud.BaseService.<clinit>(BaseService.java:48)
at com.google.cloud.spanner.SpannerOptions$DefaultSpannerFactory.create(SpannerOptions.java:60)
at com.google.cloud.spanner.SpannerOptions$DefaultSpannerFactory.create(SpannerOptions.java:55)
at com.google.cloud.ServiceOptions.getService(ServiceOptions.java:426)
at org.apache.beam.sdk.io.gcp.spanner.SpannerWriteIT.setUp(SpannerWriteIT.java:91)
Caused by:
java.lang.ClassNotFoundException: com.google.api.gax.retrying.ExceptionRetryAlgorithm
at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:338)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
... 17 more
java.lang.NullPointerException
at org.apache.beam.sdk.io.gcp.spanner.SpannerWriteIT.tearDown(SpannerWriteIT.java:148)
12 tests completed, 3 failed
Finished generating test XML results (0.01 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/ws/src/runners/google-cloud-dataflow-java/build/test-results/googleCloudPlatformIntegrationTest>
Generating HTML test report...
Finished generating test html results (0.015 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/googleCloudPlatformIntegrationTest>
:beam-runners-google-cloud-dataflow-java:googleCloudPlatformIntegrationTest FAILED
:beam-runners-google-cloud-dataflow-java:googleCloudPlatformIntegrationTest (Thread[main,5,main]) completed. Took 16 mins 25.286 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:googleCloudPlatformIntegrationTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/googleCloudPlatformIntegrationTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.6/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 52m 13s
541 actionable tasks: 534 executed, 7 from cache
Publishing build scan...
https://gradle.com/s/5giirxcft4yhk
Build cache (/home/jenkins/.gradle/caches/build-cache-1) has not been cleaned up in 0 days
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user kedin@google.com
Not sending mail to unregistered user kirpichov@google.com
Not sending mail to unregistered user relax@relax-macbookpro2.roam.corp.google.com
Build failed in Jenkins: beam_PostCommit_Java_GradleBuild #185
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/185/display/redirect>
------------------------------------------
[...truncated 19.54 MB...]
Apr 25, 2018 12:46:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T12:46:01.708Z: Fusing consumer PAssert$3/CreateActual/GatherPanes/GroupByKey/GroupByWindow into PAssert$3/CreateActual/GatherPanes/GroupByKey/Read
Apr 25, 2018 12:46:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T12:46:01.729Z: Fusing consumer PAssert$3/CreateActual/GatherPanes/GroupByKey/Reify into PAssert$3/CreateActual/GatherPanes/Window.Into()/Window.Assign
Apr 25, 2018 12:46:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T12:46:01.752Z: Fusing consumer PAssert$3/CreateActual/GatherPanes/GroupByKey/Write into PAssert$3/CreateActual/GatherPanes/GroupByKey/Reify
Apr 25, 2018 12:46:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T12:46:01.799Z: Fusing consumer PAssert$3/CreateActual/GatherPanes/Window.Into()/Window.Assign into PAssert$3/CreateActual/GatherPanes/WithKeys/AddKeys/Map
Apr 25, 2018 12:46:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T12:46:01.819Z: Unzipping flatten s18-u63 for input s19.output-c61
Apr 25, 2018 12:46:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T12:46:01.844Z: Fusing unzipped copy of PAssert$3/CreateActual/GatherPanes/Reify.Window/ParDo(Anonymous), through flatten s18-u63, into producer PAssert$3/CreateActual/FilterActuals/Window.Assign
Apr 25, 2018 12:46:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T12:46:01.863Z: Fusing consumer PAssert$3/CreateActual/GatherPanes/Reify.Window/ParDo(Anonymous) into PAssert$3/CreateActual/FilterActuals/Window.Assign
Apr 25, 2018 12:46:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T12:46:01.885Z: Fusing consumer PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
Apr 25, 2018 12:46:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T12:46:01.901Z: Fusing consumer PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
Apr 25, 2018 12:46:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T12:46:01.924Z: Fusing consumer PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
Apr 25, 2018 12:46:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T12:46:01.949Z: Fusing consumer PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
Apr 25, 2018 12:46:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T12:46:01.964Z: Fusing consumer PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
Apr 25, 2018 12:46:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T12:46:01.985Z: Fusing consumer PAssert$3/CreateActual/RewindowActuals/Window.Assign into PAssert$3/CreateActual/Flatten.Iterables/FlattenIterables/FlatMap
Apr 25, 2018 12:46:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T12:46:02.005Z: Fusing consumer PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
Apr 25, 2018 12:46:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T12:46:02.031Z: Fusing consumer PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
Apr 25, 2018 12:46:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T12:46:02.050Z: Fusing consumer PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
Apr 25, 2018 12:46:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T12:46:02.064Z: Fusing consumer PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
Apr 25, 2018 12:46:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T12:46:02.086Z: Fusing consumer PAssert$3/CreateActual/ParDo(Anonymous) into PAssert$3/CreateActual/RewindowActuals/Window.Assign
Apr 25, 2018 12:46:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T12:46:02.112Z: Fusing consumer PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into PAssert$3/CreateActual/ParDo(Anonymous)
Apr 25, 2018 12:46:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T12:46:02.131Z: Fusing consumer Combine.globally(Count)/ProduceDefault into Combine.globally(Count)/CreateVoid/Read(CreateSource)
Apr 25, 2018 12:46:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T12:46:02.154Z: Fusing consumer Combine.globally(Count)/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow) into Combine.globally(Count)/Values/Values/Map
Apr 25, 2018 12:46:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T12:46:02.202Z: Fusing consumer Combine.globally(Count)/Combine.perKey(Count)/Combine.GroupedValues into Combine.globally(Count)/Combine.perKey(Count)/GroupByKey/Read
Apr 25, 2018 12:46:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T12:46:02.224Z: Fusing consumer Combine.globally(Count)/Combine.perKey(Count)/GroupByKey+Combine.globally(Count)/Combine.perKey(Count)/Combine.GroupedValues/Partial into Combine.globally(Count)/WithKeys/AddKeys/Map
Apr 25, 2018 12:46:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T12:46:02.247Z: Fusing consumer DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/GroupByWindow into DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/Read
Apr 25, 2018 12:46:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T12:46:02.273Z: Fusing consumer Combine.globally(Count)/Combine.perKey(Count)/GroupByKey/Reify into Combine.globally(Count)/Combine.perKey(Count)/GroupByKey+Combine.globally(Count)/Combine.perKey(Count)/Combine.GroupedValues/Partial
Apr 25, 2018 12:46:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T12:46:02.296Z: Fusing consumer Combine.globally(Count)/WithKeys/AddKeys/Map into DatastoreV1.Read/Read
Apr 25, 2018 12:46:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T12:46:02.317Z: Fusing consumer DatastoreV1.Read/Reshuffle/Pair with random key into DatastoreV1.Read/Split
Apr 25, 2018 12:46:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T12:46:02.339Z: Fusing consumer DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/Write into DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/Reify
Apr 25, 2018 12:46:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T12:46:02.355Z: Fusing consumer DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/Reify into DatastoreV1.Read/Reshuffle/Reshuffle/Window.Into()/Window.Assign
Apr 25, 2018 12:46:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T12:46:02.378Z: Fusing consumer Combine.globally(Count)/Values/Values/Map into Combine.globally(Count)/Combine.perKey(Count)/Combine.GroupedValues/Extract
Apr 25, 2018 12:46:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T12:46:02.399Z: Fusing consumer DatastoreV1.Read/Split into DatastoreV1.Read/ParDo(GqlQueryTranslate)
Apr 25, 2018 12:46:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T12:46:02.423Z: Fusing consumer DatastoreV1.Read/Reshuffle/Reshuffle/Window.Into()/Window.Assign into DatastoreV1.Read/Reshuffle/Pair with random key
Apr 25, 2018 12:46:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T12:46:02.444Z: Fusing consumer Combine.globally(Count)/Combine.perKey(Count)/GroupByKey/Write into Combine.globally(Count)/Combine.perKey(Count)/GroupByKey/Reify
Apr 25, 2018 12:46:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T12:46:02.492Z: Fusing consumer DatastoreV1.Read/ParDo(GqlQueryTranslate) into DatastoreV1.Read/Create.OfValueProvider/Create.Values/Read(CreateSource)
Apr 25, 2018 12:46:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T12:46:02.514Z: Fusing consumer DatastoreV1.Read/Read into DatastoreV1.Read/Reshuffle/Values/Values/Map
Apr 25, 2018 12:46:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T12:46:02.536Z: Fusing consumer DatastoreV1.Read/Reshuffle/Values/Values/Map into DatastoreV1.Read/Reshuffle/Reshuffle/ExpandIterable
Apr 25, 2018 12:46:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T12:46:02.550Z: Fusing consumer DatastoreV1.Read/Reshuffle/Reshuffle/ExpandIterable into DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/GroupByWindow
Apr 25, 2018 12:46:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T12:46:02.572Z: Fusing consumer Combine.globally(Count)/Combine.perKey(Count)/Combine.GroupedValues/Extract into Combine.globally(Count)/Combine.perKey(Count)/Combine.GroupedValues
Apr 25, 2018 12:46:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T12:46:02.596Z: Fusing consumer PAssert$3/RunChecks into PAssert$3/WindowToken/Window.Assign
Apr 25, 2018 12:46:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T12:46:02.613Z: Fusing consumer PAssert$3/WindowToken/Window.Assign into PAssert$3/Create.Values/Read(CreateSource)
Apr 25, 2018 12:46:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T12:46:02.638Z: Fusing consumer PAssert$3/VerifyAssertions/ParDo(DefaultConclude) into PAssert$3/RunChecks
Apr 25, 2018 12:46:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T12:46:02.896Z: Executing operation Combine.globally(Count)/Combine.perKey(Count)/GroupByKey/Create
Apr 25, 2018 12:46:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T12:46:02.918Z: Executing operation PAssert$3/CreateActual/GatherPanes/GroupByKey/Create
Apr 25, 2018 12:46:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T12:46:02.942Z: Executing operation PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
Apr 25, 2018 12:46:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T12:46:02.951Z: Starting 1 workers in us-central1-f...
Apr 25, 2018 12:46:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T12:46:02.965Z: Executing operation PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
Apr 25, 2018 12:46:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T12:46:02.987Z: Executing operation DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/Create
Apr 25, 2018 12:46:10 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T12:46:10.060Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
Apr 25, 2018 12:46:12 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T12:46:10.168Z: Executing operation DatastoreV1.Read/Create.OfValueProvider/Create.Values/Read(CreateSource)+DatastoreV1.Read/ParDo(GqlQueryTranslate)+DatastoreV1.Read/Split+DatastoreV1.Read/Reshuffle/Pair with random key+DatastoreV1.Read/Reshuffle/Reshuffle/Window.Into()/Window.Assign+DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/Reify+DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/Write
Apr 25, 2018 12:46:16 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T12:46:15.696Z: Autoscaling: Resizing worker pool from 1 to 5.
Apr 25, 2018 12:46:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T12:46:27.334Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
Apr 25, 2018 12:46:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T12:46:27.357Z: Resized worker pool to 1, though goal was 5. This could be a quota issue.
Apr 25, 2018 12:46:40 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T12:46:37.911Z: Autoscaling: Raised the number of workers to 5 based on the rate of progress in the currently running step(s).
Apr 25, 2018 12:46:43 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T12:46:43.195Z: Workers have started successfully.
Apr 25, 2018 12:47:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T12:47:06.544Z: Executing operation DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/Close
Apr 25, 2018 12:47:08 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T12:47:06.601Z: Executing operation DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/Read+DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/GroupByWindow+DatastoreV1.Read/Reshuffle/Reshuffle/ExpandIterable+DatastoreV1.Read/Reshuffle/Values/Values/Map+DatastoreV1.Read/Read+Combine.globally(Count)/WithKeys/AddKeys/Map+Combine.globally(Count)/Combine.perKey(Count)/GroupByKey+Combine.globally(Count)/Combine.perKey(Count)/Combine.GroupedValues/Partial+Combine.globally(Count)/Combine.perKey(Count)/GroupByKey/Reify+Combine.globally(Count)/Combine.perKey(Count)/GroupByKey/Write
Apr 25, 2018 12:47:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T12:47:15.953Z: Executing operation Combine.globally(Count)/Combine.perKey(Count)/GroupByKey/Close
Apr 25, 2018 12:47:18 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T12:47:16.026Z: Executing operation Combine.globally(Count)/Combine.perKey(Count)/GroupByKey/Read+Combine.globally(Count)/Combine.perKey(Count)/Combine.GroupedValues+Combine.globally(Count)/Combine.perKey(Count)/Combine.GroupedValues/Extract+Combine.globally(Count)/Values/Values/Map+PAssert$3/CreateActual/FilterActuals/Window.Assign+PAssert$3/CreateActual/GatherPanes/Reify.Window/ParDo(Anonymous)+PAssert$3/CreateActual/GatherPanes/WithKeys/AddKeys/Map+PAssert$3/CreateActual/GatherPanes/Window.Into()/Window.Assign+PAssert$3/CreateActual/GatherPanes/GroupByKey/Reify+PAssert$3/CreateActual/GatherPanes/GroupByKey/Write+Combine.globally(Count)/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow)
Apr 25, 2018 12:47:24 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T12:47:22.111Z: Executing operation Combine.globally(Count)/View.AsIterable/CreateDataflowView
Apr 25, 2018 12:47:24 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T12:47:22.226Z: Executing operation Combine.globally(Count)/CreateVoid/Read(CreateSource)+Combine.globally(Count)/ProduceDefault+PAssert$3/CreateActual/FilterActuals/Window.Assign+PAssert$3/CreateActual/GatherPanes/Reify.Window/ParDo(Anonymous)+PAssert$3/CreateActual/GatherPanes/WithKeys/AddKeys/Map+PAssert$3/CreateActual/GatherPanes/Window.Into()/Window.Assign+PAssert$3/CreateActual/GatherPanes/GroupByKey/Reify+PAssert$3/CreateActual/GatherPanes/GroupByKey/Write
Apr 25, 2018 12:47:25 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T12:47:25.375Z: Executing operation PAssert$3/CreateActual/GatherPanes/GroupByKey/Close
Apr 25, 2018 12:47:25 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T12:47:25.422Z: Executing operation PAssert$3/CreateActual/GatherPanes/GroupByKey/Read+PAssert$3/CreateActual/GatherPanes/GroupByKey/GroupByWindow+PAssert$3/CreateActual/GatherPanes/Values/Values/Map+PAssert$3/CreateActual/ExtractPane/Map+PAssert$3/CreateActual/Flatten.Iterables/FlattenIterables/FlatMap+PAssert$3/CreateActual/RewindowActuals/Window.Assign+PAssert$3/CreateActual/ParDo(Anonymous)+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
Apr 25, 2018 12:47:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T12:47:26.948Z: Executing operation PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
Apr 25, 2018 12:47:27 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T12:47:26.993Z: Executing operation PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
Apr 25, 2018 12:47:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T12:47:29.833Z: Executing operation PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
Apr 25, 2018 12:47:31 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T12:47:29.889Z: Executing operation PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
Apr 25, 2018 12:47:33 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T12:47:33.280Z: Executing operation PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
Apr 25, 2018 12:47:33 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T12:47:33.417Z: Executing operation PAssert$3/Create.Values/Read(CreateSource)+PAssert$3/WindowToken/Window.Assign+PAssert$3/RunChecks+PAssert$3/VerifyAssertions/ParDo(DefaultConclude)
Apr 25, 2018 12:47:36 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T12:47:36.228Z: Cleaning up.
Apr 25, 2018 12:47:39 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T12:47:36.438Z: Stopping worker pool...
Apr 25, 2018 12:49:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T12:49:17.408Z: Autoscaling: Resized worker pool from 5 to 0.
Apr 25, 2018 12:49:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T12:49:17.431Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
Apr 25, 2018 12:49:17 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T12:49:17.458Z: Worker pool stopped.
Apr 25, 2018 12:49:27 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-04-25_05_45_52-13762700431011054755 finished with status DONE.
Apr 25, 2018 12:49:27 PM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-04-25_05_45_52-13762700431011054755. Found 1 success, 0 failures out of 1 expected assertions.
Apr 25, 2018 12:49:28 PM org.apache.beam.sdk.io.gcp.datastore.V1TestUtil$V1TestWriter flushBatch
INFO: Writing batch of 500 entities
Apr 25, 2018 12:49:28 PM org.apache.beam.sdk.io.gcp.datastore.V1TestUtil$V1TestWriter flushBatch
INFO: Successfully wrote 500 entities
Apr 25, 2018 12:49:29 PM org.apache.beam.sdk.io.gcp.datastore.V1TestUtil$V1TestWriter flushBatch
INFO: Writing batch of 500 entities
Apr 25, 2018 12:49:29 PM org.apache.beam.sdk.io.gcp.datastore.V1TestUtil$V1TestWriter flushBatch
INFO: Successfully wrote 500 entities
Apr 25, 2018 12:49:29 PM org.apache.beam.sdk.io.gcp.datastore.V1TestUtil deleteAllEntities
INFO: Successfully deleted 1000 entities
org.apache.beam.sdk.io.gcp.datastore.SplitQueryFnIT > testSplitQueryFnWithLargeDataset STANDARD_ERROR
Apr 25, 2018 12:49:29 PM org.apache.beam.sdk.transforms.DoFnTester of
WARNING: Your tests use DoFnTester, which may not exercise DoFns correctly. Please use TestPipeline instead.
Apr 25, 2018 12:49:30 PM org.apache.beam.sdk.io.gcp.datastore.DatastoreV1$Read getEstimatedSizeBytes
INFO: Latest stats timestamp for kind sort_1G is 1524123813000000
Apr 25, 2018 12:49:30 PM org.apache.beam.sdk.io.gcp.datastore.DatastoreV1$Read getEstimatedNumSplits
INFO: Estimated size bytes for the query is: 2130000000
Apr 25, 2018 12:49:30 PM org.apache.beam.sdk.io.gcp.datastore.DatastoreV1$Read$SplitQueryFn processElement
INFO: Splitting the query into 32 splits
org.apache.beam.sdk.io.gcp.datastore.SplitQueryFnIT > testSplitQueryFnWithSmallDataset STANDARD_ERROR
Apr 25, 2018 12:49:31 PM org.apache.beam.sdk.transforms.DoFnTester of
WARNING: Your tests use DoFnTester, which may not exercise DoFns correctly. Please use TestPipeline instead.
Apr 25, 2018 12:49:31 PM org.apache.beam.sdk.io.gcp.datastore.DatastoreV1$Read getEstimatedSizeBytes
INFO: Latest stats timestamp for kind shakespeare is 1524123813000000
Apr 25, 2018 12:49:31 PM org.apache.beam.sdk.io.gcp.datastore.DatastoreV1$Read getEstimatedNumSplits
INFO: Estimated size bytes for the query is: 26383451
Apr 25, 2018 12:49:31 PM org.apache.beam.sdk.io.gcp.datastore.DatastoreV1$Read$SplitQueryFn processElement
INFO: Splitting the query into 12 splits
Gradle Test Executor 128 finished executing tests.
org.apache.beam.sdk.io.gcp.spanner.SpannerWriteIT > testWrite FAILED
java.lang.NoClassDefFoundError: com/google/api/gax/retrying/ExceptionRetryAlgorithm
at java.lang.ClassLoader.defineClass1(Native Method)
at java.lang.ClassLoader.defineClass(ClassLoader.java:763)
at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)
at java.net.URLClassLoader.defineClass(URLClassLoader.java:467)
at java.net.URLClassLoader.access$100(URLClassLoader.java:73)
at java.net.URLClassLoader$1.run(URLClassLoader.java:368)
at java.net.URLClassLoader$1.run(URLClassLoader.java:362)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:361)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:338)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
at com.google.cloud.BaseService.<clinit>(BaseService.java:48)
at com.google.cloud.spanner.SpannerOptions$DefaultSpannerFactory.create(SpannerOptions.java:60)
at com.google.cloud.spanner.SpannerOptions$DefaultSpannerFactory.create(SpannerOptions.java:55)
at com.google.cloud.ServiceOptions.getService(ServiceOptions.java:426)
at org.apache.beam.sdk.io.gcp.spanner.SpannerWriteIT.setUp(SpannerWriteIT.java:91)
Caused by:
java.lang.ClassNotFoundException: com.google.api.gax.retrying.ExceptionRetryAlgorithm
at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:338)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
... 17 more
java.lang.NullPointerException
at org.apache.beam.sdk.io.gcp.spanner.SpannerWriteIT.tearDown(SpannerWriteIT.java:148)
12 tests completed, 3 failed
Finished generating test XML results (0.007 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/ws/src/runners/google-cloud-dataflow-java/build/test-results/googleCloudPlatformIntegrationTest>
Generating HTML test report...
Finished generating test html results (0.01 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/googleCloudPlatformIntegrationTest>
:beam-runners-google-cloud-dataflow-java:googleCloudPlatformIntegrationTest FAILED
:beam-runners-google-cloud-dataflow-java:googleCloudPlatformIntegrationTest (Thread[Task worker for ':',5,main]) completed. Took 15 mins 30.597 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:googleCloudPlatformIntegrationTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/googleCloudPlatformIntegrationTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.6/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 48m 38s
541 actionable tasks: 533 executed, 8 from cache
Publishing build scan...
https://gradle.com/s/7h62fedxiujue
Build cache (/home/jenkins/.gradle/caches/build-cache-1) has not been cleaned up in 0 days
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user kedin@google.com
Not sending mail to unregistered user kirpichov@google.com
Build failed in Jenkins: beam_PostCommit_Java_GradleBuild #184
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/184/display/redirect?page=changes>
Changes:
[szewinho] [BEAM-4153] Fixing performance test of spark, added option to trigger
------------------------------------------
[...truncated 19.33 MB...]
Apr 25, 2018 8:03:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T08:03:24.969Z: Fusing consumer PAssert$3/CreateActual/GatherPanes/Values/Values/Map into PAssert$3/CreateActual/GatherPanes/GroupByKey/GroupByWindow
Apr 25, 2018 8:03:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T08:03:24.999Z: Fusing consumer PAssert$3/CreateActual/GatherPanes/GroupByKey/GroupByWindow into PAssert$3/CreateActual/GatherPanes/GroupByKey/Read
Apr 25, 2018 8:03:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T08:03:25.032Z: Fusing consumer PAssert$3/CreateActual/GatherPanes/GroupByKey/Reify into PAssert$3/CreateActual/GatherPanes/Window.Into()/Window.Assign
Apr 25, 2018 8:03:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T08:03:25.063Z: Fusing consumer PAssert$3/CreateActual/GatherPanes/GroupByKey/Write into PAssert$3/CreateActual/GatherPanes/GroupByKey/Reify
Apr 25, 2018 8:03:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T08:03:25.095Z: Fusing consumer PAssert$3/CreateActual/GatherPanes/Window.Into()/Window.Assign into PAssert$3/CreateActual/GatherPanes/WithKeys/AddKeys/Map
Apr 25, 2018 8:03:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T08:03:25.123Z: Unzipping flatten s18-u63 for input s19.output-c61
Apr 25, 2018 8:03:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T08:03:25.147Z: Fusing unzipped copy of PAssert$3/CreateActual/GatherPanes/Reify.Window/ParDo(Anonymous), through flatten s18-u63, into producer PAssert$3/CreateActual/FilterActuals/Window.Assign
Apr 25, 2018 8:03:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T08:03:25.170Z: Fusing consumer PAssert$3/CreateActual/GatherPanes/Reify.Window/ParDo(Anonymous) into PAssert$3/CreateActual/FilterActuals/Window.Assign
Apr 25, 2018 8:03:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T08:03:25.195Z: Fusing consumer PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) into PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
Apr 25, 2018 8:03:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T08:03:25.225Z: Fusing consumer PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write into PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
Apr 25, 2018 8:03:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T08:03:25.257Z: Fusing consumer PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map into PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
Apr 25, 2018 8:03:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T08:03:25.288Z: Fusing consumer PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey) into PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
Apr 25, 2018 8:03:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T08:03:25.311Z: Fusing consumer PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract into PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
Apr 25, 2018 8:03:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T08:03:25.343Z: Fusing consumer PAssert$3/CreateActual/RewindowActuals/Window.Assign into PAssert$3/CreateActual/Flatten.Iterables/FlattenIterables/FlatMap
Apr 25, 2018 8:03:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T08:03:25.372Z: Fusing consumer PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
Apr 25, 2018 8:03:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T08:03:25.402Z: Fusing consumer PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues into PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
Apr 25, 2018 8:03:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T08:03:25.414Z: Fusing consumer PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write into PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
Apr 25, 2018 8:03:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T08:03:25.445Z: Fusing consumer PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
Apr 25, 2018 8:03:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T08:03:25.480Z: Fusing consumer PAssert$3/CreateActual/ParDo(Anonymous) into PAssert$3/CreateActual/RewindowActuals/Window.Assign
Apr 25, 2018 8:03:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T08:03:25.514Z: Fusing consumer PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into PAssert$3/CreateActual/ParDo(Anonymous)
Apr 25, 2018 8:03:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T08:03:25.545Z: Fusing consumer Combine.globally(Count)/ProduceDefault into Combine.globally(Count)/CreateVoid/Read(CreateSource)
Apr 25, 2018 8:03:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T08:03:25.576Z: Fusing consumer Combine.globally(Count)/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow) into Combine.globally(Count)/Values/Values/Map
Apr 25, 2018 8:03:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T08:03:25.598Z: Fusing consumer Combine.globally(Count)/Combine.perKey(Count)/Combine.GroupedValues into Combine.globally(Count)/Combine.perKey(Count)/GroupByKey/Read
Apr 25, 2018 8:03:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T08:03:25.619Z: Fusing consumer Combine.globally(Count)/Combine.perKey(Count)/GroupByKey+Combine.globally(Count)/Combine.perKey(Count)/Combine.GroupedValues/Partial into Combine.globally(Count)/WithKeys/AddKeys/Map
Apr 25, 2018 8:03:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T08:03:25.650Z: Fusing consumer DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/GroupByWindow into DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/Read
Apr 25, 2018 8:03:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T08:03:25.678Z: Fusing consumer Combine.globally(Count)/Combine.perKey(Count)/GroupByKey/Reify into Combine.globally(Count)/Combine.perKey(Count)/GroupByKey+Combine.globally(Count)/Combine.perKey(Count)/Combine.GroupedValues/Partial
Apr 25, 2018 8:03:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T08:03:25.701Z: Fusing consumer Combine.globally(Count)/WithKeys/AddKeys/Map into DatastoreV1.Read/Read
Apr 25, 2018 8:03:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T08:03:25.721Z: Fusing consumer DatastoreV1.Read/Reshuffle/Pair with random key into DatastoreV1.Read/Split
Apr 25, 2018 8:03:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T08:03:25.756Z: Fusing consumer DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/Write into DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/Reify
Apr 25, 2018 8:03:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T08:03:25.788Z: Fusing consumer DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/Reify into DatastoreV1.Read/Reshuffle/Reshuffle/Window.Into()/Window.Assign
Apr 25, 2018 8:03:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T08:03:25.817Z: Fusing consumer Combine.globally(Count)/Values/Values/Map into Combine.globally(Count)/Combine.perKey(Count)/Combine.GroupedValues/Extract
Apr 25, 2018 8:03:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T08:03:25.848Z: Fusing consumer DatastoreV1.Read/Split into DatastoreV1.Read/ParDo(GqlQueryTranslate)
Apr 25, 2018 8:03:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T08:03:25.878Z: Fusing consumer DatastoreV1.Read/Reshuffle/Reshuffle/Window.Into()/Window.Assign into DatastoreV1.Read/Reshuffle/Pair with random key
Apr 25, 2018 8:03:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T08:03:25.904Z: Fusing consumer Combine.globally(Count)/Combine.perKey(Count)/GroupByKey/Write into Combine.globally(Count)/Combine.perKey(Count)/GroupByKey/Reify
Apr 25, 2018 8:03:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T08:03:25.936Z: Fusing consumer DatastoreV1.Read/ParDo(GqlQueryTranslate) into DatastoreV1.Read/Create.OfValueProvider/Create.Values/Read(CreateSource)
Apr 25, 2018 8:03:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T08:03:25.966Z: Fusing consumer DatastoreV1.Read/Read into DatastoreV1.Read/Reshuffle/Values/Values/Map
Apr 25, 2018 8:03:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T08:03:25.989Z: Fusing consumer DatastoreV1.Read/Reshuffle/Values/Values/Map into DatastoreV1.Read/Reshuffle/Reshuffle/ExpandIterable
Apr 25, 2018 8:03:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T08:03:26.012Z: Fusing consumer DatastoreV1.Read/Reshuffle/Reshuffle/ExpandIterable into DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/GroupByWindow
Apr 25, 2018 8:03:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T08:03:26.042Z: Fusing consumer Combine.globally(Count)/Combine.perKey(Count)/Combine.GroupedValues/Extract into Combine.globally(Count)/Combine.perKey(Count)/Combine.GroupedValues
Apr 25, 2018 8:03:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T08:03:26.072Z: Fusing consumer PAssert$3/RunChecks into PAssert$3/WindowToken/Window.Assign
Apr 25, 2018 8:03:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T08:03:26.103Z: Fusing consumer PAssert$3/WindowToken/Window.Assign into PAssert$3/Create.Values/Read(CreateSource)
Apr 25, 2018 8:03:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T08:03:26.131Z: Fusing consumer PAssert$3/VerifyAssertions/ParDo(DefaultConclude) into PAssert$3/RunChecks
Apr 25, 2018 8:03:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T08:03:26.432Z: Executing operation Combine.globally(Count)/Combine.perKey(Count)/GroupByKey/Create
Apr 25, 2018 8:03:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T08:03:26.454Z: Executing operation PAssert$3/CreateActual/GatherPanes/GroupByKey/Create
Apr 25, 2018 8:03:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T08:03:26.487Z: Executing operation PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
Apr 25, 2018 8:03:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T08:03:26.487Z: Starting 1 workers in us-central1-f...
Apr 25, 2018 8:03:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T08:03:26.509Z: Executing operation PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
Apr 25, 2018 8:03:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T08:03:26.542Z: Executing operation DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/Create
Apr 25, 2018 8:03:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T08:03:36.323Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
Apr 25, 2018 8:03:37 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T08:03:36.756Z: Executing operation DatastoreV1.Read/Create.OfValueProvider/Create.Values/Read(CreateSource)+DatastoreV1.Read/ParDo(GqlQueryTranslate)+DatastoreV1.Read/Split+DatastoreV1.Read/Reshuffle/Pair with random key+DatastoreV1.Read/Reshuffle/Reshuffle/Window.Into()/Window.Assign+DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/Reify+DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/Write
Apr 25, 2018 8:03:43 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T08:03:42.214Z: Autoscaling: Resizing worker pool from 1 to 5.
Apr 25, 2018 8:03:56 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T08:03:53.755Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
Apr 25, 2018 8:03:56 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T08:03:53.778Z: Resized worker pool to 1, though goal was 5. This could be a quota issue.
Apr 25, 2018 8:04:06 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T08:04:04.253Z: Autoscaling: Raised the number of workers to 5 based on the rate of progress in the currently running step(s).
Apr 25, 2018 8:04:14 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T08:04:12.698Z: Workers have started successfully.
Apr 25, 2018 8:04:45 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T08:04:43.222Z: Executing operation DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/Close
Apr 25, 2018 8:04:45 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T08:04:43.292Z: Executing operation DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/Read+DatastoreV1.Read/Reshuffle/Reshuffle/GroupByKey/GroupByWindow+DatastoreV1.Read/Reshuffle/Reshuffle/ExpandIterable+DatastoreV1.Read/Reshuffle/Values/Values/Map+DatastoreV1.Read/Read+Combine.globally(Count)/WithKeys/AddKeys/Map+Combine.globally(Count)/Combine.perKey(Count)/GroupByKey+Combine.globally(Count)/Combine.perKey(Count)/Combine.GroupedValues/Partial+Combine.globally(Count)/Combine.perKey(Count)/GroupByKey/Reify+Combine.globally(Count)/Combine.perKey(Count)/GroupByKey/Write
Apr 25, 2018 8:04:52 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T08:04:52.268Z: Executing operation Combine.globally(Count)/Combine.perKey(Count)/GroupByKey/Close
Apr 25, 2018 8:04:54 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T08:04:52.331Z: Executing operation Combine.globally(Count)/Combine.perKey(Count)/GroupByKey/Read+Combine.globally(Count)/Combine.perKey(Count)/Combine.GroupedValues+Combine.globally(Count)/Combine.perKey(Count)/Combine.GroupedValues/Extract+Combine.globally(Count)/Values/Values/Map+PAssert$3/CreateActual/FilterActuals/Window.Assign+PAssert$3/CreateActual/GatherPanes/Reify.Window/ParDo(Anonymous)+PAssert$3/CreateActual/GatherPanes/WithKeys/AddKeys/Map+PAssert$3/CreateActual/GatherPanes/Window.Into()/Window.Assign+PAssert$3/CreateActual/GatherPanes/GroupByKey/Reify+PAssert$3/CreateActual/GatherPanes/GroupByKey/Write+Combine.globally(Count)/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow)
Apr 25, 2018 8:05:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T08:05:02.311Z: Executing operation Combine.globally(Count)/View.AsIterable/CreateDataflowView
Apr 25, 2018 8:05:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T08:05:02.482Z: Executing operation Combine.globally(Count)/CreateVoid/Read(CreateSource)+Combine.globally(Count)/ProduceDefault+PAssert$3/CreateActual/FilterActuals/Window.Assign+PAssert$3/CreateActual/GatherPanes/Reify.Window/ParDo(Anonymous)+PAssert$3/CreateActual/GatherPanes/WithKeys/AddKeys/Map+PAssert$3/CreateActual/GatherPanes/Window.Into()/Window.Assign+PAssert$3/CreateActual/GatherPanes/GroupByKey/Reify+PAssert$3/CreateActual/GatherPanes/GroupByKey/Write
Apr 25, 2018 8:05:05 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T08:05:04.762Z: Executing operation PAssert$3/CreateActual/GatherPanes/GroupByKey/Close
Apr 25, 2018 8:05:05 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T08:05:04.843Z: Executing operation PAssert$3/CreateActual/GatherPanes/GroupByKey/Read+PAssert$3/CreateActual/GatherPanes/GroupByKey/GroupByWindow+PAssert$3/CreateActual/GatherPanes/Values/Values/Map+PAssert$3/CreateActual/ExtractPane/Map+PAssert$3/CreateActual/Flatten.Iterables/FlattenIterables/FlatMap+PAssert$3/CreateActual/RewindowActuals/Window.Assign+PAssert$3/CreateActual/ParDo(Anonymous)+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
Apr 25, 2018 8:05:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T08:05:06.763Z: Executing operation PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
Apr 25, 2018 8:05:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T08:05:06.833Z: Executing operation PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
Apr 25, 2018 8:05:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T08:05:08.540Z: Executing operation PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
Apr 25, 2018 8:05:10 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T08:05:08.612Z: Executing operation PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
Apr 25, 2018 8:05:14 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T08:05:12.202Z: Executing operation PAssert$3/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
Apr 25, 2018 8:05:14 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T08:05:12.386Z: Executing operation PAssert$3/Create.Values/Read(CreateSource)+PAssert$3/WindowToken/Window.Assign+PAssert$3/RunChecks+PAssert$3/VerifyAssertions/ParDo(DefaultConclude)
Apr 25, 2018 8:05:14 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T08:05:14.331Z: Cleaning up.
Apr 25, 2018 8:05:16 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T08:05:14.761Z: Stopping worker pool...
Apr 25, 2018 8:06:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T08:06:36.103Z: Autoscaling: Resized worker pool from 5 to 0.
Apr 25, 2018 8:06:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T08:06:36.130Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
Apr 25, 2018 8:06:44 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-04-25_01_03_17-4438895678979376035 finished with status DONE.
Apr 25, 2018 8:06:44 AM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-04-25_01_03_17-4438895678979376035. Found 1 success, 0 failures out of 1 expected assertions.
Apr 25, 2018 8:06:44 AM org.apache.beam.sdk.io.gcp.datastore.V1TestUtil$V1TestWriter flushBatch
INFO: Writing batch of 500 entities
Apr 25, 2018 8:06:44 AM org.apache.beam.sdk.io.gcp.datastore.V1TestUtil$V1TestWriter flushBatch
INFO: Successfully wrote 500 entities
Apr 25, 2018 8:06:45 AM org.apache.beam.sdk.io.gcp.datastore.V1TestUtil$V1TestWriter flushBatch
INFO: Writing batch of 500 entities
Apr 25, 2018 8:06:45 AM org.apache.beam.sdk.io.gcp.datastore.V1TestUtil$V1TestWriter flushBatch
INFO: Successfully wrote 500 entities
Apr 25, 2018 8:06:45 AM org.apache.beam.sdk.io.gcp.datastore.V1TestUtil deleteAllEntities
INFO: Successfully deleted 1000 entities
org.apache.beam.sdk.io.gcp.datastore.SplitQueryFnIT > testSplitQueryFnWithLargeDataset STANDARD_ERROR
Apr 25, 2018 8:06:45 AM org.apache.beam.sdk.transforms.DoFnTester of
WARNING: Your tests use DoFnTester, which may not exercise DoFns correctly. Please use TestPipeline instead.
Apr 25, 2018 8:06:46 AM org.apache.beam.sdk.io.gcp.datastore.DatastoreV1$Read getEstimatedSizeBytes
INFO: Latest stats timestamp for kind sort_1G is 1524123813000000
Apr 25, 2018 8:06:46 AM org.apache.beam.sdk.io.gcp.datastore.DatastoreV1$Read getEstimatedNumSplits
INFO: Estimated size bytes for the query is: 2130000000
Apr 25, 2018 8:06:46 AM org.apache.beam.sdk.io.gcp.datastore.DatastoreV1$Read$SplitQueryFn processElement
INFO: Splitting the query into 32 splits
org.apache.beam.sdk.io.gcp.datastore.SplitQueryFnIT > testSplitQueryFnWithSmallDataset STANDARD_ERROR
Apr 25, 2018 8:06:47 AM org.apache.beam.sdk.transforms.DoFnTester of
WARNING: Your tests use DoFnTester, which may not exercise DoFns correctly. Please use TestPipeline instead.
Apr 25, 2018 8:06:47 AM org.apache.beam.sdk.io.gcp.datastore.DatastoreV1$Read getEstimatedSizeBytes
INFO: Latest stats timestamp for kind shakespeare is 1524123813000000
Apr 25, 2018 8:06:48 AM org.apache.beam.sdk.io.gcp.datastore.DatastoreV1$Read getEstimatedNumSplits
INFO: Estimated size bytes for the query is: 26383451
Apr 25, 2018 8:06:48 AM org.apache.beam.sdk.io.gcp.datastore.DatastoreV1$Read$SplitQueryFn processElement
INFO: Splitting the query into 12 splits
Gradle Test Executor 128 finished executing tests.
org.apache.beam.sdk.io.gcp.spanner.SpannerWriteIT > testWrite FAILED
java.lang.NoClassDefFoundError: com/google/api/gax/retrying/ExceptionRetryAlgorithm
at java.lang.ClassLoader.defineClass1(Native Method)
at java.lang.ClassLoader.defineClass(ClassLoader.java:763)
at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)
at java.net.URLClassLoader.defineClass(URLClassLoader.java:467)
at java.net.URLClassLoader.access$100(URLClassLoader.java:73)
at java.net.URLClassLoader$1.run(URLClassLoader.java:368)
at java.net.URLClassLoader$1.run(URLClassLoader.java:362)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:361)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:338)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
at com.google.cloud.BaseService.<clinit>(BaseService.java:48)
at com.google.cloud.spanner.SpannerOptions$DefaultSpannerFactory.create(SpannerOptions.java:60)
at com.google.cloud.spanner.SpannerOptions$DefaultSpannerFactory.create(SpannerOptions.java:55)
at com.google.cloud.ServiceOptions.getService(ServiceOptions.java:426)
at org.apache.beam.sdk.io.gcp.spanner.SpannerWriteIT.setUp(SpannerWriteIT.java:91)
Caused by:
java.lang.ClassNotFoundException: com.google.api.gax.retrying.ExceptionRetryAlgorithm
at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:338)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
... 17 more
java.lang.NullPointerException
at org.apache.beam.sdk.io.gcp.spanner.SpannerWriteIT.tearDown(SpannerWriteIT.java:148)
12 tests completed, 3 failed
Finished generating test XML results (0.006 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/ws/src/runners/google-cloud-dataflow-java/build/test-results/googleCloudPlatformIntegrationTest>
Generating HTML test report...
Finished generating test html results (0.008 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/googleCloudPlatformIntegrationTest>
:beam-runners-google-cloud-dataflow-java:googleCloudPlatformIntegrationTest FAILED
:beam-runners-google-cloud-dataflow-java:googleCloudPlatformIntegrationTest (Thread[main,5,main]) completed. Took 14 mins 40.561 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:googleCloudPlatformIntegrationTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/googleCloudPlatformIntegrationTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.6/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 44m 19s
541 actionable tasks: 533 executed, 8 from cache
Publishing build scan...
https://gradle.com/s/55z5tvac5pxbq
Build cache (/home/jenkins/.gradle/caches/build-cache-1) has not been cleaned up in 0 days
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user kedin@google.com
Not sending mail to unregistered user kirpichov@google.com
Build failed in Jenkins: beam_PostCommit_Java_GradleBuild #183
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/183/display/redirect>
------------------------------------------
[...truncated 19.82 MB...]
Apr 25, 2018 6:42:21 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.m2/repository/org/tukaani/xz/1.5/xz-1.5.jar to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0425064219-5ddebc87/output/results/staging/xz-1.5-UQUOWVswjErsisMU9m4YvA.jar
Apr 25, 2018 6:42:21 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.m2/repository/junit/junit/4.12/junit-4.12.jar to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0425064219-5ddebc87/output/results/staging/junit-4.12-WzjEDJf70K3uKfkeYEBVhA.jar
Apr 25, 2018 6:42:21 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.m2/repository/com/fasterxml/jackson/core/jackson-databind/2.8.9/jackson-databind-2.8.9.jar to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0425064219-5ddebc87/output/results/staging/jackson-databind-2.8.9-LY9EwV_rjXYnHufFJYsgcg.jar
Apr 25, 2018 6:42:21 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.m2/repository/org/codehaus/jackson/jackson-core-asl/1.9.13/jackson-core-asl-1.9.13.jar to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0425064219-5ddebc87/output/results/staging/jackson-core-asl-1.9.13-MZxJpDBOP6n-PNjc_ACdNw.jar
Apr 25, 2018 6:42:21 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.m2/repository/com/google/errorprone/error_prone_annotations/2.0.15/error_prone_annotations-2.0.15.jar to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0425064219-5ddebc87/output/results/staging/error_prone_annotations-2.0.15-npnuyJrjs2dF75GdvUBIvQ.jar
Apr 25, 2018 6:42:21 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/ws/src/runners/direct-java/build/libs/beam-runners-direct-java-2.5.0-SNAPSHOT-shaded.jar> to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0425064219-5ddebc87/output/results/staging/beam-runners-direct-java-2.5.0-SNAPSHOT-shaded-8Wx_RGDnr32LHdCGbTpUbQ.jar
Apr 25, 2018 6:42:21 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.m2/repository/com/thoughtworks/paranamer/paranamer/2.7/paranamer-2.7.jar to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0425064219-5ddebc87/output/results/staging/paranamer-2.7-VweilzYySf_-OOgYnNb5yw.jar
Apr 25, 2018 6:42:21 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/ws/src/sdks/java/core/build/libs/beam-sdks-java-core-2.5.0-SNAPSHOT-shaded.jar> to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0425064219-5ddebc87/output/results/staging/beam-sdks-java-core-2.5.0-SNAPSHOT-shaded-9Ma709ZquatgS7CyJSnItw.jar
Apr 25, 2018 6:42:21 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.m2/repository/com/google/protobuf/protobuf-java/3.2.0/protobuf-java-3.2.0.jar to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0425064219-5ddebc87/output/results/staging/protobuf-java-3.2.0-fh30Gescj5k_IhxJOGxriw.jar
Apr 25, 2018 6:42:21 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.m2/repository/org/mockito/mockito-core/1.9.5/mockito-core-1.9.5.jar to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0425064219-5ddebc87/output/results/staging/mockito-core-1.9.5-b3PPBKVutgqqmWUG58EPxw.jar
Apr 25, 2018 6:42:21 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.m2/repository/org/codehaus/jackson/jackson-mapper-asl/1.9.13/jackson-mapper-asl-1.9.13.jar to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0425064219-5ddebc87/output/results/staging/jackson-mapper-asl-1.9.13-F1D5wzk1L8S3KNYbVxcWEw.jar
Apr 25, 2018 6:42:21 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.m2/repository/io/netty/netty-handler-proxy/4.1.8.Final/netty-handler-proxy-4.1.8.Final.jar to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0425064219-5ddebc87/output/results/staging/netty-handler-proxy-4.1.8.Final-Zey48Fj4mlWtgpwIc7Osgg.jar
Apr 25, 2018 6:42:21 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.gradle/caches/modules-2/files-2.1/io.grpc/grpc-context/1.9.0/28b0836f48c9705abf73829bbc536dba29a1329a/grpc-context-1.9.0.jar to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0425064219-5ddebc87/output/results/staging/grpc-context-1.9.0-atYmq4r_lax8i7-0BRHcCg.jar
Apr 25, 2018 6:42:21 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.m2/repository/io/netty/netty-buffer/4.1.8.Final/netty-buffer-4.1.8.Final.jar to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0425064219-5ddebc87/output/results/staging/netty-buffer-4.1.8.Final-iwny8IFMu0G1ln10Yx5VrA.jar
Apr 25, 2018 6:42:21 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.m2/repository/org/threeten/threetenbp/1.3.3/threetenbp-1.3.3.jar to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0425064219-5ddebc87/output/results/staging/threetenbp-1.3.3-bEXFSgaAYiXSdUtR-98IjQ.jar
Apr 25, 2018 6:42:21 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.m2/repository/io/netty/netty-codec-socks/4.1.8.Final/netty-codec-socks-4.1.8.Final.jar to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0425064219-5ddebc87/output/results/staging/netty-codec-socks-4.1.8.Final-dfbCpCpgkEl1iwscd6OVeQ.jar
Apr 25, 2018 6:42:21 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.m2/repository/com/google/guava/guava/20.0/guava-20.0.jar to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0425064219-5ddebc87/output/results/staging/guava-20.0-8yqKJSRiDb7Mn2v2ogwpPw.jar
Apr 25, 2018 6:42:21 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.m2/repository/org/objenesis/objenesis/2.6/objenesis-2.6.jar to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0425064219-5ddebc87/output/results/staging/objenesis-2.6-X_rD9RQFypspFZcKIks-jw.jar
Apr 25, 2018 6:42:21 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.m2/repository/commons-codec/commons-codec/1.3/commons-codec-1.3.jar to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0425064219-5ddebc87/output/results/staging/commons-codec-1.3-jhScEFN0HANzalLfg5dNzA.jar
Apr 25, 2018 6:42:21 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.m2/repository/org/apache/commons/commons-compress/1.16.1/commons-compress-1.16.1.jar to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0425064219-5ddebc87/output/results/staging/commons-compress-1.16.1-NAljjWtr0jBC7qxc2X4lbA.jar
Apr 25, 2018 6:42:21 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.m2/repository/org/xerial/snappy/snappy-java/1.1.4/snappy-java-1.1.4.jar to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0425064219-5ddebc87/output/results/staging/snappy-java-1.1.4-SFNwbMuGq13aaoKVzeS1Tw.jar
Apr 25, 2018 6:42:21 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.m2/repository/io/netty/netty-codec/4.1.8.Final/netty-codec-4.1.8.Final.jar to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0425064219-5ddebc87/output/results/staging/netty-codec-4.1.8.Final-Og5DJ4MB-fn1oSzjKqVU_w.jar
Apr 25, 2018 6:42:21 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.m2/repository/org/json/json/20160810/json-20160810.jar to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0425064219-5ddebc87/output/results/staging/json-20160810-L3-Jnwdm5lAXdEpMT8FNRg.jar
Apr 25, 2018 6:42:21 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.m2/repository/io/netty/netty-transport/4.1.8.Final/netty-transport-4.1.8.Final.jar to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0425064219-5ddebc87/output/results/staging/netty-transport-4.1.8.Final-PXWj5ZmqlznhCnqhkcOwDA.jar
Apr 25, 2018 6:42:21 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.m2/repository/io/netty/netty-resolver/4.1.8.Final/netty-resolver-4.1.8.Final.jar to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0425064219-5ddebc87/output/results/staging/netty-resolver-4.1.8.Final-ZBELwscrxRZgRR5DKH9siA.jar
Apr 25, 2018 6:42:21 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.m2/repository/org/apache/httpcomponents/httpcore/4.0.1/httpcore-4.0.1.jar to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0425064219-5ddebc87/output/results/staging/httpcore-4.0.1-bBlj_YrAxAwATJ6JLg13Aw.jar
Apr 25, 2018 6:42:21 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.m2/repository/commons-logging/commons-logging/1.2/commons-logging-1.2.jar to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0425064219-5ddebc87/output/results/staging/commons-logging-1.2-BAtLTY6siG9rSio70vMbAA.jar
Apr 25, 2018 6:42:22 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.m2/repository/com/squareup/okio/okio/1.6.0/okio-1.6.0.jar to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0425064219-5ddebc87/output/results/staging/okio-1.6.0-Fk0cKMMjz24qkX1gN0xXGA.jar
Apr 25, 2018 6:42:22 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.m2/repository/com/google/protobuf/nano/protobuf-javanano/3.0.0-alpha-5/protobuf-javanano-3.0.0-alpha-5.jar to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0425064219-5ddebc87/output/results/staging/protobuf-javanano-3.0.0-alpha-5-SsS7fZe7brffHbAGUgRrnw.jar
Apr 25, 2018 6:42:22 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.gradle/caches/modules-2/files-2.1/com.esotericsoftware.kryo/kryo/2.21/9a4e69cff8d225729656f7e97e40893b23bffef/kryo-2.21.jar to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0425064219-5ddebc87/output/results/staging/kryo-2.21-olkSUBNMYGe-WXkdlwcytQ.jar
Apr 25, 2018 6:42:22 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.gradle/caches/modules-2/files-2.1/com.esotericsoftware.minlog/minlog/1.2/59bfcd171d82f9981a5e242b9e840191f650e209/minlog-1.2.jar to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0425064219-5ddebc87/output/results/staging/minlog-1.2-98-99jtn3wu_pMfLJgiFvA.jar
Apr 25, 2018 6:42:22 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.m2/repository/com/google/code/gson/gson/2.7/gson-2.7.jar to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0425064219-5ddebc87/output/results/staging/gson-2.7-UTSiNQ9YiQ_7nbC0AEcZXQ.jar
Apr 25, 2018 6:42:22 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.m2/repository/io/netty/netty-tcnative-boringssl-static/1.1.33.Fork26/netty-tcnative-boringssl-static-1.1.33.Fork26.jar to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0425064219-5ddebc87/output/results/staging/netty-tcnative-boringssl-static-1.1.33.Fork26-29XB0C44MyezMyoCB5cCbw.jar
Apr 25, 2018 6:42:22 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.gradle/caches/modules-2/files-2.1/com.esotericsoftware.reflectasm/reflectasm/1.07/76f11c94a53ee975a0d9154b325c408b210155bd/reflectasm-1.07-shaded.jar to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0425064219-5ddebc87/output/results/staging/reflectasm-1.07-shaded-IELCIoQPsh49E873w5ZYMQ.jar
Apr 25, 2018 6:42:22 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.m2/repository/com/squareup/okhttp/okhttp/2.5.0/okhttp-2.5.0.jar to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0425064219-5ddebc87/output/results/staging/okhttp-2.5.0-64v0X4G_nxfR_PsuymOqpg.jar
Apr 25, 2018 6:42:22 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.m2/repository/io/netty/netty-codec-http/4.1.8.Final/netty-codec-http-4.1.8.Final.jar to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0425064219-5ddebc87/output/results/staging/netty-codec-http-4.1.8.Final-uBsfxiZeL3IeVQNS0QTHUw.jar
Apr 25, 2018 6:42:22 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.gradle/caches/modules-2/files-2.1/org.ow2.asm/asm/4.0/659add6efc75a4715d738e73f07505246edf4d66/asm-4.0.jar to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0425064219-5ddebc87/output/results/staging/asm-4.0-Mi2PiMURGvYS34OMAZHNfg.jar
Apr 25, 2018 6:42:22 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.gradle/caches/modules-2/files-2.1/org.yaml/snakeyaml/1.17/7a27ea250c5130b2922b86dea63cbb1cc10a660c/snakeyaml-1.17.jar to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0425064219-5ddebc87/output/results/staging/snakeyaml-1.17-q2IcPO4xYjatBKbw_k3RfA.jar
Apr 25, 2018 6:42:22 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.m2/repository/io/netty/netty-common/4.1.8.Final/netty-common-4.1.8.Final.jar to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0425064219-5ddebc87/output/results/staging/netty-common-4.1.8.Final-lafOW8vGsI6SRwZSmXNClg.jar
Apr 25, 2018 6:42:22 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/ws/src/sdks/java/io/google-cloud-platform/build/libs/beam-sdks-java-io-google-cloud-platform-2.5.0-SNAPSHOT-shaded-tests.jar> to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0425064219-5ddebc87/output/results/staging/beam-sdks-java-io-google-cloud-platform-2.5.0-SNAPSHOT-shaded-tests-9kLDt-LUUEjFFf6PThe5pg.jar
Apr 25, 2018 6:42:22 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/ws/src/sdks/java/io/google-cloud-platform/build/libs/beam-sdks-java-io-google-cloud-platform-2.5.0-SNAPSHOT-shaded.jar> to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0425064219-5ddebc87/output/results/staging/beam-sdks-java-io-google-cloud-platform-2.5.0-SNAPSHOT-shaded-P6KhRJYP3M8yzWwsB5X1LA.jar
Apr 25, 2018 6:42:22 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading /home/jenkins/.gradle/caches/modules-2/files-2.1/com.google.auto.value/auto-value/1.4/6d1448fcd13074bd3658ef915022410b7c48343b/auto-value-1.4.jar to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0425064219-5ddebc87/output/results/staging/auto-value-1.4-_7tYdqNvCowycFIDpBenFw.jar
Apr 25, 2018 6:42:27 AM org.apache.beam.runners.dataflow.util.PackageUtil stageClasspathElements
INFO: Staging files complete: 0 files cached, 127 files newly uploaded
Apr 25, 2018 6:42:27 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding GenerateSequence/Read(BoundedCountingSource) as step s1
Apr 25, 2018 6:42:27 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding ParDo(CreateEntity) as step s2
Apr 25, 2018 6:42:27 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding DatastoreV1.Write/Convert to Mutation/Map as step s3
Apr 25, 2018 6:42:27 AM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding DatastoreV1.Write/Write Mutation to Datastore as step s4
Apr 25, 2018 6:42:27 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0425064219-5ddebc87/output/results/staging/
Apr 25, 2018 6:42:27 AM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <8773 bytes, hash fOGif6enecHcPRWOcCRd0A> to gs://temp-storage-for-end-to-end-tests/testpipeline-jenkins-0425064219-5ddebc87/output/results/staging/pipeline-fOGif6enecHcPRWOcCRd0A.pb
org.apache.beam.sdk.io.gcp.datastore.V1WriteIT > testE2EV1Write STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT
org.apache.beam.sdk.io.gcp.datastore.V1WriteIT > testE2EV1Write STANDARD_ERROR
Apr 25, 2018 6:42:28 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-04-24_23_42_27-17772194430985438440?project=apache-beam-testing
org.apache.beam.sdk.io.gcp.datastore.V1WriteIT > testE2EV1Write STANDARD_OUT
Submitted job: 2018-04-24_23_42_27-17772194430985438440
org.apache.beam.sdk.io.gcp.datastore.V1WriteIT > testE2EV1Write STANDARD_ERROR
Apr 25, 2018 6:42:28 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2018-04-24_23_42_27-17772194430985438440
Apr 25, 2018 6:42:28 AM org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-04-24_23_42_27-17772194430985438440 with 0 expected assertions.
Apr 25, 2018 6:42:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T06:42:27.742Z: Autoscaling is enabled for job 2018-04-24_23_42_27-17772194430985438440. The number of workers will be between 1 and 1000.
Apr 25, 2018 6:42:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T06:42:27.770Z: Autoscaling was automatically enabled for job 2018-04-24_23_42_27-17772194430985438440.
Apr 25, 2018 6:42:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T06:42:30.212Z: Checking required Cloud APIs are enabled.
Apr 25, 2018 6:42:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T06:42:30.316Z: Checking permissions granted to controller Service Account.
Apr 25, 2018 6:42:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T06:42:35.598Z: Worker configuration: n1-standard-1 in us-central1-f.
Apr 25, 2018 6:42:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T06:42:35.924Z: Expanding CoGroupByKey operations into optimizable parts.
Apr 25, 2018 6:42:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T06:42:35.957Z: Expanding GroupByKey operations into optimizable parts.
Apr 25, 2018 6:42:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T06:42:35.990Z: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
Apr 25, 2018 6:42:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T06:42:36.073Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
Apr 25, 2018 6:42:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T06:42:36.107Z: Fusing consumer ParDo(CreateEntity) into GenerateSequence/Read(BoundedCountingSource)
Apr 25, 2018 6:42:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T06:42:36.189Z: Fusing consumer DatastoreV1.Write/Write Mutation to Datastore into DatastoreV1.Write/Convert to Mutation/Map
Apr 25, 2018 6:42:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T06:42:36.219Z: Fusing consumer DatastoreV1.Write/Convert to Mutation/Map into ParDo(CreateEntity)
Apr 25, 2018 6:42:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T06:42:36.584Z: Executing operation GenerateSequence/Read(BoundedCountingSource)+ParDo(CreateEntity)+DatastoreV1.Write/Convert to Mutation/Map+DatastoreV1.Write/Write Mutation to Datastore
Apr 25, 2018 6:42:38 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T06:42:36.649Z: Starting 1 workers in us-central1-f...
Apr 25, 2018 6:42:46 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T06:42:46.073Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
Apr 25, 2018 6:42:57 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T06:42:56.617Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
Apr 25, 2018 6:43:20 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T06:43:19.222Z: Workers have started successfully.
Apr 25, 2018 6:43:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T06:43:52.961Z: Cleaning up.
Apr 25, 2018 6:43:53 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T06:43:53.058Z: Stopping worker pool...
Apr 25, 2018 6:45:12 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T06:45:11.866Z: Autoscaling: Resized worker pool from 1 to 0.
Apr 25, 2018 6:45:12 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-25T06:45:11.890Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
Apr 25, 2018 6:45:20 AM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-04-24_23_42_27-17772194430985438440 finished with status DONE.
Apr 25, 2018 6:45:20 AM org.apache.beam.runners.dataflow.TestDataflowRunner checkForPAssertSuccess
INFO: Success result for Dataflow job 2018-04-24_23_42_27-17772194430985438440. Found 0 success, 0 failures out of 0 expected assertions.
Apr 25, 2018 6:45:21 AM org.apache.beam.sdk.io.gcp.datastore.V1TestUtil$V1TestWriter flushBatch
INFO: Writing batch of 500 entities
Apr 25, 2018 6:45:22 AM org.apache.beam.sdk.io.gcp.datastore.V1TestUtil$V1TestWriter flushBatch
INFO: Successfully wrote 500 entities
Apr 25, 2018 6:45:22 AM org.apache.beam.sdk.io.gcp.datastore.V1TestUtil$V1TestWriter flushBatch
INFO: Writing batch of 500 entities
Apr 25, 2018 6:45:23 AM org.apache.beam.sdk.io.gcp.datastore.V1TestUtil$V1TestWriter flushBatch
INFO: Successfully wrote 500 entities
Apr 25, 2018 6:45:23 AM org.apache.beam.sdk.io.gcp.datastore.V1TestUtil deleteAllEntities
INFO: Successfully deleted 1000 entities
org.apache.beam.sdk.io.gcp.spanner.SpannerReadIT > testQuery FAILED
Gradle Test Executor 130 finished executing tests.
java.lang.NoClassDefFoundError: com/google/api/gax/retrying/ExceptionRetryAlgorithm
at java.lang.ClassLoader.defineClass1(Native Method)
at java.lang.ClassLoader.defineClass(ClassLoader.java:763)
at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)
at java.net.URLClassLoader.defineClass(URLClassLoader.java:467)
at java.net.URLClassLoader.access$100(URLClassLoader.java:73)
at java.net.URLClassLoader$1.run(URLClassLoader.java:368)
at java.net.URLClassLoader$1.run(URLClassLoader.java:362)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:361)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:338)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
at com.google.cloud.BaseService.<clinit>(BaseService.java:48)
at com.google.cloud.spanner.SpannerOptions$DefaultSpannerFactory.create(SpannerOptions.java:60)
at com.google.cloud.spanner.SpannerOptions$DefaultSpannerFactory.create(SpannerOptions.java:55)
at com.google.cloud.ServiceOptions.getService(ServiceOptions.java:426)
at org.apache.beam.sdk.io.gcp.spanner.SpannerReadIT.setUp(SpannerReadIT.java:90)
Caused by:
java.lang.ClassNotFoundException: com.google.api.gax.retrying.ExceptionRetryAlgorithm
at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:338)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
... 17 more
java.lang.NullPointerException
at org.apache.beam.sdk.io.gcp.spanner.SpannerReadIT.tearDown(SpannerReadIT.java:198)
org.apache.beam.sdk.io.gcp.spanner.SpannerReadIT > testRead FAILED
java.lang.NoClassDefFoundError: Could not initialize class com.google.cloud.spanner.SpannerImpl
at com.google.cloud.spanner.SpannerOptions$DefaultSpannerFactory.create(SpannerOptions.java:60)
at com.google.cloud.spanner.SpannerOptions$DefaultSpannerFactory.create(SpannerOptions.java:55)
at com.google.cloud.ServiceOptions.getService(ServiceOptions.java:426)
at org.apache.beam.sdk.io.gcp.spanner.SpannerReadIT.setUp(SpannerReadIT.java:90)
java.lang.NullPointerException
at org.apache.beam.sdk.io.gcp.spanner.SpannerReadIT.tearDown(SpannerReadIT.java:198)
12 tests completed, 3 failed
Finished generating test XML results (0.007 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/ws/src/runners/google-cloud-dataflow-java/build/test-results/googleCloudPlatformIntegrationTest>
Generating HTML test report...
Finished generating test html results (0.008 secs) into: <https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/googleCloudPlatformIntegrationTest>
:beam-runners-google-cloud-dataflow-java:googleCloudPlatformIntegrationTest FAILED
:beam-runners-google-cloud-dataflow-java:googleCloudPlatformIntegrationTest (Thread[main,5,main]) completed. Took 18 mins 8.479 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-google-cloud-dataflow-java:googleCloudPlatformIntegrationTest'.
> There were failing tests. See the report at: file://<https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/googleCloudPlatformIntegrationTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
See https://docs.gradle.org/4.6/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 44m 29s
541 actionable tasks: 534 executed, 7 from cache
Publishing build scan...
https://gradle.com/s/p6hcebqfdowea
Build cache (/home/jenkins/.gradle/caches/build-cache-1) has not been cleaned up in 0 days
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user kedin@google.com
Not sending mail to unregistered user kirpichov@google.com