You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2018/03/28 03:59:42 UTC
Build failed in Jenkins: beam_PostRelease_NightlySnapshot #162
See <https://builds.apache.org/job/beam_PostRelease_NightlySnapshot/162/display/redirect>
------------------------------------------
[...truncated 34.66 MB...]
GOT user4_AppleGreenEmu,AppleGreenEmu,5,1522208894000,2018-03-27 20:48:14.657
GOT user2_ArmyGreenPossum,ArmyGreenPossum,2,1522208887000,2018-03-27 20:48:07.644
GOT user11_AquaKangaroo,AquaKangaroo,3,1522208894000,2018-03-27 20:48:14.657
GOT user8_AzureEchidna,AzureEchidna,5,1522208887000,2018-03-27 20:48:07.644
GOT user3_AppleGreenEmu,AppleGreenEmu,18,1522208894000,2018-03-27 20:48:14.658
GOT user9_ArmyGreenKangaroo,ArmyGreenKangaroo,3,1522208887000,2018-03-27 20:48:07.644
GOT user3_RubyBandicoot,RubyBandicoot,1,1522208894000,2018-03-27 20:48:14.658
GOT user2_AsparagusPlatypus,AsparagusPlatypus,17,1522208887000,2018-03-27 20:48:07.644
GOT Robot-0,AquaWombat,7,1522208894000,2018-03-27 20:48:14.658
GOT user8_RubyBandicoot,RubyBandicoot,9,1522208889000,2018-03-27 20:48:09.159
GOT user2_AquaKangaroo,AquaKangaroo,0,1522208889000,2018-03-27 20:48:09.159
GOT user4_AquaKangaroo,AquaKangaroo,17,1522208889000,2018-03-27 20:48:09.159
GOT user2_RubyBandicoot,RubyBandicoot,6,1522208889000,2018-03-27 20:48:09.159
GOT user2_RubyBandicoot,RubyBandicoot,9,1522208889000,2018-03-27 20:48:09.159
GOT user8_AquaWombat,AquaWombat,7,1522208888000,2018-03-27 20:48:08.646
GOT user2_ArmyGreenPossum,ArmyGreenPossum,19,1522208889000,2018-03-27 20:48:09.159
GOT user1_ArmyGreenPossum,ArmyGreenPossum,6,1522208888000,2018-03-27 20:48:08.646
GOT user1_AppleGreenEmu,AppleGreenEmu,12,1522208889000,2018-03-27 20:48:09.159
GOT user2_AquaDingo,AquaDingo,12,1522208888000,2018-03-27 20:48:08.646
GOT user3_BarnRedWombat,BarnRedWombat,2,1522208889000,2018-03-27 20:48:09.159
GOT user5_AntiqueBrassCaneToad,AntiqueBrassCaneToad,14,1522208888000,2018-03-27 20:48:08.646
GOT user3_FuchsiaCassowary,FuchsiaCassowary,16,1522208889000,2018-03-27 20:48:09.159
GOT user1_ArmyGreenPossum,ArmyGreenPossum,2,1522208888000,2018-03-27 20:48:08.646
GOT user7_ArmyGreenKangaroo,ArmyGreenKangaroo,10,1522208889000,2018-03-27 20:48:09.159
GOT Robot-0,AquaWombat,15,1522208888000,2018-03-27 20:48:08.646
GOT user6_AquaWombat,AquaWombat,8,1522208888000,2018-03-27 20:48:08.646
GOT user3_AzureEchidna,AzureEchidna,4,1522208888000,2018-03-27 20:48:08.646
GOT user0_RubyBandicoot,RubyBandicoot,18,1522208888000,2018-03-27 20:48:08.646
GOT user0_FuchsiaPlatypus,FuchsiaPlatypus,11,1522208888000,2018-03-27 20:48:08.646
GOT user6_AppleGreenEmu,AppleGreenEmu,3,1522209043000,2018-03-27 20:50:43.538
GOT user8_AsparagusPlatypus,AsparagusPlatypus,4,1522209043000,2018-03-27 20:50:43.538
GOT user14_ArmyGreenKangaroo,ArmyGreenKangaroo,1,1522209043000,2018-03-27 20:50:43.538
GOT user2_ArmyGreenPossum,ArmyGreenPossum,4,1522209043000,2018-03-27 20:50:43.538
GOT user4_AppleGreenKookaburra,AppleGreenKookaburra,4,1522208877000,2018-03-27 20:47:57.577
GOT user2_AppleGreenEmu,AppleGreenEmu,19,1522209043000,2018-03-27 20:50:43.538
GOT user2_MagentaBandicoot,MagentaBandicoot,19,1522208877000,2018-03-27 20:47:57.577
GOT user3_AsparagusPlatypus,AsparagusPlatypus,18,1522209043000,2018-03-27 20:50:43.538
GOT user10_AliceBlueKoala,AliceBlueKoala,1,1522208877000,2018-03-27 20:47:57.577
GOT user1_AppleGreenEmu,AppleGreenEmu,1,1522209043000,2018-03-27 20:50:43.538
GOT user8_BarnRedCassowary,BarnRedCassowary,0,1522208877000,2018-03-27 20:47:57.577
GOT user13_AntiqueBrassCaneToad,AntiqueBrassCaneToad,4,1522209043000,2018-03-27 20:50:43.538
GOT user8_MagentaKookaburra,MagentaKookaburra,14,1522208877000,2018-03-27 20:47:57.577
GOT user0_AmberEchidna,AmberEchidna,15,1522209043000,2018-03-27 20:50:43.538
GOT user2_AliceBlueCockatoo,AliceBlueCockatoo,18,1522208877000,2018-03-27 20:47:57.577
GOT user14_AquaKangaroo,AquaKangaroo,3,1522209043000,2018-03-27 20:50:43.538
GOT user2_ApricotKangaroo,ApricotKangaroo,19,1522208877000,2018-03-27 20:47:57.577
GOT user4_BananaMarmot,BananaMarmot,12,1522208877000,2018-03-27 20:47:57.577
GOT user0_AppleGreenKookaburra,AppleGreenKookaburra,14,1522208877000,2018-03-27 20:47:57.577
GOT user10_ArmyGreenKookaburra,ArmyGreenKookaburra,17,1522208877000,2018-03-27 20:47:57.577
GOT user2_BarnRedWombat,BarnRedWombat,4,1522208890000,2018-03-27 20:48:10.646
GOT user0_FuchsiaPlatypus,FuchsiaPlatypus,16,1522208890000,2018-03-27 20:48:10.646
GOT user13_AntiqueBrassCaneToad,AntiqueBrassCaneToad,18,1522208890000,2018-03-27 20:48:10.646
GOT Robot-16,AsparagusPlatypus,13,1522208890000,2018-03-27 20:48:10.646
GOT user5_BarnRedAntechinus,BarnRedAntechinus,10,1522209063000,2018-03-27 20:51:03.161
Verified Magenta
GOT user7_AppleGreenEmu,AppleGreenEmu,1,1522208890000,2018-03-27 20:48:10.646
GOT user10_AlmondPossum,AlmondPossum,7,1522209063000,2018-03-27 20:51:03.161
GOT user15_BeigeCassowary,BeigeCassowary,12,1522208890000,2018-03-27 20:48:10.646
GOT user10_BarnRedCassowary,BarnRedCassowary,11,1522209063000,2018-03-27 20:51:03.161
GOT user4_ArmyGreenPossum,ArmyGreenPossum,0,1522208890000,2018-03-27 20:48:10.646
GOT user2_BarnRedAntechinus,BarnRedAntechinus,6,1522209063000,2018-03-27 20:51:03.161
GOT Robot-16,AsparagusPlatypus,2,1522208890000,2018-03-27 20:48:10.646
GOT user0_MagentaKookaburra,MagentaKookaburra,17,1522209063000,2018-03-27 20:51:03.161
GOT user12_AquaKangaroo,AquaKangaroo,12,1522208890000,2018-03-27 20:48:10.646
GOT user3_AliceBlueCockatoo,AliceBlueCockatoo,12,1522209063000,2018-03-27 20:51:03.161
GOT user6_BeigeCassowary,BeigeCassowary,14,1522208890000,2018-03-27 20:48:10.646
GOT user11_AliceBlueKoala,AliceBlueKoala,11,1522209063000,2018-03-27 20:51:03.161
GOT user0_MagentaBandicoot,MagentaBandicoot,7,1522209063000,2018-03-27 20:51:03.161
GOT Robot-19,AliceBlueCockatoo,8,1522209063000,2018-03-27 20:51:03.161
GOT user7_MagentaBandicoot,MagentaBandicoot,17,1522209063000,2018-03-27 20:51:03.161
GOT user7_AlmondPossum,AlmondPossum,6,1522208884000,2018-03-27 20:48:04.581
GOT user2_ApricotKangaroo,ApricotKangaroo,10,1522208884000,2018-03-27 20:48:04.581
GOT user5_AppleGreenKookaburra,AppleGreenKookaburra,12,1522208884000,2018-03-27 20:48:04.581
GOT user11_BarnRedAntechinus,BarnRedAntechinus,11,1522208884000,2018-03-27 20:48:04.581
GOT user13_AquaWombat,AquaWombat,17,1522208883000,2018-03-27 20:48:03.632
GOT user0_AliceBlueCockatoo,AliceBlueCockatoo,8,1522208884000,2018-03-27 20:48:04.581
GOT user1_BeigeCassowary,BeigeCassowary,12,1522208883000,2018-03-27 20:48:03.632
GOT Robot-16,AppleGreenCassowary,18,1522208884000,2018-03-27 20:48:04.581
GOT user2_AquaDingo,AquaDingo,18,1522208883000,2018-03-27 20:48:03.632
GOT user9_BarnRedAntechinus,BarnRedAntechinus,14,1522208884000,2018-03-27 20:48:04.581
GOT user1_AquaWombat,AquaWombat,0,1522208883000,2018-03-27 20:48:03.632
GOT user2_AliceBlueCockatoo,AliceBlueCockatoo,14,1522208884000,2018-03-27 20:48:04.581
GOT user2_AntiqueBrassCaneToad,AntiqueBrassCaneToad,17,1522208883000,2018-03-27 20:48:03.632
GOT user4_MagentaKookaburra,MagentaKookaburra,1,1522208884000,2018-03-27 20:48:04.581
GOT user3_RubyBandicoot,RubyBandicoot,4,1522208883000,2018-03-27 20:48:03.632
GOT user1_BarnRedAntechinus,BarnRedAntechinus,19,1522208884000,2018-03-27 20:48:04.581
GOT user0_AquaDingo,AquaDingo,3,1522208883000,2018-03-27 20:48:03.632
GOT user10_AquaWombat,AquaWombat,19,1522208883000,2018-03-27 20:48:03.632
GOT user4_BarnRedWombat,BarnRedWombat,11,1522208883000,2018-03-27 20:48:03.632
GOT user8_AquaWombat,AquaWombat,3,1522208883000,2018-03-27 20:48:03.632
GOT user16_FuchsiaPlatypus,FuchsiaPlatypus,2,1522209188000,2018-03-27 20:53:08.540
GOT user3_BarnRedWombat,BarnRedWombat,8,1522209188000,2018-03-27 20:53:08.540
GOT user4_ArmyGreenKangaroo,ArmyGreenKangaroo,2,1522209188000,2018-03-27 20:53:08.540
GOT user1_BarnRedWombat,BarnRedWombat,9,1522209188000,2018-03-27 20:53:08.540
GOT user1_AppleGreenCassowary,AppleGreenCassowary,4,1522209112000,2018-03-27 20:51:52.833
GOT user2_AmberEchidna,AmberEchidna,16,1522209188000,2018-03-27 20:53:08.540
GOT user0_BananaMarmot,BananaMarmot,9,1522209112000,2018-03-27 20:51:52.833
GOT user1_AquaWombat,AquaWombat,5,1522209188000,2018-03-27 20:53:08.540
GOT user3_AlmondBandicoot,AlmondBandicoot,2,1522209112000,2018-03-27 20:51:52.833
GOT user9_ArmyGreenKangaroo,ArmyGreenKangaroo,15,1522209188000,2018-03-27 20:53:08.540
GOT user1_BarnRedAntechinus,BarnRedAntechinus,15,1522209112000,2018-03-27 20:51:52.833
GOT Robot-19,AmberEchidna,1,1522209188000,2018-03-27 20:53:08.540
GOT user0_MagentaKookaburra,MagentaKookaburra,6,1522209112000,2018-03-27 20:51:52.833
GOT Robot-2,AquaDingo,18,1522209188000,2018-03-27 20:53:08.540
GOT user11_AlmondPossum,AlmondPossum,16,1522209112000,2018-03-27 20:51:52.833
GOT user6_AquaWombat,AquaWombat,6,1522209188000,2018-03-27 20:53:08.540
GOT user2_ArmyGreenEchidna,ArmyGreenEchidna,9,1522209112000,2018-03-27 20:51:52.833
GOT user4_BananaMarmot,BananaMarmot,16,1522209112000,2018-03-27 20:51:52.833
GOT user10_MagentaBandicoot,MagentaBandicoot,8,1522209112000,2018-03-27 20:51:52.833
GOT user5_AlmondBandicoot,AlmondBandicoot,5,1522209112000,2018-03-27 20:51:52.833
GOT user13_ArmyGreenKangaroo,ArmyGreenKangaroo,13,1522208891000,2018-03-27 20:48:11.146
GOT user13_AquaKangaroo,AquaKangaroo,18,1522208891000,2018-03-27 20:48:11.146
GOT user2_AppleGreenEmu,AppleGreenEmu,18,1522208891000,2018-03-27 20:48:11.146
GOT user10_AppleGreenEmu,AppleGreenEmu,8,1522208891000,2018-03-27 20:48:11.146
GOT user4_ArmyGreenPossum,ArmyGreenPossum,4,1522208891000,2018-03-27 20:48:11.146
GOT user17_ArmyGreenKangaroo,ArmyGreenKangaroo,9,1522208891000,2018-03-27 20:48:11.146
GOT user2_AntiqueBrassCaneToad,AntiqueBrassCaneToad,19,1522208891000,2018-03-27 20:48:11.146
GOT user9_AquaWombat,AquaWombat,8,1522208891000,2018-03-27 20:48:11.146
GOT Robot-19,AmberEchidna,13,1522208891000,2018-03-27 20:48:11.146
GOT user3_FuchsiaCassowary,FuchsiaCassowary,17,1522208891000,2018-03-27 20:48:11.146
GOT user1_BananaMarmot,BananaMarmot,8,1522208891000,2018-03-27 20:48:11.595
GOT user0_ArmyGreenWombat,ArmyGreenWombat,2,1522208891000,2018-03-27 20:48:11.595
GOT user7_ArmyGreenEchidna,ArmyGreenEchidna,3,1522208891000,2018-03-27 20:48:11.595
GOT user3_AppleGreenKookaburra,AppleGreenKookaburra,6,1522208891000,2018-03-27 20:48:11.595
GOT user12_ArmyGreenKookaburra,ArmyGreenKookaburra,3,1522208891000,2018-03-27 20:48:11.595
GOT user3_AppleGreenKookaburra,AppleGreenKookaburra,19,1522208891000,2018-03-27 20:48:11.595
GOT user1_ArmyGreenKookaburra,ArmyGreenKookaburra,9,1522208891000,2018-03-27 20:48:11.595
GOT user5_ArmyGreenEchidna,ArmyGreenEchidna,4,1522208891000,2018-03-27 20:48:11.595
GOT user11_MagentaKookaburra,MagentaKookaburra,19,1522208891000,2018-03-27 20:48:11.595
GOT user2_BananaMarmot,BananaMarmot,3,1522208891000,2018-03-27 20:48:11.595
**************************************
* SUCCESS: LeaderBoard successfully run on DirectRunner.
**************************************
Waiting on bqjob_r27db70c8cd7ef266_000001626ac08842_1 ... (98s) Current status: PENDING
[SUCCESS]
Waiting on bqjob_r27db70c8cd7ef266_000001626ac08842_1 ... (99s) Current status: PENDING
Waiting on bqjob_r27db70c8cd7ef266_000001626ac08842_1 ... (100s) Current status: PENDING
Waiting on bqjob_r27db70c8cd7ef266_000001626ac08842_1 ... (101s) Current status: PENDING
Waiting on bqjob_r27db70c8cd7ef266_000001626ac08842_1 ... (102s) Current status: PENDING
Waiting on bqjob_r27db70c8cd7ef266_000001626ac08842_1 ... (103s) Current status: PENDING
Waiting on bqjob_r27db70c8cd7ef266_000001626ac08842_1 ... (104s) Current status: PENDING
Waiting on bqjob_r27db70c8cd7ef266_000001626ac08842_1 ... (105s) Current status: PENDING
Waiting on bqjob_r27db70c8cd7ef266_000001626ac08842_1 ... (106s) Current status: PENDING
Waiting on bqjob_r27db70c8cd7ef266_000001626ac08842_1 ... (107s) Current status: PENDING
Waiting on bqjob_r27db70c8cd7ef266_000001626ac08842_1 ... (108s) Current status: PENDING
Waiting on bqjob_r27db70c8cd7ef266_000001626ac08842_1 ... (109s) Current status: PENDING
Waiting on bqjob_r27db70c8cd7ef266_000001626ac08842_1 ... (110s) Current status: PENDING
Waiting on bqjob_r27db70c8cd7ef266_000001626ac08842_1 ... (111s) Current status: PENDING
Waiting on bqjob_r27db70c8cd7ef266_000001626ac08842_1 ... (112s) Current status: PENDING
Waiting on bqjob_r27db70c8cd7ef266_000001626ac08842_1 ... (113s) Current status: PENDING
Waiting on bqjob_r27db70c8cd7ef266_000001626ac08842_1 ... (114s) Current status: PENDING
Waiting on bqjob_r27db70c8cd7ef266_000001626ac08842_1 ... (115s) Current status: PENDING
............................................................Introducing a parse error.
Waiting on bqjob_r27db70c8cd7ef266_000001626ac08842_1 ... (116s) Current status: PENDING
Waiting on bqjob_r27db70c8cd7ef266_000001626ac08842_1 ... (117s) Current status: PENDING
Waiting on bqjob_r27db70c8cd7ef266_000001626ac08842_1 ... (118s) Current status: PENDING
Waiting on bqjob_r27db70c8cd7ef266_000001626ac08842_1 ... (119s) Current status: PENDING
Waiting on bqjob_r27db70c8cd7ef266_000001626ac08842_1 ... (120s) Current status: PENDING
Waiting on bqjob_r27db70c8cd7ef266_000001626ac08842_1 ... (121s) Current status: PENDING
Waiting on bqjob_r27db70c8cd7ef266_000001626ac08842_1 ... (122s) Current status: PENDING
Waiting on bqjob_r27db70c8cd7ef266_000001626ac08842_1 ... (123s) Current status: PENDING
Waiting on bqjob_r27db70c8cd7ef266_000001626ac08842_1 ... (124s) Current status: PENDING
Waiting on bqjob_r27db70c8cd7ef266_000001626ac08842_1 ... (125s) Current status: PENDING
Waiting on bqjob_r27db70c8cd7ef266_000001626ac08842_1 ... (126s) Current status: PENDING
Waiting on bqjob_r27db70c8cd7ef266_000001626ac08842_1 ... (127s) Current status: PENDING
Waiting on bqjob_r27db70c8cd7ef266_000001626ac08842_1 ... (128s) Current status: PENDING
Waiting on bqjob_r27db70c8cd7ef266_000001626ac08842_1 ... (129s) Current status: PENDING
Waiting on bqjob_r27db70c8cd7ef266_000001626ac08842_1 ... (130s) Current status: PENDING
Waiting on bqjob_r27db70c8cd7ef266_000001626ac08842_1 ... (131s) Current status: PENDING
Waiting on bqjob_r27db70c8cd7ef266_000001626ac08842_1 ... (132s) Current status: PENDING
Waiting on bqjob_r27db70c8cd7ef266_000001626ac08842_1 ... (133s) Current status: PENDING
Waiting on bqjob_r27db70c8cd7ef266_000001626ac08842_1 ... (133s) Current status: DONE
+---------------------------+
| user |
+---------------------------+
| user11_BarnRedCassowary |
| user6_ArmyGreenWombat |
| user4_AlmondPossum |
| user10_AliceBlueKoala |
| user3_BarnRedAntechinus |
| user0_MagentaKookaburra |
| user5_BarnRedCassowary |
| user9_AliceBlueKoala |
| user0_BarnRedCassowary |
| user6_ArmyGreenKookaburra |
+---------------------------+
Verified Magenta
gcloud dataflow jobs cancel $(gcloud dataflow jobs list | grep leaderboard-jenkins | grep Running | cut -d' ' -f1)
Cancelled job [2018-03-27_20_43_37-18079096694273263030]
**************************************
* SUCCESS: LeaderBoard successfully run on DataflowRunner.
**************************************
[SUCCESS]
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':runners:flink:runQuickstartJavaFlinkLocal'.
> Process 'command '/usr/local/asfpackages/java/jdk1.8.0_152/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 25m 11s
5 actionable tasks: 5 executed
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Jenkins build is back to normal : beam_PostRelease_NightlySnapshot
#169
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostRelease_NightlySnapshot/169/display/redirect?page=changes>
Build failed in Jenkins: beam_PostRelease_NightlySnapshot #168
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostRelease_NightlySnapshot/168/display/redirect?page=changes>
Changes:
[altay] Update streaming wordcount example and allign with the batch example.
[github] Fix linter error in typehints.
[wcn] Remove include directives for proto well-known-types.
------------------------------------------
[...truncated 2.76 MB...]
INFO: Running task 6.0 in stage 2.0 (TID 14)
Mar 30, 2018 11:04:51 AM org.apache.spark.internal.Logging$class logInfo
INFO: Finished task 0.0 in stage 2.0 (TID 8) in 79 ms on localhost (executor driver) (2/8)
Mar 30, 2018 11:04:51 AM org.apache.spark.internal.Logging$class logInfo
INFO: Finished task 3.0 in stage 2.0 (TID 11) in 74 ms on localhost (executor driver) (3/8)
Mar 30, 2018 11:04:51 AM org.apache.spark.internal.Logging$class logInfo
INFO: Block rdd_41_2 stored as values in memory (estimated size 1280.0 B, free 1825.1 MB)
Mar 30, 2018 11:04:51 AM org.apache.spark.internal.Logging$class logInfo
INFO: Added rdd_41_2 in memory on 127.0.0.1:46087 (size: 1280.0 B, free: 1825.4 MB)
Mar 30, 2018 11:04:51 AM org.apache.spark.internal.Logging$class logInfo
INFO: Finished task 2.0 in stage 2.0 (TID 10). 13283 bytes result sent to driver
Mar 30, 2018 11:04:51 AM org.apache.spark.internal.Logging$class logInfo
INFO: Getting 0 non-empty blocks out of 4 blocks
Mar 30, 2018 11:04:51 AM org.apache.spark.internal.Logging$class logInfo
INFO: Started 0 remote fetches in 0 ms
Mar 30, 2018 11:04:51 AM org.apache.spark.internal.Logging$class logInfo
INFO: Starting task 7.0 in stage 2.0 (TID 15, localhost, executor driver, partition 7, PROCESS_LOCAL, 4730 bytes)
Mar 30, 2018 11:04:51 AM org.apache.spark.internal.Logging$class logInfo
INFO: Getting 0 non-empty blocks out of 4 blocks
Mar 30, 2018 11:04:51 AM org.apache.spark.internal.Logging$class logInfo
INFO: Started 0 remote fetches in 0 ms
Mar 30, 2018 11:04:51 AM org.apache.spark.internal.Logging$class logInfo
INFO: Finished task 2.0 in stage 2.0 (TID 10) in 97 ms on localhost (executor driver) (4/8)
Mar 30, 2018 11:04:51 AM org.apache.spark.internal.Logging$class logInfo
INFO: Running task 7.0 in stage 2.0 (TID 15)
Mar 30, 2018 11:04:51 AM org.apache.spark.internal.Logging$class logInfo
INFO: Getting 0 non-empty blocks out of 4 blocks
Mar 30, 2018 11:04:51 AM org.apache.spark.internal.Logging$class logInfo
INFO: Started 0 remote fetches in 1 ms
Mar 30, 2018 11:04:51 AM org.apache.spark.internal.Logging$class logInfo
INFO: Getting 0 non-empty blocks out of 4 blocks
Mar 30, 2018 11:04:51 AM org.apache.spark.internal.Logging$class logInfo
INFO: Started 0 remote fetches in 1 ms
Mar 30, 2018 11:04:51 AM org.apache.spark.internal.Logging$class logInfo
INFO: Block rdd_41_4 stored as values in memory (estimated size 16.0 B, free 1825.1 MB)
Mar 30, 2018 11:04:51 AM org.apache.spark.internal.Logging$class logInfo
INFO: Added rdd_41_4 in memory on 127.0.0.1:46087 (size: 16.0 B, free: 1825.4 MB)
Mar 30, 2018 11:04:51 AM org.apache.spark.internal.Logging$class logInfo
INFO: Block rdd_41_6 stored as values in memory (estimated size 16.0 B, free 1825.1 MB)
Mar 30, 2018 11:04:51 AM org.apache.spark.internal.Logging$class logInfo
INFO: Block rdd_41_7 stored as values in memory (estimated size 16.0 B, free 1825.1 MB)
Mar 30, 2018 11:04:51 AM org.apache.spark.internal.Logging$class logInfo
INFO: Added rdd_41_6 in memory on 127.0.0.1:46087 (size: 16.0 B, free: 1825.4 MB)
Mar 30, 2018 11:04:51 AM org.apache.spark.internal.Logging$class logInfo
INFO: Added rdd_41_7 in memory on 127.0.0.1:46087 (size: 16.0 B, free: 1825.4 MB)
Mar 30, 2018 11:04:51 AM org.apache.spark.internal.Logging$class logInfo
INFO: Finished task 7.0 in stage 2.0 (TID 15). 11942 bytes result sent to driver
Mar 30, 2018 11:04:51 AM org.apache.spark.internal.Logging$class logInfo
INFO: Finished task 6.0 in stage 2.0 (TID 14). 11942 bytes result sent to driver
Mar 30, 2018 11:04:51 AM org.apache.spark.internal.Logging$class logInfo
INFO: Block rdd_41_5 stored as values in memory (estimated size 16.0 B, free 1825.1 MB)
Mar 30, 2018 11:04:51 AM org.apache.spark.internal.Logging$class logInfo
INFO: Added rdd_41_5 in memory on 127.0.0.1:46087 (size: 16.0 B, free: 1825.4 MB)
Mar 30, 2018 11:04:51 AM org.apache.spark.internal.Logging$class logInfo
INFO: Finished task 6.0 in stage 2.0 (TID 14) in 92 ms on localhost (executor driver) (5/8)
Mar 30, 2018 11:04:51 AM org.apache.spark.internal.Logging$class logInfo
INFO: Finished task 7.0 in stage 2.0 (TID 15) in 68 ms on localhost (executor driver) (6/8)
Mar 30, 2018 11:04:51 AM org.apache.spark.internal.Logging$class logInfo
INFO: Finished task 5.0 in stage 2.0 (TID 13). 11942 bytes result sent to driver
Mar 30, 2018 11:04:51 AM org.apache.spark.internal.Logging$class logInfo
INFO: Finished task 4.0 in stage 2.0 (TID 12). 11942 bytes result sent to driver
Mar 30, 2018 11:04:51 AM org.apache.spark.internal.Logging$class logInfo
INFO: Finished task 5.0 in stage 2.0 (TID 13) in 99 ms on localhost (executor driver) (7/8)
Mar 30, 2018 11:04:51 AM org.apache.spark.internal.Logging$class logInfo
INFO: Finished task 4.0 in stage 2.0 (TID 12) in 107 ms on localhost (executor driver) (8/8)
Mar 30, 2018 11:04:51 AM org.apache.spark.internal.Logging$class logInfo
INFO: Removed TaskSet 2.0, whose tasks have all completed, from pool
Mar 30, 2018 11:04:51 AM org.apache.spark.internal.Logging$class logInfo
INFO: ResultStage 2 (collect at BoundedDataset.java:87) finished in 0.173 s
Mar 30, 2018 11:04:51 AM org.apache.spark.internal.Logging$class logInfo
INFO: Job 0 finished: collect at BoundedDataset.java:87, took 4.016823 s
Mar 30, 2018 11:04:51 AM org.apache.beam.runners.spark.SparkRunner$Evaluator enterCompositeTransform
INFO: Entering directly-translatable composite transform: 'WriteCounts/WriteFiles/GatherTempFileResults/Reify.ReifyViewInGlobalWindow/Create.Values'
Mar 30, 2018 11:04:51 AM org.apache.beam.runners.spark.SparkRunner$Evaluator doVisitTransform
INFO: Evaluating Create.Values
Mar 30, 2018 11:04:51 AM org.apache.beam.runners.spark.SparkRunner$Evaluator doVisitTransform
INFO: Evaluating org.apache.beam.sdk.transforms.Reify$ReifyView$1@32e0ce6c
Mar 30, 2018 11:04:51 AM org.apache.spark.internal.Logging$class logInfo
INFO: Block broadcast_3 stored as values in memory (estimated size 672.0 B, free 1825.1 MB)
Mar 30, 2018 11:04:51 AM org.apache.spark.internal.Logging$class logInfo
INFO: Block broadcast_3_piece0 stored as bytes in memory (estimated size 362.0 B, free 1825.1 MB)
Mar 30, 2018 11:04:51 AM org.apache.spark.internal.Logging$class logInfo
INFO: Added broadcast_3_piece0 in memory on 127.0.0.1:46087 (size: 362.0 B, free: 1825.4 MB)
Mar 30, 2018 11:04:51 AM org.apache.spark.internal.Logging$class logInfo
INFO: Created broadcast 3 from broadcast at SideInputBroadcast.java:59
Mar 30, 2018 11:04:51 AM org.apache.beam.runners.spark.SparkRunner$Evaluator doVisitTransform
INFO: Evaluating org.apache.beam.sdk.transforms.MapElements$1@5abf2f11
Mar 30, 2018 11:04:51 AM org.apache.beam.runners.spark.SparkRunner$Evaluator doVisitTransform
INFO: Evaluating org.apache.beam.sdk.io.WriteFiles$FinalizeTempFileBundles$FinalizeFn@4292b1d9
Mar 30, 2018 11:04:51 AM org.apache.spark.internal.Logging$class logInfo
INFO: Starting job: foreach at BoundedDataset.java:117
Mar 30, 2018 11:04:51 AM org.apache.spark.internal.Logging$class logInfo
INFO: Got job 1 (foreach at BoundedDataset.java:117) with 4 output partitions
Mar 30, 2018 11:04:51 AM org.apache.spark.internal.Logging$class logInfo
INFO: Final stage: ResultStage 3 (foreach at BoundedDataset.java:117)
Mar 30, 2018 11:04:51 AM org.apache.spark.internal.Logging$class logInfo
INFO: Parents of final stage: List()
Mar 30, 2018 11:04:51 AM org.apache.spark.internal.Logging$class logInfo
INFO: Missing parents: List()
Mar 30, 2018 11:04:51 AM org.apache.spark.internal.Logging$class logInfo
INFO: Submitting ResultStage 3 (WriteCounts/WriteFiles/FinalizeTempFileBundles/Finalize/ParMultiDo(Finalize).output MapPartitionsRDD[53] at values at TransformTranslator.java:400), which has no missing parents
Mar 30, 2018 11:04:51 AM org.apache.spark.internal.Logging$class logInfo
INFO: Block broadcast_4 stored as values in memory (estimated size 83.9 KB, free 1825.0 MB)
Mar 30, 2018 11:04:51 AM org.apache.spark.internal.Logging$class logInfo
INFO: Block broadcast_4_piece0 stored as bytes in memory (estimated size 22.3 KB, free 1825.0 MB)
Mar 30, 2018 11:04:51 AM org.apache.spark.internal.Logging$class logInfo
INFO: Added broadcast_4_piece0 in memory on 127.0.0.1:46087 (size: 22.3 KB, free: 1825.3 MB)
Mar 30, 2018 11:04:51 AM org.apache.spark.internal.Logging$class logInfo
INFO: Created broadcast 4 from broadcast at DAGScheduler.scala:1006
Mar 30, 2018 11:04:51 AM org.apache.spark.internal.Logging$class logInfo
INFO: Submitting 4 missing tasks from ResultStage 3 (WriteCounts/WriteFiles/FinalizeTempFileBundles/Finalize/ParMultiDo(Finalize).output MapPartitionsRDD[53] at values at TransformTranslator.java:400) (first 15 tasks are for partitions Vector(0, 1, 2, 3))
Mar 30, 2018 11:04:51 AM org.apache.spark.internal.Logging$class logInfo
INFO: Adding task set 3.0 with 4 tasks
Mar 30, 2018 11:04:51 AM org.apache.spark.internal.Logging$class logInfo
INFO: Starting task 0.0 in stage 3.0 (TID 16, localhost, executor driver, partition 0, PROCESS_LOCAL, 4827 bytes)
Mar 30, 2018 11:04:51 AM org.apache.spark.internal.Logging$class logInfo
INFO: Starting task 1.0 in stage 3.0 (TID 17, localhost, executor driver, partition 1, PROCESS_LOCAL, 4827 bytes)
Mar 30, 2018 11:04:51 AM org.apache.spark.internal.Logging$class logInfo
INFO: Starting task 2.0 in stage 3.0 (TID 18, localhost, executor driver, partition 2, PROCESS_LOCAL, 4827 bytes)
Mar 30, 2018 11:04:51 AM org.apache.spark.internal.Logging$class logInfo
INFO: Starting task 3.0 in stage 3.0 (TID 19, localhost, executor driver, partition 3, PROCESS_LOCAL, 4837 bytes)
Mar 30, 2018 11:04:51 AM org.apache.spark.internal.Logging$class logInfo
INFO: Running task 1.0 in stage 3.0 (TID 17)
Mar 30, 2018 11:04:51 AM org.apache.spark.internal.Logging$class logInfo
INFO: Running task 0.0 in stage 3.0 (TID 16)
Mar 30, 2018 11:04:51 AM org.apache.spark.internal.Logging$class logInfo
INFO: Running task 3.0 in stage 3.0 (TID 19)
Mar 30, 2018 11:04:51 AM org.apache.spark.internal.Logging$class logInfo
INFO: Running task 2.0 in stage 3.0 (TID 18)
Mar 30, 2018 11:04:51 AM org.apache.spark.internal.Logging$class logInfo
INFO: Finished task 1.0 in stage 3.0 (TID 17). 12184 bytes result sent to driver
Mar 30, 2018 11:04:51 AM org.apache.spark.internal.Logging$class logInfo
INFO: Finished task 0.0 in stage 3.0 (TID 16). 12141 bytes result sent to driver
Mar 30, 2018 11:04:51 AM org.apache.spark.internal.Logging$class logInfo
INFO: Finished task 1.0 in stage 3.0 (TID 17) in 72 ms on localhost (executor driver) (1/4)
Mar 30, 2018 11:04:51 AM org.apache.spark.internal.Logging$class logInfo
INFO: Finished task 0.0 in stage 3.0 (TID 16) in 79 ms on localhost (executor driver) (2/4)
Mar 30, 2018 11:04:51 AM org.apache.spark.internal.Logging$class logInfo
INFO: Finished task 2.0 in stage 3.0 (TID 18). 12141 bytes result sent to driver
Mar 30, 2018 11:04:51 AM org.apache.spark.internal.Logging$class logInfo
INFO: Finished task 2.0 in stage 3.0 (TID 18) in 77 ms on localhost (executor driver) (3/4)
Mar 30, 2018 11:04:51 AM org.apache.beam.sdk.io.WriteFiles$FinalizeTempFileBundles$FinalizeFn process
INFO: Finalizing 4 file results
Mar 30, 2018 11:04:51 AM org.apache.beam.sdk.io.FileBasedSink$WriteOperation createMissingEmptyShards
INFO: Finalizing for destination null num shards 4.
Mar 30, 2018 11:04:51 AM org.apache.beam.sdk.io.FileBasedSink$WriteOperation moveToOutputFiles
INFO: Will copy temporary file FileResult{tempFilename=/tmp/groovy-generated-2823552157073012210-tmpdir/word-count-beam/.temp-beam-2018-03-30_11-04-43-0/503d39b2-5ff8-4c85-955d-d5aa6d609401, shard=0, window=org.apache.beam.sdk.transforms.windowing.GlobalWindow@89137d7, paneInfo=PaneInfo.NO_FIRING} to final location /tmp/groovy-generated-2823552157073012210-tmpdir/word-count-beam/counts-00000-of-00004
Mar 30, 2018 11:04:51 AM org.apache.beam.sdk.io.FileBasedSink$WriteOperation moveToOutputFiles
INFO: Will copy temporary file FileResult{tempFilename=/tmp/groovy-generated-2823552157073012210-tmpdir/word-count-beam/.temp-beam-2018-03-30_11-04-43-0/36d5bec0-a255-4790-9cc1-aa1b3fd9e6a3, shard=1, window=org.apache.beam.sdk.transforms.windowing.GlobalWindow@89137d7, paneInfo=PaneInfo.NO_FIRING} to final location /tmp/groovy-generated-2823552157073012210-tmpdir/word-count-beam/counts-00001-of-00004
Mar 30, 2018 11:04:51 AM org.apache.beam.sdk.io.FileBasedSink$WriteOperation moveToOutputFiles
INFO: Will copy temporary file FileResult{tempFilename=/tmp/groovy-generated-2823552157073012210-tmpdir/word-count-beam/.temp-beam-2018-03-30_11-04-43-0/56aa1ef2-c5de-43d7-91ec-14ef0b78b727, shard=2, window=org.apache.beam.sdk.transforms.windowing.GlobalWindow@89137d7, paneInfo=PaneInfo.NO_FIRING} to final location /tmp/groovy-generated-2823552157073012210-tmpdir/word-count-beam/counts-00002-of-00004
Mar 30, 2018 11:04:51 AM org.apache.beam.sdk.io.FileBasedSink$WriteOperation moveToOutputFiles
INFO: Will copy temporary file FileResult{tempFilename=/tmp/groovy-generated-2823552157073012210-tmpdir/word-count-beam/.temp-beam-2018-03-30_11-04-43-0/3d737ad8-e965-47ba-a9ab-dcb259d3fe9b, shard=3, window=org.apache.beam.sdk.transforms.windowing.GlobalWindow@89137d7, paneInfo=PaneInfo.NO_FIRING} to final location /tmp/groovy-generated-2823552157073012210-tmpdir/word-count-beam/counts-00003-of-00004
Mar 30, 2018 11:04:51 AM org.apache.beam.sdk.io.FileBasedSink$WriteOperation removeTemporaryFiles
INFO: Will remove known temporary file /tmp/groovy-generated-2823552157073012210-tmpdir/word-count-beam/.temp-beam-2018-03-30_11-04-43-0/56aa1ef2-c5de-43d7-91ec-14ef0b78b727
Mar 30, 2018 11:04:51 AM org.apache.beam.sdk.io.FileBasedSink$WriteOperation removeTemporaryFiles
INFO: Will remove known temporary file /tmp/groovy-generated-2823552157073012210-tmpdir/word-count-beam/.temp-beam-2018-03-30_11-04-43-0/503d39b2-5ff8-4c85-955d-d5aa6d609401
Mar 30, 2018 11:04:51 AM org.apache.beam.sdk.io.FileBasedSink$WriteOperation removeTemporaryFiles
INFO: Will remove known temporary file /tmp/groovy-generated-2823552157073012210-tmpdir/word-count-beam/.temp-beam-2018-03-30_11-04-43-0/3d737ad8-e965-47ba-a9ab-dcb259d3fe9b
Mar 30, 2018 11:04:51 AM org.apache.beam.sdk.io.FileBasedSink$WriteOperation removeTemporaryFiles
INFO: Will remove known temporary file /tmp/groovy-generated-2823552157073012210-tmpdir/word-count-beam/.temp-beam-2018-03-30_11-04-43-0/36d5bec0-a255-4790-9cc1-aa1b3fd9e6a3
Mar 30, 2018 11:04:51 AM org.apache.spark.internal.Logging$class logInfo
INFO: Finished task 3.0 in stage 3.0 (TID 19). 15889 bytes result sent to driver
Mar 30, 2018 11:04:51 AM org.apache.spark.internal.Logging$class logInfo
INFO: Finished task 3.0 in stage 3.0 (TID 19) in 125 ms on localhost (executor driver) (4/4)
Mar 30, 2018 11:04:51 AM org.apache.spark.internal.Logging$class logInfo
INFO: Removed TaskSet 3.0, whose tasks have all completed, from pool
Mar 30, 2018 11:04:51 AM org.apache.spark.internal.Logging$class logInfo
INFO: ResultStage 3 (foreach at BoundedDataset.java:117) finished in 0.132 s
Mar 30, 2018 11:04:51 AM org.apache.spark.internal.Logging$class logInfo
INFO: Job 1 finished: foreach at BoundedDataset.java:117, took 0.161148 s
Mar 30, 2018 11:04:51 AM org.apache.beam.runners.spark.SparkRunner lambda$run$1
INFO: Batch pipeline execution complete.
Mar 30, 2018 11:04:51 AM org.spark_project.jetty.server.AbstractConnector doStop
INFO: Stopped Spark@a2118be{HTTP/1.1,[http/1.1]}{127.0.0.1:4040}
Mar 30, 2018 11:04:51 AM org.apache.spark.internal.Logging$class logInfo
INFO: Stopped Spark web UI at http://127.0.0.1:4040
Mar 30, 2018 11:04:51 AM org.apache.spark.internal.Logging$class logInfo
INFO: MapOutputTrackerMasterEndpoint stopped!
Mar 30, 2018 11:04:51 AM org.apache.spark.internal.Logging$class logInfo
INFO: MemoryStore cleared
Mar 30, 2018 11:04:51 AM org.apache.spark.internal.Logging$class logInfo
INFO: BlockManager stopped
Mar 30, 2018 11:04:51 AM org.apache.spark.internal.Logging$class logInfo
INFO: BlockManagerMaster stopped
Mar 30, 2018 11:04:51 AM org.apache.spark.internal.Logging$class logInfo
INFO: OutputCommitCoordinator stopped!
Mar 30, 2018 11:04:51 AM org.apache.spark.internal.Logging$class logInfo
INFO: Successfully stopped SparkContext
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 01:48 min
[INFO] Finished at: 2018-03-30T11:04:51Z
[INFO] Final Memory: 90M/806M
[INFO] ------------------------------------------------------------------------
grep Foundation counts*
counts-00000-of-00004:Foundation: 1
Verified Foundation: 1
[SUCCESS]
Mar 30, 2018 12:07:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2018-03-30T12:07:13.005Z: Workflow failed. Causes: The Dataflow appears to be stuck. You can get help with Cloud Dataflow at https://cloud.google.com/dataflow/support.
Mar 30, 2018 12:07:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-03-30T12:07:13.128Z: Cancel request is committed for workflow job: 2018-03-30_04_02_42-8928514858622684642.
Mar 30, 2018 12:07:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-03-30T12:07:13.242Z: Cleaning up.
Mar 30, 2018 12:07:13 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-03-30T12:07:13.288Z: Stopping worker pool...
Mar 30, 2018 12:08:38 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-03-30T12:08:36.315Z: Autoscaling: Reduced the number of workers to 0 based on the rate of progress in the currently running step(s).
Mar 30, 2018 12:08:46 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-03-30_04_02_42-8928514858622684642 failed with status FAILED.
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 01:07 h
[INFO] Finished at: 2018-03-30T12:08:46Z
[INFO] Final Memory: 38M/534M
[INFO] ------------------------------------------------------------------------
gsutil cat gs://temp-storage-for-release-validation-tests/quickstart/count* | grep Montague:
CommandException: No URLs matched: gs://temp-storage-for-release-validation-tests/quickstart/count*
CommandException: No URLs matched: gs://temp-storage-for-release-validation-tests/quickstart/count*
[ERROR] Failed command
:runners:google-cloud-dataflow-java:runQuickstartJavaDataflow FAILED
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:runQuickstartJavaDataflow'.
> Process 'command '/usr/local/asfpackages/java/jdk1.8.0_152/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1h 8m 35s
6 actionable tasks: 6 executed
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Not sending mail to unregistered user rober@frantil.com
Not sending mail to unregistered user dawid@getindata.com
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user ccy@google.com
Not sending mail to unregistered user mairbek@google.com
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user aromanenko.dev@gmail.com
Not sending mail to unregistered user github@alasdairhodge.co.uk
Build failed in Jenkins: beam_PostRelease_NightlySnapshot #167
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostRelease_NightlySnapshot/167/display/redirect?page=changes>
Changes:
[mairbek] [BEAM-3932] Adds handling of array null values to MutationSizeEstimator
[lcwik] [BEAM-3326] Abstract away closing the inbound receiver, waiting for the
[aromanenko.dev] [BEAM-3819] Add withRequestRecordsLimit() option to KinesisIO
[altay] [BEAM-3738] Add more flake8 tests to run_pylint.sh
[lcwik] [BEAM-3326] Address additional comments from PR/4963.
[lcwik] [BEAM-3104] Set up state interfaces, wire into SDK harness client.
------------------------------------------
[...truncated 2.76 MB...]
Mar 29, 2018 11:04:50 AM org.apache.spark.internal.Logging$class logInfo
INFO: Finished task 1.0 in stage 2.0 (TID 9) in 53 ms on localhost (executor driver) (1/8)
Mar 29, 2018 11:04:50 AM org.apache.spark.internal.Logging$class logInfo
INFO: Finished task 3.0 in stage 2.0 (TID 11) in 55 ms on localhost (executor driver) (2/8)
Mar 29, 2018 11:04:50 AM org.apache.spark.internal.Logging$class logInfo
INFO: Finished task 0.0 in stage 2.0 (TID 8) in 63 ms on localhost (executor driver) (3/8)
Mar 29, 2018 11:04:50 AM org.apache.spark.internal.Logging$class logInfo
INFO: Running task 5.0 in stage 2.0 (TID 13)
Mar 29, 2018 11:04:50 AM org.apache.spark.internal.Logging$class logInfo
INFO: Finished task 2.0 in stage 2.0 (TID 10). 13240 bytes result sent to driver
Mar 29, 2018 11:04:50 AM org.apache.spark.internal.Logging$class logInfo
INFO: Starting task 7.0 in stage 2.0 (TID 15, localhost, executor driver, partition 7, PROCESS_LOCAL, 4730 bytes)
Mar 29, 2018 11:04:50 AM org.apache.spark.internal.Logging$class logInfo
INFO: Running task 7.0 in stage 2.0 (TID 15)
Mar 29, 2018 11:04:50 AM org.apache.spark.internal.Logging$class logInfo
INFO: Finished task 2.0 in stage 2.0 (TID 10) in 66 ms on localhost (executor driver) (4/8)
Mar 29, 2018 11:04:50 AM org.apache.spark.internal.Logging$class logInfo
INFO: Running task 4.0 in stage 2.0 (TID 12)
Mar 29, 2018 11:04:50 AM org.apache.spark.internal.Logging$class logInfo
INFO: Getting 0 non-empty blocks out of 4 blocks
Mar 29, 2018 11:04:50 AM org.apache.spark.internal.Logging$class logInfo
INFO: Started 0 remote fetches in 1 ms
Mar 29, 2018 11:04:50 AM org.apache.spark.internal.Logging$class logInfo
INFO: Getting 0 non-empty blocks out of 4 blocks
Mar 29, 2018 11:04:50 AM org.apache.spark.internal.Logging$class logInfo
INFO: Started 0 remote fetches in 0 ms
Mar 29, 2018 11:04:50 AM org.apache.spark.internal.Logging$class logInfo
INFO: Getting 0 non-empty blocks out of 4 blocks
Mar 29, 2018 11:04:50 AM org.apache.spark.internal.Logging$class logInfo
INFO: Started 0 remote fetches in 0 ms
Mar 29, 2018 11:04:50 AM org.apache.spark.internal.Logging$class logInfo
INFO: Getting 0 non-empty blocks out of 4 blocks
Mar 29, 2018 11:04:50 AM org.apache.spark.internal.Logging$class logInfo
INFO: Started 0 remote fetches in 6 ms
Mar 29, 2018 11:04:50 AM org.apache.spark.internal.Logging$class logInfo
INFO: Block rdd_41_4 stored as values in memory (estimated size 16.0 B, free 1825.1 MB)
Mar 29, 2018 11:04:50 AM org.apache.spark.internal.Logging$class logInfo
INFO: Added rdd_41_4 in memory on 127.0.0.1:37833 (size: 16.0 B, free: 1825.4 MB)
Mar 29, 2018 11:04:50 AM org.apache.spark.internal.Logging$class logInfo
INFO: Block rdd_41_6 stored as values in memory (estimated size 16.0 B, free 1825.1 MB)
Mar 29, 2018 11:04:50 AM org.apache.spark.internal.Logging$class logInfo
INFO: Added rdd_41_6 in memory on 127.0.0.1:37833 (size: 16.0 B, free: 1825.4 MB)
Mar 29, 2018 11:04:50 AM org.apache.spark.internal.Logging$class logInfo
INFO: Finished task 4.0 in stage 2.0 (TID 12). 11942 bytes result sent to driver
Mar 29, 2018 11:04:50 AM org.apache.spark.internal.Logging$class logInfo
INFO: Finished task 6.0 in stage 2.0 (TID 14). 11942 bytes result sent to driver
Mar 29, 2018 11:04:50 AM org.apache.spark.internal.Logging$class logInfo
INFO: Block rdd_41_7 stored as values in memory (estimated size 16.0 B, free 1825.1 MB)
Mar 29, 2018 11:04:50 AM org.apache.spark.internal.Logging$class logInfo
INFO: Finished task 4.0 in stage 2.0 (TID 12) in 79 ms on localhost (executor driver) (5/8)
Mar 29, 2018 11:04:50 AM org.apache.spark.internal.Logging$class logInfo
INFO: Added rdd_41_7 in memory on 127.0.0.1:37833 (size: 16.0 B, free: 1825.4 MB)
Mar 29, 2018 11:04:50 AM org.apache.spark.internal.Logging$class logInfo
INFO: Finished task 6.0 in stage 2.0 (TID 14) in 82 ms on localhost (executor driver) (6/8)
Mar 29, 2018 11:04:50 AM org.apache.spark.internal.Logging$class logInfo
INFO: Block rdd_41_5 stored as values in memory (estimated size 16.0 B, free 1825.1 MB)
Mar 29, 2018 11:04:50 AM org.apache.spark.internal.Logging$class logInfo
INFO: Finished task 7.0 in stage 2.0 (TID 15). 11985 bytes result sent to driver
Mar 29, 2018 11:04:50 AM org.apache.spark.internal.Logging$class logInfo
INFO: Added rdd_41_5 in memory on 127.0.0.1:37833 (size: 16.0 B, free: 1825.4 MB)
Mar 29, 2018 11:04:50 AM org.apache.spark.internal.Logging$class logInfo
INFO: Finished task 7.0 in stage 2.0 (TID 15) in 78 ms on localhost (executor driver) (7/8)
Mar 29, 2018 11:04:50 AM org.apache.spark.internal.Logging$class logInfo
INFO: Finished task 5.0 in stage 2.0 (TID 13). 11942 bytes result sent to driver
Mar 29, 2018 11:04:50 AM org.apache.spark.internal.Logging$class logInfo
INFO: Finished task 5.0 in stage 2.0 (TID 13) in 100 ms on localhost (executor driver) (8/8)
Mar 29, 2018 11:04:50 AM org.apache.spark.internal.Logging$class logInfo
INFO: Removed TaskSet 2.0, whose tasks have all completed, from pool
Mar 29, 2018 11:04:50 AM org.apache.spark.internal.Logging$class logInfo
INFO: ResultStage 2 (collect at BoundedDataset.java:87) finished in 0.156 s
Mar 29, 2018 11:04:50 AM org.apache.spark.internal.Logging$class logInfo
INFO: Job 0 finished: collect at BoundedDataset.java:87, took 5.442581 s
Mar 29, 2018 11:04:50 AM org.apache.beam.runners.spark.SparkRunner$Evaluator enterCompositeTransform
INFO: Entering directly-translatable composite transform: 'WriteCounts/WriteFiles/GatherTempFileResults/Reify.ReifyViewInGlobalWindow/Create.Values'
Mar 29, 2018 11:04:50 AM org.apache.beam.runners.spark.SparkRunner$Evaluator doVisitTransform
INFO: Evaluating Create.Values
Mar 29, 2018 11:04:50 AM org.apache.beam.runners.spark.SparkRunner$Evaluator doVisitTransform
INFO: Evaluating org.apache.beam.sdk.transforms.Reify$ReifyView$1@6a53b247
Mar 29, 2018 11:04:50 AM org.apache.spark.internal.Logging$class logInfo
INFO: Block broadcast_3 stored as values in memory (estimated size 672.0 B, free 1825.1 MB)
Mar 29, 2018 11:04:50 AM org.apache.spark.internal.Logging$class logInfo
INFO: Block broadcast_3_piece0 stored as bytes in memory (estimated size 363.0 B, free 1825.1 MB)
Mar 29, 2018 11:04:50 AM org.apache.spark.internal.Logging$class logInfo
INFO: Added broadcast_3_piece0 in memory on 127.0.0.1:37833 (size: 363.0 B, free: 1825.4 MB)
Mar 29, 2018 11:04:50 AM org.apache.spark.internal.Logging$class logInfo
INFO: Created broadcast 3 from broadcast at SideInputBroadcast.java:59
Mar 29, 2018 11:04:50 AM org.apache.beam.runners.spark.SparkRunner$Evaluator doVisitTransform
INFO: Evaluating org.apache.beam.sdk.transforms.MapElements$1@365cc925
Mar 29, 2018 11:04:50 AM org.apache.beam.runners.spark.SparkRunner$Evaluator doVisitTransform
INFO: Evaluating org.apache.beam.sdk.io.WriteFiles$FinalizeTempFileBundles$FinalizeFn@79b10126
Mar 29, 2018 11:04:50 AM org.apache.spark.internal.Logging$class logInfo
INFO: Starting job: foreach at BoundedDataset.java:117
Mar 29, 2018 11:04:50 AM org.apache.spark.internal.Logging$class logInfo
INFO: Got job 1 (foreach at BoundedDataset.java:117) with 4 output partitions
Mar 29, 2018 11:04:50 AM org.apache.spark.internal.Logging$class logInfo
INFO: Final stage: ResultStage 3 (foreach at BoundedDataset.java:117)
Mar 29, 2018 11:04:50 AM org.apache.spark.internal.Logging$class logInfo
INFO: Parents of final stage: List()
Mar 29, 2018 11:04:50 AM org.apache.spark.internal.Logging$class logInfo
INFO: Missing parents: List()
Mar 29, 2018 11:04:50 AM org.apache.spark.internal.Logging$class logInfo
INFO: Submitting ResultStage 3 (WriteCounts/WriteFiles/FinalizeTempFileBundles/Finalize/ParMultiDo(Finalize).output MapPartitionsRDD[53] at values at TransformTranslator.java:400), which has no missing parents
Mar 29, 2018 11:04:50 AM org.apache.spark.internal.Logging$class logInfo
INFO: Block broadcast_4 stored as values in memory (estimated size 83.9 KB, free 1825.0 MB)
Mar 29, 2018 11:04:50 AM org.apache.spark.internal.Logging$class logInfo
INFO: Block broadcast_4_piece0 stored as bytes in memory (estimated size 22.3 KB, free 1825.0 MB)
Mar 29, 2018 11:04:50 AM org.apache.spark.internal.Logging$class logInfo
INFO: Added broadcast_4_piece0 in memory on 127.0.0.1:37833 (size: 22.3 KB, free: 1825.3 MB)
Mar 29, 2018 11:04:50 AM org.apache.spark.internal.Logging$class logInfo
INFO: Created broadcast 4 from broadcast at DAGScheduler.scala:1006
Mar 29, 2018 11:04:50 AM org.apache.spark.internal.Logging$class logInfo
INFO: Submitting 4 missing tasks from ResultStage 3 (WriteCounts/WriteFiles/FinalizeTempFileBundles/Finalize/ParMultiDo(Finalize).output MapPartitionsRDD[53] at values at TransformTranslator.java:400) (first 15 tasks are for partitions Vector(0, 1, 2, 3))
Mar 29, 2018 11:04:50 AM org.apache.spark.internal.Logging$class logInfo
INFO: Adding task set 3.0 with 4 tasks
Mar 29, 2018 11:04:50 AM org.apache.spark.internal.Logging$class logInfo
INFO: Starting task 0.0 in stage 3.0 (TID 16, localhost, executor driver, partition 0, PROCESS_LOCAL, 4827 bytes)
Mar 29, 2018 11:04:50 AM org.apache.spark.internal.Logging$class logInfo
INFO: Starting task 1.0 in stage 3.0 (TID 17, localhost, executor driver, partition 1, PROCESS_LOCAL, 4827 bytes)
Mar 29, 2018 11:04:50 AM org.apache.spark.internal.Logging$class logInfo
INFO: Starting task 2.0 in stage 3.0 (TID 18, localhost, executor driver, partition 2, PROCESS_LOCAL, 4827 bytes)
Mar 29, 2018 11:04:50 AM org.apache.spark.internal.Logging$class logInfo
INFO: Starting task 3.0 in stage 3.0 (TID 19, localhost, executor driver, partition 3, PROCESS_LOCAL, 4837 bytes)
Mar 29, 2018 11:04:50 AM org.apache.spark.internal.Logging$class logInfo
INFO: Running task 0.0 in stage 3.0 (TID 16)
Mar 29, 2018 11:04:50 AM org.apache.spark.internal.Logging$class logInfo
INFO: Running task 1.0 in stage 3.0 (TID 17)
Mar 29, 2018 11:04:50 AM org.apache.spark.internal.Logging$class logInfo
INFO: Running task 2.0 in stage 3.0 (TID 18)
Mar 29, 2018 11:04:50 AM org.apache.spark.internal.Logging$class logInfo
INFO: Running task 3.0 in stage 3.0 (TID 19)
Mar 29, 2018 11:04:50 AM org.apache.spark.internal.Logging$class logInfo
INFO: Finished task 0.0 in stage 3.0 (TID 16). 12184 bytes result sent to driver
Mar 29, 2018 11:04:50 AM org.apache.spark.internal.Logging$class logInfo
INFO: Finished task 0.0 in stage 3.0 (TID 16) in 63 ms on localhost (executor driver) (1/4)
Mar 29, 2018 11:04:50 AM org.apache.spark.internal.Logging$class logInfo
INFO: Finished task 2.0 in stage 3.0 (TID 18). 12184 bytes result sent to driver
Mar 29, 2018 11:04:50 AM org.apache.spark.internal.Logging$class logInfo
INFO: Finished task 1.0 in stage 3.0 (TID 17). 12184 bytes result sent to driver
Mar 29, 2018 11:04:50 AM org.apache.spark.internal.Logging$class logInfo
INFO: Finished task 2.0 in stage 3.0 (TID 18) in 66 ms on localhost (executor driver) (2/4)
Mar 29, 2018 11:04:50 AM org.apache.spark.internal.Logging$class logInfo
INFO: Finished task 1.0 in stage 3.0 (TID 17) in 67 ms on localhost (executor driver) (3/4)
Mar 29, 2018 11:04:50 AM org.apache.beam.sdk.io.WriteFiles$FinalizeTempFileBundles$FinalizeFn process
INFO: Finalizing 4 file results
Mar 29, 2018 11:04:50 AM org.apache.beam.sdk.io.FileBasedSink$WriteOperation createMissingEmptyShards
INFO: Finalizing for destination null num shards 4.
Mar 29, 2018 11:04:50 AM org.apache.beam.sdk.io.FileBasedSink$WriteOperation moveToOutputFiles
INFO: Will copy temporary file FileResult{tempFilename=/tmp/groovy-generated-6392609454069710736-tmpdir/word-count-beam/.temp-beam-2018-03-29_11-04-41-0/9418c1e0-6640-4832-b292-6b205269feea, shard=0, window=org.apache.beam.sdk.transforms.windowing.GlobalWindow@4fb7a209, paneInfo=PaneInfo.NO_FIRING} to final location /tmp/groovy-generated-6392609454069710736-tmpdir/word-count-beam/counts-00000-of-00004
Mar 29, 2018 11:04:50 AM org.apache.beam.sdk.io.FileBasedSink$WriteOperation moveToOutputFiles
INFO: Will copy temporary file FileResult{tempFilename=/tmp/groovy-generated-6392609454069710736-tmpdir/word-count-beam/.temp-beam-2018-03-29_11-04-41-0/a78b7b30-dee9-46b0-9849-da342cd6d62f, shard=1, window=org.apache.beam.sdk.transforms.windowing.GlobalWindow@4fb7a209, paneInfo=PaneInfo.NO_FIRING} to final location /tmp/groovy-generated-6392609454069710736-tmpdir/word-count-beam/counts-00001-of-00004
Mar 29, 2018 11:04:50 AM org.apache.beam.sdk.io.FileBasedSink$WriteOperation moveToOutputFiles
INFO: Will copy temporary file FileResult{tempFilename=/tmp/groovy-generated-6392609454069710736-tmpdir/word-count-beam/.temp-beam-2018-03-29_11-04-41-0/308ce35f-ee2e-4c1e-bc12-3de3af1a5ae5, shard=2, window=org.apache.beam.sdk.transforms.windowing.GlobalWindow@4fb7a209, paneInfo=PaneInfo.NO_FIRING} to final location /tmp/groovy-generated-6392609454069710736-tmpdir/word-count-beam/counts-00002-of-00004
Mar 29, 2018 11:04:50 AM org.apache.beam.sdk.io.FileBasedSink$WriteOperation moveToOutputFiles
INFO: Will copy temporary file FileResult{tempFilename=/tmp/groovy-generated-6392609454069710736-tmpdir/word-count-beam/.temp-beam-2018-03-29_11-04-41-0/7e16f2fd-6b15-4ddf-83a1-3d7944de9d34, shard=3, window=org.apache.beam.sdk.transforms.windowing.GlobalWindow@4fb7a209, paneInfo=PaneInfo.NO_FIRING} to final location /tmp/groovy-generated-6392609454069710736-tmpdir/word-count-beam/counts-00003-of-00004
Mar 29, 2018 11:04:50 AM org.apache.beam.sdk.io.FileBasedSink$WriteOperation removeTemporaryFiles
INFO: Will remove known temporary file /tmp/groovy-generated-6392609454069710736-tmpdir/word-count-beam/.temp-beam-2018-03-29_11-04-41-0/a78b7b30-dee9-46b0-9849-da342cd6d62f
Mar 29, 2018 11:04:50 AM org.apache.beam.sdk.io.FileBasedSink$WriteOperation removeTemporaryFiles
INFO: Will remove known temporary file /tmp/groovy-generated-6392609454069710736-tmpdir/word-count-beam/.temp-beam-2018-03-29_11-04-41-0/308ce35f-ee2e-4c1e-bc12-3de3af1a5ae5
Mar 29, 2018 11:04:50 AM org.apache.beam.sdk.io.FileBasedSink$WriteOperation removeTemporaryFiles
INFO: Will remove known temporary file /tmp/groovy-generated-6392609454069710736-tmpdir/word-count-beam/.temp-beam-2018-03-29_11-04-41-0/7e16f2fd-6b15-4ddf-83a1-3d7944de9d34
Mar 29, 2018 11:04:50 AM org.apache.beam.sdk.io.FileBasedSink$WriteOperation removeTemporaryFiles
INFO: Will remove known temporary file /tmp/groovy-generated-6392609454069710736-tmpdir/word-count-beam/.temp-beam-2018-03-29_11-04-41-0/9418c1e0-6640-4832-b292-6b205269feea
Mar 29, 2018 11:04:50 AM org.apache.spark.internal.Logging$class logInfo
INFO: Finished task 3.0 in stage 3.0 (TID 19). 15889 bytes result sent to driver
Mar 29, 2018 11:04:50 AM org.apache.spark.internal.Logging$class logInfo
INFO: Finished task 3.0 in stage 3.0 (TID 19) in 121 ms on localhost (executor driver) (4/4)
Mar 29, 2018 11:04:50 AM org.apache.spark.internal.Logging$class logInfo
INFO: Removed TaskSet 3.0, whose tasks have all completed, from pool
Mar 29, 2018 11:04:50 AM org.apache.spark.internal.Logging$class logInfo
INFO: ResultStage 3 (foreach at BoundedDataset.java:117) finished in 0.127 s
Mar 29, 2018 11:04:50 AM org.apache.spark.internal.Logging$class logInfo
INFO: Job 1 finished: foreach at BoundedDataset.java:117, took 0.156819 s
Mar 29, 2018 11:04:50 AM org.apache.beam.runners.spark.SparkRunner lambda$run$1
INFO: Batch pipeline execution complete.
Mar 29, 2018 11:04:50 AM org.spark_project.jetty.server.AbstractConnector doStop
INFO: Stopped Spark@59c44ba6{HTTP/1.1,[http/1.1]}{127.0.0.1:4040}
Mar 29, 2018 11:04:50 AM org.apache.spark.internal.Logging$class logInfo
INFO: Stopped Spark web UI at http://127.0.0.1:4040
Mar 29, 2018 11:04:50 AM org.apache.spark.internal.Logging$class logInfo
INFO: MapOutputTrackerMasterEndpoint stopped!
Mar 29, 2018 11:04:50 AM org.apache.spark.internal.Logging$class logInfo
INFO: MemoryStore cleared
Mar 29, 2018 11:04:50 AM org.apache.spark.internal.Logging$class logInfo
INFO: BlockManager stopped
Mar 29, 2018 11:04:50 AM org.apache.spark.internal.Logging$class logInfo
INFO: BlockManagerMaster stopped
Mar 29, 2018 11:04:50 AM org.apache.spark.internal.Logging$class logInfo
INFO: OutputCommitCoordinator stopped!
Mar 29, 2018 11:04:50 AM org.apache.spark.internal.Logging$class logInfo
INFO: Successfully stopped SparkContext
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 01:54 min
[INFO] Finished at: 2018-03-29T11:04:50Z
[INFO] Final Memory: 98M/1384M
[INFO] ------------------------------------------------------------------------
grep Foundation counts*
counts-00000-of-00004:Foundation: 1
Verified Foundation: 1
[SUCCESS]
Mar 29, 2018 12:07:22 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2018-03-29T12:07:22.014Z: Workflow failed. Causes: The Dataflow appears to be stuck. You can get help with Cloud Dataflow at https://cloud.google.com/dataflow/support.
Mar 29, 2018 12:07:22 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-03-29T12:07:22.121Z: Cancel request is committed for workflow job: 2018-03-29_04_02_45-10177233672216086838.
Mar 29, 2018 12:07:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-03-29T12:07:22.242Z: Cleaning up.
Mar 29, 2018 12:07:23 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-03-29T12:07:22.382Z: Stopping worker pool...
Mar 29, 2018 12:08:49 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-03-29T12:08:47.646Z: Autoscaling: Reduced the number of workers to 0 based on the rate of progress in the currently running step(s).
Mar 29, 2018 12:08:56 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-03-29_04_02_45-10177233672216086838 failed with status FAILED.
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 01:07 h
[INFO] Finished at: 2018-03-29T12:08:56Z
[INFO] Final Memory: 40M/576M
[INFO] ------------------------------------------------------------------------
gsutil cat gs://temp-storage-for-release-validation-tests/quickstart/count* | grep Montague:
CommandException: No URLs matched: gs://temp-storage-for-release-validation-tests/quickstart/count*
CommandException: No URLs matched: gs://temp-storage-for-release-validation-tests/quickstart/count*
[ERROR] Failed command
:runners:google-cloud-dataflow-java:runQuickstartJavaDataflow FAILED
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:runQuickstartJavaDataflow'.
> Process 'command '/usr/local/asfpackages/java/jdk1.8.0_152/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1h 8m 48s
6 actionable tasks: 6 executed
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user ccy@google.com
Not sending mail to unregistered user mairbek@google.com
Not sending mail to unregistered user dawid@getindata.com
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user rober@frantil.com
Not sending mail to unregistered user aromanenko.dev@gmail.com
Build failed in Jenkins: beam_PostRelease_NightlySnapshot #166
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostRelease_NightlySnapshot/166/display/redirect?page=changes>
Changes:
[yifanzou] return stdout text from command execution and stop using var.last_text
------------------------------------------
[...truncated 34.04 MB...]
Waiting on bqjob_r5614f1babc3e5e32_000001626ff8fa89_1 ... (34s) Current status: PENDING
Waiting on bqjob_r5614f1babc3e5e32_000001626ff8fa89_1 ... (35s) Current status: PENDING
Waiting on bqjob_r5614f1babc3e5e32_000001626ff8fa89_1 ... (36s) Current status: PENDING
Waiting on bqjob_r5614f1babc3e5e32_000001626ff8fa89_1 ... (37s) Current status: PENDING
Waiting on bqjob_r5614f1babc3e5e32_000001626ff8fa89_1 ... (38s) Current status: PENDING
Waiting on bqjob_r5614f1babc3e5e32_000001626ff8fa89_1 ... (39s) Current status: PENDING
Waiting on bqjob_r5614f1babc3e5e32_000001626ff8fa89_1 ... (40s) Current status: PENDING
Waiting on bqjob_r5614f1babc3e5e32_000001626ff8fa89_1 ... (41s) Current status: PENDING
Waiting on bqjob_r5614f1babc3e5e32_000001626ff8fa89_1 ... (42s) Current status: PENDING
Waiting on bqjob_r5614f1babc3e5e32_000001626ff8fa89_1 ... (43s) Current status: PENDING
Waiting on bqjob_r5614f1babc3e5e32_000001626ff8fa89_1 ... (44s) Current status: PENDING
Waiting on bqjob_r5614f1babc3e5e32_000001626ff8fa89_1 ... (45s) Current status: PENDING
Waiting on bqjob_r5614f1babc3e5e32_000001626ff8fa89_1 ... (46s) Current status: PENDING
Waiting on bqjob_r5614f1babc3e5e32_000001626ff8fa89_1 ... (47s) Current status: PENDING
Waiting on bqjob_r5614f1babc3e5e32_000001626ff8fa89_1 ... (48s) Current status: PENDING
Waiting on bqjob_r5614f1babc3e5e32_000001626ff8fa89_1 ... (49s) Current status: PENDING
Waiting on bqjob_r5614f1babc3e5e32_000001626ff8fa89_1 ... (50s) Current status: PENDING
Waiting on bqjob_r5614f1babc3e5e32_000001626ff8fa89_1 ... (51s) Current status: PENDING
Waiting on bqjob_r5614f1babc3e5e32_000001626ff8fa89_1 ... (52s) Current status: PENDING
Waiting on bqjob_r5614f1babc3e5e32_000001626ff8fa89_1 ... (53s) Current status: PENDING
Waiting on bqjob_r5614f1babc3e5e32_000001626ff8fa89_1 ... (54s) Current status: PENDING
Waiting on bqjob_r5614f1babc3e5e32_000001626ff8fa89_1 ... (55s) Current status: PENDING
Waiting on bqjob_r5614f1babc3e5e32_000001626ff8fa89_1 ... (56s) Current status: PENDING
Waiting on bqjob_r5614f1babc3e5e32_000001626ff8fa89_1 ... (57s) Current status: PENDING
.......................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................DELAY(465887, 1)
{timestamp_ms=1522296605000}
late data for: user6_FuchsiaWallaby,FuchsiaWallaby,2,1522296605000,2018-03-28 21:17:50.940
Waiting on bqjob_r5614f1babc3e5e32_000001626ff8fa89_1 ... (58s) Current status: PENDING
Waiting on bqjob_r5614f1babc3e5e32_000001626ff8fa89_1 ... (59s) Current status: PENDING
Waiting on bqjob_r5614f1babc3e5e32_000001626ff8fa89_1 ... (60s) Current status: PENDING
Waiting on bqjob_r5614f1babc3e5e32_000001626ff8fa89_1 ... (61s) Current status: PENDING
Waiting on bqjob_r5614f1babc3e5e32_000001626ff8fa89_1 ... (62s) Current status: PENDING
Waiting on bqjob_r5614f1babc3e5e32_000001626ff8fa89_1 ... (63s) Current status: PENDING
Waiting on bqjob_r5614f1babc3e5e32_000001626ff8fa89_1 ... (64s) Current status: PENDING
Waiting on bqjob_r5614f1babc3e5e32_000001626ff8fa89_1 ... (66s) Current status: PENDING
Waiting on bqjob_r5614f1babc3e5e32_000001626ff8fa89_1 ... (67s) Current status: PENDING
Waiting on bqjob_r5614f1babc3e5e32_000001626ff8fa89_1 ... (68s) Current status: PENDING
Waiting on bqjob_r5614f1babc3e5e32_000001626ff8fa89_1 ... (69s) Current status: PENDING
Waiting on bqjob_r5614f1babc3e5e32_000001626ff8fa89_1 ... (70s) Current status: PENDING
Waiting on bqjob_r5614f1babc3e5e32_000001626ff8fa89_1 ... (71s) Current status: PENDING
Waiting on bqjob_r5614f1babc3e5e32_000001626ff8fa89_1 ... (72s) Current status: PENDING
Waiting on bqjob_r5614f1babc3e5e32_000001626ff8fa89_1 ... (73s) Current status: PENDING
Waiting on bqjob_r5614f1babc3e5e32_000001626ff8fa89_1 ... (74s) Current status: PENDING
Waiting on bqjob_r5614f1babc3e5e32_000001626ff8fa89_1 ... (75s) Current status: PENDING
Waiting on bqjob_r5614f1babc3e5e32_000001626ff8fa89_1 ... (76s) Current status: PENDING
Waiting on bqjob_r5614f1babc3e5e32_000001626ff8fa89_1 ... (77s) Current status: PENDING
Waiting on bqjob_r5614f1babc3e5e32_000001626ff8fa89_1 ... (78s) Current status: PENDING
Waiting on bqjob_r5614f1babc3e5e32_000001626ff8fa89_1 ... (79s) Current status: PENDING
Waiting on bqjob_r5614f1babc3e5e32_000001626ff8fa89_1 ... (80s) Current status: PENDING
Waiting on bqjob_r5614f1babc3e5e32_000001626ff8fa89_1 ... (81s) Current status: PENDING
Waiting on bqjob_r5614f1babc3e5e32_000001626ff8fa89_1 ... (82s) Current status: PENDING
Waiting on bqjob_r5614f1babc3e5e32_000001626ff8fa89_1 ... (83s) Current status: PENDING
Waiting on bqjob_r5614f1babc3e5e32_000001626ff8fa89_1 ... (84s) Current status: PENDING
Waiting on bqjob_r5614f1babc3e5e32_000001626ff8fa89_1 ... (85s) Current status: PENDING
Waiting on bqjob_r5614f1babc3e5e32_000001626ff8fa89_1 ... (86s) Current status: PENDING
Waiting on bqjob_r5614f1babc3e5e32_000001626ff8fa89_1 ... (87s) Current status: PENDING
Waiting on bqjob_r5614f1babc3e5e32_000001626ff8fa89_1 ... (88s) Current status: PENDING
Waiting on bqjob_r5614f1babc3e5e32_000001626ff8fa89_1 ... (89s) Current status: PENDING
Waiting on bqjob_r5614f1babc3e5e32_000001626ff8fa89_1 ... (90s) Current status: PENDING
Waiting on bqjob_r5614f1babc3e5e32_000001626ff8fa89_1 ... (91s) Current status: PENDING
Waiting on bqjob_r5614f1babc3e5e32_000001626ff8fa89_1 ... (92s) Current status: PENDING
Waiting on bqjob_r5614f1babc3e5e32_000001626ff8fa89_1 ... (93s) Current status: PENDING
Waiting on bqjob_r5614f1babc3e5e32_000001626ff8fa89_1 ... (94s) Current status: PENDING
Waiting on bqjob_r5614f1babc3e5e32_000001626ff8fa89_1 ... (95s) Current status: PENDING
Waiting on bqjob_r5614f1babc3e5e32_000001626ff8fa89_1 ... (96s) Current status: PENDING
Waiting on bqjob_r5614f1babc3e5e32_000001626ff8fa89_1 ... (97s) Current status: PENDING
Waiting on bqjob_r5614f1babc3e5e32_000001626ff8fa89_1 ... (98s) Current status: PENDING
Waiting on bqjob_r5614f1babc3e5e32_000001626ff8fa89_1 ... (99s) Current status: PENDING
Waiting on bqjob_r5614f1babc3e5e32_000001626ff8fa89_1 ... (100s) Current status: PENDING
Waiting on bqjob_r5614f1babc3e5e32_000001626ff8fa89_1 ... (101s) Current status: PENDING
Waiting on bqjob_r5614f1babc3e5e32_000001626ff8fa89_1 ... (102s) Current status: PENDING
Waiting on bqjob_r5614f1babc3e5e32_000001626ff8fa89_1 ... (103s) Current status: PENDING
Waiting on bqjob_r5614f1babc3e5e32_000001626ff8fa89_1 ... (104s) Current status: PENDING
Waiting on bqjob_r5614f1babc3e5e32_000001626ff8fa89_1 ... (105s) Current status: PENDING
Waiting on bqjob_r5614f1babc3e5e32_000001626ff8fa89_1 ... (106s) Current status: PENDING
Waiting on bqjob_r5614f1babc3e5e32_000001626ff8fa89_1 ... (107s) Current status: PENDING
Waiting on bqjob_r5614f1babc3e5e32_000001626ff8fa89_1 ... (108s) Current status: PENDING
Waiting on bqjob_r5614f1babc3e5e32_000001626ff8fa89_1 ... (109s) Current status: PENDING
Waiting on bqjob_r5614f1babc3e5e32_000001626ff8fa89_1 ... (110s) Current status: PENDING
Waiting on bqjob_r5614f1babc3e5e32_000001626ff8fa89_1 ... (111s) Current status: PENDING
Waiting on bqjob_r5614f1babc3e5e32_000001626ff8fa89_1 ... (112s) Current status: PENDING
Waiting on bqjob_r5614f1babc3e5e32_000001626ff8fa89_1 ... (113s) Current status: PENDING
Waiting on bqjob_r5614f1babc3e5e32_000001626ff8fa89_1 ... (114s) Current status: PENDING
Waiting on bqjob_r5614f1babc3e5e32_000001626ff8fa89_1 ... (115s) Current status: PENDING
Waiting on bqjob_r5614f1babc3e5e32_000001626ff8fa89_1 ... (116s) Current status: PENDING
Waiting on bqjob_r5614f1babc3e5e32_000001626ff8fa89_1 ... (117s) Current status: PENDING
Waiting on bqjob_r5614f1babc3e5e32_000001626ff8fa89_1 ... (118s) Current status: PENDING
Waiting on bqjob_r5614f1babc3e5e32_000001626ff8fa89_1 ... (119s) Current status: PENDING
Waiting on bqjob_r5614f1babc3e5e32_000001626ff8fa89_1 ... (120s) Current status: PENDING
Waiting on bqjob_r5614f1babc3e5e32_000001626ff8fa89_1 ... (121s) Current status: PENDING
Waiting on bqjob_r5614f1babc3e5e32_000001626ff8fa89_1 ... (122s) Current status: PENDING
Waiting on bqjob_r5614f1babc3e5e32_000001626ff8fa89_1 ... (123s) Current status: PENDING
Waiting on bqjob_r5614f1babc3e5e32_000001626ff8fa89_1 ... (124s) Current status: PENDING
Waiting on bqjob_r5614f1babc3e5e32_000001626ff8fa89_1 ... (125s) Current status: PENDING
Waiting on bqjob_r5614f1babc3e5e32_000001626ff8fa89_1 ... (126s) Current status: PENDING
Waiting on bqjob_r5614f1babc3e5e32_000001626ff8fa89_1 ... (127s) Current status: PENDING
Waiting on bqjob_r5614f1babc3e5e32_000001626ff8fa89_1 ... (128s) Current status: PENDING
Waiting on bqjob_r5614f1babc3e5e32_000001626ff8fa89_1 ... (129s) Current status: PENDING
Waiting on bqjob_r5614f1babc3e5e32_000001626ff8fa89_1 ... (130s) Current status: PENDING
Waiting on bqjob_r5614f1babc3e5e32_000001626ff8fa89_1 ... (131s) Current status: PENDING
Waiting on bqjob_r5614f1babc3e5e32_000001626ff8fa89_1 ... (132s) Current status: PENDING
Waiting on bqjob_r5614f1babc3e5e32_000001626ff8fa89_1 ... (133s) Current status: PENDING
Waiting on bqjob_r5614f1babc3e5e32_000001626ff8fa89_1 ... (134s) Current status: PENDING
Waiting on bqjob_r5614f1babc3e5e32_000001626ff8fa89_1 ... (134s) Current status: DONE
+---------------------------+
| user |
+---------------------------+
| user9_ApricotWallaby |
| user0_AppleGreenCassowary |
| user3_RubyPossum |
| user1_AzureCockatoo |
| user6_AsparagusBandicoot |
| user3_AlmondCockatoo |
| user9_BeigePlatypus |
| user4_AlmondCockatoo |
| user11_RubyBilby |
| user6_AntiqueBrassQuokka |
+---------------------------+
Verified Almond
gcloud dataflow jobs cancel $(gcloud dataflow jobs list | grep leaderboard-jenkins | grep Running | cut -d' ' -f1)
Cancelled job [2018-03-28_21_02_57-9111129276491170785]
**************************************
* SUCCESS: LeaderBoard successfully run on DataflowRunner.
**************************************
[SUCCESS]
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':runners:flink:runQuickstartJavaFlinkLocal'.
> Process 'command '/usr/local/asfpackages/java/jdk1.8.0_152/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 30m 49s
5 actionable tasks: 5 executed
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user ccy@google.com
Not sending mail to unregistered user dawid@getindata.com
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user rober@frantil.com
Build failed in Jenkins: beam_PostRelease_NightlySnapshot #165
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostRelease_NightlySnapshot/165/display/redirect?page=changes>
Changes:
[yifanzou] return stdout text from command execution and stop using var.last_text
------------------------------------------
GitHub pull request #4788 of commit d21ee96d1416d9b7852f60ec14da4f40a3773061, no merge conflicts.
Setting status of d21ee96d1416d9b7852f60ec14da4f40a3773061 to PENDING with url https://builds.apache.org/job/beam_PostRelease_NightlySnapshot/165/ and message: 'Build started sha1 is merged.'
Using context: Jenkins: ./gradlew :release:runJavaExamplesValidationTask
[EnvInject] - Loading node environment variables.
Building remotely on beam4 (beam) in workspace <https://builds.apache.org/job/beam_PostRelease_NightlySnapshot/ws/>
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/4788/*:refs/remotes/origin/pr/4788/*
> git rev-parse refs/remotes/origin/pr/4788/merge^{commit} # timeout=10
> git rev-parse refs/remotes/origin/origin/pr/4788/merge^{commit} # timeout=10
Checking out Revision e4cc451903634f783f04c6c8ddfa88d74f2d7ce8 (refs/remotes/origin/pr/4788/merge)
> git config core.sparsecheckout # timeout=10
> git checkout -f e4cc451903634f783f04c6c8ddfa88d74f2d7ce8
Commit message: "Merge d21ee96d1416d9b7852f60ec14da4f40a3773061 into 397688a62b1f9f0f9840a43ed4ad1a59ba77b981"
> git rev-list --no-walk 9725347b0dc7da1b26d89e7525bb2f6803261910 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[Gradle] - Launching build.
[src] $ <https://builds.apache.org/job/beam_PostRelease_NightlySnapshot/ws/src/gradlew> -Pver= -Prepourl= :release:runJavaExamplesValidationTask
Parallel execution with configuration on demand is an incubating feature.
Applying build_rules.gradle to src
Applying build_rules.gradle to flink
applyJavaNature with [artifactId:beam-runners-flink_2.11] for project flink
Applying build_rules.gradle to fn-execution
applyJavaNature with [artifactId:beam-model-fn-execution, enableFindbugs:false] for project fn-execution
applyGrpcNature with default configuration for project fn-execution
Applying build_rules.gradle to core-java
applyJavaNature with [artifactId:runners-core-java] for project core-java
Applying build_rules.gradle to core
applyJavaNature with [artifactId:beam-sdks-java-core] for project core
applyAvroNature with default configuration for project core
Generating :runQuickstartJavaFlinkLocal
Applying build_rules.gradle to direct-java
applyJavaNature with [artifactId:beam-runners-direct-java] for project direct-java
Applying build_rules.gradle to core-construction-java
applyJavaNature with [artifactId:beam-runners-core-construction-java] for project core-construction-java
Generating :runQuickstartJavaDirect
Generating :runMobileGamingJavaDirect
Applying build_rules.gradle to google-cloud-dataflow-java
applyJavaNature with [enableFindbugs:false, artifactId:beam-runners-google-cloud-dataflow-java] for project google-cloud-dataflow-java
Applying build_rules.gradle to google-cloud-platform
applyJavaNature with [artifactId:beam-sdks-java-io-google-cloud-platform, enableFindbugs:false] for project google-cloud-platform
Applying build_rules.gradle to google-cloud-platform-core
applyJavaNature with [artifactId:beam-sdks-java-extensions-google-cloud-platform-core] for project google-cloud-platform-core
Generating :runQuickstartJavaDataflow
Generating :runMobileGamingJavaDataflow
Applying build_rules.gradle to apex
applyJavaNature with [artifactId:beam-runners-apex] for project apex
Generating :runQuickstartJavaApex
Applying build_rules.gradle to spark
applyJavaNature with [artifactId:beam-runners-spark] for project spark
Generating :runQuickstartJavaSpark
:release:compileJava NO-SOURCE
:release:compileGroovystartup failed:
<https://builds.apache.org/job/beam_PostRelease_NightlySnapshot/ws/src/release/src/main/groovy/QuickstartArchetype.groovy>: 23: Apparent variable 'output_text' was found in a static scope but doesn't refer to a local variable, static field or class. Possible causes:
You attempted to reference a variable in the binding or an instance variable from a static context.
You misspelled a classname or statically imported field. Please check the spelling.
You attempted to use a method 'output_text' but left out brackets in a place not allowed by the grammar.
@ line 23, column 5.
output_text = t.run """mvn archetype:generate \
^
<https://builds.apache.org/job/beam_PostRelease_NightlySnapshot/ws/src/release/src/main/groovy/QuickstartArchetype.groovy>: 34: Apparent variable 'output_text' was found in a static scope but doesn't refer to a local variable, static field or class. Possible causes:
You attempted to reference a variable in the binding or an instance variable from a static context.
You misspelled a classname or statically imported field. Please check the spelling.
You attempted to use a method 'output_text' but left out brackets in a place not allowed by the grammar.
@ line 34, column 35.
t.see "[INFO] BUILD SUCCESS", output_text
^
<https://builds.apache.org/job/beam_PostRelease_NightlySnapshot/ws/src/release/src/main/groovy/QuickstartArchetype.groovy>: 36: Apparent variable 'output_text' was found in a static scope but doesn't refer to a local variable, static field or class. Possible causes:
You attempted to reference a variable in the binding or an instance variable from a static context.
You misspelled a classname or statically imported field. Please check the spelling.
You attempted to use a method 'output_text' but left out brackets in a place not allowed by the grammar.
@ line 36, column 5.
output_text = t.run "ls"
^
<https://builds.apache.org/job/beam_PostRelease_NightlySnapshot/ws/src/release/src/main/groovy/QuickstartArchetype.groovy>: 37: Apparent variable 'output_text' was found in a static scope but doesn't refer to a local variable, static field or class. Possible causes:
You attempted to reference a variable in the binding or an instance variable from a static context.
You misspelled a classname or statically imported field. Please check the spelling.
You attempted to use a method 'output_text' but left out brackets in a place not allowed by the grammar.
@ line 37, column 22.
t.see "pom.xml", output_text
^
<https://builds.apache.org/job/beam_PostRelease_NightlySnapshot/ws/src/release/src/main/groovy/QuickstartArchetype.groovy>: 38: Apparent variable 'output_text' was found in a static scope but doesn't refer to a local variable, static field or class. Possible causes:
You attempted to reference a variable in the binding or an instance variable from a static context.
You misspelled a classname or statically imported field. Please check the spelling.
You attempted to use a method 'output_text' but left out brackets in a place not allowed by the grammar.
@ line 38, column 18.
t.see "src", output_text
^
<https://builds.apache.org/job/beam_PostRelease_NightlySnapshot/ws/src/release/src/main/groovy/QuickstartArchetype.groovy>: 39: Apparent variable 'wordcounts' was found in a static scope but doesn't refer to a local variable, static field or class. Possible causes:
You attempted to reference a variable in the binding or an instance variable from a static context.
You misspelled a classname or statically imported field. Please check the spelling.
You attempted to use a method 'wordcounts' but left out brackets in a place not allowed by the grammar.
@ line 39, column 5.
wordcounts = t.run "ls src/main/java/org/apache/beam/examples/"
^
<https://builds.apache.org/job/beam_PostRelease_NightlySnapshot/ws/src/release/src/main/groovy/QuickstartArchetype.groovy>: 40: Apparent variable 'wordcounts' was found in a static scope but doesn't refer to a local variable, static field or class. Possible causes:
You attempted to reference a variable in the binding or an instance variable from a static context.
You misspelled a classname or statically imported field. Please check the spelling.
You attempted to use a method 'wordcounts' but left out brackets in a place not allowed by the grammar.
@ line 40, column 29.
t.see "WordCount.java", wordcounts
^
<https://builds.apache.org/job/beam_PostRelease_NightlySnapshot/ws/src/release/src/main/groovy/QuickstartArchetype.groovy>: 41: Apparent variable 'games' was found in a static scope but doesn't refer to a local variable, static field or class. Possible causes:
You attempted to reference a variable in the binding or an instance variable from a static context.
You misspelled a classname or statically imported field. Please check the spelling.
You attempted to use a method 'games' but left out brackets in a place not allowed by the grammar.
@ line 41, column 5.
games = t.run "ls src/main/java/org/apache/beam/examples/complete/game/"
^
<https://builds.apache.org/job/beam_PostRelease_NightlySnapshot/ws/src/release/src/main/groovy/QuickstartArchetype.groovy>: 42: Apparent variable 'games' was found in a static scope but doesn't refer to a local variable, static field or class. Possible causes:
You attempted to reference a variable in the binding or an instance variable from a static context.
You misspelled a classname or statically imported field. Please check the spelling.
You attempted to use a method 'games' but left out brackets in a place not allowed by the grammar.
@ line 42, column 29.
t.see "UserScore.java", games
^
9 errors
FAILED
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':release:compileGroovy'.
> Compilation failed; see the compiler error output for details.
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 11s
1 actionable task: 1 executed
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user ccy@google.com
Not sending mail to unregistered user dawid@getindata.com
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user rober@frantil.com
Build failed in Jenkins: beam_PostRelease_NightlySnapshot #164
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostRelease_NightlySnapshot/164/display/redirect>
------------------------------------------
[...truncated 237.26 KB...]
[INFO] Downloading from test.release: https://repository.apache.org/content/repositories/snapshots/org/apache/beam/beam-sdks-java-maven-archetypes-examples/2.5.0-SNAPSHOT/beam-sdks-java-maven-archetypes-examples-2.5.0-20180328.102636-19.jar
[INFO] Downloaded from test.release: https://repository.apache.org/content/repositories/snapshots/org/apache/beam/beam-sdks-java-maven-archetypes-examples/2.5.0-SNAPSHOT/beam-sdks-java-maven-archetypes-examples-2.5.0-20180328.102636-19.jar (2.8 MB at 4.8 MB/s)
[INFO] ----------------------------------------------------------------------------
[INFO] Using following parameters for creating project from Archetype: beam-sdks-java-maven-archetypes-examples:2.5.0-SNAPSHOT
[INFO] ----------------------------------------------------------------------------
[INFO] Parameter: groupId, Value: org.example
[INFO] Parameter: artifactId, Value: word-count-beam
[INFO] Parameter: version, Value: 0.1
[INFO] Parameter: package, Value: org.apache.beam.examples
[INFO] Parameter: packageInPathFormat, Value: org/apache/beam/examples
[INFO] Parameter: package, Value: org.apache.beam.examples
[INFO] Parameter: version, Value: 0.1
[INFO] Parameter: groupId, Value: org.example
[INFO] Parameter: targetPlatform, Value: 1.8
[INFO] Parameter: artifactId, Value: word-count-beam
[INFO] Downloaded from test.release: https://repository.apache.org/content/repositories/snapshots/org/apache/beam/beam-sdks-java-maven-archetypes-examples/2.5.0-SNAPSHOT/beam-sdks-java-maven-archetypes-examples-2.5.0-20180328.102636-19.jar (2.8 MB at 4.7 MB/s)
[INFO] Project created from Archetype in dir: /tmp/groovy-generated-877773687350564370-tmpdir/word-count-beam
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 19.916 s
[INFO] Finished at: 2018-03-29T03:31:52Z
[INFO] ----------------------------------------------------------------------------
[INFO] Using following parameters for creating project from Archetype: beam-sdks-java-maven-archetypes-examples:2.5.0-SNAPSHOT
[INFO] ----------------------------------------------------------------------------
[INFO] Parameter: groupId, Value: org.example
[INFO] Parameter: artifactId, Value: word-count-beam
[INFO] Parameter: version, Value: 0.1
[INFO] Parameter: package, Value: org.apache.beam.examples
[INFO] Parameter: packageInPathFormat, Value: org/apache/beam/examples
[INFO] Parameter: package, Value: org.apache.beam.examples
[INFO] Parameter: version, Value: 0.1
[INFO] Parameter: groupId, Value: org.example
[INFO] Parameter: targetPlatform, Value: 1.8
[INFO] Parameter: artifactId, Value: word-count-beam
[INFO] Project created from Archetype in dir: /tmp/groovy-generated-2936964842916562708-tmpdir/word-count-beam
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 19.885 s
[INFO] Finished at: 2018-03-29T03:31:53Z
[INFO] Final Memory: 21M/300M
[INFO] ------------------------------------------------------------------------
Exception in thread "main" groovy.lang.MissingMethodException: No signature of method: TestScripts.see() is applicable for argument types: (java.lang.String) values: [[INFO] BUILD SUCCESS]
Possible solutions: see(java.lang.String, java.lang.String), ver(), run(java.lang.String), sleep(long), use([Ljava.lang.Object;), done()
at org.codehaus.groovy.runtime.ScriptBytecodeAdapter.unwrap(ScriptBytecodeAdapter.java:58)
at org.codehaus.groovy.runtime.callsite.PogoMetaClassSite.call(PogoMetaClassSite.java:54)
at org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCall(CallSiteArray.java:48)
at org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:113)
at org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:125)
at QuickstartArchetype.generate(QuickstartArchetype.groovy:34)
at QuickstartArchetype$generate.call(Unknown Source)
at org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCall(CallSiteArray.java:48)
at org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:113)
at org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:125)
at quickstart-java-flinklocal.run(quickstart-java-flinklocal.groovy:29)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.codehaus.groovy.reflection.CachedMethod.invoke(CachedMethod.java:93)
at groovy.lang.MetaMethod.doMethodInvoke(MetaMethod.java:325)
at groovy.lang.MetaClassImpl.invokeMethod(MetaClassImpl.java:1213)
at groovy.lang.MetaClassImpl.invokeMethod(MetaClassImpl.java:1022)
at org.codehaus.groovy.runtime.InvokerHelper.invokePogoMethod(InvokerHelper.java:925)
at org.codehaus.groovy.runtime.InvokerHelper.invokeMethod(InvokerHelper.java:908)
at org.codehaus.groovy.runtime.InvokerHelper.runScript(InvokerHelper.java:412)
at org.codehaus.groovy.runtime.InvokerHelper$runScript.call(Unknown Source)
at org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCall(CallSiteArray.java:48)
at org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:113)
at org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:133)
at quickstart-java-flinklocal.main(quickstart-java-flinklocal.groovy)
[INFO] Downloaded from test.release: https://repository.apache.org/content/repositories/snapshots/org/apache/beam/beam-sdks-java-maven-archetypes-examples/2.5.0-SNAPSHOT/beam-sdks-java-maven-archetypes-examples-2.5.0-20180328.102636-19.jar (2.8 MB at 4.1 MB/s)
:runners:flink:runQuickstartJavaFlinkLocal FAILED
[INFO] Final Memory: 21M/294M
[INFO] ------------------------------------------------------------------------
[INFO] Project created from Archetype in dir: /tmp/groovy-generated-1569266770464494173-tmpdir/word-count-beam
[INFO] ----------------------------------------------------------------------------
[INFO] Using following parameters for creating project from Archetype: beam-sdks-java-maven-archetypes-examples:2.5.0-SNAPSHOT
[INFO] ----------------------------------------------------------------------------
[INFO] ------------------------------------------------------------------------
[INFO] Parameter: groupId, Value: org.example
[INFO] Parameter: artifactId, Value: word-count-beam
[INFO] Parameter: version, Value: 0.1
[INFO] Parameter: package, Value: org.apache.beam.examples
[INFO] Parameter: packageInPathFormat, Value: org/apache/beam/examples
[INFO] Parameter: package, Value: org.apache.beam.examples
Exception in thread "main" [INFO] Parameter: version, Value: 0.1
[INFO] Parameter: groupId, Value: org.example
[INFO] Parameter: targetPlatform, Value: 1.8
[INFO] Parameter: artifactId, Value: word-count-beam
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 20.133 s
[INFO] Finished at: 2018-03-29T03:31:53Z
groovy.lang.MissingMethodException: No signature of method: TestScripts.see() is applicable for argument types: (java.lang.String) values: [[INFO] BUILD SUCCESS]
Possible solutions: see(java.lang.String, java.lang.String), ver(), run(java.lang.String), sleep(long), use([Ljava.lang.Object;), done()
at org.codehaus.groovy.runtime.ScriptBytecodeAdapter.unwrap(ScriptBytecodeAdapter.java:58)
at org.codehaus.groovy.runtime.callsite.PogoMetaClassSite.call(PogoMetaClassSite.java:54)
at org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCall(CallSiteArray.java:48)
at org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:113)
at org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:125)
at QuickstartArchetype.generate(QuickstartArchetype.groovy:34)
at QuickstartArchetype$generate.call(Unknown Source)
at org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCall(CallSiteArray.java:48)
at org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:113)
at org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:125)
at mobilegaming-java-direct.run(mobilegaming-java-direct.groovy:31)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.codehaus.groovy.reflection.CachedMethod.invoke(CachedMethod.java:93)
at groovy.lang.MetaMethod.doMethodInvoke(MetaMethod.java:325)
at groovy.lang.MetaClassImpl.invokeMethod(MetaClassImpl.java:1213)
at groovy.lang.MetaClassImpl.invokeMethod(MetaClassImpl.java:1022)
at org.codehaus.groovy.runtime.InvokerHelper.invokePogoMethod(InvokerHelper.java:925)
at org.codehaus.groovy.runtime.InvokerHelper.invokeMethod(InvokerHelper.java:908)
at org.codehaus.groovy.runtime.InvokerHelper.runScript(InvokerHelper.java:412)
at org.codehaus.groovy.runtime.InvokerHelper$runScript.call(Unknown Source)
at org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCall(CallSiteArray.java:48)
at org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:113)
at org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:133)
at mobilegaming-java-direct.main(mobilegaming-java-direct.groovy)
:runners:direct-java:runMobileGamingJavaDirect FAILED
[INFO] Project created from Archetype in dir: /tmp/groovy-generated-2166700484090545472-tmpdir/word-count-beam
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 20.515 s
[INFO] Finished at: 2018-03-29T03:31:53Z
[INFO] Final Memory: 21M/315M
[INFO] ------------------------------------------------------------------------
Exception in thread "main" groovy.lang.MissingMethodException: No signature of method: TestScripts.see() is applicable for argument types: (java.lang.String) values: [[INFO] BUILD SUCCESS]
Possible solutions: see(java.lang.String, java.lang.String), ver(), run(java.lang.String), sleep(long), use([Ljava.lang.Object;), done()
at org.codehaus.groovy.runtime.ScriptBytecodeAdapter.unwrap(ScriptBytecodeAdapter.java:58)
at org.codehaus.groovy.runtime.callsite.PogoMetaClassSite.call(PogoMetaClassSite.java:54)
at org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCall(CallSiteArray.java:48)
at org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:113)
at org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:125)
at QuickstartArchetype.generate(QuickstartArchetype.groovy:34)
at QuickstartArchetype$generate.call(Unknown Source)
at org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCall(CallSiteArray.java:48)
at org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:113)
at org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:125)
at quickstart-java-apex.run(quickstart-java-apex.groovy:29)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.codehaus.groovy.reflection.CachedMethod.invoke(CachedMethod.java:93)
at groovy.lang.MetaMethod.doMethodInvoke(MetaMethod.java:325)
at groovy.lang.MetaClassImpl.invokeMethod(MetaClassImpl.java:1213)
at groovy.lang.MetaClassImpl.invokeMethod(MetaClassImpl.java:1022)
at org.codehaus.groovy.runtime.InvokerHelper.invokePogoMethod(InvokerHelper.java:925)
at org.codehaus.groovy.runtime.InvokerHelper.invokeMethod(InvokerHelper.java:908)
at org.codehaus.groovy.runtime.InvokerHelper.runScript(InvokerHelper.java:412)
at org.codehaus.groovy.runtime.InvokerHelper$runScript.call(Unknown Source)
at org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCall(CallSiteArray.java:48)
at org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:113)
at org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:133)
at quickstart-java-apex.main(quickstart-java-apex.groovy)
[INFO] Final Memory: 17M/261M
[INFO] ------------------------------------------------------------------------
:runners:apex:runQuickstartJavaApex FAILED
Exception in thread "main" groovy.lang.MissingMethodException: No signature of method: TestScripts.see() is applicable for argument types: (java.lang.String) values: [[INFO] BUILD SUCCESS]
Possible solutions: see(java.lang.String, java.lang.String), ver(), run(java.lang.String), sleep(long), use([Ljava.lang.Object;), done()
at org.codehaus.groovy.runtime.ScriptBytecodeAdapter.unwrap(ScriptBytecodeAdapter.java:58)
at org.codehaus.groovy.runtime.callsite.PogoMetaClassSite.call(PogoMetaClassSite.java:54)
at org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCall(CallSiteArray.java:48)
at org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:113)
at org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:125)
at QuickstartArchetype.generate(QuickstartArchetype.groovy:34)
at QuickstartArchetype$generate.call(Unknown Source)
at org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCall(CallSiteArray.java:48)
at org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:113)
at org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:125)
at mobilegaming-java-dataflow.run(mobilegaming-java-dataflow.groovy:31)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.codehaus.groovy.reflection.CachedMethod.invoke(CachedMethod.java:93)
at groovy.lang.MetaMethod.doMethodInvoke(MetaMethod.java:325)
at groovy.lang.MetaClassImpl.invokeMethod(MetaClassImpl.java:1213)
at groovy.lang.MetaClassImpl.invokeMethod(MetaClassImpl.java:1022)
at org.codehaus.groovy.runtime.InvokerHelper.invokePogoMethod(InvokerHelper.java:925)
at org.codehaus.groovy.runtime.InvokerHelper.invokeMethod(InvokerHelper.java:908)
at org.codehaus.groovy.runtime.InvokerHelper.runScript(InvokerHelper.java:412)
at org.codehaus.groovy.runtime.InvokerHelper$runScript.call(Unknown Source)
at org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCall(CallSiteArray.java:48)
at org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:113)
at org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:133)
at mobilegaming-java-dataflow.main(mobilegaming-java-dataflow.groovy)
:runners:google-cloud-dataflow-java:runMobileGamingJavaDataflow FAILED
FAILURE: Build completed with 4 failures.
1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':runners:flink:runQuickstartJavaFlinkLocal'.
> Process 'command '/usr/local/asfpackages/java/jdk1.8.0_152/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':runners:direct-java:runMobileGamingJavaDirect'.
> Process 'command '/usr/local/asfpackages/java/jdk1.8.0_152/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
3: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':runners:apex:runQuickstartJavaApex'.
> Process 'command '/usr/local/asfpackages/java/jdk1.8.0_152/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
4: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:runMobileGamingJavaDataflow'.
> Process 'command '/usr/local/asfpackages/java/jdk1.8.0_152/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
BUILD FAILED in 43s
5 actionable tasks: 5 executed
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Not sending mail to unregistered user ccy@google.com
Not sending mail to unregistered user dawid@getindata.com
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user rober@frantil.com
Build failed in Jenkins: beam_PostRelease_NightlySnapshot #163
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostRelease_NightlySnapshot/163/display/redirect?page=changes>
Changes:
[tgroh] Cleanups in GroupAlsoByWindowEvaluatorFactory
[dawid] [BEAM-2831] Do not wrap IOException in SerializableCoder
[tgroh] Allow Fusion to Continue with unknown PTransforms
[tgroh] fixup! Allow Fusion to Continue with unknown PTransforms
[tgroh] fixup! fixup! Allow Fusion to Continue with unknown PTransforms
[wcn] Fix documentation around pipeline creation.
[herohde] Migrate container instructions and builds to Gradle
[rober] Go SDK usercounters
[chamikara] [BEAM-3744] Expand Pubsub read API for Python. (#4901)
[herohde] CR: added comments to container helper function
[herohde] CR: make containerImageName take named parameters
[ccy] Revert #4781 which broke Python postsubmits
------------------------------------------
[...truncated 3.02 MB...]
Mar 28, 2018 11:04:45 AM org.apache.spark.internal.Logging$class logInfo
INFO: Finished task 0.0 in stage 2.0 (TID 8). 13240 bytes result sent to driver
Mar 28, 2018 11:04:45 AM org.apache.spark.internal.Logging$class logInfo
INFO: Starting task 7.0 in stage 2.0 (TID 15, localhost, executor driver, partition 7, PROCESS_LOCAL, 4730 bytes)
Mar 28, 2018 11:04:45 AM org.apache.spark.internal.Logging$class logInfo
INFO: Running task 7.0 in stage 2.0 (TID 15)
Mar 28, 2018 11:04:45 AM org.apache.spark.internal.Logging$class logInfo
INFO: Finished task 0.0 in stage 2.0 (TID 8) in 96 ms on localhost (executor driver) (4/8)
Mar 28, 2018 11:04:45 AM org.apache.spark.internal.Logging$class logInfo
INFO: Getting 0 non-empty blocks out of 4 blocks
Mar 28, 2018 11:04:45 AM org.apache.spark.internal.Logging$class logInfo
INFO: Started 0 remote fetches in 1 ms
Mar 28, 2018 11:04:45 AM org.apache.spark.internal.Logging$class logInfo
INFO: Getting 0 non-empty blocks out of 4 blocks
Mar 28, 2018 11:04:45 AM org.apache.spark.internal.Logging$class logInfo
INFO: Started 0 remote fetches in 1 ms
Mar 28, 2018 11:04:45 AM org.apache.spark.internal.Logging$class logInfo
INFO: Getting 0 non-empty blocks out of 4 blocks
Mar 28, 2018 11:04:45 AM org.apache.spark.internal.Logging$class logInfo
INFO: Started 0 remote fetches in 0 ms
Mar 28, 2018 11:04:45 AM org.apache.spark.internal.Logging$class logInfo
INFO: Getting 0 non-empty blocks out of 4 blocks
Mar 28, 2018 11:04:45 AM org.apache.spark.internal.Logging$class logInfo
INFO: Started 0 remote fetches in 1 ms
Mar 28, 2018 11:04:45 AM org.apache.spark.internal.Logging$class logInfo
INFO: Block rdd_41_4 stored as values in memory (estimated size 16.0 B, free 1825.1 MB)
Mar 28, 2018 11:04:45 AM org.apache.spark.internal.Logging$class logInfo
INFO: Block rdd_41_5 stored as values in memory (estimated size 16.0 B, free 1825.1 MB)
Mar 28, 2018 11:04:45 AM org.apache.spark.internal.Logging$class logInfo
INFO: Block rdd_41_7 stored as values in memory (estimated size 16.0 B, free 1825.1 MB)
Mar 28, 2018 11:04:45 AM org.apache.spark.internal.Logging$class logInfo
INFO: Block rdd_41_6 stored as values in memory (estimated size 16.0 B, free 1825.1 MB)
Mar 28, 2018 11:04:45 AM org.apache.spark.internal.Logging$class logInfo
INFO: Added rdd_41_4 in memory on 127.0.0.1:43400 (size: 16.0 B, free: 1825.4 MB)
Mar 28, 2018 11:04:45 AM org.apache.spark.internal.Logging$class logInfo
INFO: Added rdd_41_7 in memory on 127.0.0.1:43400 (size: 16.0 B, free: 1825.4 MB)
Mar 28, 2018 11:04:45 AM org.apache.spark.internal.Logging$class logInfo
INFO: Added rdd_41_6 in memory on 127.0.0.1:43400 (size: 16.0 B, free: 1825.4 MB)
Mar 28, 2018 11:04:45 AM org.apache.spark.internal.Logging$class logInfo
INFO: Added rdd_41_5 in memory on 127.0.0.1:43400 (size: 16.0 B, free: 1825.4 MB)
Mar 28, 2018 11:04:45 AM org.apache.spark.internal.Logging$class logInfo
INFO: Finished task 7.0 in stage 2.0 (TID 15). 11942 bytes result sent to driver
Mar 28, 2018 11:04:45 AM org.apache.spark.internal.Logging$class logInfo
INFO: Finished task 5.0 in stage 2.0 (TID 13). 11942 bytes result sent to driver
Mar 28, 2018 11:04:45 AM org.apache.spark.internal.Logging$class logInfo
INFO: Finished task 4.0 in stage 2.0 (TID 12). 11942 bytes result sent to driver
Mar 28, 2018 11:04:45 AM org.apache.spark.internal.Logging$class logInfo
INFO: Finished task 7.0 in stage 2.0 (TID 15) in 69 ms on localhost (executor driver) (5/8)
Mar 28, 2018 11:04:45 AM org.apache.spark.internal.Logging$class logInfo
INFO: Finished task 5.0 in stage 2.0 (TID 13) in 89 ms on localhost (executor driver) (6/8)
Mar 28, 2018 11:04:45 AM org.apache.spark.internal.Logging$class logInfo
INFO: Finished task 4.0 in stage 2.0 (TID 12) in 92 ms on localhost (executor driver) (7/8)
Mar 28, 2018 11:04:45 AM org.apache.spark.internal.Logging$class logInfo
INFO: Finished task 6.0 in stage 2.0 (TID 14). 11942 bytes result sent to driver
Mar 28, 2018 11:04:45 AM org.apache.spark.internal.Logging$class logInfo
INFO: Finished task 6.0 in stage 2.0 (TID 14) in 86 ms on localhost (executor driver) (8/8)
Mar 28, 2018 11:04:45 AM org.apache.spark.internal.Logging$class logInfo
INFO: Removed TaskSet 2.0, whose tasks have all completed, from pool
Mar 28, 2018 11:04:45 AM org.apache.spark.internal.Logging$class logInfo
INFO: ResultStage 2 (collect at BoundedDataset.java:87) finished in 0.159 s
Mar 28, 2018 11:04:45 AM org.apache.spark.internal.Logging$class logInfo
INFO: Job 0 finished: collect at BoundedDataset.java:87, took 4.417106 s
Mar 28, 2018 11:04:45 AM org.apache.beam.runners.spark.SparkRunner$Evaluator enterCompositeTransform
INFO: Entering directly-translatable composite transform: 'WriteCounts/WriteFiles/GatherTempFileResults/Reify.ReifyViewInGlobalWindow/Create.Values'
Mar 28, 2018 11:04:45 AM org.apache.beam.runners.spark.SparkRunner$Evaluator doVisitTransform
INFO: Evaluating Create.Values
Mar 28, 2018 11:04:45 AM org.apache.beam.runners.spark.SparkRunner$Evaluator doVisitTransform
INFO: Evaluating org.apache.beam.sdk.transforms.Reify$ReifyView$1@51de1b24
Mar 28, 2018 11:04:45 AM org.apache.spark.internal.Logging$class logInfo
INFO: Block broadcast_3 stored as values in memory (estimated size 672.0 B, free 1825.1 MB)
Mar 28, 2018 11:04:45 AM org.apache.spark.internal.Logging$class logInfo
INFO: Block broadcast_3_piece0 stored as bytes in memory (estimated size 361.0 B, free 1825.1 MB)
Mar 28, 2018 11:04:45 AM org.apache.spark.internal.Logging$class logInfo
INFO: Added broadcast_3_piece0 in memory on 127.0.0.1:43400 (size: 361.0 B, free: 1825.4 MB)
Mar 28, 2018 11:04:45 AM org.apache.spark.internal.Logging$class logInfo
INFO: Created broadcast 3 from broadcast at SideInputBroadcast.java:59
Mar 28, 2018 11:04:45 AM org.apache.beam.runners.spark.SparkRunner$Evaluator doVisitTransform
INFO: Evaluating org.apache.beam.sdk.transforms.MapElements$1@4a707370
Mar 28, 2018 11:04:45 AM org.apache.beam.runners.spark.SparkRunner$Evaluator doVisitTransform
INFO: Evaluating org.apache.beam.sdk.io.WriteFiles$FinalizeTempFileBundles$FinalizeFn@43d8899
Mar 28, 2018 11:04:45 AM org.apache.spark.internal.Logging$class logInfo
INFO: Starting job: foreach at BoundedDataset.java:117
Mar 28, 2018 11:04:45 AM org.apache.spark.internal.Logging$class logInfo
INFO: Got job 1 (foreach at BoundedDataset.java:117) with 4 output partitions
Mar 28, 2018 11:04:45 AM org.apache.spark.internal.Logging$class logInfo
INFO: Final stage: ResultStage 3 (foreach at BoundedDataset.java:117)
Mar 28, 2018 11:04:45 AM org.apache.spark.internal.Logging$class logInfo
INFO: Parents of final stage: List()
Mar 28, 2018 11:04:45 AM org.apache.spark.internal.Logging$class logInfo
INFO: Missing parents: List()
Mar 28, 2018 11:04:45 AM org.apache.spark.internal.Logging$class logInfo
INFO: Submitting ResultStage 3 (WriteCounts/WriteFiles/FinalizeTempFileBundles/Finalize/ParMultiDo(Finalize).output MapPartitionsRDD[53] at values at TransformTranslator.java:400), which has no missing parents
Mar 28, 2018 11:04:45 AM org.apache.spark.internal.Logging$class logInfo
INFO: Block broadcast_4 stored as values in memory (estimated size 84.1 KB, free 1825.0 MB)
Mar 28, 2018 11:04:45 AM org.apache.spark.internal.Logging$class logInfo
INFO: Block broadcast_4_piece0 stored as bytes in memory (estimated size 22.4 KB, free 1825.0 MB)
Mar 28, 2018 11:04:46 AM org.apache.spark.internal.Logging$class logInfo
INFO: Added broadcast_4_piece0 in memory on 127.0.0.1:43400 (size: 22.4 KB, free: 1825.3 MB)
Mar 28, 2018 11:04:46 AM org.apache.spark.internal.Logging$class logInfo
INFO: Created broadcast 4 from broadcast at DAGScheduler.scala:1006
Mar 28, 2018 11:04:46 AM org.apache.spark.internal.Logging$class logInfo
INFO: Submitting 4 missing tasks from ResultStage 3 (WriteCounts/WriteFiles/FinalizeTempFileBundles/Finalize/ParMultiDo(Finalize).output MapPartitionsRDD[53] at values at TransformTranslator.java:400) (first 15 tasks are for partitions Vector(0, 1, 2, 3))
Mar 28, 2018 11:04:46 AM org.apache.spark.internal.Logging$class logInfo
INFO: Adding task set 3.0 with 4 tasks
Mar 28, 2018 11:04:46 AM org.apache.spark.internal.Logging$class logInfo
INFO: Starting task 0.0 in stage 3.0 (TID 16, localhost, executor driver, partition 0, PROCESS_LOCAL, 4827 bytes)
Mar 28, 2018 11:04:46 AM org.apache.spark.internal.Logging$class logInfo
INFO: Starting task 1.0 in stage 3.0 (TID 17, localhost, executor driver, partition 1, PROCESS_LOCAL, 4827 bytes)
Mar 28, 2018 11:04:46 AM org.apache.spark.internal.Logging$class logInfo
INFO: Starting task 2.0 in stage 3.0 (TID 18, localhost, executor driver, partition 2, PROCESS_LOCAL, 4827 bytes)
Mar 28, 2018 11:04:46 AM org.apache.spark.internal.Logging$class logInfo
INFO: Starting task 3.0 in stage 3.0 (TID 19, localhost, executor driver, partition 3, PROCESS_LOCAL, 4837 bytes)
Mar 28, 2018 11:04:46 AM org.apache.spark.internal.Logging$class logInfo
INFO: Running task 2.0 in stage 3.0 (TID 18)
Mar 28, 2018 11:04:46 AM org.apache.spark.internal.Logging$class logInfo
INFO: Running task 0.0 in stage 3.0 (TID 16)
Mar 28, 2018 11:04:46 AM org.apache.spark.internal.Logging$class logInfo
INFO: Running task 1.0 in stage 3.0 (TID 17)
Mar 28, 2018 11:04:46 AM org.apache.spark.internal.Logging$class logInfo
INFO: Running task 3.0 in stage 3.0 (TID 19)
Mar 28, 2018 11:04:46 AM org.apache.spark.internal.Logging$class logInfo
INFO: Finished task 0.0 in stage 3.0 (TID 16). 12184 bytes result sent to driver
Mar 28, 2018 11:04:46 AM org.apache.spark.internal.Logging$class logInfo
INFO: Finished task 2.0 in stage 3.0 (TID 18). 12141 bytes result sent to driver
Mar 28, 2018 11:04:46 AM org.apache.spark.internal.Logging$class logInfo
INFO: Finished task 1.0 in stage 3.0 (TID 17). 12141 bytes result sent to driver
Mar 28, 2018 11:04:46 AM org.apache.spark.internal.Logging$class logInfo
INFO: Finished task 0.0 in stage 3.0 (TID 16) in 70 ms on localhost (executor driver) (1/4)
Mar 28, 2018 11:04:46 AM org.apache.spark.internal.Logging$class logInfo
INFO: Finished task 1.0 in stage 3.0 (TID 17) in 69 ms on localhost (executor driver) (2/4)
Mar 28, 2018 11:04:46 AM org.apache.spark.internal.Logging$class logInfo
INFO: Finished task 2.0 in stage 3.0 (TID 18) in 72 ms on localhost (executor driver) (3/4)
Mar 28, 2018 11:04:46 AM org.apache.beam.sdk.io.WriteFiles$FinalizeTempFileBundles$FinalizeFn process
INFO: Finalizing 4 file results
Mar 28, 2018 11:04:46 AM org.apache.beam.sdk.io.FileBasedSink$WriteOperation createMissingEmptyShards
INFO: Finalizing for destination null num shards 4.
Mar 28, 2018 11:04:46 AM org.apache.beam.sdk.io.FileBasedSink$WriteOperation moveToOutputFiles
INFO: Will copy temporary file FileResult{tempFilename=/tmp/groovy-generated-2204937763380428322-tmpdir/word-count-beam/.temp-beam-2018-03-28_11-04-37-0/0f8fec26-178e-426b-83e2-51ee452f6bb8, shard=0, window=org.apache.beam.sdk.transforms.windowing.GlobalWindow@1374bd08, paneInfo=PaneInfo.NO_FIRING} to final location /tmp/groovy-generated-2204937763380428322-tmpdir/word-count-beam/counts-00000-of-00004
Mar 28, 2018 11:04:46 AM org.apache.beam.sdk.io.FileBasedSink$WriteOperation moveToOutputFiles
INFO: Will copy temporary file FileResult{tempFilename=/tmp/groovy-generated-2204937763380428322-tmpdir/word-count-beam/.temp-beam-2018-03-28_11-04-37-0/029c5b0c-b6ef-44a3-9422-3e9965099f12, shard=1, window=org.apache.beam.sdk.transforms.windowing.GlobalWindow@1374bd08, paneInfo=PaneInfo.NO_FIRING} to final location /tmp/groovy-generated-2204937763380428322-tmpdir/word-count-beam/counts-00001-of-00004
Mar 28, 2018 11:04:46 AM org.apache.beam.sdk.io.FileBasedSink$WriteOperation moveToOutputFiles
INFO: Will copy temporary file FileResult{tempFilename=/tmp/groovy-generated-2204937763380428322-tmpdir/word-count-beam/.temp-beam-2018-03-28_11-04-37-0/472f680c-5fca-4d42-be96-46fa0c582c72, shard=2, window=org.apache.beam.sdk.transforms.windowing.GlobalWindow@1374bd08, paneInfo=PaneInfo.NO_FIRING} to final location /tmp/groovy-generated-2204937763380428322-tmpdir/word-count-beam/counts-00002-of-00004
Mar 28, 2018 11:04:46 AM org.apache.beam.sdk.io.FileBasedSink$WriteOperation moveToOutputFiles
INFO: Will copy temporary file FileResult{tempFilename=/tmp/groovy-generated-2204937763380428322-tmpdir/word-count-beam/.temp-beam-2018-03-28_11-04-37-0/fc1ab1ee-5d06-40df-a989-c0230a05c91b, shard=3, window=org.apache.beam.sdk.transforms.windowing.GlobalWindow@1374bd08, paneInfo=PaneInfo.NO_FIRING} to final location /tmp/groovy-generated-2204937763380428322-tmpdir/word-count-beam/counts-00003-of-00004
Mar 28, 2018 11:04:46 AM org.apache.beam.sdk.io.FileBasedSink$WriteOperation removeTemporaryFiles
INFO: Will remove known temporary file /tmp/groovy-generated-2204937763380428322-tmpdir/word-count-beam/.temp-beam-2018-03-28_11-04-37-0/0f8fec26-178e-426b-83e2-51ee452f6bb8
Mar 28, 2018 11:04:46 AM org.apache.beam.sdk.io.FileBasedSink$WriteOperation removeTemporaryFiles
INFO: Will remove known temporary file /tmp/groovy-generated-2204937763380428322-tmpdir/word-count-beam/.temp-beam-2018-03-28_11-04-37-0/029c5b0c-b6ef-44a3-9422-3e9965099f12
Mar 28, 2018 11:04:46 AM org.apache.beam.sdk.io.FileBasedSink$WriteOperation removeTemporaryFiles
INFO: Will remove known temporary file /tmp/groovy-generated-2204937763380428322-tmpdir/word-count-beam/.temp-beam-2018-03-28_11-04-37-0/fc1ab1ee-5d06-40df-a989-c0230a05c91b
Mar 28, 2018 11:04:46 AM org.apache.beam.sdk.io.FileBasedSink$WriteOperation removeTemporaryFiles
INFO: Will remove known temporary file /tmp/groovy-generated-2204937763380428322-tmpdir/word-count-beam/.temp-beam-2018-03-28_11-04-37-0/472f680c-5fca-4d42-be96-46fa0c582c72
Mar 28, 2018 11:04:46 AM org.apache.spark.internal.Logging$class logInfo
INFO: Finished task 3.0 in stage 3.0 (TID 19). 15889 bytes result sent to driver
Mar 28, 2018 11:04:46 AM org.apache.spark.internal.Logging$class logInfo
INFO: Finished task 3.0 in stage 3.0 (TID 19) in 124 ms on localhost (executor driver) (4/4)
Mar 28, 2018 11:04:46 AM org.apache.spark.internal.Logging$class logInfo
INFO: ResultStage 3 (foreach at BoundedDataset.java:117) finished in 0.127 s
Mar 28, 2018 11:04:46 AM org.apache.spark.internal.Logging$class logInfo
INFO: Job 1 finished: foreach at BoundedDataset.java:117, took 0.157978 s
Mar 28, 2018 11:04:46 AM org.apache.spark.internal.Logging$class logInfo
INFO: Removed TaskSet 3.0, whose tasks have all completed, from pool
Mar 28, 2018 11:04:46 AM org.apache.beam.runners.spark.SparkRunner lambda$run$1
INFO: Batch pipeline execution complete.
Mar 28, 2018 11:04:46 AM org.spark_project.jetty.server.AbstractConnector doStop
INFO: Stopped Spark@7aef989c{HTTP/1.1,[http/1.1]}{127.0.0.1:4040}
Mar 28, 2018 11:04:46 AM org.apache.spark.internal.Logging$class logInfo
INFO: Stopped Spark web UI at http://127.0.0.1:4040
Mar 28, 2018 11:04:46 AM org.apache.spark.internal.Logging$class logInfo
INFO: MapOutputTrackerMasterEndpoint stopped!
Mar 28, 2018 11:04:46 AM org.apache.spark.internal.Logging$class logInfo
INFO: MemoryStore cleared
Mar 28, 2018 11:04:46 AM org.apache.spark.internal.Logging$class logInfo
INFO: BlockManager stopped
Mar 28, 2018 11:04:46 AM org.apache.spark.internal.Logging$class logInfo
INFO: BlockManagerMaster stopped
Mar 28, 2018 11:04:46 AM org.apache.spark.internal.Logging$class logInfo
INFO: OutputCommitCoordinator stopped!
Mar 28, 2018 11:04:46 AM org.apache.spark.internal.Logging$class logInfo
INFO: Successfully stopped SparkContext
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 01:52 min
[INFO] Finished at: 2018-03-28T11:04:46Z
[INFO] Final Memory: 92M/892M
[INFO] ------------------------------------------------------------------------
grep Foundation counts*
counts-00000-of-00004:Foundation: 1
Verified Foundation: 1
[SUCCESS]
Mar 28, 2018 12:07:22 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2018-03-28T12:07:22.137Z: Workflow failed. Causes: The Dataflow appears to be stuck. You can get help with Cloud Dataflow at https://cloud.google.com/dataflow/support.
Mar 28, 2018 12:07:22 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-03-28T12:07:22.262Z: Cancel request is committed for workflow job: 2018-03-28_04_02_39-9444388526551827135.
Mar 28, 2018 12:07:22 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-03-28T12:07:22.356Z: Cleaning up.
Mar 28, 2018 12:07:22 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-03-28T12:07:22.466Z: Stopping worker pool...
Mar 28, 2018 12:08:40 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-03-28T12:08:37.831Z: Autoscaling: Reduced the number of workers to 0 based on the rate of progress in the currently running step(s).
Mar 28, 2018 12:08:46 PM org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-03-28_04_02_39-9444388526551827135 failed with status FAILED.
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 01:07 h
[INFO] Finished at: 2018-03-28T12:08:46Z
[INFO] Final Memory: 35M/273M
[INFO] ------------------------------------------------------------------------
gsutil cat gs://temp-storage-for-release-validation-tests/quickstart/count* | grep Montague:
CommandException: No URLs matched: gs://temp-storage-for-release-validation-tests/quickstart/count*
CommandException: No URLs matched: gs://temp-storage-for-release-validation-tests/quickstart/count*
[ERROR] Failed command
:runners:google-cloud-dataflow-java:runQuickstartJavaDataflow FAILED
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':runners:flink:runQuickstartJavaFlinkLocal'.
> Process 'command '/usr/local/asfpackages/java/jdk1.8.0_152/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:runQuickstartJavaDataflow'.
> Process 'command '/usr/local/asfpackages/java/jdk1.8.0_152/bin/java'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
BUILD FAILED in 1h 8m 31s
6 actionable tasks: 6 executed
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Not sending mail to unregistered user ccy@google.com
Not sending mail to unregistered user dawid@getindata.com
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user rober@frantil.com