You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2017/04/16 06:02:51 UTC
Build failed in Jenkins: beam_PerformanceTests_Dataflow #314
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/314/display/redirect>
------------------------------------------
[...truncated 236.00 KB...]
x [deleted] (none) -> origin/pr/967/merge
x [deleted] (none) -> origin/pr/968/head
x [deleted] (none) -> origin/pr/968/merge
x [deleted] (none) -> origin/pr/969/head
x [deleted] (none) -> origin/pr/969/merge
x [deleted] (none) -> origin/pr/97/head
x [deleted] (none) -> origin/pr/97/merge
x [deleted] (none) -> origin/pr/970/head
x [deleted] (none) -> origin/pr/970/merge
x [deleted] (none) -> origin/pr/971/head
x [deleted] (none) -> origin/pr/971/merge
x [deleted] (none) -> origin/pr/972/head
x [deleted] (none) -> origin/pr/973/head
x [deleted] (none) -> origin/pr/974/head
x [deleted] (none) -> origin/pr/974/merge
x [deleted] (none) -> origin/pr/975/head
x [deleted] (none) -> origin/pr/975/merge
x [deleted] (none) -> origin/pr/976/head
x [deleted] (none) -> origin/pr/976/merge
x [deleted] (none) -> origin/pr/977/head
x [deleted] (none) -> origin/pr/977/merge
x [deleted] (none) -> origin/pr/978/head
x [deleted] (none) -> origin/pr/978/merge
x [deleted] (none) -> origin/pr/979/head
x [deleted] (none) -> origin/pr/979/merge
x [deleted] (none) -> origin/pr/98/head
x [deleted] (none) -> origin/pr/980/head
x [deleted] (none) -> origin/pr/980/merge
x [deleted] (none) -> origin/pr/981/head
x [deleted] (none) -> origin/pr/982/head
x [deleted] (none) -> origin/pr/982/merge
x [deleted] (none) -> origin/pr/983/head
x [deleted] (none) -> origin/pr/983/merge
x [deleted] (none) -> origin/pr/984/head
x [deleted] (none) -> origin/pr/984/merge
x [deleted] (none) -> origin/pr/985/head
x [deleted] (none) -> origin/pr/985/merge
x [deleted] (none) -> origin/pr/986/head
x [deleted] (none) -> origin/pr/986/merge
x [deleted] (none) -> origin/pr/987/head
x [deleted] (none) -> origin/pr/988/head
x [deleted] (none) -> origin/pr/988/merge
x [deleted] (none) -> origin/pr/989/head
x [deleted] (none) -> origin/pr/989/merge
x [deleted] (none) -> origin/pr/99/head
x [deleted] (none) -> origin/pr/99/merge
x [deleted] (none) -> origin/pr/990/head
x [deleted] (none) -> origin/pr/990/merge
x [deleted] (none) -> origin/pr/991/head
x [deleted] (none) -> origin/pr/991/merge
x [deleted] (none) -> origin/pr/992/head
x [deleted] (none) -> origin/pr/992/merge
x [deleted] (none) -> origin/pr/993/head
x [deleted] (none) -> origin/pr/993/merge
x [deleted] (none) -> origin/pr/994/head
x [deleted] (none) -> origin/pr/994/merge
x [deleted] (none) -> origin/pr/995/head
x [deleted] (none) -> origin/pr/995/merge
x [deleted] (none) -> origin/pr/996/head
x [deleted] (none) -> origin/pr/996/merge
x [deleted] (none) -> origin/pr/997/head
x [deleted] (none) -> origin/pr/997/merge
x [deleted] (none) -> origin/pr/998/head
x [deleted] (none) -> origin/pr/999/head
x [deleted] (none) -> origin/pr/999/merge
remote: Counting objects: 1941, done.
remote: Compressing objects: 0% (1/158) remote: Compressing objects: 1% (2/158) remote: Compressing objects: 2% (4/158) remote: Compressing objects: 3% (5/158) remote: Compressing objects: 4% (7/158) remote: Compressing objects: 5% (8/158) remote: Compressing objects: 6% (10/158) remote: Compressing objects: 7% (12/158) remote: Compressing objects: 8% (13/158) remote: Compressing objects: 9% (15/158) remote: Compressing objects: 10% (16/158) remote: Compressing objects: 11% (18/158) remote: Compressing objects: 12% (19/158) remote: Compressing objects: 13% (21/158) remote: Compressing objects: 14% (23/158) remote: Compressing objects: 15% (24/158) remote: Compressing objects: 16% (26/158) remote: Compressing objects: 17% (27/158) remote: Compressing objects: 18% (29/158) remote: Compressing objects: 19% (31/158) remote: Compressing objects: 20% (32/158) remote: Compressing objects: 21% (34/158) remote: Compressing objects: 22% (35/158) remote: Compressing objects: 23% (37/158) remote: Compressing objects: 24% (38/158) remote: Compressing objects: 25% (40/158) remote: Compressing objects: 26% (42/158) remote: Compressing objects: 27% (43/158) remote: Compressing objects: 28% (45/158) remote: Compressing objects: 29% (46/158) remote: Compressing objects: 30% (48/158) remote: Compressing objects: 31% (49/158) remote: Compressing objects: 32% (51/158) remote: Compressing objects: 33% (53/158) remote: Compressing objects: 34% (54/158) remote: Compressing objects: 35% (56/158) remote: Compressing objects: 36% (57/158) remote: Compressing objects: 37% (59/158) remote: Compressing objects: 38% (61/158) remote: Compressing objects: 39% (62/158) remote: Compressing objects: 40% (64/158) remote: Compressing objects: 41% (65/158) remote: Compressing objects: 42% (67/158) remote: Compressing objects: 43% (68/158) remote: Compressing objects: 44% (70/158) remote: Compressing objects: 45% (72/158) remote: Compressing objects: 46% (73/158) remote: Compressing objects: 47% (75/158) remote: Compressing objects: 48% (76/158) remote: Compressing objects: 49% (78/158) remote: Compressing objects: 50% (79/158) remote: Compressing objects: 51% (81/158) remote: Compressing objects: 52% (83/158) remote: Compressing objects: 53% (84/158) remote: Compressing objects: 54% (86/158) remote: Compressing objects: 55% (87/158) remote: Compressing objects: 56% (89/158) remote: Compressing objects: 57% (91/158) remote: Compressing objects: 58% (92/158) remote: Compressing objects: 59% (94/158) remote: Compressing objects: 60% (95/158) remote: Compressing objects: 61% (97/158) remote: Compressing objects: 62% (98/158) remote: Compressing objects: 63% (100/158) remote: Compressing objects: 64% (102/158) remote: Compressing objects: 65% (103/158) remote: Compressing objects: 66% (105/158) remote: Compressing objects: 67% (106/158) remote: Compressing objects: 68% (108/158) remote: Compressing objects: 69% (110/158) remote: Compressing objects: 70% (111/158) remote: Compressing objects: 71% (113/158) remote: Compressing objects: 72% (114/158) remote: Compressing objects: 73% (116/158) remote: Compressing objects: 74% (117/158) remote: Compressing objects: 75% (119/158) remote: Compressing objects: 76% (121/158) remote: Compressing objects: 77% (122/158) remote: Compressing objects: 78% (124/158) remote: Compressing objects: 79% (125/158) remote: Compressing objects: 80% (127/158) remote: Compressing objects: 81% (128/158) remote: Compressing objects: 82% (130/158) remote: Compressing objects: 83% (132/158) remote: Compressing objects: 84% (133/158) remote: Compressing objects: 85% (135/158) remote: Compressing objects: 86% (136/158) remote: Compressing objects: 87% (138/158) remote: Compressing objects: 88% (140/158) remote: Compressing objects: 89% (141/158) remote: Compressing objects: 90% (143/158) remote: Compressing objects: 91% (144/158) remote: Compressing objects: 92% (146/158) remote: Compressing objects: 93% (147/158) remote: Compressing objects: 94% (149/158) remote: Compressing objects: 95% (151/158) remote: Compressing objects: 96% (152/158) remote: Compressing objects: 97% (154/158) remote: Compressing objects: 98% (155/158) remote: Compressing objects: 99% (157/158) remote: Compressing objects: 100% (158/158) remote: Compressing objects: 100% (158/158), done.
Receiving objects: 0% (1/1941) Receiving objects: 1% (20/1941) Receiving objects: 2% (39/1941) Receiving objects: 3% (59/1941) Receiving objects: 4% (78/1941) Receiving objects: 5% (98/1941) Receiving objects: 6% (117/1941) Receiving objects: 7% (136/1941) Receiving objects: 8% (156/1941) Receiving objects: 9% (175/1941) Receiving objects: 10% (195/1941) Receiving objects: 11% (214/1941) Receiving objects: 12% (233/1941) Receiving objects: 13% (253/1941) Receiving objects: 14% (272/1941) Receiving objects: 15% (292/1941) Receiving objects: 16% (311/1941) Receiving objects: 17% (330/1941) Receiving objects: 18% (350/1941) Receiving objects: 19% (369/1941) Receiving objects: 20% (389/1941) Receiving objects: 21% (408/1941) Receiving objects: 22% (428/1941) Receiving objects: 23% (447/1941) Receiving objects: 24% (466/1941) Receiving objects: 25% (486/1941) Receiving objects: 26% (505/1941) Receiving objects: 27% (525/1941) Receiving objects: 28% (544/1941) Receiving objects: 29% (563/1941) Receiving objects: 30% (583/1941) Receiving objects: 31% (602/1941) Receiving objects: 32% (622/1941) Receiving objects: 33% (641/1941) Receiving objects: 34% (660/1941) Receiving objects: 35% (680/1941) Receiving objects: 36% (699/1941) Receiving objects: 37% (719/1941) Receiving objects: 38% (738/1941) Receiving objects: 39% (757/1941) Receiving objects: 40% (777/1941) Receiving objects: 41% (796/1941) Receiving objects: 42% (816/1941) Receiving objects: 43% (835/1941) Receiving objects: 44% (855/1941) Receiving objects: 45% (874/1941) Receiving objects: 46% (893/1941) Receiving objects: 47% (913/1941) Receiving objects: 48% (932/1941) Receiving objects: 49% (952/1941) Receiving objects: 50% (971/1941) Receiving objects: 51% (990/1941) Receiving objects: 52% (1010/1941) Receiving objects: 53% (1029/1941) Receiving objects: 54% (1049/1941) Receiving objects: 55% (1068/1941) Receiving objects: 56% (1087/1941) Receiving objects: 57% (1107/1941) Receiving objects: 58% (1126/1941) Receiving objects: 59% (1146/1941) Receiving objects: 60% (1165/1941) Receiving objects: 61% (1185/1941) Receiving objects: 62% (1204/1941) Receiving objects: 63% (1223/1941) Receiving objects: 64% (1243/1941) Receiving objects: 65% (1262/1941) Receiving objects: 66% (1282/1941) Receiving objects: 67% (1301/1941) Receiving objects: 68% (1320/1941) Receiving objects: 69% (1340/1941) Receiving objects: 70% (1359/1941) Receiving objects: 71% (1379/1941) Receiving objects: 72% (1398/1941) Receiving objects: 73% (1417/1941) Receiving objects: 74% (1437/1941) Receiving objects: 75% (1456/1941) Receiving objects: 76% (1476/1941) Receiving objects: 77% (1495/1941) Receiving objects: 78% (1514/1941) Receiving objects: 79% (1534/1941) Receiving objects: 80% (1553/1941) Receiving objects: 81% (1573/1941) Receiving objects: 82% (1592/1941) Receiving objects: 83% (1612/1941) Receiving objects: 84% (1631/1941) Receiving objects: 85% (1650/1941) Receiving objects: 86% (1670/1941) Receiving objects: 87% (1689/1941) Receiving objects: 88% (1709/1941) Receiving objects: 89% (1728/1941) Receiving objects: 90% (1747/1941) Receiving objects: 91% (1767/1941) Receiving objects: 92% (1786/1941) Receiving objects: 93% (1806/1941) Receiving objects: 94% (1825/1941) remote: Total 1941 (delta 696), reused 632 (delta 632), pack-reused 1074
Receiving objects: 95% (1844/1941) Receiving objects: 96% (1864/1941) Receiving objects: 97% (1883/1941) Receiving objects: 98% (1903/1941) Receiving objects: 99% (1922/1941) Receiving objects: 100% (1941/1941) Receiving objects: 100% (1941/1941), 257.33 KiB | 0 bytes/s, done.
Resolving deltas: 0% (0/719) Resolving deltas: 1% (8/719) Resolving deltas: 2% (15/719) Resolving deltas: 3% (22/719) Resolving deltas: 4% (31/719) Resolving deltas: 5% (41/719) Resolving deltas: 6% (47/719) Resolving deltas: 7% (52/719) Resolving deltas: 8% (59/719) Resolving deltas: 9% (70/719) Resolving deltas: 10% (79/719) Resolving deltas: 11% (80/719) Resolving deltas: 12% (87/719) Resolving deltas: 13% (94/719) Resolving deltas: 15% (108/719) Resolving deltas: 16% (119/719) Resolving deltas: 17% (124/719) Resolving deltas: 19% (142/719) Resolving deltas: 20% (145/719) Resolving deltas: 21% (156/719) Resolving deltas: 22% (162/719) Resolving deltas: 23% (166/719) Resolving deltas: 24% (173/719) Resolving deltas: 25% (180/719) Resolving deltas: 26% (187/719) Resolving deltas: 27% (195/719) Resolving deltas: 28% (203/719) Resolving deltas: 29% (210/719) Resolving deltas: 30% (218/719) Resolving deltas: 31% (223/719) Resolving deltas: 32% (231/719) Resolving deltas: 33% (238/719) Resolving deltas: 34% (246/719) Resolving deltas: 35% (252/719) Resolving deltas: 36% (259/719) Resolving deltas: 37% (268/719) Resolving deltas: 38% (274/719) Resolving deltas: 39% (282/719) Resolving deltas: 40% (288/719) Resolving deltas: 41% (296/719) Resolving deltas: 42% (303/719) Resolving deltas: 43% (310/719) Resolving deltas: 44% (317/719) Resolving deltas: 45% (325/719) Resolving deltas: 46% (335/719) Resolving deltas: 47% (338/719) Resolving deltas: 48% (346/719) Resolving deltas: 49% (355/719) Resolving deltas: 50% (360/719) Resolving deltas: 51% (369/719) Resolving deltas: 52% (379/719) Resolving deltas: 53% (383/719) Resolving deltas: 54% (390/719) Resolving deltas: 55% (396/719) Resolving deltas: 56% (403/719) Resolving deltas: 57% (412/719) Resolving deltas: 58% (419/719) Resolving deltas: 59% (425/719) Resolving deltas: 60% (432/719) Resolving deltas: 61% (439/719) Resolving deltas: 62% (447/719) Resolving deltas: 63% (454/719) Resolving deltas: 64% (462/719) Resolving deltas: 65% (470/719) Resolving deltas: 66% (478/719) Resolving deltas: 67% (482/719) Resolving deltas: 68% (490/719) Resolving deltas: 69% (498/719) Resolving deltas: 70% (505/719) Resolving deltas: 71% (511/719) Resolving deltas: 72% (519/719) Resolving deltas: 73% (526/719) Resolving deltas: 74% (533/719) Resolving deltas: 75% (541/719) Resolving deltas: 76% (548/719) Resolving deltas: 77% (555/719) Resolving deltas: 78% (562/719) Resolving deltas: 79% (570/719) Resolving deltas: 80% (576/719) Resolving deltas: 81% (584/719) Resolving deltas: 82% (590/719) Resolving deltas: 83% (598/719) Resolving deltas: 84% (604/719) Resolving deltas: 85% (612/719) Resolving deltas: 86% (619/719) Resolving deltas: 87% (626/719) Resolving deltas: 88% (633/719) Resolving deltas: 89% (640/719) Resolving deltas: 90% (648/719) Resolving deltas: 91% (655/719) Resolving deltas: 92% (662/719) Resolving deltas: 94% (677/719) Resolving deltas: 95% (684/719) Resolving deltas: 96% (693/719) Resolving deltas: 97% (698/719) Resolving deltas: 98% (706/719) Resolving deltas: 99% (713/719) Resolving deltas: 100% (719/719) Resolving deltas: 100% (719/719), completed with 295 local objects.
error: unable to resolve reference refs/remotes/origin/pr/2457/head: No such file or directory
! 2b57dbf...6da2026 refs/pull/2457/head -> origin/pr/2457/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2457/merge: No such file or directory
! c1f2a0c...d158c14 refs/pull/2457/merge -> origin/pr/2457/merge (unable to update local ref)
* [new ref] refs/pull/2516/head -> origin/pr/2516/head
* [new ref] refs/pull/2516/merge -> origin/pr/2516/merge
* [new ref] refs/pull/2517/head -> origin/pr/2517/head
* [new ref] refs/pull/2517/merge -> origin/pr/2517/merge
* [new ref] refs/pull/2518/head -> origin/pr/2518/head
* [new ref] refs/pull/2518/merge -> origin/pr/2518/merge
* [new ref] refs/pull/2519/head -> origin/pr/2519/head
* [new ref] refs/pull/2519/merge -> origin/pr/2519/merge
* [new ref] refs/pull/2520/head -> origin/pr/2520/head
* [new ref] refs/pull/2520/merge -> origin/pr/2520/merge
* [new ref] refs/pull/2521/head -> origin/pr/2521/head
* [new ref] refs/pull/2521/merge -> origin/pr/2521/merge
* [new ref] refs/pull/2522/head -> origin/pr/2522/head
* [new ref] refs/pull/2522/merge -> origin/pr/2522/merge
* [new ref] refs/pull/2523/head -> origin/pr/2523/head
* [new ref] refs/pull/2523/merge -> origin/pr/2523/merge
* [new ref] refs/pull/2524/head -> origin/pr/2524/head
* [new ref] refs/pull/2525/head -> origin/pr/2525/head
* [new ref] refs/pull/2525/merge -> origin/pr/2525/merge
* [new ref] refs/pull/2526/head -> origin/pr/2526/head
* [new ref] refs/pull/2527/head -> origin/pr/2527/head
* [new ref] refs/pull/2527/merge -> origin/pr/2527/merge
* [new ref] refs/pull/2528/head -> origin/pr/2528/head
* [new ref] refs/pull/2528/merge -> origin/pr/2528/merge
* [new ref] refs/pull/2529/head -> origin/pr/2529/head
* [new ref] refs/pull/2529/merge -> origin/pr/2529/merge
* [new ref] refs/pull/2530/head -> origin/pr/2530/head
* [new ref] refs/pull/2530/merge -> origin/pr/2530/merge
* [new ref] refs/pull/2531/head -> origin/pr/2531/head
* [new ref] refs/pull/2531/merge -> origin/pr/2531/merge
* [new ref] refs/pull/2532/head -> origin/pr/2532/head
* [new ref] refs/pull/2532/merge -> origin/pr/2532/merge
* [new ref] refs/pull/2533/head -> origin/pr/2533/head
* [new ref] refs/pull/2533/merge -> origin/pr/2533/merge
* [new ref] refs/pull/2534/head -> origin/pr/2534/head
* [new ref] refs/pull/2534/merge -> origin/pr/2534/merge
* [new ref] refs/pull/2535/head -> origin/pr/2535/head
* [new ref] refs/pull/2535/merge -> origin/pr/2535/merge
* [new ref] refs/pull/2536/head -> origin/pr/2536/head
* [new ref] refs/pull/2536/merge -> origin/pr/2536/merge
* [new ref] refs/pull/2537/head -> origin/pr/2537/head
* [new ref] refs/pull/2537/merge -> origin/pr/2537/merge
* [new ref] refs/pull/2538/head -> origin/pr/2538/head
* [new ref] refs/pull/2538/merge -> origin/pr/2538/merge
* [new ref] refs/pull/2539/head -> origin/pr/2539/head
* [new ref] refs/pull/2539/merge -> origin/pr/2539/merge
* [new ref] refs/pull/2540/head -> origin/pr/2540/head
* [new ref] refs/pull/2540/merge -> origin/pr/2540/merge
* [new ref] refs/pull/2541/head -> origin/pr/2541/head
* [new ref] refs/pull/2541/merge -> origin/pr/2541/merge
* [new ref] refs/pull/2542/head -> origin/pr/2542/head
* [new ref] refs/pull/2542/merge -> origin/pr/2542/merge
* [new ref] refs/pull/2543/head -> origin/pr/2543/head
* [new ref] refs/pull/2543/merge -> origin/pr/2543/merge
* [new ref] refs/pull/2544/head -> origin/pr/2544/head
* [new ref] refs/pull/2544/merge -> origin/pr/2544/merge
* [new ref] refs/pull/2545/head -> origin/pr/2545/head
* [new ref] refs/pull/2545/merge -> origin/pr/2545/merge
* [new ref] refs/pull/2546/head -> origin/pr/2546/head
* [new ref] refs/pull/2546/merge -> origin/pr/2546/merge
* [new ref] refs/pull/2547/head -> origin/pr/2547/head
* [new ref] refs/pull/2547/merge -> origin/pr/2547/merge
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1793)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1519)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:64)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:315)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor807.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy97.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision f7d727c0f7ada7a162f5cb73f658ce52f094dd86 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f f7d727c0f7ada7a162f5cb73f658ce52f094dd86
> git rev-list f7d727c0f7ada7a162f5cb73f658ce52f094dd86 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3073561050663803706.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5106164085112923022.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3489441953458436907.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3948071831209831805.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-16 06:02:50,510 21cf9cc3 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/21cf9cc3/pkb.log
2017-04-16 06:02:50,510 21cf9cc3 MainThread INFO PerfKitBenchmarker version: v1.11.0-40-g1f4031b
2017-04-16 06:02:50,511 21cf9cc3 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-16 06:02:50,771 21cf9cc3 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-16 06:02:50,861 21cf9cc3 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-16 06:02:50,863 21cf9cc3 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-16 06:02:50,864 21cf9cc3 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-16 06:02:50,870 21cf9cc3 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-16 06:02:50,872 21cf9cc3 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-16 06:02:50,894 21cf9cc3 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-16 06:02:50,894 21cf9cc3 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/21cf9cc3/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #376
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/376/display/redirect?page=changes>
Changes:
[klk] Activate WindowedWordCountIT on Apex runner
[klk] No parallelism for Apex WindowedWordCountIT
[dhalperi] [BEAM-2016] Delete HdfsFileSource & Sink
[tgroh] Run Optimize Imports on the Repository
[tgroh] Move AppliedPTransform into the Runners package
[tgroh] Convert Coder into an Abstract Static Class
[dhalperi] [BEAM-59] Fully delete IOChannelUtils
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on beam8 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/>
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/*
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 0d2a0aeeef92bdbc23e4061ec066da47e3c7de38 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 0d2a0aeeef92bdbc23e4061ec066da47e3c7de38
> git rev-list 3bffe0e0014bdd6ae73dc2e8ecfc2b61d066120c # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson6165280624966686801.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4580259411695657974.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson991341416332915944.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4900402012477053724.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-05-05 18:54:23,115 424c35d3 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/424c35d3/pkb.log
2017-05-05 18:54:23,115 424c35d3 MainThread INFO PerfKitBenchmarker version: v1.11.0-49-g10dd95b
2017-05-05 18:54:23,116 424c35d3 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-05-05 18:54:23,645 424c35d3 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-05-05 18:54:23,740 424c35d3 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-05-05 18:54:23,743 424c35d3 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-05-05 18:54:23,743 424c35d3 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-05-05 18:54:23,748 424c35d3 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 543, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 459, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-05-05 18:54:23,750 424c35d3 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-05-05 18:54:23,776 424c35d3 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-05-05 18:54:23,776 424c35d3 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/424c35d3/pkb.log
2017-05-05 18:54:23,777 424c35d3 MainThread INFO Completion statuses can be found at: /tmp/perfkitbenchmarker/runs/424c35d3/completion_statuses.json
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #375
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/375/display/redirect?page=changes>
Changes:
[aljoscha.krettek] [BEAM-1862] SplittableDoFnOperator should close the
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on beam5 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/>
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/*
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 3bffe0e0014bdd6ae73dc2e8ecfc2b61d066120c (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 3bffe0e0014bdd6ae73dc2e8ecfc2b61d066120c
> git rev-list 7903e59c4e07822f8def85ee6a7f8ef3ccb1ca7a # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2417919858563827519.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson7895987214291620795.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2766035856415306403.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5946974480346757738.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-05-05 12:00:18,732 d6d41712 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/d6d41712/pkb.log
2017-05-05 12:00:18,732 d6d41712 MainThread INFO PerfKitBenchmarker version: v1.11.0-49-g10dd95b
2017-05-05 12:00:18,733 d6d41712 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-05-05 12:00:19,014 d6d41712 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-05-05 12:00:19,172 d6d41712 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-05-05 12:00:19,176 d6d41712 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-05-05 12:00:19,177 d6d41712 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-05-05 12:00:19,185 d6d41712 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 543, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 459, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-05-05 12:00:19,187 d6d41712 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-05-05 12:00:19,240 d6d41712 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-05-05 12:00:19,240 d6d41712 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/d6d41712/pkb.log
2017-05-05 12:00:19,240 d6d41712 MainThread INFO Completion statuses can be found at: /tmp/perfkitbenchmarker/runs/d6d41712/completion_statuses.json
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #374
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/374/display/redirect?page=changes>
Changes:
[klk] Move Java sdk.util.state to sdk.state
[klk] Add @Internal and @Experimental to state package
[klk] Move user-facing timer-related classes out of util
[klk] Mark TimeDomain experimental alongside Timers; improve javadoc
[klk] Move WindowingStrategy from util to values
[klk] Move PathValidator adjacent to other filesystem bits
[klk] Move SideInputReader to runners/core-java
[klk] Move Reshuffle and ReshuffleTrigger out of util
[klk] Move ValueWithRecordId to sdk.values, annotated
[klk] Move some PCollectionView bits out of util
[klk] Update Dataflow worker to 20170504-2
[tgroh] Update expectation in ProcessBundleHandlerTest
[dhalperi] [BEAM-1871] Move out test only utilities used only in examples/java out
[dhalperi] Revert "This closes #2905"
[klk] Adjust error message expectation in DoFnSignaturesTest
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on beam5 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/>
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/*
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 7903e59c4e07822f8def85ee6a7f8ef3ccb1ca7a (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 7903e59c4e07822f8def85ee6a7f8ef3ccb1ca7a
> git rev-list 2f4dd8dfaf9e94ff2a1f97edc695fbcd75be34cd # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson7538084356404224735.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4042714355130252232.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson426470528539862612.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4859371696513139763.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-05-05 06:00:18,988 fd9fd549 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/fd9fd549/pkb.log
2017-05-05 06:00:18,988 fd9fd549 MainThread INFO PerfKitBenchmarker version: v1.11.0-49-g10dd95b
2017-05-05 06:00:18,989 fd9fd549 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-05-05 06:00:19,229 fd9fd549 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-05-05 06:00:19,314 fd9fd549 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-05-05 06:00:20,165 fd9fd549 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-05-05 06:00:20,165 fd9fd549 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-05-05 06:00:20,170 fd9fd549 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 543, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 459, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-05-05 06:00:20,172 fd9fd549 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-05-05 06:00:20,203 fd9fd549 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-05-05 06:00:20,204 fd9fd549 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/fd9fd549/pkb.log
2017-05-05 06:00:20,204 fd9fd549 MainThread INFO Completion statuses can be found at: /tmp/perfkitbenchmarker/runs/fd9fd549/completion_statuses.json
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #373
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/373/display/redirect?page=changes>
Changes:
[dhalperi] GCP-IO: manage versions in top level pom
[dhalperi] Remove IOChannelUtil/Factory from BigQueryIO
[klk] Eliminate Pipeline.getOptions
[robertwb] Cleanup old cython files before testing again
[klk] [BEAM-1727] Add align and offset to Timer
[klk] Fix initial watermark of DoFnOperator in Flink runner
[dhalperi] [BEAM-59] Remove IOChannelUtils, IOChannelFactory
[dhalperi] Move thrown.expect to correct place
[tgroh] Note when checkpoints may be committed.
[tgroh] Split StartBundleContext and FinishBundleContext
[kirpichov] [BEAM-2170] PubsubMessageWithAttributesCoder should not NPE on messages
[kirpichov] Makes PubsubMessagePayloadOnlyCoder not require whole-stream context
[kirpichov] Moves coder choice into PubsubSource
[davor] [BEAM-2144] Remove transform.reflect and utils from Javadocs
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on beam5 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/>
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/*
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 2f4dd8dfaf9e94ff2a1f97edc695fbcd75be34cd (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 2f4dd8dfaf9e94ff2a1f97edc695fbcd75be34cd
> git rev-list b73918b55ab06e5a47ef9dc33ae3dbaebaed330a # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson227170201862895542.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5916819713713284246.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5309455617960359779.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson7566161025314604258.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-05-05 00:00:58,427 4a3fc96e MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/4a3fc96e/pkb.log
2017-05-05 00:00:58,465 4a3fc96e MainThread INFO PerfKitBenchmarker version: v1.11.0-49-g10dd95b
2017-05-05 00:00:58,465 4a3fc96e MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-05-05 00:00:59,060 4a3fc96e MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-05-05 00:00:59,163 4a3fc96e MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-05-05 00:00:59,165 4a3fc96e MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-05-05 00:00:59,166 4a3fc96e MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-05-05 00:00:59,170 4a3fc96e MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 543, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 459, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-05-05 00:00:59,172 4a3fc96e MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-05-05 00:00:59,200 4a3fc96e MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-05-05 00:00:59,201 4a3fc96e MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/4a3fc96e/pkb.log
2017-05-05 00:00:59,201 4a3fc96e MainThread INFO Completion statuses can be found at: /tmp/perfkitbenchmarker/runs/4a3fc96e/completion_statuses.json
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #372
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/372/display/redirect?page=changes>
Changes:
[klk] Annotate internal methods of PCollection
[klk] Annotate internal pieces of sdks.transforms
[klk] Tighten access control and internal annotations for triggers
[klk] The transforms.reflect package is not for users
[klk] Annotate internal-only bits of Java sdk.runners
[klk] Tighten access in sdk.options
[klk] Annotate internal methods on Pipeline
[lcwik] [BEAM-2165] Update Apex to support serializing/deserializing custom user
[lcwik] [BEAM-2165] Update Dataflow to support serializing/deserializing custom
[lcwik] [BEAM-2165] Update Flink to support serializing/deserializing custom
[lcwik] [BEAM-1871] Migrate ReleaseInfo away from Google API client GenericJson
[dhalperi] DataflowRunner: integration test GCP-IO
[lcwik] [BEAM-1491]Identify HADOOP_CONF_DIR(or YARN_CONF_DIR) environment
[lcwik] Split Coder's encode/decode methods into two methods depending on
[dhalperi] [BEAM-2162] Add logging to long BigQuery jobs
[tgroh] Use BinaryCombineLongFn in GroupIntoBatches
[altay] [BEAM-2152] Remove gcloud auth as application default credentials does
[dhalperi] AvroIOTest: stop using IOChannelUtils, remove invalid test
[dhalperi] DataflowRunner: switch from IOChannels to FileSystems for creating files
[dhalperi] DataflowPipelineOptions: use FileSystems, not IOChannelUtils, to resolve
[dhalperi] Stop registering IOChannelFactories in SDK harness, runners, tests
[dhalperi] FileSystems: add match(String) for single spec
[dhalperi] WriteWithShardingFactoryTest: switch to FileSystems
[dhalperi] ReadTranslator: remove outdated comment
[dhalperi] TFRecordIO: switch to FileSystems from IOChannelUtils
[lcwik] Remove POutput#recordAsOutput
[robertwb] One more TaggedOutput name change.
[dhalperi] Update JavaDoc of checkpoint, and expose `enable.auto.commit` for more
[lcwik] Use CloudObject encodings in the Beam Fn Harness
[aviemzur] [BEAM-1763] Verify PAssert execution in runners which support metrics.
[aviemzur] [BEAM-1726] Fix empty side inputs in Flink Streaming Runner
[aviemzur] [BEAM-1726] Fix RuntimeException throwing in FlinkStateInternals
[aviemzur] [BEAM-1726] Fix Flatten with input copies in Flink Streaming Runner
[aviemzur] [BEAM-1763] Replace usage of PipelineRule with TestPipeline in Spark
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on beam2 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/>
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/*
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision b73918b55ab06e5a47ef9dc33ae3dbaebaed330a (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f b73918b55ab06e5a47ef9dc33ae3dbaebaed330a
> git rev-list ff6bb353002610169a8079d1164118606bebb21e # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson8302199996735440149.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson6393172615410736925.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4182315741520362001.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2998196018294298494.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-05-04 18:18:28,736 8fcb4f87 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/8fcb4f87/pkb.log
2017-05-04 18:18:28,736 8fcb4f87 MainThread INFO PerfKitBenchmarker version: v1.11.0-48-ge557505
2017-05-04 18:18:28,737 8fcb4f87 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-05-04 18:18:29,449 8fcb4f87 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-05-04 18:18:29,614 8fcb4f87 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-05-04 18:18:29,617 8fcb4f87 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-05-04 18:18:29,617 8fcb4f87 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-05-04 18:18:29,624 8fcb4f87 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 543, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 459, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-05-04 18:18:29,627 8fcb4f87 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-05-04 18:18:29,681 8fcb4f87 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-05-04 18:18:29,682 8fcb4f87 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/8fcb4f87/pkb.log
2017-05-04 18:18:29,682 8fcb4f87 MainThread INFO Completion statuses can be found at: /tmp/perfkitbenchmarker/runs/8fcb4f87/completion_statuses.json
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #371
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/371/display/redirect>
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on beam5 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/>
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/*
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision ff6bb353002610169a8079d1164118606bebb21e (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f ff6bb353002610169a8079d1164118606bebb21e
> git rev-list ff6bb353002610169a8079d1164118606bebb21e # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson1079305215059373945.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson400584237070228302.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson6782621028537445695.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2869572068032251778.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-05-04 12:01:19,146 397f971b MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/397f971b/pkb.log
2017-05-04 12:01:19,147 397f971b MainThread INFO PerfKitBenchmarker version: v1.11.0-48-ge557505
2017-05-04 12:01:19,147 397f971b MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-05-04 12:01:19,263 397f971b MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-05-04 12:01:19,350 397f971b MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-05-04 12:01:19,352 397f971b MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-05-04 12:01:19,352 397f971b MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-05-04 12:01:19,358 397f971b MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 543, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 459, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-05-04 12:01:19,360 397f971b MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-05-04 12:01:19,386 397f971b MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-05-04 12:01:19,386 397f971b MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/397f971b/pkb.log
2017-05-04 12:01:19,386 397f971b MainThread INFO Completion statuses can be found at: /tmp/perfkitbenchmarker/runs/397f971b/completion_statuses.json
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #370
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/370/display/redirect?page=changes>
Changes:
[dhalperi] Convert WriteFiles/FileBasedSink from IOChannelFactory to FileSystems
[tgroh] Inline TypedPValue
[lcwik] [BEAM-2157] Fix HDFS Test That Failed in Other JDK Versions
[kirpichov] Provides a default coder for PubsubMessage
[kirpichov] Moves PubsubMessage to upper level and renames payload
[klk] BigQueryIO: Remove tempLocation usage at pipeline construction time
[dhalperi] Removal of Aggregator class. Also removal from comments.
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on beam5 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/>
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/*
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision ff6bb353002610169a8079d1164118606bebb21e (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f ff6bb353002610169a8079d1164118606bebb21e
> git rev-list b4bafd09282cf66adf121b750d3e2d9e5a0fefbe # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson1444438434785476686.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson7081035498281775005.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2859973814943599527.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson7637998100796022197.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-05-04 06:00:42,550 b7a79798 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/b7a79798/pkb.log
2017-05-04 06:00:42,550 b7a79798 MainThread INFO PerfKitBenchmarker version: v1.11.0-48-ge557505
2017-05-04 06:00:42,550 b7a79798 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-05-04 06:00:42,855 b7a79798 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-05-04 06:00:42,964 b7a79798 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-05-04 06:00:42,966 b7a79798 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-05-04 06:00:42,967 b7a79798 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-05-04 06:00:42,972 b7a79798 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 543, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 459, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-05-04 06:00:42,974 b7a79798 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-05-04 06:00:43,001 b7a79798 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-05-04 06:00:43,002 b7a79798 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/b7a79798/pkb.log
2017-05-04 06:00:43,002 b7a79798 MainThread INFO Completion statuses can be found at: /tmp/perfkitbenchmarker/runs/b7a79798/completion_statuses.json
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #369
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/369/display/redirect?page=changes>
Changes:
[klk] Use Thread context ClassLoader as parent in AvroCoderTest
[tgroh] Mark all PCollectionView methods internal
[lcwik] [BEAM-1871] Move GCP specific serialization CloudObject and supporting
[tgroh] Reduce visibility of DirectRunner classes
[altay] Retry on correct error codes for datastoreio
[robertwb] Try PTransform-based coder inference before using fallback coder.
[robertwb] Fix coder inference ambiguity in CombineFnsTest.
[klk] Remove job name usages from BigQueryIO at pipeline construction time
[kirpichov] Fully general dynamic tables (including schemas) in BigQueryIO.
[kirpichov] Fixes PubsubIO.Write translation in Dataflow runner
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on beam2 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/>
Cloning the remote Git repository
Cloning repository https://github.com/apache/beam.git
> git init <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/> # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/*
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
> git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/*
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision b4bafd09282cf66adf121b750d3e2d9e5a0fefbe (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f b4bafd09282cf66adf121b750d3e2d9e5a0fefbe
> git rev-list 0d19d3cb210ef179e1831b971f7cf6d3d6bb1dde # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson197114110450717999.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2867269520771524429.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4022959279102052127.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson1410710530977960850.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-05-04 00:03:05,091 822da785 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/822da785/pkb.log
2017-05-04 00:03:05,093 822da785 MainThread INFO PerfKitBenchmarker version: v1.11.0-48-ge557505
2017-05-04 00:03:05,094 822da785 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-05-04 00:03:05,598 822da785 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-05-04 00:03:05,733 822da785 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-05-04 00:03:05,736 822da785 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-05-04 00:03:05,736 822da785 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-05-04 00:03:05,748 822da785 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 543, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 459, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-05-04 00:03:05,750 822da785 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-05-04 00:03:05,803 822da785 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-05-04 00:03:05,804 822da785 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/822da785/pkb.log
2017-05-04 00:03:05,804 822da785 MainThread INFO Completion statuses can be found at: /tmp/perfkitbenchmarker/runs/822da785/completion_statuses.json
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #368
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/368/display/redirect?page=changes>
Changes:
[klk] Use LinkedHashMap for step contexts in BaseExecutionContext
[dhalperi] Remove IoChannelUtils from PackageUtil
[dhalperi] [BEAM-59] FileChecksumMatcherTest: switch from IOChannelUtils to java
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on beam7 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/>
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/*
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 0d19d3cb210ef179e1831b971f7cf6d3d6bb1dde (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 0d19d3cb210ef179e1831b971f7cf6d3d6bb1dde
> git rev-list 3b61f6a9034b3dbb8b08f695b7b526656660c8a6 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson8822402256232841916.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson6143726776491349836.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5896650652856289214.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3659993746409279566.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-05-03 18:04:37,849 33130c4f MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/33130c4f/pkb.log
2017-05-03 18:04:37,849 33130c4f MainThread INFO PerfKitBenchmarker version: v1.11.0-48-ge557505
2017-05-03 18:04:37,850 33130c4f MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-05-03 18:04:38,526 33130c4f MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-05-03 18:04:38,662 33130c4f MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-05-03 18:04:38,664 33130c4f MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-05-03 18:04:38,665 33130c4f MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-05-03 18:04:38,673 33130c4f MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 543, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 459, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-05-03 18:04:38,676 33130c4f MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-05-03 18:04:38,709 33130c4f MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-05-03 18:04:38,709 33130c4f MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/33130c4f/pkb.log
2017-05-03 18:04:38,710 33130c4f MainThread INFO Completion statuses can be found at: /tmp/perfkitbenchmarker/runs/33130c4f/completion_statuses.json
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #367
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/367/display/redirect?page=changes>
Changes:
[vikasrk] Triggers for Java SDK post submit tests
[kirpichov] Removed coder and parseFn from PubsubIO.Read
[kirpichov] Removed coder and formatFn from PubsubIO.Write
[kirpichov] Introduces read/writePubsubMessages
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on beam5 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/>
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/*
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 3b61f6a9034b3dbb8b08f695b7b526656660c8a6 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 3b61f6a9034b3dbb8b08f695b7b526656660c8a6
> git rev-list dc0fdcb7e62067fdc629b8558659fce7e37e4856 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5223032132045342938.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3069112977640495240.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2562948682559758564.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4871808138669294515.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-05-03 12:00:18,040 00eb0167 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/00eb0167/pkb.log
2017-05-03 12:00:18,041 00eb0167 MainThread INFO PerfKitBenchmarker version: v1.11.0-48-ge557505
2017-05-03 12:00:18,041 00eb0167 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-05-03 12:00:18,338 00eb0167 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-05-03 12:00:18,436 00eb0167 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-05-03 12:00:18,439 00eb0167 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-05-03 12:00:18,439 00eb0167 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-05-03 12:00:18,445 00eb0167 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 543, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 459, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-05-03 12:00:18,448 00eb0167 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-05-03 12:00:18,467 00eb0167 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-05-03 12:00:18,468 00eb0167 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/00eb0167/pkb.log
2017-05-03 12:00:18,468 00eb0167 MainThread INFO Completion statuses can be found at: /tmp/perfkitbenchmarker/runs/00eb0167/completion_statuses.json
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #366
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/366/display/redirect?page=changes>
Changes:
[robertwb] Deprecate <pipeline>.options usage
[lcwik] Remove Coder.asCloudObject and related methods
[altay] Updating Dataflow API protos and client
[tgroh] Add Additional CloudObjectTranslators
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on beam5 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/>
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/*
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision dc0fdcb7e62067fdc629b8558659fce7e37e4856 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f dc0fdcb7e62067fdc629b8558659fce7e37e4856
> git rev-list 3bb0f8e6ad8a2b378a656731732a79c9c16e4a8d # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4609501167634798019.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson9117219116175138012.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson380355071913316710.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson6791561348024361129.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-05-03 06:00:33,733 714e3efe MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/714e3efe/pkb.log
2017-05-03 06:00:33,733 714e3efe MainThread INFO PerfKitBenchmarker version: v1.11.0-48-ge557505
2017-05-03 06:00:33,734 714e3efe MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-05-03 06:00:33,998 714e3efe MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-05-03 06:00:34,082 714e3efe MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-05-03 06:00:34,084 714e3efe MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-05-03 06:00:34,085 714e3efe MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-05-03 06:00:34,090 714e3efe MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 543, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 459, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-05-03 06:00:34,092 714e3efe MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-05-03 06:00:34,119 714e3efe MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-05-03 06:00:34,119 714e3efe MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/714e3efe/pkb.log
2017-05-03 06:00:34,120 714e3efe MainThread INFO Completion statuses can be found at: /tmp/perfkitbenchmarker/runs/714e3efe/completion_statuses.json
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #365
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/365/display/redirect?page=changes>
Changes:
[klk] Use processing time for synchronized processing time in Flink runner
[klk] Simplify type parameters of StateSpec and related
[klk] Make DoFnSignatures robust to StateSpec subclasses
[kirpichov] Removes leftover no-op withoutValidation methods
[kirpichov] Removes TextIO.Read.Bound
[kirpichov] Converts TextIO.Read to AutoValue
[kirpichov] Removes TextIO.Write.Bound
[kirpichov] Converts TextIO.Write to AutoValue
[kirpichov] Moves TextSource and TextSink to top level
[lcwik] [BEAM-2135] Move hdfs to hadoop-file-system
[dhalperi] [BEAM-2141] Disable JDBC tests
[dhalperi] BigQuery: swap from asSingleton to asIterable for Cleanup
[lcwik] [BEAM-2020] Convert all unknown Coders into CustomCoder CloudObjects
[chamikara] [BEAM-539] Fixes several issues of FileSink.
[altay] [BEAM-1316] Remove the usage of mock from ptransform tests
[lcwik] [BEAM-2135] Fix pointers to GCP-core
[klk] Skip null options when converting back to argv
[klk] Instantiate runner briefly in Pipeline
[lcwik] [BEAM-2135] Fix pointers to sdks/java/io/hadoop-file-system
[davor] [BEAM-2093] Use the jackson version from the maven property in maven
[dhalperi] [BEAM-59] Delete old restrictions on output file paths
[lcwik] [BEAM-2139] Disable SplittableDoFn ValidatesRunner tests for Streaming
[dhalperi] [BEAM-59] Move GcsFileSystem to gcp-core
[dhalperi] Full removal of Aggregators in Java SDK and Runners
[davor] Include LICENSE and NOTICE in python dist files
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on beam1 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/>
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/*
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 3bb0f8e6ad8a2b378a656731732a79c9c16e4a8d (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 3bb0f8e6ad8a2b378a656731732a79c9c16e4a8d
> git rev-list eec903fb538eb9c3d41d737dba94a41f7c1c469e # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4423006436169070601.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5338004820536756484.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson1500182718279178360.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5189078248202599501.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-05-03 00:02:38,285 bc160be8 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/bc160be8/pkb.log
2017-05-03 00:02:38,285 bc160be8 MainThread INFO PerfKitBenchmarker version: v1.11.0-48-ge557505
2017-05-03 00:02:38,286 bc160be8 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-05-03 00:02:38,833 bc160be8 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-05-03 00:02:38,932 bc160be8 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-05-03 00:02:38,934 bc160be8 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-05-03 00:02:38,934 bc160be8 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-05-03 00:02:38,939 bc160be8 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 543, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 459, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-05-03 00:02:38,941 bc160be8 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-05-03 00:02:38,962 bc160be8 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-05-03 00:02:38,963 bc160be8 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/bc160be8/pkb.log
2017-05-03 00:02:38,963 bc160be8 MainThread INFO Completion statuses can be found at: /tmp/perfkitbenchmarker/runs/bc160be8/completion_statuses.json
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #364
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/364/display/redirect?page=changes>
Changes:
[wtanaka] Add comments to Trigger.java
[iemejia] [BEAM-1764] Remove aggregators from Flink Runner
[davor] Update github PR template after travis removal.
[altay] Add retry logic for job creation
[tgroh] Add an @Internal Annotation
[robertwb] Revert clean else-return lint changes.
[lcwik] [BEAM-2135] Move gcp-core to google-cloud-platform-core
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on beam4 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/>
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/*
ERROR: Error fetching remote repo 'origin'
hudson.plugins.git.GitException: Failed to fetch from https://github.com/apache/beam.git
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:809)
at hudson.plugins.git.GitSCM.retrieveChanges(GitSCM.java:1076)
at hudson.plugins.git.GitSCM.checkout(GitSCM.java:1107)
at hudson.scm.SCM.checkout(SCM.java:496)
at hudson.model.AbstractProject.checkout(AbstractProject.java:1281)
at hudson.model.AbstractBuild$AbstractBuildExecution.defaultCheckout(AbstractBuild.java:604)
at jenkins.scm.SCMCheckoutStrategy.checkout(SCMCheckoutStrategy.java:86)
at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:529)
at hudson.model.Run.execute(Run.java:1728)
at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
at hudson.model.ResourceController.execute(ResourceController.java:98)
at hudson.model.Executor.run(Executor.java:405)
Caused by: hudson.plugins.git.GitException: Command "git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/*" returned status code 128:
stdout:
stderr: error: RPC failed; result=18, HTTP code = 200
fatal: The remote end hung up unexpectedly
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1866)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1585)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:71)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:348)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam4(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1545)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:830)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor788.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy103.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:807)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/*
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision eec903fb538eb9c3d41d737dba94a41f7c1c469e (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f eec903fb538eb9c3d41d737dba94a41f7c1c469e
> git rev-list ae72456b7125a28f2db4b8dad2990b2bb063ca9b # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson8706026561929483622.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson425751425269746362.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4441358561143021270.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson1024427901516202230.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-05-02 18:25:21,716 554ad8e1 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/554ad8e1/pkb.log
2017-05-02 18:25:21,718 554ad8e1 MainThread INFO PerfKitBenchmarker version: v1.11.0-47-gb38dddb
2017-05-02 18:25:21,719 554ad8e1 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-05-02 18:25:22,240 554ad8e1 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-05-02 18:25:22,450 554ad8e1 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-05-02 18:25:22,454 554ad8e1 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-05-02 18:25:22,454 554ad8e1 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-05-02 18:25:22,462 554ad8e1 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 543, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 459, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-05-02 18:25:22,465 554ad8e1 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-05-02 18:25:22,509 554ad8e1 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-05-02 18:25:22,510 554ad8e1 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/554ad8e1/pkb.log
2017-05-02 18:25:22,510 554ad8e1 MainThread INFO Completion statuses can be found at: /tmp/perfkitbenchmarker/runs/554ad8e1/completion_statuses.json
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #363
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/363/display/redirect?page=changes>
Changes:
[dhalperi] Remove Aggregators from StatefulDoFn runner
[dhalperi] Removing Aggregator from core runner code
[dhalperi] Remove accumulators from DoFn tester.
[jbonofre] Remove unneeded elements from the POM files
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on beam5 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/>
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/*
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision ae72456b7125a28f2db4b8dad2990b2bb063ca9b (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f ae72456b7125a28f2db4b8dad2990b2bb063ca9b
> git rev-list e92ead58cd661ff7ee952278f2983a578bdd2412 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson8808595505571951135.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5575995026223943279.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4231598413718564875.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4168573447482597019.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-05-02 12:00:25,291 c5c7fb81 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/c5c7fb81/pkb.log
2017-05-02 12:00:25,291 c5c7fb81 MainThread INFO PerfKitBenchmarker version: v1.11.0-47-gb38dddb
2017-05-02 12:00:25,292 c5c7fb81 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-05-02 12:00:25,623 c5c7fb81 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-05-02 12:00:25,715 c5c7fb81 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-05-02 12:00:25,717 c5c7fb81 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-05-02 12:00:25,718 c5c7fb81 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-05-02 12:00:25,723 c5c7fb81 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 543, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 459, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-05-02 12:00:25,726 c5c7fb81 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-05-02 12:00:25,746 c5c7fb81 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-05-02 12:00:25,746 c5c7fb81 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/c5c7fb81/pkb.log
2017-05-02 12:00:25,747 c5c7fb81 MainThread INFO Completion statuses can be found at: /tmp/perfkitbenchmarker/runs/c5c7fb81/completion_statuses.json
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #362
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/362/display/redirect?page=changes>
Changes:
[robertwb] Fn API support for Python.
[robertwb] Rename OutputValue to TaggedOutput.
[lcwik] Copy CloudObject to the Dataflow Module
[lcwik] [BEAM-1871] Remove deprecated org.apache.beam.sdk.options.GcsOptions
[kirpichov] Fixes javadoc of TextIO to not point to AvroIO
[kirpichov] Moves AvroSink to upper level
[kirpichov] Removes AvroIO.Read.Bound
[kirpichov] Adds AvroIO.readGenericRecords()
[kirpichov] Converts AvroIO.Read to AutoValue
[kirpichov] Removes AvroIO.Write.Bound
[kirpichov] Moves AvroIO.Read.withSchema into read()
[kirpichov] Converts AvroIO.Write to AutoValue; adds writeGenericRecords()
[kirpichov] Moves AvroIO.write().withSchema into write()
[kirpichov] Scattered minor improvements per review comments
[dhalperi] maptask_executor_runner_test: build fix
[lcwik] [BEAM-2005, BEAM-2030, BEAM-2031, BEAM-2032, BEAM-2033, BEAM-2070] Base
[lcwik] [BEAM-2005] Fix build break, ignore test due to change in
[lcwik] Remove aggregators from DoFn contexts and internal SDK usage
[dhalperi] [BEAM-59] Core tests: stop using gs:// paths
[dhalperi] [BEAM-59] TFRecordIOTest: cleanup
[dhalperi] [BEAM-59] DataflowRunnerTests: configure FileSystems in test
[dhalperi] [BEAM-59] AvroIOTest: use absolute paths for display data
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on beam5 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/>
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/*
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision e92ead58cd661ff7ee952278f2983a578bdd2412 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f e92ead58cd661ff7ee952278f2983a578bdd2412
> git rev-list b8131fe935d00db7f760b6410a4eb2239db1d25a # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson7353765744138912579.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5378899830644152793.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3104503862056589697.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson6892438915894804756.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-05-02 06:00:32,557 3603e1c1 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/3603e1c1/pkb.log
2017-05-02 06:00:32,558 3603e1c1 MainThread INFO PerfKitBenchmarker version: v1.11.0-47-gb38dddb
2017-05-02 06:00:32,558 3603e1c1 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-05-02 06:00:32,904 3603e1c1 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-05-02 06:00:32,994 3603e1c1 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-05-02 06:00:32,997 3603e1c1 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-05-02 06:00:32,997 3603e1c1 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-05-02 06:00:33,002 3603e1c1 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 543, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 459, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-05-02 06:00:33,004 3603e1c1 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-05-02 06:00:33,031 3603e1c1 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-05-02 06:00:33,032 3603e1c1 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/3603e1c1/pkb.log
2017-05-02 06:00:33,032 3603e1c1 MainThread INFO Completion statuses can be found at: /tmp/perfkitbenchmarker/runs/3603e1c1/completion_statuses.json
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #361
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/361/display/redirect?page=changes>
Changes:
[klk] Do not repeat log messages in DataflowPipelineJob
[tgroh] Add A CoderTranslator Interface
[lcwik] Re-enable WindowedWordCountIT on Flink runner in precommit
[tgroh] Add Cloud Object Translators for Coders
[dhalperi] [BEAM-1676] Internalize ClassPath from Guava 21.0 to fix the failures
[lcwik] [BEAM-1871] Hide CloudResourceManager client in
[chamikara] [BEAM-1925] Remove deprecated context param from DoFn
[dhalperi] Remove IOChannelUtils from BigQuery TableRowWriter
[dhalperi] [BEAM-59] Switch mimeType from mutable protected field to constructor
[lcwik] Add CloudObjectTranslators for Avro, Serializable
[altay] [BEAM-1441] remove manual join from apiclient
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on beam1 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/>
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/*
ERROR: Error fetching remote repo 'origin'
hudson.plugins.git.GitException: Failed to fetch from https://github.com/apache/beam.git
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:809)
at hudson.plugins.git.GitSCM.retrieveChanges(GitSCM.java:1076)
at hudson.plugins.git.GitSCM.checkout(GitSCM.java:1107)
at hudson.scm.SCM.checkout(SCM.java:496)
at hudson.model.AbstractProject.checkout(AbstractProject.java:1281)
at hudson.model.AbstractBuild$AbstractBuildExecution.defaultCheckout(AbstractBuild.java:604)
at jenkins.scm.SCMCheckoutStrategy.checkout(SCMCheckoutStrategy.java:86)
at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:529)
at hudson.model.Run.execute(Run.java:1728)
at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
at hudson.model.ResourceController.execute(ResourceController.java:98)
at hudson.model.Executor.run(Executor.java:405)
Caused by: hudson.plugins.git.GitException: Command "git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/*" returned status code 128:
stdout:
stderr: error: RPC failed; result=18, HTTP code = 200
fatal: The remote end hung up unexpectedly
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1866)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1585)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:71)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:348)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam1(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1545)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:830)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor788.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy103.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:807)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/*
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision b8131fe935d00db7f760b6410a4eb2239db1d25a (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f b8131fe935d00db7f760b6410a4eb2239db1d25a
> git rev-list fe2a32000be87bbed1e8ae5a81a8e0368f0b0234 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson6960404443284401470.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson6555700586416662445.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson6545264446819990109.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3892156480876229696.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-05-02 00:05:08,036 b3752e07 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/b3752e07/pkb.log
2017-05-02 00:05:08,036 b3752e07 MainThread INFO PerfKitBenchmarker version: v1.11.0-47-gb38dddb
2017-05-02 00:05:08,036 b3752e07 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-05-02 00:05:08,480 b3752e07 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-05-02 00:05:08,569 b3752e07 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-05-02 00:05:08,571 b3752e07 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-05-02 00:05:08,572 b3752e07 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-05-02 00:05:08,577 b3752e07 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 543, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 459, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-05-02 00:05:08,586 b3752e07 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-05-02 00:05:08,605 b3752e07 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-05-02 00:05:08,605 b3752e07 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/b3752e07/pkb.log
2017-05-02 00:05:08,606 b3752e07 MainThread INFO Completion statuses can be found at: /tmp/perfkitbenchmarker/runs/b3752e07/completion_statuses.json
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #360
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/360/display/redirect?page=changes>
Changes:
[staslevin] [BEAM-2074,BEAM-2073] Fixed SourceDStream's rate control usage.
[lcwik] Use a new ReflectData for each AvroCoder instance
[lcwik] [BEAM-2130] Ensure the options id is never null.
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on beam5 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/>
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/*
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision fe2a32000be87bbed1e8ae5a81a8e0368f0b0234 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f fe2a32000be87bbed1e8ae5a81a8e0368f0b0234
> git rev-list 254470e626edb6a013ba5cb2d3312dc3bfbdcb51 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson7363877203267415167.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5694443500676162576.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2268732869890752569.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson7788084381097802984.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-05-01 18:00:12,066 e7cfe82e MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/e7cfe82e/pkb.log
2017-05-01 18:00:12,066 e7cfe82e MainThread INFO PerfKitBenchmarker version: v1.11.0-47-gb38dddb
2017-05-01 18:00:12,066 e7cfe82e MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-05-01 18:00:12,193 e7cfe82e MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-05-01 18:00:12,280 e7cfe82e MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-05-01 18:00:12,282 e7cfe82e MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-05-01 18:00:12,282 e7cfe82e MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-05-01 18:00:12,288 e7cfe82e MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 543, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 459, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-05-01 18:00:12,290 e7cfe82e MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-05-01 18:00:12,316 e7cfe82e MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-05-01 18:00:12,317 e7cfe82e MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/e7cfe82e/pkb.log
2017-05-01 18:00:12,317 e7cfe82e MainThread INFO Completion statuses can be found at: /tmp/perfkitbenchmarker/runs/e7cfe82e/completion_statuses.json
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #359
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/359/display/redirect?page=changes>
Changes:
[aviemzur] [BEAM-2129] Fix flaky KafkaIOTest#testUnboundedSourceMetrics
[staslevin] [BEAM-2072] Fixed MicrobatchSource.reader stops reading after reaching
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on beam5 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/>
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/*
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 254470e626edb6a013ba5cb2d3312dc3bfbdcb51 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 254470e626edb6a013ba5cb2d3312dc3bfbdcb51
> git rev-list 1197bef19b3ef974cdab39bd0468050586f17649 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson6152341388469165452.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5067099177971037270.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson6554058786833359081.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4784823925227759670.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-05-01 12:00:10,272 8eb5fb9e MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/8eb5fb9e/pkb.log
2017-05-01 12:00:10,272 8eb5fb9e MainThread INFO PerfKitBenchmarker version: v1.11.0-45-g6f31bb3
2017-05-01 12:00:10,273 8eb5fb9e MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-05-01 12:00:10,444 8eb5fb9e MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-05-01 12:00:10,554 8eb5fb9e MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-05-01 12:00:10,556 8eb5fb9e MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-05-01 12:00:10,557 8eb5fb9e MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-05-01 12:00:10,562 8eb5fb9e MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-05-01 12:00:10,564 8eb5fb9e MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-05-01 12:00:10,585 8eb5fb9e MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-05-01 12:00:10,585 8eb5fb9e MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/8eb5fb9e/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #358
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/358/display/redirect?page=changes>
Changes:
[dhalperi] [BEAM-59] Minor style cleanups to WriteOneWindowPerFile
[klk] Remove KeyedCombineFn
[klk] Update Dataflow worker version to beam-master-20170430
[dhalperi] [BEAM-59] DataflowRunner: Sink is always a FileBasedSink now
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on beam5 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/>
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/*
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 1197bef19b3ef974cdab39bd0468050586f17649 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 1197bef19b3ef974cdab39bd0468050586f17649
> git rev-list 46ca02aba5f4453b636e1c3eb799fca66cef9cfc # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson7071712309772056122.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5333494622897297169.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5714470993083099562.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson7610602714037543274.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-05-01 06:00:10,077 0ad3ea50 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/0ad3ea50/pkb.log
2017-05-01 06:00:10,077 0ad3ea50 MainThread INFO PerfKitBenchmarker version: v1.11.0-45-g6f31bb3
2017-05-01 06:00:10,078 0ad3ea50 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-05-01 06:00:10,272 0ad3ea50 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-05-01 06:00:10,358 0ad3ea50 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-05-01 06:00:10,360 0ad3ea50 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-05-01 06:00:10,360 0ad3ea50 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-05-01 06:00:10,366 0ad3ea50 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-05-01 06:00:10,368 0ad3ea50 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-05-01 06:00:10,393 0ad3ea50 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-05-01 06:00:10,393 0ad3ea50 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/0ad3ea50/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #357
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/357/display/redirect?page=changes>
Changes:
[dhalperi] Do not prune branches in Jenkins
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on beam5 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/>
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/*
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 46ca02aba5f4453b636e1c3eb799fca66cef9cfc (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 46ca02aba5f4453b636e1c3eb799fca66cef9cfc
> git rev-list a19ceaf47cbf6adddd755ee523141c88bbc53f05 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3701123732946005273.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson8305364138761762006.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4622022496640876743.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4157783115163909445.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-05-01 00:00:09,649 dd94e0d2 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/dd94e0d2/pkb.log
2017-05-01 00:00:09,649 dd94e0d2 MainThread INFO PerfKitBenchmarker version: v1.11.0-45-g6f31bb3
2017-05-01 00:00:09,650 dd94e0d2 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-05-01 00:00:10,307 dd94e0d2 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-05-01 00:00:10,390 dd94e0d2 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-05-01 00:00:10,397 dd94e0d2 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-05-01 00:00:10,398 dd94e0d2 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-05-01 00:00:10,404 dd94e0d2 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-05-01 00:00:10,446 dd94e0d2 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-05-01 00:00:10,477 dd94e0d2 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-05-01 00:00:10,478 dd94e0d2 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/dd94e0d2/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #356
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/356/display/redirect?page=changes>
Changes:
[thw] BEAM-2022 fix triggering for processing time timers
[kirpichov] [BEAM-2114] Fixed display data for Kafka read/write with coders
[kirpichov] [BEAM-2114] Throw instead of warning when KafkaIO cannot infer coder
[kirpichov] [BEAM-2114] Tests for KafkaIO: use ExpectedException rule
[iemejia] Fix hamcrest-core version in parent pom
------------------------------------------
[...truncated 244.20 KB...]
x [deleted] (none) -> origin/pr/93/head
x [deleted] (none) -> origin/pr/930/head
x [deleted] (none) -> origin/pr/930/merge
x [deleted] (none) -> origin/pr/931/head
x [deleted] (none) -> origin/pr/931/merge
x [deleted] (none) -> origin/pr/932/head
x [deleted] (none) -> origin/pr/932/merge
x [deleted] (none) -> origin/pr/933/head
x [deleted] (none) -> origin/pr/933/merge
x [deleted] (none) -> origin/pr/934/head
x [deleted] (none) -> origin/pr/934/merge
x [deleted] (none) -> origin/pr/935/head
x [deleted] (none) -> origin/pr/936/head
x [deleted] (none) -> origin/pr/936/merge
x [deleted] (none) -> origin/pr/937/head
x [deleted] (none) -> origin/pr/937/merge
x [deleted] (none) -> origin/pr/938/head
x [deleted] (none) -> origin/pr/939/head
x [deleted] (none) -> origin/pr/94/head
x [deleted] (none) -> origin/pr/940/head
x [deleted] (none) -> origin/pr/940/merge
x [deleted] (none) -> origin/pr/941/head
x [deleted] (none) -> origin/pr/941/merge
x [deleted] (none) -> origin/pr/942/head
x [deleted] (none) -> origin/pr/942/merge
x [deleted] (none) -> origin/pr/943/head
x [deleted] (none) -> origin/pr/943/merge
x [deleted] (none) -> origin/pr/944/head
x [deleted] (none) -> origin/pr/945/head
x [deleted] (none) -> origin/pr/945/merge
x [deleted] (none) -> origin/pr/946/head
x [deleted] (none) -> origin/pr/946/merge
x [deleted] (none) -> origin/pr/947/head
x [deleted] (none) -> origin/pr/947/merge
x [deleted] (none) -> origin/pr/948/head
x [deleted] (none) -> origin/pr/948/merge
x [deleted] (none) -> origin/pr/949/head
x [deleted] (none) -> origin/pr/949/merge
x [deleted] (none) -> origin/pr/95/head
x [deleted] (none) -> origin/pr/95/merge
x [deleted] (none) -> origin/pr/950/head
x [deleted] (none) -> origin/pr/951/head
x [deleted] (none) -> origin/pr/951/merge
x [deleted] (none) -> origin/pr/952/head
x [deleted] (none) -> origin/pr/952/merge
x [deleted] (none) -> origin/pr/953/head
x [deleted] (none) -> origin/pr/954/head
x [deleted] (none) -> origin/pr/954/merge
x [deleted] (none) -> origin/pr/955/head
x [deleted] (none) -> origin/pr/955/merge
x [deleted] (none) -> origin/pr/956/head
x [deleted] (none) -> origin/pr/957/head
x [deleted] (none) -> origin/pr/958/head
x [deleted] (none) -> origin/pr/959/head
x [deleted] (none) -> origin/pr/959/merge
x [deleted] (none) -> origin/pr/96/head
x [deleted] (none) -> origin/pr/96/merge
x [deleted] (none) -> origin/pr/960/head
x [deleted] (none) -> origin/pr/960/merge
x [deleted] (none) -> origin/pr/961/head
x [deleted] (none) -> origin/pr/962/head
x [deleted] (none) -> origin/pr/962/merge
x [deleted] (none) -> origin/pr/963/head
x [deleted] (none) -> origin/pr/963/merge
x [deleted] (none) -> origin/pr/964/head
x [deleted] (none) -> origin/pr/965/head
x [deleted] (none) -> origin/pr/965/merge
x [deleted] (none) -> origin/pr/966/head
x [deleted] (none) -> origin/pr/967/head
x [deleted] (none) -> origin/pr/967/merge
x [deleted] (none) -> origin/pr/968/head
x [deleted] (none) -> origin/pr/968/merge
x [deleted] (none) -> origin/pr/969/head
x [deleted] (none) -> origin/pr/969/merge
x [deleted] (none) -> origin/pr/97/head
x [deleted] (none) -> origin/pr/97/merge
x [deleted] (none) -> origin/pr/970/head
x [deleted] (none) -> origin/pr/970/merge
x [deleted] (none) -> origin/pr/971/head
x [deleted] (none) -> origin/pr/971/merge
x [deleted] (none) -> origin/pr/972/head
x [deleted] (none) -> origin/pr/973/head
x [deleted] (none) -> origin/pr/974/head
x [deleted] (none) -> origin/pr/974/merge
x [deleted] (none) -> origin/pr/975/head
x [deleted] (none) -> origin/pr/975/merge
x [deleted] (none) -> origin/pr/976/head
x [deleted] (none) -> origin/pr/976/merge
x [deleted] (none) -> origin/pr/977/head
x [deleted] (none) -> origin/pr/977/merge
x [deleted] (none) -> origin/pr/978/head
x [deleted] (none) -> origin/pr/978/merge
x [deleted] (none) -> origin/pr/979/head
x [deleted] (none) -> origin/pr/979/merge
x [deleted] (none) -> origin/pr/98/head
x [deleted] (none) -> origin/pr/980/head
x [deleted] (none) -> origin/pr/980/merge
x [deleted] (none) -> origin/pr/981/head
x [deleted] (none) -> origin/pr/982/head
x [deleted] (none) -> origin/pr/982/merge
x [deleted] (none) -> origin/pr/983/head
x [deleted] (none) -> origin/pr/983/merge
x [deleted] (none) -> origin/pr/984/head
x [deleted] (none) -> origin/pr/984/merge
x [deleted] (none) -> origin/pr/985/head
x [deleted] (none) -> origin/pr/985/merge
x [deleted] (none) -> origin/pr/986/head
x [deleted] (none) -> origin/pr/986/merge
x [deleted] (none) -> origin/pr/987/head
x [deleted] (none) -> origin/pr/988/head
x [deleted] (none) -> origin/pr/988/merge
x [deleted] (none) -> origin/pr/989/head
x [deleted] (none) -> origin/pr/989/merge
x [deleted] (none) -> origin/pr/99/head
x [deleted] (none) -> origin/pr/99/merge
x [deleted] (none) -> origin/pr/990/head
x [deleted] (none) -> origin/pr/990/merge
x [deleted] (none) -> origin/pr/991/head
x [deleted] (none) -> origin/pr/991/merge
x [deleted] (none) -> origin/pr/992/head
x [deleted] (none) -> origin/pr/992/merge
x [deleted] (none) -> origin/pr/993/head
x [deleted] (none) -> origin/pr/993/merge
x [deleted] (none) -> origin/pr/994/head
x [deleted] (none) -> origin/pr/994/merge
x [deleted] (none) -> origin/pr/995/head
x [deleted] (none) -> origin/pr/995/merge
x [deleted] (none) -> origin/pr/996/head
x [deleted] (none) -> origin/pr/996/merge
x [deleted] (none) -> origin/pr/997/head
x [deleted] (none) -> origin/pr/997/merge
x [deleted] (none) -> origin/pr/998/head
x [deleted] (none) -> origin/pr/999/head
x [deleted] (none) -> origin/pr/999/merge
error: RPC failed; result=18, HTTP code = 200
fatal: The remote end hung up unexpectedly
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1866)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1585)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:71)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:348)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1545)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:830)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor788.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy103.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:807)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision a19ceaf47cbf6adddd755ee523141c88bbc53f05 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f a19ceaf47cbf6adddd755ee523141c88bbc53f05
> git rev-list fc55d2f811a57d25e8d1e5f204d9a07e2c50a370 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson1845648802584385833.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5289481183229827751.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5305735820570203269.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3437877643927861753.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-30 18:03:08,543 a3d92479 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/a3d92479/pkb.log
2017-04-30 18:03:08,543 a3d92479 MainThread INFO PerfKitBenchmarker version: v1.11.0-45-g6f31bb3
2017-04-30 18:03:08,544 a3d92479 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-30 18:03:09,001 a3d92479 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-30 18:03:09,092 a3d92479 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-30 18:03:09,094 a3d92479 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-30 18:03:09,095 a3d92479 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-30 18:03:09,100 a3d92479 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-30 18:03:09,102 a3d92479 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-30 18:03:09,126 a3d92479 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-30 18:03:09,127 a3d92479 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/a3d92479/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #355
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/355/display/redirect>
------------------------------------------
[...truncated 275.61 KB...]
* [new ref] refs/pull/2716/head -> origin/pr/2716/head
* [new ref] refs/pull/2716/merge -> origin/pr/2716/merge
* [new ref] refs/pull/2717/head -> origin/pr/2717/head
* [new ref] refs/pull/2717/merge -> origin/pr/2717/merge
* [new ref] refs/pull/2718/head -> origin/pr/2718/head
* [new ref] refs/pull/2718/merge -> origin/pr/2718/merge
* [new ref] refs/pull/2719/head -> origin/pr/2719/head
* [new ref] refs/pull/2719/merge -> origin/pr/2719/merge
* [new ref] refs/pull/2720/head -> origin/pr/2720/head
* [new ref] refs/pull/2721/head -> origin/pr/2721/head
* [new ref] refs/pull/2721/merge -> origin/pr/2721/merge
* [new ref] refs/pull/2722/head -> origin/pr/2722/head
* [new ref] refs/pull/2722/merge -> origin/pr/2722/merge
* [new ref] refs/pull/2723/head -> origin/pr/2723/head
* [new ref] refs/pull/2723/merge -> origin/pr/2723/merge
* [new ref] refs/pull/2724/head -> origin/pr/2724/head
* [new ref] refs/pull/2724/merge -> origin/pr/2724/merge
* [new ref] refs/pull/2725/head -> origin/pr/2725/head
* [new ref] refs/pull/2726/head -> origin/pr/2726/head
* [new ref] refs/pull/2727/head -> origin/pr/2727/head
* [new ref] refs/pull/2727/merge -> origin/pr/2727/merge
* [new ref] refs/pull/2728/head -> origin/pr/2728/head
* [new ref] refs/pull/2729/head -> origin/pr/2729/head
* [new ref] refs/pull/2729/merge -> origin/pr/2729/merge
* [new ref] refs/pull/2730/head -> origin/pr/2730/head
* [new ref] refs/pull/2730/merge -> origin/pr/2730/merge
* [new ref] refs/pull/2731/head -> origin/pr/2731/head
* [new ref] refs/pull/2732/head -> origin/pr/2732/head
* [new ref] refs/pull/2732/merge -> origin/pr/2732/merge
* [new ref] refs/pull/2733/head -> origin/pr/2733/head
* [new ref] refs/pull/2733/merge -> origin/pr/2733/merge
* [new ref] refs/pull/2734/head -> origin/pr/2734/head
* [new ref] refs/pull/2735/head -> origin/pr/2735/head
* [new ref] refs/pull/2735/merge -> origin/pr/2735/merge
* [new ref] refs/pull/2736/head -> origin/pr/2736/head
* [new ref] refs/pull/2736/merge -> origin/pr/2736/merge
* [new ref] refs/pull/2737/head -> origin/pr/2737/head
* [new ref] refs/pull/2737/merge -> origin/pr/2737/merge
* [new ref] refs/pull/2738/head -> origin/pr/2738/head
* [new ref] refs/pull/2738/merge -> origin/pr/2738/merge
* [new ref] refs/pull/2739/head -> origin/pr/2739/head
* [new ref] refs/pull/2739/merge -> origin/pr/2739/merge
* [new ref] refs/pull/2740/head -> origin/pr/2740/head
* [new ref] refs/pull/2740/merge -> origin/pr/2740/merge
* [new ref] refs/pull/2741/head -> origin/pr/2741/head
* [new ref] refs/pull/2742/head -> origin/pr/2742/head
* [new ref] refs/pull/2743/head -> origin/pr/2743/head
* [new ref] refs/pull/2743/merge -> origin/pr/2743/merge
* [new ref] refs/pull/2744/head -> origin/pr/2744/head
* [new ref] refs/pull/2744/merge -> origin/pr/2744/merge
* [new ref] refs/pull/2745/head -> origin/pr/2745/head
* [new ref] refs/pull/2745/merge -> origin/pr/2745/merge
* [new ref] refs/pull/2746/head -> origin/pr/2746/head
* [new ref] refs/pull/2746/merge -> origin/pr/2746/merge
* [new ref] refs/pull/2747/head -> origin/pr/2747/head
* [new ref] refs/pull/2747/merge -> origin/pr/2747/merge
* [new ref] refs/pull/2748/head -> origin/pr/2748/head
* [new ref] refs/pull/2748/merge -> origin/pr/2748/merge
* [new ref] refs/pull/2749/head -> origin/pr/2749/head
* [new ref] refs/pull/2749/merge -> origin/pr/2749/merge
* [new ref] refs/pull/2750/head -> origin/pr/2750/head
* [new ref] refs/pull/2751/head -> origin/pr/2751/head
* [new ref] refs/pull/2751/merge -> origin/pr/2751/merge
* [new ref] refs/pull/2752/head -> origin/pr/2752/head
* [new ref] refs/pull/2752/merge -> origin/pr/2752/merge
* [new ref] refs/pull/2753/head -> origin/pr/2753/head
* [new ref] refs/pull/2753/merge -> origin/pr/2753/merge
* [new ref] refs/pull/2754/head -> origin/pr/2754/head
* [new ref] refs/pull/2754/merge -> origin/pr/2754/merge
* [new ref] refs/pull/2755/head -> origin/pr/2755/head
* [new ref] refs/pull/2756/head -> origin/pr/2756/head
* [new ref] refs/pull/2756/merge -> origin/pr/2756/merge
* [new ref] refs/pull/2757/head -> origin/pr/2757/head
* [new ref] refs/pull/2757/merge -> origin/pr/2757/merge
* [new ref] refs/pull/2758/head -> origin/pr/2758/head
* [new ref] refs/pull/2758/merge -> origin/pr/2758/merge
* [new ref] refs/pull/2759/head -> origin/pr/2759/head
* [new ref] refs/pull/2759/merge -> origin/pr/2759/merge
* [new ref] refs/pull/2760/head -> origin/pr/2760/head
* [new ref] refs/pull/2760/merge -> origin/pr/2760/merge
* [new ref] refs/pull/2761/head -> origin/pr/2761/head
* [new ref] refs/pull/2761/merge -> origin/pr/2761/merge
* [new ref] refs/pull/2762/head -> origin/pr/2762/head
* [new ref] refs/pull/2762/merge -> origin/pr/2762/merge
* [new ref] refs/pull/2763/head -> origin/pr/2763/head
* [new ref] refs/pull/2763/merge -> origin/pr/2763/merge
* [new ref] refs/pull/2764/head -> origin/pr/2764/head
* [new ref] refs/pull/2764/merge -> origin/pr/2764/merge
* [new ref] refs/pull/2765/head -> origin/pr/2765/head
* [new ref] refs/pull/2766/head -> origin/pr/2766/head
* [new ref] refs/pull/2766/merge -> origin/pr/2766/merge
* [new ref] refs/pull/2767/head -> origin/pr/2767/head
* [new ref] refs/pull/2767/merge -> origin/pr/2767/merge
* [new ref] refs/pull/2768/head -> origin/pr/2768/head
* [new ref] refs/pull/2768/merge -> origin/pr/2768/merge
* [new ref] refs/pull/2769/head -> origin/pr/2769/head
* [new ref] refs/pull/2769/merge -> origin/pr/2769/merge
* [new ref] refs/pull/2770/head -> origin/pr/2770/head
* [new ref] refs/pull/2770/merge -> origin/pr/2770/merge
* [new ref] refs/pull/2771/head -> origin/pr/2771/head
* [new ref] refs/pull/2771/merge -> origin/pr/2771/merge
* [new ref] refs/pull/2772/head -> origin/pr/2772/head
* [new ref] refs/pull/2772/merge -> origin/pr/2772/merge
* [new ref] refs/pull/2773/head -> origin/pr/2773/head
* [new ref] refs/pull/2773/merge -> origin/pr/2773/merge
* [new ref] refs/pull/2774/head -> origin/pr/2774/head
* [new ref] refs/pull/2774/merge -> origin/pr/2774/merge
* [new ref] refs/pull/2775/head -> origin/pr/2775/head
* [new ref] refs/pull/2775/merge -> origin/pr/2775/merge
* [new ref] refs/pull/2776/head -> origin/pr/2776/head
* [new ref] refs/pull/2776/merge -> origin/pr/2776/merge
* [new ref] refs/pull/2777/head -> origin/pr/2777/head
* [new ref] refs/pull/2777/merge -> origin/pr/2777/merge
* [new ref] refs/pull/2778/head -> origin/pr/2778/head
* [new ref] refs/pull/2778/merge -> origin/pr/2778/merge
* [new ref] refs/pull/2779/head -> origin/pr/2779/head
* [new ref] refs/pull/2779/merge -> origin/pr/2779/merge
* [new ref] refs/pull/2780/head -> origin/pr/2780/head
* [new ref] refs/pull/2780/merge -> origin/pr/2780/merge
* [new ref] refs/pull/2781/head -> origin/pr/2781/head
* [new ref] refs/pull/2782/head -> origin/pr/2782/head
* [new ref] refs/pull/2782/merge -> origin/pr/2782/merge
* [new ref] refs/pull/2783/head -> origin/pr/2783/head
* [new ref] refs/pull/2783/merge -> origin/pr/2783/merge
* [new ref] refs/pull/2784/head -> origin/pr/2784/head
* [new ref] refs/pull/2784/merge -> origin/pr/2784/merge
* [new ref] refs/pull/2785/head -> origin/pr/2785/head
* [new ref] refs/pull/2785/merge -> origin/pr/2785/merge
* [new ref] refs/pull/2786/head -> origin/pr/2786/head
* [new ref] refs/pull/2786/merge -> origin/pr/2786/merge
* [new ref] refs/pull/2787/head -> origin/pr/2787/head
* [new ref] refs/pull/2787/merge -> origin/pr/2787/merge
* [new ref] refs/pull/2788/head -> origin/pr/2788/head
* [new ref] refs/pull/2788/merge -> origin/pr/2788/merge
* [new ref] refs/pull/2789/head -> origin/pr/2789/head
* [new ref] refs/pull/2789/merge -> origin/pr/2789/merge
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1866)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1585)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:71)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:348)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1545)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:830)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor788.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy103.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:807)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision fc55d2f811a57d25e8d1e5f204d9a07e2c50a370 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f fc55d2f811a57d25e8d1e5f204d9a07e2c50a370
> git rev-list fc55d2f811a57d25e8d1e5f204d9a07e2c50a370 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson7453968279601938384.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson8885442801494115696.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson6183792721343274824.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson510426867877615601.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-30 12:03:45,742 d2074a0c MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/d2074a0c/pkb.log
2017-04-30 12:03:45,742 d2074a0c MainThread INFO PerfKitBenchmarker version: v1.11.0-45-g6f31bb3
2017-04-30 12:03:45,743 d2074a0c MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-30 12:03:45,953 d2074a0c MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-30 12:03:46,039 d2074a0c MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-30 12:03:46,041 d2074a0c MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-30 12:03:46,041 d2074a0c MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-30 12:03:46,047 d2074a0c MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-30 12:03:46,049 d2074a0c MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-30 12:03:46,076 d2074a0c MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-30 12:03:46,076 d2074a0c MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/d2074a0c/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #354
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/354/display/redirect?page=changes>
Changes:
[lcwik] Remove useless return statement
[lcwik] Remove redundant private on enum constructors
[lcwik] Remove useless continue statements
------------------------------------------
[...truncated 279.34 KB...]
* [new ref] refs/pull/2716/head -> origin/pr/2716/head
* [new ref] refs/pull/2716/merge -> origin/pr/2716/merge
* [new ref] refs/pull/2717/head -> origin/pr/2717/head
* [new ref] refs/pull/2717/merge -> origin/pr/2717/merge
* [new ref] refs/pull/2718/head -> origin/pr/2718/head
* [new ref] refs/pull/2718/merge -> origin/pr/2718/merge
* [new ref] refs/pull/2719/head -> origin/pr/2719/head
* [new ref] refs/pull/2719/merge -> origin/pr/2719/merge
* [new ref] refs/pull/2720/head -> origin/pr/2720/head
* [new ref] refs/pull/2721/head -> origin/pr/2721/head
* [new ref] refs/pull/2721/merge -> origin/pr/2721/merge
* [new ref] refs/pull/2722/head -> origin/pr/2722/head
* [new ref] refs/pull/2722/merge -> origin/pr/2722/merge
* [new ref] refs/pull/2723/head -> origin/pr/2723/head
* [new ref] refs/pull/2723/merge -> origin/pr/2723/merge
* [new ref] refs/pull/2724/head -> origin/pr/2724/head
* [new ref] refs/pull/2724/merge -> origin/pr/2724/merge
* [new ref] refs/pull/2725/head -> origin/pr/2725/head
* [new ref] refs/pull/2726/head -> origin/pr/2726/head
* [new ref] refs/pull/2727/head -> origin/pr/2727/head
* [new ref] refs/pull/2727/merge -> origin/pr/2727/merge
* [new ref] refs/pull/2728/head -> origin/pr/2728/head
* [new ref] refs/pull/2729/head -> origin/pr/2729/head
* [new ref] refs/pull/2729/merge -> origin/pr/2729/merge
* [new ref] refs/pull/2730/head -> origin/pr/2730/head
* [new ref] refs/pull/2730/merge -> origin/pr/2730/merge
* [new ref] refs/pull/2731/head -> origin/pr/2731/head
* [new ref] refs/pull/2732/head -> origin/pr/2732/head
* [new ref] refs/pull/2732/merge -> origin/pr/2732/merge
* [new ref] refs/pull/2733/head -> origin/pr/2733/head
* [new ref] refs/pull/2733/merge -> origin/pr/2733/merge
* [new ref] refs/pull/2734/head -> origin/pr/2734/head
* [new ref] refs/pull/2735/head -> origin/pr/2735/head
* [new ref] refs/pull/2735/merge -> origin/pr/2735/merge
* [new ref] refs/pull/2736/head -> origin/pr/2736/head
* [new ref] refs/pull/2736/merge -> origin/pr/2736/merge
* [new ref] refs/pull/2737/head -> origin/pr/2737/head
* [new ref] refs/pull/2737/merge -> origin/pr/2737/merge
* [new ref] refs/pull/2738/head -> origin/pr/2738/head
* [new ref] refs/pull/2738/merge -> origin/pr/2738/merge
* [new ref] refs/pull/2739/head -> origin/pr/2739/head
* [new ref] refs/pull/2739/merge -> origin/pr/2739/merge
* [new ref] refs/pull/2740/head -> origin/pr/2740/head
* [new ref] refs/pull/2740/merge -> origin/pr/2740/merge
* [new ref] refs/pull/2741/head -> origin/pr/2741/head
* [new ref] refs/pull/2742/head -> origin/pr/2742/head
* [new ref] refs/pull/2743/head -> origin/pr/2743/head
* [new ref] refs/pull/2743/merge -> origin/pr/2743/merge
* [new ref] refs/pull/2744/head -> origin/pr/2744/head
* [new ref] refs/pull/2744/merge -> origin/pr/2744/merge
* [new ref] refs/pull/2745/head -> origin/pr/2745/head
* [new ref] refs/pull/2745/merge -> origin/pr/2745/merge
* [new ref] refs/pull/2746/head -> origin/pr/2746/head
* [new ref] refs/pull/2746/merge -> origin/pr/2746/merge
* [new ref] refs/pull/2747/head -> origin/pr/2747/head
* [new ref] refs/pull/2747/merge -> origin/pr/2747/merge
* [new ref] refs/pull/2748/head -> origin/pr/2748/head
* [new ref] refs/pull/2748/merge -> origin/pr/2748/merge
* [new ref] refs/pull/2749/head -> origin/pr/2749/head
* [new ref] refs/pull/2749/merge -> origin/pr/2749/merge
* [new ref] refs/pull/2750/head -> origin/pr/2750/head
* [new ref] refs/pull/2751/head -> origin/pr/2751/head
* [new ref] refs/pull/2751/merge -> origin/pr/2751/merge
* [new ref] refs/pull/2752/head -> origin/pr/2752/head
* [new ref] refs/pull/2752/merge -> origin/pr/2752/merge
* [new ref] refs/pull/2753/head -> origin/pr/2753/head
* [new ref] refs/pull/2753/merge -> origin/pr/2753/merge
* [new ref] refs/pull/2754/head -> origin/pr/2754/head
* [new ref] refs/pull/2754/merge -> origin/pr/2754/merge
* [new ref] refs/pull/2755/head -> origin/pr/2755/head
* [new ref] refs/pull/2756/head -> origin/pr/2756/head
* [new ref] refs/pull/2756/merge -> origin/pr/2756/merge
* [new ref] refs/pull/2757/head -> origin/pr/2757/head
* [new ref] refs/pull/2757/merge -> origin/pr/2757/merge
* [new ref] refs/pull/2758/head -> origin/pr/2758/head
* [new ref] refs/pull/2758/merge -> origin/pr/2758/merge
* [new ref] refs/pull/2759/head -> origin/pr/2759/head
* [new ref] refs/pull/2759/merge -> origin/pr/2759/merge
* [new ref] refs/pull/2760/head -> origin/pr/2760/head
* [new ref] refs/pull/2760/merge -> origin/pr/2760/merge
* [new ref] refs/pull/2761/head -> origin/pr/2761/head
* [new ref] refs/pull/2761/merge -> origin/pr/2761/merge
* [new ref] refs/pull/2762/head -> origin/pr/2762/head
* [new ref] refs/pull/2762/merge -> origin/pr/2762/merge
* [new ref] refs/pull/2763/head -> origin/pr/2763/head
* [new ref] refs/pull/2763/merge -> origin/pr/2763/merge
* [new ref] refs/pull/2764/head -> origin/pr/2764/head
* [new ref] refs/pull/2764/merge -> origin/pr/2764/merge
* [new ref] refs/pull/2765/head -> origin/pr/2765/head
* [new ref] refs/pull/2766/head -> origin/pr/2766/head
* [new ref] refs/pull/2766/merge -> origin/pr/2766/merge
* [new ref] refs/pull/2767/head -> origin/pr/2767/head
* [new ref] refs/pull/2767/merge -> origin/pr/2767/merge
* [new ref] refs/pull/2768/head -> origin/pr/2768/head
* [new ref] refs/pull/2768/merge -> origin/pr/2768/merge
* [new ref] refs/pull/2769/head -> origin/pr/2769/head
* [new ref] refs/pull/2769/merge -> origin/pr/2769/merge
* [new ref] refs/pull/2770/head -> origin/pr/2770/head
* [new ref] refs/pull/2770/merge -> origin/pr/2770/merge
* [new ref] refs/pull/2771/head -> origin/pr/2771/head
* [new ref] refs/pull/2771/merge -> origin/pr/2771/merge
* [new ref] refs/pull/2772/head -> origin/pr/2772/head
* [new ref] refs/pull/2772/merge -> origin/pr/2772/merge
* [new ref] refs/pull/2773/head -> origin/pr/2773/head
* [new ref] refs/pull/2773/merge -> origin/pr/2773/merge
* [new ref] refs/pull/2774/head -> origin/pr/2774/head
* [new ref] refs/pull/2774/merge -> origin/pr/2774/merge
* [new ref] refs/pull/2775/head -> origin/pr/2775/head
* [new ref] refs/pull/2775/merge -> origin/pr/2775/merge
* [new ref] refs/pull/2776/head -> origin/pr/2776/head
* [new ref] refs/pull/2776/merge -> origin/pr/2776/merge
* [new ref] refs/pull/2777/head -> origin/pr/2777/head
* [new ref] refs/pull/2777/merge -> origin/pr/2777/merge
* [new ref] refs/pull/2778/head -> origin/pr/2778/head
* [new ref] refs/pull/2778/merge -> origin/pr/2778/merge
* [new ref] refs/pull/2779/head -> origin/pr/2779/head
* [new ref] refs/pull/2779/merge -> origin/pr/2779/merge
* [new ref] refs/pull/2780/head -> origin/pr/2780/head
* [new ref] refs/pull/2780/merge -> origin/pr/2780/merge
* [new ref] refs/pull/2781/head -> origin/pr/2781/head
* [new ref] refs/pull/2782/head -> origin/pr/2782/head
* [new ref] refs/pull/2782/merge -> origin/pr/2782/merge
* [new ref] refs/pull/2783/head -> origin/pr/2783/head
* [new ref] refs/pull/2783/merge -> origin/pr/2783/merge
* [new ref] refs/pull/2784/head -> origin/pr/2784/head
* [new ref] refs/pull/2784/merge -> origin/pr/2784/merge
* [new ref] refs/pull/2785/head -> origin/pr/2785/head
* [new ref] refs/pull/2785/merge -> origin/pr/2785/merge
* [new ref] refs/pull/2786/head -> origin/pr/2786/head
* [new ref] refs/pull/2786/merge -> origin/pr/2786/merge
* [new ref] refs/pull/2787/head -> origin/pr/2787/head
* [new ref] refs/pull/2787/merge -> origin/pr/2787/merge
* [new ref] refs/pull/2788/head -> origin/pr/2788/head
* [new ref] refs/pull/2788/merge -> origin/pr/2788/merge
* [new ref] refs/pull/2789/head -> origin/pr/2789/head
* [new ref] refs/pull/2789/merge -> origin/pr/2789/merge
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1866)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1585)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:71)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:348)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1545)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:830)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor788.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy103.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:807)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision fc55d2f811a57d25e8d1e5f204d9a07e2c50a370 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f fc55d2f811a57d25e8d1e5f204d9a07e2c50a370
> git rev-list 14d60b26e7e9b8a578038599341e66ccd99d012b # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson6862909983330959471.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4580765514315349282.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5721452976460685433.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3975592660729805138.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-30 06:03:56,700 138e2101 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/138e2101/pkb.log
2017-04-30 06:03:56,700 138e2101 MainThread INFO PerfKitBenchmarker version: v1.11.0-45-g6f31bb3
2017-04-30 06:03:56,702 138e2101 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-30 06:03:57,053 138e2101 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-30 06:03:57,167 138e2101 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-30 06:03:57,169 138e2101 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-30 06:03:57,170 138e2101 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-30 06:03:57,177 138e2101 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-30 06:03:57,179 138e2101 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-30 06:03:57,197 138e2101 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-30 06:03:57,198 138e2101 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/138e2101/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #353
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/353/display/redirect?page=changes>
Changes:
[klk] Move stable name validation to Pipeline.run()
[klk] Remove PipelineOptions from createWriteOperation()
[klk] Move PTransform.validate to post-construction, modulo BigQueryIO
[klk] Supply PipelineOptions at Pipeline.run()
[kirpichov] Converts PubsubIO.Read to AutoValue
[kirpichov] Renames PubsubIO.Read builder methods to be style guide compliant
[kirpichov] Remove override of topic by subscription and vice versa
[kirpichov] Converts PubsubIO.Write to AutoValue
[kirpichov] Renames PubsubIO.Write builder methods to be style guide compliant
[kirpichov] Adds PubsubIO.readStrings(), readProtos(), readAvros()
[kirpichov] Adds PubsubIO.writeStrings(), writeProtos(), writeAvros()
[kirpichov] Renames {id,timestamp}Label to {id,timestamp}Attribute throughout SDK
------------------------------------------
[...truncated 277.08 KB...]
* [new ref] refs/pull/2710/head -> origin/pr/2710/head
* [new ref] refs/pull/2710/merge -> origin/pr/2710/merge
* [new ref] refs/pull/2711/head -> origin/pr/2711/head
* [new ref] refs/pull/2711/merge -> origin/pr/2711/merge
* [new ref] refs/pull/2712/head -> origin/pr/2712/head
* [new ref] refs/pull/2712/merge -> origin/pr/2712/merge
* [new ref] refs/pull/2713/head -> origin/pr/2713/head
* [new ref] refs/pull/2713/merge -> origin/pr/2713/merge
* [new ref] refs/pull/2714/head -> origin/pr/2714/head
* [new ref] refs/pull/2714/merge -> origin/pr/2714/merge
* [new ref] refs/pull/2715/head -> origin/pr/2715/head
* [new ref] refs/pull/2715/merge -> origin/pr/2715/merge
* [new ref] refs/pull/2716/head -> origin/pr/2716/head
* [new ref] refs/pull/2716/merge -> origin/pr/2716/merge
* [new ref] refs/pull/2717/head -> origin/pr/2717/head
* [new ref] refs/pull/2717/merge -> origin/pr/2717/merge
* [new ref] refs/pull/2718/head -> origin/pr/2718/head
* [new ref] refs/pull/2718/merge -> origin/pr/2718/merge
* [new ref] refs/pull/2719/head -> origin/pr/2719/head
* [new ref] refs/pull/2719/merge -> origin/pr/2719/merge
* [new ref] refs/pull/2720/head -> origin/pr/2720/head
* [new ref] refs/pull/2721/head -> origin/pr/2721/head
* [new ref] refs/pull/2721/merge -> origin/pr/2721/merge
* [new ref] refs/pull/2722/head -> origin/pr/2722/head
* [new ref] refs/pull/2722/merge -> origin/pr/2722/merge
* [new ref] refs/pull/2723/head -> origin/pr/2723/head
* [new ref] refs/pull/2723/merge -> origin/pr/2723/merge
* [new ref] refs/pull/2724/head -> origin/pr/2724/head
* [new ref] refs/pull/2724/merge -> origin/pr/2724/merge
* [new ref] refs/pull/2725/head -> origin/pr/2725/head
* [new ref] refs/pull/2726/head -> origin/pr/2726/head
* [new ref] refs/pull/2727/head -> origin/pr/2727/head
* [new ref] refs/pull/2727/merge -> origin/pr/2727/merge
* [new ref] refs/pull/2728/head -> origin/pr/2728/head
* [new ref] refs/pull/2729/head -> origin/pr/2729/head
* [new ref] refs/pull/2729/merge -> origin/pr/2729/merge
* [new ref] refs/pull/2730/head -> origin/pr/2730/head
* [new ref] refs/pull/2730/merge -> origin/pr/2730/merge
* [new ref] refs/pull/2731/head -> origin/pr/2731/head
* [new ref] refs/pull/2732/head -> origin/pr/2732/head
* [new ref] refs/pull/2732/merge -> origin/pr/2732/merge
* [new ref] refs/pull/2733/head -> origin/pr/2733/head
* [new ref] refs/pull/2733/merge -> origin/pr/2733/merge
* [new ref] refs/pull/2734/head -> origin/pr/2734/head
* [new ref] refs/pull/2735/head -> origin/pr/2735/head
* [new ref] refs/pull/2735/merge -> origin/pr/2735/merge
* [new ref] refs/pull/2736/head -> origin/pr/2736/head
* [new ref] refs/pull/2736/merge -> origin/pr/2736/merge
* [new ref] refs/pull/2737/head -> origin/pr/2737/head
* [new ref] refs/pull/2737/merge -> origin/pr/2737/merge
* [new ref] refs/pull/2738/head -> origin/pr/2738/head
* [new ref] refs/pull/2738/merge -> origin/pr/2738/merge
* [new ref] refs/pull/2739/head -> origin/pr/2739/head
* [new ref] refs/pull/2739/merge -> origin/pr/2739/merge
* [new ref] refs/pull/2740/head -> origin/pr/2740/head
* [new ref] refs/pull/2740/merge -> origin/pr/2740/merge
* [new ref] refs/pull/2741/head -> origin/pr/2741/head
* [new ref] refs/pull/2742/head -> origin/pr/2742/head
* [new ref] refs/pull/2743/head -> origin/pr/2743/head
* [new ref] refs/pull/2743/merge -> origin/pr/2743/merge
* [new ref] refs/pull/2744/head -> origin/pr/2744/head
* [new ref] refs/pull/2744/merge -> origin/pr/2744/merge
* [new ref] refs/pull/2745/head -> origin/pr/2745/head
* [new ref] refs/pull/2745/merge -> origin/pr/2745/merge
* [new ref] refs/pull/2746/head -> origin/pr/2746/head
* [new ref] refs/pull/2746/merge -> origin/pr/2746/merge
* [new ref] refs/pull/2747/head -> origin/pr/2747/head
* [new ref] refs/pull/2747/merge -> origin/pr/2747/merge
* [new ref] refs/pull/2748/head -> origin/pr/2748/head
* [new ref] refs/pull/2748/merge -> origin/pr/2748/merge
* [new ref] refs/pull/2749/head -> origin/pr/2749/head
* [new ref] refs/pull/2749/merge -> origin/pr/2749/merge
* [new ref] refs/pull/2750/head -> origin/pr/2750/head
* [new ref] refs/pull/2751/head -> origin/pr/2751/head
* [new ref] refs/pull/2751/merge -> origin/pr/2751/merge
* [new ref] refs/pull/2752/head -> origin/pr/2752/head
* [new ref] refs/pull/2752/merge -> origin/pr/2752/merge
* [new ref] refs/pull/2753/head -> origin/pr/2753/head
* [new ref] refs/pull/2753/merge -> origin/pr/2753/merge
* [new ref] refs/pull/2754/head -> origin/pr/2754/head
* [new ref] refs/pull/2754/merge -> origin/pr/2754/merge
* [new ref] refs/pull/2755/head -> origin/pr/2755/head
* [new ref] refs/pull/2756/head -> origin/pr/2756/head
* [new ref] refs/pull/2756/merge -> origin/pr/2756/merge
* [new ref] refs/pull/2757/head -> origin/pr/2757/head
* [new ref] refs/pull/2757/merge -> origin/pr/2757/merge
* [new ref] refs/pull/2758/head -> origin/pr/2758/head
* [new ref] refs/pull/2758/merge -> origin/pr/2758/merge
* [new ref] refs/pull/2759/head -> origin/pr/2759/head
* [new ref] refs/pull/2759/merge -> origin/pr/2759/merge
* [new ref] refs/pull/2760/head -> origin/pr/2760/head
* [new ref] refs/pull/2760/merge -> origin/pr/2760/merge
* [new ref] refs/pull/2761/head -> origin/pr/2761/head
* [new ref] refs/pull/2761/merge -> origin/pr/2761/merge
* [new ref] refs/pull/2762/head -> origin/pr/2762/head
* [new ref] refs/pull/2762/merge -> origin/pr/2762/merge
* [new ref] refs/pull/2763/head -> origin/pr/2763/head
* [new ref] refs/pull/2763/merge -> origin/pr/2763/merge
* [new ref] refs/pull/2764/head -> origin/pr/2764/head
* [new ref] refs/pull/2764/merge -> origin/pr/2764/merge
* [new ref] refs/pull/2765/head -> origin/pr/2765/head
* [new ref] refs/pull/2766/head -> origin/pr/2766/head
* [new ref] refs/pull/2766/merge -> origin/pr/2766/merge
* [new ref] refs/pull/2767/head -> origin/pr/2767/head
* [new ref] refs/pull/2767/merge -> origin/pr/2767/merge
* [new ref] refs/pull/2768/head -> origin/pr/2768/head
* [new ref] refs/pull/2768/merge -> origin/pr/2768/merge
* [new ref] refs/pull/2769/head -> origin/pr/2769/head
* [new ref] refs/pull/2769/merge -> origin/pr/2769/merge
* [new ref] refs/pull/2770/head -> origin/pr/2770/head
* [new ref] refs/pull/2770/merge -> origin/pr/2770/merge
* [new ref] refs/pull/2771/head -> origin/pr/2771/head
* [new ref] refs/pull/2771/merge -> origin/pr/2771/merge
* [new ref] refs/pull/2772/head -> origin/pr/2772/head
* [new ref] refs/pull/2772/merge -> origin/pr/2772/merge
* [new ref] refs/pull/2773/head -> origin/pr/2773/head
* [new ref] refs/pull/2773/merge -> origin/pr/2773/merge
* [new ref] refs/pull/2774/head -> origin/pr/2774/head
* [new ref] refs/pull/2774/merge -> origin/pr/2774/merge
* [new ref] refs/pull/2775/head -> origin/pr/2775/head
* [new ref] refs/pull/2775/merge -> origin/pr/2775/merge
* [new ref] refs/pull/2776/head -> origin/pr/2776/head
* [new ref] refs/pull/2776/merge -> origin/pr/2776/merge
* [new ref] refs/pull/2777/head -> origin/pr/2777/head
* [new ref] refs/pull/2777/merge -> origin/pr/2777/merge
* [new ref] refs/pull/2778/head -> origin/pr/2778/head
* [new ref] refs/pull/2778/merge -> origin/pr/2778/merge
* [new ref] refs/pull/2779/head -> origin/pr/2779/head
* [new ref] refs/pull/2779/merge -> origin/pr/2779/merge
* [new ref] refs/pull/2780/head -> origin/pr/2780/head
* [new ref] refs/pull/2780/merge -> origin/pr/2780/merge
* [new ref] refs/pull/2781/head -> origin/pr/2781/head
* [new ref] refs/pull/2782/head -> origin/pr/2782/head
* [new ref] refs/pull/2782/merge -> origin/pr/2782/merge
* [new ref] refs/pull/2783/head -> origin/pr/2783/head
* [new ref] refs/pull/2783/merge -> origin/pr/2783/merge
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1866)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1585)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:71)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:348)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1545)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:830)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor788.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy103.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:807)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 14d60b26e7e9b8a578038599341e66ccd99d012b (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 14d60b26e7e9b8a578038599341e66ccd99d012b
> git rev-list be883666f377b29926cc1e7408d7cd268ca6ceff # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson8367195479928485348.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3089505677135875789.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3553683777749011579.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4294483275160305081.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-30 00:03:26,437 08e803bf MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/08e803bf/pkb.log
2017-04-30 00:03:26,437 08e803bf MainThread INFO PerfKitBenchmarker version: v1.11.0-45-g6f31bb3
2017-04-30 00:03:26,438 08e803bf MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-30 00:03:26,562 08e803bf MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-30 00:03:26,655 08e803bf MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-30 00:03:26,658 08e803bf MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-30 00:03:26,658 08e803bf MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-30 00:03:26,665 08e803bf MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-30 00:03:26,668 08e803bf MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-30 00:03:26,684 08e803bf MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-30 00:03:26,685 08e803bf MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/08e803bf/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #352
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/352/display/redirect?page=changes>
Changes:
[aviemzur] Fix broken build
[aviemzur] [BEAM-2057] Add a test for metrics reporting in Spark runner.
[aviemzur] [BEAM-1398] KafkaIO metrics.
[lcwik] [BEAM-1871] Hide internal implementation details of how we create a
[lcwik] [BEAM-2098] Walkthrough URL in example code Javadoc is 404 not found
------------------------------------------
[...truncated 272.56 KB...]
* [new ref] refs/pull/2709/merge -> origin/pr/2709/merge
* [new ref] refs/pull/2710/head -> origin/pr/2710/head
* [new ref] refs/pull/2710/merge -> origin/pr/2710/merge
* [new ref] refs/pull/2711/head -> origin/pr/2711/head
* [new ref] refs/pull/2711/merge -> origin/pr/2711/merge
* [new ref] refs/pull/2712/head -> origin/pr/2712/head
* [new ref] refs/pull/2712/merge -> origin/pr/2712/merge
* [new ref] refs/pull/2713/head -> origin/pr/2713/head
* [new ref] refs/pull/2713/merge -> origin/pr/2713/merge
* [new ref] refs/pull/2714/head -> origin/pr/2714/head
* [new ref] refs/pull/2714/merge -> origin/pr/2714/merge
* [new ref] refs/pull/2715/head -> origin/pr/2715/head
* [new ref] refs/pull/2715/merge -> origin/pr/2715/merge
* [new ref] refs/pull/2716/head -> origin/pr/2716/head
* [new ref] refs/pull/2716/merge -> origin/pr/2716/merge
* [new ref] refs/pull/2717/head -> origin/pr/2717/head
* [new ref] refs/pull/2717/merge -> origin/pr/2717/merge
* [new ref] refs/pull/2718/head -> origin/pr/2718/head
* [new ref] refs/pull/2718/merge -> origin/pr/2718/merge
* [new ref] refs/pull/2719/head -> origin/pr/2719/head
* [new ref] refs/pull/2719/merge -> origin/pr/2719/merge
* [new ref] refs/pull/2720/head -> origin/pr/2720/head
* [new ref] refs/pull/2721/head -> origin/pr/2721/head
* [new ref] refs/pull/2721/merge -> origin/pr/2721/merge
* [new ref] refs/pull/2722/head -> origin/pr/2722/head
* [new ref] refs/pull/2722/merge -> origin/pr/2722/merge
* [new ref] refs/pull/2723/head -> origin/pr/2723/head
* [new ref] refs/pull/2723/merge -> origin/pr/2723/merge
* [new ref] refs/pull/2724/head -> origin/pr/2724/head
* [new ref] refs/pull/2724/merge -> origin/pr/2724/merge
* [new ref] refs/pull/2725/head -> origin/pr/2725/head
* [new ref] refs/pull/2726/head -> origin/pr/2726/head
* [new ref] refs/pull/2727/head -> origin/pr/2727/head
* [new ref] refs/pull/2727/merge -> origin/pr/2727/merge
* [new ref] refs/pull/2728/head -> origin/pr/2728/head
* [new ref] refs/pull/2729/head -> origin/pr/2729/head
* [new ref] refs/pull/2729/merge -> origin/pr/2729/merge
* [new ref] refs/pull/2730/head -> origin/pr/2730/head
* [new ref] refs/pull/2730/merge -> origin/pr/2730/merge
* [new ref] refs/pull/2731/head -> origin/pr/2731/head
* [new ref] refs/pull/2732/head -> origin/pr/2732/head
* [new ref] refs/pull/2732/merge -> origin/pr/2732/merge
* [new ref] refs/pull/2733/head -> origin/pr/2733/head
* [new ref] refs/pull/2733/merge -> origin/pr/2733/merge
* [new ref] refs/pull/2734/head -> origin/pr/2734/head
* [new ref] refs/pull/2735/head -> origin/pr/2735/head
* [new ref] refs/pull/2735/merge -> origin/pr/2735/merge
* [new ref] refs/pull/2736/head -> origin/pr/2736/head
* [new ref] refs/pull/2736/merge -> origin/pr/2736/merge
* [new ref] refs/pull/2737/head -> origin/pr/2737/head
* [new ref] refs/pull/2737/merge -> origin/pr/2737/merge
* [new ref] refs/pull/2738/head -> origin/pr/2738/head
* [new ref] refs/pull/2738/merge -> origin/pr/2738/merge
* [new ref] refs/pull/2739/head -> origin/pr/2739/head
* [new ref] refs/pull/2739/merge -> origin/pr/2739/merge
* [new ref] refs/pull/2740/head -> origin/pr/2740/head
* [new ref] refs/pull/2740/merge -> origin/pr/2740/merge
* [new ref] refs/pull/2741/head -> origin/pr/2741/head
* [new ref] refs/pull/2742/head -> origin/pr/2742/head
* [new ref] refs/pull/2743/head -> origin/pr/2743/head
* [new ref] refs/pull/2743/merge -> origin/pr/2743/merge
* [new ref] refs/pull/2744/head -> origin/pr/2744/head
* [new ref] refs/pull/2744/merge -> origin/pr/2744/merge
* [new ref] refs/pull/2745/head -> origin/pr/2745/head
* [new ref] refs/pull/2745/merge -> origin/pr/2745/merge
* [new ref] refs/pull/2746/head -> origin/pr/2746/head
* [new ref] refs/pull/2746/merge -> origin/pr/2746/merge
* [new ref] refs/pull/2747/head -> origin/pr/2747/head
* [new ref] refs/pull/2747/merge -> origin/pr/2747/merge
* [new ref] refs/pull/2748/head -> origin/pr/2748/head
* [new ref] refs/pull/2748/merge -> origin/pr/2748/merge
* [new ref] refs/pull/2749/head -> origin/pr/2749/head
* [new ref] refs/pull/2749/merge -> origin/pr/2749/merge
* [new ref] refs/pull/2750/head -> origin/pr/2750/head
* [new ref] refs/pull/2750/merge -> origin/pr/2750/merge
* [new ref] refs/pull/2751/head -> origin/pr/2751/head
* [new ref] refs/pull/2751/merge -> origin/pr/2751/merge
* [new ref] refs/pull/2752/head -> origin/pr/2752/head
* [new ref] refs/pull/2752/merge -> origin/pr/2752/merge
* [new ref] refs/pull/2753/head -> origin/pr/2753/head
* [new ref] refs/pull/2753/merge -> origin/pr/2753/merge
* [new ref] refs/pull/2754/head -> origin/pr/2754/head
* [new ref] refs/pull/2754/merge -> origin/pr/2754/merge
* [new ref] refs/pull/2755/head -> origin/pr/2755/head
* [new ref] refs/pull/2756/head -> origin/pr/2756/head
* [new ref] refs/pull/2756/merge -> origin/pr/2756/merge
* [new ref] refs/pull/2757/head -> origin/pr/2757/head
* [new ref] refs/pull/2757/merge -> origin/pr/2757/merge
* [new ref] refs/pull/2758/head -> origin/pr/2758/head
* [new ref] refs/pull/2758/merge -> origin/pr/2758/merge
* [new ref] refs/pull/2759/head -> origin/pr/2759/head
* [new ref] refs/pull/2759/merge -> origin/pr/2759/merge
* [new ref] refs/pull/2760/head -> origin/pr/2760/head
* [new ref] refs/pull/2760/merge -> origin/pr/2760/merge
* [new ref] refs/pull/2761/head -> origin/pr/2761/head
* [new ref] refs/pull/2761/merge -> origin/pr/2761/merge
* [new ref] refs/pull/2762/head -> origin/pr/2762/head
* [new ref] refs/pull/2762/merge -> origin/pr/2762/merge
* [new ref] refs/pull/2763/head -> origin/pr/2763/head
* [new ref] refs/pull/2763/merge -> origin/pr/2763/merge
* [new ref] refs/pull/2764/head -> origin/pr/2764/head
* [new ref] refs/pull/2764/merge -> origin/pr/2764/merge
* [new ref] refs/pull/2765/head -> origin/pr/2765/head
* [new ref] refs/pull/2766/head -> origin/pr/2766/head
* [new ref] refs/pull/2766/merge -> origin/pr/2766/merge
* [new ref] refs/pull/2767/head -> origin/pr/2767/head
* [new ref] refs/pull/2767/merge -> origin/pr/2767/merge
* [new ref] refs/pull/2768/head -> origin/pr/2768/head
* [new ref] refs/pull/2768/merge -> origin/pr/2768/merge
* [new ref] refs/pull/2769/head -> origin/pr/2769/head
* [new ref] refs/pull/2769/merge -> origin/pr/2769/merge
* [new ref] refs/pull/2770/head -> origin/pr/2770/head
* [new ref] refs/pull/2770/merge -> origin/pr/2770/merge
* [new ref] refs/pull/2771/head -> origin/pr/2771/head
* [new ref] refs/pull/2771/merge -> origin/pr/2771/merge
* [new ref] refs/pull/2772/head -> origin/pr/2772/head
* [new ref] refs/pull/2772/merge -> origin/pr/2772/merge
* [new ref] refs/pull/2773/head -> origin/pr/2773/head
* [new ref] refs/pull/2773/merge -> origin/pr/2773/merge
* [new ref] refs/pull/2774/head -> origin/pr/2774/head
* [new ref] refs/pull/2774/merge -> origin/pr/2774/merge
* [new ref] refs/pull/2775/head -> origin/pr/2775/head
* [new ref] refs/pull/2775/merge -> origin/pr/2775/merge
* [new ref] refs/pull/2776/head -> origin/pr/2776/head
* [new ref] refs/pull/2776/merge -> origin/pr/2776/merge
* [new ref] refs/pull/2777/head -> origin/pr/2777/head
* [new ref] refs/pull/2777/merge -> origin/pr/2777/merge
* [new ref] refs/pull/2778/head -> origin/pr/2778/head
* [new ref] refs/pull/2778/merge -> origin/pr/2778/merge
* [new ref] refs/pull/2779/head -> origin/pr/2779/head
* [new ref] refs/pull/2779/merge -> origin/pr/2779/merge
* [new ref] refs/pull/2780/head -> origin/pr/2780/head
* [new ref] refs/pull/2780/merge -> origin/pr/2780/merge
* [new ref] refs/pull/2781/head -> origin/pr/2781/head
* [new ref] refs/pull/2782/head -> origin/pr/2782/head
* [new ref] refs/pull/2782/merge -> origin/pr/2782/merge
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1866)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1585)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:71)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:348)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1545)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:830)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor788.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy103.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:807)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision be883666f377b29926cc1e7408d7cd268ca6ceff (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f be883666f377b29926cc1e7408d7cd268ca6ceff
> git rev-list 2b6cb8ca17a8a87aa9db2e5725f018ef564f27d7 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4745471857012938703.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson6358110927967500065.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson8940889086758308405.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3378038771597517468.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-29 18:03:49,527 bb4cfe9b MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/bb4cfe9b/pkb.log
2017-04-29 18:03:49,527 bb4cfe9b MainThread INFO PerfKitBenchmarker version: v1.11.0-45-g6f31bb3
2017-04-29 18:03:49,528 bb4cfe9b MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-29 18:03:49,751 bb4cfe9b MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-29 18:03:49,894 bb4cfe9b MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-29 18:03:49,897 bb4cfe9b MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-29 18:03:49,897 bb4cfe9b MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-29 18:03:49,904 bb4cfe9b MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-29 18:03:49,906 bb4cfe9b MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-29 18:03:49,918 bb4cfe9b MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-29 18:03:49,919 bb4cfe9b MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/bb4cfe9b/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #351
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/351/display/redirect>
------------------------------------------
[...truncated 275.47 KB...]
* [new ref] refs/pull/2709/head -> origin/pr/2709/head
* [new ref] refs/pull/2709/merge -> origin/pr/2709/merge
* [new ref] refs/pull/2710/head -> origin/pr/2710/head
* [new ref] refs/pull/2710/merge -> origin/pr/2710/merge
* [new ref] refs/pull/2711/head -> origin/pr/2711/head
* [new ref] refs/pull/2711/merge -> origin/pr/2711/merge
* [new ref] refs/pull/2712/head -> origin/pr/2712/head
* [new ref] refs/pull/2712/merge -> origin/pr/2712/merge
* [new ref] refs/pull/2713/head -> origin/pr/2713/head
* [new ref] refs/pull/2713/merge -> origin/pr/2713/merge
* [new ref] refs/pull/2714/head -> origin/pr/2714/head
* [new ref] refs/pull/2714/merge -> origin/pr/2714/merge
* [new ref] refs/pull/2715/head -> origin/pr/2715/head
* [new ref] refs/pull/2715/merge -> origin/pr/2715/merge
* [new ref] refs/pull/2716/head -> origin/pr/2716/head
* [new ref] refs/pull/2716/merge -> origin/pr/2716/merge
* [new ref] refs/pull/2717/head -> origin/pr/2717/head
* [new ref] refs/pull/2717/merge -> origin/pr/2717/merge
* [new ref] refs/pull/2718/head -> origin/pr/2718/head
* [new ref] refs/pull/2718/merge -> origin/pr/2718/merge
* [new ref] refs/pull/2719/head -> origin/pr/2719/head
* [new ref] refs/pull/2719/merge -> origin/pr/2719/merge
* [new ref] refs/pull/2720/head -> origin/pr/2720/head
* [new ref] refs/pull/2721/head -> origin/pr/2721/head
* [new ref] refs/pull/2721/merge -> origin/pr/2721/merge
* [new ref] refs/pull/2722/head -> origin/pr/2722/head
* [new ref] refs/pull/2722/merge -> origin/pr/2722/merge
* [new ref] refs/pull/2723/head -> origin/pr/2723/head
* [new ref] refs/pull/2723/merge -> origin/pr/2723/merge
* [new ref] refs/pull/2724/head -> origin/pr/2724/head
* [new ref] refs/pull/2724/merge -> origin/pr/2724/merge
* [new ref] refs/pull/2725/head -> origin/pr/2725/head
* [new ref] refs/pull/2726/head -> origin/pr/2726/head
* [new ref] refs/pull/2727/head -> origin/pr/2727/head
* [new ref] refs/pull/2727/merge -> origin/pr/2727/merge
* [new ref] refs/pull/2728/head -> origin/pr/2728/head
* [new ref] refs/pull/2729/head -> origin/pr/2729/head
* [new ref] refs/pull/2729/merge -> origin/pr/2729/merge
* [new ref] refs/pull/2730/head -> origin/pr/2730/head
* [new ref] refs/pull/2730/merge -> origin/pr/2730/merge
* [new ref] refs/pull/2731/head -> origin/pr/2731/head
* [new ref] refs/pull/2732/head -> origin/pr/2732/head
* [new ref] refs/pull/2732/merge -> origin/pr/2732/merge
* [new ref] refs/pull/2733/head -> origin/pr/2733/head
* [new ref] refs/pull/2733/merge -> origin/pr/2733/merge
* [new ref] refs/pull/2734/head -> origin/pr/2734/head
* [new ref] refs/pull/2735/head -> origin/pr/2735/head
* [new ref] refs/pull/2735/merge -> origin/pr/2735/merge
* [new ref] refs/pull/2736/head -> origin/pr/2736/head
* [new ref] refs/pull/2736/merge -> origin/pr/2736/merge
* [new ref] refs/pull/2737/head -> origin/pr/2737/head
* [new ref] refs/pull/2737/merge -> origin/pr/2737/merge
* [new ref] refs/pull/2738/head -> origin/pr/2738/head
* [new ref] refs/pull/2738/merge -> origin/pr/2738/merge
* [new ref] refs/pull/2739/head -> origin/pr/2739/head
* [new ref] refs/pull/2739/merge -> origin/pr/2739/merge
* [new ref] refs/pull/2740/head -> origin/pr/2740/head
* [new ref] refs/pull/2740/merge -> origin/pr/2740/merge
* [new ref] refs/pull/2741/head -> origin/pr/2741/head
* [new ref] refs/pull/2742/head -> origin/pr/2742/head
* [new ref] refs/pull/2743/head -> origin/pr/2743/head
* [new ref] refs/pull/2743/merge -> origin/pr/2743/merge
* [new ref] refs/pull/2744/head -> origin/pr/2744/head
* [new ref] refs/pull/2744/merge -> origin/pr/2744/merge
* [new ref] refs/pull/2745/head -> origin/pr/2745/head
* [new ref] refs/pull/2745/merge -> origin/pr/2745/merge
* [new ref] refs/pull/2746/head -> origin/pr/2746/head
* [new ref] refs/pull/2746/merge -> origin/pr/2746/merge
* [new ref] refs/pull/2747/head -> origin/pr/2747/head
* [new ref] refs/pull/2747/merge -> origin/pr/2747/merge
* [new ref] refs/pull/2748/head -> origin/pr/2748/head
* [new ref] refs/pull/2748/merge -> origin/pr/2748/merge
* [new ref] refs/pull/2749/head -> origin/pr/2749/head
* [new ref] refs/pull/2749/merge -> origin/pr/2749/merge
* [new ref] refs/pull/2750/head -> origin/pr/2750/head
* [new ref] refs/pull/2750/merge -> origin/pr/2750/merge
* [new ref] refs/pull/2751/head -> origin/pr/2751/head
* [new ref] refs/pull/2751/merge -> origin/pr/2751/merge
* [new ref] refs/pull/2752/head -> origin/pr/2752/head
* [new ref] refs/pull/2752/merge -> origin/pr/2752/merge
* [new ref] refs/pull/2753/head -> origin/pr/2753/head
* [new ref] refs/pull/2753/merge -> origin/pr/2753/merge
* [new ref] refs/pull/2754/head -> origin/pr/2754/head
* [new ref] refs/pull/2754/merge -> origin/pr/2754/merge
* [new ref] refs/pull/2755/head -> origin/pr/2755/head
* [new ref] refs/pull/2756/head -> origin/pr/2756/head
* [new ref] refs/pull/2756/merge -> origin/pr/2756/merge
* [new ref] refs/pull/2757/head -> origin/pr/2757/head
* [new ref] refs/pull/2757/merge -> origin/pr/2757/merge
* [new ref] refs/pull/2758/head -> origin/pr/2758/head
* [new ref] refs/pull/2758/merge -> origin/pr/2758/merge
* [new ref] refs/pull/2759/head -> origin/pr/2759/head
* [new ref] refs/pull/2759/merge -> origin/pr/2759/merge
* [new ref] refs/pull/2760/head -> origin/pr/2760/head
* [new ref] refs/pull/2760/merge -> origin/pr/2760/merge
* [new ref] refs/pull/2761/head -> origin/pr/2761/head
* [new ref] refs/pull/2761/merge -> origin/pr/2761/merge
* [new ref] refs/pull/2762/head -> origin/pr/2762/head
* [new ref] refs/pull/2762/merge -> origin/pr/2762/merge
* [new ref] refs/pull/2763/head -> origin/pr/2763/head
* [new ref] refs/pull/2763/merge -> origin/pr/2763/merge
* [new ref] refs/pull/2764/head -> origin/pr/2764/head
* [new ref] refs/pull/2764/merge -> origin/pr/2764/merge
* [new ref] refs/pull/2765/head -> origin/pr/2765/head
* [new ref] refs/pull/2766/head -> origin/pr/2766/head
* [new ref] refs/pull/2766/merge -> origin/pr/2766/merge
* [new ref] refs/pull/2767/head -> origin/pr/2767/head
* [new ref] refs/pull/2767/merge -> origin/pr/2767/merge
* [new ref] refs/pull/2768/head -> origin/pr/2768/head
* [new ref] refs/pull/2768/merge -> origin/pr/2768/merge
* [new ref] refs/pull/2769/head -> origin/pr/2769/head
* [new ref] refs/pull/2769/merge -> origin/pr/2769/merge
* [new ref] refs/pull/2770/head -> origin/pr/2770/head
* [new ref] refs/pull/2770/merge -> origin/pr/2770/merge
* [new ref] refs/pull/2771/head -> origin/pr/2771/head
* [new ref] refs/pull/2771/merge -> origin/pr/2771/merge
* [new ref] refs/pull/2772/head -> origin/pr/2772/head
* [new ref] refs/pull/2772/merge -> origin/pr/2772/merge
* [new ref] refs/pull/2773/head -> origin/pr/2773/head
* [new ref] refs/pull/2773/merge -> origin/pr/2773/merge
* [new ref] refs/pull/2774/head -> origin/pr/2774/head
* [new ref] refs/pull/2774/merge -> origin/pr/2774/merge
* [new ref] refs/pull/2775/head -> origin/pr/2775/head
* [new ref] refs/pull/2775/merge -> origin/pr/2775/merge
* [new ref] refs/pull/2776/head -> origin/pr/2776/head
* [new ref] refs/pull/2776/merge -> origin/pr/2776/merge
* [new ref] refs/pull/2777/head -> origin/pr/2777/head
* [new ref] refs/pull/2777/merge -> origin/pr/2777/merge
* [new ref] refs/pull/2778/head -> origin/pr/2778/head
* [new ref] refs/pull/2778/merge -> origin/pr/2778/merge
* [new ref] refs/pull/2779/head -> origin/pr/2779/head
* [new ref] refs/pull/2779/merge -> origin/pr/2779/merge
* [new ref] refs/pull/2780/head -> origin/pr/2780/head
* [new ref] refs/pull/2780/merge -> origin/pr/2780/merge
* [new ref] refs/pull/2781/head -> origin/pr/2781/head
* [new ref] refs/pull/2781/merge -> origin/pr/2781/merge
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1866)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1585)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:71)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:348)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1545)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:830)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor788.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy103.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:807)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 2b6cb8ca17a8a87aa9db2e5725f018ef564f27d7 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 2b6cb8ca17a8a87aa9db2e5725f018ef564f27d7
> git rev-list 2b6cb8ca17a8a87aa9db2e5725f018ef564f27d7 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5610768077729537594.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2140599300260081637.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3098636546658275577.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2183055372966426644.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-29 12:02:56,991 71421fca MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/71421fca/pkb.log
2017-04-29 12:02:56,992 71421fca MainThread INFO PerfKitBenchmarker version: v1.11.0-45-g6f31bb3
2017-04-29 12:02:56,992 71421fca MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-29 12:02:57,205 71421fca MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-29 12:02:57,299 71421fca MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-29 12:02:57,302 71421fca MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-29 12:02:57,302 71421fca MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-29 12:02:57,309 71421fca MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-29 12:02:57,311 71421fca MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-29 12:02:57,333 71421fca MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-29 12:02:57,334 71421fca MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/71421fca/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #350
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/350/display/redirect?page=changes>
Changes:
[tgroh] Java-Serialize Coders Directly
[tgroh] Use Runner API Encodings in the Fn API
------------------------------------------
[...truncated 276.76 KB...]
* [new ref] refs/pull/2707/head -> origin/pr/2707/head
* [new ref] refs/pull/2707/merge -> origin/pr/2707/merge
* [new ref] refs/pull/2708/head -> origin/pr/2708/head
* [new ref] refs/pull/2708/merge -> origin/pr/2708/merge
* [new ref] refs/pull/2709/head -> origin/pr/2709/head
* [new ref] refs/pull/2709/merge -> origin/pr/2709/merge
* [new ref] refs/pull/2710/head -> origin/pr/2710/head
* [new ref] refs/pull/2710/merge -> origin/pr/2710/merge
* [new ref] refs/pull/2711/head -> origin/pr/2711/head
* [new ref] refs/pull/2711/merge -> origin/pr/2711/merge
* [new ref] refs/pull/2712/head -> origin/pr/2712/head
* [new ref] refs/pull/2712/merge -> origin/pr/2712/merge
* [new ref] refs/pull/2713/head -> origin/pr/2713/head
* [new ref] refs/pull/2713/merge -> origin/pr/2713/merge
* [new ref] refs/pull/2714/head -> origin/pr/2714/head
* [new ref] refs/pull/2714/merge -> origin/pr/2714/merge
* [new ref] refs/pull/2715/head -> origin/pr/2715/head
* [new ref] refs/pull/2715/merge -> origin/pr/2715/merge
* [new ref] refs/pull/2716/head -> origin/pr/2716/head
* [new ref] refs/pull/2716/merge -> origin/pr/2716/merge
* [new ref] refs/pull/2717/head -> origin/pr/2717/head
* [new ref] refs/pull/2717/merge -> origin/pr/2717/merge
* [new ref] refs/pull/2718/head -> origin/pr/2718/head
* [new ref] refs/pull/2718/merge -> origin/pr/2718/merge
* [new ref] refs/pull/2719/head -> origin/pr/2719/head
* [new ref] refs/pull/2719/merge -> origin/pr/2719/merge
* [new ref] refs/pull/2720/head -> origin/pr/2720/head
* [new ref] refs/pull/2721/head -> origin/pr/2721/head
* [new ref] refs/pull/2721/merge -> origin/pr/2721/merge
* [new ref] refs/pull/2722/head -> origin/pr/2722/head
* [new ref] refs/pull/2722/merge -> origin/pr/2722/merge
* [new ref] refs/pull/2723/head -> origin/pr/2723/head
* [new ref] refs/pull/2723/merge -> origin/pr/2723/merge
* [new ref] refs/pull/2724/head -> origin/pr/2724/head
* [new ref] refs/pull/2724/merge -> origin/pr/2724/merge
* [new ref] refs/pull/2725/head -> origin/pr/2725/head
* [new ref] refs/pull/2726/head -> origin/pr/2726/head
* [new ref] refs/pull/2727/head -> origin/pr/2727/head
* [new ref] refs/pull/2727/merge -> origin/pr/2727/merge
* [new ref] refs/pull/2728/head -> origin/pr/2728/head
* [new ref] refs/pull/2729/head -> origin/pr/2729/head
* [new ref] refs/pull/2729/merge -> origin/pr/2729/merge
* [new ref] refs/pull/2730/head -> origin/pr/2730/head
* [new ref] refs/pull/2730/merge -> origin/pr/2730/merge
* [new ref] refs/pull/2731/head -> origin/pr/2731/head
* [new ref] refs/pull/2732/head -> origin/pr/2732/head
* [new ref] refs/pull/2732/merge -> origin/pr/2732/merge
* [new ref] refs/pull/2733/head -> origin/pr/2733/head
* [new ref] refs/pull/2733/merge -> origin/pr/2733/merge
* [new ref] refs/pull/2734/head -> origin/pr/2734/head
* [new ref] refs/pull/2735/head -> origin/pr/2735/head
* [new ref] refs/pull/2735/merge -> origin/pr/2735/merge
* [new ref] refs/pull/2736/head -> origin/pr/2736/head
* [new ref] refs/pull/2736/merge -> origin/pr/2736/merge
* [new ref] refs/pull/2737/head -> origin/pr/2737/head
* [new ref] refs/pull/2737/merge -> origin/pr/2737/merge
* [new ref] refs/pull/2738/head -> origin/pr/2738/head
* [new ref] refs/pull/2738/merge -> origin/pr/2738/merge
* [new ref] refs/pull/2739/head -> origin/pr/2739/head
* [new ref] refs/pull/2739/merge -> origin/pr/2739/merge
* [new ref] refs/pull/2740/head -> origin/pr/2740/head
* [new ref] refs/pull/2740/merge -> origin/pr/2740/merge
* [new ref] refs/pull/2741/head -> origin/pr/2741/head
* [new ref] refs/pull/2742/head -> origin/pr/2742/head
* [new ref] refs/pull/2743/head -> origin/pr/2743/head
* [new ref] refs/pull/2743/merge -> origin/pr/2743/merge
* [new ref] refs/pull/2744/head -> origin/pr/2744/head
* [new ref] refs/pull/2744/merge -> origin/pr/2744/merge
* [new ref] refs/pull/2745/head -> origin/pr/2745/head
* [new ref] refs/pull/2745/merge -> origin/pr/2745/merge
* [new ref] refs/pull/2746/head -> origin/pr/2746/head
* [new ref] refs/pull/2746/merge -> origin/pr/2746/merge
* [new ref] refs/pull/2747/head -> origin/pr/2747/head
* [new ref] refs/pull/2747/merge -> origin/pr/2747/merge
* [new ref] refs/pull/2748/head -> origin/pr/2748/head
* [new ref] refs/pull/2748/merge -> origin/pr/2748/merge
* [new ref] refs/pull/2749/head -> origin/pr/2749/head
* [new ref] refs/pull/2749/merge -> origin/pr/2749/merge
* [new ref] refs/pull/2750/head -> origin/pr/2750/head
* [new ref] refs/pull/2750/merge -> origin/pr/2750/merge
* [new ref] refs/pull/2751/head -> origin/pr/2751/head
* [new ref] refs/pull/2751/merge -> origin/pr/2751/merge
* [new ref] refs/pull/2752/head -> origin/pr/2752/head
* [new ref] refs/pull/2752/merge -> origin/pr/2752/merge
* [new ref] refs/pull/2753/head -> origin/pr/2753/head
* [new ref] refs/pull/2753/merge -> origin/pr/2753/merge
* [new ref] refs/pull/2754/head -> origin/pr/2754/head
* [new ref] refs/pull/2754/merge -> origin/pr/2754/merge
* [new ref] refs/pull/2755/head -> origin/pr/2755/head
* [new ref] refs/pull/2756/head -> origin/pr/2756/head
* [new ref] refs/pull/2756/merge -> origin/pr/2756/merge
* [new ref] refs/pull/2757/head -> origin/pr/2757/head
* [new ref] refs/pull/2757/merge -> origin/pr/2757/merge
* [new ref] refs/pull/2758/head -> origin/pr/2758/head
* [new ref] refs/pull/2758/merge -> origin/pr/2758/merge
* [new ref] refs/pull/2759/head -> origin/pr/2759/head
* [new ref] refs/pull/2759/merge -> origin/pr/2759/merge
* [new ref] refs/pull/2760/head -> origin/pr/2760/head
* [new ref] refs/pull/2760/merge -> origin/pr/2760/merge
* [new ref] refs/pull/2761/head -> origin/pr/2761/head
* [new ref] refs/pull/2761/merge -> origin/pr/2761/merge
* [new ref] refs/pull/2762/head -> origin/pr/2762/head
* [new ref] refs/pull/2762/merge -> origin/pr/2762/merge
* [new ref] refs/pull/2763/head -> origin/pr/2763/head
* [new ref] refs/pull/2763/merge -> origin/pr/2763/merge
* [new ref] refs/pull/2764/head -> origin/pr/2764/head
* [new ref] refs/pull/2764/merge -> origin/pr/2764/merge
* [new ref] refs/pull/2765/head -> origin/pr/2765/head
* [new ref] refs/pull/2766/head -> origin/pr/2766/head
* [new ref] refs/pull/2766/merge -> origin/pr/2766/merge
* [new ref] refs/pull/2767/head -> origin/pr/2767/head
* [new ref] refs/pull/2767/merge -> origin/pr/2767/merge
* [new ref] refs/pull/2768/head -> origin/pr/2768/head
* [new ref] refs/pull/2768/merge -> origin/pr/2768/merge
* [new ref] refs/pull/2769/head -> origin/pr/2769/head
* [new ref] refs/pull/2769/merge -> origin/pr/2769/merge
* [new ref] refs/pull/2770/head -> origin/pr/2770/head
* [new ref] refs/pull/2770/merge -> origin/pr/2770/merge
* [new ref] refs/pull/2771/head -> origin/pr/2771/head
* [new ref] refs/pull/2771/merge -> origin/pr/2771/merge
* [new ref] refs/pull/2772/head -> origin/pr/2772/head
* [new ref] refs/pull/2772/merge -> origin/pr/2772/merge
* [new ref] refs/pull/2773/head -> origin/pr/2773/head
* [new ref] refs/pull/2773/merge -> origin/pr/2773/merge
* [new ref] refs/pull/2774/head -> origin/pr/2774/head
* [new ref] refs/pull/2774/merge -> origin/pr/2774/merge
* [new ref] refs/pull/2775/head -> origin/pr/2775/head
* [new ref] refs/pull/2775/merge -> origin/pr/2775/merge
* [new ref] refs/pull/2776/head -> origin/pr/2776/head
* [new ref] refs/pull/2776/merge -> origin/pr/2776/merge
* [new ref] refs/pull/2777/head -> origin/pr/2777/head
* [new ref] refs/pull/2777/merge -> origin/pr/2777/merge
* [new ref] refs/pull/2778/head -> origin/pr/2778/head
* [new ref] refs/pull/2778/merge -> origin/pr/2778/merge
* [new ref] refs/pull/2779/head -> origin/pr/2779/head
* [new ref] refs/pull/2779/merge -> origin/pr/2779/merge
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1866)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1585)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:71)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:348)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1545)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:830)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor788.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy103.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:807)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 2b6cb8ca17a8a87aa9db2e5725f018ef564f27d7 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 2b6cb8ca17a8a87aa9db2e5725f018ef564f27d7
> git rev-list 8cc4d59c2f617746228ae71f7c9b3606ab41d4aa # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson575957050051838022.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4536196834838176277.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4461022084672753065.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2123489805330147213.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-29 06:03:00,455 12fcd3a7 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/12fcd3a7/pkb.log
2017-04-29 06:03:00,455 12fcd3a7 MainThread INFO PerfKitBenchmarker version: v1.11.0-45-g6f31bb3
2017-04-29 06:03:00,455 12fcd3a7 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-29 06:03:00,806 12fcd3a7 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-29 06:03:00,893 12fcd3a7 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-29 06:03:00,896 12fcd3a7 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-29 06:03:00,896 12fcd3a7 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-29 06:03:00,903 12fcd3a7 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-29 06:03:00,905 12fcd3a7 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-29 06:03:00,928 12fcd3a7 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-29 06:03:00,929 12fcd3a7 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/12fcd3a7/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #349
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/349/display/redirect?page=changes>
Changes:
[thw] BEAM-1981 Fix ApexTimerInternals serialization error.
[lcwik] [BEAM-2119] Fix FileSystems to have the local filesystem installed by
[dhalperi] ResourceId: Add #isDirectory
[dhalperi] TextIOTest: shrink size of test data
[dhalperi] Remove IOChannelUtils from a few ITs
[dhalperi] Use getFileName in NumberedShardedFile
[dhalperi] [BEAM-2114] Wrap inferred KafkaIO Coders with NullableCoder
[lcwik] [BEAM-2031] Add support to pass through zero or more Hadoop
[davor] Retire Travis-CI coverage in Apache Beam
[klk] Rollforwards "Replace OutputTimeFn UDF with TimestampCombiner enum""
[klk] Update Dataflow worker container to 20170428-2
[lcwik] [BEAM-2005] Swap to use Lists within MatchResult instead of arrays.
[tgroh] Rename StandardCoder to StructuredCoder
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on beam3 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/>
Cloning the remote Git repository
Cloning repository https://github.com/apache/beam.git
> git init <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/> # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/*
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
> git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 8cc4d59c2f617746228ae71f7c9b3606ab41d4aa (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 8cc4d59c2f617746228ae71f7c9b3606ab41d4aa
> git rev-list a8a04a2905e1ff639f403be7d9132acb77365e84 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson8165256925489934285.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5977251568187376076.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson7413298209517419532.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson7237457073097871041.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-29 03:13:57,597 4369b025 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/4369b025/pkb.log
2017-04-29 03:13:57,597 4369b025 MainThread INFO PerfKitBenchmarker version: v1.11.0-45-g6f31bb3
2017-04-29 03:13:57,598 4369b025 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-29 03:13:58,134 4369b025 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-29 03:13:58,237 4369b025 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-29 03:13:58,240 4369b025 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-29 03:13:58,240 4369b025 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-29 03:13:58,246 4369b025 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-29 03:13:58,248 4369b025 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-29 03:13:58,253 4369b025 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-29 03:13:58,254 4369b025 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/4369b025/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #348
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/348/display/redirect?page=changes>
Changes:
[lcwik] [BEAM-1871] Remove irrelevant runtime dependencies.
[lcwik] [BEAM-2005] Move getScheme from FileSystemRegistrar to FileSystem
[iemejia] Remove missing references to the flink examples package after refactor
[altay] [BEAM-2094] WordCount examples produce garbage for non-English input
[davor] Fix Javadoc warnings
[dhalperi] Add getFilename method to ResourceId
------------------------------------------
[...truncated 278.83 KB...]
* [new ref] refs/pull/2695/merge -> origin/pr/2695/merge
* [new ref] refs/pull/2696/head -> origin/pr/2696/head
* [new ref] refs/pull/2696/merge -> origin/pr/2696/merge
* [new ref] refs/pull/2697/head -> origin/pr/2697/head
* [new ref] refs/pull/2697/merge -> origin/pr/2697/merge
* [new ref] refs/pull/2698/head -> origin/pr/2698/head
* [new ref] refs/pull/2698/merge -> origin/pr/2698/merge
* [new ref] refs/pull/2699/head -> origin/pr/2699/head
* [new ref] refs/pull/2699/merge -> origin/pr/2699/merge
* [new ref] refs/pull/2700/head -> origin/pr/2700/head
* [new ref] refs/pull/2700/merge -> origin/pr/2700/merge
* [new ref] refs/pull/2701/head -> origin/pr/2701/head
* [new ref] refs/pull/2701/merge -> origin/pr/2701/merge
* [new ref] refs/pull/2702/head -> origin/pr/2702/head
* [new ref] refs/pull/2702/merge -> origin/pr/2702/merge
* [new ref] refs/pull/2703/head -> origin/pr/2703/head
* [new ref] refs/pull/2703/merge -> origin/pr/2703/merge
* [new ref] refs/pull/2704/head -> origin/pr/2704/head
* [new ref] refs/pull/2704/merge -> origin/pr/2704/merge
* [new ref] refs/pull/2705/head -> origin/pr/2705/head
* [new ref] refs/pull/2705/merge -> origin/pr/2705/merge
* [new ref] refs/pull/2706/head -> origin/pr/2706/head
* [new ref] refs/pull/2707/head -> origin/pr/2707/head
* [new ref] refs/pull/2707/merge -> origin/pr/2707/merge
* [new ref] refs/pull/2708/head -> origin/pr/2708/head
* [new ref] refs/pull/2708/merge -> origin/pr/2708/merge
* [new ref] refs/pull/2709/head -> origin/pr/2709/head
* [new ref] refs/pull/2709/merge -> origin/pr/2709/merge
* [new ref] refs/pull/2710/head -> origin/pr/2710/head
* [new ref] refs/pull/2710/merge -> origin/pr/2710/merge
* [new ref] refs/pull/2711/head -> origin/pr/2711/head
* [new ref] refs/pull/2711/merge -> origin/pr/2711/merge
* [new ref] refs/pull/2712/head -> origin/pr/2712/head
* [new ref] refs/pull/2712/merge -> origin/pr/2712/merge
* [new ref] refs/pull/2713/head -> origin/pr/2713/head
* [new ref] refs/pull/2713/merge -> origin/pr/2713/merge
* [new ref] refs/pull/2714/head -> origin/pr/2714/head
* [new ref] refs/pull/2714/merge -> origin/pr/2714/merge
* [new ref] refs/pull/2715/head -> origin/pr/2715/head
* [new ref] refs/pull/2715/merge -> origin/pr/2715/merge
* [new ref] refs/pull/2716/head -> origin/pr/2716/head
* [new ref] refs/pull/2716/merge -> origin/pr/2716/merge
* [new ref] refs/pull/2717/head -> origin/pr/2717/head
* [new ref] refs/pull/2717/merge -> origin/pr/2717/merge
* [new ref] refs/pull/2718/head -> origin/pr/2718/head
* [new ref] refs/pull/2718/merge -> origin/pr/2718/merge
* [new ref] refs/pull/2719/head -> origin/pr/2719/head
* [new ref] refs/pull/2719/merge -> origin/pr/2719/merge
* [new ref] refs/pull/2720/head -> origin/pr/2720/head
* [new ref] refs/pull/2720/merge -> origin/pr/2720/merge
* [new ref] refs/pull/2721/head -> origin/pr/2721/head
* [new ref] refs/pull/2721/merge -> origin/pr/2721/merge
* [new ref] refs/pull/2722/head -> origin/pr/2722/head
* [new ref] refs/pull/2722/merge -> origin/pr/2722/merge
* [new ref] refs/pull/2723/head -> origin/pr/2723/head
* [new ref] refs/pull/2723/merge -> origin/pr/2723/merge
* [new ref] refs/pull/2724/head -> origin/pr/2724/head
* [new ref] refs/pull/2724/merge -> origin/pr/2724/merge
* [new ref] refs/pull/2725/head -> origin/pr/2725/head
* [new ref] refs/pull/2726/head -> origin/pr/2726/head
* [new ref] refs/pull/2727/head -> origin/pr/2727/head
* [new ref] refs/pull/2727/merge -> origin/pr/2727/merge
* [new ref] refs/pull/2728/head -> origin/pr/2728/head
* [new ref] refs/pull/2729/head -> origin/pr/2729/head
* [new ref] refs/pull/2729/merge -> origin/pr/2729/merge
* [new ref] refs/pull/2730/head -> origin/pr/2730/head
* [new ref] refs/pull/2730/merge -> origin/pr/2730/merge
* [new ref] refs/pull/2731/head -> origin/pr/2731/head
* [new ref] refs/pull/2732/head -> origin/pr/2732/head
* [new ref] refs/pull/2732/merge -> origin/pr/2732/merge
* [new ref] refs/pull/2733/head -> origin/pr/2733/head
* [new ref] refs/pull/2733/merge -> origin/pr/2733/merge
* [new ref] refs/pull/2734/head -> origin/pr/2734/head
* [new ref] refs/pull/2734/merge -> origin/pr/2734/merge
* [new ref] refs/pull/2735/head -> origin/pr/2735/head
* [new ref] refs/pull/2735/merge -> origin/pr/2735/merge
* [new ref] refs/pull/2736/head -> origin/pr/2736/head
* [new ref] refs/pull/2736/merge -> origin/pr/2736/merge
* [new ref] refs/pull/2737/head -> origin/pr/2737/head
* [new ref] refs/pull/2737/merge -> origin/pr/2737/merge
* [new ref] refs/pull/2738/head -> origin/pr/2738/head
* [new ref] refs/pull/2738/merge -> origin/pr/2738/merge
* [new ref] refs/pull/2739/head -> origin/pr/2739/head
* [new ref] refs/pull/2739/merge -> origin/pr/2739/merge
* [new ref] refs/pull/2740/head -> origin/pr/2740/head
* [new ref] refs/pull/2740/merge -> origin/pr/2740/merge
* [new ref] refs/pull/2741/head -> origin/pr/2741/head
* [new ref] refs/pull/2741/merge -> origin/pr/2741/merge
* [new ref] refs/pull/2742/head -> origin/pr/2742/head
* [new ref] refs/pull/2743/head -> origin/pr/2743/head
* [new ref] refs/pull/2743/merge -> origin/pr/2743/merge
* [new ref] refs/pull/2744/head -> origin/pr/2744/head
* [new ref] refs/pull/2744/merge -> origin/pr/2744/merge
* [new ref] refs/pull/2745/head -> origin/pr/2745/head
* [new ref] refs/pull/2745/merge -> origin/pr/2745/merge
* [new ref] refs/pull/2746/head -> origin/pr/2746/head
* [new ref] refs/pull/2746/merge -> origin/pr/2746/merge
* [new ref] refs/pull/2747/head -> origin/pr/2747/head
* [new ref] refs/pull/2747/merge -> origin/pr/2747/merge
* [new ref] refs/pull/2748/head -> origin/pr/2748/head
* [new ref] refs/pull/2748/merge -> origin/pr/2748/merge
* [new ref] refs/pull/2749/head -> origin/pr/2749/head
* [new ref] refs/pull/2749/merge -> origin/pr/2749/merge
* [new ref] refs/pull/2750/head -> origin/pr/2750/head
* [new ref] refs/pull/2750/merge -> origin/pr/2750/merge
* [new ref] refs/pull/2751/head -> origin/pr/2751/head
* [new ref] refs/pull/2751/merge -> origin/pr/2751/merge
* [new ref] refs/pull/2752/head -> origin/pr/2752/head
* [new ref] refs/pull/2752/merge -> origin/pr/2752/merge
* [new ref] refs/pull/2753/head -> origin/pr/2753/head
* [new ref] refs/pull/2753/merge -> origin/pr/2753/merge
* [new ref] refs/pull/2754/head -> origin/pr/2754/head
* [new ref] refs/pull/2754/merge -> origin/pr/2754/merge
* [new ref] refs/pull/2755/head -> origin/pr/2755/head
* [new ref] refs/pull/2756/head -> origin/pr/2756/head
* [new ref] refs/pull/2756/merge -> origin/pr/2756/merge
* [new ref] refs/pull/2757/head -> origin/pr/2757/head
* [new ref] refs/pull/2757/merge -> origin/pr/2757/merge
* [new ref] refs/pull/2758/head -> origin/pr/2758/head
* [new ref] refs/pull/2758/merge -> origin/pr/2758/merge
* [new ref] refs/pull/2759/head -> origin/pr/2759/head
* [new ref] refs/pull/2759/merge -> origin/pr/2759/merge
* [new ref] refs/pull/2760/head -> origin/pr/2760/head
* [new ref] refs/pull/2760/merge -> origin/pr/2760/merge
* [new ref] refs/pull/2761/head -> origin/pr/2761/head
* [new ref] refs/pull/2761/merge -> origin/pr/2761/merge
* [new ref] refs/pull/2762/head -> origin/pr/2762/head
* [new ref] refs/pull/2762/merge -> origin/pr/2762/merge
* [new ref] refs/pull/2763/head -> origin/pr/2763/head
* [new ref] refs/pull/2763/merge -> origin/pr/2763/merge
* [new ref] refs/pull/2764/head -> origin/pr/2764/head
* [new ref] refs/pull/2764/merge -> origin/pr/2764/merge
* [new ref] refs/pull/2765/head -> origin/pr/2765/head
* [new ref] refs/pull/2765/merge -> origin/pr/2765/merge
error: unable to resolve reference refs/remotes/origin/pr/900/merge: No such file or directory
! c340815...7db1c72 refs/pull/900/merge -> origin/pr/900/merge (unable to update local ref)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1799)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1525)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:65)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:316)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor669.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy103.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision a8a04a2905e1ff639f403be7d9132acb77365e84 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f a8a04a2905e1ff639f403be7d9132acb77365e84
> git rev-list 47aaf11250e61d61c0bb3616063dbd5b7f2adb88 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4564722808097325418.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson7314216211457396990.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2895089141881926520.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson1619236758377138686.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-28 18:03:53,919 b587cc76 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/b587cc76/pkb.log
2017-04-28 18:03:53,920 b587cc76 MainThread INFO PerfKitBenchmarker version: v1.11.0-45-g6f31bb3
2017-04-28 18:03:53,920 b587cc76 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-28 18:03:54,167 b587cc76 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-28 18:03:54,252 b587cc76 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-28 18:03:54,254 b587cc76 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-28 18:03:54,254 b587cc76 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-28 18:03:54,259 b587cc76 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-28 18:03:54,261 b587cc76 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-28 18:03:54,289 b587cc76 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-28 18:03:54,289 b587cc76 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/b587cc76/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #347
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/347/display/redirect?page=changes>
Changes:
[dhalperi] [BEAM-59] Remove IOChannelFactory usage from
------------------------------------------
[...truncated 274.58 KB...]
* [new ref] refs/pull/2688/merge -> origin/pr/2688/merge
* [new ref] refs/pull/2689/head -> origin/pr/2689/head
* [new ref] refs/pull/2689/merge -> origin/pr/2689/merge
* [new ref] refs/pull/2690/head -> origin/pr/2690/head
* [new ref] refs/pull/2690/merge -> origin/pr/2690/merge
* [new ref] refs/pull/2691/head -> origin/pr/2691/head
* [new ref] refs/pull/2691/merge -> origin/pr/2691/merge
* [new ref] refs/pull/2692/head -> origin/pr/2692/head
* [new ref] refs/pull/2692/merge -> origin/pr/2692/merge
* [new ref] refs/pull/2693/head -> origin/pr/2693/head
* [new ref] refs/pull/2693/merge -> origin/pr/2693/merge
* [new ref] refs/pull/2694/head -> origin/pr/2694/head
* [new ref] refs/pull/2694/merge -> origin/pr/2694/merge
* [new ref] refs/pull/2695/head -> origin/pr/2695/head
* [new ref] refs/pull/2695/merge -> origin/pr/2695/merge
* [new ref] refs/pull/2696/head -> origin/pr/2696/head
* [new ref] refs/pull/2696/merge -> origin/pr/2696/merge
* [new ref] refs/pull/2697/head -> origin/pr/2697/head
* [new ref] refs/pull/2697/merge -> origin/pr/2697/merge
* [new ref] refs/pull/2698/head -> origin/pr/2698/head
* [new ref] refs/pull/2698/merge -> origin/pr/2698/merge
* [new ref] refs/pull/2699/head -> origin/pr/2699/head
* [new ref] refs/pull/2699/merge -> origin/pr/2699/merge
* [new ref] refs/pull/2700/head -> origin/pr/2700/head
* [new ref] refs/pull/2700/merge -> origin/pr/2700/merge
* [new ref] refs/pull/2701/head -> origin/pr/2701/head
* [new ref] refs/pull/2701/merge -> origin/pr/2701/merge
* [new ref] refs/pull/2702/head -> origin/pr/2702/head
* [new ref] refs/pull/2702/merge -> origin/pr/2702/merge
* [new ref] refs/pull/2703/head -> origin/pr/2703/head
* [new ref] refs/pull/2703/merge -> origin/pr/2703/merge
* [new ref] refs/pull/2704/head -> origin/pr/2704/head
* [new ref] refs/pull/2704/merge -> origin/pr/2704/merge
* [new ref] refs/pull/2705/head -> origin/pr/2705/head
* [new ref] refs/pull/2705/merge -> origin/pr/2705/merge
* [new ref] refs/pull/2706/head -> origin/pr/2706/head
* [new ref] refs/pull/2707/head -> origin/pr/2707/head
* [new ref] refs/pull/2707/merge -> origin/pr/2707/merge
* [new ref] refs/pull/2708/head -> origin/pr/2708/head
* [new ref] refs/pull/2708/merge -> origin/pr/2708/merge
* [new ref] refs/pull/2709/head -> origin/pr/2709/head
* [new ref] refs/pull/2709/merge -> origin/pr/2709/merge
* [new ref] refs/pull/2710/head -> origin/pr/2710/head
* [new ref] refs/pull/2710/merge -> origin/pr/2710/merge
* [new ref] refs/pull/2711/head -> origin/pr/2711/head
* [new ref] refs/pull/2711/merge -> origin/pr/2711/merge
* [new ref] refs/pull/2712/head -> origin/pr/2712/head
* [new ref] refs/pull/2712/merge -> origin/pr/2712/merge
* [new ref] refs/pull/2713/head -> origin/pr/2713/head
* [new ref] refs/pull/2713/merge -> origin/pr/2713/merge
* [new ref] refs/pull/2714/head -> origin/pr/2714/head
* [new ref] refs/pull/2714/merge -> origin/pr/2714/merge
* [new ref] refs/pull/2715/head -> origin/pr/2715/head
* [new ref] refs/pull/2715/merge -> origin/pr/2715/merge
* [new ref] refs/pull/2716/head -> origin/pr/2716/head
* [new ref] refs/pull/2716/merge -> origin/pr/2716/merge
* [new ref] refs/pull/2717/head -> origin/pr/2717/head
* [new ref] refs/pull/2717/merge -> origin/pr/2717/merge
* [new ref] refs/pull/2718/head -> origin/pr/2718/head
* [new ref] refs/pull/2718/merge -> origin/pr/2718/merge
* [new ref] refs/pull/2719/head -> origin/pr/2719/head
* [new ref] refs/pull/2719/merge -> origin/pr/2719/merge
* [new ref] refs/pull/2720/head -> origin/pr/2720/head
* [new ref] refs/pull/2720/merge -> origin/pr/2720/merge
* [new ref] refs/pull/2721/head -> origin/pr/2721/head
* [new ref] refs/pull/2721/merge -> origin/pr/2721/merge
* [new ref] refs/pull/2722/head -> origin/pr/2722/head
* [new ref] refs/pull/2722/merge -> origin/pr/2722/merge
* [new ref] refs/pull/2723/head -> origin/pr/2723/head
* [new ref] refs/pull/2723/merge -> origin/pr/2723/merge
* [new ref] refs/pull/2724/head -> origin/pr/2724/head
* [new ref] refs/pull/2724/merge -> origin/pr/2724/merge
* [new ref] refs/pull/2725/head -> origin/pr/2725/head
* [new ref] refs/pull/2726/head -> origin/pr/2726/head
* [new ref] refs/pull/2727/head -> origin/pr/2727/head
* [new ref] refs/pull/2727/merge -> origin/pr/2727/merge
* [new ref] refs/pull/2728/head -> origin/pr/2728/head
* [new ref] refs/pull/2729/head -> origin/pr/2729/head
* [new ref] refs/pull/2729/merge -> origin/pr/2729/merge
* [new ref] refs/pull/2730/head -> origin/pr/2730/head
* [new ref] refs/pull/2730/merge -> origin/pr/2730/merge
* [new ref] refs/pull/2731/head -> origin/pr/2731/head
* [new ref] refs/pull/2732/head -> origin/pr/2732/head
* [new ref] refs/pull/2732/merge -> origin/pr/2732/merge
* [new ref] refs/pull/2733/head -> origin/pr/2733/head
* [new ref] refs/pull/2733/merge -> origin/pr/2733/merge
* [new ref] refs/pull/2734/head -> origin/pr/2734/head
* [new ref] refs/pull/2734/merge -> origin/pr/2734/merge
* [new ref] refs/pull/2735/head -> origin/pr/2735/head
* [new ref] refs/pull/2735/merge -> origin/pr/2735/merge
* [new ref] refs/pull/2736/head -> origin/pr/2736/head
* [new ref] refs/pull/2736/merge -> origin/pr/2736/merge
* [new ref] refs/pull/2737/head -> origin/pr/2737/head
* [new ref] refs/pull/2737/merge -> origin/pr/2737/merge
* [new ref] refs/pull/2738/head -> origin/pr/2738/head
* [new ref] refs/pull/2738/merge -> origin/pr/2738/merge
* [new ref] refs/pull/2739/head -> origin/pr/2739/head
* [new ref] refs/pull/2739/merge -> origin/pr/2739/merge
* [new ref] refs/pull/2740/head -> origin/pr/2740/head
* [new ref] refs/pull/2740/merge -> origin/pr/2740/merge
* [new ref] refs/pull/2741/head -> origin/pr/2741/head
* [new ref] refs/pull/2741/merge -> origin/pr/2741/merge
* [new ref] refs/pull/2742/head -> origin/pr/2742/head
* [new ref] refs/pull/2743/head -> origin/pr/2743/head
* [new ref] refs/pull/2743/merge -> origin/pr/2743/merge
* [new ref] refs/pull/2744/head -> origin/pr/2744/head
* [new ref] refs/pull/2744/merge -> origin/pr/2744/merge
* [new ref] refs/pull/2745/head -> origin/pr/2745/head
* [new ref] refs/pull/2745/merge -> origin/pr/2745/merge
* [new ref] refs/pull/2746/head -> origin/pr/2746/head
* [new ref] refs/pull/2746/merge -> origin/pr/2746/merge
* [new ref] refs/pull/2747/head -> origin/pr/2747/head
* [new ref] refs/pull/2747/merge -> origin/pr/2747/merge
* [new ref] refs/pull/2748/head -> origin/pr/2748/head
* [new ref] refs/pull/2748/merge -> origin/pr/2748/merge
* [new ref] refs/pull/2749/head -> origin/pr/2749/head
* [new ref] refs/pull/2749/merge -> origin/pr/2749/merge
* [new ref] refs/pull/2750/head -> origin/pr/2750/head
* [new ref] refs/pull/2750/merge -> origin/pr/2750/merge
* [new ref] refs/pull/2751/head -> origin/pr/2751/head
* [new ref] refs/pull/2751/merge -> origin/pr/2751/merge
* [new ref] refs/pull/2752/head -> origin/pr/2752/head
* [new ref] refs/pull/2752/merge -> origin/pr/2752/merge
* [new ref] refs/pull/2753/head -> origin/pr/2753/head
* [new ref] refs/pull/2753/merge -> origin/pr/2753/merge
* [new ref] refs/pull/2754/head -> origin/pr/2754/head
* [new ref] refs/pull/2754/merge -> origin/pr/2754/merge
* [new ref] refs/pull/2755/head -> origin/pr/2755/head
* [new ref] refs/pull/2756/head -> origin/pr/2756/head
* [new ref] refs/pull/2756/merge -> origin/pr/2756/merge
* [new ref] refs/pull/2757/head -> origin/pr/2757/head
* [new ref] refs/pull/2757/merge -> origin/pr/2757/merge
* [new ref] refs/pull/2758/head -> origin/pr/2758/head
* [new ref] refs/pull/2758/merge -> origin/pr/2758/merge
* [new ref] refs/pull/2759/head -> origin/pr/2759/head
* [new ref] refs/pull/2759/merge -> origin/pr/2759/merge
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1799)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1525)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:65)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:316)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor669.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy103.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 47aaf11250e61d61c0bb3616063dbd5b7f2adb88 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 47aaf11250e61d61c0bb3616063dbd5b7f2adb88
> git rev-list 185dc47982078124abf6e851ad1c66ebc4ae8c54 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson237869347449738261.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson1892242311269932473.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3470559880167990717.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson9059110588875269546.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-28 12:03:03,070 d98aca1b MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/d98aca1b/pkb.log
2017-04-28 12:03:03,070 d98aca1b MainThread INFO PerfKitBenchmarker version: v1.11.0-45-g6f31bb3
2017-04-28 12:03:03,071 d98aca1b MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-28 12:03:03,431 d98aca1b MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-28 12:03:03,519 d98aca1b MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-28 12:03:03,522 d98aca1b MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-28 12:03:03,522 d98aca1b MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-28 12:03:03,527 d98aca1b MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-28 12:03:03,529 d98aca1b MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-28 12:03:03,553 d98aca1b MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-28 12:03:03,553 d98aca1b MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/d98aca1b/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #346
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/346/display/redirect?page=changes>
Changes:
[dhalperi] WriteFiles: trivial message fix
[altay] Add a simple snippet for a composite transform.
[lcwik] [BEAM-2031] Add support to PipelineOptionsFactory/ProxyInvocationHandler
------------------------------------------
[...truncated 278.41 KB...]
* [new ref] refs/pull/2687/merge -> origin/pr/2687/merge
* [new ref] refs/pull/2688/head -> origin/pr/2688/head
* [new ref] refs/pull/2688/merge -> origin/pr/2688/merge
* [new ref] refs/pull/2689/head -> origin/pr/2689/head
* [new ref] refs/pull/2689/merge -> origin/pr/2689/merge
* [new ref] refs/pull/2690/head -> origin/pr/2690/head
* [new ref] refs/pull/2690/merge -> origin/pr/2690/merge
* [new ref] refs/pull/2691/head -> origin/pr/2691/head
* [new ref] refs/pull/2691/merge -> origin/pr/2691/merge
* [new ref] refs/pull/2692/head -> origin/pr/2692/head
* [new ref] refs/pull/2692/merge -> origin/pr/2692/merge
* [new ref] refs/pull/2693/head -> origin/pr/2693/head
* [new ref] refs/pull/2693/merge -> origin/pr/2693/merge
* [new ref] refs/pull/2694/head -> origin/pr/2694/head
* [new ref] refs/pull/2694/merge -> origin/pr/2694/merge
* [new ref] refs/pull/2695/head -> origin/pr/2695/head
* [new ref] refs/pull/2695/merge -> origin/pr/2695/merge
* [new ref] refs/pull/2696/head -> origin/pr/2696/head
* [new ref] refs/pull/2696/merge -> origin/pr/2696/merge
* [new ref] refs/pull/2697/head -> origin/pr/2697/head
* [new ref] refs/pull/2697/merge -> origin/pr/2697/merge
* [new ref] refs/pull/2698/head -> origin/pr/2698/head
* [new ref] refs/pull/2698/merge -> origin/pr/2698/merge
* [new ref] refs/pull/2699/head -> origin/pr/2699/head
* [new ref] refs/pull/2699/merge -> origin/pr/2699/merge
* [new ref] refs/pull/2700/head -> origin/pr/2700/head
* [new ref] refs/pull/2700/merge -> origin/pr/2700/merge
* [new ref] refs/pull/2701/head -> origin/pr/2701/head
* [new ref] refs/pull/2701/merge -> origin/pr/2701/merge
* [new ref] refs/pull/2702/head -> origin/pr/2702/head
* [new ref] refs/pull/2702/merge -> origin/pr/2702/merge
* [new ref] refs/pull/2703/head -> origin/pr/2703/head
* [new ref] refs/pull/2703/merge -> origin/pr/2703/merge
* [new ref] refs/pull/2704/head -> origin/pr/2704/head
* [new ref] refs/pull/2704/merge -> origin/pr/2704/merge
* [new ref] refs/pull/2705/head -> origin/pr/2705/head
* [new ref] refs/pull/2705/merge -> origin/pr/2705/merge
* [new ref] refs/pull/2706/head -> origin/pr/2706/head
* [new ref] refs/pull/2707/head -> origin/pr/2707/head
* [new ref] refs/pull/2707/merge -> origin/pr/2707/merge
* [new ref] refs/pull/2708/head -> origin/pr/2708/head
* [new ref] refs/pull/2708/merge -> origin/pr/2708/merge
* [new ref] refs/pull/2709/head -> origin/pr/2709/head
* [new ref] refs/pull/2709/merge -> origin/pr/2709/merge
* [new ref] refs/pull/2710/head -> origin/pr/2710/head
* [new ref] refs/pull/2710/merge -> origin/pr/2710/merge
* [new ref] refs/pull/2711/head -> origin/pr/2711/head
* [new ref] refs/pull/2711/merge -> origin/pr/2711/merge
* [new ref] refs/pull/2712/head -> origin/pr/2712/head
* [new ref] refs/pull/2712/merge -> origin/pr/2712/merge
* [new ref] refs/pull/2713/head -> origin/pr/2713/head
* [new ref] refs/pull/2713/merge -> origin/pr/2713/merge
* [new ref] refs/pull/2714/head -> origin/pr/2714/head
* [new ref] refs/pull/2714/merge -> origin/pr/2714/merge
* [new ref] refs/pull/2715/head -> origin/pr/2715/head
* [new ref] refs/pull/2715/merge -> origin/pr/2715/merge
* [new ref] refs/pull/2716/head -> origin/pr/2716/head
* [new ref] refs/pull/2716/merge -> origin/pr/2716/merge
* [new ref] refs/pull/2717/head -> origin/pr/2717/head
* [new ref] refs/pull/2717/merge -> origin/pr/2717/merge
* [new ref] refs/pull/2718/head -> origin/pr/2718/head
* [new ref] refs/pull/2718/merge -> origin/pr/2718/merge
* [new ref] refs/pull/2719/head -> origin/pr/2719/head
* [new ref] refs/pull/2719/merge -> origin/pr/2719/merge
* [new ref] refs/pull/2720/head -> origin/pr/2720/head
* [new ref] refs/pull/2720/merge -> origin/pr/2720/merge
* [new ref] refs/pull/2721/head -> origin/pr/2721/head
* [new ref] refs/pull/2721/merge -> origin/pr/2721/merge
* [new ref] refs/pull/2722/head -> origin/pr/2722/head
* [new ref] refs/pull/2722/merge -> origin/pr/2722/merge
* [new ref] refs/pull/2723/head -> origin/pr/2723/head
* [new ref] refs/pull/2723/merge -> origin/pr/2723/merge
* [new ref] refs/pull/2724/head -> origin/pr/2724/head
* [new ref] refs/pull/2724/merge -> origin/pr/2724/merge
* [new ref] refs/pull/2725/head -> origin/pr/2725/head
* [new ref] refs/pull/2726/head -> origin/pr/2726/head
* [new ref] refs/pull/2727/head -> origin/pr/2727/head
* [new ref] refs/pull/2727/merge -> origin/pr/2727/merge
* [new ref] refs/pull/2728/head -> origin/pr/2728/head
* [new ref] refs/pull/2729/head -> origin/pr/2729/head
* [new ref] refs/pull/2729/merge -> origin/pr/2729/merge
* [new ref] refs/pull/2730/head -> origin/pr/2730/head
* [new ref] refs/pull/2730/merge -> origin/pr/2730/merge
* [new ref] refs/pull/2731/head -> origin/pr/2731/head
* [new ref] refs/pull/2732/head -> origin/pr/2732/head
* [new ref] refs/pull/2732/merge -> origin/pr/2732/merge
* [new ref] refs/pull/2733/head -> origin/pr/2733/head
* [new ref] refs/pull/2733/merge -> origin/pr/2733/merge
* [new ref] refs/pull/2734/head -> origin/pr/2734/head
* [new ref] refs/pull/2734/merge -> origin/pr/2734/merge
* [new ref] refs/pull/2735/head -> origin/pr/2735/head
* [new ref] refs/pull/2735/merge -> origin/pr/2735/merge
* [new ref] refs/pull/2736/head -> origin/pr/2736/head
* [new ref] refs/pull/2736/merge -> origin/pr/2736/merge
* [new ref] refs/pull/2737/head -> origin/pr/2737/head
* [new ref] refs/pull/2737/merge -> origin/pr/2737/merge
* [new ref] refs/pull/2738/head -> origin/pr/2738/head
* [new ref] refs/pull/2738/merge -> origin/pr/2738/merge
* [new ref] refs/pull/2739/head -> origin/pr/2739/head
* [new ref] refs/pull/2739/merge -> origin/pr/2739/merge
* [new ref] refs/pull/2740/head -> origin/pr/2740/head
* [new ref] refs/pull/2740/merge -> origin/pr/2740/merge
* [new ref] refs/pull/2741/head -> origin/pr/2741/head
* [new ref] refs/pull/2741/merge -> origin/pr/2741/merge
* [new ref] refs/pull/2742/head -> origin/pr/2742/head
* [new ref] refs/pull/2743/head -> origin/pr/2743/head
* [new ref] refs/pull/2743/merge -> origin/pr/2743/merge
* [new ref] refs/pull/2744/head -> origin/pr/2744/head
* [new ref] refs/pull/2744/merge -> origin/pr/2744/merge
* [new ref] refs/pull/2745/head -> origin/pr/2745/head
* [new ref] refs/pull/2745/merge -> origin/pr/2745/merge
* [new ref] refs/pull/2746/head -> origin/pr/2746/head
* [new ref] refs/pull/2746/merge -> origin/pr/2746/merge
* [new ref] refs/pull/2747/head -> origin/pr/2747/head
* [new ref] refs/pull/2747/merge -> origin/pr/2747/merge
* [new ref] refs/pull/2748/head -> origin/pr/2748/head
* [new ref] refs/pull/2748/merge -> origin/pr/2748/merge
* [new ref] refs/pull/2749/head -> origin/pr/2749/head
* [new ref] refs/pull/2749/merge -> origin/pr/2749/merge
* [new ref] refs/pull/2750/head -> origin/pr/2750/head
* [new ref] refs/pull/2750/merge -> origin/pr/2750/merge
* [new ref] refs/pull/2751/head -> origin/pr/2751/head
* [new ref] refs/pull/2751/merge -> origin/pr/2751/merge
* [new ref] refs/pull/2752/head -> origin/pr/2752/head
* [new ref] refs/pull/2752/merge -> origin/pr/2752/merge
* [new ref] refs/pull/2753/head -> origin/pr/2753/head
* [new ref] refs/pull/2753/merge -> origin/pr/2753/merge
* [new ref] refs/pull/2754/head -> origin/pr/2754/head
* [new ref] refs/pull/2754/merge -> origin/pr/2754/merge
* [new ref] refs/pull/2755/head -> origin/pr/2755/head
* [new ref] refs/pull/2756/head -> origin/pr/2756/head
* [new ref] refs/pull/2756/merge -> origin/pr/2756/merge
* [new ref] refs/pull/2757/head -> origin/pr/2757/head
* [new ref] refs/pull/2757/merge -> origin/pr/2757/merge
* [new ref] refs/pull/2758/head -> origin/pr/2758/head
* [new ref] refs/pull/2758/merge -> origin/pr/2758/merge
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1799)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1525)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:65)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:316)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor669.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy103.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 185dc47982078124abf6e851ad1c66ebc4ae8c54 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 185dc47982078124abf6e851ad1c66ebc4ae8c54
> git rev-list f71395bfd8f94cbe8d78098f5bb66a1dce65e74b # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson7629065342476446863.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5164883115491144609.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5434082747574129193.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3907632445143274954.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-28 06:03:23,260 b10f0b95 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/b10f0b95/pkb.log
2017-04-28 06:03:23,261 b10f0b95 MainThread INFO PerfKitBenchmarker version: v1.11.0-45-g6f31bb3
2017-04-28 06:03:23,261 b10f0b95 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-28 06:03:23,893 b10f0b95 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-28 06:03:23,993 b10f0b95 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-28 06:03:23,996 b10f0b95 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-28 06:03:23,996 b10f0b95 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-28 06:03:24,001 b10f0b95 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-28 06:03:24,003 b10f0b95 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-28 06:03:24,032 b10f0b95 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-28 06:03:24,032 b10f0b95 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/b10f0b95/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #345
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/345/display/redirect?page=changes>
Changes:
[dhalperi] [BEAM-59] LocalResources: helper utility to create LocalResourceId
------------------------------------------
[...truncated 335.14 KB...]
* [new ref] refs/pull/2695/head -> origin/pr/2695/head
* [new ref] refs/pull/2695/merge -> origin/pr/2695/merge
* [new ref] refs/pull/2696/head -> origin/pr/2696/head
* [new ref] refs/pull/2696/merge -> origin/pr/2696/merge
* [new ref] refs/pull/2697/head -> origin/pr/2697/head
* [new ref] refs/pull/2697/merge -> origin/pr/2697/merge
* [new ref] refs/pull/2698/head -> origin/pr/2698/head
* [new ref] refs/pull/2698/merge -> origin/pr/2698/merge
* [new ref] refs/pull/2699/head -> origin/pr/2699/head
* [new ref] refs/pull/2699/merge -> origin/pr/2699/merge
* [new ref] refs/pull/2700/head -> origin/pr/2700/head
* [new ref] refs/pull/2700/merge -> origin/pr/2700/merge
* [new ref] refs/pull/2701/head -> origin/pr/2701/head
* [new ref] refs/pull/2701/merge -> origin/pr/2701/merge
* [new ref] refs/pull/2702/head -> origin/pr/2702/head
* [new ref] refs/pull/2702/merge -> origin/pr/2702/merge
* [new ref] refs/pull/2703/head -> origin/pr/2703/head
* [new ref] refs/pull/2703/merge -> origin/pr/2703/merge
* [new ref] refs/pull/2704/head -> origin/pr/2704/head
* [new ref] refs/pull/2704/merge -> origin/pr/2704/merge
* [new ref] refs/pull/2705/head -> origin/pr/2705/head
* [new ref] refs/pull/2705/merge -> origin/pr/2705/merge
* [new ref] refs/pull/2706/head -> origin/pr/2706/head
* [new ref] refs/pull/2707/head -> origin/pr/2707/head
* [new ref] refs/pull/2707/merge -> origin/pr/2707/merge
* [new ref] refs/pull/2708/head -> origin/pr/2708/head
* [new ref] refs/pull/2708/merge -> origin/pr/2708/merge
* [new ref] refs/pull/2709/head -> origin/pr/2709/head
* [new ref] refs/pull/2709/merge -> origin/pr/2709/merge
* [new ref] refs/pull/2710/head -> origin/pr/2710/head
* [new ref] refs/pull/2710/merge -> origin/pr/2710/merge
* [new ref] refs/pull/2711/head -> origin/pr/2711/head
* [new ref] refs/pull/2711/merge -> origin/pr/2711/merge
* [new ref] refs/pull/2712/head -> origin/pr/2712/head
* [new ref] refs/pull/2712/merge -> origin/pr/2712/merge
* [new ref] refs/pull/2713/head -> origin/pr/2713/head
* [new ref] refs/pull/2713/merge -> origin/pr/2713/merge
* [new ref] refs/pull/2714/head -> origin/pr/2714/head
* [new ref] refs/pull/2714/merge -> origin/pr/2714/merge
* [new ref] refs/pull/2715/head -> origin/pr/2715/head
* [new ref] refs/pull/2715/merge -> origin/pr/2715/merge
* [new ref] refs/pull/2716/head -> origin/pr/2716/head
* [new ref] refs/pull/2716/merge -> origin/pr/2716/merge
* [new ref] refs/pull/2717/head -> origin/pr/2717/head
* [new ref] refs/pull/2717/merge -> origin/pr/2717/merge
* [new ref] refs/pull/2718/head -> origin/pr/2718/head
* [new ref] refs/pull/2718/merge -> origin/pr/2718/merge
* [new ref] refs/pull/2719/head -> origin/pr/2719/head
* [new ref] refs/pull/2719/merge -> origin/pr/2719/merge
* [new ref] refs/pull/2720/head -> origin/pr/2720/head
* [new ref] refs/pull/2720/merge -> origin/pr/2720/merge
* [new ref] refs/pull/2721/head -> origin/pr/2721/head
* [new ref] refs/pull/2721/merge -> origin/pr/2721/merge
* [new ref] refs/pull/2722/head -> origin/pr/2722/head
* [new ref] refs/pull/2722/merge -> origin/pr/2722/merge
* [new ref] refs/pull/2723/head -> origin/pr/2723/head
* [new ref] refs/pull/2723/merge -> origin/pr/2723/merge
* [new ref] refs/pull/2724/head -> origin/pr/2724/head
* [new ref] refs/pull/2724/merge -> origin/pr/2724/merge
* [new ref] refs/pull/2725/head -> origin/pr/2725/head
* [new ref] refs/pull/2726/head -> origin/pr/2726/head
* [new ref] refs/pull/2727/head -> origin/pr/2727/head
* [new ref] refs/pull/2727/merge -> origin/pr/2727/merge
* [new ref] refs/pull/2728/head -> origin/pr/2728/head
* [new ref] refs/pull/2729/head -> origin/pr/2729/head
* [new ref] refs/pull/2729/merge -> origin/pr/2729/merge
* [new ref] refs/pull/2730/head -> origin/pr/2730/head
* [new ref] refs/pull/2730/merge -> origin/pr/2730/merge
* [new ref] refs/pull/2731/head -> origin/pr/2731/head
* [new ref] refs/pull/2732/head -> origin/pr/2732/head
* [new ref] refs/pull/2732/merge -> origin/pr/2732/merge
* [new ref] refs/pull/2733/head -> origin/pr/2733/head
* [new ref] refs/pull/2733/merge -> origin/pr/2733/merge
* [new ref] refs/pull/2734/head -> origin/pr/2734/head
* [new ref] refs/pull/2734/merge -> origin/pr/2734/merge
* [new ref] refs/pull/2735/head -> origin/pr/2735/head
* [new ref] refs/pull/2735/merge -> origin/pr/2735/merge
* [new ref] refs/pull/2736/head -> origin/pr/2736/head
* [new ref] refs/pull/2736/merge -> origin/pr/2736/merge
* [new ref] refs/pull/2737/head -> origin/pr/2737/head
* [new ref] refs/pull/2737/merge -> origin/pr/2737/merge
* [new ref] refs/pull/2738/head -> origin/pr/2738/head
* [new ref] refs/pull/2738/merge -> origin/pr/2738/merge
* [new ref] refs/pull/2739/head -> origin/pr/2739/head
* [new ref] refs/pull/2739/merge -> origin/pr/2739/merge
* [new ref] refs/pull/2740/head -> origin/pr/2740/head
* [new ref] refs/pull/2740/merge -> origin/pr/2740/merge
* [new ref] refs/pull/2741/head -> origin/pr/2741/head
* [new ref] refs/pull/2741/merge -> origin/pr/2741/merge
* [new ref] refs/pull/2742/head -> origin/pr/2742/head
* [new ref] refs/pull/2743/head -> origin/pr/2743/head
* [new ref] refs/pull/2743/merge -> origin/pr/2743/merge
* [new ref] refs/pull/2744/head -> origin/pr/2744/head
* [new ref] refs/pull/2744/merge -> origin/pr/2744/merge
* [new ref] refs/pull/2745/head -> origin/pr/2745/head
* [new ref] refs/pull/2745/merge -> origin/pr/2745/merge
* [new ref] refs/pull/2746/head -> origin/pr/2746/head
* [new ref] refs/pull/2746/merge -> origin/pr/2746/merge
* [new ref] refs/pull/2747/head -> origin/pr/2747/head
* [new ref] refs/pull/2747/merge -> origin/pr/2747/merge
* [new ref] refs/pull/2748/head -> origin/pr/2748/head
* [new ref] refs/pull/2748/merge -> origin/pr/2748/merge
* [new ref] refs/pull/2749/head -> origin/pr/2749/head
* [new ref] refs/pull/2749/merge -> origin/pr/2749/merge
* [new ref] refs/pull/2750/head -> origin/pr/2750/head
* [new ref] refs/pull/2750/merge -> origin/pr/2750/merge
* [new ref] refs/pull/2751/head -> origin/pr/2751/head
* [new ref] refs/pull/2751/merge -> origin/pr/2751/merge
* [new ref] refs/pull/2752/head -> origin/pr/2752/head
* [new ref] refs/pull/2752/merge -> origin/pr/2752/merge
* [new ref] refs/pull/2753/head -> origin/pr/2753/head
* [new ref] refs/pull/2753/merge -> origin/pr/2753/merge
* [new ref] refs/pull/2754/head -> origin/pr/2754/head
* [new ref] refs/pull/2754/merge -> origin/pr/2754/merge
* [new ref] refs/pull/2755/head -> origin/pr/2755/head
* [new ref] refs/pull/2755/merge -> origin/pr/2755/merge
error: unable to resolve reference refs/remotes/origin/pr/288/merge: No such file or directory
! 33b68a2...f9612e3 refs/pull/288/merge -> origin/pr/288/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/592/merge: No such file or directory
! 7129de6...0d9a8ae refs/pull/592/merge -> origin/pr/592/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/871/merge: No such file or directory
! 61f4dd5...dcc5b0b refs/pull/871/merge -> origin/pr/871/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/886/merge: No such file or directory
! 01f16da...9fe583c refs/pull/886/merge -> origin/pr/886/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/900/merge: No such file or directory
! c0c0a26...c340815 refs/pull/900/merge -> origin/pr/900/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/902/merge: No such file or directory
! 38d7315...824f162 refs/pull/902/merge -> origin/pr/902/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/914/merge: No such file or directory
! 3c4444a...b93dd41 refs/pull/914/merge -> origin/pr/914/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/917/merge: No such file or directory
! 7db5e68...b264c75 refs/pull/917/merge -> origin/pr/917/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/959/merge: No such file or directory
! 39c9afa...25d5f19 refs/pull/959/merge -> origin/pr/959/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/984/merge: No such file or directory
! 54fa2a8...da83b57 refs/pull/984/merge -> origin/pr/984/merge (unable to update local ref)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1799)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1525)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:65)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:316)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam4(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor669.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy103.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision f71395bfd8f94cbe8d78098f5bb66a1dce65e74b (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f f71395bfd8f94cbe8d78098f5bb66a1dce65e74b
> git rev-list a46eb1a80074dc9c382da4d71725ffc61f2e65ba # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson8414838313204931955.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2274779365146555086.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson126783067219510162.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson1619822904534489164.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-28 00:16:41,181 3baf5fc3 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/3baf5fc3/pkb.log
2017-04-28 00:16:41,181 3baf5fc3 MainThread INFO PerfKitBenchmarker version: v1.11.0-45-g6f31bb3
2017-04-28 00:16:41,182 3baf5fc3 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-28 00:16:41,459 3baf5fc3 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-28 00:16:41,579 3baf5fc3 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-28 00:16:41,581 3baf5fc3 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-28 00:16:41,582 3baf5fc3 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-28 00:16:41,588 3baf5fc3 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-28 00:16:41,590 3baf5fc3 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-28 00:16:41,616 3baf5fc3 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-28 00:16:41,616 3baf5fc3 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/3baf5fc3/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #344
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/344/display/redirect?page=changes>
Changes:
[tgroh] Remove Coder Encoding IDs
[dhalperi] [BEAM-2029] NullPointerException when using multi output ParDo in Spark
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on beam1 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/>
Cloning the remote Git repository
Cloning repository https://github.com/apache/beam.git
> git init <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/> # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/*
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
> git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision a46eb1a80074dc9c382da4d71725ffc61f2e65ba (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f a46eb1a80074dc9c382da4d71725ffc61f2e65ba
> git rev-list 14a90d7c5196d96de66e897687d28202d790439f # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson8954828005480798397.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson7600906786718259233.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson7565460630655822730.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2039476742967189830.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-27 23:08:54,432 1990bb3b MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/1990bb3b/pkb.log
2017-04-27 23:08:54,433 1990bb3b MainThread INFO PerfKitBenchmarker version: v1.11.0-45-g6f31bb3
2017-04-27 23:08:54,433 1990bb3b MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-27 23:08:54,782 1990bb3b MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-27 23:08:54,892 1990bb3b MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-27 23:08:54,894 1990bb3b MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-27 23:08:54,894 1990bb3b MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-27 23:08:54,899 1990bb3b MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-27 23:08:54,906 1990bb3b MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-27 23:08:54,926 1990bb3b MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-27 23:08:54,927 1990bb3b MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/1990bb3b/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #343
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/343/display/redirect?page=changes>
Changes:
[dhalperi] [BEAM-59] Add FileSystems#matchNewResource
------------------------------------------
[...truncated 226.76 KB...]
x [deleted] (none) -> origin/pr/93/head
x [deleted] (none) -> origin/pr/930/head
x [deleted] (none) -> origin/pr/930/merge
x [deleted] (none) -> origin/pr/931/head
x [deleted] (none) -> origin/pr/931/merge
x [deleted] (none) -> origin/pr/932/head
x [deleted] (none) -> origin/pr/932/merge
x [deleted] (none) -> origin/pr/933/head
x [deleted] (none) -> origin/pr/933/merge
x [deleted] (none) -> origin/pr/934/head
x [deleted] (none) -> origin/pr/934/merge
x [deleted] (none) -> origin/pr/935/head
x [deleted] (none) -> origin/pr/936/head
x [deleted] (none) -> origin/pr/936/merge
x [deleted] (none) -> origin/pr/937/head
x [deleted] (none) -> origin/pr/937/merge
x [deleted] (none) -> origin/pr/938/head
x [deleted] (none) -> origin/pr/939/head
x [deleted] (none) -> origin/pr/94/head
x [deleted] (none) -> origin/pr/940/head
x [deleted] (none) -> origin/pr/940/merge
x [deleted] (none) -> origin/pr/941/head
x [deleted] (none) -> origin/pr/941/merge
x [deleted] (none) -> origin/pr/942/head
x [deleted] (none) -> origin/pr/942/merge
x [deleted] (none) -> origin/pr/943/head
x [deleted] (none) -> origin/pr/943/merge
x [deleted] (none) -> origin/pr/944/head
x [deleted] (none) -> origin/pr/945/head
x [deleted] (none) -> origin/pr/945/merge
x [deleted] (none) -> origin/pr/946/head
x [deleted] (none) -> origin/pr/946/merge
x [deleted] (none) -> origin/pr/947/head
x [deleted] (none) -> origin/pr/947/merge
x [deleted] (none) -> origin/pr/948/head
x [deleted] (none) -> origin/pr/948/merge
x [deleted] (none) -> origin/pr/949/head
x [deleted] (none) -> origin/pr/949/merge
x [deleted] (none) -> origin/pr/95/head
x [deleted] (none) -> origin/pr/95/merge
x [deleted] (none) -> origin/pr/950/head
x [deleted] (none) -> origin/pr/951/head
x [deleted] (none) -> origin/pr/951/merge
x [deleted] (none) -> origin/pr/952/head
x [deleted] (none) -> origin/pr/952/merge
x [deleted] (none) -> origin/pr/953/head
x [deleted] (none) -> origin/pr/954/head
x [deleted] (none) -> origin/pr/954/merge
x [deleted] (none) -> origin/pr/955/head
x [deleted] (none) -> origin/pr/955/merge
x [deleted] (none) -> origin/pr/956/head
x [deleted] (none) -> origin/pr/957/head
x [deleted] (none) -> origin/pr/958/head
x [deleted] (none) -> origin/pr/959/head
x [deleted] (none) -> origin/pr/959/merge
x [deleted] (none) -> origin/pr/96/head
x [deleted] (none) -> origin/pr/96/merge
x [deleted] (none) -> origin/pr/960/head
x [deleted] (none) -> origin/pr/960/merge
x [deleted] (none) -> origin/pr/961/head
x [deleted] (none) -> origin/pr/962/head
x [deleted] (none) -> origin/pr/962/merge
x [deleted] (none) -> origin/pr/963/head
x [deleted] (none) -> origin/pr/963/merge
x [deleted] (none) -> origin/pr/964/head
x [deleted] (none) -> origin/pr/965/head
x [deleted] (none) -> origin/pr/965/merge
x [deleted] (none) -> origin/pr/966/head
x [deleted] (none) -> origin/pr/967/head
x [deleted] (none) -> origin/pr/967/merge
x [deleted] (none) -> origin/pr/968/head
x [deleted] (none) -> origin/pr/968/merge
x [deleted] (none) -> origin/pr/969/head
x [deleted] (none) -> origin/pr/969/merge
x [deleted] (none) -> origin/pr/97/head
x [deleted] (none) -> origin/pr/97/merge
x [deleted] (none) -> origin/pr/970/head
x [deleted] (none) -> origin/pr/970/merge
x [deleted] (none) -> origin/pr/971/head
x [deleted] (none) -> origin/pr/971/merge
x [deleted] (none) -> origin/pr/972/head
x [deleted] (none) -> origin/pr/973/head
x [deleted] (none) -> origin/pr/974/head
x [deleted] (none) -> origin/pr/974/merge
x [deleted] (none) -> origin/pr/975/head
x [deleted] (none) -> origin/pr/975/merge
x [deleted] (none) -> origin/pr/976/head
x [deleted] (none) -> origin/pr/976/merge
x [deleted] (none) -> origin/pr/977/head
x [deleted] (none) -> origin/pr/977/merge
x [deleted] (none) -> origin/pr/978/head
x [deleted] (none) -> origin/pr/978/merge
x [deleted] (none) -> origin/pr/979/head
x [deleted] (none) -> origin/pr/979/merge
x [deleted] (none) -> origin/pr/98/head
x [deleted] (none) -> origin/pr/980/head
x [deleted] (none) -> origin/pr/980/merge
x [deleted] (none) -> origin/pr/981/head
x [deleted] (none) -> origin/pr/982/head
x [deleted] (none) -> origin/pr/982/merge
x [deleted] (none) -> origin/pr/983/head
x [deleted] (none) -> origin/pr/983/merge
x [deleted] (none) -> origin/pr/984/head
x [deleted] (none) -> origin/pr/984/merge
x [deleted] (none) -> origin/pr/985/head
x [deleted] (none) -> origin/pr/985/merge
x [deleted] (none) -> origin/pr/986/head
x [deleted] (none) -> origin/pr/986/merge
x [deleted] (none) -> origin/pr/987/head
x [deleted] (none) -> origin/pr/988/head
x [deleted] (none) -> origin/pr/988/merge
x [deleted] (none) -> origin/pr/989/head
x [deleted] (none) -> origin/pr/989/merge
x [deleted] (none) -> origin/pr/99/head
x [deleted] (none) -> origin/pr/99/merge
x [deleted] (none) -> origin/pr/990/head
x [deleted] (none) -> origin/pr/990/merge
x [deleted] (none) -> origin/pr/991/head
x [deleted] (none) -> origin/pr/991/merge
x [deleted] (none) -> origin/pr/992/head
x [deleted] (none) -> origin/pr/992/merge
x [deleted] (none) -> origin/pr/993/head
x [deleted] (none) -> origin/pr/993/merge
x [deleted] (none) -> origin/pr/994/head
x [deleted] (none) -> origin/pr/994/merge
x [deleted] (none) -> origin/pr/995/head
x [deleted] (none) -> origin/pr/995/merge
x [deleted] (none) -> origin/pr/996/head
x [deleted] (none) -> origin/pr/996/merge
x [deleted] (none) -> origin/pr/997/head
x [deleted] (none) -> origin/pr/997/merge
x [deleted] (none) -> origin/pr/998/head
x [deleted] (none) -> origin/pr/999/head
x [deleted] (none) -> origin/pr/999/merge
error: RPC failed; result=18, HTTP code = 200
fatal: The remote end hung up unexpectedly
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1799)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1525)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:65)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:316)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam7(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor669.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy103.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 14a90d7c5196d96de66e897687d28202d790439f (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 14a90d7c5196d96de66e897687d28202d790439f
> git rev-list fdf2de9994268f5e1d704aa30a4504ac6ee624b8 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2015906685247531260.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson6969306375109267709.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2093116221770561675.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson7146861158317934605.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-27 22:00:01,523 b1eb7fb8 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/b1eb7fb8/pkb.log
2017-04-27 22:00:01,523 b1eb7fb8 MainThread INFO PerfKitBenchmarker version: v1.11.0-45-g6f31bb3
2017-04-27 22:00:01,524 b1eb7fb8 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-27 22:00:01,704 b1eb7fb8 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-27 22:00:01,830 b1eb7fb8 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-27 22:00:01,834 b1eb7fb8 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-27 22:00:01,834 b1eb7fb8 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-27 22:00:01,842 b1eb7fb8 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-27 22:00:01,846 b1eb7fb8 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-27 22:00:01,915 b1eb7fb8 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-27 22:00:01,916 b1eb7fb8 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/b1eb7fb8/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #342
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/342/display/redirect?page=changes>
Changes:
[dhalperi] [BEAM-2096] Make DataflowMetrics more resilient
------------------------------------------
[...truncated 272.22 KB...]
* [new ref] refs/pull/2671/merge -> origin/pr/2671/merge
* [new ref] refs/pull/2672/head -> origin/pr/2672/head
* [new ref] refs/pull/2673/head -> origin/pr/2673/head
* [new ref] refs/pull/2673/merge -> origin/pr/2673/merge
* [new ref] refs/pull/2674/head -> origin/pr/2674/head
* [new ref] refs/pull/2675/head -> origin/pr/2675/head
* [new ref] refs/pull/2676/head -> origin/pr/2676/head
* [new ref] refs/pull/2676/merge -> origin/pr/2676/merge
* [new ref] refs/pull/2677/head -> origin/pr/2677/head
* [new ref] refs/pull/2678/head -> origin/pr/2678/head
* [new ref] refs/pull/2678/merge -> origin/pr/2678/merge
* [new ref] refs/pull/2679/head -> origin/pr/2679/head
* [new ref] refs/pull/2679/merge -> origin/pr/2679/merge
* [new ref] refs/pull/2680/head -> origin/pr/2680/head
* [new ref] refs/pull/2680/merge -> origin/pr/2680/merge
* [new ref] refs/pull/2681/head -> origin/pr/2681/head
* [new ref] refs/pull/2681/merge -> origin/pr/2681/merge
* [new ref] refs/pull/2682/head -> origin/pr/2682/head
* [new ref] refs/pull/2682/merge -> origin/pr/2682/merge
* [new ref] refs/pull/2683/head -> origin/pr/2683/head
* [new ref] refs/pull/2684/head -> origin/pr/2684/head
* [new ref] refs/pull/2685/head -> origin/pr/2685/head
* [new ref] refs/pull/2685/merge -> origin/pr/2685/merge
* [new ref] refs/pull/2686/head -> origin/pr/2686/head
* [new ref] refs/pull/2686/merge -> origin/pr/2686/merge
* [new ref] refs/pull/2687/head -> origin/pr/2687/head
* [new ref] refs/pull/2687/merge -> origin/pr/2687/merge
* [new ref] refs/pull/2688/head -> origin/pr/2688/head
* [new ref] refs/pull/2688/merge -> origin/pr/2688/merge
* [new ref] refs/pull/2689/head -> origin/pr/2689/head
* [new ref] refs/pull/2689/merge -> origin/pr/2689/merge
* [new ref] refs/pull/2690/head -> origin/pr/2690/head
* [new ref] refs/pull/2690/merge -> origin/pr/2690/merge
* [new ref] refs/pull/2691/head -> origin/pr/2691/head
* [new ref] refs/pull/2691/merge -> origin/pr/2691/merge
* [new ref] refs/pull/2692/head -> origin/pr/2692/head
* [new ref] refs/pull/2692/merge -> origin/pr/2692/merge
* [new ref] refs/pull/2693/head -> origin/pr/2693/head
* [new ref] refs/pull/2693/merge -> origin/pr/2693/merge
* [new ref] refs/pull/2694/head -> origin/pr/2694/head
* [new ref] refs/pull/2694/merge -> origin/pr/2694/merge
* [new ref] refs/pull/2695/head -> origin/pr/2695/head
* [new ref] refs/pull/2695/merge -> origin/pr/2695/merge
* [new ref] refs/pull/2696/head -> origin/pr/2696/head
* [new ref] refs/pull/2696/merge -> origin/pr/2696/merge
* [new ref] refs/pull/2697/head -> origin/pr/2697/head
* [new ref] refs/pull/2697/merge -> origin/pr/2697/merge
* [new ref] refs/pull/2698/head -> origin/pr/2698/head
* [new ref] refs/pull/2698/merge -> origin/pr/2698/merge
* [new ref] refs/pull/2699/head -> origin/pr/2699/head
* [new ref] refs/pull/2699/merge -> origin/pr/2699/merge
* [new ref] refs/pull/2700/head -> origin/pr/2700/head
* [new ref] refs/pull/2700/merge -> origin/pr/2700/merge
* [new ref] refs/pull/2701/head -> origin/pr/2701/head
* [new ref] refs/pull/2701/merge -> origin/pr/2701/merge
* [new ref] refs/pull/2702/head -> origin/pr/2702/head
* [new ref] refs/pull/2702/merge -> origin/pr/2702/merge
* [new ref] refs/pull/2703/head -> origin/pr/2703/head
* [new ref] refs/pull/2703/merge -> origin/pr/2703/merge
* [new ref] refs/pull/2704/head -> origin/pr/2704/head
* [new ref] refs/pull/2704/merge -> origin/pr/2704/merge
* [new ref] refs/pull/2705/head -> origin/pr/2705/head
* [new ref] refs/pull/2705/merge -> origin/pr/2705/merge
* [new ref] refs/pull/2706/head -> origin/pr/2706/head
* [new ref] refs/pull/2707/head -> origin/pr/2707/head
* [new ref] refs/pull/2707/merge -> origin/pr/2707/merge
* [new ref] refs/pull/2708/head -> origin/pr/2708/head
* [new ref] refs/pull/2708/merge -> origin/pr/2708/merge
* [new ref] refs/pull/2709/head -> origin/pr/2709/head
* [new ref] refs/pull/2709/merge -> origin/pr/2709/merge
* [new ref] refs/pull/2710/head -> origin/pr/2710/head
* [new ref] refs/pull/2710/merge -> origin/pr/2710/merge
* [new ref] refs/pull/2711/head -> origin/pr/2711/head
* [new ref] refs/pull/2711/merge -> origin/pr/2711/merge
* [new ref] refs/pull/2712/head -> origin/pr/2712/head
* [new ref] refs/pull/2712/merge -> origin/pr/2712/merge
* [new ref] refs/pull/2713/head -> origin/pr/2713/head
* [new ref] refs/pull/2713/merge -> origin/pr/2713/merge
* [new ref] refs/pull/2714/head -> origin/pr/2714/head
* [new ref] refs/pull/2714/merge -> origin/pr/2714/merge
* [new ref] refs/pull/2715/head -> origin/pr/2715/head
* [new ref] refs/pull/2715/merge -> origin/pr/2715/merge
* [new ref] refs/pull/2716/head -> origin/pr/2716/head
* [new ref] refs/pull/2716/merge -> origin/pr/2716/merge
* [new ref] refs/pull/2717/head -> origin/pr/2717/head
* [new ref] refs/pull/2717/merge -> origin/pr/2717/merge
* [new ref] refs/pull/2718/head -> origin/pr/2718/head
* [new ref] refs/pull/2718/merge -> origin/pr/2718/merge
* [new ref] refs/pull/2719/head -> origin/pr/2719/head
* [new ref] refs/pull/2719/merge -> origin/pr/2719/merge
* [new ref] refs/pull/2720/head -> origin/pr/2720/head
* [new ref] refs/pull/2720/merge -> origin/pr/2720/merge
* [new ref] refs/pull/2721/head -> origin/pr/2721/head
* [new ref] refs/pull/2721/merge -> origin/pr/2721/merge
* [new ref] refs/pull/2722/head -> origin/pr/2722/head
* [new ref] refs/pull/2722/merge -> origin/pr/2722/merge
* [new ref] refs/pull/2723/head -> origin/pr/2723/head
* [new ref] refs/pull/2723/merge -> origin/pr/2723/merge
* [new ref] refs/pull/2724/head -> origin/pr/2724/head
* [new ref] refs/pull/2724/merge -> origin/pr/2724/merge
* [new ref] refs/pull/2725/head -> origin/pr/2725/head
* [new ref] refs/pull/2726/head -> origin/pr/2726/head
* [new ref] refs/pull/2727/head -> origin/pr/2727/head
* [new ref] refs/pull/2727/merge -> origin/pr/2727/merge
* [new ref] refs/pull/2728/head -> origin/pr/2728/head
* [new ref] refs/pull/2728/merge -> origin/pr/2728/merge
* [new ref] refs/pull/2729/head -> origin/pr/2729/head
* [new ref] refs/pull/2729/merge -> origin/pr/2729/merge
* [new ref] refs/pull/2730/head -> origin/pr/2730/head
* [new ref] refs/pull/2730/merge -> origin/pr/2730/merge
* [new ref] refs/pull/2731/head -> origin/pr/2731/head
* [new ref] refs/pull/2732/head -> origin/pr/2732/head
* [new ref] refs/pull/2732/merge -> origin/pr/2732/merge
* [new ref] refs/pull/2733/head -> origin/pr/2733/head
* [new ref] refs/pull/2733/merge -> origin/pr/2733/merge
* [new ref] refs/pull/2734/head -> origin/pr/2734/head
* [new ref] refs/pull/2734/merge -> origin/pr/2734/merge
* [new ref] refs/pull/2735/head -> origin/pr/2735/head
* [new ref] refs/pull/2735/merge -> origin/pr/2735/merge
* [new ref] refs/pull/2736/head -> origin/pr/2736/head
* [new ref] refs/pull/2736/merge -> origin/pr/2736/merge
* [new ref] refs/pull/2737/head -> origin/pr/2737/head
* [new ref] refs/pull/2737/merge -> origin/pr/2737/merge
* [new ref] refs/pull/2738/head -> origin/pr/2738/head
* [new ref] refs/pull/2738/merge -> origin/pr/2738/merge
* [new ref] refs/pull/2739/head -> origin/pr/2739/head
* [new ref] refs/pull/2739/merge -> origin/pr/2739/merge
* [new ref] refs/pull/2740/head -> origin/pr/2740/head
* [new ref] refs/pull/2740/merge -> origin/pr/2740/merge
* [new ref] refs/pull/2741/head -> origin/pr/2741/head
* [new ref] refs/pull/2741/merge -> origin/pr/2741/merge
* [new ref] refs/pull/2742/head -> origin/pr/2742/head
* [new ref] refs/pull/2743/head -> origin/pr/2743/head
* [new ref] refs/pull/2743/merge -> origin/pr/2743/merge
* [new ref] refs/pull/2744/head -> origin/pr/2744/head
* [new ref] refs/pull/2744/merge -> origin/pr/2744/merge
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1799)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1525)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:65)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:316)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor669.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy103.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision fdf2de9994268f5e1d704aa30a4504ac6ee624b8 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f fdf2de9994268f5e1d704aa30a4504ac6ee624b8
> git rev-list 884935cb98f0e29bd965fda9182970423d111d7e # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson1481056550875902878.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson7057979296962581930.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson1649567276947638519.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4082715966327646198.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-27 20:26:33,447 b639e0e6 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/b639e0e6/pkb.log
2017-04-27 20:26:33,447 b639e0e6 MainThread INFO PerfKitBenchmarker version: v1.11.0-45-g6f31bb3
2017-04-27 20:26:33,448 b639e0e6 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-27 20:26:33,625 b639e0e6 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-27 20:26:33,723 b639e0e6 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-27 20:26:33,726 b639e0e6 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-27 20:26:33,727 b639e0e6 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-27 20:26:33,735 b639e0e6 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-27 20:26:33,738 b639e0e6 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-27 20:26:33,753 b639e0e6 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-27 20:26:33,753 b639e0e6 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/b639e0e6/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #341
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/341/display/redirect?page=changes>
Changes:
[altay] [BEAM-1695] Improve Python-SDK's programming guide
------------------------------------------
[...truncated 309.18 KB...]
* [new ref] refs/pull/2673/head -> origin/pr/2673/head
* [new ref] refs/pull/2673/merge -> origin/pr/2673/merge
* [new ref] refs/pull/2674/head -> origin/pr/2674/head
* [new ref] refs/pull/2675/head -> origin/pr/2675/head
* [new ref] refs/pull/2676/head -> origin/pr/2676/head
* [new ref] refs/pull/2676/merge -> origin/pr/2676/merge
* [new ref] refs/pull/2677/head -> origin/pr/2677/head
* [new ref] refs/pull/2678/head -> origin/pr/2678/head
* [new ref] refs/pull/2678/merge -> origin/pr/2678/merge
* [new ref] refs/pull/2679/head -> origin/pr/2679/head
* [new ref] refs/pull/2679/merge -> origin/pr/2679/merge
* [new ref] refs/pull/2680/head -> origin/pr/2680/head
* [new ref] refs/pull/2680/merge -> origin/pr/2680/merge
* [new ref] refs/pull/2681/head -> origin/pr/2681/head
* [new ref] refs/pull/2681/merge -> origin/pr/2681/merge
* [new ref] refs/pull/2682/head -> origin/pr/2682/head
* [new ref] refs/pull/2682/merge -> origin/pr/2682/merge
* [new ref] refs/pull/2683/head -> origin/pr/2683/head
* [new ref] refs/pull/2684/head -> origin/pr/2684/head
* [new ref] refs/pull/2685/head -> origin/pr/2685/head
* [new ref] refs/pull/2685/merge -> origin/pr/2685/merge
* [new ref] refs/pull/2686/head -> origin/pr/2686/head
* [new ref] refs/pull/2686/merge -> origin/pr/2686/merge
* [new ref] refs/pull/2687/head -> origin/pr/2687/head
* [new ref] refs/pull/2687/merge -> origin/pr/2687/merge
* [new ref] refs/pull/2688/head -> origin/pr/2688/head
* [new ref] refs/pull/2688/merge -> origin/pr/2688/merge
* [new ref] refs/pull/2689/head -> origin/pr/2689/head
* [new ref] refs/pull/2689/merge -> origin/pr/2689/merge
* [new ref] refs/pull/2690/head -> origin/pr/2690/head
* [new ref] refs/pull/2690/merge -> origin/pr/2690/merge
* [new ref] refs/pull/2691/head -> origin/pr/2691/head
* [new ref] refs/pull/2691/merge -> origin/pr/2691/merge
* [new ref] refs/pull/2692/head -> origin/pr/2692/head
* [new ref] refs/pull/2692/merge -> origin/pr/2692/merge
* [new ref] refs/pull/2693/head -> origin/pr/2693/head
* [new ref] refs/pull/2693/merge -> origin/pr/2693/merge
* [new ref] refs/pull/2694/head -> origin/pr/2694/head
* [new ref] refs/pull/2694/merge -> origin/pr/2694/merge
* [new ref] refs/pull/2695/head -> origin/pr/2695/head
* [new ref] refs/pull/2695/merge -> origin/pr/2695/merge
* [new ref] refs/pull/2696/head -> origin/pr/2696/head
* [new ref] refs/pull/2696/merge -> origin/pr/2696/merge
* [new ref] refs/pull/2697/head -> origin/pr/2697/head
* [new ref] refs/pull/2697/merge -> origin/pr/2697/merge
* [new ref] refs/pull/2698/head -> origin/pr/2698/head
* [new ref] refs/pull/2698/merge -> origin/pr/2698/merge
* [new ref] refs/pull/2699/head -> origin/pr/2699/head
* [new ref] refs/pull/2699/merge -> origin/pr/2699/merge
* [new ref] refs/pull/2700/head -> origin/pr/2700/head
* [new ref] refs/pull/2700/merge -> origin/pr/2700/merge
* [new ref] refs/pull/2701/head -> origin/pr/2701/head
* [new ref] refs/pull/2701/merge -> origin/pr/2701/merge
* [new ref] refs/pull/2702/head -> origin/pr/2702/head
* [new ref] refs/pull/2702/merge -> origin/pr/2702/merge
* [new ref] refs/pull/2703/head -> origin/pr/2703/head
* [new ref] refs/pull/2703/merge -> origin/pr/2703/merge
* [new ref] refs/pull/2704/head -> origin/pr/2704/head
* [new ref] refs/pull/2704/merge -> origin/pr/2704/merge
* [new ref] refs/pull/2705/head -> origin/pr/2705/head
* [new ref] refs/pull/2705/merge -> origin/pr/2705/merge
* [new ref] refs/pull/2706/head -> origin/pr/2706/head
* [new ref] refs/pull/2707/head -> origin/pr/2707/head
* [new ref] refs/pull/2707/merge -> origin/pr/2707/merge
* [new ref] refs/pull/2708/head -> origin/pr/2708/head
* [new ref] refs/pull/2708/merge -> origin/pr/2708/merge
* [new ref] refs/pull/2709/head -> origin/pr/2709/head
* [new ref] refs/pull/2709/merge -> origin/pr/2709/merge
* [new ref] refs/pull/2710/head -> origin/pr/2710/head
* [new ref] refs/pull/2710/merge -> origin/pr/2710/merge
* [new ref] refs/pull/2711/head -> origin/pr/2711/head
* [new ref] refs/pull/2711/merge -> origin/pr/2711/merge
* [new ref] refs/pull/2712/head -> origin/pr/2712/head
* [new ref] refs/pull/2712/merge -> origin/pr/2712/merge
* [new ref] refs/pull/2713/head -> origin/pr/2713/head
* [new ref] refs/pull/2713/merge -> origin/pr/2713/merge
* [new ref] refs/pull/2714/head -> origin/pr/2714/head
* [new ref] refs/pull/2714/merge -> origin/pr/2714/merge
* [new ref] refs/pull/2715/head -> origin/pr/2715/head
* [new ref] refs/pull/2715/merge -> origin/pr/2715/merge
* [new ref] refs/pull/2716/head -> origin/pr/2716/head
* [new ref] refs/pull/2716/merge -> origin/pr/2716/merge
* [new ref] refs/pull/2717/head -> origin/pr/2717/head
* [new ref] refs/pull/2717/merge -> origin/pr/2717/merge
* [new ref] refs/pull/2718/head -> origin/pr/2718/head
* [new ref] refs/pull/2718/merge -> origin/pr/2718/merge
* [new ref] refs/pull/2719/head -> origin/pr/2719/head
* [new ref] refs/pull/2719/merge -> origin/pr/2719/merge
* [new ref] refs/pull/2720/head -> origin/pr/2720/head
* [new ref] refs/pull/2720/merge -> origin/pr/2720/merge
* [new ref] refs/pull/2721/head -> origin/pr/2721/head
* [new ref] refs/pull/2721/merge -> origin/pr/2721/merge
* [new ref] refs/pull/2722/head -> origin/pr/2722/head
* [new ref] refs/pull/2722/merge -> origin/pr/2722/merge
* [new ref] refs/pull/2723/head -> origin/pr/2723/head
* [new ref] refs/pull/2723/merge -> origin/pr/2723/merge
* [new ref] refs/pull/2724/head -> origin/pr/2724/head
* [new ref] refs/pull/2724/merge -> origin/pr/2724/merge
* [new ref] refs/pull/2725/head -> origin/pr/2725/head
* [new ref] refs/pull/2726/head -> origin/pr/2726/head
* [new ref] refs/pull/2727/head -> origin/pr/2727/head
* [new ref] refs/pull/2727/merge -> origin/pr/2727/merge
* [new ref] refs/pull/2728/head -> origin/pr/2728/head
* [new ref] refs/pull/2728/merge -> origin/pr/2728/merge
* [new ref] refs/pull/2729/head -> origin/pr/2729/head
* [new ref] refs/pull/2729/merge -> origin/pr/2729/merge
* [new ref] refs/pull/2730/head -> origin/pr/2730/head
* [new ref] refs/pull/2730/merge -> origin/pr/2730/merge
* [new ref] refs/pull/2731/head -> origin/pr/2731/head
* [new ref] refs/pull/2732/head -> origin/pr/2732/head
* [new ref] refs/pull/2732/merge -> origin/pr/2732/merge
* [new ref] refs/pull/2733/head -> origin/pr/2733/head
* [new ref] refs/pull/2733/merge -> origin/pr/2733/merge
* [new ref] refs/pull/2734/head -> origin/pr/2734/head
* [new ref] refs/pull/2734/merge -> origin/pr/2734/merge
* [new ref] refs/pull/2735/head -> origin/pr/2735/head
* [new ref] refs/pull/2735/merge -> origin/pr/2735/merge
* [new ref] refs/pull/2736/head -> origin/pr/2736/head
* [new ref] refs/pull/2736/merge -> origin/pr/2736/merge
* [new ref] refs/pull/2737/head -> origin/pr/2737/head
* [new ref] refs/pull/2737/merge -> origin/pr/2737/merge
* [new ref] refs/pull/2738/head -> origin/pr/2738/head
* [new ref] refs/pull/2738/merge -> origin/pr/2738/merge
* [new ref] refs/pull/2739/head -> origin/pr/2739/head
* [new ref] refs/pull/2739/merge -> origin/pr/2739/merge
* [new ref] refs/pull/2740/head -> origin/pr/2740/head
* [new ref] refs/pull/2740/merge -> origin/pr/2740/merge
* [new ref] refs/pull/2741/head -> origin/pr/2741/head
* [new ref] refs/pull/2741/merge -> origin/pr/2741/merge
* [new ref] refs/pull/2742/head -> origin/pr/2742/head
* [new ref] refs/pull/2743/head -> origin/pr/2743/head
* [new ref] refs/pull/2743/merge -> origin/pr/2743/merge
* [new ref] refs/pull/2744/head -> origin/pr/2744/head
* [new ref] refs/pull/2744/merge -> origin/pr/2744/merge
Auto packing the repository for optimum performance. You may also
run "git gc" manually. See "git help gc" for more information.
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1799)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1525)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:65)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:316)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor669.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy103.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 884935cb98f0e29bd965fda9182970423d111d7e (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 884935cb98f0e29bd965fda9182970423d111d7e
> git rev-list 42e3a6f8588046f257e5c780dec12d16d0314a66 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson6704943479662226469.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3812416565813157439.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson8451535733436451284.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson6961187350016169677.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-27 19:27:59,818 f0b1d683 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/f0b1d683/pkb.log
2017-04-27 19:27:59,819 f0b1d683 MainThread INFO PerfKitBenchmarker version: v1.11.0-45-g6f31bb3
2017-04-27 19:27:59,820 f0b1d683 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-27 19:28:00,404 f0b1d683 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-27 19:28:00,616 f0b1d683 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-27 19:28:00,620 f0b1d683 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-27 19:28:00,620 f0b1d683 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-27 19:28:00,627 f0b1d683 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-27 19:28:00,631 f0b1d683 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-27 19:28:00,674 f0b1d683 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-27 19:28:00,675 f0b1d683 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/f0b1d683/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #340
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/340/display/redirect?page=changes>
Changes:
[dhalperi] [BEAM-59] Move IOChannelUtils.constructName to FileBasedSink
[lcwik] [BEAM-1871] Move several options/auth classes around in gcp-core
[altay] Add extra message to deprecated annotation
------------------------------------------
[...truncated 113.83 KB...]
building 'numpy.core.umath' extension
compiling C sources
C compiler: x86_64-linux-gnu-gcc -pthread -fno-strict-aliasing -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -fPIC
compile options: '-DHAVE_NPY_CONFIG_H=1 -D_FILE_OFFSET_BITS=64 -D_LARGEFILE_SOURCE=1 -D_LARGEFILE64_SOURCE=1 -Ibuild/src.linux-x86_64-2.7/numpy/core/src/umath -Inumpy/core/include -Ibuild/src.linux-x86_64-2.7/numpy/core/include/numpy -Inumpy/core/src/private -Inumpy/core/src -Inumpy/core -Inumpy/core/src/npymath -Inumpy/core/src/multiarray -Inumpy/core/src/umath -Inumpy/core/src/npysort -I/usr/include/python2.7 -Ibuild/src.linux-x86_64-2.7/numpy/core/src/private -Ibuild/src.linux-x86_64-2.7/numpy/core/src/private -Ibuild/src.linux-x86_64-2.7/numpy/core/src/private -c'
x86_64-linux-gnu-gcc: numpy/core/src/umath/ufunc_type_resolution.c
x86_64-linux-gnu-gcc: numpy/core/src/umath/ufunc_object.c
x86_64-linux-gnu-gcc: build/src.linux-x86_64-2.7/numpy/core/src/umath/scalarmath.c
x86_64-linux-gnu-gcc: build/src.linux-x86_64-2.7/numpy/core/src/umath/loops.c
x86_64-linux-gnu-gcc: numpy/core/src/umath/umathmodule.c
x86_64-linux-gnu-gcc: numpy/core/src/umath/reduction.c
x86_64-linux-gnu-gcc -pthread -shared -Wl,-O1 -Wl,-Bsymbolic-functions -Wl,-Bsymbolic-functions -Wl,-z,relro -fno-strict-aliasing -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -D_FORTIFY_SOURCE=2 -g -fstack-protector --param=ssp-buffer-size=4 -Wformat -Werror=format-security build/temp.linux-x86_64-2.7/numpy/core/src/umath/umathmodule.o build/temp.linux-x86_64-2.7/numpy/core/src/umath/reduction.o build/temp.linux-x86_64-2.7/build/src.linux-x86_64-2.7/numpy/core/src/umath/loops.o build/temp.linux-x86_64-2.7/numpy/core/src/umath/ufunc_object.o build/temp.linux-x86_64-2.7/build/src.linux-x86_64-2.7/numpy/core/src/umath/scalarmath.o build/temp.linux-x86_64-2.7/numpy/core/src/umath/ufunc_type_resolution.o -Lbuild/temp.linux-x86_64-2.7 -lnpymath -lm -o build/lib.linux-x86_64-2.7/numpy/core/umath.so
building 'numpy.core.umath_tests' extension
compiling C sources
C compiler: x86_64-linux-gnu-gcc -pthread -fno-strict-aliasing -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -fPIC
compile options: '-DHAVE_NPY_CONFIG_H=1 -D_FILE_OFFSET_BITS=64 -D_LARGEFILE_SOURCE=1 -D_LARGEFILE64_SOURCE=1 -Inumpy/core/include -Ibuild/src.linux-x86_64-2.7/numpy/core/include/numpy -Inumpy/core/src/private -Inumpy/core/src -Inumpy/core -Inumpy/core/src/npymath -Inumpy/core/src/multiarray -Inumpy/core/src/umath -Inumpy/core/src/npysort -I/usr/include/python2.7 -Ibuild/src.linux-x86_64-2.7/numpy/core/src/private -Ibuild/src.linux-x86_64-2.7/numpy/core/src/private -Ibuild/src.linux-x86_64-2.7/numpy/core/src/private -c'
x86_64-linux-gnu-gcc: build/src.linux-x86_64-2.7/numpy/core/src/umath/umath_tests.c
x86_64-linux-gnu-gcc -pthread -shared -Wl,-O1 -Wl,-Bsymbolic-functions -Wl,-Bsymbolic-functions -Wl,-z,relro -fno-strict-aliasing -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -D_FORTIFY_SOURCE=2 -g -fstack-protector --param=ssp-buffer-size=4 -Wformat -Werror=format-security build/temp.linux-x86_64-2.7/build/src.linux-x86_64-2.7/numpy/core/src/umath/umath_tests.o -Lbuild/temp.linux-x86_64-2.7 -o build/lib.linux-x86_64-2.7/numpy/core/umath_tests.so
building 'numpy.core.test_rational' extension
compiling C sources
C compiler: x86_64-linux-gnu-gcc -pthread -fno-strict-aliasing -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -fPIC
compile options: '-DHAVE_NPY_CONFIG_H=1 -D_FILE_OFFSET_BITS=64 -D_LARGEFILE_SOURCE=1 -D_LARGEFILE64_SOURCE=1 -Inumpy/core/include -Ibuild/src.linux-x86_64-2.7/numpy/core/include/numpy -Inumpy/core/src/private -Inumpy/core/src -Inumpy/core -Inumpy/core/src/npymath -Inumpy/core/src/multiarray -Inumpy/core/src/umath -Inumpy/core/src/npysort -I/usr/include/python2.7 -Ibuild/src.linux-x86_64-2.7/numpy/core/src/private -Ibuild/src.linux-x86_64-2.7/numpy/core/src/private -Ibuild/src.linux-x86_64-2.7/numpy/core/src/private -c'
x86_64-linux-gnu-gcc: build/src.linux-x86_64-2.7/numpy/core/src/umath/test_rational.c
x86_64-linux-gnu-gcc -pthread -shared -Wl,-O1 -Wl,-Bsymbolic-functions -Wl,-Bsymbolic-functions -Wl,-z,relro -fno-strict-aliasing -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -D_FORTIFY_SOURCE=2 -g -fstack-protector --param=ssp-buffer-size=4 -Wformat -Werror=format-security build/temp.linux-x86_64-2.7/build/src.linux-x86_64-2.7/numpy/core/src/umath/test_rational.o -Lbuild/temp.linux-x86_64-2.7 -o build/lib.linux-x86_64-2.7/numpy/core/test_rational.so
building 'numpy.core.struct_ufunc_test' extension
compiling C sources
C compiler: x86_64-linux-gnu-gcc -pthread -fno-strict-aliasing -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -fPIC
compile options: '-DHAVE_NPY_CONFIG_H=1 -D_FILE_OFFSET_BITS=64 -D_LARGEFILE_SOURCE=1 -D_LARGEFILE64_SOURCE=1 -Inumpy/core/include -Ibuild/src.linux-x86_64-2.7/numpy/core/include/numpy -Inumpy/core/src/private -Inumpy/core/src -Inumpy/core -Inumpy/core/src/npymath -Inumpy/core/src/multiarray -Inumpy/core/src/umath -Inumpy/core/src/npysort -I/usr/include/python2.7 -Ibuild/src.linux-x86_64-2.7/numpy/core/src/private -Ibuild/src.linux-x86_64-2.7/numpy/core/src/private -Ibuild/src.linux-x86_64-2.7/numpy/core/src/private -c'
x86_64-linux-gnu-gcc: build/src.linux-x86_64-2.7/numpy/core/src/umath/struct_ufunc_test.c
x86_64-linux-gnu-gcc -pthread -shared -Wl,-O1 -Wl,-Bsymbolic-functions -Wl,-Bsymbolic-functions -Wl,-z,relro -fno-strict-aliasing -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -D_FORTIFY_SOURCE=2 -g -fstack-protector --param=ssp-buffer-size=4 -Wformat -Werror=format-security build/temp.linux-x86_64-2.7/build/src.linux-x86_64-2.7/numpy/core/src/umath/struct_ufunc_test.o -Lbuild/temp.linux-x86_64-2.7 -o build/lib.linux-x86_64-2.7/numpy/core/struct_ufunc_test.so
building 'numpy.core.multiarray_tests' extension
compiling C sources
C compiler: x86_64-linux-gnu-gcc -pthread -fno-strict-aliasing -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -fPIC
compile options: '-DHAVE_NPY_CONFIG_H=1 -D_FILE_OFFSET_BITS=64 -D_LARGEFILE_SOURCE=1 -D_LARGEFILE64_SOURCE=1 -Inumpy/core/include -Ibuild/src.linux-x86_64-2.7/numpy/core/include/numpy -Inumpy/core/src/private -Inumpy/core/src -Inumpy/core -Inumpy/core/src/npymath -Inumpy/core/src/multiarray -Inumpy/core/src/umath -Inumpy/core/src/npysort -I/usr/include/python2.7 -Ibuild/src.linux-x86_64-2.7/numpy/core/src/private -Ibuild/src.linux-x86_64-2.7/numpy/core/src/private -Ibuild/src.linux-x86_64-2.7/numpy/core/src/private -c'
x86_64-linux-gnu-gcc: numpy/core/src/private/mem_overlap.c
x86_64-linux-gnu-gcc: build/src.linux-x86_64-2.7/numpy/core/src/multiarray/multiarray_tests.c
x86_64-linux-gnu-gcc -pthread -shared -Wl,-O1 -Wl,-Bsymbolic-functions -Wl,-Bsymbolic-functions -Wl,-z,relro -fno-strict-aliasing -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -D_FORTIFY_SOURCE=2 -g -fstack-protector --param=ssp-buffer-size=4 -Wformat -Werror=format-security build/temp.linux-x86_64-2.7/build/src.linux-x86_64-2.7/numpy/core/src/multiarray/multiarray_tests.o build/temp.linux-x86_64-2.7/numpy/core/src/private/mem_overlap.o -Lbuild/temp.linux-x86_64-2.7 -o build/lib.linux-x86_64-2.7/numpy/core/multiarray_tests.so
building 'numpy.core.operand_flag_tests' extension
compiling C sources
C compiler: x86_64-linux-gnu-gcc -pthread -fno-strict-aliasing -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -fPIC
compile options: '-DHAVE_NPY_CONFIG_H=1 -D_FILE_OFFSET_BITS=64 -D_LARGEFILE_SOURCE=1 -D_LARGEFILE64_SOURCE=1 -Inumpy/core/include -Ibuild/src.linux-x86_64-2.7/numpy/core/include/numpy -Inumpy/core/src/private -Inumpy/core/src -Inumpy/core -Inumpy/core/src/npymath -Inumpy/core/src/multiarray -Inumpy/core/src/umath -Inumpy/core/src/npysort -I/usr/include/python2.7 -Ibuild/src.linux-x86_64-2.7/numpy/core/src/private -Ibuild/src.linux-x86_64-2.7/numpy/core/src/private -Ibuild/src.linux-x86_64-2.7/numpy/core/src/private -c'
x86_64-linux-gnu-gcc: build/src.linux-x86_64-2.7/numpy/core/src/umath/operand_flag_tests.c
x86_64-linux-gnu-gcc -pthread -shared -Wl,-O1 -Wl,-Bsymbolic-functions -Wl,-Bsymbolic-functions -Wl,-z,relro -fno-strict-aliasing -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -D_FORTIFY_SOURCE=2 -g -fstack-protector --param=ssp-buffer-size=4 -Wformat -Werror=format-security build/temp.linux-x86_64-2.7/build/src.linux-x86_64-2.7/numpy/core/src/umath/operand_flag_tests.o -Lbuild/temp.linux-x86_64-2.7 -o build/lib.linux-x86_64-2.7/numpy/core/operand_flag_tests.so
building 'numpy.fft.fftpack_lite' extension
compiling C sources
C compiler: x86_64-linux-gnu-gcc -pthread -fno-strict-aliasing -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -fPIC
compile options: '-Inumpy/core/include -Ibuild/src.linux-x86_64-2.7/numpy/core/include/numpy -Inumpy/core/src/private -Inumpy/core/src -Inumpy/core -Inumpy/core/src/npymath -Inumpy/core/src/multiarray -Inumpy/core/src/umath -Inumpy/core/src/npysort -I/usr/include/python2.7 -Ibuild/src.linux-x86_64-2.7/numpy/core/src/private -Ibuild/src.linux-x86_64-2.7/numpy/core/src/private -Ibuild/src.linux-x86_64-2.7/numpy/core/src/private -c'
x86_64-linux-gnu-gcc: numpy/fft/fftpack.c
x86_64-linux-gnu-gcc: numpy/fft/fftpack_litemodule.c
x86_64-linux-gnu-gcc -pthread -shared -Wl,-O1 -Wl,-Bsymbolic-functions -Wl,-Bsymbolic-functions -Wl,-z,relro -fno-strict-aliasing -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -D_FORTIFY_SOURCE=2 -g -fstack-protector --param=ssp-buffer-size=4 -Wformat -Werror=format-security build/temp.linux-x86_64-2.7/numpy/fft/fftpack_litemodule.o build/temp.linux-x86_64-2.7/numpy/fft/fftpack.o -Lbuild/temp.linux-x86_64-2.7 -o build/lib.linux-x86_64-2.7/numpy/fft/fftpack_lite.so
building 'numpy.linalg.lapack_lite' extension
compiling C sources
C compiler: x86_64-linux-gnu-gcc -pthread -fno-strict-aliasing -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -fPIC
compile options: '-Inumpy/core/include -Ibuild/src.linux-x86_64-2.7/numpy/core/include/numpy -Inumpy/core/src/private -Inumpy/core/src -Inumpy/core -Inumpy/core/src/npymath -Inumpy/core/src/multiarray -Inumpy/core/src/umath -Inumpy/core/src/npysort -I/usr/include/python2.7 -Ibuild/src.linux-x86_64-2.7/numpy/core/src/private -Ibuild/src.linux-x86_64-2.7/numpy/core/src/private -Ibuild/src.linux-x86_64-2.7/numpy/core/src/private -c'
x86_64-linux-gnu-gcc: numpy/linalg/lapack_lite/python_xerbla.c
x86_64-linux-gnu-gcc: numpy/linalg/lapack_lite/dlamch.c
numpy/linalg/lapack_lite/dlamch.c: In function ‘dlamc4_’:
numpy/linalg/lapack_lite/dlamch.c:720:13: warning: variable ‘i__1’ set but not used [-Wunused-but-set-variable]
integer i__1;
^
numpy/linalg/lapack_lite/dlamch.c: In function ‘dlamc5_’:
numpy/linalg/lapack_lite/dlamch.c:834:13: warning: variable ‘i__1’ set but not used [-Wunused-but-set-variable]
integer i__1;
^
x86_64-linux-gnu-gcc: numpy/linalg/lapack_lite/blas_lite.c
numpy/linalg/lapack_lite/blas_lite.c: In function ‘cgemm_’:
numpy/linalg/lapack_lite/blas_lite.c:352:20: warning: variable ‘ncola’ set but not used [-Wunused-but-set-variable]
static integer ncola;
^
numpy/linalg/lapack_lite/blas_lite.c: In function ‘dgemm_’:
numpy/linalg/lapack_lite/blas_lite.c:6624:20: warning: variable ‘ncola’ set but not used [-Wunused-but-set-variable]
static integer ncola;
^
numpy/linalg/lapack_lite/blas_lite.c: In function ‘sgemm_’:
numpy/linalg/lapack_lite/blas_lite.c:11190:20: warning: variable ‘ncola’ set but not used [-Wunused-but-set-variable]
static integer ncola;
^
numpy/linalg/lapack_lite/blas_lite.c: In function ‘zgemm_’:
numpy/linalg/lapack_lite/blas_lite.c:15222:20: warning: variable ‘ncola’ set but not used [-Wunused-but-set-variable]
static integer ncola;
^
numpy/linalg/lapack_lite/blas_lite.c: At top level:
numpy/linalg/lapack_lite/blas_lite.c:24:16: warning: ‘c__1’ defined but not used [-Wunused-variable]
static integer c__1 = 1;
^
x86_64-linux-gnu-gcc: numpy/linalg/lapack_litemodule.c
x86_64-linux-gnu-gcc: numpy/linalg/lapack_lite/dlapack_lite.c
numpy/linalg/lapack_lite/dlapack_lite.c: In function ‘claed7_’:
numpy/linalg/lapack_lite/dlapack_lite.c:9857:59: warning: variable ‘ind2’ set but not used [-Wunused-but-set-variable]
static integer i__, k, n1, n2, iq, iw, iz, ptr, ind1, ind2, indx, curr,
^
numpy/linalg/lapack_lite/dlapack_lite.c:9857:53: warning: variable ‘ind1’ set but not used [-Wunused-but-set-variable]
static integer i__, k, n1, n2, iq, iw, iz, ptr, ind1, ind2, indx, curr,
^
numpy/linalg/lapack_lite/dlapack_lite.c: In function ‘dbdsqr_’:
numpy/linalg/lapack_lite/dlapack_lite.c:27451:23: warning: variable ‘sminlo’ set but not used [-Wunused-but-set-variable]
static doublereal sminlo, tolmul;
^
numpy/linalg/lapack_lite/dlapack_lite.c: In function ‘sbdsqr_’:
numpy/linalg/lapack_lite/dlapack_lite.c:64393:17: warning: variable ‘sminlo’ set but not used [-Wunused-but-set-variable]
static real sminlo, tolmul;
^
x86_64-linux-gnu-gcc: numpy/linalg/lapack_lite/f2c_lite.c
x86_64-linux-gnu-gcc: numpy/linalg/lapack_lite/zlapack_lite.c
numpy/linalg/lapack_lite/zlapack_lite.c: In function ‘zlaed7_’:
numpy/linalg/lapack_lite/zlapack_lite.c:10000:59: warning: variable ‘ind2’ set but not used [-Wunused-but-set-variable]
static integer i__, k, n1, n2, iq, iw, iz, ptr, ind1, ind2, indx, curr,
^
numpy/linalg/lapack_lite/zlapack_lite.c:10000:53: warning: variable ‘ind1’ set but not used [-Wunused-but-set-variable]
static integer i__, k, n1, n2, iq, iw, iz, ptr, ind1, ind2, indx, curr,
^
x86_64-linux-gnu-gcc -pthread -shared -Wl,-O1 -Wl,-Bsymbolic-functions -Wl,-Bsymbolic-functions -Wl,-z,relro -fno-strict-aliasing -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -D_FORTIFY_SOURCE=2 -g -fstack-protector --param=ssp-buffer-size=4 -Wformat -Werror=format-security build/temp.linux-x86_64-2.7/numpy/linalg/lapack_litemodule.o build/temp.linux-x86_64-2.7/numpy/linalg/lapack_lite/python_xerbla.o build/temp.linux-x86_64-2.7/numpy/linalg/lapack_lite/zlapack_lite.o build/temp.linux-x86_64-2.7/numpy/linalg/lapack_lite/dlapack_lite.o build/temp.linux-x86_64-2.7/numpy/linalg/lapack_lite/blas_lite.o build/temp.linux-x86_64-2.7/numpy/linalg/lapack_lite/dlamch.o build/temp.linux-x86_64-2.7/numpy/linalg/lapack_lite/f2c_lite.o -Lbuild/temp.linux-x86_64-2.7 -o build/lib.linux-x86_64-2.7/numpy/linalg/lapack_lite.so
building 'numpy.linalg._umath_linalg' extension
compiling C sources
C compiler: x86_64-linux-gnu-gcc -pthread -fno-strict-aliasing -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -fPIC
compile options: '-Inumpy/core/include -Ibuild/src.linux-x86_64-2.7/numpy/core/include/numpy -Inumpy/core/src/private -Inumpy/core/src -Inumpy/core -Inumpy/core/src/npymath -Inumpy/core/src/multiarray -Inumpy/core/src/umath -Inumpy/core/src/npysort -I/usr/include/python2.7 -Ibuild/src.linux-x86_64-2.7/numpy/core/src/private -Ibuild/src.linux-x86_64-2.7/numpy/core/src/private -Ibuild/src.linux-x86_64-2.7/numpy/core/src/private -c'
x86_64-linux-gnu-gcc: numpy/linalg/lapack_lite/python_xerbla.c
x86_64-linux-gnu-gcc: numpy/linalg/lapack_lite/dlamch.c
numpy/linalg/lapack_lite/dlamch.c: In function ‘dlamc4_’:
numpy/linalg/lapack_lite/dlamch.c:720:13: warning: variable ‘i__1’ set but not used [-Wunused-but-set-variable]
integer i__1;
^
numpy/linalg/lapack_lite/dlamch.c: In function ‘dlamc5_’:
numpy/linalg/lapack_lite/dlamch.c:834:13: warning: variable ‘i__1’ set but not used [-Wunused-but-set-variable]
integer i__1;
^
x86_64-linux-gnu-gcc: numpy/linalg/lapack_lite/blas_lite.c
numpy/linalg/lapack_lite/blas_lite.c: In function ‘cgemm_’:
numpy/linalg/lapack_lite/blas_lite.c:352:20: warning: variable ‘ncola’ set but not used [-Wunused-but-set-variable]
static integer ncola;
^
numpy/linalg/lapack_lite/blas_lite.c: In function ‘dgemm_’:
numpy/linalg/lapack_lite/blas_lite.c:6624:20: warning: variable ‘ncola’ set but not used [-Wunused-but-set-variable]
static integer ncola;
^
numpy/linalg/lapack_lite/blas_lite.c: In function ‘sgemm_’:
numpy/linalg/lapack_lite/blas_lite.c:11190:20: warning: variable ‘ncola’ set but not used [-Wunused-but-set-variable]
static integer ncola;
^
numpy/linalg/lapack_lite/blas_lite.c: In function ‘zgemm_’:
numpy/linalg/lapack_lite/blas_lite.c:15222:20: warning: variable ‘ncola’ set but not used [-Wunused-but-set-variable]
static integer ncola;
^
numpy/linalg/lapack_lite/blas_lite.c: At top level:
numpy/linalg/lapack_lite/blas_lite.c:24:16: warning: ‘c__1’ defined but not used [-Wunused-variable]
static integer c__1 = 1;
^
x86_64-linux-gnu-gcc: numpy/linalg/lapack_lite/dlapack_lite.c
numpy/linalg/lapack_lite/dlapack_lite.c: In function ‘claed7_’:
numpy/linalg/lapack_lite/dlapack_lite.c:9857:59: warning: variable ‘ind2’ set but not used [-Wunused-but-set-variable]
static integer i__, k, n1, n2, iq, iw, iz, ptr, ind1, ind2, indx, curr,
^
numpy/linalg/lapack_lite/dlapack_lite.c:9857:53: warning: variable ‘ind1’ set but not used [-Wunused-but-set-variable]
static integer i__, k, n1, n2, iq, iw, iz, ptr, ind1, ind2, indx, curr,
^
numpy/linalg/lapack_lite/dlapack_lite.c: In function ‘dbdsqr_’:
numpy/linalg/lapack_lite/dlapack_lite.c:27451:23: warning: variable ‘sminlo’ set but not used [-Wunused-but-set-variable]
static doublereal sminlo, tolmul;
^
numpy/linalg/lapack_lite/dlapack_lite.c: In function ‘sbdsqr_’:
numpy/linalg/lapack_lite/dlapack_lite.c:64393:17: warning: variable ‘sminlo’ set but not used [-Wunused-but-set-variable]
static real sminlo, tolmul;
^
x86_64-linux-gnu-gcc: build/src.linux-x86_64-2.7/numpy/linalg/umath_linalg.c
x86_64-linux-gnu-gcc: numpy/linalg/lapack_lite/f2c_lite.c
x86_64-linux-gnu-gcc: numpy/linalg/lapack_lite/zlapack_lite.c
numpy/linalg/lapack_lite/zlapack_lite.c: In function ‘zlaed7_’:
numpy/linalg/lapack_lite/zlapack_lite.c:10000:59: warning: variable ‘ind2’ set but not used [-Wunused-but-set-variable]
static integer i__, k, n1, n2, iq, iw, iz, ptr, ind1, ind2, indx, curr,
^
numpy/linalg/lapack_lite/zlapack_lite.c:10000:53: warning: variable ‘ind1’ set but not used [-Wunused-but-set-variable]
static integer i__, k, n1, n2, iq, iw, iz, ptr, ind1, ind2, indx, curr,
^
x86_64-linux-gnu-gcc -pthread -shared -Wl,-O1 -Wl,-Bsymbolic-functions -Wl,-Bsymbolic-functions -Wl,-z,relro -fno-strict-aliasing -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -D_FORTIFY_SOURCE=2 -g -fstack-protector --param=ssp-buffer-size=4 -Wformat -Werror=format-security build/temp.linux-x86_64-2.7/build/src.linux-x86_64-2.7/numpy/linalg/umath_linalg.o build/temp.linux-x86_64-2.7/numpy/linalg/lapack_lite/python_xerbla.o build/temp.linux-x86_64-2.7/numpy/linalg/lapack_lite/zlapack_lite.o build/temp.linux-x86_64-2.7/numpy/linalg/lapack_lite/dlapack_lite.o build/temp.linux-x86_64-2.7/numpy/linalg/lapack_lite/blas_lite.o build/temp.linux-x86_64-2.7/numpy/linalg/lapack_lite/dlamch.o build/temp.linux-x86_64-2.7/numpy/linalg/lapack_lite/f2c_lite.o -Lbuild/temp.linux-x86_64-2.7 -lnpymath -o build/lib.linux-x86_64-2.7/numpy/linalg/_umath_linalg.so
building 'numpy.random.mtrand' extension
compiling C sources
C compiler: x86_64-linux-gnu-gcc -pthread -fno-strict-aliasing -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -fPIC
compile options: '-D_FILE_OFFSET_BITS=64 -D_LARGEFILE_SOURCE=1 -D_LARGEFILE64_SOURCE=1 -Inumpy/core/include -Ibuild/src.linux-x86_64-2.7/numpy/core/include/numpy -Inumpy/core/src/private -Inumpy/core/src -Inumpy/core -Inumpy/core/src/npymath -Inumpy/core/src/multiarray -Inumpy/core/src/umath -Inumpy/core/src/npysort -I/usr/include/python2.7 -Ibuild/src.linux-x86_64-2.7/numpy/core/src/private -Ibuild/src.linux-x86_64-2.7/numpy/core/src/private -Ibuild/src.linux-x86_64-2.7/numpy/core/src/private -c'
x86_64-linux-gnu-gcc: numpy/random/mtrand/distributions.c
x86_64-linux-gnu-gcc: numpy/random/mtrand/mtrand.c
x86_64-linux-gnu-gcc: numpy/random/mtrand/initarray.c
x86_64-linux-gnu-gcc: numpy/random/mtrand/randomkit.c
x86_64-linux-gnu-gcc -pthread -shared -Wl,-O1 -Wl,-Bsymbolic-functions -Wl,-Bsymbolic-functions -Wl,-z,relro -fno-strict-aliasing -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -D_FORTIFY_SOURCE=2 -g -fstack-protector --param=ssp-buffer-size=4 -Wformat -Werror=format-security build/temp.linux-x86_64-2.7/numpy/random/mtrand/mtrand.o build/temp.linux-x86_64-2.7/numpy/random/mtrand/randomkit.o build/temp.linux-x86_64-2.7/numpy/random/mtrand/initarray.o build/temp.linux-x86_64-2.7/numpy/random/mtrand/distributions.o -Lbuild/temp.linux-x86_64-2.7 -o build/lib.linux-x86_64-2.7/numpy/random/mtrand.so
Creating build/scripts.linux-x86_64-2.7/f2py
adding 'build/scripts.linux-x86_64-2.7/f2py' to scripts
changing mode of build/scripts.linux-x86_64-2.7/f2py from 644 to 755
warning: no previously-included files matching '*.pyo' found anywhere in distribution
warning: no previously-included files matching '*.pyd' found anywhere in distribution
changing mode of /home/jenkins/.local/bin/f2py to 755
Running setup.py install for functools32
warning: no files found matching '*.txt'
no previously-included directories found matching 'build'
no previously-included directories found matching 'dist'
no previously-included directories found matching '.git*'
Successfully installed python-gflags colorlog blinker futures PyYAML pint numpy functools32 contextlib2
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5195933728526926087.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-27 18:56:02,639 848488b6 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/848488b6/pkb.log
2017-04-27 18:56:02,639 848488b6 MainThread INFO PerfKitBenchmarker version: v1.11.0-45-g6f31bb3
2017-04-27 18:56:02,639 848488b6 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-27 18:56:03,032 848488b6 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-27 18:56:03,124 848488b6 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-27 18:56:03,127 848488b6 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-27 18:56:03,127 848488b6 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-27 18:56:03,133 848488b6 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-27 18:56:03,135 848488b6 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-27 18:56:03,159 848488b6 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-27 18:56:03,160 848488b6 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/848488b6/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #339
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/339/display/redirect?page=changes>
Changes:
[wtanaka] Rename openWindows => windowsThatAreOpen
[chamikara] Adding validatesrunner test for sources
[lcwik] Update pom.xml
[lcwik] [BEAM-2060] Allow to specify charset in XmlIO
[lcwik] [BEAM-2060] Use withCharset(Charset) for the user facing API
[dhalperi] Remove unnecessary semicolons
[tgroh] Use Structural Value when comparing Window(AndTrigger) Namespaces
[altay] Add ValueProvider tests to json_value_test.py
[bchambers] [BEAM-1148] Port PAssert away from aggregators
[sisk] TextIO & AvroIO no longer validate schemas against IOChannelFactory
[altay] Increase post commit timeout from 600 seconds to 900
[robertwb] Add instructions to regenerate Python proto wrappers.
[robertwb] Generate python proto wrappers for runner and fn API.
[robertwb] Add apache licence to generated files.
[robertwb] Adapt to PR #2505 changes to protos.
[lcwik] [BEAM-1871] Move ProtoCoder to new sdks/java/extensions/protobuf
[tgroh] Properly Declare Protobuf extension dependencies
[tgroh] Stop Extending AtomicCoder
[altay] Pin apitools to 0.5.8
[iemejia] Fix error with the artifactId on Flink runner after refactor
[iemejia] [BEAM-2075] Update flink runner to use flink version 1.2.1
[aljoscha.krettek] [BEAM-1772] Support merging WindowFn other than IntervalWindow on Flink
[aljoscha.krettek] [BEAM-1812] Add externalized checkpoint configuration to
[dhalperi] ByteKey: remove ByteString from public API, replace with ByteBuffer
[lcwik] [BEAM-1877] Use Iterables.isEmpty in GroupIntoBatches
[tgroh] Add `Filter#equal`
[tgroh] Add HadoopResourceId
[tgroh] Add Cloud Object Translators for Coders
[tgroh] Revert "Add HadoopResourceId"
[altay] Fix in dataflow metrics
[bchambers] Removing Aggregators from Examples
[bchambers] Removing Aggregators from runner-specific examples and tests
[bchambers] Removing Aggregators from PipelineResults and subclasses
[sourabhbajaj] [BEAM-2068] Update to latest version of apitools
[lcwik] [BEAM-1871] Move Bigquery/Pubsub options to
[tgroh] Make Most StandardCoders CustomCoders
[chamikara] [BEAM-1988] Add FileSystems Interface for accessing underlying FS
[altay] [BEAM-1989] Fix the syntax warning from import star
[altay] [BEAM-1749] Upgrade to pycodestyle
[dhalperi] Datastore: fix use of deprecated function
[wtanaka] Remove unused private fields
[chamikara] Updates DoFn invocation logic to be more extensible.
[lcwik] [BEAM-1871] Move ByteStringCoder to sdks/java/extensions/protobuf
[dhalperi] Update maven surefire and failsafe plugins to version 2.20
[lcwik] [BEAM-1871] Move functionality from AvroUtils to AvroSource hiding
[dhalperi] Add surefire-plugin.version property to archetype pom.xml
[tgroh] Remove AtomicCoder
[aviemzur] [BEAM-1958] Standard IO Metrics in Java SDK
[tgroh] Fix small typo in comment in CoderRegistry
[lcwik] [BEAM-1871] Remove deprecated methods from AvroCoder
[lcwik] [BEAM-2060] Add charset support in XmlSink
[lcwik] [BEAM-1871] Move RetryHttpRequestInitializer and remove deprecated
[dhalperi] LocalResourceId: make toString end in '/' for directories
[dhalperi] FileSystems: make tolerant of and more efficient for empty lists
[dhalperi] LocalFileSystem: create parent directories if needed
[lcwik] Add getElementCoders to UnionCoder
[dhalperi] Make it possible to test runners that don't support all metrics
[lcwik] Make WindowedValueCoder an Interface
[lcwik] [BEAM-1871] Drop usage of Jackson/CloudObject from CoGbkResultSchema
[kirpichov] [BEAM-1573] Use Kafka serializers instead of coders in KafkaIO
[bchambers] Remove aggregators from Dataflow runner
[klk] Replace OutputTimeFn UDF with TimestampCombiner enum
[lcwik] [BEAM-1871] Clean-up org.apache.beam.sdk.util, move BitSetCoder from
[lcwik] [BEAM-1871] Re-add BitSetCoder to sdk/util for Dataflow worker.
[altay] Do not depend on message id in DataflowRunner
[altay] [BEAM-1316] start bundle should not output any elements
[robertwb] Per-transform runner api dispatch.
[robertwb] Translate flatten to Runner API.
[robertwb] Translate WindowInto through the Runner API.
[robertwb] Factor out URN registration logic.
[kirpichov] update JavaDoc for Count.globally
[tgroh] Add Registrars for Coder Cloud Object Translators
[dhalperi] FileBasedSink: fix typos
[klk] Revert "Replace OutputTimeFn UDF with TimestampCombiner enum"
[tgroh] Revert "Make WindowedValueCoder an Interface"
[iemejia] Use parent pom version of hadoop, move common deps into the hadoop
[iemejia] Change to commons-lang dependency to commons-lang3 to be consistent with
[jbonofre] [BEAM-2091] Typo in build instructions in Apex Runner's README.md
[klk] Do not rely on metrics in streaming TestDataflowRunner
[thw] BEAM-1766 Remove Aggregators from Apex runner
[lcwik] XmlIO and XmlSource now take an optional validationEventHandler to throw
[tgroh] Mark Pipeline#getPipelineOptions Experimental
------------------------------------------
Started by timer
Started by timer
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on beam6 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/>
Cloning the remote Git repository
Cloning repository https://github.com/apache/beam.git
> git init <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/> # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/*
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
> git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 1babed250404d4c1b5ce82034e1cda0bcfa71c26 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 1babed250404d4c1b5ce82034e1cda0bcfa71c26
> git rev-list a67019739dc7f09a8336b9606c3726ad5d546f51 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson8481344159617934558.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5395040492010499161.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson1482093818285122542.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson7652032562621552715.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-27 17:24:40,325 c2085155 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/c2085155/pkb.log
2017-04-27 17:24:40,325 c2085155 MainThread INFO PerfKitBenchmarker version: v1.11.0-45-g6f31bb3
2017-04-27 17:24:40,326 c2085155 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-27 17:24:40,901 c2085155 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-27 17:24:41,043 c2085155 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-27 17:24:41,045 c2085155 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-27 17:24:41,046 c2085155 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-27 17:24:41,051 c2085155 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-27 17:24:41,053 c2085155 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-27 17:24:41,108 c2085155 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-27 17:24:41,108 c2085155 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/c2085155/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #338
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/338/display/redirect?page=changes>
Changes:
[altay] [BEAM-1988] Migrate from utils.path to BFS
------------------------------------------
[...truncated 270.92 KB...]
error: unable to resolve reference refs/remotes/origin/pr/2505/merge: No such file or directory
! 0f11265...780e3cd refs/pull/2505/merge -> origin/pr/2505/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2507/merge: No such file or directory
! b448bef...16e9c65 refs/pull/2507/merge -> origin/pr/2507/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2508/merge: No such file or directory
! a9fedd2...10b9545 refs/pull/2508/merge -> origin/pr/2508/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2511/merge: No such file or directory
! afe991b...c82ff73 refs/pull/2511/merge -> origin/pr/2511/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2514/merge: No such file or directory
! 0ae3202...ec1b6e0 refs/pull/2514/merge -> origin/pr/2514/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2517/merge: No such file or directory
! fa0c57f...f442410 refs/pull/2517/merge -> origin/pr/2517/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2518/merge: No such file or directory
! 10a8893...54a9356 refs/pull/2518/merge -> origin/pr/2518/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2519/merge: No such file or directory
! 98ea9f6...aad7043 refs/pull/2519/merge -> origin/pr/2519/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2520/merge: No such file or directory
! fc04459...07f8717 refs/pull/2520/merge -> origin/pr/2520/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2522/merge: No such file or directory
! c99fa26...c740b2d refs/pull/2522/merge -> origin/pr/2522/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2525/merge: No such file or directory
! 441d1b2...7e01908 refs/pull/2525/merge -> origin/pr/2525/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2527/merge: No such file or directory
! 216da5f...feee33b refs/pull/2527/merge -> origin/pr/2527/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2528/merge: No such file or directory
! 01b3137...6ee7dcc refs/pull/2528/merge -> origin/pr/2528/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2531/merge: No such file or directory
! 49d5bde...e435821 refs/pull/2531/merge -> origin/pr/2531/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2534/merge: No such file or directory
! 081af1f...ef9e0fc refs/pull/2534/merge -> origin/pr/2534/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2535/merge: No such file or directory
! 7d4bdcb...4ad387e refs/pull/2535/merge -> origin/pr/2535/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2538/head: No such file or directory
! e1f3b03...142e469 refs/pull/2538/head -> origin/pr/2538/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2538/merge: No such file or directory
! 8c865f5...f824c27 refs/pull/2538/merge -> origin/pr/2538/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2541/merge: No such file or directory
! a7fdea3...8b9aa21 refs/pull/2541/merge -> origin/pr/2541/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2544/merge: No such file or directory
! e52973a...4c36b29 refs/pull/2544/merge -> origin/pr/2544/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2555/merge: No such file or directory
! 219db6f...04900c3 refs/pull/2555/merge -> origin/pr/2555/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2573/merge: No such file or directory
! ff7c24f...c92f372 refs/pull/2573/merge -> origin/pr/2573/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2578/merge: No such file or directory
! 9b3d521...2a90ded refs/pull/2578/merge -> origin/pr/2578/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2581/merge: No such file or directory
! b905438...b6f4753 refs/pull/2581/merge -> origin/pr/2581/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2591/merge: No such file or directory
! f0b2095...81d27bb refs/pull/2591/merge -> origin/pr/2591/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2593/merge: No such file or directory
! 88036dc...6950873 refs/pull/2593/merge -> origin/pr/2593/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2595/merge: No such file or directory
! a1da297...a86fe73 refs/pull/2595/merge -> origin/pr/2595/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2597/merge: No such file or directory
! f6d46f5...bad5fb6 refs/pull/2597/merge -> origin/pr/2597/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2603/merge: No such file or directory
! 956876b...811d0eb refs/pull/2603/merge -> origin/pr/2603/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2609/merge: No such file or directory
! c596646...e8440c5 refs/pull/2609/merge -> origin/pr/2609/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2611/merge: No such file or directory
! cb24c79...a2fc9c6 refs/pull/2611/merge -> origin/pr/2611/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2612/merge: No such file or directory
! 071e347...fde1693 refs/pull/2612/merge -> origin/pr/2612/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2615/merge: No such file or directory
! 66b12ee...90a071d refs/pull/2615/merge -> origin/pr/2615/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2617/merge: No such file or directory
! fcaa4c1...8aeff7f refs/pull/2617/merge -> origin/pr/2617/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2620/merge: No such file or directory
! 94305ad...325d694 refs/pull/2620/merge -> origin/pr/2620/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2622/merge: No such file or directory
! 88414bb...bd3c5d0 refs/pull/2622/merge -> origin/pr/2622/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2625/merge: No such file or directory
! f8009ae...d4b3686 refs/pull/2625/merge -> origin/pr/2625/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2626/merge: No such file or directory
! f253a9a...a6320e1 refs/pull/2626/merge -> origin/pr/2626/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2627/merge: No such file or directory
! c0125ba...9b3449b refs/pull/2627/merge -> origin/pr/2627/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2630/merge: No such file or directory
! 7cc8e95...ca206d9 refs/pull/2630/merge -> origin/pr/2630/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2631/merge: No such file or directory
! 0373f59...5ece9c8 refs/pull/2631/merge -> origin/pr/2631/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2632/merge: No such file or directory
! 8fb02b8...6f95956 refs/pull/2632/merge -> origin/pr/2632/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2633/merge: No such file or directory
! e0d3a93...bfb2227 refs/pull/2633/merge -> origin/pr/2633/merge (unable to update local ref)
* [new ref] refs/pull/2634/head -> origin/pr/2634/head
* [new ref] refs/pull/2634/merge -> origin/pr/2634/merge
* [new ref] refs/pull/2635/head -> origin/pr/2635/head
* [new ref] refs/pull/2636/head -> origin/pr/2636/head
* [new ref] refs/pull/2636/merge -> origin/pr/2636/merge
* [new ref] refs/pull/2637/head -> origin/pr/2637/head
* [new ref] refs/pull/2637/merge -> origin/pr/2637/merge
* [new ref] refs/pull/2638/head -> origin/pr/2638/head
* [new ref] refs/pull/2638/merge -> origin/pr/2638/merge
* [new ref] refs/pull/2639/head -> origin/pr/2639/head
* [new ref] refs/pull/2639/merge -> origin/pr/2639/merge
* [new ref] refs/pull/2640/head -> origin/pr/2640/head
* [new ref] refs/pull/2640/merge -> origin/pr/2640/merge
* [new ref] refs/pull/2641/head -> origin/pr/2641/head
* [new ref] refs/pull/2641/merge -> origin/pr/2641/merge
* [new ref] refs/pull/2642/head -> origin/pr/2642/head
* [new ref] refs/pull/2642/merge -> origin/pr/2642/merge
* [new ref] refs/pull/2643/head -> origin/pr/2643/head
* [new ref] refs/pull/2643/merge -> origin/pr/2643/merge
* [new ref] refs/pull/2644/head -> origin/pr/2644/head
* [new ref] refs/pull/2644/merge -> origin/pr/2644/merge
* [new ref] refs/pull/2645/head -> origin/pr/2645/head
* [new ref] refs/pull/2645/merge -> origin/pr/2645/merge
* [new ref] refs/pull/2646/head -> origin/pr/2646/head
* [new ref] refs/pull/2646/merge -> origin/pr/2646/merge
* [new ref] refs/pull/2647/head -> origin/pr/2647/head
* [new ref] refs/pull/2647/merge -> origin/pr/2647/merge
* [new ref] refs/pull/2648/head -> origin/pr/2648/head
* [new ref] refs/pull/2648/merge -> origin/pr/2648/merge
* [new ref] refs/pull/2649/head -> origin/pr/2649/head
* [new ref] refs/pull/2649/merge -> origin/pr/2649/merge
* [new ref] refs/pull/2650/head -> origin/pr/2650/head
* [new ref] refs/pull/2650/merge -> origin/pr/2650/merge
* [new ref] refs/pull/2651/head -> origin/pr/2651/head
* [new ref] refs/pull/2651/merge -> origin/pr/2651/merge
* [new ref] refs/pull/2652/head -> origin/pr/2652/head
* [new ref] refs/pull/2652/merge -> origin/pr/2652/merge
* [new ref] refs/pull/2653/head -> origin/pr/2653/head
* [new ref] refs/pull/2653/merge -> origin/pr/2653/merge
* [new ref] refs/pull/2654/head -> origin/pr/2654/head
* [new ref] refs/pull/2654/merge -> origin/pr/2654/merge
* [new ref] refs/pull/2655/head -> origin/pr/2655/head
* [new ref] refs/pull/2655/merge -> origin/pr/2655/merge
* [new ref] refs/pull/2656/head -> origin/pr/2656/head
* [new ref] refs/pull/2656/merge -> origin/pr/2656/merge
* [new ref] refs/pull/2657/head -> origin/pr/2657/head
* [new ref] refs/pull/2657/merge -> origin/pr/2657/merge
Auto packing the repository for optimum performance. You may also
run "git gc" manually. See "git help gc" for more information.
warning: There are too many unreachable loose objects; run 'git prune' to remove them.
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1799)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1525)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:65)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:316)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor584.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy103.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision a67019739dc7f09a8336b9606c3726ad5d546f51 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f a67019739dc7f09a8336b9606c3726ad5d546f51
> git rev-list 1dce98f0745e9c1cc4d83a7532895f2f28ec86bf # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3820256674966605868.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson1772409161506125821.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson7031598677226722041.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5096140202131393241.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-24 01:19:55,466 3daa2bb9 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/3daa2bb9/pkb.log
2017-04-24 01:19:55,466 3daa2bb9 MainThread INFO PerfKitBenchmarker version: v1.11.0-43-g6012a89
2017-04-24 01:19:55,467 3daa2bb9 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-24 01:19:55,799 3daa2bb9 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-24 01:19:55,889 3daa2bb9 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-24 01:19:55,892 3daa2bb9 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-24 01:19:55,892 3daa2bb9 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-24 01:19:55,897 3daa2bb9 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-24 01:19:55,899 3daa2bb9 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-24 01:19:55,924 3daa2bb9 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-24 01:19:55,925 3daa2bb9 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/3daa2bb9/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #337
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/337/display/redirect?page=changes>
Changes:
[lcwik] Validates that input and output GCS paths specify a bucket
[kirpichov] Makes cachedSplitResult transient in BigQuerySourceBase
[lcwik] Update Dataflow Worker Version
[tgroh] Coder.structuralValue(T) should never throw
[chamikara] [BEAM-1988] Add join operation to the filesystem
[chamikara] Change dataflow Job log from info to debug
[tgroh] Remove DeterministicStandardCoder
[lcwik] [BEAM-1786] Post Dataflow worker CoderRegistry clean-up
[lcwik] [BEAM-1871] Remove unnecessary runtime dependencies for Google Cloud
[lcwik] [BEAM-1871] Move Xml IO and related classes to new sdks/java/io/xml
[kirpichov] Introduces GenerateSequence transform
[kirpichov] Replaces all usages of CountingInput with GenerateSequence
[kirpichov] Deletes CountingInput
[kirpichov] Replaces fromTo() with from().to()
[tgroh] Make SimplePCollectionView Visible
[jbonofre] [BEAM-2044] Upgrade HBaseIO to use HBase client version 1.3.1
[kirpichov] [BEAM-1428] KinesisIO should comply with PTransform style guide
[jbonofre] [BEAM-2044] Downgrade HBaseIO to use the stable HBase client version
------------------------------------------
[...truncated 301.79 KB...]
error: unable to resolve reference refs/remotes/origin/pr/2565/merge: No such file or directory
! 8d8deaa...0d15126 refs/pull/2565/merge -> origin/pr/2565/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2577/merge: No such file or directory
! c754797...318505c refs/pull/2577/merge -> origin/pr/2577/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2578/merge: No such file or directory
! 9626f20...9b3d521 refs/pull/2578/merge -> origin/pr/2578/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2579/merge: No such file or directory
! 612129b...23a6992 refs/pull/2579/merge -> origin/pr/2579/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2583/merge: No such file or directory
! 10f5731...0036268 refs/pull/2583/merge -> origin/pr/2583/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2585/merge: No such file or directory
! 9d76f1b...2e46ca2 refs/pull/2585/merge -> origin/pr/2585/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2586/merge: No such file or directory
! 96ed22a...01309ce refs/pull/2586/merge -> origin/pr/2586/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2587/merge: No such file or directory
! 5007331...afc4e4d refs/pull/2587/merge -> origin/pr/2587/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2591/head: No such file or directory
! 09693e1...dddf8ea refs/pull/2591/head -> origin/pr/2591/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2591/merge: No such file or directory
! 8e64258...f0b2095 refs/pull/2591/merge -> origin/pr/2591/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2592/merge: No such file or directory
! 4a576ac...745acd7 refs/pull/2592/merge -> origin/pr/2592/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2593/merge: No such file or directory
! a155fdd...88036dc refs/pull/2593/merge -> origin/pr/2593/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2594/merge: No such file or directory
! f84f6e6...088b3f8 refs/pull/2594/merge -> origin/pr/2594/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2595/merge: No such file or directory
! 1f9dbb3...a1da297 refs/pull/2595/merge -> origin/pr/2595/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2596/merge: No such file or directory
! 1632f84...4711963 refs/pull/2596/merge -> origin/pr/2596/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2597/merge: No such file or directory
! 760bf36...f6d46f5 refs/pull/2597/merge -> origin/pr/2597/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2601/head: No such file or directory
! a79e43e..10545e5 refs/pull/2601/head -> origin/pr/2601/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2601/merge: No such file or directory
! be457d8...e614410 refs/pull/2601/merge -> origin/pr/2601/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2602/merge: No such file or directory
! c392c0a...9b63013 refs/pull/2602/merge -> origin/pr/2602/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2603/merge: No such file or directory
! c93f436...956876b refs/pull/2603/merge -> origin/pr/2603/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2604/merge: No such file or directory
! b6086fd...db1763c refs/pull/2604/merge -> origin/pr/2604/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2606/merge: No such file or directory
! 20d5c0c...d5bb314 refs/pull/2606/merge -> origin/pr/2606/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2607/merge: No such file or directory
! 9c1b65b...77bc015 refs/pull/2607/merge -> origin/pr/2607/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2608/merge: No such file or directory
! 4aac841...0a79e06 refs/pull/2608/merge -> origin/pr/2608/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2609/merge: No such file or directory
! 06c64e4...c596646 refs/pull/2609/merge -> origin/pr/2609/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2611/merge: No such file or directory
! d8747f5...cb24c79 refs/pull/2611/merge -> origin/pr/2611/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2612/head: No such file or directory
! 1fbab77...43c6c3a refs/pull/2612/head -> origin/pr/2612/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2612/merge: No such file or directory
! 063960f...071e347 refs/pull/2612/merge -> origin/pr/2612/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2615/merge: No such file or directory
! 905ac4d...66b12ee refs/pull/2615/merge -> origin/pr/2615/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2617/merge: No such file or directory
! 43412f1...fcaa4c1 refs/pull/2617/merge -> origin/pr/2617/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2620/merge: No such file or directory
! 8e44ad3...94305ad refs/pull/2620/merge -> origin/pr/2620/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2622/merge: No such file or directory
! bad5814...88414bb refs/pull/2622/merge -> origin/pr/2622/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2625/merge: No such file or directory
! 181104c...f8009ae refs/pull/2625/merge -> origin/pr/2625/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2626/head: No such file or directory
! 7365423...6d4aeab refs/pull/2626/head -> origin/pr/2626/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2626/merge: No such file or directory
! a20a922...f253a9a refs/pull/2626/merge -> origin/pr/2626/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2627/merge: No such file or directory
! 750ee4a...c0125ba refs/pull/2627/merge -> origin/pr/2627/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2629/merge: No such file or directory
! 96be125...94801ef refs/pull/2629/merge -> origin/pr/2629/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2630/merge: No such file or directory
! f558484...7cc8e95 refs/pull/2630/merge -> origin/pr/2630/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2631/merge: No such file or directory
! 54713d3...0373f59 refs/pull/2631/merge -> origin/pr/2631/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2632/head: No such file or directory
! f4f94db..c040104 refs/pull/2632/head -> origin/pr/2632/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2632/merge: No such file or directory
! 8bd47d1...8fb02b8 refs/pull/2632/merge -> origin/pr/2632/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2633/merge: No such file or directory
! c0af0a3...e0d3a93 refs/pull/2633/merge -> origin/pr/2633/merge (unable to update local ref)
* [new ref] refs/pull/2634/head -> origin/pr/2634/head
* [new ref] refs/pull/2634/merge -> origin/pr/2634/merge
* [new ref] refs/pull/2635/head -> origin/pr/2635/head
* [new ref] refs/pull/2636/head -> origin/pr/2636/head
* [new ref] refs/pull/2636/merge -> origin/pr/2636/merge
* [new ref] refs/pull/2637/head -> origin/pr/2637/head
* [new ref] refs/pull/2637/merge -> origin/pr/2637/merge
* [new ref] refs/pull/2638/head -> origin/pr/2638/head
* [new ref] refs/pull/2638/merge -> origin/pr/2638/merge
* [new ref] refs/pull/2639/head -> origin/pr/2639/head
* [new ref] refs/pull/2639/merge -> origin/pr/2639/merge
* [new ref] refs/pull/2640/head -> origin/pr/2640/head
* [new ref] refs/pull/2640/merge -> origin/pr/2640/merge
* [new ref] refs/pull/2641/head -> origin/pr/2641/head
* [new ref] refs/pull/2641/merge -> origin/pr/2641/merge
* [new ref] refs/pull/2642/head -> origin/pr/2642/head
* [new ref] refs/pull/2642/merge -> origin/pr/2642/merge
* [new ref] refs/pull/2643/head -> origin/pr/2643/head
* [new ref] refs/pull/2643/merge -> origin/pr/2643/merge
* [new ref] refs/pull/2644/head -> origin/pr/2644/head
* [new ref] refs/pull/2644/merge -> origin/pr/2644/merge
* [new ref] refs/pull/2645/head -> origin/pr/2645/head
* [new ref] refs/pull/2645/merge -> origin/pr/2645/merge
* [new ref] refs/pull/2646/head -> origin/pr/2646/head
* [new ref] refs/pull/2646/merge -> origin/pr/2646/merge
* [new ref] refs/pull/2647/head -> origin/pr/2647/head
* [new ref] refs/pull/2647/merge -> origin/pr/2647/merge
* [new ref] refs/pull/2648/head -> origin/pr/2648/head
* [new ref] refs/pull/2648/merge -> origin/pr/2648/merge
* [new ref] refs/pull/2649/head -> origin/pr/2649/head
* [new ref] refs/pull/2649/merge -> origin/pr/2649/merge
* [new ref] refs/pull/2650/head -> origin/pr/2650/head
* [new ref] refs/pull/2650/merge -> origin/pr/2650/merge
* [new ref] refs/pull/2651/head -> origin/pr/2651/head
* [new ref] refs/pull/2651/merge -> origin/pr/2651/merge
* [new ref] refs/pull/2652/head -> origin/pr/2652/head
* [new ref] refs/pull/2652/merge -> origin/pr/2652/merge
* [new ref] refs/pull/2653/head -> origin/pr/2653/head
* [new ref] refs/pull/2653/merge -> origin/pr/2653/merge
* [new ref] refs/pull/2654/head -> origin/pr/2654/head
* [new ref] refs/pull/2654/merge -> origin/pr/2654/merge
* [new ref] refs/pull/2655/head -> origin/pr/2655/head
* [new ref] refs/pull/2655/merge -> origin/pr/2655/merge
* [new ref] refs/pull/2656/head -> origin/pr/2656/head
* [new ref] refs/pull/2656/merge -> origin/pr/2656/merge
error: unable to resolve reference refs/remotes/origin/pr/288/merge: No such file or directory
! 33b68a2...f9612e3 refs/pull/288/merge -> origin/pr/288/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/592/merge: No such file or directory
! 88fbba8...0d9a8ae refs/pull/592/merge -> origin/pr/592/merge (unable to update local ref)
Auto packing the repository for optimum performance. You may also
run "git gc" manually. See "git help gc" for more information.
warning: There are too many unreachable loose objects; run 'git prune' to remove them.
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1799)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1525)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:65)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:316)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor862.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy103.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 1dce98f0745e9c1cc4d83a7532895f2f28ec86bf (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 1dce98f0745e9c1cc4d83a7532895f2f28ec86bf
> git rev-list f3806f64f2f80d9ff04f161bb60bbfe6c663dd05 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5115482460724809902.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3477231007021095089.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson64432856848543630.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3378241908788949308.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-23 13:17:35,444 d31400d9 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/d31400d9/pkb.log
2017-04-23 13:17:35,444 d31400d9 MainThread INFO PerfKitBenchmarker version: v1.11.0-43-g6012a89
2017-04-23 13:17:35,445 d31400d9 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-23 13:17:35,977 d31400d9 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-23 13:17:36,096 d31400d9 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-23 13:17:36,098 d31400d9 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-23 13:17:36,099 d31400d9 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-23 13:17:36,105 d31400d9 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-23 13:17:36,108 d31400d9 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-23 13:17:36,118 d31400d9 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-23 13:17:36,119 d31400d9 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/d31400d9/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #336
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/336/display/redirect?page=changes>
Changes:
[klk] Inline and remove POutputValueBase
[tgroh] Improve GlobalWindow, IntervalWindow Coders
------------------------------------------
[...truncated 232.45 KB...]
x [deleted] (none) -> origin/pr/93/head
x [deleted] (none) -> origin/pr/930/head
x [deleted] (none) -> origin/pr/930/merge
x [deleted] (none) -> origin/pr/931/head
x [deleted] (none) -> origin/pr/931/merge
x [deleted] (none) -> origin/pr/932/head
x [deleted] (none) -> origin/pr/932/merge
x [deleted] (none) -> origin/pr/933/head
x [deleted] (none) -> origin/pr/933/merge
x [deleted] (none) -> origin/pr/934/head
x [deleted] (none) -> origin/pr/934/merge
x [deleted] (none) -> origin/pr/935/head
x [deleted] (none) -> origin/pr/936/head
x [deleted] (none) -> origin/pr/936/merge
x [deleted] (none) -> origin/pr/937/head
x [deleted] (none) -> origin/pr/937/merge
x [deleted] (none) -> origin/pr/938/head
x [deleted] (none) -> origin/pr/939/head
x [deleted] (none) -> origin/pr/94/head
x [deleted] (none) -> origin/pr/940/head
x [deleted] (none) -> origin/pr/940/merge
x [deleted] (none) -> origin/pr/941/head
x [deleted] (none) -> origin/pr/941/merge
x [deleted] (none) -> origin/pr/942/head
x [deleted] (none) -> origin/pr/942/merge
x [deleted] (none) -> origin/pr/943/head
x [deleted] (none) -> origin/pr/943/merge
x [deleted] (none) -> origin/pr/944/head
x [deleted] (none) -> origin/pr/945/head
x [deleted] (none) -> origin/pr/945/merge
x [deleted] (none) -> origin/pr/946/head
x [deleted] (none) -> origin/pr/946/merge
x [deleted] (none) -> origin/pr/947/head
x [deleted] (none) -> origin/pr/947/merge
x [deleted] (none) -> origin/pr/948/head
x [deleted] (none) -> origin/pr/948/merge
x [deleted] (none) -> origin/pr/949/head
x [deleted] (none) -> origin/pr/949/merge
x [deleted] (none) -> origin/pr/95/head
x [deleted] (none) -> origin/pr/95/merge
x [deleted] (none) -> origin/pr/950/head
x [deleted] (none) -> origin/pr/951/head
x [deleted] (none) -> origin/pr/951/merge
x [deleted] (none) -> origin/pr/952/head
x [deleted] (none) -> origin/pr/952/merge
x [deleted] (none) -> origin/pr/953/head
x [deleted] (none) -> origin/pr/954/head
x [deleted] (none) -> origin/pr/954/merge
x [deleted] (none) -> origin/pr/955/head
x [deleted] (none) -> origin/pr/955/merge
x [deleted] (none) -> origin/pr/956/head
x [deleted] (none) -> origin/pr/957/head
x [deleted] (none) -> origin/pr/958/head
x [deleted] (none) -> origin/pr/959/head
x [deleted] (none) -> origin/pr/959/merge
x [deleted] (none) -> origin/pr/96/head
x [deleted] (none) -> origin/pr/96/merge
x [deleted] (none) -> origin/pr/960/head
x [deleted] (none) -> origin/pr/960/merge
x [deleted] (none) -> origin/pr/961/head
x [deleted] (none) -> origin/pr/962/head
x [deleted] (none) -> origin/pr/962/merge
x [deleted] (none) -> origin/pr/963/head
x [deleted] (none) -> origin/pr/963/merge
x [deleted] (none) -> origin/pr/964/head
x [deleted] (none) -> origin/pr/965/head
x [deleted] (none) -> origin/pr/965/merge
x [deleted] (none) -> origin/pr/966/head
x [deleted] (none) -> origin/pr/967/head
x [deleted] (none) -> origin/pr/967/merge
x [deleted] (none) -> origin/pr/968/head
x [deleted] (none) -> origin/pr/968/merge
x [deleted] (none) -> origin/pr/969/head
x [deleted] (none) -> origin/pr/969/merge
x [deleted] (none) -> origin/pr/97/head
x [deleted] (none) -> origin/pr/97/merge
x [deleted] (none) -> origin/pr/970/head
x [deleted] (none) -> origin/pr/970/merge
x [deleted] (none) -> origin/pr/971/head
x [deleted] (none) -> origin/pr/971/merge
x [deleted] (none) -> origin/pr/972/head
x [deleted] (none) -> origin/pr/973/head
x [deleted] (none) -> origin/pr/974/head
x [deleted] (none) -> origin/pr/974/merge
x [deleted] (none) -> origin/pr/975/head
x [deleted] (none) -> origin/pr/975/merge
x [deleted] (none) -> origin/pr/976/head
x [deleted] (none) -> origin/pr/976/merge
x [deleted] (none) -> origin/pr/977/head
x [deleted] (none) -> origin/pr/977/merge
x [deleted] (none) -> origin/pr/978/head
x [deleted] (none) -> origin/pr/978/merge
x [deleted] (none) -> origin/pr/979/head
x [deleted] (none) -> origin/pr/979/merge
x [deleted] (none) -> origin/pr/98/head
x [deleted] (none) -> origin/pr/980/head
x [deleted] (none) -> origin/pr/980/merge
x [deleted] (none) -> origin/pr/981/head
x [deleted] (none) -> origin/pr/982/head
x [deleted] (none) -> origin/pr/982/merge
x [deleted] (none) -> origin/pr/983/head
x [deleted] (none) -> origin/pr/983/merge
x [deleted] (none) -> origin/pr/984/head
x [deleted] (none) -> origin/pr/984/merge
x [deleted] (none) -> origin/pr/985/head
x [deleted] (none) -> origin/pr/985/merge
x [deleted] (none) -> origin/pr/986/head
x [deleted] (none) -> origin/pr/986/merge
x [deleted] (none) -> origin/pr/987/head
x [deleted] (none) -> origin/pr/988/head
x [deleted] (none) -> origin/pr/988/merge
x [deleted] (none) -> origin/pr/989/head
x [deleted] (none) -> origin/pr/989/merge
x [deleted] (none) -> origin/pr/99/head
x [deleted] (none) -> origin/pr/99/merge
x [deleted] (none) -> origin/pr/990/head
x [deleted] (none) -> origin/pr/990/merge
x [deleted] (none) -> origin/pr/991/head
x [deleted] (none) -> origin/pr/991/merge
x [deleted] (none) -> origin/pr/992/head
x [deleted] (none) -> origin/pr/992/merge
x [deleted] (none) -> origin/pr/993/head
x [deleted] (none) -> origin/pr/993/merge
x [deleted] (none) -> origin/pr/994/head
x [deleted] (none) -> origin/pr/994/merge
x [deleted] (none) -> origin/pr/995/head
x [deleted] (none) -> origin/pr/995/merge
x [deleted] (none) -> origin/pr/996/head
x [deleted] (none) -> origin/pr/996/merge
x [deleted] (none) -> origin/pr/997/head
x [deleted] (none) -> origin/pr/997/merge
x [deleted] (none) -> origin/pr/998/head
x [deleted] (none) -> origin/pr/999/head
x [deleted] (none) -> origin/pr/999/merge
error: RPC failed; result=18, HTTP code = 200
fatal: The remote end hung up unexpectedly
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1799)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1525)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:65)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:316)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor862.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy103.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision f3806f64f2f80d9ff04f161bb60bbfe6c663dd05 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f f3806f64f2f80d9ff04f161bb60bbfe6c663dd05
> git rev-list 8160924e12a4723df34209a04c907d4f95466ecf # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson8714472946511256926.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson1848932547714709924.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2766001969086583293.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3630428433477182461.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-21 18:01:49,081 570bf0bd MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/570bf0bd/pkb.log
2017-04-21 18:01:49,081 570bf0bd MainThread INFO PerfKitBenchmarker version: v1.11.0-43-g6012a89
2017-04-21 18:01:49,082 570bf0bd MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-21 18:01:49,420 570bf0bd MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-21 18:01:49,498 570bf0bd MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-21 18:01:49,500 570bf0bd MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-21 18:01:49,501 570bf0bd MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-21 18:01:49,504 570bf0bd MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-21 18:01:49,506 570bf0bd MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-21 18:01:49,536 570bf0bd MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-21 18:01:49,537 570bf0bd MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/570bf0bd/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #335
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/335/display/redirect?page=changes>
Changes:
[aljoscha.krettek] [BEAM-773] Implement Metrics support for Flink runner
[aljoscha.krettek] Add IO metrics to Flink runner
[aljoscha.krettek] Ensure all Read outputs are consumed in Flink runner
------------------------------------------
[...truncated 264.67 KB...]
* [new ref] refs/pull/2558/head -> origin/pr/2558/head
* [new ref] refs/pull/2558/merge -> origin/pr/2558/merge
* [new ref] refs/pull/2559/head -> origin/pr/2559/head
* [new ref] refs/pull/2559/merge -> origin/pr/2559/merge
* [new ref] refs/pull/2560/head -> origin/pr/2560/head
* [new ref] refs/pull/2560/merge -> origin/pr/2560/merge
* [new ref] refs/pull/2561/head -> origin/pr/2561/head
* [new ref] refs/pull/2561/merge -> origin/pr/2561/merge
* [new ref] refs/pull/2562/head -> origin/pr/2562/head
* [new ref] refs/pull/2562/merge -> origin/pr/2562/merge
* [new ref] refs/pull/2563/head -> origin/pr/2563/head
* [new ref] refs/pull/2564/head -> origin/pr/2564/head
* [new ref] refs/pull/2564/merge -> origin/pr/2564/merge
* [new ref] refs/pull/2565/head -> origin/pr/2565/head
* [new ref] refs/pull/2565/merge -> origin/pr/2565/merge
* [new ref] refs/pull/2566/head -> origin/pr/2566/head
* [new ref] refs/pull/2566/merge -> origin/pr/2566/merge
* [new ref] refs/pull/2567/head -> origin/pr/2567/head
* [new ref] refs/pull/2567/merge -> origin/pr/2567/merge
* [new ref] refs/pull/2568/head -> origin/pr/2568/head
* [new ref] refs/pull/2569/head -> origin/pr/2569/head
* [new ref] refs/pull/2569/merge -> origin/pr/2569/merge
* [new ref] refs/pull/2570/head -> origin/pr/2570/head
* [new ref] refs/pull/2570/merge -> origin/pr/2570/merge
* [new ref] refs/pull/2571/head -> origin/pr/2571/head
* [new ref] refs/pull/2571/merge -> origin/pr/2571/merge
* [new ref] refs/pull/2572/head -> origin/pr/2572/head
* [new ref] refs/pull/2572/merge -> origin/pr/2572/merge
* [new ref] refs/pull/2573/head -> origin/pr/2573/head
* [new ref] refs/pull/2573/merge -> origin/pr/2573/merge
* [new ref] refs/pull/2574/head -> origin/pr/2574/head
* [new ref] refs/pull/2575/head -> origin/pr/2575/head
* [new ref] refs/pull/2575/merge -> origin/pr/2575/merge
* [new ref] refs/pull/2576/head -> origin/pr/2576/head
* [new ref] refs/pull/2577/head -> origin/pr/2577/head
* [new ref] refs/pull/2577/merge -> origin/pr/2577/merge
* [new ref] refs/pull/2578/head -> origin/pr/2578/head
* [new ref] refs/pull/2578/merge -> origin/pr/2578/merge
* [new ref] refs/pull/2579/head -> origin/pr/2579/head
* [new ref] refs/pull/2579/merge -> origin/pr/2579/merge
* [new ref] refs/pull/2580/head -> origin/pr/2580/head
* [new ref] refs/pull/2581/head -> origin/pr/2581/head
* [new ref] refs/pull/2581/merge -> origin/pr/2581/merge
* [new ref] refs/pull/2582/head -> origin/pr/2582/head
* [new ref] refs/pull/2582/merge -> origin/pr/2582/merge
* [new ref] refs/pull/2583/head -> origin/pr/2583/head
* [new ref] refs/pull/2583/merge -> origin/pr/2583/merge
* [new ref] refs/pull/2584/head -> origin/pr/2584/head
* [new ref] refs/pull/2585/head -> origin/pr/2585/head
* [new ref] refs/pull/2585/merge -> origin/pr/2585/merge
* [new ref] refs/pull/2586/head -> origin/pr/2586/head
* [new ref] refs/pull/2586/merge -> origin/pr/2586/merge
* [new ref] refs/pull/2587/head -> origin/pr/2587/head
* [new ref] refs/pull/2587/merge -> origin/pr/2587/merge
* [new ref] refs/pull/2588/head -> origin/pr/2588/head
* [new ref] refs/pull/2589/head -> origin/pr/2589/head
* [new ref] refs/pull/2589/merge -> origin/pr/2589/merge
* [new ref] refs/pull/2590/head -> origin/pr/2590/head
* [new ref] refs/pull/2590/merge -> origin/pr/2590/merge
* [new ref] refs/pull/2591/head -> origin/pr/2591/head
* [new ref] refs/pull/2591/merge -> origin/pr/2591/merge
* [new ref] refs/pull/2592/head -> origin/pr/2592/head
* [new ref] refs/pull/2592/merge -> origin/pr/2592/merge
* [new ref] refs/pull/2593/head -> origin/pr/2593/head
* [new ref] refs/pull/2593/merge -> origin/pr/2593/merge
* [new ref] refs/pull/2594/head -> origin/pr/2594/head
* [new ref] refs/pull/2594/merge -> origin/pr/2594/merge
* [new ref] refs/pull/2595/head -> origin/pr/2595/head
* [new ref] refs/pull/2595/merge -> origin/pr/2595/merge
* [new ref] refs/pull/2596/head -> origin/pr/2596/head
* [new ref] refs/pull/2596/merge -> origin/pr/2596/merge
* [new ref] refs/pull/2597/head -> origin/pr/2597/head
* [new ref] refs/pull/2597/merge -> origin/pr/2597/merge
* [new ref] refs/pull/2598/head -> origin/pr/2598/head
* [new ref] refs/pull/2598/merge -> origin/pr/2598/merge
* [new ref] refs/pull/2599/head -> origin/pr/2599/head
* [new ref] refs/pull/2599/merge -> origin/pr/2599/merge
* [new ref] refs/pull/2600/head -> origin/pr/2600/head
* [new ref] refs/pull/2600/merge -> origin/pr/2600/merge
* [new ref] refs/pull/2601/head -> origin/pr/2601/head
* [new ref] refs/pull/2601/merge -> origin/pr/2601/merge
* [new ref] refs/pull/2602/head -> origin/pr/2602/head
* [new ref] refs/pull/2602/merge -> origin/pr/2602/merge
* [new ref] refs/pull/2603/head -> origin/pr/2603/head
* [new ref] refs/pull/2603/merge -> origin/pr/2603/merge
* [new ref] refs/pull/2604/head -> origin/pr/2604/head
* [new ref] refs/pull/2604/merge -> origin/pr/2604/merge
* [new ref] refs/pull/2605/head -> origin/pr/2605/head
* [new ref] refs/pull/2605/merge -> origin/pr/2605/merge
* [new ref] refs/pull/2606/head -> origin/pr/2606/head
* [new ref] refs/pull/2606/merge -> origin/pr/2606/merge
* [new ref] refs/pull/2607/head -> origin/pr/2607/head
* [new ref] refs/pull/2607/merge -> origin/pr/2607/merge
* [new ref] refs/pull/2608/head -> origin/pr/2608/head
* [new ref] refs/pull/2608/merge -> origin/pr/2608/merge
* [new ref] refs/pull/2609/head -> origin/pr/2609/head
* [new ref] refs/pull/2609/merge -> origin/pr/2609/merge
* [new ref] refs/pull/2610/head -> origin/pr/2610/head
* [new ref] refs/pull/2610/merge -> origin/pr/2610/merge
* [new ref] refs/pull/2611/head -> origin/pr/2611/head
* [new ref] refs/pull/2611/merge -> origin/pr/2611/merge
* [new ref] refs/pull/2612/head -> origin/pr/2612/head
* [new ref] refs/pull/2612/merge -> origin/pr/2612/merge
* [new ref] refs/pull/2613/head -> origin/pr/2613/head
* [new ref] refs/pull/2614/head -> origin/pr/2614/head
* [new ref] refs/pull/2615/head -> origin/pr/2615/head
* [new ref] refs/pull/2615/merge -> origin/pr/2615/merge
* [new ref] refs/pull/2616/head -> origin/pr/2616/head
* [new ref] refs/pull/2616/merge -> origin/pr/2616/merge
* [new ref] refs/pull/2617/head -> origin/pr/2617/head
* [new ref] refs/pull/2617/merge -> origin/pr/2617/merge
* [new ref] refs/pull/2618/head -> origin/pr/2618/head
* [new ref] refs/pull/2619/head -> origin/pr/2619/head
* [new ref] refs/pull/2619/merge -> origin/pr/2619/merge
* [new ref] refs/pull/2620/head -> origin/pr/2620/head
* [new ref] refs/pull/2620/merge -> origin/pr/2620/merge
* [new ref] refs/pull/2621/head -> origin/pr/2621/head
* [new ref] refs/pull/2621/merge -> origin/pr/2621/merge
* [new ref] refs/pull/2622/head -> origin/pr/2622/head
* [new ref] refs/pull/2622/merge -> origin/pr/2622/merge
* [new ref] refs/pull/2623/head -> origin/pr/2623/head
* [new ref] refs/pull/2623/merge -> origin/pr/2623/merge
* [new ref] refs/pull/2624/head -> origin/pr/2624/head
* [new ref] refs/pull/2625/head -> origin/pr/2625/head
* [new ref] refs/pull/2625/merge -> origin/pr/2625/merge
* [new ref] refs/pull/2626/head -> origin/pr/2626/head
* [new ref] refs/pull/2626/merge -> origin/pr/2626/merge
* [new ref] refs/pull/2627/head -> origin/pr/2627/head
* [new ref] refs/pull/2627/merge -> origin/pr/2627/merge
* [new ref] refs/pull/2628/head -> origin/pr/2628/head
* [new ref] refs/pull/2628/merge -> origin/pr/2628/merge
error: unable to resolve reference refs/remotes/origin/pr/592/merge: No such file or directory
! 2ecab23...856bade refs/pull/592/merge -> origin/pr/592/merge (unable to update local ref)
Auto packing the repository for optimum performance. You may also
run "git gc" manually. See "git help gc" for more information.
warning: There are too many unreachable loose objects; run 'git prune' to remove them.
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1799)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1525)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:65)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:316)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor862.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy103.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 8160924e12a4723df34209a04c907d4f95466ecf (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 8160924e12a4723df34209a04c907d4f95466ecf
> git rev-list b3827955e3898b5f39d5b45db40c884b92cd3cef # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson1736839190964272974.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4261684650816203298.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson6450516308736435345.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4295639915615809346.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-21 12:02:40,509 fde62082 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/fde62082/pkb.log
2017-04-21 12:02:40,509 fde62082 MainThread INFO PerfKitBenchmarker version: v1.11.0-43-g6012a89
2017-04-21 12:02:40,510 fde62082 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-21 12:02:40,689 fde62082 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-21 12:02:40,784 fde62082 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-21 12:02:40,786 fde62082 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-21 12:02:40,786 fde62082 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-21 12:02:40,791 fde62082 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-21 12:02:40,793 fde62082 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-21 12:02:40,820 fde62082 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-21 12:02:40,821 fde62082 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/fde62082/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #334
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/334/display/redirect?page=changes>
Changes:
[klk] Make crashing errors in Structs unchecked exceptions
[klk] Derive Dataflow output names from steps, not PCollection names
[dhalperi] [BEAM-2012] Remove BoundedSource.splitIntoBundles for real
[dhalperi] Upgrade autovalue
[altay] Fix GCP import check in bigquery.py
------------------------------------------
[...truncated 272.29 KB...]
* [new ref] refs/pull/2557/head -> origin/pr/2557/head
* [new ref] refs/pull/2557/merge -> origin/pr/2557/merge
* [new ref] refs/pull/2558/head -> origin/pr/2558/head
* [new ref] refs/pull/2558/merge -> origin/pr/2558/merge
* [new ref] refs/pull/2559/head -> origin/pr/2559/head
* [new ref] refs/pull/2559/merge -> origin/pr/2559/merge
* [new ref] refs/pull/2560/head -> origin/pr/2560/head
* [new ref] refs/pull/2560/merge -> origin/pr/2560/merge
* [new ref] refs/pull/2561/head -> origin/pr/2561/head
* [new ref] refs/pull/2561/merge -> origin/pr/2561/merge
* [new ref] refs/pull/2562/head -> origin/pr/2562/head
* [new ref] refs/pull/2562/merge -> origin/pr/2562/merge
* [new ref] refs/pull/2563/head -> origin/pr/2563/head
* [new ref] refs/pull/2564/head -> origin/pr/2564/head
* [new ref] refs/pull/2564/merge -> origin/pr/2564/merge
* [new ref] refs/pull/2565/head -> origin/pr/2565/head
* [new ref] refs/pull/2565/merge -> origin/pr/2565/merge
* [new ref] refs/pull/2566/head -> origin/pr/2566/head
* [new ref] refs/pull/2566/merge -> origin/pr/2566/merge
* [new ref] refs/pull/2567/head -> origin/pr/2567/head
* [new ref] refs/pull/2567/merge -> origin/pr/2567/merge
* [new ref] refs/pull/2568/head -> origin/pr/2568/head
* [new ref] refs/pull/2569/head -> origin/pr/2569/head
* [new ref] refs/pull/2569/merge -> origin/pr/2569/merge
* [new ref] refs/pull/2570/head -> origin/pr/2570/head
* [new ref] refs/pull/2570/merge -> origin/pr/2570/merge
* [new ref] refs/pull/2571/head -> origin/pr/2571/head
* [new ref] refs/pull/2571/merge -> origin/pr/2571/merge
* [new ref] refs/pull/2572/head -> origin/pr/2572/head
* [new ref] refs/pull/2572/merge -> origin/pr/2572/merge
* [new ref] refs/pull/2573/head -> origin/pr/2573/head
* [new ref] refs/pull/2573/merge -> origin/pr/2573/merge
* [new ref] refs/pull/2574/head -> origin/pr/2574/head
* [new ref] refs/pull/2575/head -> origin/pr/2575/head
* [new ref] refs/pull/2575/merge -> origin/pr/2575/merge
* [new ref] refs/pull/2576/head -> origin/pr/2576/head
* [new ref] refs/pull/2577/head -> origin/pr/2577/head
* [new ref] refs/pull/2577/merge -> origin/pr/2577/merge
* [new ref] refs/pull/2578/head -> origin/pr/2578/head
* [new ref] refs/pull/2578/merge -> origin/pr/2578/merge
* [new ref] refs/pull/2579/head -> origin/pr/2579/head
* [new ref] refs/pull/2579/merge -> origin/pr/2579/merge
* [new ref] refs/pull/2580/head -> origin/pr/2580/head
* [new ref] refs/pull/2581/head -> origin/pr/2581/head
* [new ref] refs/pull/2581/merge -> origin/pr/2581/merge
* [new ref] refs/pull/2582/head -> origin/pr/2582/head
* [new ref] refs/pull/2582/merge -> origin/pr/2582/merge
* [new ref] refs/pull/2583/head -> origin/pr/2583/head
* [new ref] refs/pull/2583/merge -> origin/pr/2583/merge
* [new ref] refs/pull/2584/head -> origin/pr/2584/head
* [new ref] refs/pull/2585/head -> origin/pr/2585/head
* [new ref] refs/pull/2585/merge -> origin/pr/2585/merge
* [new ref] refs/pull/2586/head -> origin/pr/2586/head
* [new ref] refs/pull/2586/merge -> origin/pr/2586/merge
* [new ref] refs/pull/2587/head -> origin/pr/2587/head
* [new ref] refs/pull/2587/merge -> origin/pr/2587/merge
* [new ref] refs/pull/2588/head -> origin/pr/2588/head
* [new ref] refs/pull/2589/head -> origin/pr/2589/head
* [new ref] refs/pull/2589/merge -> origin/pr/2589/merge
* [new ref] refs/pull/2590/head -> origin/pr/2590/head
* [new ref] refs/pull/2590/merge -> origin/pr/2590/merge
* [new ref] refs/pull/2591/head -> origin/pr/2591/head
* [new ref] refs/pull/2591/merge -> origin/pr/2591/merge
* [new ref] refs/pull/2592/head -> origin/pr/2592/head
* [new ref] refs/pull/2592/merge -> origin/pr/2592/merge
* [new ref] refs/pull/2593/head -> origin/pr/2593/head
* [new ref] refs/pull/2593/merge -> origin/pr/2593/merge
* [new ref] refs/pull/2594/head -> origin/pr/2594/head
* [new ref] refs/pull/2594/merge -> origin/pr/2594/merge
* [new ref] refs/pull/2595/head -> origin/pr/2595/head
* [new ref] refs/pull/2595/merge -> origin/pr/2595/merge
* [new ref] refs/pull/2596/head -> origin/pr/2596/head
* [new ref] refs/pull/2596/merge -> origin/pr/2596/merge
* [new ref] refs/pull/2597/head -> origin/pr/2597/head
* [new ref] refs/pull/2597/merge -> origin/pr/2597/merge
* [new ref] refs/pull/2598/head -> origin/pr/2598/head
* [new ref] refs/pull/2598/merge -> origin/pr/2598/merge
* [new ref] refs/pull/2599/head -> origin/pr/2599/head
* [new ref] refs/pull/2599/merge -> origin/pr/2599/merge
* [new ref] refs/pull/2600/head -> origin/pr/2600/head
* [new ref] refs/pull/2600/merge -> origin/pr/2600/merge
* [new ref] refs/pull/2601/head -> origin/pr/2601/head
* [new ref] refs/pull/2601/merge -> origin/pr/2601/merge
* [new ref] refs/pull/2602/head -> origin/pr/2602/head
* [new ref] refs/pull/2602/merge -> origin/pr/2602/merge
* [new ref] refs/pull/2603/head -> origin/pr/2603/head
* [new ref] refs/pull/2603/merge -> origin/pr/2603/merge
* [new ref] refs/pull/2604/head -> origin/pr/2604/head
* [new ref] refs/pull/2604/merge -> origin/pr/2604/merge
* [new ref] refs/pull/2605/head -> origin/pr/2605/head
* [new ref] refs/pull/2605/merge -> origin/pr/2605/merge
* [new ref] refs/pull/2606/head -> origin/pr/2606/head
* [new ref] refs/pull/2606/merge -> origin/pr/2606/merge
* [new ref] refs/pull/2607/head -> origin/pr/2607/head
* [new ref] refs/pull/2607/merge -> origin/pr/2607/merge
* [new ref] refs/pull/2608/head -> origin/pr/2608/head
* [new ref] refs/pull/2608/merge -> origin/pr/2608/merge
* [new ref] refs/pull/2609/head -> origin/pr/2609/head
* [new ref] refs/pull/2609/merge -> origin/pr/2609/merge
* [new ref] refs/pull/2610/head -> origin/pr/2610/head
* [new ref] refs/pull/2610/merge -> origin/pr/2610/merge
* [new ref] refs/pull/2611/head -> origin/pr/2611/head
* [new ref] refs/pull/2611/merge -> origin/pr/2611/merge
* [new ref] refs/pull/2612/head -> origin/pr/2612/head
* [new ref] refs/pull/2612/merge -> origin/pr/2612/merge
* [new ref] refs/pull/2613/head -> origin/pr/2613/head
* [new ref] refs/pull/2614/head -> origin/pr/2614/head
* [new ref] refs/pull/2615/head -> origin/pr/2615/head
* [new ref] refs/pull/2615/merge -> origin/pr/2615/merge
* [new ref] refs/pull/2616/head -> origin/pr/2616/head
* [new ref] refs/pull/2616/merge -> origin/pr/2616/merge
* [new ref] refs/pull/2617/head -> origin/pr/2617/head
* [new ref] refs/pull/2617/merge -> origin/pr/2617/merge
* [new ref] refs/pull/2618/head -> origin/pr/2618/head
* [new ref] refs/pull/2619/head -> origin/pr/2619/head
* [new ref] refs/pull/2619/merge -> origin/pr/2619/merge
* [new ref] refs/pull/2620/head -> origin/pr/2620/head
* [new ref] refs/pull/2620/merge -> origin/pr/2620/merge
* [new ref] refs/pull/2621/head -> origin/pr/2621/head
* [new ref] refs/pull/2621/merge -> origin/pr/2621/merge
* [new ref] refs/pull/2622/head -> origin/pr/2622/head
* [new ref] refs/pull/2622/merge -> origin/pr/2622/merge
* [new ref] refs/pull/2623/head -> origin/pr/2623/head
* [new ref] refs/pull/2623/merge -> origin/pr/2623/merge
* [new ref] refs/pull/2624/head -> origin/pr/2624/head
* [new ref] refs/pull/2625/head -> origin/pr/2625/head
* [new ref] refs/pull/2625/merge -> origin/pr/2625/merge
* [new ref] refs/pull/2626/head -> origin/pr/2626/head
* [new ref] refs/pull/2626/merge -> origin/pr/2626/merge
* [new ref] refs/pull/2627/head -> origin/pr/2627/head
* [new ref] refs/pull/2627/merge -> origin/pr/2627/merge
error: unable to resolve reference refs/remotes/origin/pr/592/merge: No such file or directory
! c595f6e...2ecab23 refs/pull/592/merge -> origin/pr/592/merge (unable to update local ref)
Auto packing the repository for optimum performance. You may also
run "git gc" manually. See "git help gc" for more information.
warning: There are too many unreachable loose objects; run 'git prune' to remove them.
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1799)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1525)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:65)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:316)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor862.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy103.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision b3827955e3898b5f39d5b45db40c884b92cd3cef (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f b3827955e3898b5f39d5b45db40c884b92cd3cef
> git rev-list 524165ac95d01e6c4e4b97911e5e4cce78677a93 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4192513743201487707.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2598521639352903674.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson8704712167288035670.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson6204150598789171428.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-21 06:02:09,245 bbfe7ede MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/bbfe7ede/pkb.log
2017-04-21 06:02:09,245 bbfe7ede MainThread INFO PerfKitBenchmarker version: v1.11.0-43-g6012a89
2017-04-21 06:02:09,245 bbfe7ede MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-21 06:02:09,595 bbfe7ede MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-21 06:02:09,674 bbfe7ede MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-21 06:02:09,676 bbfe7ede MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-21 06:02:09,676 bbfe7ede MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-21 06:02:09,680 bbfe7ede MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-21 06:02:09,682 bbfe7ede MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-21 06:02:09,712 bbfe7ede MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-21 06:02:09,712 bbfe7ede MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/bbfe7ede/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #333
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/333/display/redirect?page=changes>
Changes:
[dhalperi] Add javadoc to the Metric interfaces
[dhalperi] Fix javadoc typo
[klk] Remove Sink in favor of FileBasedSink
[lcwik] [BEAM-1786, BEAM-1871] Add the ability to register coder factories for
[lcwik] [BEAM-1871] Move over GcsPath to gcp-core
[dhalperi] [BEAM-59] FileBasedSource: convert to FileSystem
[kirpichov] [BEAM-1992] Move Count.PerElement javadoc to a public place
[kirpichov] Fix erroneous use of .expand() in KafkaIO
[altay] Remove _unused_options_id
------------------------------------------
[...truncated 268.19 KB...]
* [new ref] refs/pull/2551/head -> origin/pr/2551/head
* [new ref] refs/pull/2551/merge -> origin/pr/2551/merge
* [new ref] refs/pull/2552/head -> origin/pr/2552/head
* [new ref] refs/pull/2552/merge -> origin/pr/2552/merge
* [new ref] refs/pull/2553/head -> origin/pr/2553/head
* [new ref] refs/pull/2553/merge -> origin/pr/2553/merge
* [new ref] refs/pull/2554/head -> origin/pr/2554/head
* [new ref] refs/pull/2554/merge -> origin/pr/2554/merge
* [new ref] refs/pull/2555/head -> origin/pr/2555/head
* [new ref] refs/pull/2555/merge -> origin/pr/2555/merge
* [new ref] refs/pull/2556/head -> origin/pr/2556/head
* [new ref] refs/pull/2556/merge -> origin/pr/2556/merge
* [new ref] refs/pull/2557/head -> origin/pr/2557/head
* [new ref] refs/pull/2557/merge -> origin/pr/2557/merge
* [new ref] refs/pull/2558/head -> origin/pr/2558/head
* [new ref] refs/pull/2558/merge -> origin/pr/2558/merge
* [new ref] refs/pull/2559/head -> origin/pr/2559/head
* [new ref] refs/pull/2559/merge -> origin/pr/2559/merge
* [new ref] refs/pull/2560/head -> origin/pr/2560/head
* [new ref] refs/pull/2560/merge -> origin/pr/2560/merge
* [new ref] refs/pull/2561/head -> origin/pr/2561/head
* [new ref] refs/pull/2561/merge -> origin/pr/2561/merge
* [new ref] refs/pull/2562/head -> origin/pr/2562/head
* [new ref] refs/pull/2562/merge -> origin/pr/2562/merge
* [new ref] refs/pull/2563/head -> origin/pr/2563/head
* [new ref] refs/pull/2564/head -> origin/pr/2564/head
* [new ref] refs/pull/2564/merge -> origin/pr/2564/merge
* [new ref] refs/pull/2565/head -> origin/pr/2565/head
* [new ref] refs/pull/2565/merge -> origin/pr/2565/merge
* [new ref] refs/pull/2566/head -> origin/pr/2566/head
* [new ref] refs/pull/2566/merge -> origin/pr/2566/merge
* [new ref] refs/pull/2567/head -> origin/pr/2567/head
* [new ref] refs/pull/2567/merge -> origin/pr/2567/merge
* [new ref] refs/pull/2568/head -> origin/pr/2568/head
* [new ref] refs/pull/2569/head -> origin/pr/2569/head
* [new ref] refs/pull/2569/merge -> origin/pr/2569/merge
* [new ref] refs/pull/2570/head -> origin/pr/2570/head
* [new ref] refs/pull/2570/merge -> origin/pr/2570/merge
* [new ref] refs/pull/2571/head -> origin/pr/2571/head
* [new ref] refs/pull/2571/merge -> origin/pr/2571/merge
* [new ref] refs/pull/2572/head -> origin/pr/2572/head
* [new ref] refs/pull/2572/merge -> origin/pr/2572/merge
* [new ref] refs/pull/2573/head -> origin/pr/2573/head
* [new ref] refs/pull/2573/merge -> origin/pr/2573/merge
* [new ref] refs/pull/2574/head -> origin/pr/2574/head
* [new ref] refs/pull/2575/head -> origin/pr/2575/head
* [new ref] refs/pull/2575/merge -> origin/pr/2575/merge
* [new ref] refs/pull/2576/head -> origin/pr/2576/head
* [new ref] refs/pull/2577/head -> origin/pr/2577/head
* [new ref] refs/pull/2577/merge -> origin/pr/2577/merge
* [new ref] refs/pull/2578/head -> origin/pr/2578/head
* [new ref] refs/pull/2578/merge -> origin/pr/2578/merge
* [new ref] refs/pull/2579/head -> origin/pr/2579/head
* [new ref] refs/pull/2579/merge -> origin/pr/2579/merge
* [new ref] refs/pull/2580/head -> origin/pr/2580/head
* [new ref] refs/pull/2581/head -> origin/pr/2581/head
* [new ref] refs/pull/2581/merge -> origin/pr/2581/merge
* [new ref] refs/pull/2582/head -> origin/pr/2582/head
* [new ref] refs/pull/2582/merge -> origin/pr/2582/merge
* [new ref] refs/pull/2583/head -> origin/pr/2583/head
* [new ref] refs/pull/2583/merge -> origin/pr/2583/merge
* [new ref] refs/pull/2584/head -> origin/pr/2584/head
* [new ref] refs/pull/2585/head -> origin/pr/2585/head
* [new ref] refs/pull/2585/merge -> origin/pr/2585/merge
* [new ref] refs/pull/2586/head -> origin/pr/2586/head
* [new ref] refs/pull/2586/merge -> origin/pr/2586/merge
* [new ref] refs/pull/2587/head -> origin/pr/2587/head
* [new ref] refs/pull/2587/merge -> origin/pr/2587/merge
* [new ref] refs/pull/2588/head -> origin/pr/2588/head
* [new ref] refs/pull/2589/head -> origin/pr/2589/head
* [new ref] refs/pull/2589/merge -> origin/pr/2589/merge
* [new ref] refs/pull/2590/head -> origin/pr/2590/head
* [new ref] refs/pull/2590/merge -> origin/pr/2590/merge
* [new ref] refs/pull/2591/head -> origin/pr/2591/head
* [new ref] refs/pull/2591/merge -> origin/pr/2591/merge
* [new ref] refs/pull/2592/head -> origin/pr/2592/head
* [new ref] refs/pull/2592/merge -> origin/pr/2592/merge
* [new ref] refs/pull/2593/head -> origin/pr/2593/head
* [new ref] refs/pull/2593/merge -> origin/pr/2593/merge
* [new ref] refs/pull/2594/head -> origin/pr/2594/head
* [new ref] refs/pull/2594/merge -> origin/pr/2594/merge
* [new ref] refs/pull/2595/head -> origin/pr/2595/head
* [new ref] refs/pull/2595/merge -> origin/pr/2595/merge
* [new ref] refs/pull/2596/head -> origin/pr/2596/head
* [new ref] refs/pull/2596/merge -> origin/pr/2596/merge
* [new ref] refs/pull/2597/head -> origin/pr/2597/head
* [new ref] refs/pull/2597/merge -> origin/pr/2597/merge
* [new ref] refs/pull/2598/head -> origin/pr/2598/head
* [new ref] refs/pull/2598/merge -> origin/pr/2598/merge
* [new ref] refs/pull/2599/head -> origin/pr/2599/head
* [new ref] refs/pull/2599/merge -> origin/pr/2599/merge
* [new ref] refs/pull/2600/head -> origin/pr/2600/head
* [new ref] refs/pull/2600/merge -> origin/pr/2600/merge
* [new ref] refs/pull/2601/head -> origin/pr/2601/head
* [new ref] refs/pull/2601/merge -> origin/pr/2601/merge
* [new ref] refs/pull/2602/head -> origin/pr/2602/head
* [new ref] refs/pull/2602/merge -> origin/pr/2602/merge
* [new ref] refs/pull/2603/head -> origin/pr/2603/head
* [new ref] refs/pull/2603/merge -> origin/pr/2603/merge
* [new ref] refs/pull/2604/head -> origin/pr/2604/head
* [new ref] refs/pull/2604/merge -> origin/pr/2604/merge
* [new ref] refs/pull/2605/head -> origin/pr/2605/head
* [new ref] refs/pull/2605/merge -> origin/pr/2605/merge
* [new ref] refs/pull/2606/head -> origin/pr/2606/head
* [new ref] refs/pull/2606/merge -> origin/pr/2606/merge
* [new ref] refs/pull/2607/head -> origin/pr/2607/head
* [new ref] refs/pull/2607/merge -> origin/pr/2607/merge
* [new ref] refs/pull/2608/head -> origin/pr/2608/head
* [new ref] refs/pull/2608/merge -> origin/pr/2608/merge
* [new ref] refs/pull/2609/head -> origin/pr/2609/head
* [new ref] refs/pull/2609/merge -> origin/pr/2609/merge
* [new ref] refs/pull/2610/head -> origin/pr/2610/head
* [new ref] refs/pull/2610/merge -> origin/pr/2610/merge
* [new ref] refs/pull/2611/head -> origin/pr/2611/head
* [new ref] refs/pull/2611/merge -> origin/pr/2611/merge
* [new ref] refs/pull/2612/head -> origin/pr/2612/head
* [new ref] refs/pull/2612/merge -> origin/pr/2612/merge
* [new ref] refs/pull/2613/head -> origin/pr/2613/head
* [new ref] refs/pull/2614/head -> origin/pr/2614/head
* [new ref] refs/pull/2615/head -> origin/pr/2615/head
* [new ref] refs/pull/2615/merge -> origin/pr/2615/merge
* [new ref] refs/pull/2616/head -> origin/pr/2616/head
* [new ref] refs/pull/2616/merge -> origin/pr/2616/merge
* [new ref] refs/pull/2617/head -> origin/pr/2617/head
* [new ref] refs/pull/2617/merge -> origin/pr/2617/merge
* [new ref] refs/pull/2618/head -> origin/pr/2618/head
* [new ref] refs/pull/2618/merge -> origin/pr/2618/merge
* [new ref] refs/pull/2619/head -> origin/pr/2619/head
* [new ref] refs/pull/2619/merge -> origin/pr/2619/merge
* [new ref] refs/pull/2620/head -> origin/pr/2620/head
* [new ref] refs/pull/2620/merge -> origin/pr/2620/merge
error: unable to resolve reference refs/remotes/origin/pr/592/merge: No such file or directory
! 7088ca3...c595f6e refs/pull/592/merge -> origin/pr/592/merge (unable to update local ref)
Auto packing the repository for optimum performance. You may also
run "git gc" manually. See "git help gc" for more information.
warning: There are too many unreachable loose objects; run 'git prune' to remove them.
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1799)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1525)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:65)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:316)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor862.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy103.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 524165ac95d01e6c4e4b97911e5e4cce78677a93 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 524165ac95d01e6c4e4b97911e5e4cce78677a93
> git rev-list bf16b4a80562cb9db1cd4adba354dd393ed7afd0 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson1838359322014054068.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson1019098651526907023.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4757535067975429973.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson8186375252874857784.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-21 00:02:23,450 17af334b MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/17af334b/pkb.log
2017-04-21 00:02:23,450 17af334b MainThread INFO PerfKitBenchmarker version: v1.11.0-43-g6012a89
2017-04-21 00:02:23,451 17af334b MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-21 00:02:23,848 17af334b MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-21 00:02:23,938 17af334b MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-21 00:02:23,941 17af334b MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-21 00:02:23,941 17af334b MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-21 00:02:23,947 17af334b MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-21 00:02:23,949 17af334b MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-21 00:02:23,974 17af334b MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-21 00:02:23,975 17af334b MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/17af334b/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #332
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/332/display/redirect?page=changes>
Changes:
[tgroh] [BEAM-1948] Defend against absent Aggregators
[robertwb] [BEAM-662] Fix for allowing floating point periods in windows
[robertwb] Make stage names consistent.
[robertwb] Require deterministic window coders.
[robertwb] Enable IntervalWindowCoder test check.
[robertwb] Remove obsolete and unused Runner.clear
[robertwb] Rename AfterFirst to AfterAny for consistency with Java.
[robertwb] Remove bigshuffle from python examples
[robertwb] Remove vestigial Read and Write from core.py
[aljoscha.krettek] [BEAM-1886] Remove TextIO override in Flink runner
[aljoscha.krettek] Exclude UsesSplittableParDoWithWindowedSideInputs in Flink Stream Runner
[altay] Fix KafkaIO javadoc typo
------------------------------------------
[...truncated 261.02 KB...]
* [new ref] refs/pull/2543/merge -> origin/pr/2543/merge
* [new ref] refs/pull/2544/head -> origin/pr/2544/head
* [new ref] refs/pull/2544/merge -> origin/pr/2544/merge
* [new ref] refs/pull/2545/head -> origin/pr/2545/head
* [new ref] refs/pull/2545/merge -> origin/pr/2545/merge
* [new ref] refs/pull/2546/head -> origin/pr/2546/head
* [new ref] refs/pull/2546/merge -> origin/pr/2546/merge
* [new ref] refs/pull/2547/head -> origin/pr/2547/head
* [new ref] refs/pull/2547/merge -> origin/pr/2547/merge
* [new ref] refs/pull/2548/head -> origin/pr/2548/head
* [new ref] refs/pull/2548/merge -> origin/pr/2548/merge
* [new ref] refs/pull/2550/head -> origin/pr/2550/head
* [new ref] refs/pull/2550/merge -> origin/pr/2550/merge
* [new ref] refs/pull/2551/head -> origin/pr/2551/head
* [new ref] refs/pull/2551/merge -> origin/pr/2551/merge
* [new ref] refs/pull/2552/head -> origin/pr/2552/head
* [new ref] refs/pull/2552/merge -> origin/pr/2552/merge
* [new ref] refs/pull/2553/head -> origin/pr/2553/head
* [new ref] refs/pull/2553/merge -> origin/pr/2553/merge
* [new ref] refs/pull/2554/head -> origin/pr/2554/head
* [new ref] refs/pull/2554/merge -> origin/pr/2554/merge
* [new ref] refs/pull/2555/head -> origin/pr/2555/head
* [new ref] refs/pull/2555/merge -> origin/pr/2555/merge
* [new ref] refs/pull/2556/head -> origin/pr/2556/head
* [new ref] refs/pull/2556/merge -> origin/pr/2556/merge
* [new ref] refs/pull/2557/head -> origin/pr/2557/head
* [new ref] refs/pull/2557/merge -> origin/pr/2557/merge
* [new ref] refs/pull/2558/head -> origin/pr/2558/head
* [new ref] refs/pull/2558/merge -> origin/pr/2558/merge
* [new ref] refs/pull/2559/head -> origin/pr/2559/head
* [new ref] refs/pull/2559/merge -> origin/pr/2559/merge
* [new ref] refs/pull/2560/head -> origin/pr/2560/head
* [new ref] refs/pull/2560/merge -> origin/pr/2560/merge
* [new ref] refs/pull/2561/head -> origin/pr/2561/head
* [new ref] refs/pull/2561/merge -> origin/pr/2561/merge
* [new ref] refs/pull/2562/head -> origin/pr/2562/head
* [new ref] refs/pull/2562/merge -> origin/pr/2562/merge
* [new ref] refs/pull/2563/head -> origin/pr/2563/head
* [new ref] refs/pull/2563/merge -> origin/pr/2563/merge
* [new ref] refs/pull/2564/head -> origin/pr/2564/head
* [new ref] refs/pull/2564/merge -> origin/pr/2564/merge
* [new ref] refs/pull/2565/head -> origin/pr/2565/head
* [new ref] refs/pull/2565/merge -> origin/pr/2565/merge
* [new ref] refs/pull/2566/head -> origin/pr/2566/head
* [new ref] refs/pull/2566/merge -> origin/pr/2566/merge
* [new ref] refs/pull/2567/head -> origin/pr/2567/head
* [new ref] refs/pull/2567/merge -> origin/pr/2567/merge
* [new ref] refs/pull/2568/head -> origin/pr/2568/head
* [new ref] refs/pull/2569/head -> origin/pr/2569/head
* [new ref] refs/pull/2569/merge -> origin/pr/2569/merge
* [new ref] refs/pull/2570/head -> origin/pr/2570/head
* [new ref] refs/pull/2570/merge -> origin/pr/2570/merge
* [new ref] refs/pull/2571/head -> origin/pr/2571/head
* [new ref] refs/pull/2571/merge -> origin/pr/2571/merge
* [new ref] refs/pull/2572/head -> origin/pr/2572/head
* [new ref] refs/pull/2572/merge -> origin/pr/2572/merge
* [new ref] refs/pull/2573/head -> origin/pr/2573/head
* [new ref] refs/pull/2573/merge -> origin/pr/2573/merge
* [new ref] refs/pull/2574/head -> origin/pr/2574/head
* [new ref] refs/pull/2575/head -> origin/pr/2575/head
* [new ref] refs/pull/2575/merge -> origin/pr/2575/merge
* [new ref] refs/pull/2576/head -> origin/pr/2576/head
* [new ref] refs/pull/2577/head -> origin/pr/2577/head
* [new ref] refs/pull/2577/merge -> origin/pr/2577/merge
* [new ref] refs/pull/2578/head -> origin/pr/2578/head
* [new ref] refs/pull/2578/merge -> origin/pr/2578/merge
* [new ref] refs/pull/2579/head -> origin/pr/2579/head
* [new ref] refs/pull/2579/merge -> origin/pr/2579/merge
* [new ref] refs/pull/2580/head -> origin/pr/2580/head
* [new ref] refs/pull/2581/head -> origin/pr/2581/head
* [new ref] refs/pull/2581/merge -> origin/pr/2581/merge
* [new ref] refs/pull/2582/head -> origin/pr/2582/head
* [new ref] refs/pull/2582/merge -> origin/pr/2582/merge
* [new ref] refs/pull/2583/head -> origin/pr/2583/head
* [new ref] refs/pull/2583/merge -> origin/pr/2583/merge
* [new ref] refs/pull/2584/head -> origin/pr/2584/head
* [new ref] refs/pull/2585/head -> origin/pr/2585/head
* [new ref] refs/pull/2585/merge -> origin/pr/2585/merge
* [new ref] refs/pull/2586/head -> origin/pr/2586/head
* [new ref] refs/pull/2586/merge -> origin/pr/2586/merge
* [new ref] refs/pull/2587/head -> origin/pr/2587/head
* [new ref] refs/pull/2587/merge -> origin/pr/2587/merge
* [new ref] refs/pull/2588/head -> origin/pr/2588/head
* [new ref] refs/pull/2589/head -> origin/pr/2589/head
* [new ref] refs/pull/2589/merge -> origin/pr/2589/merge
* [new ref] refs/pull/2590/head -> origin/pr/2590/head
* [new ref] refs/pull/2590/merge -> origin/pr/2590/merge
* [new ref] refs/pull/2591/head -> origin/pr/2591/head
* [new ref] refs/pull/2591/merge -> origin/pr/2591/merge
* [new ref] refs/pull/2592/head -> origin/pr/2592/head
* [new ref] refs/pull/2592/merge -> origin/pr/2592/merge
* [new ref] refs/pull/2593/head -> origin/pr/2593/head
* [new ref] refs/pull/2593/merge -> origin/pr/2593/merge
* [new ref] refs/pull/2594/head -> origin/pr/2594/head
* [new ref] refs/pull/2594/merge -> origin/pr/2594/merge
* [new ref] refs/pull/2595/head -> origin/pr/2595/head
* [new ref] refs/pull/2595/merge -> origin/pr/2595/merge
* [new ref] refs/pull/2596/head -> origin/pr/2596/head
* [new ref] refs/pull/2596/merge -> origin/pr/2596/merge
* [new ref] refs/pull/2597/head -> origin/pr/2597/head
* [new ref] refs/pull/2597/merge -> origin/pr/2597/merge
* [new ref] refs/pull/2598/head -> origin/pr/2598/head
* [new ref] refs/pull/2598/merge -> origin/pr/2598/merge
* [new ref] refs/pull/2599/head -> origin/pr/2599/head
* [new ref] refs/pull/2599/merge -> origin/pr/2599/merge
* [new ref] refs/pull/2600/head -> origin/pr/2600/head
* [new ref] refs/pull/2600/merge -> origin/pr/2600/merge
* [new ref] refs/pull/2601/head -> origin/pr/2601/head
* [new ref] refs/pull/2601/merge -> origin/pr/2601/merge
* [new ref] refs/pull/2602/head -> origin/pr/2602/head
* [new ref] refs/pull/2602/merge -> origin/pr/2602/merge
* [new ref] refs/pull/2603/head -> origin/pr/2603/head
* [new ref] refs/pull/2603/merge -> origin/pr/2603/merge
* [new ref] refs/pull/2604/head -> origin/pr/2604/head
* [new ref] refs/pull/2604/merge -> origin/pr/2604/merge
* [new ref] refs/pull/2605/head -> origin/pr/2605/head
* [new ref] refs/pull/2605/merge -> origin/pr/2605/merge
* [new ref] refs/pull/2606/head -> origin/pr/2606/head
* [new ref] refs/pull/2606/merge -> origin/pr/2606/merge
* [new ref] refs/pull/2607/head -> origin/pr/2607/head
* [new ref] refs/pull/2607/merge -> origin/pr/2607/merge
* [new ref] refs/pull/2608/head -> origin/pr/2608/head
* [new ref] refs/pull/2608/merge -> origin/pr/2608/merge
* [new ref] refs/pull/2609/head -> origin/pr/2609/head
* [new ref] refs/pull/2609/merge -> origin/pr/2609/merge
* [new ref] refs/pull/2610/head -> origin/pr/2610/head
* [new ref] refs/pull/2610/merge -> origin/pr/2610/merge
* [new ref] refs/pull/2611/head -> origin/pr/2611/head
* [new ref] refs/pull/2611/merge -> origin/pr/2611/merge
* [new ref] refs/pull/2612/head -> origin/pr/2612/head
* [new ref] refs/pull/2612/merge -> origin/pr/2612/merge
error: unable to resolve reference refs/remotes/origin/pr/592/merge: No such file or directory
! b9bfa5a...7088ca3 refs/pull/592/merge -> origin/pr/592/merge (unable to update local ref)
Auto packing the repository for optimum performance. You may also
run "git gc" manually. See "git help gc" for more information.
warning: There are too many unreachable loose objects; run 'git prune' to remove them.
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1799)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1525)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:65)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:316)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor862.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy103.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision bf16b4a80562cb9db1cd4adba354dd393ed7afd0 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f bf16b4a80562cb9db1cd4adba354dd393ed7afd0
> git rev-list 104f9823563c4a2cd2ef9495e9a16b3a219dd49b # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4510350363730592827.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson8634217960513722945.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4714285922725186566.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson1069675392217594109.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-20 18:02:03,583 9cf86a74 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/9cf86a74/pkb.log
2017-04-20 18:02:03,584 9cf86a74 MainThread INFO PerfKitBenchmarker version: v1.11.0-43-g6012a89
2017-04-20 18:02:03,584 9cf86a74 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-20 18:02:04,221 9cf86a74 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-20 18:02:04,356 9cf86a74 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-20 18:02:04,358 9cf86a74 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-20 18:02:04,359 9cf86a74 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-20 18:02:04,363 9cf86a74 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-20 18:02:04,365 9cf86a74 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-20 18:02:04,378 9cf86a74 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-20 18:02:04,379 9cf86a74 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/9cf86a74/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #331
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/331/display/redirect>
------------------------------------------
[...truncated 259.73 KB...]
* [new ref] refs/pull/2539/merge -> origin/pr/2539/merge
* [new ref] refs/pull/2540/head -> origin/pr/2540/head
* [new ref] refs/pull/2540/merge -> origin/pr/2540/merge
* [new ref] refs/pull/2541/head -> origin/pr/2541/head
* [new ref] refs/pull/2541/merge -> origin/pr/2541/merge
* [new ref] refs/pull/2542/head -> origin/pr/2542/head
* [new ref] refs/pull/2542/merge -> origin/pr/2542/merge
* [new ref] refs/pull/2543/head -> origin/pr/2543/head
* [new ref] refs/pull/2543/merge -> origin/pr/2543/merge
* [new ref] refs/pull/2544/head -> origin/pr/2544/head
* [new ref] refs/pull/2544/merge -> origin/pr/2544/merge
* [new ref] refs/pull/2545/head -> origin/pr/2545/head
* [new ref] refs/pull/2545/merge -> origin/pr/2545/merge
* [new ref] refs/pull/2546/head -> origin/pr/2546/head
* [new ref] refs/pull/2546/merge -> origin/pr/2546/merge
* [new ref] refs/pull/2547/head -> origin/pr/2547/head
* [new ref] refs/pull/2547/merge -> origin/pr/2547/merge
* [new ref] refs/pull/2548/head -> origin/pr/2548/head
* [new ref] refs/pull/2548/merge -> origin/pr/2548/merge
* [new ref] refs/pull/2550/head -> origin/pr/2550/head
* [new ref] refs/pull/2550/merge -> origin/pr/2550/merge
* [new ref] refs/pull/2551/head -> origin/pr/2551/head
* [new ref] refs/pull/2551/merge -> origin/pr/2551/merge
* [new ref] refs/pull/2552/head -> origin/pr/2552/head
* [new ref] refs/pull/2552/merge -> origin/pr/2552/merge
* [new ref] refs/pull/2553/head -> origin/pr/2553/head
* [new ref] refs/pull/2553/merge -> origin/pr/2553/merge
* [new ref] refs/pull/2554/head -> origin/pr/2554/head
* [new ref] refs/pull/2554/merge -> origin/pr/2554/merge
* [new ref] refs/pull/2555/head -> origin/pr/2555/head
* [new ref] refs/pull/2555/merge -> origin/pr/2555/merge
* [new ref] refs/pull/2556/head -> origin/pr/2556/head
* [new ref] refs/pull/2556/merge -> origin/pr/2556/merge
* [new ref] refs/pull/2557/head -> origin/pr/2557/head
* [new ref] refs/pull/2557/merge -> origin/pr/2557/merge
* [new ref] refs/pull/2558/head -> origin/pr/2558/head
* [new ref] refs/pull/2558/merge -> origin/pr/2558/merge
* [new ref] refs/pull/2559/head -> origin/pr/2559/head
* [new ref] refs/pull/2559/merge -> origin/pr/2559/merge
* [new ref] refs/pull/2560/head -> origin/pr/2560/head
* [new ref] refs/pull/2560/merge -> origin/pr/2560/merge
* [new ref] refs/pull/2561/head -> origin/pr/2561/head
* [new ref] refs/pull/2561/merge -> origin/pr/2561/merge
* [new ref] refs/pull/2562/head -> origin/pr/2562/head
* [new ref] refs/pull/2562/merge -> origin/pr/2562/merge
* [new ref] refs/pull/2563/head -> origin/pr/2563/head
* [new ref] refs/pull/2563/merge -> origin/pr/2563/merge
* [new ref] refs/pull/2564/head -> origin/pr/2564/head
* [new ref] refs/pull/2564/merge -> origin/pr/2564/merge
* [new ref] refs/pull/2565/head -> origin/pr/2565/head
* [new ref] refs/pull/2565/merge -> origin/pr/2565/merge
* [new ref] refs/pull/2566/head -> origin/pr/2566/head
* [new ref] refs/pull/2566/merge -> origin/pr/2566/merge
* [new ref] refs/pull/2567/head -> origin/pr/2567/head
* [new ref] refs/pull/2567/merge -> origin/pr/2567/merge
* [new ref] refs/pull/2568/head -> origin/pr/2568/head
* [new ref] refs/pull/2569/head -> origin/pr/2569/head
* [new ref] refs/pull/2569/merge -> origin/pr/2569/merge
* [new ref] refs/pull/2570/head -> origin/pr/2570/head
* [new ref] refs/pull/2570/merge -> origin/pr/2570/merge
* [new ref] refs/pull/2571/head -> origin/pr/2571/head
* [new ref] refs/pull/2571/merge -> origin/pr/2571/merge
* [new ref] refs/pull/2572/head -> origin/pr/2572/head
* [new ref] refs/pull/2572/merge -> origin/pr/2572/merge
* [new ref] refs/pull/2573/head -> origin/pr/2573/head
* [new ref] refs/pull/2573/merge -> origin/pr/2573/merge
* [new ref] refs/pull/2574/head -> origin/pr/2574/head
* [new ref] refs/pull/2575/head -> origin/pr/2575/head
* [new ref] refs/pull/2575/merge -> origin/pr/2575/merge
* [new ref] refs/pull/2576/head -> origin/pr/2576/head
* [new ref] refs/pull/2577/head -> origin/pr/2577/head
* [new ref] refs/pull/2577/merge -> origin/pr/2577/merge
* [new ref] refs/pull/2578/head -> origin/pr/2578/head
* [new ref] refs/pull/2578/merge -> origin/pr/2578/merge
* [new ref] refs/pull/2579/head -> origin/pr/2579/head
* [new ref] refs/pull/2579/merge -> origin/pr/2579/merge
* [new ref] refs/pull/2580/head -> origin/pr/2580/head
* [new ref] refs/pull/2581/head -> origin/pr/2581/head
* [new ref] refs/pull/2581/merge -> origin/pr/2581/merge
* [new ref] refs/pull/2582/head -> origin/pr/2582/head
* [new ref] refs/pull/2582/merge -> origin/pr/2582/merge
* [new ref] refs/pull/2583/head -> origin/pr/2583/head
* [new ref] refs/pull/2583/merge -> origin/pr/2583/merge
* [new ref] refs/pull/2584/head -> origin/pr/2584/head
* [new ref] refs/pull/2585/head -> origin/pr/2585/head
* [new ref] refs/pull/2585/merge -> origin/pr/2585/merge
* [new ref] refs/pull/2586/head -> origin/pr/2586/head
* [new ref] refs/pull/2586/merge -> origin/pr/2586/merge
* [new ref] refs/pull/2587/head -> origin/pr/2587/head
* [new ref] refs/pull/2587/merge -> origin/pr/2587/merge
* [new ref] refs/pull/2588/head -> origin/pr/2588/head
* [new ref] refs/pull/2589/head -> origin/pr/2589/head
* [new ref] refs/pull/2589/merge -> origin/pr/2589/merge
* [new ref] refs/pull/2590/head -> origin/pr/2590/head
* [new ref] refs/pull/2590/merge -> origin/pr/2590/merge
* [new ref] refs/pull/2591/head -> origin/pr/2591/head
* [new ref] refs/pull/2591/merge -> origin/pr/2591/merge
* [new ref] refs/pull/2592/head -> origin/pr/2592/head
* [new ref] refs/pull/2592/merge -> origin/pr/2592/merge
* [new ref] refs/pull/2593/head -> origin/pr/2593/head
* [new ref] refs/pull/2593/merge -> origin/pr/2593/merge
* [new ref] refs/pull/2594/head -> origin/pr/2594/head
* [new ref] refs/pull/2594/merge -> origin/pr/2594/merge
* [new ref] refs/pull/2595/head -> origin/pr/2595/head
* [new ref] refs/pull/2595/merge -> origin/pr/2595/merge
* [new ref] refs/pull/2596/head -> origin/pr/2596/head
* [new ref] refs/pull/2596/merge -> origin/pr/2596/merge
* [new ref] refs/pull/2597/head -> origin/pr/2597/head
* [new ref] refs/pull/2597/merge -> origin/pr/2597/merge
* [new ref] refs/pull/2598/head -> origin/pr/2598/head
* [new ref] refs/pull/2598/merge -> origin/pr/2598/merge
* [new ref] refs/pull/2599/head -> origin/pr/2599/head
* [new ref] refs/pull/2599/merge -> origin/pr/2599/merge
* [new ref] refs/pull/2600/head -> origin/pr/2600/head
* [new ref] refs/pull/2600/merge -> origin/pr/2600/merge
* [new ref] refs/pull/2601/head -> origin/pr/2601/head
* [new ref] refs/pull/2601/merge -> origin/pr/2601/merge
* [new ref] refs/pull/2602/head -> origin/pr/2602/head
* [new ref] refs/pull/2602/merge -> origin/pr/2602/merge
* [new ref] refs/pull/2603/head -> origin/pr/2603/head
* [new ref] refs/pull/2603/merge -> origin/pr/2603/merge
* [new ref] refs/pull/2604/head -> origin/pr/2604/head
* [new ref] refs/pull/2604/merge -> origin/pr/2604/merge
* [new ref] refs/pull/2605/head -> origin/pr/2605/head
* [new ref] refs/pull/2605/merge -> origin/pr/2605/merge
* [new ref] refs/pull/2606/head -> origin/pr/2606/head
* [new ref] refs/pull/2606/merge -> origin/pr/2606/merge
* [new ref] refs/pull/2607/head -> origin/pr/2607/head
* [new ref] refs/pull/2607/merge -> origin/pr/2607/merge
* [new ref] refs/pull/2608/head -> origin/pr/2608/head
* [new ref] refs/pull/2608/merge -> origin/pr/2608/merge
* [new ref] refs/pull/2609/head -> origin/pr/2609/head
* [new ref] refs/pull/2609/merge -> origin/pr/2609/merge
Auto packing the repository for optimum performance. You may also
run "git gc" manually. See "git help gc" for more information.
warning: There are too many unreachable loose objects; run 'git prune' to remove them.
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1799)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1525)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:65)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:316)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor862.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy103.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 104f9823563c4a2cd2ef9495e9a16b3a219dd49b (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 104f9823563c4a2cd2ef9495e9a16b3a219dd49b
> git rev-list 104f9823563c4a2cd2ef9495e9a16b3a219dd49b # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson1686600943140788379.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5687234350595086105.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson8890289747034149854.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5629853312363568363.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-20 12:01:56,850 3ffb136c MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/3ffb136c/pkb.log
2017-04-20 12:01:56,850 3ffb136c MainThread INFO PerfKitBenchmarker version: v1.11.0-43-g6012a89
2017-04-20 12:01:56,851 3ffb136c MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-20 12:01:57,047 3ffb136c MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-20 12:01:57,126 3ffb136c MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-20 12:01:57,128 3ffb136c MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-20 12:01:57,129 3ffb136c MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-20 12:01:57,134 3ffb136c MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-20 12:01:57,136 3ffb136c MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-20 12:01:57,165 3ffb136c MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-20 12:01:57,165 3ffb136c MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/3ffb136c/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #330
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/330/display/redirect?page=changes>
Changes:
[chamikara] add temp dataset location for non-query BigQuerySource
------------------------------------------
[...truncated 259.98 KB...]
* [new ref] refs/pull/2540/merge -> origin/pr/2540/merge
* [new ref] refs/pull/2541/head -> origin/pr/2541/head
* [new ref] refs/pull/2541/merge -> origin/pr/2541/merge
* [new ref] refs/pull/2542/head -> origin/pr/2542/head
* [new ref] refs/pull/2542/merge -> origin/pr/2542/merge
* [new ref] refs/pull/2543/head -> origin/pr/2543/head
* [new ref] refs/pull/2543/merge -> origin/pr/2543/merge
* [new ref] refs/pull/2544/head -> origin/pr/2544/head
* [new ref] refs/pull/2544/merge -> origin/pr/2544/merge
* [new ref] refs/pull/2545/head -> origin/pr/2545/head
* [new ref] refs/pull/2545/merge -> origin/pr/2545/merge
* [new ref] refs/pull/2546/head -> origin/pr/2546/head
* [new ref] refs/pull/2546/merge -> origin/pr/2546/merge
* [new ref] refs/pull/2547/head -> origin/pr/2547/head
* [new ref] refs/pull/2547/merge -> origin/pr/2547/merge
* [new ref] refs/pull/2548/head -> origin/pr/2548/head
* [new ref] refs/pull/2548/merge -> origin/pr/2548/merge
* [new ref] refs/pull/2550/head -> origin/pr/2550/head
* [new ref] refs/pull/2550/merge -> origin/pr/2550/merge
* [new ref] refs/pull/2551/head -> origin/pr/2551/head
* [new ref] refs/pull/2551/merge -> origin/pr/2551/merge
* [new ref] refs/pull/2552/head -> origin/pr/2552/head
* [new ref] refs/pull/2552/merge -> origin/pr/2552/merge
* [new ref] refs/pull/2553/head -> origin/pr/2553/head
* [new ref] refs/pull/2553/merge -> origin/pr/2553/merge
* [new ref] refs/pull/2554/head -> origin/pr/2554/head
* [new ref] refs/pull/2554/merge -> origin/pr/2554/merge
* [new ref] refs/pull/2555/head -> origin/pr/2555/head
* [new ref] refs/pull/2555/merge -> origin/pr/2555/merge
* [new ref] refs/pull/2556/head -> origin/pr/2556/head
* [new ref] refs/pull/2556/merge -> origin/pr/2556/merge
* [new ref] refs/pull/2557/head -> origin/pr/2557/head
* [new ref] refs/pull/2557/merge -> origin/pr/2557/merge
* [new ref] refs/pull/2558/head -> origin/pr/2558/head
* [new ref] refs/pull/2558/merge -> origin/pr/2558/merge
* [new ref] refs/pull/2559/head -> origin/pr/2559/head
* [new ref] refs/pull/2559/merge -> origin/pr/2559/merge
* [new ref] refs/pull/2560/head -> origin/pr/2560/head
* [new ref] refs/pull/2560/merge -> origin/pr/2560/merge
* [new ref] refs/pull/2561/head -> origin/pr/2561/head
* [new ref] refs/pull/2561/merge -> origin/pr/2561/merge
* [new ref] refs/pull/2562/head -> origin/pr/2562/head
* [new ref] refs/pull/2562/merge -> origin/pr/2562/merge
* [new ref] refs/pull/2563/head -> origin/pr/2563/head
* [new ref] refs/pull/2563/merge -> origin/pr/2563/merge
* [new ref] refs/pull/2564/head -> origin/pr/2564/head
* [new ref] refs/pull/2564/merge -> origin/pr/2564/merge
* [new ref] refs/pull/2565/head -> origin/pr/2565/head
* [new ref] refs/pull/2565/merge -> origin/pr/2565/merge
* [new ref] refs/pull/2566/head -> origin/pr/2566/head
* [new ref] refs/pull/2566/merge -> origin/pr/2566/merge
* [new ref] refs/pull/2567/head -> origin/pr/2567/head
* [new ref] refs/pull/2567/merge -> origin/pr/2567/merge
* [new ref] refs/pull/2568/head -> origin/pr/2568/head
* [new ref] refs/pull/2569/head -> origin/pr/2569/head
* [new ref] refs/pull/2569/merge -> origin/pr/2569/merge
* [new ref] refs/pull/2570/head -> origin/pr/2570/head
* [new ref] refs/pull/2570/merge -> origin/pr/2570/merge
* [new ref] refs/pull/2571/head -> origin/pr/2571/head
* [new ref] refs/pull/2571/merge -> origin/pr/2571/merge
* [new ref] refs/pull/2572/head -> origin/pr/2572/head
* [new ref] refs/pull/2572/merge -> origin/pr/2572/merge
* [new ref] refs/pull/2573/head -> origin/pr/2573/head
* [new ref] refs/pull/2573/merge -> origin/pr/2573/merge
* [new ref] refs/pull/2574/head -> origin/pr/2574/head
* [new ref] refs/pull/2575/head -> origin/pr/2575/head
* [new ref] refs/pull/2575/merge -> origin/pr/2575/merge
* [new ref] refs/pull/2576/head -> origin/pr/2576/head
* [new ref] refs/pull/2577/head -> origin/pr/2577/head
* [new ref] refs/pull/2577/merge -> origin/pr/2577/merge
* [new ref] refs/pull/2578/head -> origin/pr/2578/head
* [new ref] refs/pull/2578/merge -> origin/pr/2578/merge
* [new ref] refs/pull/2579/head -> origin/pr/2579/head
* [new ref] refs/pull/2579/merge -> origin/pr/2579/merge
* [new ref] refs/pull/2580/head -> origin/pr/2580/head
* [new ref] refs/pull/2581/head -> origin/pr/2581/head
* [new ref] refs/pull/2581/merge -> origin/pr/2581/merge
* [new ref] refs/pull/2582/head -> origin/pr/2582/head
* [new ref] refs/pull/2582/merge -> origin/pr/2582/merge
* [new ref] refs/pull/2583/head -> origin/pr/2583/head
* [new ref] refs/pull/2583/merge -> origin/pr/2583/merge
* [new ref] refs/pull/2584/head -> origin/pr/2584/head
* [new ref] refs/pull/2585/head -> origin/pr/2585/head
* [new ref] refs/pull/2585/merge -> origin/pr/2585/merge
* [new ref] refs/pull/2586/head -> origin/pr/2586/head
* [new ref] refs/pull/2586/merge -> origin/pr/2586/merge
* [new ref] refs/pull/2587/head -> origin/pr/2587/head
* [new ref] refs/pull/2587/merge -> origin/pr/2587/merge
* [new ref] refs/pull/2588/head -> origin/pr/2588/head
* [new ref] refs/pull/2589/head -> origin/pr/2589/head
* [new ref] refs/pull/2589/merge -> origin/pr/2589/merge
* [new ref] refs/pull/2590/head -> origin/pr/2590/head
* [new ref] refs/pull/2590/merge -> origin/pr/2590/merge
* [new ref] refs/pull/2591/head -> origin/pr/2591/head
* [new ref] refs/pull/2591/merge -> origin/pr/2591/merge
* [new ref] refs/pull/2592/head -> origin/pr/2592/head
* [new ref] refs/pull/2592/merge -> origin/pr/2592/merge
* [new ref] refs/pull/2593/head -> origin/pr/2593/head
* [new ref] refs/pull/2593/merge -> origin/pr/2593/merge
* [new ref] refs/pull/2594/head -> origin/pr/2594/head
* [new ref] refs/pull/2594/merge -> origin/pr/2594/merge
* [new ref] refs/pull/2595/head -> origin/pr/2595/head
* [new ref] refs/pull/2595/merge -> origin/pr/2595/merge
* [new ref] refs/pull/2596/head -> origin/pr/2596/head
* [new ref] refs/pull/2596/merge -> origin/pr/2596/merge
* [new ref] refs/pull/2597/head -> origin/pr/2597/head
* [new ref] refs/pull/2597/merge -> origin/pr/2597/merge
* [new ref] refs/pull/2598/head -> origin/pr/2598/head
* [new ref] refs/pull/2598/merge -> origin/pr/2598/merge
* [new ref] refs/pull/2599/head -> origin/pr/2599/head
* [new ref] refs/pull/2599/merge -> origin/pr/2599/merge
* [new ref] refs/pull/2600/head -> origin/pr/2600/head
* [new ref] refs/pull/2600/merge -> origin/pr/2600/merge
* [new ref] refs/pull/2601/head -> origin/pr/2601/head
* [new ref] refs/pull/2601/merge -> origin/pr/2601/merge
* [new ref] refs/pull/2602/head -> origin/pr/2602/head
* [new ref] refs/pull/2602/merge -> origin/pr/2602/merge
* [new ref] refs/pull/2603/head -> origin/pr/2603/head
* [new ref] refs/pull/2603/merge -> origin/pr/2603/merge
* [new ref] refs/pull/2604/head -> origin/pr/2604/head
* [new ref] refs/pull/2604/merge -> origin/pr/2604/merge
* [new ref] refs/pull/2605/head -> origin/pr/2605/head
* [new ref] refs/pull/2605/merge -> origin/pr/2605/merge
* [new ref] refs/pull/2606/head -> origin/pr/2606/head
* [new ref] refs/pull/2606/merge -> origin/pr/2606/merge
* [new ref] refs/pull/2607/head -> origin/pr/2607/head
* [new ref] refs/pull/2607/merge -> origin/pr/2607/merge
error: unable to resolve reference refs/remotes/origin/pr/592/merge: No such file or directory
! 0d420d3...b9bfa5a refs/pull/592/merge -> origin/pr/592/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/959/merge: No such file or directory
! 39c9afa...25d5f19 refs/pull/959/merge -> origin/pr/959/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/984/merge: No such file or directory
! 54fa2a8...da83b57 refs/pull/984/merge -> origin/pr/984/merge (unable to update local ref)
Auto packing the repository for optimum performance. You may also
run "git gc" manually. See "git help gc" for more information.
warning: There are too many unreachable loose objects; run 'git prune' to remove them.
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1799)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1525)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:65)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:316)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor862.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy103.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 104f9823563c4a2cd2ef9495e9a16b3a219dd49b (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 104f9823563c4a2cd2ef9495e9a16b3a219dd49b
> git rev-list 3ef614c72d24f44a8cf463040a2bcf17b9445bc8 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson8286626980164617294.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson498259845201682450.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson1786429201611599997.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2156720948161282351.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-20 06:02:22,876 e08fd0e7 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/e08fd0e7/pkb.log
2017-04-20 06:02:22,876 e08fd0e7 MainThread INFO PerfKitBenchmarker version: v1.11.0-43-g6012a89
2017-04-20 06:02:22,876 e08fd0e7 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-20 06:02:23,250 e08fd0e7 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-20 06:02:23,343 e08fd0e7 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-20 06:02:23,345 e08fd0e7 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-20 06:02:23,346 e08fd0e7 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-20 06:02:23,352 e08fd0e7 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-20 06:02:23,354 e08fd0e7 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-20 06:02:23,377 e08fd0e7 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-20 06:02:23,378 e08fd0e7 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/e08fd0e7/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #329
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/329/display/redirect?page=changes>
Changes:
[kirpichov] Cache result of BigQuerySourceBase.split
[dhalperi] [BEAM-2015] Remove shared profile in runners/pom.xml and fix Dataflow
[lcwik] [BEAM-2014] Upgrade to Google Auth 0.6.1
[lcwik] [BEAM-2013] Upgrade to Jackson 2.8.8
[dhalperi] [BEAM-2017] Fix NPE in DataflowRunner when there are no metrics
[lcwik] [BEAM-1871] Remove another depedendency by moving TestCredential
[lcwik] Modify types for input PCollections of Flatten transform to that of the
[altay] added module option, use more common zero test, show module name in log
------------------------------------------
[...truncated 266.21 KB...]
* [new ref] refs/pull/2544/merge -> origin/pr/2544/merge
* [new ref] refs/pull/2545/head -> origin/pr/2545/head
* [new ref] refs/pull/2545/merge -> origin/pr/2545/merge
* [new ref] refs/pull/2546/head -> origin/pr/2546/head
* [new ref] refs/pull/2546/merge -> origin/pr/2546/merge
* [new ref] refs/pull/2547/head -> origin/pr/2547/head
* [new ref] refs/pull/2547/merge -> origin/pr/2547/merge
* [new ref] refs/pull/2548/head -> origin/pr/2548/head
* [new ref] refs/pull/2548/merge -> origin/pr/2548/merge
* [new ref] refs/pull/2550/head -> origin/pr/2550/head
* [new ref] refs/pull/2550/merge -> origin/pr/2550/merge
* [new ref] refs/pull/2551/head -> origin/pr/2551/head
* [new ref] refs/pull/2551/merge -> origin/pr/2551/merge
* [new ref] refs/pull/2552/head -> origin/pr/2552/head
* [new ref] refs/pull/2552/merge -> origin/pr/2552/merge
* [new ref] refs/pull/2553/head -> origin/pr/2553/head
* [new ref] refs/pull/2553/merge -> origin/pr/2553/merge
* [new ref] refs/pull/2554/head -> origin/pr/2554/head
* [new ref] refs/pull/2554/merge -> origin/pr/2554/merge
* [new ref] refs/pull/2555/head -> origin/pr/2555/head
* [new ref] refs/pull/2555/merge -> origin/pr/2555/merge
* [new ref] refs/pull/2556/head -> origin/pr/2556/head
* [new ref] refs/pull/2556/merge -> origin/pr/2556/merge
* [new ref] refs/pull/2557/head -> origin/pr/2557/head
* [new ref] refs/pull/2557/merge -> origin/pr/2557/merge
* [new ref] refs/pull/2558/head -> origin/pr/2558/head
* [new ref] refs/pull/2558/merge -> origin/pr/2558/merge
* [new ref] refs/pull/2559/head -> origin/pr/2559/head
* [new ref] refs/pull/2559/merge -> origin/pr/2559/merge
* [new ref] refs/pull/2560/head -> origin/pr/2560/head
* [new ref] refs/pull/2560/merge -> origin/pr/2560/merge
* [new ref] refs/pull/2561/head -> origin/pr/2561/head
* [new ref] refs/pull/2561/merge -> origin/pr/2561/merge
* [new ref] refs/pull/2562/head -> origin/pr/2562/head
* [new ref] refs/pull/2562/merge -> origin/pr/2562/merge
* [new ref] refs/pull/2563/head -> origin/pr/2563/head
* [new ref] refs/pull/2563/merge -> origin/pr/2563/merge
* [new ref] refs/pull/2564/head -> origin/pr/2564/head
* [new ref] refs/pull/2564/merge -> origin/pr/2564/merge
* [new ref] refs/pull/2565/head -> origin/pr/2565/head
* [new ref] refs/pull/2565/merge -> origin/pr/2565/merge
* [new ref] refs/pull/2566/head -> origin/pr/2566/head
* [new ref] refs/pull/2566/merge -> origin/pr/2566/merge
* [new ref] refs/pull/2567/head -> origin/pr/2567/head
* [new ref] refs/pull/2567/merge -> origin/pr/2567/merge
* [new ref] refs/pull/2568/head -> origin/pr/2568/head
* [new ref] refs/pull/2569/head -> origin/pr/2569/head
* [new ref] refs/pull/2569/merge -> origin/pr/2569/merge
* [new ref] refs/pull/2570/head -> origin/pr/2570/head
* [new ref] refs/pull/2570/merge -> origin/pr/2570/merge
* [new ref] refs/pull/2571/head -> origin/pr/2571/head
* [new ref] refs/pull/2571/merge -> origin/pr/2571/merge
* [new ref] refs/pull/2572/head -> origin/pr/2572/head
* [new ref] refs/pull/2572/merge -> origin/pr/2572/merge
* [new ref] refs/pull/2573/head -> origin/pr/2573/head
* [new ref] refs/pull/2573/merge -> origin/pr/2573/merge
* [new ref] refs/pull/2574/head -> origin/pr/2574/head
* [new ref] refs/pull/2575/head -> origin/pr/2575/head
* [new ref] refs/pull/2575/merge -> origin/pr/2575/merge
* [new ref] refs/pull/2576/head -> origin/pr/2576/head
* [new ref] refs/pull/2577/head -> origin/pr/2577/head
* [new ref] refs/pull/2577/merge -> origin/pr/2577/merge
* [new ref] refs/pull/2578/head -> origin/pr/2578/head
* [new ref] refs/pull/2578/merge -> origin/pr/2578/merge
* [new ref] refs/pull/2579/head -> origin/pr/2579/head
* [new ref] refs/pull/2579/merge -> origin/pr/2579/merge
* [new ref] refs/pull/2580/head -> origin/pr/2580/head
* [new ref] refs/pull/2581/head -> origin/pr/2581/head
* [new ref] refs/pull/2581/merge -> origin/pr/2581/merge
* [new ref] refs/pull/2582/head -> origin/pr/2582/head
* [new ref] refs/pull/2582/merge -> origin/pr/2582/merge
* [new ref] refs/pull/2583/head -> origin/pr/2583/head
* [new ref] refs/pull/2583/merge -> origin/pr/2583/merge
* [new ref] refs/pull/2584/head -> origin/pr/2584/head
* [new ref] refs/pull/2585/head -> origin/pr/2585/head
* [new ref] refs/pull/2585/merge -> origin/pr/2585/merge
* [new ref] refs/pull/2586/head -> origin/pr/2586/head
* [new ref] refs/pull/2586/merge -> origin/pr/2586/merge
* [new ref] refs/pull/2587/head -> origin/pr/2587/head
* [new ref] refs/pull/2587/merge -> origin/pr/2587/merge
* [new ref] refs/pull/2588/head -> origin/pr/2588/head
* [new ref] refs/pull/2589/head -> origin/pr/2589/head
* [new ref] refs/pull/2589/merge -> origin/pr/2589/merge
* [new ref] refs/pull/2590/head -> origin/pr/2590/head
* [new ref] refs/pull/2590/merge -> origin/pr/2590/merge
* [new ref] refs/pull/2591/head -> origin/pr/2591/head
* [new ref] refs/pull/2591/merge -> origin/pr/2591/merge
* [new ref] refs/pull/2592/head -> origin/pr/2592/head
* [new ref] refs/pull/2592/merge -> origin/pr/2592/merge
* [new ref] refs/pull/2593/head -> origin/pr/2593/head
* [new ref] refs/pull/2593/merge -> origin/pr/2593/merge
* [new ref] refs/pull/2594/head -> origin/pr/2594/head
* [new ref] refs/pull/2594/merge -> origin/pr/2594/merge
* [new ref] refs/pull/2595/head -> origin/pr/2595/head
* [new ref] refs/pull/2595/merge -> origin/pr/2595/merge
* [new ref] refs/pull/2596/head -> origin/pr/2596/head
* [new ref] refs/pull/2596/merge -> origin/pr/2596/merge
* [new ref] refs/pull/2597/head -> origin/pr/2597/head
* [new ref] refs/pull/2597/merge -> origin/pr/2597/merge
* [new ref] refs/pull/2598/head -> origin/pr/2598/head
* [new ref] refs/pull/2598/merge -> origin/pr/2598/merge
* [new ref] refs/pull/2599/head -> origin/pr/2599/head
* [new ref] refs/pull/2599/merge -> origin/pr/2599/merge
* [new ref] refs/pull/2600/head -> origin/pr/2600/head
* [new ref] refs/pull/2600/merge -> origin/pr/2600/merge
* [new ref] refs/pull/2601/head -> origin/pr/2601/head
* [new ref] refs/pull/2601/merge -> origin/pr/2601/merge
* [new ref] refs/pull/2602/head -> origin/pr/2602/head
* [new ref] refs/pull/2602/merge -> origin/pr/2602/merge
* [new ref] refs/pull/2603/head -> origin/pr/2603/head
* [new ref] refs/pull/2603/merge -> origin/pr/2603/merge
error: unable to resolve reference refs/remotes/origin/pr/592/merge: No such file or directory
! e816697...0d420d3 refs/pull/592/merge -> origin/pr/592/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/809/merge: No such file or directory
! ac26af4...50ab53b refs/pull/809/merge -> origin/pr/809/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/810/merge: No such file or directory
! edfdeb5...7cab9bf refs/pull/810/merge -> origin/pr/810/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/819/merge: No such file or directory
! 94703ec...f95321a refs/pull/819/merge -> origin/pr/819/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/838/merge: No such file or directory
! 53a8fe0...3eb5563 refs/pull/838/merge -> origin/pr/838/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/871/merge: No such file or directory
! 61f4dd5...dcc5b0b refs/pull/871/merge -> origin/pr/871/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/886/merge: No such file or directory
! 01f16da...9fe583c refs/pull/886/merge -> origin/pr/886/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/900/merge: No such file or directory
! c0c0a26...c340815 refs/pull/900/merge -> origin/pr/900/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/902/merge: No such file or directory
! 38d7315...824f162 refs/pull/902/merge -> origin/pr/902/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/914/merge: No such file or directory
! 3c4444a...b93dd41 refs/pull/914/merge -> origin/pr/914/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/917/merge: No such file or directory
! 7db5e68...b264c75 refs/pull/917/merge -> origin/pr/917/merge (unable to update local ref)
Auto packing the repository for optimum performance. You may also
run "git gc" manually. See "git help gc" for more information.
warning: There are too many unreachable loose objects; run 'git prune' to remove them.
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1799)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1525)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:65)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:316)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor862.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy103.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 3ef614c72d24f44a8cf463040a2bcf17b9445bc8 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 3ef614c72d24f44a8cf463040a2bcf17b9445bc8
> git rev-list 29e054a8d7ffe6a061dbbe9a1885185b02f4e8ec # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2663058786604102121.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson8290558974798900018.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4943685089095665165.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson7646488805423744271.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-20 00:02:03,418 bf07c8ef MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/bf07c8ef/pkb.log
2017-04-20 00:02:03,418 bf07c8ef MainThread INFO PerfKitBenchmarker version: v1.11.0-43-g6012a89
2017-04-20 00:02:03,418 bf07c8ef MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-20 00:02:03,849 bf07c8ef MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-20 00:02:03,935 bf07c8ef MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-20 00:02:03,938 bf07c8ef MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-20 00:02:03,938 bf07c8ef MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-20 00:02:03,943 bf07c8ef MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-20 00:02:03,945 bf07c8ef MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-20 00:02:03,971 bf07c8ef MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-20 00:02:03,972 bf07c8ef MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/bf07c8ef/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #328
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/328/display/redirect?page=changes>
Changes:
[iemejia] [BEAM-1994] Remove Flink examples package
[chamikara] [BEAM-1441] Remove deprecated ChannelFactory
[tgroh] Ensure all Read outputs are consumed in Dataflow
------------------------------------------
[...truncated 239.71 KB...]
x [deleted] (none) -> origin/pr/93/head
x [deleted] (none) -> origin/pr/930/head
x [deleted] (none) -> origin/pr/930/merge
x [deleted] (none) -> origin/pr/931/head
x [deleted] (none) -> origin/pr/931/merge
x [deleted] (none) -> origin/pr/932/head
x [deleted] (none) -> origin/pr/932/merge
x [deleted] (none) -> origin/pr/933/head
x [deleted] (none) -> origin/pr/933/merge
x [deleted] (none) -> origin/pr/934/head
x [deleted] (none) -> origin/pr/934/merge
x [deleted] (none) -> origin/pr/935/head
x [deleted] (none) -> origin/pr/936/head
x [deleted] (none) -> origin/pr/936/merge
x [deleted] (none) -> origin/pr/937/head
x [deleted] (none) -> origin/pr/937/merge
x [deleted] (none) -> origin/pr/938/head
x [deleted] (none) -> origin/pr/939/head
x [deleted] (none) -> origin/pr/94/head
x [deleted] (none) -> origin/pr/940/head
x [deleted] (none) -> origin/pr/940/merge
x [deleted] (none) -> origin/pr/941/head
x [deleted] (none) -> origin/pr/941/merge
x [deleted] (none) -> origin/pr/942/head
x [deleted] (none) -> origin/pr/942/merge
x [deleted] (none) -> origin/pr/943/head
x [deleted] (none) -> origin/pr/943/merge
x [deleted] (none) -> origin/pr/944/head
x [deleted] (none) -> origin/pr/945/head
x [deleted] (none) -> origin/pr/945/merge
x [deleted] (none) -> origin/pr/946/head
x [deleted] (none) -> origin/pr/946/merge
x [deleted] (none) -> origin/pr/947/head
x [deleted] (none) -> origin/pr/947/merge
x [deleted] (none) -> origin/pr/948/head
x [deleted] (none) -> origin/pr/948/merge
x [deleted] (none) -> origin/pr/949/head
x [deleted] (none) -> origin/pr/949/merge
x [deleted] (none) -> origin/pr/95/head
x [deleted] (none) -> origin/pr/95/merge
x [deleted] (none) -> origin/pr/950/head
x [deleted] (none) -> origin/pr/951/head
x [deleted] (none) -> origin/pr/951/merge
x [deleted] (none) -> origin/pr/952/head
x [deleted] (none) -> origin/pr/952/merge
x [deleted] (none) -> origin/pr/953/head
x [deleted] (none) -> origin/pr/954/head
x [deleted] (none) -> origin/pr/954/merge
x [deleted] (none) -> origin/pr/955/head
x [deleted] (none) -> origin/pr/955/merge
x [deleted] (none) -> origin/pr/956/head
x [deleted] (none) -> origin/pr/957/head
x [deleted] (none) -> origin/pr/958/head
x [deleted] (none) -> origin/pr/959/head
x [deleted] (none) -> origin/pr/959/merge
x [deleted] (none) -> origin/pr/96/head
x [deleted] (none) -> origin/pr/96/merge
x [deleted] (none) -> origin/pr/960/head
x [deleted] (none) -> origin/pr/960/merge
x [deleted] (none) -> origin/pr/961/head
x [deleted] (none) -> origin/pr/962/head
x [deleted] (none) -> origin/pr/962/merge
x [deleted] (none) -> origin/pr/963/head
x [deleted] (none) -> origin/pr/963/merge
x [deleted] (none) -> origin/pr/964/head
x [deleted] (none) -> origin/pr/965/head
x [deleted] (none) -> origin/pr/965/merge
x [deleted] (none) -> origin/pr/966/head
x [deleted] (none) -> origin/pr/967/head
x [deleted] (none) -> origin/pr/967/merge
x [deleted] (none) -> origin/pr/968/head
x [deleted] (none) -> origin/pr/968/merge
x [deleted] (none) -> origin/pr/969/head
x [deleted] (none) -> origin/pr/969/merge
x [deleted] (none) -> origin/pr/97/head
x [deleted] (none) -> origin/pr/97/merge
x [deleted] (none) -> origin/pr/970/head
x [deleted] (none) -> origin/pr/970/merge
x [deleted] (none) -> origin/pr/971/head
x [deleted] (none) -> origin/pr/971/merge
x [deleted] (none) -> origin/pr/972/head
x [deleted] (none) -> origin/pr/973/head
x [deleted] (none) -> origin/pr/974/head
x [deleted] (none) -> origin/pr/974/merge
x [deleted] (none) -> origin/pr/975/head
x [deleted] (none) -> origin/pr/975/merge
x [deleted] (none) -> origin/pr/976/head
x [deleted] (none) -> origin/pr/976/merge
x [deleted] (none) -> origin/pr/977/head
x [deleted] (none) -> origin/pr/977/merge
x [deleted] (none) -> origin/pr/978/head
x [deleted] (none) -> origin/pr/978/merge
x [deleted] (none) -> origin/pr/979/head
x [deleted] (none) -> origin/pr/979/merge
x [deleted] (none) -> origin/pr/98/head
x [deleted] (none) -> origin/pr/980/head
x [deleted] (none) -> origin/pr/980/merge
x [deleted] (none) -> origin/pr/981/head
x [deleted] (none) -> origin/pr/982/head
x [deleted] (none) -> origin/pr/982/merge
x [deleted] (none) -> origin/pr/983/head
x [deleted] (none) -> origin/pr/983/merge
x [deleted] (none) -> origin/pr/984/head
x [deleted] (none) -> origin/pr/984/merge
x [deleted] (none) -> origin/pr/985/head
x [deleted] (none) -> origin/pr/985/merge
x [deleted] (none) -> origin/pr/986/head
x [deleted] (none) -> origin/pr/986/merge
x [deleted] (none) -> origin/pr/987/head
x [deleted] (none) -> origin/pr/988/head
x [deleted] (none) -> origin/pr/988/merge
x [deleted] (none) -> origin/pr/989/head
x [deleted] (none) -> origin/pr/989/merge
x [deleted] (none) -> origin/pr/99/head
x [deleted] (none) -> origin/pr/99/merge
x [deleted] (none) -> origin/pr/990/head
x [deleted] (none) -> origin/pr/990/merge
x [deleted] (none) -> origin/pr/991/head
x [deleted] (none) -> origin/pr/991/merge
x [deleted] (none) -> origin/pr/992/head
x [deleted] (none) -> origin/pr/992/merge
x [deleted] (none) -> origin/pr/993/head
x [deleted] (none) -> origin/pr/993/merge
x [deleted] (none) -> origin/pr/994/head
x [deleted] (none) -> origin/pr/994/merge
x [deleted] (none) -> origin/pr/995/head
x [deleted] (none) -> origin/pr/995/merge
x [deleted] (none) -> origin/pr/996/head
x [deleted] (none) -> origin/pr/996/merge
x [deleted] (none) -> origin/pr/997/head
x [deleted] (none) -> origin/pr/997/merge
x [deleted] (none) -> origin/pr/998/head
x [deleted] (none) -> origin/pr/999/head
x [deleted] (none) -> origin/pr/999/merge
error: RPC failed; result=18, HTTP code = 200
fatal: The remote end hung up unexpectedly
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1799)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1525)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:65)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:316)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam4(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor862.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy103.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 29e054a8d7ffe6a061dbbe9a1885185b02f4e8ec (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 29e054a8d7ffe6a061dbbe9a1885185b02f4e8ec
> git rev-list 8a00f225454bcc742e5b38a499237bd5de455fb7 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson8365579214532950003.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson1454548667904036598.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson1369842140295342366.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5369403042547739192.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-19 18:03:52,596 80cdb2f8 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/80cdb2f8/pkb.log
2017-04-19 18:03:52,597 80cdb2f8 MainThread INFO PerfKitBenchmarker version: v1.11.0-43-g6012a89
2017-04-19 18:03:52,598 80cdb2f8 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-19 18:03:53,263 80cdb2f8 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-19 18:03:53,439 80cdb2f8 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-19 18:03:53,441 80cdb2f8 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-19 18:03:53,442 80cdb2f8 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-19 18:03:53,449 80cdb2f8 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-19 18:03:53,452 80cdb2f8 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-19 18:03:53,462 80cdb2f8 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-19 18:03:53,463 80cdb2f8 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/80cdb2f8/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #327
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/327/display/redirect?page=changes>
Changes:
[jbonofre] [BEAM-1914]Â XmlIO now complies with PTransform style guide
[iemejia] Pin default commons-compress version to beam-parent pom
------------------------------------------
[...truncated 259.49 KB...]
* [new ref] refs/pull/2528/head -> origin/pr/2528/head
* [new ref] refs/pull/2528/merge -> origin/pr/2528/merge
* [new ref] refs/pull/2529/head -> origin/pr/2529/head
* [new ref] refs/pull/2529/merge -> origin/pr/2529/merge
* [new ref] refs/pull/2530/head -> origin/pr/2530/head
* [new ref] refs/pull/2531/head -> origin/pr/2531/head
* [new ref] refs/pull/2531/merge -> origin/pr/2531/merge
* [new ref] refs/pull/2532/head -> origin/pr/2532/head
* [new ref] refs/pull/2532/merge -> origin/pr/2532/merge
* [new ref] refs/pull/2533/head -> origin/pr/2533/head
* [new ref] refs/pull/2533/merge -> origin/pr/2533/merge
* [new ref] refs/pull/2534/head -> origin/pr/2534/head
* [new ref] refs/pull/2534/merge -> origin/pr/2534/merge
* [new ref] refs/pull/2535/head -> origin/pr/2535/head
* [new ref] refs/pull/2535/merge -> origin/pr/2535/merge
* [new ref] refs/pull/2536/head -> origin/pr/2536/head
* [new ref] refs/pull/2536/merge -> origin/pr/2536/merge
* [new ref] refs/pull/2537/head -> origin/pr/2537/head
* [new ref] refs/pull/2537/merge -> origin/pr/2537/merge
* [new ref] refs/pull/2538/head -> origin/pr/2538/head
* [new ref] refs/pull/2538/merge -> origin/pr/2538/merge
* [new ref] refs/pull/2539/head -> origin/pr/2539/head
* [new ref] refs/pull/2539/merge -> origin/pr/2539/merge
* [new ref] refs/pull/2540/head -> origin/pr/2540/head
* [new ref] refs/pull/2540/merge -> origin/pr/2540/merge
* [new ref] refs/pull/2541/head -> origin/pr/2541/head
* [new ref] refs/pull/2541/merge -> origin/pr/2541/merge
* [new ref] refs/pull/2542/head -> origin/pr/2542/head
* [new ref] refs/pull/2542/merge -> origin/pr/2542/merge
* [new ref] refs/pull/2543/head -> origin/pr/2543/head
* [new ref] refs/pull/2543/merge -> origin/pr/2543/merge
* [new ref] refs/pull/2544/head -> origin/pr/2544/head
* [new ref] refs/pull/2544/merge -> origin/pr/2544/merge
* [new ref] refs/pull/2545/head -> origin/pr/2545/head
* [new ref] refs/pull/2545/merge -> origin/pr/2545/merge
* [new ref] refs/pull/2546/head -> origin/pr/2546/head
* [new ref] refs/pull/2546/merge -> origin/pr/2546/merge
* [new ref] refs/pull/2547/head -> origin/pr/2547/head
* [new ref] refs/pull/2547/merge -> origin/pr/2547/merge
* [new ref] refs/pull/2548/head -> origin/pr/2548/head
* [new ref] refs/pull/2548/merge -> origin/pr/2548/merge
error: unable to resolve reference refs/remotes/origin/pr/2549/merge: No such file or directory
! 04ca87a...b839137 refs/pull/2549/merge -> origin/pr/2549/merge (unable to update local ref)
* [new ref] refs/pull/2550/head -> origin/pr/2550/head
* [new ref] refs/pull/2550/merge -> origin/pr/2550/merge
* [new ref] refs/pull/2551/head -> origin/pr/2551/head
* [new ref] refs/pull/2551/merge -> origin/pr/2551/merge
* [new ref] refs/pull/2552/head -> origin/pr/2552/head
* [new ref] refs/pull/2552/merge -> origin/pr/2552/merge
* [new ref] refs/pull/2553/head -> origin/pr/2553/head
* [new ref] refs/pull/2553/merge -> origin/pr/2553/merge
* [new ref] refs/pull/2554/head -> origin/pr/2554/head
* [new ref] refs/pull/2554/merge -> origin/pr/2554/merge
* [new ref] refs/pull/2555/head -> origin/pr/2555/head
* [new ref] refs/pull/2555/merge -> origin/pr/2555/merge
* [new ref] refs/pull/2556/head -> origin/pr/2556/head
* [new ref] refs/pull/2556/merge -> origin/pr/2556/merge
* [new ref] refs/pull/2557/head -> origin/pr/2557/head
* [new ref] refs/pull/2557/merge -> origin/pr/2557/merge
* [new ref] refs/pull/2558/head -> origin/pr/2558/head
* [new ref] refs/pull/2558/merge -> origin/pr/2558/merge
* [new ref] refs/pull/2559/head -> origin/pr/2559/head
* [new ref] refs/pull/2559/merge -> origin/pr/2559/merge
* [new ref] refs/pull/2560/head -> origin/pr/2560/head
* [new ref] refs/pull/2560/merge -> origin/pr/2560/merge
* [new ref] refs/pull/2561/head -> origin/pr/2561/head
* [new ref] refs/pull/2561/merge -> origin/pr/2561/merge
* [new ref] refs/pull/2562/head -> origin/pr/2562/head
* [new ref] refs/pull/2562/merge -> origin/pr/2562/merge
* [new ref] refs/pull/2563/head -> origin/pr/2563/head
* [new ref] refs/pull/2563/merge -> origin/pr/2563/merge
* [new ref] refs/pull/2564/head -> origin/pr/2564/head
* [new ref] refs/pull/2564/merge -> origin/pr/2564/merge
* [new ref] refs/pull/2565/head -> origin/pr/2565/head
* [new ref] refs/pull/2565/merge -> origin/pr/2565/merge
* [new ref] refs/pull/2566/head -> origin/pr/2566/head
* [new ref] refs/pull/2566/merge -> origin/pr/2566/merge
* [new ref] refs/pull/2567/head -> origin/pr/2567/head
* [new ref] refs/pull/2567/merge -> origin/pr/2567/merge
* [new ref] refs/pull/2568/head -> origin/pr/2568/head
* [new ref] refs/pull/2569/head -> origin/pr/2569/head
* [new ref] refs/pull/2569/merge -> origin/pr/2569/merge
* [new ref] refs/pull/2570/head -> origin/pr/2570/head
* [new ref] refs/pull/2570/merge -> origin/pr/2570/merge
* [new ref] refs/pull/2571/head -> origin/pr/2571/head
* [new ref] refs/pull/2571/merge -> origin/pr/2571/merge
* [new ref] refs/pull/2572/head -> origin/pr/2572/head
* [new ref] refs/pull/2572/merge -> origin/pr/2572/merge
* [new ref] refs/pull/2573/head -> origin/pr/2573/head
* [new ref] refs/pull/2573/merge -> origin/pr/2573/merge
* [new ref] refs/pull/2574/head -> origin/pr/2574/head
* [new ref] refs/pull/2575/head -> origin/pr/2575/head
* [new ref] refs/pull/2575/merge -> origin/pr/2575/merge
* [new ref] refs/pull/2576/head -> origin/pr/2576/head
* [new ref] refs/pull/2576/merge -> origin/pr/2576/merge
* [new ref] refs/pull/2577/head -> origin/pr/2577/head
* [new ref] refs/pull/2577/merge -> origin/pr/2577/merge
* [new ref] refs/pull/2578/head -> origin/pr/2578/head
* [new ref] refs/pull/2578/merge -> origin/pr/2578/merge
* [new ref] refs/pull/2579/head -> origin/pr/2579/head
* [new ref] refs/pull/2579/merge -> origin/pr/2579/merge
* [new ref] refs/pull/2580/head -> origin/pr/2580/head
* [new ref] refs/pull/2581/head -> origin/pr/2581/head
* [new ref] refs/pull/2581/merge -> origin/pr/2581/merge
* [new ref] refs/pull/2582/head -> origin/pr/2582/head
* [new ref] refs/pull/2582/merge -> origin/pr/2582/merge
* [new ref] refs/pull/2583/head -> origin/pr/2583/head
* [new ref] refs/pull/2583/merge -> origin/pr/2583/merge
* [new ref] refs/pull/2584/head -> origin/pr/2584/head
* [new ref] refs/pull/2584/merge -> origin/pr/2584/merge
* [new ref] refs/pull/2585/head -> origin/pr/2585/head
* [new ref] refs/pull/2585/merge -> origin/pr/2585/merge
* [new ref] refs/pull/2586/head -> origin/pr/2586/head
* [new ref] refs/pull/2586/merge -> origin/pr/2586/merge
* [new ref] refs/pull/2587/head -> origin/pr/2587/head
* [new ref] refs/pull/2587/merge -> origin/pr/2587/merge
* [new ref] refs/pull/2588/head -> origin/pr/2588/head
error: unable to resolve reference refs/remotes/origin/pr/592/merge: No such file or directory
! 3af926b...e816697 refs/pull/592/merge -> origin/pr/592/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/610/merge: No such file or directory
! 48d03d0...ff3ad90 refs/pull/610/merge -> origin/pr/610/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/618/merge: No such file or directory
! ff85f45...bef390f refs/pull/618/merge -> origin/pr/618/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/682/merge: No such file or directory
! 74ed1e8...5a4558b refs/pull/682/merge -> origin/pr/682/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/727/merge: No such file or directory
! d20a818...9dea77a refs/pull/727/merge -> origin/pr/727/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/728/merge: No such file or directory
! ad97d7e...6a2c66f refs/pull/728/merge -> origin/pr/728/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/732/merge: No such file or directory
! 9161b26...4e32f69 refs/pull/732/merge -> origin/pr/732/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/740/merge: No such file or directory
! 69ac523...5faa7e1 refs/pull/740/merge -> origin/pr/740/merge (unable to update local ref)
Auto packing the repository for optimum performance. You may also
run "git gc" manually. See "git help gc" for more information.
warning: There are too many unreachable loose objects; run 'git prune' to remove them.
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1799)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1525)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:65)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:316)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor862.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy103.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 8a00f225454bcc742e5b38a499237bd5de455fb7 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 8a00f225454bcc742e5b38a499237bd5de455fb7
> git rev-list 57929fb802d0cb6a6b6c3f14819d473dc2ace113 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson855294298243729482.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2762815817616975954.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3848627904993101890.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson1824862734094644161.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-19 12:02:27,362 10f41cb0 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/10f41cb0/pkb.log
2017-04-19 12:02:27,362 10f41cb0 MainThread INFO PerfKitBenchmarker version: v1.11.0-43-g6012a89
2017-04-19 12:02:27,363 10f41cb0 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-19 12:02:27,689 10f41cb0 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-19 12:02:27,781 10f41cb0 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-19 12:02:27,783 10f41cb0 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-19 12:02:27,784 10f41cb0 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-19 12:02:27,792 10f41cb0 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-19 12:02:27,794 10f41cb0 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-19 12:02:27,840 10f41cb0 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-19 12:02:27,840 10f41cb0 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/10f41cb0/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #326
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/326/display/redirect?page=changes>
Changes:
[dhalperi] Delete deprecated AttemptAndTimeBoundedExponentialBackoff
[dhalperi] Remove deprecated method in IOChannelUtils
[dhalperi] Remove deprecated/unused code from Pipeline
[dhalperi] Delete AttemptBoundedExponentialBackoff
[dhalperi] Delete IntervalBoundedExponentialBackoff
[dhalperi] Delete AppEngineEnvironment
[dhalperi] Upgrade worker to not depend on deprecated now deleted code
[dhalperi] Changed snappy version to 1.1.4-M3
[kirpichov] Separates side input test and side output test
[kirpichov] ProcessFn remembers more info about its application context
[kirpichov] Minor cleanups in ParDoEvaluator
[kirpichov] Extracts interface from PushbackSideInputDoFnRunner
[kirpichov] Creates ProcessFnRunner and wires it through ParDoEvaluator
[kirpichov] Explodes windows before GBKIKWI
[kirpichov] Use tableRefFunction throughout BigQueryIO. Constant table writes use
[kirpichov] Add PrepareWrite transform.
[kirpichov] Refactor streaming write branch into separate reusable components.
[kirpichov] Refactor batch load job path, and add support for data-dependent tables.
[kirpichov] Refactor batch loads, and add support for windowed writes.
[kirpichov] Fix tests to properly fake out BigQueryService, and add tests for
[kirpichov] Separate streaming writes into two pluggable components - CreateTables,
------------------------------------------
[...truncated 273.30 KB...]
* [new ref] refs/pull/2540/head -> origin/pr/2540/head
* [new ref] refs/pull/2540/merge -> origin/pr/2540/merge
* [new ref] refs/pull/2541/head -> origin/pr/2541/head
* [new ref] refs/pull/2541/merge -> origin/pr/2541/merge
* [new ref] refs/pull/2542/head -> origin/pr/2542/head
* [new ref] refs/pull/2542/merge -> origin/pr/2542/merge
* [new ref] refs/pull/2543/head -> origin/pr/2543/head
* [new ref] refs/pull/2543/merge -> origin/pr/2543/merge
* [new ref] refs/pull/2544/head -> origin/pr/2544/head
* [new ref] refs/pull/2544/merge -> origin/pr/2544/merge
* [new ref] refs/pull/2545/head -> origin/pr/2545/head
* [new ref] refs/pull/2545/merge -> origin/pr/2545/merge
* [new ref] refs/pull/2546/head -> origin/pr/2546/head
* [new ref] refs/pull/2546/merge -> origin/pr/2546/merge
* [new ref] refs/pull/2547/head -> origin/pr/2547/head
* [new ref] refs/pull/2547/merge -> origin/pr/2547/merge
* [new ref] refs/pull/2548/head -> origin/pr/2548/head
* [new ref] refs/pull/2548/merge -> origin/pr/2548/merge
error: unable to resolve reference refs/remotes/origin/pr/2549/merge: No such file or directory
! 3490028...04ca87a refs/pull/2549/merge -> origin/pr/2549/merge (unable to update local ref)
* [new ref] refs/pull/2550/head -> origin/pr/2550/head
* [new ref] refs/pull/2550/merge -> origin/pr/2550/merge
* [new ref] refs/pull/2551/head -> origin/pr/2551/head
* [new ref] refs/pull/2551/merge -> origin/pr/2551/merge
* [new ref] refs/pull/2552/head -> origin/pr/2552/head
* [new ref] refs/pull/2552/merge -> origin/pr/2552/merge
* [new ref] refs/pull/2553/head -> origin/pr/2553/head
* [new ref] refs/pull/2553/merge -> origin/pr/2553/merge
* [new ref] refs/pull/2554/head -> origin/pr/2554/head
* [new ref] refs/pull/2554/merge -> origin/pr/2554/merge
* [new ref] refs/pull/2555/head -> origin/pr/2555/head
* [new ref] refs/pull/2555/merge -> origin/pr/2555/merge
* [new ref] refs/pull/2556/head -> origin/pr/2556/head
* [new ref] refs/pull/2556/merge -> origin/pr/2556/merge
* [new ref] refs/pull/2557/head -> origin/pr/2557/head
* [new ref] refs/pull/2557/merge -> origin/pr/2557/merge
* [new ref] refs/pull/2558/head -> origin/pr/2558/head
* [new ref] refs/pull/2558/merge -> origin/pr/2558/merge
* [new ref] refs/pull/2559/head -> origin/pr/2559/head
* [new ref] refs/pull/2559/merge -> origin/pr/2559/merge
* [new ref] refs/pull/2560/head -> origin/pr/2560/head
* [new ref] refs/pull/2560/merge -> origin/pr/2560/merge
* [new ref] refs/pull/2561/head -> origin/pr/2561/head
* [new ref] refs/pull/2561/merge -> origin/pr/2561/merge
* [new ref] refs/pull/2562/head -> origin/pr/2562/head
* [new ref] refs/pull/2562/merge -> origin/pr/2562/merge
* [new ref] refs/pull/2563/head -> origin/pr/2563/head
* [new ref] refs/pull/2563/merge -> origin/pr/2563/merge
* [new ref] refs/pull/2564/head -> origin/pr/2564/head
* [new ref] refs/pull/2564/merge -> origin/pr/2564/merge
* [new ref] refs/pull/2565/head -> origin/pr/2565/head
* [new ref] refs/pull/2565/merge -> origin/pr/2565/merge
* [new ref] refs/pull/2566/head -> origin/pr/2566/head
* [new ref] refs/pull/2566/merge -> origin/pr/2566/merge
* [new ref] refs/pull/2567/head -> origin/pr/2567/head
* [new ref] refs/pull/2567/merge -> origin/pr/2567/merge
* [new ref] refs/pull/2568/head -> origin/pr/2568/head
* [new ref] refs/pull/2569/head -> origin/pr/2569/head
* [new ref] refs/pull/2569/merge -> origin/pr/2569/merge
* [new ref] refs/pull/2570/head -> origin/pr/2570/head
* [new ref] refs/pull/2570/merge -> origin/pr/2570/merge
* [new ref] refs/pull/2571/head -> origin/pr/2571/head
* [new ref] refs/pull/2571/merge -> origin/pr/2571/merge
* [new ref] refs/pull/2572/head -> origin/pr/2572/head
* [new ref] refs/pull/2572/merge -> origin/pr/2572/merge
* [new ref] refs/pull/2573/head -> origin/pr/2573/head
* [new ref] refs/pull/2573/merge -> origin/pr/2573/merge
* [new ref] refs/pull/2574/head -> origin/pr/2574/head
* [new ref] refs/pull/2575/head -> origin/pr/2575/head
* [new ref] refs/pull/2575/merge -> origin/pr/2575/merge
* [new ref] refs/pull/2576/head -> origin/pr/2576/head
* [new ref] refs/pull/2576/merge -> origin/pr/2576/merge
* [new ref] refs/pull/2577/head -> origin/pr/2577/head
* [new ref] refs/pull/2577/merge -> origin/pr/2577/merge
* [new ref] refs/pull/2578/head -> origin/pr/2578/head
* [new ref] refs/pull/2578/merge -> origin/pr/2578/merge
* [new ref] refs/pull/2579/head -> origin/pr/2579/head
* [new ref] refs/pull/2579/merge -> origin/pr/2579/merge
* [new ref] refs/pull/2580/head -> origin/pr/2580/head
* [new ref] refs/pull/2581/head -> origin/pr/2581/head
* [new ref] refs/pull/2581/merge -> origin/pr/2581/merge
* [new ref] refs/pull/2582/head -> origin/pr/2582/head
* [new ref] refs/pull/2582/merge -> origin/pr/2582/merge
* [new ref] refs/pull/2583/head -> origin/pr/2583/head
* [new ref] refs/pull/2583/merge -> origin/pr/2583/merge
* [new ref] refs/pull/2584/head -> origin/pr/2584/head
* [new ref] refs/pull/2584/merge -> origin/pr/2584/merge
* [new ref] refs/pull/2585/head -> origin/pr/2585/head
* [new ref] refs/pull/2585/merge -> origin/pr/2585/merge
* [new ref] refs/pull/2586/head -> origin/pr/2586/head
* [new ref] refs/pull/2586/merge -> origin/pr/2586/merge
* [new ref] refs/pull/2587/head -> origin/pr/2587/head
* [new ref] refs/pull/2587/merge -> origin/pr/2587/merge
error: unable to resolve reference refs/remotes/origin/pr/288/merge: No such file or directory
! 19675f4...33b68a2 refs/pull/288/merge -> origin/pr/288/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/311/merge: No such file or directory
! b1b5420...38f43c8 refs/pull/311/merge -> origin/pr/311/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/314/merge: No such file or directory
! 049852e...387f0d0 refs/pull/314/merge -> origin/pr/314/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/373/merge: No such file or directory
! b76a439...e477b34 refs/pull/373/merge -> origin/pr/373/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/405/merge: No such file or directory
! 49c7afb...53cc1f3 refs/pull/405/merge -> origin/pr/405/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/439/merge: No such file or directory
! 7316fec...1af3a6a refs/pull/439/merge -> origin/pr/439/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/455/merge: No such file or directory
! 895dfbd...0cb45d9 refs/pull/455/merge -> origin/pr/455/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/456/merge: No such file or directory
! afdd93d...9f247c6 refs/pull/456/merge -> origin/pr/456/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/477/merge: No such file or directory
! 0072b18...e6a7374 refs/pull/477/merge -> origin/pr/477/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/478/merge: No such file or directory
! e6d165e...99723f9 refs/pull/478/merge -> origin/pr/478/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/501/merge: No such file or directory
! 774a826...1465309 refs/pull/501/merge -> origin/pr/501/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/506/merge: No such file or directory
! b8b554c...10d253a refs/pull/506/merge -> origin/pr/506/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/511/merge: No such file or directory
! 4e29989...7d39fcd refs/pull/511/merge -> origin/pr/511/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/515/merge: No such file or directory
! 330a4ce...dd58944 refs/pull/515/merge -> origin/pr/515/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/541/merge: No such file or directory
! 359ac26...600cfee refs/pull/541/merge -> origin/pr/541/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/572/merge: No such file or directory
! 026ae3c...dfe226f refs/pull/572/merge -> origin/pr/572/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/577/merge: No such file or directory
! ebba24a...649c63b refs/pull/577/merge -> origin/pr/577/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/583/merge: No such file or directory
! 3ba48ca...1525173 refs/pull/583/merge -> origin/pr/583/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/586/merge: No such file or directory
! 4657dbe...52f541b refs/pull/586/merge -> origin/pr/586/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/592/merge: No such file or directory
! f5b7f08...3af926b refs/pull/592/merge -> origin/pr/592/merge (unable to update local ref)
Auto packing the repository for optimum performance. You may also
run "git gc" manually. See "git help gc" for more information.
warning: There are too many unreachable loose objects; run 'git prune' to remove them.
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1799)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1525)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:65)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:316)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor862.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy103.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 57929fb802d0cb6a6b6c3f14819d473dc2ace113 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 57929fb802d0cb6a6b6c3f14819d473dc2ace113
> git rev-list 6d3fe51ce3240cea54e01cb61723f1547039904d # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4777849911207284166.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson1618973676818635769.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2986352072992804019.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3477464880998356108.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-19 06:02:25,873 027dd7cc MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/027dd7cc/pkb.log
2017-04-19 06:02:25,874 027dd7cc MainThread INFO PerfKitBenchmarker version: v1.11.0-43-g6012a89
2017-04-19 06:02:25,875 027dd7cc MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-19 06:02:26,538 027dd7cc MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-19 06:02:26,700 027dd7cc MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-19 06:02:26,814 027dd7cc MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-19 06:02:26,815 027dd7cc MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-19 06:02:26,821 027dd7cc MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-19 06:02:26,823 027dd7cc MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-19 06:02:26,836 027dd7cc MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-19 06:02:26,837 027dd7cc MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/027dd7cc/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #325
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/325/display/redirect?page=changes>
Changes:
[kirpichov] Revert "Removes final minor usages of OldDoFn outside OldDoFn itself"
[dhalperi] [BEAM-1272] Align the naming of "generateInitialSplits" and
[kirpichov] [BEAM-1990] Comment: Don't use Window.Assign
[tgroh] Rename SideOutputValue to OutputValue
[dhalperi] runners-core-construction-java fix artifact name
[kirpichov] Gets rid of TFRecordIO.Read.Bound
[kirpichov] Converts TFRecordIO.Read to AutoValue
[kirpichov] Gets rid of TFRecordIO.Write.Bound
[kirpichov] Converts TFRecordIO.Write to AutoValue
[kirpichov] Removes unused validation parameter
[altay] Revert "Revert "Revert "Revert "Add ValueProvider class for
[altay] Revert "Revert "Throw specialized exception in value providers""
[altay] Remove options_id concept from templated runs.
[altay] [BEAM-1964] Upgrade Pylint
[lcwik] [BEAM-1871] Create new GCP core module package and move several GCP
------------------------------------------
[...truncated 217.71 KB...]
x [deleted] (none) -> origin/pr/93/head
x [deleted] (none) -> origin/pr/930/head
x [deleted] (none) -> origin/pr/930/merge
x [deleted] (none) -> origin/pr/931/head
x [deleted] (none) -> origin/pr/931/merge
x [deleted] (none) -> origin/pr/932/head
x [deleted] (none) -> origin/pr/932/merge
x [deleted] (none) -> origin/pr/933/head
x [deleted] (none) -> origin/pr/933/merge
x [deleted] (none) -> origin/pr/934/head
x [deleted] (none) -> origin/pr/934/merge
x [deleted] (none) -> origin/pr/935/head
x [deleted] (none) -> origin/pr/936/head
x [deleted] (none) -> origin/pr/936/merge
x [deleted] (none) -> origin/pr/937/head
x [deleted] (none) -> origin/pr/937/merge
x [deleted] (none) -> origin/pr/938/head
x [deleted] (none) -> origin/pr/939/head
x [deleted] (none) -> origin/pr/94/head
x [deleted] (none) -> origin/pr/940/head
x [deleted] (none) -> origin/pr/940/merge
x [deleted] (none) -> origin/pr/941/head
x [deleted] (none) -> origin/pr/941/merge
x [deleted] (none) -> origin/pr/942/head
x [deleted] (none) -> origin/pr/942/merge
x [deleted] (none) -> origin/pr/943/head
x [deleted] (none) -> origin/pr/943/merge
x [deleted] (none) -> origin/pr/944/head
x [deleted] (none) -> origin/pr/945/head
x [deleted] (none) -> origin/pr/945/merge
x [deleted] (none) -> origin/pr/946/head
x [deleted] (none) -> origin/pr/946/merge
x [deleted] (none) -> origin/pr/947/head
x [deleted] (none) -> origin/pr/947/merge
x [deleted] (none) -> origin/pr/948/head
x [deleted] (none) -> origin/pr/948/merge
x [deleted] (none) -> origin/pr/949/head
x [deleted] (none) -> origin/pr/949/merge
x [deleted] (none) -> origin/pr/95/head
x [deleted] (none) -> origin/pr/95/merge
x [deleted] (none) -> origin/pr/950/head
x [deleted] (none) -> origin/pr/951/head
x [deleted] (none) -> origin/pr/951/merge
x [deleted] (none) -> origin/pr/952/head
x [deleted] (none) -> origin/pr/952/merge
x [deleted] (none) -> origin/pr/953/head
x [deleted] (none) -> origin/pr/954/head
x [deleted] (none) -> origin/pr/954/merge
x [deleted] (none) -> origin/pr/955/head
x [deleted] (none) -> origin/pr/955/merge
x [deleted] (none) -> origin/pr/956/head
x [deleted] (none) -> origin/pr/957/head
x [deleted] (none) -> origin/pr/958/head
x [deleted] (none) -> origin/pr/959/head
x [deleted] (none) -> origin/pr/959/merge
x [deleted] (none) -> origin/pr/96/head
x [deleted] (none) -> origin/pr/96/merge
x [deleted] (none) -> origin/pr/960/head
x [deleted] (none) -> origin/pr/960/merge
x [deleted] (none) -> origin/pr/961/head
x [deleted] (none) -> origin/pr/962/head
x [deleted] (none) -> origin/pr/962/merge
x [deleted] (none) -> origin/pr/963/head
x [deleted] (none) -> origin/pr/963/merge
x [deleted] (none) -> origin/pr/964/head
x [deleted] (none) -> origin/pr/965/head
x [deleted] (none) -> origin/pr/965/merge
x [deleted] (none) -> origin/pr/966/head
x [deleted] (none) -> origin/pr/967/head
x [deleted] (none) -> origin/pr/967/merge
x [deleted] (none) -> origin/pr/968/head
x [deleted] (none) -> origin/pr/968/merge
x [deleted] (none) -> origin/pr/969/head
x [deleted] (none) -> origin/pr/969/merge
x [deleted] (none) -> origin/pr/97/head
x [deleted] (none) -> origin/pr/97/merge
x [deleted] (none) -> origin/pr/970/head
x [deleted] (none) -> origin/pr/970/merge
x [deleted] (none) -> origin/pr/971/head
x [deleted] (none) -> origin/pr/971/merge
x [deleted] (none) -> origin/pr/972/head
x [deleted] (none) -> origin/pr/973/head
x [deleted] (none) -> origin/pr/974/head
x [deleted] (none) -> origin/pr/974/merge
x [deleted] (none) -> origin/pr/975/head
x [deleted] (none) -> origin/pr/975/merge
x [deleted] (none) -> origin/pr/976/head
x [deleted] (none) -> origin/pr/976/merge
x [deleted] (none) -> origin/pr/977/head
x [deleted] (none) -> origin/pr/977/merge
x [deleted] (none) -> origin/pr/978/head
x [deleted] (none) -> origin/pr/978/merge
x [deleted] (none) -> origin/pr/979/head
x [deleted] (none) -> origin/pr/979/merge
x [deleted] (none) -> origin/pr/98/head
x [deleted] (none) -> origin/pr/980/head
x [deleted] (none) -> origin/pr/980/merge
x [deleted] (none) -> origin/pr/981/head
x [deleted] (none) -> origin/pr/982/head
x [deleted] (none) -> origin/pr/982/merge
x [deleted] (none) -> origin/pr/983/head
x [deleted] (none) -> origin/pr/983/merge
x [deleted] (none) -> origin/pr/984/head
x [deleted] (none) -> origin/pr/984/merge
x [deleted] (none) -> origin/pr/985/head
x [deleted] (none) -> origin/pr/985/merge
x [deleted] (none) -> origin/pr/986/head
x [deleted] (none) -> origin/pr/986/merge
x [deleted] (none) -> origin/pr/987/head
x [deleted] (none) -> origin/pr/988/head
x [deleted] (none) -> origin/pr/988/merge
x [deleted] (none) -> origin/pr/989/head
x [deleted] (none) -> origin/pr/989/merge
x [deleted] (none) -> origin/pr/99/head
x [deleted] (none) -> origin/pr/99/merge
x [deleted] (none) -> origin/pr/990/head
x [deleted] (none) -> origin/pr/990/merge
x [deleted] (none) -> origin/pr/991/head
x [deleted] (none) -> origin/pr/991/merge
x [deleted] (none) -> origin/pr/992/head
x [deleted] (none) -> origin/pr/992/merge
x [deleted] (none) -> origin/pr/993/head
x [deleted] (none) -> origin/pr/993/merge
x [deleted] (none) -> origin/pr/994/head
x [deleted] (none) -> origin/pr/994/merge
x [deleted] (none) -> origin/pr/995/head
x [deleted] (none) -> origin/pr/995/merge
x [deleted] (none) -> origin/pr/996/head
x [deleted] (none) -> origin/pr/996/merge
x [deleted] (none) -> origin/pr/997/head
x [deleted] (none) -> origin/pr/997/merge
x [deleted] (none) -> origin/pr/998/head
x [deleted] (none) -> origin/pr/999/head
x [deleted] (none) -> origin/pr/999/merge
error: RPC failed; result=18, HTTP code = 200
fatal: The remote end hung up unexpectedly
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1799)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1525)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:65)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:316)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam4(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor862.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy103.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 6d3fe51ce3240cea54e01cb61723f1547039904d (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 6d3fe51ce3240cea54e01cb61723f1547039904d
> git rev-list 8f4bb0158cecb8c4144766706fa9d70b094fc88d # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson1329739036196276955.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5801673408767828225.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5168717403391126895.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2981690994877704682.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-19 00:03:17,038 b91b9bc2 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/b91b9bc2/pkb.log
2017-04-19 00:03:17,038 b91b9bc2 MainThread INFO PerfKitBenchmarker version: v1.11.0-43-g6012a89
2017-04-19 00:03:17,039 b91b9bc2 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-19 00:03:17,628 b91b9bc2 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-19 00:03:17,740 b91b9bc2 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-19 00:03:17,744 b91b9bc2 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-19 00:03:17,744 b91b9bc2 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-19 00:03:17,751 b91b9bc2 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-19 00:03:17,754 b91b9bc2 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-19 00:03:17,765 b91b9bc2 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-19 00:03:17,766 b91b9bc2 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/b91b9bc2/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #324
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/324/display/redirect?page=changes>
Changes:
[iemejia] Enable flink dependency enforcement and make dependencies explicit
[iemejia] Fix Javadoc warnings on Flink Runner
[iemejia] Remove flink-annotations dependency
[iemejia] [BEAM-1993] Remove special unbounded Flink source/sink
[tgroh] Translate PTransforms to and from Runner API Protos
[altay] Clean up DirectRunner Clock and TransformResult
[altay] Remove overloading of __call__ in DirectRunner
[altay] Making metrics usage in datastore_wordcount consistent
[dhalperi] Fix Hadoop pom.xml
------------------------------------------
[...truncated 261.99 KB...]
* [new ref] refs/pull/2516/head -> origin/pr/2516/head
* [new ref] refs/pull/2516/merge -> origin/pr/2516/merge
* [new ref] refs/pull/2517/head -> origin/pr/2517/head
* [new ref] refs/pull/2517/merge -> origin/pr/2517/merge
* [new ref] refs/pull/2518/head -> origin/pr/2518/head
* [new ref] refs/pull/2518/merge -> origin/pr/2518/merge
* [new ref] refs/pull/2519/head -> origin/pr/2519/head
* [new ref] refs/pull/2519/merge -> origin/pr/2519/merge
* [new ref] refs/pull/2520/head -> origin/pr/2520/head
* [new ref] refs/pull/2520/merge -> origin/pr/2520/merge
* [new ref] refs/pull/2521/head -> origin/pr/2521/head
* [new ref] refs/pull/2521/merge -> origin/pr/2521/merge
* [new ref] refs/pull/2522/head -> origin/pr/2522/head
* [new ref] refs/pull/2522/merge -> origin/pr/2522/merge
* [new ref] refs/pull/2523/head -> origin/pr/2523/head
* [new ref] refs/pull/2523/merge -> origin/pr/2523/merge
* [new ref] refs/pull/2524/head -> origin/pr/2524/head
* [new ref] refs/pull/2525/head -> origin/pr/2525/head
* [new ref] refs/pull/2525/merge -> origin/pr/2525/merge
* [new ref] refs/pull/2526/head -> origin/pr/2526/head
* [new ref] refs/pull/2527/head -> origin/pr/2527/head
* [new ref] refs/pull/2527/merge -> origin/pr/2527/merge
* [new ref] refs/pull/2528/head -> origin/pr/2528/head
* [new ref] refs/pull/2528/merge -> origin/pr/2528/merge
* [new ref] refs/pull/2529/head -> origin/pr/2529/head
* [new ref] refs/pull/2529/merge -> origin/pr/2529/merge
* [new ref] refs/pull/2530/head -> origin/pr/2530/head
* [new ref] refs/pull/2530/merge -> origin/pr/2530/merge
* [new ref] refs/pull/2531/head -> origin/pr/2531/head
* [new ref] refs/pull/2531/merge -> origin/pr/2531/merge
* [new ref] refs/pull/2532/head -> origin/pr/2532/head
* [new ref] refs/pull/2532/merge -> origin/pr/2532/merge
* [new ref] refs/pull/2533/head -> origin/pr/2533/head
* [new ref] refs/pull/2533/merge -> origin/pr/2533/merge
* [new ref] refs/pull/2534/head -> origin/pr/2534/head
* [new ref] refs/pull/2534/merge -> origin/pr/2534/merge
* [new ref] refs/pull/2535/head -> origin/pr/2535/head
* [new ref] refs/pull/2535/merge -> origin/pr/2535/merge
* [new ref] refs/pull/2536/head -> origin/pr/2536/head
* [new ref] refs/pull/2536/merge -> origin/pr/2536/merge
* [new ref] refs/pull/2537/head -> origin/pr/2537/head
* [new ref] refs/pull/2537/merge -> origin/pr/2537/merge
* [new ref] refs/pull/2538/head -> origin/pr/2538/head
* [new ref] refs/pull/2538/merge -> origin/pr/2538/merge
* [new ref] refs/pull/2539/head -> origin/pr/2539/head
* [new ref] refs/pull/2539/merge -> origin/pr/2539/merge
* [new ref] refs/pull/2540/head -> origin/pr/2540/head
* [new ref] refs/pull/2540/merge -> origin/pr/2540/merge
* [new ref] refs/pull/2541/head -> origin/pr/2541/head
* [new ref] refs/pull/2541/merge -> origin/pr/2541/merge
* [new ref] refs/pull/2542/head -> origin/pr/2542/head
* [new ref] refs/pull/2542/merge -> origin/pr/2542/merge
* [new ref] refs/pull/2543/head -> origin/pr/2543/head
* [new ref] refs/pull/2543/merge -> origin/pr/2543/merge
* [new ref] refs/pull/2544/head -> origin/pr/2544/head
* [new ref] refs/pull/2544/merge -> origin/pr/2544/merge
* [new ref] refs/pull/2545/head -> origin/pr/2545/head
* [new ref] refs/pull/2545/merge -> origin/pr/2545/merge
* [new ref] refs/pull/2546/head -> origin/pr/2546/head
* [new ref] refs/pull/2546/merge -> origin/pr/2546/merge
* [new ref] refs/pull/2547/head -> origin/pr/2547/head
* [new ref] refs/pull/2547/merge -> origin/pr/2547/merge
* [new ref] refs/pull/2548/head -> origin/pr/2548/head
* [new ref] refs/pull/2548/merge -> origin/pr/2548/merge
error: unable to resolve reference refs/remotes/origin/pr/2549/head: No such file or directory
! 89d82a1..8c5778e refs/pull/2549/head -> origin/pr/2549/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2549/merge: No such file or directory
! 8278987...3490028 refs/pull/2549/merge -> origin/pr/2549/merge (unable to update local ref)
* [new ref] refs/pull/2550/head -> origin/pr/2550/head
* [new ref] refs/pull/2550/merge -> origin/pr/2550/merge
* [new ref] refs/pull/2551/head -> origin/pr/2551/head
* [new ref] refs/pull/2551/merge -> origin/pr/2551/merge
* [new ref] refs/pull/2552/head -> origin/pr/2552/head
* [new ref] refs/pull/2552/merge -> origin/pr/2552/merge
* [new ref] refs/pull/2553/head -> origin/pr/2553/head
* [new ref] refs/pull/2553/merge -> origin/pr/2553/merge
* [new ref] refs/pull/2554/head -> origin/pr/2554/head
* [new ref] refs/pull/2554/merge -> origin/pr/2554/merge
* [new ref] refs/pull/2555/head -> origin/pr/2555/head
* [new ref] refs/pull/2555/merge -> origin/pr/2555/merge
* [new ref] refs/pull/2556/head -> origin/pr/2556/head
* [new ref] refs/pull/2556/merge -> origin/pr/2556/merge
* [new ref] refs/pull/2557/head -> origin/pr/2557/head
* [new ref] refs/pull/2557/merge -> origin/pr/2557/merge
* [new ref] refs/pull/2558/head -> origin/pr/2558/head
* [new ref] refs/pull/2558/merge -> origin/pr/2558/merge
* [new ref] refs/pull/2559/head -> origin/pr/2559/head
* [new ref] refs/pull/2559/merge -> origin/pr/2559/merge
* [new ref] refs/pull/2560/head -> origin/pr/2560/head
* [new ref] refs/pull/2560/merge -> origin/pr/2560/merge
* [new ref] refs/pull/2561/head -> origin/pr/2561/head
* [new ref] refs/pull/2561/merge -> origin/pr/2561/merge
* [new ref] refs/pull/2562/head -> origin/pr/2562/head
* [new ref] refs/pull/2562/merge -> origin/pr/2562/merge
* [new ref] refs/pull/2563/head -> origin/pr/2563/head
* [new ref] refs/pull/2563/merge -> origin/pr/2563/merge
* [new ref] refs/pull/2564/head -> origin/pr/2564/head
* [new ref] refs/pull/2564/merge -> origin/pr/2564/merge
* [new ref] refs/pull/2565/head -> origin/pr/2565/head
* [new ref] refs/pull/2565/merge -> origin/pr/2565/merge
* [new ref] refs/pull/2566/head -> origin/pr/2566/head
* [new ref] refs/pull/2566/merge -> origin/pr/2566/merge
* [new ref] refs/pull/2567/head -> origin/pr/2567/head
* [new ref] refs/pull/2567/merge -> origin/pr/2567/merge
* [new ref] refs/pull/2568/head -> origin/pr/2568/head
* [new ref] refs/pull/2568/merge -> origin/pr/2568/merge
* [new ref] refs/pull/2569/head -> origin/pr/2569/head
* [new ref] refs/pull/2569/merge -> origin/pr/2569/merge
* [new ref] refs/pull/2570/head -> origin/pr/2570/head
* [new ref] refs/pull/2570/merge -> origin/pr/2570/merge
* [new ref] refs/pull/2571/head -> origin/pr/2571/head
* [new ref] refs/pull/2571/merge -> origin/pr/2571/merge
* [new ref] refs/pull/2572/head -> origin/pr/2572/head
* [new ref] refs/pull/2572/merge -> origin/pr/2572/merge
* [new ref] refs/pull/2573/head -> origin/pr/2573/head
* [new ref] refs/pull/2573/merge -> origin/pr/2573/merge
* [new ref] refs/pull/2574/head -> origin/pr/2574/head
* [new ref] refs/pull/2575/head -> origin/pr/2575/head
* [new ref] refs/pull/2575/merge -> origin/pr/2575/merge
* [new ref] refs/pull/2576/head -> origin/pr/2576/head
* [new ref] refs/pull/2576/merge -> origin/pr/2576/merge
* [new ref] refs/pull/2577/head -> origin/pr/2577/head
* [new ref] refs/pull/2577/merge -> origin/pr/2577/merge
* [new ref] refs/pull/2578/head -> origin/pr/2578/head
* [new ref] refs/pull/2578/merge -> origin/pr/2578/merge
* [new ref] refs/pull/2579/head -> origin/pr/2579/head
* [new ref] refs/pull/2579/merge -> origin/pr/2579/merge
error: unable to resolve reference refs/remotes/origin/pr/278/merge: No such file or directory
! 4c5e015...0d23148 refs/pull/278/merge -> origin/pr/278/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/284/merge: No such file or directory
! 5d30780...da52238 refs/pull/284/merge -> origin/pr/284/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/592/merge: No such file or directory
! 79eade4...f5b7f08 refs/pull/592/merge -> origin/pr/592/merge (unable to update local ref)
Auto packing the repository for optimum performance. You may also
run "git gc" manually. See "git help gc" for more information.
warning: There are too many unreachable loose objects; run 'git prune' to remove them.
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1799)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1525)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:65)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:316)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor862.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy103.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 8f4bb0158cecb8c4144766706fa9d70b094fc88d (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 8f4bb0158cecb8c4144766706fa9d70b094fc88d
> git rev-list e5568589cab11399126f678ad3fbca4b1fb715e4 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson8901619799384700904.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson6553407579883199676.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2767305992257758221.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson1924418183473579911.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-18 18:02:36,580 64a3ea9e MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/64a3ea9e/pkb.log
2017-04-18 18:02:36,586 64a3ea9e MainThread INFO PerfKitBenchmarker version: v1.11.0-43-g6012a89
2017-04-18 18:02:36,587 64a3ea9e MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-18 18:02:37,016 64a3ea9e MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-18 18:02:37,133 64a3ea9e MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-18 18:02:37,135 64a3ea9e MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-18 18:02:37,135 64a3ea9e MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-18 18:02:37,140 64a3ea9e MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-18 18:02:37,142 64a3ea9e MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-18 18:02:37,166 64a3ea9e MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-18 18:02:37,166 64a3ea9e MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/64a3ea9e/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #323
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/323/display/redirect?page=changes>
Changes:
[jbonofre] [BEAM-59] Register standard FileSystems wherever we register
------------------------------------------
[...truncated 258.28 KB...]
! d965a1a...43d8ac2 refs/pull/2474/merge -> origin/pr/2474/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2476/merge: No such file or directory
! ee99a31...397b97d refs/pull/2476/merge -> origin/pr/2476/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2488/merge: No such file or directory
! bef69b5...2eef1fd refs/pull/2488/merge -> origin/pr/2488/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2507/merge: No such file or directory
! 366bf52...8456a6d refs/pull/2507/merge -> origin/pr/2507/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2508/merge: No such file or directory
! c7c0bed...a3b43b6 refs/pull/2508/merge -> origin/pr/2508/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2509/merge: No such file or directory
! 431c487...214205d refs/pull/2509/merge -> origin/pr/2509/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2510/merge: No such file or directory
! 1202743...5882b32 refs/pull/2510/merge -> origin/pr/2510/merge (unable to update local ref)
* [new ref] refs/pull/2516/head -> origin/pr/2516/head
* [new ref] refs/pull/2516/merge -> origin/pr/2516/merge
* [new ref] refs/pull/2517/head -> origin/pr/2517/head
* [new ref] refs/pull/2517/merge -> origin/pr/2517/merge
* [new ref] refs/pull/2518/head -> origin/pr/2518/head
* [new ref] refs/pull/2518/merge -> origin/pr/2518/merge
* [new ref] refs/pull/2519/head -> origin/pr/2519/head
* [new ref] refs/pull/2519/merge -> origin/pr/2519/merge
* [new ref] refs/pull/2520/head -> origin/pr/2520/head
* [new ref] refs/pull/2520/merge -> origin/pr/2520/merge
* [new ref] refs/pull/2521/head -> origin/pr/2521/head
* [new ref] refs/pull/2521/merge -> origin/pr/2521/merge
* [new ref] refs/pull/2522/head -> origin/pr/2522/head
* [new ref] refs/pull/2522/merge -> origin/pr/2522/merge
* [new ref] refs/pull/2523/head -> origin/pr/2523/head
* [new ref] refs/pull/2523/merge -> origin/pr/2523/merge
* [new ref] refs/pull/2524/head -> origin/pr/2524/head
* [new ref] refs/pull/2525/head -> origin/pr/2525/head
* [new ref] refs/pull/2525/merge -> origin/pr/2525/merge
* [new ref] refs/pull/2526/head -> origin/pr/2526/head
* [new ref] refs/pull/2527/head -> origin/pr/2527/head
* [new ref] refs/pull/2527/merge -> origin/pr/2527/merge
* [new ref] refs/pull/2528/head -> origin/pr/2528/head
* [new ref] refs/pull/2528/merge -> origin/pr/2528/merge
* [new ref] refs/pull/2529/head -> origin/pr/2529/head
* [new ref] refs/pull/2529/merge -> origin/pr/2529/merge
* [new ref] refs/pull/2530/head -> origin/pr/2530/head
* [new ref] refs/pull/2530/merge -> origin/pr/2530/merge
* [new ref] refs/pull/2531/head -> origin/pr/2531/head
* [new ref] refs/pull/2531/merge -> origin/pr/2531/merge
* [new ref] refs/pull/2532/head -> origin/pr/2532/head
* [new ref] refs/pull/2532/merge -> origin/pr/2532/merge
* [new ref] refs/pull/2533/head -> origin/pr/2533/head
* [new ref] refs/pull/2533/merge -> origin/pr/2533/merge
* [new ref] refs/pull/2534/head -> origin/pr/2534/head
* [new ref] refs/pull/2534/merge -> origin/pr/2534/merge
* [new ref] refs/pull/2535/head -> origin/pr/2535/head
* [new ref] refs/pull/2535/merge -> origin/pr/2535/merge
* [new ref] refs/pull/2536/head -> origin/pr/2536/head
* [new ref] refs/pull/2536/merge -> origin/pr/2536/merge
* [new ref] refs/pull/2537/head -> origin/pr/2537/head
* [new ref] refs/pull/2537/merge -> origin/pr/2537/merge
* [new ref] refs/pull/2538/head -> origin/pr/2538/head
* [new ref] refs/pull/2538/merge -> origin/pr/2538/merge
* [new ref] refs/pull/2539/head -> origin/pr/2539/head
* [new ref] refs/pull/2539/merge -> origin/pr/2539/merge
* [new ref] refs/pull/2540/head -> origin/pr/2540/head
* [new ref] refs/pull/2540/merge -> origin/pr/2540/merge
* [new ref] refs/pull/2541/head -> origin/pr/2541/head
* [new ref] refs/pull/2541/merge -> origin/pr/2541/merge
* [new ref] refs/pull/2542/head -> origin/pr/2542/head
* [new ref] refs/pull/2542/merge -> origin/pr/2542/merge
* [new ref] refs/pull/2543/head -> origin/pr/2543/head
* [new ref] refs/pull/2543/merge -> origin/pr/2543/merge
* [new ref] refs/pull/2544/head -> origin/pr/2544/head
* [new ref] refs/pull/2544/merge -> origin/pr/2544/merge
* [new ref] refs/pull/2545/head -> origin/pr/2545/head
* [new ref] refs/pull/2545/merge -> origin/pr/2545/merge
* [new ref] refs/pull/2546/head -> origin/pr/2546/head
* [new ref] refs/pull/2546/merge -> origin/pr/2546/merge
* [new ref] refs/pull/2547/head -> origin/pr/2547/head
* [new ref] refs/pull/2547/merge -> origin/pr/2547/merge
* [new ref] refs/pull/2548/head -> origin/pr/2548/head
* [new ref] refs/pull/2548/merge -> origin/pr/2548/merge
error: unable to resolve reference refs/remotes/origin/pr/2549/merge: No such file or directory
! 5650c43...8278987 refs/pull/2549/merge -> origin/pr/2549/merge (unable to update local ref)
* [new ref] refs/pull/2550/head -> origin/pr/2550/head
* [new ref] refs/pull/2550/merge -> origin/pr/2550/merge
* [new ref] refs/pull/2551/head -> origin/pr/2551/head
* [new ref] refs/pull/2551/merge -> origin/pr/2551/merge
* [new ref] refs/pull/2552/head -> origin/pr/2552/head
* [new ref] refs/pull/2552/merge -> origin/pr/2552/merge
* [new ref] refs/pull/2553/head -> origin/pr/2553/head
* [new ref] refs/pull/2553/merge -> origin/pr/2553/merge
* [new ref] refs/pull/2554/head -> origin/pr/2554/head
* [new ref] refs/pull/2554/merge -> origin/pr/2554/merge
* [new ref] refs/pull/2555/head -> origin/pr/2555/head
* [new ref] refs/pull/2555/merge -> origin/pr/2555/merge
* [new ref] refs/pull/2556/head -> origin/pr/2556/head
* [new ref] refs/pull/2556/merge -> origin/pr/2556/merge
* [new ref] refs/pull/2557/head -> origin/pr/2557/head
* [new ref] refs/pull/2557/merge -> origin/pr/2557/merge
* [new ref] refs/pull/2558/head -> origin/pr/2558/head
* [new ref] refs/pull/2558/merge -> origin/pr/2558/merge
* [new ref] refs/pull/2559/head -> origin/pr/2559/head
* [new ref] refs/pull/2559/merge -> origin/pr/2559/merge
* [new ref] refs/pull/2560/head -> origin/pr/2560/head
* [new ref] refs/pull/2560/merge -> origin/pr/2560/merge
* [new ref] refs/pull/2561/head -> origin/pr/2561/head
* [new ref] refs/pull/2561/merge -> origin/pr/2561/merge
* [new ref] refs/pull/2562/head -> origin/pr/2562/head
* [new ref] refs/pull/2562/merge -> origin/pr/2562/merge
* [new ref] refs/pull/2563/head -> origin/pr/2563/head
* [new ref] refs/pull/2563/merge -> origin/pr/2563/merge
* [new ref] refs/pull/2564/head -> origin/pr/2564/head
* [new ref] refs/pull/2564/merge -> origin/pr/2564/merge
* [new ref] refs/pull/2565/head -> origin/pr/2565/head
* [new ref] refs/pull/2565/merge -> origin/pr/2565/merge
* [new ref] refs/pull/2566/head -> origin/pr/2566/head
* [new ref] refs/pull/2566/merge -> origin/pr/2566/merge
* [new ref] refs/pull/2567/head -> origin/pr/2567/head
* [new ref] refs/pull/2567/merge -> origin/pr/2567/merge
* [new ref] refs/pull/2568/head -> origin/pr/2568/head
* [new ref] refs/pull/2568/merge -> origin/pr/2568/merge
* [new ref] refs/pull/2569/head -> origin/pr/2569/head
* [new ref] refs/pull/2569/merge -> origin/pr/2569/merge
* [new ref] refs/pull/2570/head -> origin/pr/2570/head
* [new ref] refs/pull/2570/merge -> origin/pr/2570/merge
* [new ref] refs/pull/2571/head -> origin/pr/2571/head
* [new ref] refs/pull/2571/merge -> origin/pr/2571/merge
* [new ref] refs/pull/2572/head -> origin/pr/2572/head
* [new ref] refs/pull/2572/merge -> origin/pr/2572/merge
error: unable to resolve reference refs/remotes/origin/pr/50/merge: No such file or directory
! 6f23618...9372791 refs/pull/50/merge -> origin/pr/50/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/592/merge: No such file or directory
! 6431456...79eade4 refs/pull/592/merge -> origin/pr/592/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/74/merge: No such file or directory
! b91b760...4562339 refs/pull/74/merge -> origin/pr/74/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/75/merge: No such file or directory
! e7cccaa...5331059 refs/pull/75/merge -> origin/pr/75/merge (unable to update local ref)
Auto packing the repository for optimum performance. You may also
run "git gc" manually. See "git help gc" for more information.
warning: There are too many unreachable loose objects; run 'git prune' to remove them.
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1799)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1525)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:65)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:316)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor862.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy103.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision e5568589cab11399126f678ad3fbca4b1fb715e4 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f e5568589cab11399126f678ad3fbca4b1fb715e4
> git rev-list c52ce7c4bd952d943bccb8acff53b36b40c35428 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson39426978036214425.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5796789730107017061.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson8375130796706901326.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson6295393925086791677.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-18 12:02:18,566 d1d4b765 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/d1d4b765/pkb.log
2017-04-18 12:02:18,566 d1d4b765 MainThread INFO PerfKitBenchmarker version: v1.11.0-43-g6012a89
2017-04-18 12:02:18,566 d1d4b765 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-18 12:02:18,882 d1d4b765 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-18 12:02:18,962 d1d4b765 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-18 12:02:18,964 d1d4b765 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-18 12:02:18,964 d1d4b765 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-18 12:02:18,969 d1d4b765 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-18 12:02:18,970 d1d4b765 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-18 12:02:19,001 d1d4b765 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-18 12:02:19,001 d1d4b765 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/d1d4b765/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #322
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/322/display/redirect?page=changes>
Changes:
[dhalperi] Only compile HIFIO ITs when compiling with java 8.
[tgroh] Set the Project of a Table Reference at Runtime
[altay] clean up description for sdk_location
[dhalperi] [BEAM-1991] Sum.SumDoubleFn => Sum.ofDoubles
------------------------------------------
[...truncated 263.13 KB...]
! 1c56862...d62e965 refs/pull/2493/merge -> origin/pr/2493/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2497/merge: No such file or directory
! 768927c...34bb7be refs/pull/2497/merge -> origin/pr/2497/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2498/merge: No such file or directory
! cb3f078...68b5b7a refs/pull/2498/merge -> origin/pr/2498/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2499/merge: No such file or directory
! a5be5fb...4e96823 refs/pull/2499/merge -> origin/pr/2499/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2501/merge: No such file or directory
! e135c9d...302aad6 refs/pull/2501/merge -> origin/pr/2501/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2502/merge: No such file or directory
! 652890a...649e96c refs/pull/2502/merge -> origin/pr/2502/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2505/merge: No such file or directory
! ae069b8...3ed695f refs/pull/2505/merge -> origin/pr/2505/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2507/merge: No such file or directory
! 33fc584...366bf52 refs/pull/2507/merge -> origin/pr/2507/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2508/merge: No such file or directory
! fc37405...c7c0bed refs/pull/2508/merge -> origin/pr/2508/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2509/merge: No such file or directory
! a700cb0...431c487 refs/pull/2509/merge -> origin/pr/2509/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2510/merge: No such file or directory
! 7b2c6ca...1202743 refs/pull/2510/merge -> origin/pr/2510/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2511/merge: No such file or directory
! ead989f...38a153f refs/pull/2511/merge -> origin/pr/2511/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2514/merge: No such file or directory
! 70aebaf...db83b85 refs/pull/2514/merge -> origin/pr/2514/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2515/merge: No such file or directory
! 9aec98c...8f11c5b refs/pull/2515/merge -> origin/pr/2515/merge (unable to update local ref)
* [new ref] refs/pull/2516/head -> origin/pr/2516/head
* [new ref] refs/pull/2516/merge -> origin/pr/2516/merge
* [new ref] refs/pull/2517/head -> origin/pr/2517/head
* [new ref] refs/pull/2517/merge -> origin/pr/2517/merge
* [new ref] refs/pull/2518/head -> origin/pr/2518/head
* [new ref] refs/pull/2518/merge -> origin/pr/2518/merge
* [new ref] refs/pull/2519/head -> origin/pr/2519/head
* [new ref] refs/pull/2519/merge -> origin/pr/2519/merge
* [new ref] refs/pull/2520/head -> origin/pr/2520/head
* [new ref] refs/pull/2520/merge -> origin/pr/2520/merge
* [new ref] refs/pull/2521/head -> origin/pr/2521/head
* [new ref] refs/pull/2521/merge -> origin/pr/2521/merge
* [new ref] refs/pull/2522/head -> origin/pr/2522/head
* [new ref] refs/pull/2522/merge -> origin/pr/2522/merge
* [new ref] refs/pull/2523/head -> origin/pr/2523/head
* [new ref] refs/pull/2523/merge -> origin/pr/2523/merge
* [new ref] refs/pull/2524/head -> origin/pr/2524/head
* [new ref] refs/pull/2525/head -> origin/pr/2525/head
* [new ref] refs/pull/2525/merge -> origin/pr/2525/merge
* [new ref] refs/pull/2526/head -> origin/pr/2526/head
* [new ref] refs/pull/2527/head -> origin/pr/2527/head
* [new ref] refs/pull/2527/merge -> origin/pr/2527/merge
* [new ref] refs/pull/2528/head -> origin/pr/2528/head
* [new ref] refs/pull/2528/merge -> origin/pr/2528/merge
* [new ref] refs/pull/2529/head -> origin/pr/2529/head
* [new ref] refs/pull/2529/merge -> origin/pr/2529/merge
* [new ref] refs/pull/2530/head -> origin/pr/2530/head
* [new ref] refs/pull/2530/merge -> origin/pr/2530/merge
* [new ref] refs/pull/2531/head -> origin/pr/2531/head
* [new ref] refs/pull/2531/merge -> origin/pr/2531/merge
* [new ref] refs/pull/2532/head -> origin/pr/2532/head
* [new ref] refs/pull/2532/merge -> origin/pr/2532/merge
* [new ref] refs/pull/2533/head -> origin/pr/2533/head
* [new ref] refs/pull/2533/merge -> origin/pr/2533/merge
* [new ref] refs/pull/2534/head -> origin/pr/2534/head
* [new ref] refs/pull/2534/merge -> origin/pr/2534/merge
* [new ref] refs/pull/2535/head -> origin/pr/2535/head
* [new ref] refs/pull/2535/merge -> origin/pr/2535/merge
* [new ref] refs/pull/2536/head -> origin/pr/2536/head
* [new ref] refs/pull/2536/merge -> origin/pr/2536/merge
* [new ref] refs/pull/2537/head -> origin/pr/2537/head
* [new ref] refs/pull/2537/merge -> origin/pr/2537/merge
* [new ref] refs/pull/2538/head -> origin/pr/2538/head
* [new ref] refs/pull/2538/merge -> origin/pr/2538/merge
* [new ref] refs/pull/2539/head -> origin/pr/2539/head
* [new ref] refs/pull/2539/merge -> origin/pr/2539/merge
* [new ref] refs/pull/2540/head -> origin/pr/2540/head
* [new ref] refs/pull/2540/merge -> origin/pr/2540/merge
* [new ref] refs/pull/2541/head -> origin/pr/2541/head
* [new ref] refs/pull/2541/merge -> origin/pr/2541/merge
* [new ref] refs/pull/2542/head -> origin/pr/2542/head
* [new ref] refs/pull/2542/merge -> origin/pr/2542/merge
* [new ref] refs/pull/2543/head -> origin/pr/2543/head
* [new ref] refs/pull/2543/merge -> origin/pr/2543/merge
* [new ref] refs/pull/2544/head -> origin/pr/2544/head
* [new ref] refs/pull/2544/merge -> origin/pr/2544/merge
* [new ref] refs/pull/2545/head -> origin/pr/2545/head
* [new ref] refs/pull/2545/merge -> origin/pr/2545/merge
* [new ref] refs/pull/2546/head -> origin/pr/2546/head
* [new ref] refs/pull/2546/merge -> origin/pr/2546/merge
* [new ref] refs/pull/2547/head -> origin/pr/2547/head
* [new ref] refs/pull/2547/merge -> origin/pr/2547/merge
* [new ref] refs/pull/2548/head -> origin/pr/2548/head
* [new ref] refs/pull/2548/merge -> origin/pr/2548/merge
error: unable to resolve reference refs/remotes/origin/pr/2549/merge: No such file or directory
! 7be646c...5650c43 refs/pull/2549/merge -> origin/pr/2549/merge (unable to update local ref)
* [new ref] refs/pull/2550/head -> origin/pr/2550/head
* [new ref] refs/pull/2550/merge -> origin/pr/2550/merge
* [new ref] refs/pull/2551/head -> origin/pr/2551/head
* [new ref] refs/pull/2551/merge -> origin/pr/2551/merge
* [new ref] refs/pull/2552/head -> origin/pr/2552/head
* [new ref] refs/pull/2552/merge -> origin/pr/2552/merge
* [new ref] refs/pull/2553/head -> origin/pr/2553/head
* [new ref] refs/pull/2553/merge -> origin/pr/2553/merge
* [new ref] refs/pull/2554/head -> origin/pr/2554/head
* [new ref] refs/pull/2554/merge -> origin/pr/2554/merge
* [new ref] refs/pull/2555/head -> origin/pr/2555/head
* [new ref] refs/pull/2555/merge -> origin/pr/2555/merge
* [new ref] refs/pull/2556/head -> origin/pr/2556/head
* [new ref] refs/pull/2556/merge -> origin/pr/2556/merge
* [new ref] refs/pull/2557/head -> origin/pr/2557/head
* [new ref] refs/pull/2557/merge -> origin/pr/2557/merge
* [new ref] refs/pull/2558/head -> origin/pr/2558/head
* [new ref] refs/pull/2558/merge -> origin/pr/2558/merge
* [new ref] refs/pull/2559/head -> origin/pr/2559/head
* [new ref] refs/pull/2559/merge -> origin/pr/2559/merge
* [new ref] refs/pull/2560/head -> origin/pr/2560/head
* [new ref] refs/pull/2560/merge -> origin/pr/2560/merge
* [new ref] refs/pull/2561/head -> origin/pr/2561/head
* [new ref] refs/pull/2561/merge -> origin/pr/2561/merge
* [new ref] refs/pull/2562/head -> origin/pr/2562/head
* [new ref] refs/pull/2562/merge -> origin/pr/2562/merge
* [new ref] refs/pull/2563/head -> origin/pr/2563/head
* [new ref] refs/pull/2563/merge -> origin/pr/2563/merge
* [new ref] refs/pull/2564/head -> origin/pr/2564/head
* [new ref] refs/pull/2564/merge -> origin/pr/2564/merge
* [new ref] refs/pull/2565/head -> origin/pr/2565/head
* [new ref] refs/pull/2565/merge -> origin/pr/2565/merge
* [new ref] refs/pull/2566/head -> origin/pr/2566/head
* [new ref] refs/pull/2566/merge -> origin/pr/2566/merge
* [new ref] refs/pull/2567/head -> origin/pr/2567/head
* [new ref] refs/pull/2567/merge -> origin/pr/2567/merge
* [new ref] refs/pull/2568/head -> origin/pr/2568/head
* [new ref] refs/pull/2568/merge -> origin/pr/2568/merge
error: unable to resolve reference refs/remotes/origin/pr/592/merge: No such file or directory
! 1c5a0e0...6431456 refs/pull/592/merge -> origin/pr/592/merge (unable to update local ref)
Auto packing the repository for optimum performance. You may also
run "git gc" manually. See "git help gc" for more information.
warning: There are too many unreachable loose objects; run 'git prune' to remove them.
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1799)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1525)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:65)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:316)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor862.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy103.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision c52ce7c4bd952d943bccb8acff53b36b40c35428 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f c52ce7c4bd952d943bccb8acff53b36b40c35428
> git rev-list 4ff244d49c678f658f437600559cbe0a99048f81 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson7242308831951486378.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson7246019932213222086.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3384791478864205582.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson9142746497036719553.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-18 06:01:59,996 957bfc7b MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/957bfc7b/pkb.log
2017-04-18 06:01:59,996 957bfc7b MainThread INFO PerfKitBenchmarker version: v1.11.0-43-g6012a89
2017-04-18 06:01:59,997 957bfc7b MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-18 06:02:00,103 957bfc7b MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-18 06:02:00,187 957bfc7b MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-18 06:02:00,190 957bfc7b MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-18 06:02:00,190 957bfc7b MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-18 06:02:00,197 957bfc7b MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-18 06:02:00,199 957bfc7b MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-18 06:02:00,221 957bfc7b MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-18 06:02:00,221 957bfc7b MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/957bfc7b/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #321
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/321/display/redirect?page=changes>
Changes:
[tgroh] Remove reference to the isStreaming flag
[tgroh] Remove getSideInputWindow
[altay] Add no-else return to pylintrc
[chamikara] Update assertions of source_test_utils from camelcase to
------------------------------------------
[...truncated 255.61 KB...]
! 6777f68...e7b72b0 refs/pull/2286/merge -> origin/pr/2286/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2316/merge: No such file or directory
! fc0d1a7...9d9cbc5 refs/pull/2316/merge -> origin/pr/2316/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2330/merge: No such file or directory
! 03a7191...dc28d6a refs/pull/2330/merge -> origin/pr/2330/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2331/merge: No such file or directory
! 63c0b96...4be264d refs/pull/2331/merge -> origin/pr/2331/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2339/head: No such file or directory
! a95e0a3..bfd7c69 refs/pull/2339/head -> origin/pr/2339/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2339/merge: No such file or directory
! 4d9e094...ea7f091 refs/pull/2339/merge -> origin/pr/2339/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2341/merge: No such file or directory
! e458904...ad8ef4a refs/pull/2341/merge -> origin/pr/2341/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2344/merge: No such file or directory
! f74af87...4370eb0 refs/pull/2344/merge -> origin/pr/2344/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2358/merge: No such file or directory
! 49d6432...09fbed7 refs/pull/2358/merge -> origin/pr/2358/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2417/head: No such file or directory
! 3e3b510..09923b3 refs/pull/2417/head -> origin/pr/2417/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2417/merge: No such file or directory
! 4cc17f8...687a6f6 refs/pull/2417/merge -> origin/pr/2417/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2421/merge: No such file or directory
! e3c990d...451130b refs/pull/2421/merge -> origin/pr/2421/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2426/merge: No such file or directory
! a4dbb92...2634824 refs/pull/2426/merge -> origin/pr/2426/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2442/merge: No such file or directory
! e2506ce...3c9ed06 refs/pull/2442/merge -> origin/pr/2442/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2457/merge: No such file or directory
! ceeb9d5...ffc6bdf refs/pull/2457/merge -> origin/pr/2457/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2474/merge: No such file or directory
! 13f53f2...fa45070 refs/pull/2474/merge -> origin/pr/2474/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2476/merge: No such file or directory
! a993257...b7a2dd1 refs/pull/2476/merge -> origin/pr/2476/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2488/merge: No such file or directory
! 9f62c44...76cd8aa refs/pull/2488/merge -> origin/pr/2488/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2507/merge: No such file or directory
! 1e0fb0f...33fc584 refs/pull/2507/merge -> origin/pr/2507/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2508/merge: No such file or directory
! e65f319...fc37405 refs/pull/2508/merge -> origin/pr/2508/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2509/merge: No such file or directory
! accb33b...a700cb0 refs/pull/2509/merge -> origin/pr/2509/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2510/merge: No such file or directory
! e55db78...7b2c6ca refs/pull/2510/merge -> origin/pr/2510/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2511/merge: No such file or directory
! b94d459...ead989f refs/pull/2511/merge -> origin/pr/2511/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2514/merge: No such file or directory
! 6f90c52...70aebaf refs/pull/2514/merge -> origin/pr/2514/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2515/merge: No such file or directory
! 1760aeb...9aec98c refs/pull/2515/merge -> origin/pr/2515/merge (unable to update local ref)
* [new ref] refs/pull/2516/head -> origin/pr/2516/head
* [new ref] refs/pull/2516/merge -> origin/pr/2516/merge
* [new ref] refs/pull/2517/head -> origin/pr/2517/head
* [new ref] refs/pull/2517/merge -> origin/pr/2517/merge
* [new ref] refs/pull/2518/head -> origin/pr/2518/head
* [new ref] refs/pull/2518/merge -> origin/pr/2518/merge
* [new ref] refs/pull/2519/head -> origin/pr/2519/head
* [new ref] refs/pull/2519/merge -> origin/pr/2519/merge
* [new ref] refs/pull/2520/head -> origin/pr/2520/head
* [new ref] refs/pull/2520/merge -> origin/pr/2520/merge
* [new ref] refs/pull/2521/head -> origin/pr/2521/head
* [new ref] refs/pull/2521/merge -> origin/pr/2521/merge
* [new ref] refs/pull/2522/head -> origin/pr/2522/head
* [new ref] refs/pull/2522/merge -> origin/pr/2522/merge
* [new ref] refs/pull/2523/head -> origin/pr/2523/head
* [new ref] refs/pull/2523/merge -> origin/pr/2523/merge
* [new ref] refs/pull/2524/head -> origin/pr/2524/head
* [new ref] refs/pull/2525/head -> origin/pr/2525/head
* [new ref] refs/pull/2525/merge -> origin/pr/2525/merge
* [new ref] refs/pull/2526/head -> origin/pr/2526/head
* [new ref] refs/pull/2527/head -> origin/pr/2527/head
* [new ref] refs/pull/2527/merge -> origin/pr/2527/merge
* [new ref] refs/pull/2528/head -> origin/pr/2528/head
* [new ref] refs/pull/2528/merge -> origin/pr/2528/merge
* [new ref] refs/pull/2529/head -> origin/pr/2529/head
* [new ref] refs/pull/2529/merge -> origin/pr/2529/merge
* [new ref] refs/pull/2530/head -> origin/pr/2530/head
* [new ref] refs/pull/2530/merge -> origin/pr/2530/merge
* [new ref] refs/pull/2531/head -> origin/pr/2531/head
* [new ref] refs/pull/2531/merge -> origin/pr/2531/merge
* [new ref] refs/pull/2532/head -> origin/pr/2532/head
* [new ref] refs/pull/2532/merge -> origin/pr/2532/merge
* [new ref] refs/pull/2533/head -> origin/pr/2533/head
* [new ref] refs/pull/2533/merge -> origin/pr/2533/merge
* [new ref] refs/pull/2534/head -> origin/pr/2534/head
* [new ref] refs/pull/2534/merge -> origin/pr/2534/merge
* [new ref] refs/pull/2535/head -> origin/pr/2535/head
* [new ref] refs/pull/2535/merge -> origin/pr/2535/merge
* [new ref] refs/pull/2536/head -> origin/pr/2536/head
* [new ref] refs/pull/2536/merge -> origin/pr/2536/merge
* [new ref] refs/pull/2537/head -> origin/pr/2537/head
* [new ref] refs/pull/2537/merge -> origin/pr/2537/merge
* [new ref] refs/pull/2538/head -> origin/pr/2538/head
* [new ref] refs/pull/2538/merge -> origin/pr/2538/merge
* [new ref] refs/pull/2539/head -> origin/pr/2539/head
* [new ref] refs/pull/2539/merge -> origin/pr/2539/merge
* [new ref] refs/pull/2540/head -> origin/pr/2540/head
* [new ref] refs/pull/2540/merge -> origin/pr/2540/merge
* [new ref] refs/pull/2541/head -> origin/pr/2541/head
* [new ref] refs/pull/2541/merge -> origin/pr/2541/merge
* [new ref] refs/pull/2542/head -> origin/pr/2542/head
* [new ref] refs/pull/2542/merge -> origin/pr/2542/merge
* [new ref] refs/pull/2543/head -> origin/pr/2543/head
* [new ref] refs/pull/2543/merge -> origin/pr/2543/merge
* [new ref] refs/pull/2544/head -> origin/pr/2544/head
* [new ref] refs/pull/2544/merge -> origin/pr/2544/merge
* [new ref] refs/pull/2545/head -> origin/pr/2545/head
* [new ref] refs/pull/2545/merge -> origin/pr/2545/merge
* [new ref] refs/pull/2546/head -> origin/pr/2546/head
* [new ref] refs/pull/2546/merge -> origin/pr/2546/merge
* [new ref] refs/pull/2547/head -> origin/pr/2547/head
* [new ref] refs/pull/2547/merge -> origin/pr/2547/merge
* [new ref] refs/pull/2548/head -> origin/pr/2548/head
* [new ref] refs/pull/2548/merge -> origin/pr/2548/merge
error: unable to resolve reference refs/remotes/origin/pr/2549/merge: No such file or directory
! ad1a102...7be646c refs/pull/2549/merge -> origin/pr/2549/merge (unable to update local ref)
* [new ref] refs/pull/2550/head -> origin/pr/2550/head
* [new ref] refs/pull/2550/merge -> origin/pr/2550/merge
* [new ref] refs/pull/2551/head -> origin/pr/2551/head
* [new ref] refs/pull/2551/merge -> origin/pr/2551/merge
* [new ref] refs/pull/2552/head -> origin/pr/2552/head
* [new ref] refs/pull/2552/merge -> origin/pr/2552/merge
* [new ref] refs/pull/2553/head -> origin/pr/2553/head
* [new ref] refs/pull/2553/merge -> origin/pr/2553/merge
* [new ref] refs/pull/2554/head -> origin/pr/2554/head
* [new ref] refs/pull/2554/merge -> origin/pr/2554/merge
* [new ref] refs/pull/2555/head -> origin/pr/2555/head
* [new ref] refs/pull/2555/merge -> origin/pr/2555/merge
* [new ref] refs/pull/2556/head -> origin/pr/2556/head
* [new ref] refs/pull/2556/merge -> origin/pr/2556/merge
* [new ref] refs/pull/2557/head -> origin/pr/2557/head
* [new ref] refs/pull/2557/merge -> origin/pr/2557/merge
error: unable to resolve reference refs/remotes/origin/pr/592/merge: No such file or directory
! 3607de7...1c5a0e0 refs/pull/592/merge -> origin/pr/592/merge (unable to update local ref)
Auto packing the repository for optimum performance. You may also
run "git gc" manually. See "git help gc" for more information.
warning: There are too many unreachable loose objects; run 'git prune' to remove them.
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1799)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1525)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:65)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:316)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor862.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy103.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 4ff244d49c678f658f437600559cbe0a99048f81 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 4ff244d49c678f658f437600559cbe0a99048f81
> git rev-list 8302783c3239ddcf8b5259b4aff8ee33673d02cd # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4475637422229182291.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5889208407194751846.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson7039340731844299852.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson1137852464107757677.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-18 00:02:07,135 30a3becb MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/30a3becb/pkb.log
2017-04-18 00:02:07,136 30a3becb MainThread INFO PerfKitBenchmarker version: v1.11.0-43-g6012a89
2017-04-18 00:02:07,136 30a3becb MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-18 00:02:07,273 30a3becb MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-18 00:02:07,358 30a3becb MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-18 00:02:07,361 30a3becb MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-18 00:02:07,361 30a3becb MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-18 00:02:07,367 30a3becb MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-18 00:02:07,370 30a3becb MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-18 00:02:07,398 30a3becb MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-18 00:02:07,398 30a3becb MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/30a3becb/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #320
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/320/display/redirect?page=changes>
Changes:
[jbonofre] [BEAM-1922] Close datasource in JdbcIO when possible
[tgroh] Update Dataflow Worker Version
[kirpichov] Javadoc fixups after style guide changes
------------------------------------------
[...truncated 258.35 KB...]
! c284b62...4ea7285 refs/pull/2382/merge -> origin/pr/2382/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2385/merge: No such file or directory
! fc7e7c8...351df3a refs/pull/2385/merge -> origin/pr/2385/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2410/merge: No such file or directory
! 22c3670...8923027 refs/pull/2410/merge -> origin/pr/2410/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2414/merge: No such file or directory
! 0fdba7c...c05b468 refs/pull/2414/merge -> origin/pr/2414/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2417/head: No such file or directory
! 83bad83..3e3b510 refs/pull/2417/head -> origin/pr/2417/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2417/merge: No such file or directory
! 5eed698...4cc17f8 refs/pull/2417/merge -> origin/pr/2417/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2418/merge: No such file or directory
! 736dcc8...26d171e refs/pull/2418/merge -> origin/pr/2418/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2421/merge: No such file or directory
! 87cf1fe...e3c990d refs/pull/2421/merge -> origin/pr/2421/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2426/merge: No such file or directory
! cccd360...a4dbb92 refs/pull/2426/merge -> origin/pr/2426/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2428/merge: No such file or directory
! bc3fb2f...3e6a75f refs/pull/2428/merge -> origin/pr/2428/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2434/merge: No such file or directory
! 498d04f...6c488c2 refs/pull/2434/merge -> origin/pr/2434/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2436/merge: No such file or directory
! ebb426d...76a6c17 refs/pull/2436/merge -> origin/pr/2436/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2439/merge: No such file or directory
! cd94a1d...ccb7a55 refs/pull/2439/merge -> origin/pr/2439/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2440/merge: No such file or directory
! dc8b790...45f2cae refs/pull/2440/merge -> origin/pr/2440/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2442/merge: No such file or directory
! 722ca8e...e2506ce refs/pull/2442/merge -> origin/pr/2442/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2449/merge: No such file or directory
! b78575c...23b0870 refs/pull/2449/merge -> origin/pr/2449/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2453/merge: No such file or directory
! 9dca2eb...5ff71d3 refs/pull/2453/merge -> origin/pr/2453/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2456/merge: No such file or directory
! 3b8ec12...2094a82 refs/pull/2456/merge -> origin/pr/2456/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2457/merge: No such file or directory
! 1843110...ceeb9d5 refs/pull/2457/merge -> origin/pr/2457/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2474/merge: No such file or directory
! eba7225...13f53f2 refs/pull/2474/merge -> origin/pr/2474/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2476/merge: No such file or directory
! a8f1836...a993257 refs/pull/2476/merge -> origin/pr/2476/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2482/merge: No such file or directory
! 7534645...b1e3c5a refs/pull/2482/merge -> origin/pr/2482/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2483/merge: No such file or directory
! 6b2b994...df85b9f refs/pull/2483/merge -> origin/pr/2483/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2485/merge: No such file or directory
! e0953a7...e5ccd7c refs/pull/2485/merge -> origin/pr/2485/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2488/merge: No such file or directory
! a6753b1...9f62c44 refs/pull/2488/merge -> origin/pr/2488/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2493/merge: No such file or directory
! a11307a...1c56862 refs/pull/2493/merge -> origin/pr/2493/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2501/merge: No such file or directory
! c7b289b...e135c9d refs/pull/2501/merge -> origin/pr/2501/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2502/merge: No such file or directory
! 29cae96...652890a refs/pull/2502/merge -> origin/pr/2502/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2507/merge: No such file or directory
! 1391cd4...1e0fb0f refs/pull/2507/merge -> origin/pr/2507/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2508/merge: No such file or directory
! 0baa476...e65f319 refs/pull/2508/merge -> origin/pr/2508/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2509/merge: No such file or directory
! 0f3f9d2...accb33b refs/pull/2509/merge -> origin/pr/2509/merge (unable to update local ref)
* [new ref] refs/pull/2516/head -> origin/pr/2516/head
* [new ref] refs/pull/2516/merge -> origin/pr/2516/merge
* [new ref] refs/pull/2517/head -> origin/pr/2517/head
* [new ref] refs/pull/2517/merge -> origin/pr/2517/merge
* [new ref] refs/pull/2518/head -> origin/pr/2518/head
* [new ref] refs/pull/2518/merge -> origin/pr/2518/merge
* [new ref] refs/pull/2519/head -> origin/pr/2519/head
* [new ref] refs/pull/2519/merge -> origin/pr/2519/merge
* [new ref] refs/pull/2520/head -> origin/pr/2520/head
* [new ref] refs/pull/2520/merge -> origin/pr/2520/merge
* [new ref] refs/pull/2521/head -> origin/pr/2521/head
* [new ref] refs/pull/2521/merge -> origin/pr/2521/merge
* [new ref] refs/pull/2522/head -> origin/pr/2522/head
* [new ref] refs/pull/2522/merge -> origin/pr/2522/merge
* [new ref] refs/pull/2523/head -> origin/pr/2523/head
* [new ref] refs/pull/2523/merge -> origin/pr/2523/merge
* [new ref] refs/pull/2524/head -> origin/pr/2524/head
* [new ref] refs/pull/2525/head -> origin/pr/2525/head
* [new ref] refs/pull/2525/merge -> origin/pr/2525/merge
* [new ref] refs/pull/2526/head -> origin/pr/2526/head
* [new ref] refs/pull/2527/head -> origin/pr/2527/head
* [new ref] refs/pull/2527/merge -> origin/pr/2527/merge
* [new ref] refs/pull/2528/head -> origin/pr/2528/head
* [new ref] refs/pull/2528/merge -> origin/pr/2528/merge
* [new ref] refs/pull/2529/head -> origin/pr/2529/head
* [new ref] refs/pull/2529/merge -> origin/pr/2529/merge
* [new ref] refs/pull/2530/head -> origin/pr/2530/head
* [new ref] refs/pull/2530/merge -> origin/pr/2530/merge
* [new ref] refs/pull/2531/head -> origin/pr/2531/head
* [new ref] refs/pull/2531/merge -> origin/pr/2531/merge
* [new ref] refs/pull/2532/head -> origin/pr/2532/head
* [new ref] refs/pull/2532/merge -> origin/pr/2532/merge
* [new ref] refs/pull/2533/head -> origin/pr/2533/head
* [new ref] refs/pull/2533/merge -> origin/pr/2533/merge
* [new ref] refs/pull/2534/head -> origin/pr/2534/head
* [new ref] refs/pull/2534/merge -> origin/pr/2534/merge
* [new ref] refs/pull/2535/head -> origin/pr/2535/head
* [new ref] refs/pull/2535/merge -> origin/pr/2535/merge
* [new ref] refs/pull/2536/head -> origin/pr/2536/head
* [new ref] refs/pull/2536/merge -> origin/pr/2536/merge
* [new ref] refs/pull/2537/head -> origin/pr/2537/head
* [new ref] refs/pull/2537/merge -> origin/pr/2537/merge
* [new ref] refs/pull/2538/head -> origin/pr/2538/head
* [new ref] refs/pull/2538/merge -> origin/pr/2538/merge
* [new ref] refs/pull/2539/head -> origin/pr/2539/head
* [new ref] refs/pull/2539/merge -> origin/pr/2539/merge
* [new ref] refs/pull/2540/head -> origin/pr/2540/head
* [new ref] refs/pull/2540/merge -> origin/pr/2540/merge
* [new ref] refs/pull/2541/head -> origin/pr/2541/head
* [new ref] refs/pull/2541/merge -> origin/pr/2541/merge
* [new ref] refs/pull/2542/head -> origin/pr/2542/head
* [new ref] refs/pull/2542/merge -> origin/pr/2542/merge
* [new ref] refs/pull/2543/head -> origin/pr/2543/head
* [new ref] refs/pull/2543/merge -> origin/pr/2543/merge
* [new ref] refs/pull/2544/head -> origin/pr/2544/head
* [new ref] refs/pull/2544/merge -> origin/pr/2544/merge
* [new ref] refs/pull/2545/head -> origin/pr/2545/head
* [new ref] refs/pull/2545/merge -> origin/pr/2545/merge
* [new ref] refs/pull/2546/head -> origin/pr/2546/head
* [new ref] refs/pull/2546/merge -> origin/pr/2546/merge
* [new ref] refs/pull/2547/head -> origin/pr/2547/head
* [new ref] refs/pull/2547/merge -> origin/pr/2547/merge
* [new ref] refs/pull/2548/head -> origin/pr/2548/head
* [new ref] refs/pull/2548/merge -> origin/pr/2548/merge
error: unable to resolve reference refs/remotes/origin/pr/2549/merge: No such file or directory
! 4f2eee1...ad1a102 refs/pull/2549/merge -> origin/pr/2549/merge (unable to update local ref)
* [new ref] refs/pull/2550/head -> origin/pr/2550/head
* [new ref] refs/pull/2550/merge -> origin/pr/2550/merge
* [new ref] refs/pull/2551/head -> origin/pr/2551/head
* [new ref] refs/pull/2551/merge -> origin/pr/2551/merge
error: unable to resolve reference refs/remotes/origin/pr/592/merge: No such file or directory
! dd8a5f2...3607de7 refs/pull/592/merge -> origin/pr/592/merge (unable to update local ref)
Auto packing the repository for optimum performance. You may also
run "git gc" manually. See "git help gc" for more information.
warning: There are too many unreachable loose objects; run 'git prune' to remove them.
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1799)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1525)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:65)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:316)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor862.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy103.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 8302783c3239ddcf8b5259b4aff8ee33673d02cd (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 8302783c3239ddcf8b5259b4aff8ee33673d02cd
> git rev-list 946778c5bb114814d1ba5ebe71a27bc960f9e59b # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4430182060932767693.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson1234025568128931991.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson8578646212994847135.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4904381690154377724.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-17 18:01:50,094 7f2ef3cf MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/7f2ef3cf/pkb.log
2017-04-17 18:01:50,094 7f2ef3cf MainThread INFO PerfKitBenchmarker version: v1.11.0-42-g4158261
2017-04-17 18:01:50,095 7f2ef3cf MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-17 18:01:50,430 7f2ef3cf MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-17 18:01:50,509 7f2ef3cf MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-17 18:01:50,511 7f2ef3cf MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-17 18:01:50,511 7f2ef3cf MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-17 18:01:50,516 7f2ef3cf MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-17 18:01:50,518 7f2ef3cf MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-17 18:01:50,548 7f2ef3cf MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-17 18:01:50,548 7f2ef3cf MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/7f2ef3cf/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #319
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/319/display/redirect?page=changes>
Changes:
[jbonofre] Add javadoc to getCheckpointMark in UnboundedSource
[jbonofre] Fix javadoc warnings
------------------------------------------
[...truncated 255.50 KB...]
! 502da88...9363e9c refs/pull/2057/merge -> origin/pr/2057/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2113/merge: No such file or directory
! b0a00bd...e461807 refs/pull/2113/merge -> origin/pr/2113/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2154/merge: No such file or directory
! bec8d58...26007e0 refs/pull/2154/merge -> origin/pr/2154/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2207/merge: No such file or directory
! eefcb75...1207e61 refs/pull/2207/merge -> origin/pr/2207/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2216/merge: No such file or directory
! c53a4a4...e8b15dd refs/pull/2216/merge -> origin/pr/2216/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2266/merge: No such file or directory
! acb155f...422e309 refs/pull/2266/merge -> origin/pr/2266/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2273/merge: No such file or directory
! 1e28b4d...a8882d5 refs/pull/2273/merge -> origin/pr/2273/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2286/merge: No such file or directory
! 7f686a9...5ad8a93 refs/pull/2286/merge -> origin/pr/2286/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2330/merge: No such file or directory
! 6a9103e...40050d1 refs/pull/2330/merge -> origin/pr/2330/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2331/merge: No such file or directory
! 890d1ed...0c05446 refs/pull/2331/merge -> origin/pr/2331/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2339/merge: No such file or directory
! 36cb659...670a00b refs/pull/2339/merge -> origin/pr/2339/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2341/merge: No such file or directory
! b0927d5...3e33bf1 refs/pull/2341/merge -> origin/pr/2341/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2344/merge: No such file or directory
! 8524d7b...5131c76 refs/pull/2344/merge -> origin/pr/2344/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2358/merge: No such file or directory
! 457cc80...e11f424 refs/pull/2358/merge -> origin/pr/2358/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2406/merge: No such file or directory
! 0ec058e...8b35a5d refs/pull/2406/merge -> origin/pr/2406/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2417/merge: No such file or directory
! 557cdc4...5eed698 refs/pull/2417/merge -> origin/pr/2417/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2421/merge: No such file or directory
! 92f1d8c...87cf1fe refs/pull/2421/merge -> origin/pr/2421/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2426/merge: No such file or directory
! ae4da02...cccd360 refs/pull/2426/merge -> origin/pr/2426/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2442/merge: No such file or directory
! f597223...722ca8e refs/pull/2442/merge -> origin/pr/2442/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2457/merge: No such file or directory
! d158c14...1843110 refs/pull/2457/merge -> origin/pr/2457/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2474/merge: No such file or directory
! 1eb04db...eba7225 refs/pull/2474/merge -> origin/pr/2474/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2476/merge: No such file or directory
! c20273c...a8f1836 refs/pull/2476/merge -> origin/pr/2476/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2482/merge: No such file or directory
! b1b8c98...7534645 refs/pull/2482/merge -> origin/pr/2482/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2488/merge: No such file or directory
! 10bd14d...a6753b1 refs/pull/2488/merge -> origin/pr/2488/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2505/merge: No such file or directory
! d8b33d0...ae069b8 refs/pull/2505/merge -> origin/pr/2505/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2507/merge: No such file or directory
! 9cc3ca0...1391cd4 refs/pull/2507/merge -> origin/pr/2507/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2508/merge: No such file or directory
! 0f89790...0baa476 refs/pull/2508/merge -> origin/pr/2508/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2509/merge: No such file or directory
! aed3bb9...0f3f9d2 refs/pull/2509/merge -> origin/pr/2509/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2510/merge: No such file or directory
! 9cc4e4d...e55db78 refs/pull/2510/merge -> origin/pr/2510/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2511/merge: No such file or directory
! d646411...b94d459 refs/pull/2511/merge -> origin/pr/2511/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2514/merge: No such file or directory
! 1fdb7fe...6f90c52 refs/pull/2514/merge -> origin/pr/2514/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2515/merge: No such file or directory
! 4967edf...1760aeb refs/pull/2515/merge -> origin/pr/2515/merge (unable to update local ref)
* [new ref] refs/pull/2516/head -> origin/pr/2516/head
* [new ref] refs/pull/2516/merge -> origin/pr/2516/merge
* [new ref] refs/pull/2517/head -> origin/pr/2517/head
* [new ref] refs/pull/2517/merge -> origin/pr/2517/merge
* [new ref] refs/pull/2518/head -> origin/pr/2518/head
* [new ref] refs/pull/2518/merge -> origin/pr/2518/merge
* [new ref] refs/pull/2519/head -> origin/pr/2519/head
* [new ref] refs/pull/2519/merge -> origin/pr/2519/merge
* [new ref] refs/pull/2520/head -> origin/pr/2520/head
* [new ref] refs/pull/2520/merge -> origin/pr/2520/merge
* [new ref] refs/pull/2521/head -> origin/pr/2521/head
* [new ref] refs/pull/2521/merge -> origin/pr/2521/merge
* [new ref] refs/pull/2522/head -> origin/pr/2522/head
* [new ref] refs/pull/2522/merge -> origin/pr/2522/merge
* [new ref] refs/pull/2523/head -> origin/pr/2523/head
* [new ref] refs/pull/2523/merge -> origin/pr/2523/merge
* [new ref] refs/pull/2524/head -> origin/pr/2524/head
* [new ref] refs/pull/2525/head -> origin/pr/2525/head
* [new ref] refs/pull/2525/merge -> origin/pr/2525/merge
* [new ref] refs/pull/2526/head -> origin/pr/2526/head
* [new ref] refs/pull/2527/head -> origin/pr/2527/head
* [new ref] refs/pull/2527/merge -> origin/pr/2527/merge
* [new ref] refs/pull/2528/head -> origin/pr/2528/head
* [new ref] refs/pull/2528/merge -> origin/pr/2528/merge
* [new ref] refs/pull/2529/head -> origin/pr/2529/head
* [new ref] refs/pull/2529/merge -> origin/pr/2529/merge
* [new ref] refs/pull/2530/head -> origin/pr/2530/head
* [new ref] refs/pull/2530/merge -> origin/pr/2530/merge
* [new ref] refs/pull/2531/head -> origin/pr/2531/head
* [new ref] refs/pull/2531/merge -> origin/pr/2531/merge
* [new ref] refs/pull/2532/head -> origin/pr/2532/head
* [new ref] refs/pull/2532/merge -> origin/pr/2532/merge
* [new ref] refs/pull/2533/head -> origin/pr/2533/head
* [new ref] refs/pull/2533/merge -> origin/pr/2533/merge
* [new ref] refs/pull/2534/head -> origin/pr/2534/head
* [new ref] refs/pull/2534/merge -> origin/pr/2534/merge
* [new ref] refs/pull/2535/head -> origin/pr/2535/head
* [new ref] refs/pull/2535/merge -> origin/pr/2535/merge
* [new ref] refs/pull/2536/head -> origin/pr/2536/head
* [new ref] refs/pull/2536/merge -> origin/pr/2536/merge
* [new ref] refs/pull/2537/head -> origin/pr/2537/head
* [new ref] refs/pull/2537/merge -> origin/pr/2537/merge
* [new ref] refs/pull/2538/head -> origin/pr/2538/head
* [new ref] refs/pull/2538/merge -> origin/pr/2538/merge
* [new ref] refs/pull/2539/head -> origin/pr/2539/head
* [new ref] refs/pull/2539/merge -> origin/pr/2539/merge
* [new ref] refs/pull/2540/head -> origin/pr/2540/head
* [new ref] refs/pull/2540/merge -> origin/pr/2540/merge
* [new ref] refs/pull/2541/head -> origin/pr/2541/head
* [new ref] refs/pull/2541/merge -> origin/pr/2541/merge
* [new ref] refs/pull/2542/head -> origin/pr/2542/head
* [new ref] refs/pull/2542/merge -> origin/pr/2542/merge
* [new ref] refs/pull/2543/head -> origin/pr/2543/head
* [new ref] refs/pull/2543/merge -> origin/pr/2543/merge
* [new ref] refs/pull/2544/head -> origin/pr/2544/head
* [new ref] refs/pull/2544/merge -> origin/pr/2544/merge
* [new ref] refs/pull/2545/head -> origin/pr/2545/head
* [new ref] refs/pull/2545/merge -> origin/pr/2545/merge
* [new ref] refs/pull/2546/head -> origin/pr/2546/head
* [new ref] refs/pull/2546/merge -> origin/pr/2546/merge
* [new ref] refs/pull/2547/head -> origin/pr/2547/head
* [new ref] refs/pull/2547/merge -> origin/pr/2547/merge
* [new ref] refs/pull/2548/head -> origin/pr/2548/head
* [new ref] refs/pull/2548/merge -> origin/pr/2548/merge
error: unable to resolve reference refs/remotes/origin/pr/2549/merge: No such file or directory
! eac251b...4f2eee1 refs/pull/2549/merge -> origin/pr/2549/merge (unable to update local ref)
* [new ref] refs/pull/2550/head -> origin/pr/2550/head
* [new ref] refs/pull/2550/merge -> origin/pr/2550/merge
error: unable to resolve reference refs/remotes/origin/pr/592/merge: No such file or directory
! 60d65b7...dd8a5f2 refs/pull/592/merge -> origin/pr/592/merge (unable to update local ref)
Auto packing the repository for optimum performance. You may also
run "git gc" manually. See "git help gc" for more information.
warning: There are too many unreachable loose objects; run 'git prune' to remove them.
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1799)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1525)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:65)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:316)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor862.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy103.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 946778c5bb114814d1ba5ebe71a27bc960f9e59b (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 946778c5bb114814d1ba5ebe71a27bc960f9e59b
> git rev-list f7d727c0f7ada7a162f5cb73f658ce52f094dd86 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2183302179321813950.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3671284807063179629.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5450963157070791769.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4835424911024664160.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-17 12:01:55,812 551eb6c1 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/551eb6c1/pkb.log
2017-04-17 12:01:55,813 551eb6c1 MainThread INFO PerfKitBenchmarker version: v1.11.0-40-g1f4031b
2017-04-17 12:01:55,813 551eb6c1 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-17 12:01:56,289 551eb6c1 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-17 12:01:56,369 551eb6c1 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-17 12:01:56,371 551eb6c1 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-17 12:01:56,372 551eb6c1 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-17 12:01:56,376 551eb6c1 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-17 12:01:56,378 551eb6c1 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-17 12:01:56,407 551eb6c1 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-17 12:01:56,408 551eb6c1 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/551eb6c1/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #318
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/318/display/redirect>
------------------------------------------
[...truncated 237.35 KB...]
x [deleted] (none) -> origin/pr/979/head
x [deleted] (none) -> origin/pr/979/merge
x [deleted] (none) -> origin/pr/98/head
x [deleted] (none) -> origin/pr/980/head
x [deleted] (none) -> origin/pr/980/merge
x [deleted] (none) -> origin/pr/981/head
x [deleted] (none) -> origin/pr/982/head
x [deleted] (none) -> origin/pr/982/merge
x [deleted] (none) -> origin/pr/983/head
x [deleted] (none) -> origin/pr/983/merge
x [deleted] (none) -> origin/pr/984/head
x [deleted] (none) -> origin/pr/984/merge
x [deleted] (none) -> origin/pr/985/head
x [deleted] (none) -> origin/pr/985/merge
x [deleted] (none) -> origin/pr/986/head
x [deleted] (none) -> origin/pr/986/merge
x [deleted] (none) -> origin/pr/987/head
x [deleted] (none) -> origin/pr/988/head
x [deleted] (none) -> origin/pr/988/merge
x [deleted] (none) -> origin/pr/989/head
x [deleted] (none) -> origin/pr/989/merge
x [deleted] (none) -> origin/pr/99/head
x [deleted] (none) -> origin/pr/99/merge
x [deleted] (none) -> origin/pr/990/head
x [deleted] (none) -> origin/pr/990/merge
x [deleted] (none) -> origin/pr/991/head
x [deleted] (none) -> origin/pr/991/merge
x [deleted] (none) -> origin/pr/992/head
x [deleted] (none) -> origin/pr/992/merge
x [deleted] (none) -> origin/pr/993/head
x [deleted] (none) -> origin/pr/993/merge
x [deleted] (none) -> origin/pr/994/head
x [deleted] (none) -> origin/pr/994/merge
x [deleted] (none) -> origin/pr/995/head
x [deleted] (none) -> origin/pr/995/merge
x [deleted] (none) -> origin/pr/996/head
x [deleted] (none) -> origin/pr/996/merge
x [deleted] (none) -> origin/pr/997/head
x [deleted] (none) -> origin/pr/997/merge
x [deleted] (none) -> origin/pr/998/head
x [deleted] (none) -> origin/pr/999/head
x [deleted] (none) -> origin/pr/999/merge
remote: Counting objects: 2358, done.
remote: Compressing objects: 0% (1/221) remote: Compressing objects: 1% (3/221) remote: Compressing objects: 2% (5/221) remote: Compressing objects: 3% (7/221) remote: Compressing objects: 4% (9/221) remote: Compressing objects: 5% (12/221) remote: Compressing objects: 6% (14/221) remote: Compressing objects: 7% (16/221) remote: Compressing objects: 8% (18/221) remote: Compressing objects: 9% (20/221) remote: Compressing objects: 10% (23/221) remote: Compressing objects: 11% (25/221) remote: Compressing objects: 12% (27/221) remote: Compressing objects: 13% (29/221) remote: Compressing objects: 14% (31/221) remote: Compressing objects: 15% (34/221) remote: Compressing objects: 16% (36/221) remote: Compressing objects: 17% (38/221) remote: Compressing objects: 18% (40/221) remote: Compressing objects: 19% (42/221) remote: Compressing objects: 20% (45/221) remote: Compressing objects: 21% (47/221) remote: Compressing objects: 22% (49/221) remote: Compressing objects: 23% (51/221) remote: Compressing objects: 24% (54/221) remote: Compressing objects: 25% (56/221) remote: Compressing objects: 26% (58/221) remote: Compressing objects: 27% (60/221) remote: Compressing objects: 28% (62/221) remote: Compressing objects: 29% (65/221) remote: Compressing objects: 30% (67/221) remote: Compressing objects: 31% (69/221) remote: Compressing objects: 32% (71/221) remote: Compressing objects: 33% (73/221) remote: Compressing objects: 34% (76/221) remote: Compressing objects: 35% (78/221) remote: Compressing objects: 36% (80/221) remote: Compressing objects: 37% (82/221) remote: Compressing objects: 38% (84/221) remote: Compressing objects: 39% (87/221) remote: Compressing objects: 40% (89/221) remote: Compressing objects: 41% (91/221) remote: Compressing objects: 42% (93/221) remote: Compressing objects: 43% (96/221) remote: Compressing objects: 44% (98/221) remote: Compressing objects: 45% (100/221) remote: Compressing objects: 46% (102/221) remote: Compressing objects: 47% (104/221) remote: Compressing objects: 48% (107/221) remote: Compressing objects: 49% (109/221) remote: Compressing objects: 50% (111/221) remote: Compressing objects: 51% (113/221) remote: Compressing objects: 52% (115/221) remote: Compressing objects: 53% (118/221) remote: Compressing objects: 54% (120/221) remote: Compressing objects: 55% (122/221) remote: Compressing objects: 56% (124/221) remote: Compressing objects: 57% (126/221) remote: Compressing objects: 58% (129/221) remote: Compressing objects: 59% (131/221) remote: Compressing objects: 60% (133/221) remote: Compressing objects: 61% (135/221) remote: Compressing objects: 62% (138/221) remote: Compressing objects: 63% (140/221) remote: Compressing objects: 64% (142/221) remote: Compressing objects: 65% (144/221) remote: Compressing objects: 66% (146/221) remote: Compressing objects: 67% (149/221) remote: Compressing objects: 68% (151/221) remote: Compressing objects: 69% (153/221) remote: Compressing objects: 70% (155/221) remote: Compressing objects: 71% (157/221) remote: Compressing objects: 72% (160/221) remote: Compressing objects: 73% (162/221) remote: Compressing objects: 74% (164/221) remote: Compressing objects: 75% (166/221) remote: Compressing objects: 76% (168/221) remote: Compressing objects: 77% (171/221) remote: Compressing objects: 78% (173/221) remote: Compressing objects: 79% (175/221) remote: Compressing objects: 80% (177/221) remote: Compressing objects: 81% (180/221) remote: Compressing objects: 82% (182/221) remote: Compressing objects: 83% (184/221) remote: Compressing objects: 84% (186/221) remote: Compressing objects: 85% (188/221) remote: Compressing objects: 86% (191/221) remote: Compressing objects: 87% (193/221) remote: Compressing objects: 88% (195/221) remote: Compressing objects: 89% (197/221) remote: Compressing objects: 90% (199/221) remote: Compressing objects: 91% (202/221) remote: Compressing objects: 92% (204/221) remote: Compressing objects: 93% (206/221) remote: Compressing objects: 94% (208/221) remote: Compressing objects: 95% (210/221) remote: Compressing objects: 96% (213/221) remote: Compressing objects: 97% (215/221) remote: Compressing objects: 98% (217/221) remote: Compressing objects: 99% (219/221) remote: Compressing objects: 100% (221/221) remote: Compressing objects: 100% (221/221), done.
Receiving objects: 0% (1/2358) Receiving objects: 1% (24/2358) Receiving objects: 2% (48/2358) Receiving objects: 3% (71/2358) Receiving objects: 4% (95/2358) Receiving objects: 5% (118/2358) Receiving objects: 6% (142/2358) Receiving objects: 7% (166/2358) Receiving objects: 8% (189/2358) Receiving objects: 9% (213/2358) Receiving objects: 10% (236/2358) Receiving objects: 11% (260/2358) Receiving objects: 12% (283/2358) Receiving objects: 13% (307/2358) Receiving objects: 14% (331/2358) Receiving objects: 15% (354/2358) Receiving objects: 16% (378/2358) Receiving objects: 17% (401/2358) Receiving objects: 18% (425/2358) Receiving objects: 19% (449/2358) Receiving objects: 20% (472/2358) Receiving objects: 21% (496/2358) Receiving objects: 22% (519/2358) Receiving objects: 23% (543/2358) Receiving objects: 24% (566/2358) Receiving objects: 25% (590/2358) Receiving objects: 26% (614/2358) Receiving objects: 27% (637/2358) Receiving objects: 28% (661/2358) Receiving objects: 29% (684/2358) Receiving objects: 30% (708/2358) Receiving objects: 31% (731/2358) Receiving objects: 32% (755/2358) Receiving objects: 33% (779/2358) Receiving objects: 34% (802/2358) Receiving objects: 35% (826/2358) Receiving objects: 36% (849/2358) Receiving objects: 37% (873/2358) Receiving objects: 38% (897/2358) Receiving objects: 39% (920/2358) Receiving objects: 40% (944/2358) Receiving objects: 41% (967/2358) Receiving objects: 42% (991/2358) Receiving objects: 43% (1014/2358) Receiving objects: 44% (1038/2358) Receiving objects: 45% (1062/2358) Receiving objects: 46% (1085/2358) Receiving objects: 47% (1109/2358) Receiving objects: 48% (1132/2358) Receiving objects: 49% (1156/2358) Receiving objects: 50% (1179/2358) Receiving objects: 51% (1203/2358) Receiving objects: 52% (1227/2358) Receiving objects: 53% (1250/2358) Receiving objects: 54% (1274/2358) Receiving objects: 55% (1297/2358) Receiving objects: 56% (1321/2358) Receiving objects: 57% (1345/2358) Receiving objects: 58% (1368/2358) Receiving objects: 59% (1392/2358) Receiving objects: 60% (1415/2358) Receiving objects: 61% (1439/2358) Receiving objects: 62% (1462/2358) Receiving objects: 63% (1486/2358) Receiving objects: 64% (1510/2358) Receiving objects: 65% (1533/2358) Receiving objects: 66% (1557/2358) Receiving objects: 67% (1580/2358) Receiving objects: 68% (1604/2358) Receiving objects: 69% (1628/2358) Receiving objects: 70% (1651/2358) Receiving objects: 71% (1675/2358) Receiving objects: 72% (1698/2358) Receiving objects: 73% (1722/2358) Receiving objects: 74% (1745/2358) Receiving objects: 75% (1769/2358) Receiving objects: 76% (1793/2358) Receiving objects: 77% (1816/2358) Receiving objects: 78% (1840/2358) Receiving objects: 79% (1863/2358) Receiving objects: 80% (1887/2358) Receiving objects: 81% (1910/2358) Receiving objects: 82% (1934/2358) Receiving objects: 83% (1958/2358) Receiving objects: 84% (1981/2358) Receiving objects: 85% (2005/2358) Receiving objects: 86% (2028/2358) Receiving objects: 87% (2052/2358) Receiving objects: 88% (2076/2358) Receiving objects: 89% (2099/2358) Receiving objects: 90% (2123/2358) Receiving objects: 91% (2146/2358) Receiving objects: 92% (2170/2358) Receiving objects: 93% (2193/2358) Receiving objects: 94% (2217/2358) Receiving objects: 95% (2241/2358) remote: Total 2358 (delta 850), reused 758 (delta 758), pack-reused 1273
Receiving objects: 96% (2264/2358) Receiving objects: 97% (2288/2358) Receiving objects: 98% (2311/2358) Receiving objects: 99% (2335/2358) Receiving objects: 100% (2358/2358) Receiving objects: 100% (2358/2358), 330.71 KiB | 0 bytes/s, done.
Resolving deltas: 0% (0/887) Resolving deltas: 1% (9/887) Resolving deltas: 2% (19/887) Resolving deltas: 3% (30/887) Resolving deltas: 4% (37/887) Resolving deltas: 5% (49/887) Resolving deltas: 6% (56/887) Resolving deltas: 7% (64/887) Resolving deltas: 9% (82/887) Resolving deltas: 10% (91/887) Resolving deltas: 11% (98/887) Resolving deltas: 12% (107/887) Resolving deltas: 14% (129/887) Resolving deltas: 15% (138/887) Resolving deltas: 17% (152/887) Resolving deltas: 18% (163/887) Resolving deltas: 22% (196/887) Resolving deltas: 23% (206/887) Resolving deltas: 24% (217/887) Resolving deltas: 25% (223/887) Resolving deltas: 26% (232/887) Resolving deltas: 27% (240/887) Resolving deltas: 28% (250/887) Resolving deltas: 29% (258/887) Resolving deltas: 30% (267/887) Resolving deltas: 31% (276/887) Resolving deltas: 32% (284/887) Resolving deltas: 33% (295/887) Resolving deltas: 34% (303/887) Resolving deltas: 35% (313/887) Resolving deltas: 36% (320/887) Resolving deltas: 37% (329/887) Resolving deltas: 38% (339/887) Resolving deltas: 39% (351/887) Resolving deltas: 40% (355/887) Resolving deltas: 41% (364/887) Resolving deltas: 42% (380/887) Resolving deltas: 43% (383/887) Resolving deltas: 44% (393/887) Resolving deltas: 45% (405/887) Resolving deltas: 46% (410/887) Resolving deltas: 48% (426/887) Resolving deltas: 49% (435/887) Resolving deltas: 50% (444/887) Resolving deltas: 51% (454/887) Resolving deltas: 52% (467/887) Resolving deltas: 53% (472/887) Resolving deltas: 54% (479/887) Resolving deltas: 55% (488/887) Resolving deltas: 56% (497/887) Resolving deltas: 57% (506/887) Resolving deltas: 58% (517/887) Resolving deltas: 59% (525/887) Resolving deltas: 60% (533/887) Resolving deltas: 61% (542/887) Resolving deltas: 62% (550/887) Resolving deltas: 63% (560/887) Resolving deltas: 64% (568/887) Resolving deltas: 65% (578/887) Resolving deltas: 66% (586/887) Resolving deltas: 67% (596/887) Resolving deltas: 68% (604/887) Resolving deltas: 69% (614/887) Resolving deltas: 70% (622/887) Resolving deltas: 71% (630/887) Resolving deltas: 72% (640/887) Resolving deltas: 73% (649/887) Resolving deltas: 74% (657/887) Resolving deltas: 75% (667/887) Resolving deltas: 76% (676/887) Resolving deltas: 77% (686/887) Resolving deltas: 78% (694/887) Resolving deltas: 79% (703/887) Resolving deltas: 80% (710/887) Resolving deltas: 81% (720/887) Resolving deltas: 82% (728/887) Resolving deltas: 83% (738/887) Resolving deltas: 84% (746/887) Resolving deltas: 85% (755/887) Resolving deltas: 86% (763/887) Resolving deltas: 87% (773/887) Resolving deltas: 88% (781/887) Resolving deltas: 89% (790/887) Resolving deltas: 90% (799/887) Resolving deltas: 91% (808/887) Resolving deltas: 92% (818/887) Resolving deltas: 93% (825/887) Resolving deltas: 94% (837/887) Resolving deltas: 95% (843/887) Resolving deltas: 96% (853/887) Resolving deltas: 97% (861/887) Resolving deltas: 98% (870/887) Resolving deltas: 99% (879/887) Resolving deltas: 100% (887/887) Resolving deltas: 100% (887/887), completed with 348 local objects.
error: unable to resolve reference refs/remotes/origin/pr/2357/merge: No such file or directory
! 5bb5b6d...ef7fb12 refs/pull/2357/merge -> origin/pr/2357/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2381/merge: No such file or directory
! 251f88d...49f6c1a refs/pull/2381/merge -> origin/pr/2381/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2385/merge: No such file or directory
! 33d8a6e...fc7e7c8 refs/pull/2385/merge -> origin/pr/2385/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2389/merge: No such file or directory
! 4cc83d7...6a173ff refs/pull/2389/merge -> origin/pr/2389/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2399/merge: No such file or directory
! 7f95e55...e77af3d refs/pull/2399/merge -> origin/pr/2399/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2403/merge: No such file or directory
! e9bf169...d3466d6 refs/pull/2403/merge -> origin/pr/2403/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2423/merge: No such file or directory
! 6c783c7...97b8bb7 refs/pull/2423/merge -> origin/pr/2423/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2464/merge: No such file or directory
! d4e537d...3f5fdfa refs/pull/2464/merge -> origin/pr/2464/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2497/merge: No such file or directory
! a9ffe52...768927c refs/pull/2497/merge -> origin/pr/2497/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2514/merge: No such file or directory
! 7079a6f...1fdb7fe refs/pull/2514/merge -> origin/pr/2514/merge (unable to update local ref)
* [new ref] refs/pull/2516/head -> origin/pr/2516/head
* [new ref] refs/pull/2516/merge -> origin/pr/2516/merge
* [new ref] refs/pull/2517/head -> origin/pr/2517/head
* [new ref] refs/pull/2517/merge -> origin/pr/2517/merge
* [new ref] refs/pull/2518/head -> origin/pr/2518/head
* [new ref] refs/pull/2518/merge -> origin/pr/2518/merge
* [new ref] refs/pull/2519/head -> origin/pr/2519/head
* [new ref] refs/pull/2519/merge -> origin/pr/2519/merge
* [new ref] refs/pull/2520/head -> origin/pr/2520/head
* [new ref] refs/pull/2520/merge -> origin/pr/2520/merge
* [new ref] refs/pull/2521/head -> origin/pr/2521/head
* [new ref] refs/pull/2521/merge -> origin/pr/2521/merge
* [new ref] refs/pull/2522/head -> origin/pr/2522/head
* [new ref] refs/pull/2522/merge -> origin/pr/2522/merge
* [new ref] refs/pull/2523/head -> origin/pr/2523/head
* [new ref] refs/pull/2523/merge -> origin/pr/2523/merge
* [new ref] refs/pull/2524/head -> origin/pr/2524/head
* [new ref] refs/pull/2525/head -> origin/pr/2525/head
* [new ref] refs/pull/2525/merge -> origin/pr/2525/merge
* [new ref] refs/pull/2526/head -> origin/pr/2526/head
* [new ref] refs/pull/2527/head -> origin/pr/2527/head
* [new ref] refs/pull/2527/merge -> origin/pr/2527/merge
* [new ref] refs/pull/2528/head -> origin/pr/2528/head
* [new ref] refs/pull/2528/merge -> origin/pr/2528/merge
* [new ref] refs/pull/2529/head -> origin/pr/2529/head
* [new ref] refs/pull/2529/merge -> origin/pr/2529/merge
* [new ref] refs/pull/2530/head -> origin/pr/2530/head
* [new ref] refs/pull/2530/merge -> origin/pr/2530/merge
* [new ref] refs/pull/2531/head -> origin/pr/2531/head
* [new ref] refs/pull/2531/merge -> origin/pr/2531/merge
* [new ref] refs/pull/2532/head -> origin/pr/2532/head
* [new ref] refs/pull/2532/merge -> origin/pr/2532/merge
* [new ref] refs/pull/2533/head -> origin/pr/2533/head
* [new ref] refs/pull/2533/merge -> origin/pr/2533/merge
* [new ref] refs/pull/2534/head -> origin/pr/2534/head
* [new ref] refs/pull/2534/merge -> origin/pr/2534/merge
* [new ref] refs/pull/2535/head -> origin/pr/2535/head
* [new ref] refs/pull/2535/merge -> origin/pr/2535/merge
* [new ref] refs/pull/2536/head -> origin/pr/2536/head
* [new ref] refs/pull/2536/merge -> origin/pr/2536/merge
* [new ref] refs/pull/2537/head -> origin/pr/2537/head
* [new ref] refs/pull/2537/merge -> origin/pr/2537/merge
* [new ref] refs/pull/2538/head -> origin/pr/2538/head
* [new ref] refs/pull/2538/merge -> origin/pr/2538/merge
* [new ref] refs/pull/2539/head -> origin/pr/2539/head
* [new ref] refs/pull/2539/merge -> origin/pr/2539/merge
* [new ref] refs/pull/2540/head -> origin/pr/2540/head
* [new ref] refs/pull/2540/merge -> origin/pr/2540/merge
* [new ref] refs/pull/2541/head -> origin/pr/2541/head
* [new ref] refs/pull/2541/merge -> origin/pr/2541/merge
* [new ref] refs/pull/2542/head -> origin/pr/2542/head
* [new ref] refs/pull/2542/merge -> origin/pr/2542/merge
* [new ref] refs/pull/2543/head -> origin/pr/2543/head
* [new ref] refs/pull/2543/merge -> origin/pr/2543/merge
* [new ref] refs/pull/2544/head -> origin/pr/2544/head
* [new ref] refs/pull/2544/merge -> origin/pr/2544/merge
* [new ref] refs/pull/2545/head -> origin/pr/2545/head
* [new ref] refs/pull/2545/merge -> origin/pr/2545/merge
* [new ref] refs/pull/2546/head -> origin/pr/2546/head
* [new ref] refs/pull/2546/merge -> origin/pr/2546/merge
* [new ref] refs/pull/2547/head -> origin/pr/2547/head
* [new ref] refs/pull/2547/merge -> origin/pr/2547/merge
* [new ref] refs/pull/2548/head -> origin/pr/2548/head
* [new ref] refs/pull/2548/merge -> origin/pr/2548/merge
* [new ref] refs/pull/2550/head -> origin/pr/2550/head
* [new ref] refs/pull/2550/merge -> origin/pr/2550/merge
Auto packing the repository for optimum performance. You may also
run "git gc" manually. See "git help gc" for more information.
warning: There are too many unreachable loose objects; run 'git prune' to remove them.
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1799)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1525)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:65)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:316)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor862.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy103.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision f7d727c0f7ada7a162f5cb73f658ce52f094dd86 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f f7d727c0f7ada7a162f5cb73f658ce52f094dd86
> git rev-list f7d727c0f7ada7a162f5cb73f658ce52f094dd86 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson6552707196228450310.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson6315119123645863314.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2535287405528515827.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2000769867364109042.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-17 06:01:47,308 30b4bb3a MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/30b4bb3a/pkb.log
2017-04-17 06:01:47,308 30b4bb3a MainThread INFO PerfKitBenchmarker version: v1.11.0-40-g1f4031b
2017-04-17 06:01:47,309 30b4bb3a MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-17 06:01:47,768 30b4bb3a MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-17 06:01:48,081 30b4bb3a MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-17 06:01:48,083 30b4bb3a MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-17 06:01:48,083 30b4bb3a MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-17 06:01:48,088 30b4bb3a MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-17 06:01:48,090 30b4bb3a MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-17 06:01:48,117 30b4bb3a MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-17 06:01:48,117 30b4bb3a MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/30b4bb3a/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #317
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/317/display/redirect>
------------------------------------------
[...truncated 236.50 KB...]
x [deleted] (none) -> origin/pr/970/head
x [deleted] (none) -> origin/pr/970/merge
x [deleted] (none) -> origin/pr/971/head
x [deleted] (none) -> origin/pr/971/merge
x [deleted] (none) -> origin/pr/972/head
x [deleted] (none) -> origin/pr/973/head
x [deleted] (none) -> origin/pr/974/head
x [deleted] (none) -> origin/pr/974/merge
x [deleted] (none) -> origin/pr/975/head
x [deleted] (none) -> origin/pr/975/merge
x [deleted] (none) -> origin/pr/976/head
x [deleted] (none) -> origin/pr/976/merge
x [deleted] (none) -> origin/pr/977/head
x [deleted] (none) -> origin/pr/977/merge
x [deleted] (none) -> origin/pr/978/head
x [deleted] (none) -> origin/pr/978/merge
x [deleted] (none) -> origin/pr/979/head
x [deleted] (none) -> origin/pr/979/merge
x [deleted] (none) -> origin/pr/98/head
x [deleted] (none) -> origin/pr/980/head
x [deleted] (none) -> origin/pr/980/merge
x [deleted] (none) -> origin/pr/981/head
x [deleted] (none) -> origin/pr/982/head
x [deleted] (none) -> origin/pr/982/merge
x [deleted] (none) -> origin/pr/983/head
x [deleted] (none) -> origin/pr/983/merge
x [deleted] (none) -> origin/pr/984/head
x [deleted] (none) -> origin/pr/984/merge
x [deleted] (none) -> origin/pr/985/head
x [deleted] (none) -> origin/pr/985/merge
x [deleted] (none) -> origin/pr/986/head
x [deleted] (none) -> origin/pr/986/merge
x [deleted] (none) -> origin/pr/987/head
x [deleted] (none) -> origin/pr/988/head
x [deleted] (none) -> origin/pr/988/merge
x [deleted] (none) -> origin/pr/989/head
x [deleted] (none) -> origin/pr/989/merge
x [deleted] (none) -> origin/pr/99/head
x [deleted] (none) -> origin/pr/99/merge
x [deleted] (none) -> origin/pr/990/head
x [deleted] (none) -> origin/pr/990/merge
x [deleted] (none) -> origin/pr/991/head
x [deleted] (none) -> origin/pr/991/merge
x [deleted] (none) -> origin/pr/992/head
x [deleted] (none) -> origin/pr/992/merge
x [deleted] (none) -> origin/pr/993/head
x [deleted] (none) -> origin/pr/993/merge
x [deleted] (none) -> origin/pr/994/head
x [deleted] (none) -> origin/pr/994/merge
x [deleted] (none) -> origin/pr/995/head
x [deleted] (none) -> origin/pr/995/merge
x [deleted] (none) -> origin/pr/996/head
x [deleted] (none) -> origin/pr/996/merge
x [deleted] (none) -> origin/pr/997/head
x [deleted] (none) -> origin/pr/997/merge
x [deleted] (none) -> origin/pr/998/head
x [deleted] (none) -> origin/pr/999/head
x [deleted] (none) -> origin/pr/999/merge
remote: Counting objects: 2061, done.
remote: Compressing objects: 0% (1/232) remote: Compressing objects: 1% (3/232) remote: Compressing objects: 2% (5/232) remote: Compressing objects: 3% (7/232) remote: Compressing objects: 4% (10/232) remote: Compressing objects: 5% (12/232) remote: Compressing objects: 6% (14/232) remote: Compressing objects: 7% (17/232) remote: Compressing objects: 8% (19/232) remote: Compressing objects: 9% (21/232) remote: Compressing objects: 10% (24/232) remote: Compressing objects: 11% (26/232) remote: Compressing objects: 12% (28/232) remote: Compressing objects: 13% (31/232) remote: Compressing objects: 14% (33/232) remote: Compressing objects: 15% (35/232) remote: Compressing objects: 16% (38/232) remote: Compressing objects: 17% (40/232) remote: Compressing objects: 18% (42/232) remote: Compressing objects: 19% (45/232) remote: Compressing objects: 20% (47/232) remote: Compressing objects: 21% (49/232) remote: Compressing objects: 22% (52/232) remote: Compressing objects: 23% (54/232) remote: Compressing objects: 24% (56/232) remote: Compressing objects: 25% (58/232) remote: Compressing objects: 26% (61/232) remote: Compressing objects: 27% (63/232) remote: Compressing objects: 28% (65/232) remote: Compressing objects: 29% (68/232) remote: Compressing objects: 30% (70/232) remote: Compressing objects: 31% (72/232) remote: Compressing objects: 32% (75/232) remote: Compressing objects: 33% (77/232) remote: Compressing objects: 34% (79/232) remote: Compressing objects: 35% (82/232) remote: Compressing objects: 36% (84/232) remote: Compressing objects: 37% (86/232) remote: Compressing objects: 38% (89/232) remote: Compressing objects: 39% (91/232) remote: Compressing objects: 40% (93/232) remote: Compressing objects: 41% (96/232) remote: Compressing objects: 42% (98/232) remote: Compressing objects: 43% (100/232) remote: Compressing objects: 44% (103/232) remote: Compressing objects: 45% (105/232) remote: Compressing objects: 46% (107/232) remote: Compressing objects: 47% (110/232) remote: Compressing objects: 48% (112/232) remote: Compressing objects: 49% (114/232) remote: Compressing objects: 50% (116/232) remote: Compressing objects: 51% (119/232) remote: Compressing objects: 52% (121/232) remote: Compressing objects: 53% (123/232) remote: Compressing objects: 54% (126/232) remote: Compressing objects: 55% (128/232) remote: Compressing objects: 56% (130/232) remote: Compressing objects: 57% (133/232) remote: Compressing objects: 58% (135/232) remote: Compressing objects: 59% (137/232) remote: Compressing objects: 60% (140/232) remote: Compressing objects: 61% (142/232) remote: Compressing objects: 62% (144/232) remote: Compressing objects: 63% (147/232) remote: Compressing objects: 64% (149/232) remote: Compressing objects: 65% (151/232) remote: Compressing objects: 66% (154/232) remote: Compressing objects: 67% (156/232) remote: Compressing objects: 68% (158/232) remote: Compressing objects: 69% (161/232) remote: Compressing objects: 70% (163/232) remote: Compressing objects: 71% (165/232) remote: Compressing objects: 72% (168/232) remote: Compressing objects: 73% (170/232) remote: Compressing objects: 74% (172/232) remote: Compressing objects: 75% (174/232) remote: Compressing objects: 76% (177/232) remote: Compressing objects: 77% (179/232) remote: Compressing objects: 78% (181/232) remote: Compressing objects: 79% (184/232) remote: Compressing objects: 80% (186/232) remote: Compressing objects: 81% (188/232) remote: Compressing objects: 82% (191/232) remote: Compressing objects: 83% (193/232) remote: Compressing objects: 84% (195/232) remote: Compressing objects: 85% (198/232) remote: Compressing objects: 86% (200/232) remote: Compressing objects: 87% (202/232) remote: Compressing objects: 88% (205/232) remote: Compressing objects: 89% (207/232) remote: Compressing objects: 90% (209/232) remote: Compressing objects: 91% (212/232) remote: Compressing objects: 92% (214/232) remote: Compressing objects: 93% (216/232) remote: Compressing objects: 94% (219/232) remote: Compressing objects: 95% (221/232) remote: Compressing objects: 96% (223/232) remote: Compressing objects: 97% (226/232) remote: Compressing objects: 98% (228/232) remote: Compressing objects: 99% (230/232) remote: Compressing objects: 100% (232/232) remote: Compressing objects: 100% (232/232), done.
Receiving objects: 0% (1/2061) Receiving objects: 1% (21/2061) Receiving objects: 2% (42/2061) Receiving objects: 3% (62/2061) Receiving objects: 4% (83/2061) Receiving objects: 5% (104/2061) Receiving objects: 6% (124/2061) Receiving objects: 7% (145/2061) Receiving objects: 8% (165/2061) Receiving objects: 9% (186/2061) Receiving objects: 10% (207/2061) Receiving objects: 11% (227/2061) Receiving objects: 12% (248/2061) Receiving objects: 13% (268/2061) Receiving objects: 14% (289/2061) Receiving objects: 15% (310/2061) Receiving objects: 16% (330/2061), 28.01 KiB | 46.00 KiB/s Receiving objects: 17% (351/2061), 28.01 KiB | 46.00 KiB/s Receiving objects: 18% (371/2061), 28.01 KiB | 46.00 KiB/s Receiving objects: 19% (392/2061), 28.01 KiB | 46.00 KiB/s Receiving objects: 20% (413/2061), 28.01 KiB | 46.00 KiB/s Receiving objects: 21% (433/2061), 28.01 KiB | 46.00 KiB/s Receiving objects: 22% (454/2061), 28.01 KiB | 46.00 KiB/s Receiving objects: 23% (475/2061), 28.01 KiB | 46.00 KiB/s Receiving objects: 24% (495/2061), 28.01 KiB | 46.00 KiB/s Receiving objects: 25% (516/2061), 28.01 KiB | 46.00 KiB/s Receiving objects: 26% (536/2061), 28.01 KiB | 46.00 KiB/s Receiving objects: 27% (557/2061), 28.01 KiB | 46.00 KiB/s Receiving objects: 28% (578/2061), 28.01 KiB | 46.00 KiB/s Receiving objects: 29% (598/2061), 28.01 KiB | 46.00 KiB/s Receiving objects: 30% (619/2061), 28.01 KiB | 46.00 KiB/s Receiving objects: 31% (639/2061), 28.01 KiB | 46.00 KiB/s Receiving objects: 32% (660/2061), 28.01 KiB | 46.00 KiB/s Receiving objects: 33% (681/2061), 28.01 KiB | 46.00 KiB/s Receiving objects: 34% (701/2061), 28.01 KiB | 46.00 KiB/s Receiving objects: 35% (722/2061), 28.01 KiB | 46.00 KiB/s Receiving objects: 36% (742/2061), 28.01 KiB | 46.00 KiB/s Receiving objects: 37% (763/2061), 28.01 KiB | 46.00 KiB/s Receiving objects: 38% (784/2061), 28.01 KiB | 46.00 KiB/s Receiving objects: 39% (804/2061), 28.01 KiB | 46.00 KiB/s Receiving objects: 40% (825/2061), 28.01 KiB | 46.00 KiB/s Receiving objects: 41% (846/2061), 28.01 KiB | 46.00 KiB/s Receiving objects: 42% (866/2061), 28.01 KiB | 46.00 KiB/s Receiving objects: 43% (887/2061), 28.01 KiB | 46.00 KiB/s Receiving objects: 44% (907/2061), 28.01 KiB | 46.00 KiB/s Receiving objects: 45% (928/2061), 28.01 KiB | 46.00 KiB/s Receiving objects: 46% (949/2061), 28.01 KiB | 46.00 KiB/s Receiving objects: 46% (964/2061), 28.01 KiB | 46.00 KiB/s Receiving objects: 47% (969/2061), 28.01 KiB | 46.00 KiB/s Receiving objects: 48% (990/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 49% (1010/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 50% (1031/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 51% (1052/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 52% (1072/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 53% (1093/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 54% (1113/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 55% (1134/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 56% (1155/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 57% (1175/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 58% (1196/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 59% (1216/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 60% (1237/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 61% (1258/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 62% (1278/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 63% (1299/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 64% (1320/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 65% (1340/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 66% (1361/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 67% (1381/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 68% (1402/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 69% (1423/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 70% (1443/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 71% (1464/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 72% (1484/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 73% (1505/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 74% (1526/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 75% (1546/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 76% (1567/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 77% (1587/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 78% (1608/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 79% (1629/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 80% (1649/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 81% (1670/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 82% (1691/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 83% (1711/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 84% (1732/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 85% (1752/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 86% (1773/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 87% (1794/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 88% (1814/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 89% (1835/2061), 72.01 KiB | 64.00 KiB/s remote: Total 2061 (delta 725), reused 631 (delta 631), pack-reused 1073
Receiving objects: 90% (1855/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 91% (1876/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 92% (1897/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 93% (1917/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 94% (1938/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 95% (1958/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 96% (1979/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 97% (2000/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 98% (2020/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 99% (2041/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 100% (2061/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 100% (2061/2061), 340.03 KiB | 64.00 KiB/s, done.
Resolving deltas: 0% (0/751) Resolving deltas: 1% (8/751) Resolving deltas: 2% (17/751) Resolving deltas: 3% (23/751) Resolving deltas: 4% (36/751) Resolving deltas: 5% (42/751) Resolving deltas: 6% (49/751) Resolving deltas: 8% (67/751) Resolving deltas: 9% (73/751) Resolving deltas: 10% (81/751) Resolving deltas: 11% (89/751) Resolving deltas: 12% (91/751) Resolving deltas: 13% (102/751) Resolving deltas: 14% (107/751) Resolving deltas: 15% (115/751) Resolving deltas: 16% (121/751) Resolving deltas: 17% (130/751) Resolving deltas: 18% (141/751) Resolving deltas: 19% (147/751) Resolving deltas: 20% (152/751) Resolving deltas: 23% (175/751) Resolving deltas: 24% (182/751) Resolving deltas: 25% (189/751) Resolving deltas: 26% (196/751) Resolving deltas: 27% (204/751) Resolving deltas: 28% (211/751) Resolving deltas: 29% (218/751) Resolving deltas: 30% (226/751) Resolving deltas: 31% (236/751) Resolving deltas: 32% (243/751) Resolving deltas: 33% (248/751) Resolving deltas: 34% (256/751) Resolving deltas: 35% (264/751) Resolving deltas: 36% (271/751) Resolving deltas: 37% (279/751) Resolving deltas: 38% (288/751) Resolving deltas: 39% (294/751) Resolving deltas: 40% (301/751) Resolving deltas: 41% (309/751) Resolving deltas: 42% (321/751) Resolving deltas: 43% (323/751) Resolving deltas: 44% (332/751) Resolving deltas: 45% (338/751) Resolving deltas: 46% (346/751) Resolving deltas: 47% (353/751) Resolving deltas: 48% (361/751) Resolving deltas: 49% (368/751) Resolving deltas: 50% (376/751) Resolving deltas: 51% (388/751) Resolving deltas: 52% (391/751) Resolving deltas: 53% (399/751) Resolving deltas: 54% (406/751) Resolving deltas: 55% (416/751) Resolving deltas: 56% (423/751) Resolving deltas: 57% (429/751) Resolving deltas: 58% (436/751) Resolving deltas: 59% (445/751) Resolving deltas: 60% (452/751) Resolving deltas: 61% (460/751) Resolving deltas: 62% (466/751) Resolving deltas: 63% (474/751) Resolving deltas: 64% (482/751) Resolving deltas: 65% (490/751) Resolving deltas: 66% (498/751) Resolving deltas: 67% (506/751) Resolving deltas: 68% (514/751) Resolving deltas: 69% (520/751) Resolving deltas: 70% (526/751) Resolving deltas: 71% (535/751) Resolving deltas: 72% (541/751) Resolving deltas: 73% (549/751) Resolving deltas: 74% (556/751) Resolving deltas: 75% (566/751) Resolving deltas: 76% (574/751) Resolving deltas: 77% (580/751) Resolving deltas: 78% (586/751) Resolving deltas: 79% (594/751) Resolving deltas: 80% (602/751) Resolving deltas: 81% (610/751) Resolving deltas: 82% (616/751) Resolving deltas: 83% (624/751) Resolving deltas: 84% (631/751) Resolving deltas: 85% (639/751) Resolving deltas: 86% (647/751) Resolving deltas: 87% (654/751) Resolving deltas: 88% (661/751) Resolving deltas: 89% (669/751) Resolving deltas: 90% (676/751) Resolving deltas: 91% (684/751) Resolving deltas: 92% (692/751) Resolving deltas: 93% (705/751) Resolving deltas: 94% (707/751) Resolving deltas: 95% (714/751) Resolving deltas: 96% (721/751) Resolving deltas: 97% (729/751) Resolving deltas: 98% (738/751) Resolving deltas: 99% (744/751) Resolving deltas: 100% (751/751) Resolving deltas: 100% (751/751), completed with 296 local objects.
error: unable to resolve reference refs/remotes/origin/pr/2330/head: No such file or directory
! 511a130...447306d refs/pull/2330/head -> origin/pr/2330/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2330/merge: No such file or directory
! 5d4c028...6a9103e refs/pull/2330/merge -> origin/pr/2330/merge (unable to update local ref)
* [new ref] refs/pull/2516/head -> origin/pr/2516/head
* [new ref] refs/pull/2516/merge -> origin/pr/2516/merge
* [new ref] refs/pull/2517/head -> origin/pr/2517/head
* [new ref] refs/pull/2517/merge -> origin/pr/2517/merge
* [new ref] refs/pull/2518/head -> origin/pr/2518/head
* [new ref] refs/pull/2518/merge -> origin/pr/2518/merge
* [new ref] refs/pull/2519/head -> origin/pr/2519/head
* [new ref] refs/pull/2519/merge -> origin/pr/2519/merge
* [new ref] refs/pull/2520/head -> origin/pr/2520/head
* [new ref] refs/pull/2520/merge -> origin/pr/2520/merge
* [new ref] refs/pull/2521/head -> origin/pr/2521/head
* [new ref] refs/pull/2521/merge -> origin/pr/2521/merge
* [new ref] refs/pull/2522/head -> origin/pr/2522/head
* [new ref] refs/pull/2522/merge -> origin/pr/2522/merge
* [new ref] refs/pull/2523/head -> origin/pr/2523/head
* [new ref] refs/pull/2523/merge -> origin/pr/2523/merge
* [new ref] refs/pull/2524/head -> origin/pr/2524/head
* [new ref] refs/pull/2525/head -> origin/pr/2525/head
* [new ref] refs/pull/2525/merge -> origin/pr/2525/merge
* [new ref] refs/pull/2526/head -> origin/pr/2526/head
* [new ref] refs/pull/2527/head -> origin/pr/2527/head
* [new ref] refs/pull/2527/merge -> origin/pr/2527/merge
* [new ref] refs/pull/2528/head -> origin/pr/2528/head
* [new ref] refs/pull/2528/merge -> origin/pr/2528/merge
* [new ref] refs/pull/2529/head -> origin/pr/2529/head
* [new ref] refs/pull/2529/merge -> origin/pr/2529/merge
* [new ref] refs/pull/2530/head -> origin/pr/2530/head
* [new ref] refs/pull/2530/merge -> origin/pr/2530/merge
* [new ref] refs/pull/2531/head -> origin/pr/2531/head
* [new ref] refs/pull/2531/merge -> origin/pr/2531/merge
* [new ref] refs/pull/2532/head -> origin/pr/2532/head
* [new ref] refs/pull/2532/merge -> origin/pr/2532/merge
* [new ref] refs/pull/2533/head -> origin/pr/2533/head
* [new ref] refs/pull/2533/merge -> origin/pr/2533/merge
* [new ref] refs/pull/2534/head -> origin/pr/2534/head
* [new ref] refs/pull/2534/merge -> origin/pr/2534/merge
* [new ref] refs/pull/2535/head -> origin/pr/2535/head
* [new ref] refs/pull/2535/merge -> origin/pr/2535/merge
* [new ref] refs/pull/2536/head -> origin/pr/2536/head
* [new ref] refs/pull/2536/merge -> origin/pr/2536/merge
* [new ref] refs/pull/2537/head -> origin/pr/2537/head
* [new ref] refs/pull/2537/merge -> origin/pr/2537/merge
* [new ref] refs/pull/2538/head -> origin/pr/2538/head
* [new ref] refs/pull/2538/merge -> origin/pr/2538/merge
* [new ref] refs/pull/2539/head -> origin/pr/2539/head
* [new ref] refs/pull/2539/merge -> origin/pr/2539/merge
* [new ref] refs/pull/2540/head -> origin/pr/2540/head
* [new ref] refs/pull/2540/merge -> origin/pr/2540/merge
* [new ref] refs/pull/2541/head -> origin/pr/2541/head
* [new ref] refs/pull/2541/merge -> origin/pr/2541/merge
* [new ref] refs/pull/2542/head -> origin/pr/2542/head
* [new ref] refs/pull/2542/merge -> origin/pr/2542/merge
* [new ref] refs/pull/2543/head -> origin/pr/2543/head
* [new ref] refs/pull/2543/merge -> origin/pr/2543/merge
* [new ref] refs/pull/2544/head -> origin/pr/2544/head
* [new ref] refs/pull/2544/merge -> origin/pr/2544/merge
* [new ref] refs/pull/2545/head -> origin/pr/2545/head
* [new ref] refs/pull/2545/merge -> origin/pr/2545/merge
* [new ref] refs/pull/2546/head -> origin/pr/2546/head
* [new ref] refs/pull/2546/merge -> origin/pr/2546/merge
* [new ref] refs/pull/2547/head -> origin/pr/2547/head
* [new ref] refs/pull/2547/merge -> origin/pr/2547/merge
* [new ref] refs/pull/2548/head -> origin/pr/2548/head
* [new ref] refs/pull/2548/merge -> origin/pr/2548/merge
* [new ref] refs/pull/2550/head -> origin/pr/2550/head
* [new ref] refs/pull/2550/merge -> origin/pr/2550/merge
Auto packing the repository for optimum performance. You may also
run "git gc" manually. See "git help gc" for more information.
warning: There are too many unreachable loose objects; run 'git prune' to remove them.
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1799)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1525)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:65)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:316)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor862.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy103.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision f7d727c0f7ada7a162f5cb73f658ce52f094dd86 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f f7d727c0f7ada7a162f5cb73f658ce52f094dd86
> git rev-list f7d727c0f7ada7a162f5cb73f658ce52f094dd86 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson441205929294293243.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5662280072032797148.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3937865616681008762.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson1921353125915777668.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-17 00:02:34,646 043c10b6 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/043c10b6/pkb.log
2017-04-17 00:02:34,646 043c10b6 MainThread INFO PerfKitBenchmarker version: v1.11.0-40-g1f4031b
2017-04-17 00:02:34,647 043c10b6 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-17 00:02:34,889 043c10b6 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-17 00:02:35,055 043c10b6 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-17 00:02:35,059 043c10b6 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-17 00:02:35,059 043c10b6 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-17 00:02:35,069 043c10b6 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-17 00:02:35,073 043c10b6 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-17 00:02:35,115 043c10b6 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-17 00:02:35,115 043c10b6 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/043c10b6/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #316
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/316/display/redirect>
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on beam5 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/>
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision f7d727c0f7ada7a162f5cb73f658ce52f094dd86 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f f7d727c0f7ada7a162f5cb73f658ce52f094dd86
> git rev-list f7d727c0f7ada7a162f5cb73f658ce52f094dd86 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson8832221214566515910.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5194141463253808259.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3254176213718755422.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4785452911665300387.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-16 18:00:32,774 32171fa7 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/32171fa7/pkb.log
2017-04-16 18:00:32,774 32171fa7 MainThread INFO PerfKitBenchmarker version: v1.11.0-40-g1f4031b
2017-04-16 18:00:32,775 32171fa7 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-16 18:00:33,051 32171fa7 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-16 18:00:33,135 32171fa7 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-16 18:00:33,137 32171fa7 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-16 18:00:33,138 32171fa7 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-16 18:00:33,142 32171fa7 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-16 18:00:33,144 32171fa7 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-16 18:00:33,170 32171fa7 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-16 18:00:33,171 32171fa7 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/32171fa7/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #315
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/315/display/redirect>
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on beam5 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/>
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision f7d727c0f7ada7a162f5cb73f658ce52f094dd86 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f f7d727c0f7ada7a162f5cb73f658ce52f094dd86
> git rev-list f7d727c0f7ada7a162f5cb73f658ce52f094dd86 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson1649851872837743095.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson7042953185599809301.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson7033487597033360959.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson6530248442843771628.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-16 12:44:07,682 dc8cbce5 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/dc8cbce5/pkb.log
2017-04-16 12:44:07,683 dc8cbce5 MainThread INFO PerfKitBenchmarker version: v1.11.0-40-g1f4031b
2017-04-16 12:44:07,683 dc8cbce5 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-16 12:44:07,843 dc8cbce5 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-16 12:44:07,922 dc8cbce5 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-16 12:44:07,925 dc8cbce5 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-16 12:44:07,925 dc8cbce5 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-16 12:44:07,929 dc8cbce5 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-16 12:44:07,931 dc8cbce5 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-16 12:44:07,959 dc8cbce5 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-16 12:44:07,959 dc8cbce5 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/dc8cbce5/pkb.log
Build step 'Execute shell' marked build as failure